Fix bug where partitioned tables would always return the wrong equali…

…ty in paths
Dear Gobblin maintainers,
Please accept this PR. I understand that it will not be reviewed until I have checked off all the steps below!
JIRA

[ ] My PR addresses the following Gobblin JIRA issues and references them in the PR title. For example, "[GOBBLIN-XXX] My Gobblin PR"

https://issues.apache.org/jira/browse/GOBBLIN-XXX

Description

[ ] Here are some details about my PR, including screenshots (if applicable):

Tests

[ ] My PR adds the following unit tests OR does not need testing for this extremely good reason:

Commits

[ ] My commits all reference JIRA issues in their subject lines, and I have squashed multiple commits if they address the same issue. In addition, my commits follow the guidelines from "How to write a good git commit message":

Subject is separated from body by a blank line
Subject is limited to 50 characters
Subject does not end with a period
Subject uses the imperative mood ("add", not "adding")
Body wraps at 72 characters
Body explains "what" and "why", not "how"

Codecov Report

Merging #3472 (5c3a90e) into master (91a2d1c) will decrease coverage by 3.21%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master    #3472      +/-   ##
============================================
- Coverage     46.63%   43.42%   -3.22%
+ Complexity    10360     2028    -8332
============================================
  Files          2076      405    -1671
  Lines         81037    17386   -63651
  Branches       9045     2124    -6921
============================================
- Hits          37795     7550   -30245
+ Misses        39764     8999   -30765
+ Partials       3478      837    -2641

Impacted Files
Coverage Δ

...a/org/apache/gobblin/util/limiter/NoopLimiter.java
40.00% <0.00%> (-20.00%)
:arrow_down:

...lin/util/filesystem/FileSystemInstrumentation.java
92.85% <0.00%> (-7.15%)
:arrow_down:

...in/java/org/apache/gobblin/cluster/HelixUtils.java
28.26% <0.00%> (-5.08%)
:arrow_down:

...main/java/org/apache/gobblin/util/HadoopUtils.java
30.26% <0.00%> (-0.33%)
:arrow_down:

...ata/management/copy/hive/HiveCopyEntityHelper.java

...ta/management/dataset/SimpleFileSystemDataset.java

...blin/compaction/mapreduce/RecordKeyMapperBase.java

...java/org/apache/gobblin/hive/HiveRegisterStep.java

...blin/qualitychecker/row/RowLevelPolicyChecker.java

...pache/gobblin/ingestion/google/DayPartitioner.java

... and 1666 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 91a2d1c...5c3a90e. Read the comment docs.


Update golangci-lint and fix issues

The version currently used is kinda old, so this bumps it and fixes an existing warning that was annoying me locally, while developing with a newer version 😅

Codecov Report

Merging #519 (b1edf37) into main (5787600) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #519   +/-   ##
=======================================
  Coverage   50.60%   50.60%
=======================================
  Files          41       41
  Lines        2051     2051
=======================================
  Hits         1038     1038
  Misses        838      838
  Partials      175      175

Impacted Files
Coverage Δ

pkg/commands/delete.go
44.44% <ø> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5787600...b1edf37. Read the comment docs.


CORTX-33288: Avoid redundant logs, improve log relevance.

Signed-off-by: Shriya Deshmukh<EMAIL_ADDRESS>Problem Statement

Avoid redundant logs, improve log relevance.

Design

For Bug, Describe the fix here.
For Feature, Post the link for design

Coding
Checklist for Author

[ ] Coding conventions are followed and code is consistent

Testing
Checklist for Author

[ ] Unit and System Tests are added
[ ] Test Cases cover Happy Path, Non-Happy Path and Scalability
[ ] Testing was performed with RPM

Impact Analysis
Checklist for Author/Reviewer/GateKeeper

[ ] Interface change (if any) are documented
[ ] Side effects on other features (deployment/upgrade)
[ ] Dependencies on other component(s)

Review Checklist
Checklist for Author

[ ] JIRA number/GitHub Issue added to PR
[ ] PR is self reviewed
[ ] Jira and state/status is updated and JIRA is updated with PR link
[ ] Check if the description is clear and explained

Documentation
Checklist for Author

[ ] Changes done to WIKI / Confluence page / Quick Start Guide

retest this please


[Builder.FullNodeFeature] System.OverflowException: Arithmetic operation resulted in an overflow

fail: Stratis.Bitcoin.Builder.FullNodeFeatureExecutor[0]
      An error occurred starting the application: System.AggregateException: One or more errors occurred. (Arithmetic operation resulted in an overflow.) ---> System.OverflowException: Arithmetic operation resulted in an overflow
         at DBreeze.Storage.FSR.Table_Read(Boolean useCache, Int64 offset, Int32 count)
         at DBreeze.LianaTrie.LTrieWriteCache.ReadKey(Boolean useCache, Byte[] pointer)
         at DBreeze.LianaTrie.Iterations.Backward.<ItBwd>d__10.MoveNext()
         at DBreeze.LianaTrie.Iterations.Backward.<ItBwd>d__10.MoveNext()
         at DBreeze.LianaTrie.Iterations.Backward.<ItBwd>d__10.MoveNext()
         at DBreeze.LianaTrie.Iterations.Backward.<IterateBackward>d__11.MoveNext()
         at DBreeze.Transactions.Transaction.<SelectBackward>d__80`2.MoveNext()
         at System.Linq.Enumerable.TryGetFirst[TSource](IEnumerable`1 source, Boolean& found)
         at System.Linq.Enumerable.FirstOrDefault[TSource](IEnumerable`1 source)
         at Stratis.Bitcoin.Features.Consensus.CoinViews.DBreezeCoinView.GetRewindIndex(Transaction transaction) in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin.Features.Consensus/CoinViews/DBreezeCoinView.cs:line 284
         at Stratis.Bitcoin.Features.Consensus.CoinViews.DBreezeCoinView.<Rewind>b__17_0() in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin.Features.Consensus/CoinViews/DBreezeCoinView.cs:line 301
         at System.Threading.Tasks.Task`1.InnerInvoke()
         at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
         at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot)
      --- End of stack trace from previous location where exception was thrown ---
         at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
         at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
         at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1.ConfiguredTaskAwaiter.GetResult()
         at Stratis.Bitcoin.Features.Consensus.CoinViews.CachedCoinView.<Rewind>d__34.MoveNext() in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin.Features.Consensus/CoinViews/CachedCoinView.cs:line 418
      --- End of stack trace from previous location where exception was thrown ---
         at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
         at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
         at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1.ConfiguredTaskAwaiter.GetResult()
         at Stratis.Bitcoin.Features.Consensus.ConsensusLoop.<StartAsync>d__36.MoveNext() in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin.Features.Consensus/ConsensusLoop.cs:line 234
      --- End of stack trace from previous location where exception was thrown ---
         at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
         at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
         at Stratis.Bitcoin.Features.Consensus.ConsensusFeature.Initialize() in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin.Features.Consensus/ConsensusFeature.cs:line 113
         at Stratis.Bitcoin.Builder.FullNodeFeatureExecutor.<>c.<Initialize>b__3_1(IFullNodeFeature service) in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin/Builder/FullNodeFeatureExecutor.cs:line 57
         at Stratis.Bitcoin.Builder.FullNodeFeatureExecutor.Execute(Action`1 callback, Boolean reverseOrder) in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin/Builder/FullNodeFeatureExecutor.cs:line 102
         --- End of inner exception stack trace ---
         at Stratis.Bitcoin.Builder.FullNodeFeatureExecutor.Execute(Action`1 callback, Boolean reverseOrder) in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin/Builder/FullNodeFeatureExecutor.cs:line 120
         at Stratis.Bitcoin.Builder.FullNodeFeatureExecutor.Initialize() in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin/Builder/FullNodeFeatureExecutor.cs:line 57
      ---> (Inner Exception #0) System.OverflowException: Arithmetic operation resulted in an overflow.
         at DBreeze.Storage.FSR.Table_Read(Boolean useCache, Int64 offset, Int32 count)
         at DBreeze.LianaTrie.LTrieWriteCache.ReadKey(Boolean useCache, Byte[] pointer)
         at DBreeze.LianaTrie.Iterations.Backward.<ItBwd>d__10.MoveNext()
         at DBreeze.LianaTrie.Iterations.Backward.<ItBwd>d__10.MoveNext()
         at DBreeze.LianaTrie.Iterations.Backward.<ItBwd>d__10.MoveNext()
         at DBreeze.LianaTrie.Iterations.Backward.<IterateBackward>d__11.MoveNext()
         at DBreeze.Transactions.Transaction.<SelectBackward>d__80`2.MoveNext()
         at System.Linq.Enumerable.TryGetFirst[TSource](IEnumerable`1 source, Boolean& found)
         at System.Linq.Enumerable.FirstOrDefault[TSource](IEnumerable`1 source)
         at Stratis.Bitcoin.Features.Consensus.CoinViews.DBreezeCoinView.GetRewindIndex(Transaction transaction) in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin.Features.Consensus/CoinViews/DBreezeCoinView.cs:line 284
         at Stratis.Bitcoin.Features.Consensus.CoinViews.DBreezeCoinView.<Rewind>b__17_0() in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin.Features.Consensus/CoinViews/DBreezeCoinView.cs:line 301
         at System.Threading.Tasks.Task`1.InnerInvoke()
         at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
         at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot)
      --- End of stack trace from previous location where exception was thrown ---
         at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
         at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
         at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1.ConfiguredTaskAwaiter.GetResult()
         at Stratis.Bitcoin.Features.Consensus.CoinViews.CachedCoinView.<Rewind>d__34.MoveNext() in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin.Features.Consensus/CoinViews/CachedCoinView.cs:line 418
      --- End of stack trace from previous location where exception was thrown ---
         at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
         at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
         at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1.ConfiguredTaskAwaiter.GetResult()
         at Stratis.Bitcoin.Features.Consensus.ConsensusLoop.<StartAsync>d__36.MoveNext() in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin.Features.Consensus/ConsensusLoop.cs:line 234
      --- End of stack trace from previous location where exception was thrown ---
         at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
         at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
         at Stratis.Bitcoin.Features.Consensus.ConsensusFeature.Initialize() in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin.Features.Consensus/ConsensusFeature.cs:line 113
         at Stratis.Bitcoin.Builder.FullNodeFeatureExecutor.<>c.<Initialize>b__3_1(IFullNodeFeature service) in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin/Builder/FullNodeFeatureExecutor.cs:line 57
         at Stratis.Bitcoin.Builder.FullNodeFeatureExecutor.Execute(Action`1 callback, Boolean reverseOrder) in /home/ader/coins/StratisBitcoinFullNode/src/Stratis.Bitcoin/Builder/FullNodeFeatureExecutor.cs:line 102<---

There was a problem initializing the node. Details: 'One or more errors occurred. (Arithmetic operation resulted in an overflow.)'
Application is shutting down...

Running StratisD on Testnet
LogFile: debug.txt

does it now occur to you every time you want to run this node?
if so, can you provide full data directory content?

at first glance, this looks very much like https://github.com/hhblaze/DBreeze/issues/1, which should have been fixed a long time ago, so possibly another similar issue?
it looks like it is not in our codebase, but if we want to ask hhblaze for help, we must be able to reproduce it

Closing this issue and #1006 per discussion with @Aprogiena that we've determined this to be most likely caused by a corruption in database files while transferring the datadir from a node running on a remote server using scp (secure copy). Steps that caused the problem:
Quoted from slack by @Aprogiena:

machine A: node runs, node closes normally (this I call run K-1)
transfer of data directory from machine A to machine B (using scp command from remote -> local machine)
machine B: run node, node crashes on this very bug (this I call run K)
further attempts to run node with this data dir on machine B fails
a new attempt to transfer data directory from A to B does not reproduce the problem after run


Replace alluxio.worker.memory.size with alluxio.worker.ramdisk.size

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-PR-Builder/10706/
Test PASSed.

@calvinjia @apc999 addressed comments, PTAL. Decided alias is probably the way to go for backcompat. Not removing the key

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-PR-Builder/10760/
Test PASSed.

Build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-PR-Builder/10817/
Test PASSed.

Build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-PR-Builder/10819/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-PR-Builder/10825/
Test PASSed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-PR-Builder/10838/
Test FAILed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-PR-Builder/10840/
Test PASSed.

alluxio-bot, merge this please


Solidity locals sometimes are not shown when debugging inside internal functions

When debugging a function which makes a call to an internal function then still the caller function's local variables shown.
It should show the local variables in the step's context.
With some contracts it shows with some it's not. I can't to figure out how to reproduce it

fix https://github.com/ethereum/remix/pull/562

Hello. Unfortunately, this issue still persists
http://remix.ethereum.org/#optimize=true&version=soljson-v0.4.25+commit.59dbf8f1.js


Adds Vector2 __mul and __div

Fixes #197

Coverage increased (+0.01%) to 98.034% when pulling 2a9331c05513466df06773f89b9ed728785a6c9b on froghopperjacob:vector2-mul,div into a69e24573aac6104d0f071e8c6d7583dd2dfae1b on LPGhatguy:master.

Thanks a bunch!


NVIDIA TX2+jetpack 5+Ubuntu20.4：No matching distribution found for bitsandbytes==0.43.0

System Info
cuda                           11.8
asn1crypto                0.24.0                   py37_0    c4aarch64
bzip2                     1.0.6                h7b6447c_6    c4aarch64
ca-certificates           2018.03.07                    0    c4aarch64
certifi                   2018.10.15               py37_0    c4aarch64
cffi                      1.11.5           py37hc365091_1    c4aarch64
chardet                   3.0.4                    py37_1    c4aarch64
conda                     4.5.12                   py37_0    c4aarch64
conda-env                 2.6.0                         1    c4aarch64
cryptography              2.5              py37h9d9f1b6_1    conda-forge
filelock                  3.12.2
fsspec                    2023.1.0
huggingface-hub           0.16.4
idna                      2.7                      py37_0    c4aarch64
importlib-metadata        6.7.0
libffi                    3.2.1                h71b71f5_5    c4aarch64
libgcc-ng                 7.3.0                h5c90dd9_0    c4aarch64
libstdcxx-ng              7.3.0                h5c90dd9_0    c4aarch64
ncurses                   6.1                  h71b71f5_0    c4aarch64
numpy                     1.21.6
openssl                   1.1.1a            h14c3975_1000    conda-forge
packaging                 24.0
pip                       24.0
pip                       10.0.1                   py37_0    c4aarch64
pycosat                   0.6.3            py37h7b6447c_0    c4aarch64
pycparser                 2.19                     py37_0    c4aarch64
pyopenssl                 18.0.0                   py37_0    c4aarch64
pysocks                   1.6.8                    py37_0    c4aarch64
python                    3.7.1             h39be038_1002    conda-forge
PyYAML                    6.0.1
readline                  7.0                  h7ce4240_5    c4aarch64
regex                     2023.12.25
requests                  2.19.1                   py37_0    c4aarch64
ruamel_yaml               0.15.64          py37h7b6447c_0    c4aarch64
safetensors               0.4.2
setuptools                40.4.3                   py37_0    c4aarch64
six                       1.11.0                   py37_1    c4aarch64
sqlite                    3.26.0            h1a3e907_1000    conda-forge
tk                        8.6.9             h84994c4_1000    conda-forge
tokenizers                0.13.3
torch                     1.13.1
tqdm                      4.66.2
transformers              4.30.2
typing_extensions         4.7.1
urllib3                   1.23                     py37_0    c4aarch64
wheel                     0.32.1                   py37_0    c4aarch64
xz                        5.2.4                h7ce4240_4    c4aarch64
yaml                      0.1.7                h7ce4240_3    c4aarch64
zipp                      3.15.0
zlib                      1.2.11               h7b6447c_2    c4aarch64
Reproduction
ERROR: Could not find a version that satisfies the requirement bitsandbytes==0.43.0 (from versions: 0.31.8, 0.32.0, 0.32.1, 0.32.2, 0.32.3, 0.33.0, 0.33.1, 0.34.0, 0.35.0, 0.35.1, 0.35.2, 0.35.3, 0.35.4, 0.36.0, 0.36.0.post1, 0.36.0.post2, 0.37.0, 0.37.1, 0.37.2, 0.38.0, 0.38.0.post1, 0.38.0.post2, 0.38.1, 0.39.0, 0.39.1, 0.40.0, 0.40.0.post1, 0.40.0.post2, 0.40.0.post3, 0.40.0.post4, 0.40.1, 0.40.1.post1, 0.40.2, 0.41.0, 0.41.1, 0.41.2, 0.41.2.post1, 0.41.2.post2, 0.41.3, 0.41.3.post1, 0.41.3.post2, 0.42.0)
ERROR: No matching distribution found for bitsandbytes==0.43.0
Expected behavior
@kashif @stephenroller @akx @jbn @why i can not get the latest version bitsandbytes

Hi @qxpBlog,
bitsandbytes is not currently built with support for aarch64 platforms. Releases prior to 0.43.0 to PyPI were tagged as supporting all platforms, but moving forward the wheels are tagged appropriately for the platforms they support. As of right now, that is just Windows and Linux on x86-64.
You can follow #997 for more information on plans to support additional platforms.

嗨，
bitsandbytes当前不支持 aarch64 平台。PyPI 的 0.43.0 之前的版本被标记为支持所有平台，但今后轮子会针对它们支持的平台进行适当的标记。截至目前，这只是 x86-64 上的 Windows 和 Linux。
您可以关注 #997 以获取有关支持其他平台的计划的更多信息。

thanks for your help.

I had the same issue of bitandbytes 0.42.0 being available, but not 0.43+ on RHEL 7 (centOS 7 and other older distros should also be affected):
The pip release of bitsandbytes 0.43.0+ requires glibc 0.24+, while some older distros don't have it. You can verify by running: ldd --version
If you run into this issue, you can either use the conda-forge instead (supports glibc 2.17+) or build from source.


PowerToys Run  more time/date settings

Description of the new feature / enhancement
Enable / Disable particular time display settings, add more time seeings (YYYY-MM-DD - helps making file backups and sorting them by name) because of the opportunity to add more time formats by the reduced number of search results
Scenario when this would be used?
Everytime someone tries to select date/time to copy. Selecting only 2 formats (HH-MM and DD-MM-YYYY) will reduce all the browsing through dozens of date and time formats
Supporting information
It can be simply toggle switch at every time format, or a dropdown selection

@htcfreek Maybe I'm missing something here but it doesn't seem like the "Time and Date" plugin allows for manual entry of a date/time pattern.
If I search for ) yy mmm dd - HH:mm I don't get any results. Is that the intended behavior?

@htcfreek Maybe I'm missing something here but it doesn't seem like the "Time and Date" plugin allows for manual entry of a date/time pattern.

Custom formsts are not supported yet. (#16934)

If I search for ) yy mmm dd - HH:mm I don't get any results. Is that the intended behavior?

Did you try yy-mm-dd as format name?

/dup #16934

Custom formats are not supported yet. (#16934)
Sweet, but you are working on it! 🎉

No I don't work on it. If you have an idea how it can be implemented feel free to open a PR.


Add gpu capacity and allocatable

init gpu capacity and allocatable
mount /tmp/nvidia-mps into container

/cc @pendoragon

/lgtm

/release-note-none


Renamed loop and dd

Using loop and dd was causing compilation issues on MacOS as they are names already used by NASM for other things, I have renamed them to lp and zz respectively to fix this issue.

Thanks.


[SAC-94] Fix df.write.saveAsTable to be correctly logged to Atlas (atlas-1.1)

What changes were proposed in this pull request?
This patch fixes the bug which doesn't register entities to Atlas for below query:
val df = spark.read.csv("abc.csv")
df.write.saveAsTable("app_details_spark_2_3")

After applying the patch, SAC correctly registers Atlas entities: spark_process, spark_db, spark_table, fs_path.
How was this patch tested?

Added UT
Manually verified with Atlas 1.1 (local HBase, local Solr) & Spark 2.3

This patch is closer to #95 but raising another pull request due to small conflicts.

Same outputs are provided (lineage, entities, etc.)

It's the same. It's okay for you to proceed if UT passes and you verified manually.

Please backport this accordingly.


CI fails after huggingface_hub-0.23.0 release: FutureWarning: "resume_download"

CI fails after latest huggingface_hub-0.23.0 release: https://github.com/huggingface/huggingface_hub/releases/tag/v0.23.0
FAILED tests/test_metric_common.py::LocalMetricTest::test_load_metric_bertscore - FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
FAILED tests/test_metric_common.py::LocalMetricTest::test_load_metric_frugalscore - FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
FAILED tests/test_metric_common.py::LocalMetricTest::test_load_metric_perplexity - FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
FAILED tests/test_fingerprint.py::TokenizersHashTest::test_hash_tokenizer - FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
FAILED tests/test_fingerprint.py::TokenizersHashTest::test_hash_tokenizer_with_cache - FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
FAILED tests/test_arrow_dataset.py::MiscellaneousDatasetTest::test_set_format_encode - FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.

See:

https://github.com/huggingface/transformers/issues/30618


Creating nested attributes

A while ago this library had a NlAttrHdr::new_nested() function but it seems to be removed.
Is there an alternative function to create nested attributes?

Hi @manuels, as you noticed, there were some breaking changes in v0.4.0. As I was unable to release the version due to a libc PR, I am open to including some changes before release. I think the issue here boils down to the way Genlmsghdr attributes are structured, is that correct? Genlmsghdrs require a vector of attributes which now cannot easily be created as nested attributes. If this is indeed the problem you're referring to, it's oversight on my part and I can add that function in again as deserializing attributes was given more attention during this release process than serializing. Does that sound good?

Hi @manuels, after reviewing my changes I realized that there is already a new way to do this. I originally thought there was but got tripped up by the type impls before writing my previous comment. I've uploaded an example of how to do this moving forward in the examples/ directory. The code is in the file create-nested-attributes.rs. I'm going to close this but please comment back and I'll reopen if you run into any issues.

Thanks, I'll give it a try.

No problem. Please do post back here if you run into type checking issues. Given vectors cannot have heterogeneous types, I can make some changes to some of the type definitions to allow heterogeneous trait object-based vectors if necessary. I do think this should work though as vectors of attributes should all have the same type for both the payload and type fields of the struct.

Hi @jbaublitz, I gave it a try, but nesting like this does not work:
        let attrs = vec![
            Nlattr::new(None, 1, vec![
                Nlattr::new(None, 1, "this_family"),
                Nlattr::new(None, 2, 0), // <-- expected &str, found integer !!!
            ]),
            Nlattr::new(None, 2, vec![
                Nlattr::new(None, 1, "this_family"),
                Nlattr::new(None, 2, 0),
            ])
        ];

(I want to communicate to wireguard: https://github.com/WireGuard/WireGuard/blob/master/src/uapi/wireguard.h#L32)

Reopening. I'll see what I can do to fix this and will push v0.4.1 once you've confirmed that you're able to create attributes without an error. For now, you can serialize attributes one by one into a buffer, but that is definitely not the workflow I want to provide for vectors of attributes moving forward.

@manuels I have pushed a method to master and updated examples/ to explain the two ways to do this, one for heterogeneous vectors and one for homogeneous vectors. Both are now possible. Please give that a try and let me know if I should do additional work before releasing v0.4.1.

@jbaublitz, the new function looks great. The only problem that I am facing right now is that this does not work for Nlmsghdr.
        let mut p = Nlattr::new(None, 0, vec![]);
        p.add_nested_attribute(Nlattr::new(None, WGPEER_A_PUBLIC_KEY, key.to_vec()))?;
        p.add_nested_attribute(Nlattr::new(None, WGPEER_A_FLAGS, 0))?;
        p.add_nested_attribute(Nlattr::new(None, WGPEER_A_ENDPOINT, addr))?;

        let mut peers = Nlattr::new(None, WGDEVICE_A_PEERS, vec![]);
        peers.add_nested_attribute(p)?;

        let attrs = vec![
            Nlattr::new(None, WGDEVICE_A_IFINDEX, ifindex),
            Nlattr::new(None, WGDEVICE_A_FLAGS, 0),
            peers, // <-- expected u32, found struct `std::vec::Vec`
        ];
        let genlhdr = Genlmsghdr::new(WG_CMD_SET_DEVICE, self.version, attrs)?;
        let nlhdr = Nlmsghdr::new(None, self.family_id, vec![Request, Ack], None, None, genlhdr);

Maybe Nlattr could implement neli::nlattr::Nlattr<_, std::vec::Vec<u8>> for any payload type, so you could do
        let attrs = vec![
            Nlattr::new(None, WGDEVICE_A_IFINDEX, ifindex).into(),
            Nlattr::new(None, WGDEVICE_A_FLAGS, 0).into(),
            peers.into(),
        ];

@manuels Thanks for letting me know about this. This is indeed not ideal from a usability perspective. There are work-arounds for this but what I'd prefer to do is rethink Nlattr just a little bit. My instinct is to do the following:

Leave .add_nested_attribute() as is with a bug fix for the missing needed additional type parameter
Add .set_payload() to allow on Nlattr<T, Vec<u8>> to essentially serialize payloads immediately on invocation as opposed to delaying serializing the entire data structure at the end
Change Nlattr::new() to only be available when Nlattr<T, Vec<u8>> is used and have ::new() call .set_payload() internally
Change Genlmsghdr slightly to only accept attributes that have payloads represented as Vec<u8>

This is a relatively invasive change that is a result of me trying to support too many options for attribute parsing so I'm going to release this as 0.4.0-r1 as I do not think the previous way of doing things is a very good idea after thinking more on the use case you've presented. While I will leave the option to construct Nlattr<T, P>-typed attributes, I definitely want to push generic attribute parsing more in the direction of one way to construct vectors of attributes adhering more to a builder pattern.
I updated the examples to reflect the proposed way of handling this - please let me know if what I push to master is adequate for your use case. If so, I will release.

Just a note that I considered the idea of using the Into trait and appreciate the suggestion but it didn't seem quite as straightforward and I personally think this will make the learning curve slightly less steep for new users. I think one type of approach (more of a builder pattern here) will make it slightly more transparent while also at least providing some type safety up front at the attribute top level by parsing Nlattrs into a vector and providing payloads as bytes for further manipulation if needed. Let me know if you have any additional feedback and if the current way of doing things suits your needs.

Hi @jbaublitz, the new functionality looks good so far. Thanks!


feat: add experimental signInWithIdToken for Apple, Google

Adds signInWithIdToken as experimental. This brings back the ID token login flow for Sign in with Apple and Sign in with Google for iOS and Android apps.
It's marked as experimental since there are some known issues with this endpoint, but we do realize the importance of having this method available as Sign in with Apple is mandatory on iOS devices.

When using this endpoint, I'm getting a  502Bad Gateway response. Has this been verified to worK?

Been working on integrating Apple and seeing this 502 gateway error as well.
I've reached out to<EMAIL_ADDRESS>yesterday regarding this issue, so hopefully someone can look into what's causing this.

@jaytxng I'm emailing someone from support back and forth about this. The way I was originally Signing in with Apple and Google failed due to server changes. I'm trying this out and yeah I'm getting the 502

Also: please don't merge this in without making sure it works
https://github.com/supabase/gotrue/pull/927

Hi @DanMossa we haven't merged this in yet because the gotrue version on the Supabase platform is still on v2.40.1, which doesn't contain the changes in supabase/gotrue#927.

@DanMossa heads up, I'm no longer seeing that 502 error anymore 😄

@DanMossa heads up, I'm no longer seeing that 502 error anymore 😄

Yup! After talking to support they disabled the endpoint. They just had to re enable it!

Hi All - thanks for bringing this back. I've been trying to get it working with google auth and getting an error Passed nonce and nonce in id_token should either both exist or not. Is this expected to work with google?

Hi All - thanks for bringing this back. I've been trying to get it working with google auth and getting an error Passed nonce and nonce in id_token should either both exist or not. Is this expected to work with google?

Yup! I'm using it now. Are you passing a nonce when using Sign in with Google?
Does the JWT token you get from Google contain a nonce?

Thanks for the reply! I didn't actually realize the id token was a JWT but
it looks like it does actually contain one - does that mean on the client I
should decode the JWT then pass that nonce into the argument? I had
(obviously incorrectly) assumed that the nonce would be in payload response.
On Sat, Feb 25, 2023 at 9:51 PM Daniel Mossaband @.***>
wrote:

Hi All - thanks for bringing this back. I've been trying to get it working
with google auth and getting an error Passed nonce and nonce in id_token
should either both exist or not. Is this expected to work with google?
Yup! I'm using it now. Are you passing a nonce when using Sign in with
Google?
Does the JWT token you get from Google contain a nonce?
—
Reply to this email directly, view it on GitHub
https://github.com/supabase/gotrue-js/pull/603#issuecomment-1445254997,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AADFWNFPWLQLHVAYXUMOYRDWZLAL5ANCNFSM6AAAAAAUPHQPM4
.
You are receiving this because you commented.Message ID:
@.***>

Update: I tried pulling the nonce out of the JWT manually and passing it in
the nonce arg but now getting an "Invalid nonce" error 🤦♂
On Sat, Feb 25, 2023 at 9:57 PM John Ryan @.***> wrote:

Thanks for the reply! I didn't actually realize the id token was a JWT but
it looks like it does actually contain one - does that mean on the client I
should decode the JWT then pass that nonce into the argument? I had
(obviously incorrectly) assumed that the nonce would be in payload response.
On Sat, Feb 25, 2023 at 9:51 PM Daniel Mossaband @.***>
wrote:

Hi All - thanks for bringing this back. I've been trying to get it
working with google auth and getting an error Passed nonce and nonce in
id_token should either both exist or not. Is this expected to work with
google?
Yup! I'm using it now. Are you passing a nonce when using Sign in with
Google?
Does the JWT token you get from Google contain a nonce?
—
Reply to this email directly, view it on GitHub
https://github.com/supabase/gotrue-js/pull/603#issuecomment-1445254997,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AADFWNFPWLQLHVAYXUMOYRDWZLAL5ANCNFSM6AAAAAAUPHQPM4
.
You are receiving this because you commented.Message ID:
@.***>

I am having the same issue: Passed nonce and nonce in id_token should either both exist or not. I am using this one https://github.com/CodetrixStudio/CapacitorGoogleAuth and get something like this:
 authentication: {
			refreshToken:
				'1//06VJKB6bMT0oXCgYIARAAGAYSNwF-L9IrRWKTodx0Ir_PQvMUhB3YMFYVzXfY2utSgB2JkkqGxrUBpgozIcIPg0mtCqnv0DiR2nw',
			idToken:
				'eyJhbGciOiJSUzI1NiIsImtpZCI6IjYwODNkZDU5ODE2NzNmNjYxZmRlOWRhZTY0NmI2ZjAzODBhMDE0NWMiLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwczovL2FjY291bnRzLmdvb2dsZS5jb20iLCJhenAiOiI3NDUxODY3NTM2MTMtaGI1N3MwZDNhaXZsYmVmdTNtcmVpbGU4c3N1cjdpNnMuYXBwcy5nb29nbGV1c2VyY29udGVudC5jb20iLCJhdWQiOiI3NDUxODY3NTM2MTMtZ2g4bmtvM28xbmRhbzMwcHZ2OGhqNnRrdjE5dnM1N2EuYXBwcy5nb29nbGV1c2VyY29udGVudC5jb20iLCJzdWIiOiIxMDAyNjU0ODQ0NzU5Nzk4NzU4MzgiLCJlbWFpbCI6Imxhb3RhbGFAZ21haWwuY29tIiwiZW1haWxfdmVyaWZpZWQiOnRydWUsImF0X2hhc2giOiI4YlNZU0V2QVY4X2M3VnRHM2gyR0NnIiwibm9uY2UiOiJEZjFoOG5zWmJQQWYzVzlDVW54M0lwMkV4VjZrR1M3LVhhUmRsNGt1YXVRIiwibmFtZSI6Ikxhc2lmdSBUYSIsInBpY3R1cmUiOiJodHRwczovL2xoMy5nb29nbGV1c2VyY29udGVudC5jb20vYS9BQWNIVHRkVGUyT2Vmem1kYk1xa0tlVXUxT3dLd1UxcTdMNkJSZENLaENYS1FnPXM5Ni1jIiwiZ2l2ZW5fbmFtZSI6Ikxhc2lmdSIsImZhbWlseV9uYW1lIjoiVGEiLCJsb2NhbGUiOiJlbiIsImlhdCI6MTY4NTY3OTc2NCwiZXhwIjoxNjg1NjgzMzY0fQ.qpn4hzQ-3PCF6h2-_y7K1qZ86bIDYY0gRigzp8sLuBsgXdjzjJIExA7xHGvOaYasF1rARtRU3FZxCtZXpgZwTkB5fJpyEwXLyxwwYk-NkicoO0_-j35Ipc-63QwH9B5J5Ce6zT9oB1b89lX4O0SH8BiQAXqhMpNHGl5mUXdZE-z8nWr5mcSHpodha392FQa93Bn7jXhK0rgfG-OK5jbtVegSNfVaLH2j9cp69oSbuqBE_9xQ2KdnGO_-tl1jBneIUKM7QAqSOrjM3bvZ1OtlC5Rx5m37ixz9BpgQlxhtcbYSaJSqBqKf3flqnNi_YDR_fP70-m1Vok5zUJUbGMT__w',
			accessToken:
				'ya29.a0AWY7CknAaGYidqUpcPn21IPgDiQTXhvaeSY7-o-dmMCKqDS2SzJYuJqqROS9zoWPTYUrAAlU-EIrLVKecCwzr3AnoBCZtIq7RlnCRyYPqpE4axhmDA8dBXTI9K7Nds7jnu2lNar-kQ9OiYvDXRK9qxOkxrQKaCgYKAcgSARASFQG1tDrpBQeWhVP8WqsXla9KvS0UTw0163'
		}

When I pass the Idtoken to signInWithIdToken I get error: Passed nonce and nonce in id_token should either both exist or not

Hi the same error Passed nonce and nonce in id_token should either both exist or not.
@laotala828  how you  decode  nonce in id token ?

Has anyone been able to get around the Passed nonce and nonce in id_token should either both exist or not issue?
Currently using react-native-google-signin/google-signin to retrieve the id token and passing it to supabase.auth.signInWithIdToken returns this error.

Has anyone been able to get around the Passed nonce and nonce in id_token should either both exist or not issue?
Currently using react-native-google-signin/google-signin to retrieve the id token and passing it to supabase.auth.signInWithIdToken returns this error.
Edit: Parsing the nonce from the id token and including it with signInWithIdToken produces the error Nonces mismatch.

Hey @robertn702 I did not solve this problem, but I do have a solution to allow user to Oauth log in on iOS. Previously I used React Native and now I am using Capacitorjs, it works for both. For RN you use the Linking feature, and for Capacitor you use the appUrlOpen event on App. Basically you ask users to open the gotrue endpoint url in browser, for example:
${SUPABASE_URL}/auth/v1/authorizeprovider=google&redirect_to=${SIGN_IN_CALL_BACK}&access_type=offline&prompt=consent
You can set SIGN_IN_CALL_BACK as the URL scheme of you app, for example com.my.app://logincallback and set the URL scheme for your ios app. Easy tutorial here.
Then after users signing in or up using google oauth, they will be redirected to your app, and you will get a string url like this com.my.app://logincallback#access_token=....&refresh_token=.... Replace # with a ? and turn the string url into an real URL object, you can easily get the access_token and refresh_token.
const url_string = url.replace('${SIGN_IN_CALL_BACK}#', '${SIGN_IN_CALL_BACK}?'); 			const new_url = new URL(url_string); 			const refresh_token = new_url.searchParams.get('refresh_token'); 			const access_token = new_url.searchParams.get('access_token');
Finally you call the seSession function and you will get the info you need and log users in.
const session_result = await supabase.auth.setSession({ 					access_token, 					refresh_token 				});

@laotala828 how were you able to set the redirect url correctly? In supabase I have a web redirect url and in google cloud I can't add an app specific url scheme since google enforces to create a dedicated iOS client secret.


Windows and Linux Binaries has different outputs

Hi,
I am working with Windows and Linux binaries (version 2.2.0). I took windows binaries from the "releases" section in this web page. After downloading I installed all the necesary ifortran libraries as described in the docs. For the Linux binaries I dowloaded the source code in assests section for the same version than windows binaries and then I compiled them using GNU compilers (version 6.3.0) on a Ubuntu 18.04. For linear algebra, I am using  OpenBLAS-0.2.19-LAPACK-3.7.0. There was no compiling errors or warnings.
For the Linux binaries, I run the test suite coming with OpenFAST as indicated in the docs. The results from the test suite are OK, as I discussed with Jason in OpenFAST forum.
I am currently working on a project in which we need to compare Windows and Linux results due to operative reasons of the project. The point is that we started to see that Windows and Linux binaries generates outputs which differs significatively in between them. The case in which I am currently working is wind turbine deacay of a 15M wind turbine desgined by NREL. The wind turbine (which is in onshore conditions) has an initial rotational speed of 9,6 rpm and has not input wind (still condition). There is no controller activated. In this conditions the rotational speed of the rotor should decay due to air drag forces. When, I do the compartive in between both results, I see that the rotational speed is falling down in both cases but in a different rate and seems to converge to a different value. Also, It is possible to see big differences in the thrust generated by the wind turbine. Windows binaries seems to behave correctly as they are generating a bigger thrust and moment when the rpms are higher. In the image below, I show this comparative.

I attach to you a folder with my input files. Inside of it, threre is two folders: shared (wind turbine data and common cases data) and wind_turbine_decay (case specific input files).
input_files.zip
Thanks in advance,
Best Regards,
Sergio

Dear Sergio,
As we discussed on the forum, I would generally expect the OpenFAST to give very similar results for this free-decay test when compiled with the same source code on different compilers and run on different platforms.  Thanks for providing additional information on the issue.
Can you confirm a couple things?:

I want to confirm that the results are numerically converged in both versions.  Are you using the same compiled precision (single / double) in both versions?  Are the results essentially the same if you drop the time step (DT < 0.01 s) or add a correction step (NumCrctn > 0)?

The BEM (WakeMod = 1) and unsteady airfoil aerodynamic models (AFAeroMod = 2) where developed to function best for an operational rotor, and may not work as well for cases with a parked or idling rotor.  Do the results differ between both versions if you disable the wake (WakeMod = 0) and unsteady airfoil aerodynamic effects (AFAeroMod = 1)?

For others following this issue, please note that this issue was discussed previously on our forum (and so, additional background information on the issue is provided there)--see the posts starting on Jul 01, 2020 in the following forum topic: https://wind.nrel.gov/forum/wind/viewtopic.php?f=4&t=642&start=225.
Best regards,

Dear Jason,
I have done the tests you requested. The big difference in between Windows and Linux versions was coming from the single/double precision. I did a mistake and I was pointing to the OpenFAST single precision solver in my windows launching bat files. So now, differences are quite small in between Windows and Linux.

On the other hand, I have done another test using the most suitable aerodynamic models as you said (WakeMod=0 and AFAeroMod=1). I have found that aerodynamic transient response is sensitive to single/double precision solvers even when the correct aerodynamics models are set up. Also, I have run an inflow wind staircase with the appropiate input set up for inflow velocities and I have found some differences in between single and double precision.
As a general rule, could we say that is better to use double precision solver when transients effects are important and remain single precision solver for steady aerodynamics? I am asking that because the performance difference in between single/double precision solvers is significative, at least for my computer, so we would like to take advantage of that when it is possible.
Thank you very much for your help
Best Rergards,
Sergio

Dear Sergio,
OK, thanks for clarifying.  So, it appears that the use of single versus double precision was the source of the difference.  These differences arise because the DEFAULT tolerance used in the BEM solution (as a result of IndToler = "Default") differ between the single and double precision compilations--this is documented in the AeroDyn documentation--see: https://openfast.readthedocs.io/en/master/source/user/aerodyn/input.html#aerodyn-primary-input-file.
From my experience, single precision is suitable for all engineering applications (load case simulations).  As you pointed out, single precision is much faster than double precision and generally accurate enough.  Even when compiling in single precision, we've stored the variables that have been demonstrated to require double precision (for accuracy / numerics) in double precision anyway.   In your case, the aerodynamic models used were not really intended for shutdown situations and it appears that their solution in this case is sensitive to the precision of the solve.  This may point to improvements that could be made to the solve to improve their numerics in cases beyond their originally intended application.  Simply overriding the default tolerance may achieve similar results.
Best regards,

Dear Jason,
I am not a wind turbine specialist but I have experience with BEM methods in hydrodynamics. To be honest, I was surprised that single/double precision had such an influence in the results when the solver is based on potential flow and we are calculating fluid loads (at least from my experience in hydrodynamics). Your explanation makes sense for me, now everything is clear. So, if you want we can close the issue as there is no problem with OpenFAST.
Many Thanks
Best Regards,
Sergio

Hi everyone,
Can anyone of you help me to find the right link to download  ifort (IFORT) 2021.8.0 20221119 for windows 11.
Thanks in advance.


"field must be a number" when creating queue/topic entity

Hello,
I noticed in the newer versions when creating a messaging entity like queue or topic, and not filling in all of the fields it cannot create due to validation "The X value of the X field must be a number". It seems it was a good approach to default to 0 when a value is not provided. But perhaps there is some thought behind adding this validation ? It's not an issue, but just a small inconvenience :)
Tomasz

Hi,
I just tested to create a queue and a topic and both worked as long as I put anything in the Relative URI textbox. For a short while this didn't work but I don't think that was released.
Have you tried the latest version? There were some versions released where it shows the latest released version in the About box even though the actual version is not that version.

I just downloaded latest version, yet this is occurring:

other issue I think worked earlier is when I have a queue with "session" enabled, I'm not able to view the messages due to:
<20:49:47> The queue abc has been successfully created.
<20:49:55> Exception: It is not possible for an entity that requires sessions to create a non-sessionful message receiver. TrackingId:d18faf83-a76e-45fa-b305-fd2b61e0be1a_G1_B0, SystemTracker:abcdefg123:Queue:abc, Timestamp:2021-05-19T18:49:54
<20:49:55> InnerException: It is not possible for an entity that requires sessions to create a non-sessionful message receiver. TrackingId:d18faf83-a76e-45fa-b305-fd2b61e0be1a_G1_B0, SystemTracker:abcdefg123:Queue:abc, Timestamp:2021-05-19T18:49:54
but that's another thing, perhaps I could create another case

Ok, just took a look at the code in TimeSpanControl and it seems that it's by design that all of the particular fields are being validated, so perhaps need to just live with it and always put zeroes in the empty fields :)

Hmm, strange. Are you able to create a queue just by filling in the Relative URI field and then clicking Create?
Please create another issue for the session problem.

yeah, if there is just Relative URI then it creates it with all defaults, but if just any number is put in any of fields like I would like 1 minute lock timeout, then it fails the validation, since other "empty" fields need to be filled with zeroes

I see.
@Greybird, it would be great if you looked into how this could be fixed.

@ErikMogensen sure, will take à look !


Crossref support

Hi guys
Added support for Crossref.
Out of the box it shouldn't break any original behavior, but also add an ability to use Crossref instead of DataCite.
Please review this and let me know if any adjustments are needed to be done.
Also updated the DB table initialization to use more modern CKAN way using migrations.

Hi @alycejenni , ok, I will adjust the code and write test for this.


User Defined Cache directory

Would it be possible to add an option to allow the user to define the location of the cache directory?

Hi archey,
Sorry about the late reply. I've just committed an implementation of your suggestion - could you please test it and see if it works for you?

@jekyc  looks good let me pull it down and test it and Il let you know

@jekyc works great thanks for the fix


Grunt Watch doesn't trigger until terminal has focus

I have a grunt watch task that seems to be working with other devs on my team, and for the most part works for me. HOWEVER it only seems trigger when I click into the terminal containing the grunt task (giving the terminal window the OS window focus). The IDE losing focus is not an issue as I've clicked into a browser window and it still did not trigger.
In case it matters, I'm using OSX (Mavericks), IntelliJ IDEA 13.1.6 (also watching files to be placed on our dev server), Grunt 0.4.5, and grunt-contrib-watch 0.6.1.

Same here, Ubuntu 16.04

Same here on Ubuntu 17.04, running grunt default through npm, with the command start associated with grunt default in `package.json, like so:
"scripts": {
    ...
    "start": "grunt default",
    ...
  },

Terminal: urxvt-256
Window manager: i3-gaps

Same here and massively painful. Has anyone found a workaround?

Ubuntu 16.04 LTS and issue still exists. I have to run grunt tasks manually every time I change something.


Add Kyuubi version in UI

Why are the changes needed?

Help to get the Kyuubi version.
How was this patch tested?

Codecov Report

Merging #1508 (d256766) into master (339fa76) will decrease coverage by 0.00%.
The diff coverage is 100.00%.

@@             Coverage Diff              @@
##             master    #1508      +/-   ##
============================================
- Coverage     59.40%   59.39%   -0.01%
  Complexity      172      172
============================================
  Files           237      237
  Lines         12168    12172       +4
  Branches       1492     1492
============================================
+ Hits           7228     7230       +2
- Misses         4330     4331       +1
- Partials        610      611       +1

Impacted Files
Coverage Δ

...rc/main/scala/org/apache/spark/ui/EnginePage.scala
80.19% <100.00%> (+0.25%)
:arrow_up:

...he/kyuubi/engine/spark/repl/KyuubiSparkILoop.scala
88.88% <0.00%> (-3.71%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 339fa76...d256766. Read the comment docs.

thanks, merging to master


HeaderNotFoundError

Using linux mint and Python 3.5.2
No Sugar Tonight / New Mother Nature already has tags
Relax already has tags
Love Runs Out already has tags
Traceback (most recent call last):
  File "/usr/local/bin/musicrepair", line 9, in <module>
    load_entry_point('musicrepair==4.3', 'console_scripts', 'musicrepair')()
  File "/usr/local/lib/python3.5/dist-packages/musicrepair/command_line.py", line 324, in main
    fix_music(optional_arg)
  File "/usr/local/lib/python3.5/dist-packages/musicrepair/command_line.py", line 232, in fix_music
    tags = File(file_name)
  File "/usr/local/lib/python3.5/dist-packages/mutagen/_util.py", line 131, in wrapper_func
    return func(h, *args, **kwargs)
  File "/usr/local/lib/python3.5/dist-packages/mutagen/_file.py", line 295, in File
    return Kind(fileobj, filename=filething.filename)
  File "/usr/local/lib/python3.5/dist-packages/mutagen/_file.py", line 48, in __init__
    self.load(*args, **kwargs)
  File "/usr/local/lib/python3.5/dist-packages/mutagen/_util.py", line 123, in wrapper
    return func(self, h, *args, **kwargs)
  File "/usr/local/lib/python3.5/dist-packages/mutagen/id3/_file.py", line 406, in load
    self.info = self._Info(fileobj, offset)
  File "/usr/local/lib/python3.5/dist-packages/mutagen/_util.py", line 152, in wrapper
    return func(*args, **kwargs)
  File "/usr/local/lib/python3.5/dist-packages/mutagen/mp3/__init__.py", line 387, in __init__
    raise HeaderNotFoundError("can't sync to MPEG frame")
mutagen.mp3.HeaderNotFoundError: can't sync to MPEG frame

One what file did this error get raised?

Not sure, I have a ton of files in the target folder.

Try upgrading musicrepair and let me know if the error persists.


Update README.md

Test PR. Ignore

🎉 Congratulations, Your environment is now ready at location: https://www.example.com/PR_ID/serviceName
Please use the above URL to test your code in the environment and start collecting the metrics.

Your tests are running and below are the results of the test runs:
API Results:

API Path
Method
Sample Payload
Response Code (Click to get response)
Execution Time
Delta from last run

/login
POST
{"apiKey": "some-valid-key"}
200
20ms
+10ms

/register
POST
{"user":"someUser","email":"someEmail"}
200
50ms
NA

Tip: Click on the API to see results of state change


[DRAFT] Refactor e2e expect not to

Which issue this PR addresses:
Fixes https://issues.redhat.com/browse/ARO-4489#L67
What this PR does / why we need it:
This is a little draft idea to show how we can add specific retry logic to API calls in the E2E tests to make them more fault tolerant.
TODO:

(Assuming the approach is okay'd) Apply expand this PR to fully cover the k8s API calls.
(Assuming the approach is okay'd) Start another PR/PR's for the other clients.
Bump ginkgo to 2.8.x (We're on 2.7.0) at least to get the GinkoHelper and apply that to the helper methods. Ideally, I would do this here as part of this PR. Is bumping the version of a dependency a big deal? AFAIK it's used (nearly) entirely in the E2E tests so I'm hoping it will be smooth.

Test plan for issue:
Run them all.
Is there any documentation that needs to be updated for this PR?
Very possibly

I'm in favor of having this PR, if acceptable to the wider team, merge as-is, and to make the effort of rolling this out across all our E2E tests the work of future stories, that are spread across the team. It'd be slower, but it would get more people involved in the change to hopefully normalize this approach across future tests as well.

I like this approach but I would suggest that splitting the work by client would be a more natural division. I can expand this PR to cover the k8s client and version bump and then people could pick up each of the other clients?
What do you think?
(I actually have a second proposal that builds on this concept that I thought would be useful to spread around for the same reasons you outline but I think you're right and we can start introducing it from here)

I think that works too, my goal is to split work on this across the team, whichever way we split it is fine by me as long as it gets enough eyes on the change.

/azp rerun e2e

/azp run e2e

@tsatam & @kimorris27 Sorry. AFAIK I didn't dismiss your reviews... tbh I have no idea how I triggered this action. This has actually happened me in a few PRs. Is there some implicit workflow or something I'm unaware of?

Marking this PR as high priority - I believe this change will go a long way towards fixing known flakes and currently-broken e2e tests such as the one being debugged in #3384


Snippet for Markdown File

I am trying to create a snippet for Markdown file, but nothing I seem to try is working.
These are the steps that I have followed:

Open Visual Studio Code
Open a markdown file, i.e Readme.md
Press F1, type snippet, select Create Snippet
Entered the following:

 "Test Snippet": {
  "prefix": "gep13",
  "body": [
   "test $1"
  ],
  "description": "Your snippet description here."
 }

Saved the file, and then went back to the markdown file, and typed gep13 but  the snippet never appears.

Any idea as to why this isn't working?  I have read through this: https://code.visualstudio.com/docs/customization/userdefinedsnippets and it suggests that snippets for markdown files should work, but it doesn't seem to.
I have tried opening/closing VS Code, but still nothing.  I am using VS Code version 0.10.5.

This works for me, notices the top-level {} that you seem to have removed, they are required.
{
	"Test Snippet": {
		"prefix": "gep13",
		"body": [
			"test $1"
		],
		"description": "Your snippet description here."
	}
}

@egamma sorry, but I also have those:

Can you confirm exactly what you mean by working?  I have an expectation that when editing any file with a .md or .markdown extension, that when I type gep13 I should have an option to expand that into the snippet, but that is not happening for me.
Is there anything that I can do to debug this further?

Can you confirm exactly what you mean by working?

The gep13 snippet shows up when I edit a markdown file.
Here are my steps:

preferences>user snippets
select markdown in the quick box
add the snippet to the file that opens

Now open a markdown file

type gep and press ctrl-space, the snippet shows up.

Ah, interesting, the Ctrl-Space is required.  In the Latex extension, and the Cake extension, the snippets there seemed to automatically appear, without the need for pressing Ctrl-Space.  What magic is happening in those extensions to make that just work?
For example, in the Latex extension, I was able to type cha and the snippet appeared automatically, without the need to press ctrl-space.  Thanks!

Yes this is an inconsistency. Full extensions get auto (7x24) completion by default (e.g. latex, cake), some built-in extensions like Markdown do not.

@egamma gotcha, ok, so the world makes sense again, at least for now :smile: Thanks for all your help with this!

:+1: the Ctrl-Space was not expected.
Are there any others outside of markdown that require the use of Ctrl-Space?
Asking out of ignorance here, is this something that markdown files can be made into an extension like C# is an extension?

Didn't know about the Ctrl+Space either until I read this here. +1 on wanting this to be build in by default. Or at least have a clear guide on what languages are support 24x7 and which are not for this.


DBusError.Reference() internalValue nil exception

Thanks for your helpful library !
I imported and created a DBusConnection on macOS.
let conn = try DBusConnection.init(address: "/tmp/dbus-1AGCwnZNuj", shared: false);

An error occured Fatal error: Unexpectedly found nil while implicitly unwrapping an Optional value.
It seems that padding1 is nil which caused this problem.
I changed internal let internalPointer: OpaquePointer? to fix it.
The situation is that when there is error in connection, the returned pointer is NULL/nil.

My Swift version is Apple Swift version 5.0.1 (swiftlang-1<IP_ADDRESS> clang-1<IP_ADDRESS>) Target: x86_64-apple-darwin18.6.0.
Thanks in advance !

Should I add some code to handle it ?


Electronmon listening to native file changes

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Action Performed:

Have an electron dev build running.
Run an Android or iOS native build.

Expected Result:
The Android or iOS native build should not affect electron.
Actual Result:
Electronmon is refreshing a ton of times due to what it thinks are renderer file changes:

Workaround:
n/a - this is just a minor optimization.
Platforms:
Which of our officially supported platforms is this issue occurring on?

[ ] Android / native
[ ] Android / Chrome
[ ] iOS / native
[ ] iOS / Safari
[ ] MacOS / Chrome / Safari
[x] MacOS / Desktop

View all open jobs on GitHub

This could be external but is not important enough for us to put up a bounty for imo.

@allroundexperts Thanks, but as stated above, I wasn't planning on creating an Upwork job for this issue. Feel free to submit a PR if you'd like but there's no bounty for this issue.

Thanks @allroundexperts !

Like I said, no payments are due here so I'm closing this out.


Lock ocean current calculation function

I think it's that TransientCurrentPlugin::UpdateDatabase is modifying the database (EDIT: and other vectors) in one thread while TransientCurrentPlugin::CalculateOceanCurrent is reading it another.

https://github.com/Field-Robotics-Lab/glider_hybrid_whoi/issues/64
This PR tries to lock and unlock the function.

TransientCurrentPlugin::UpdateDatabase needs to be locked as well.

Leaving a note of your test results,

Then I locked TransientCurrentPlugin::UpdateDatabase as well. It's been running for 6 hours (sim time)/11 minutes (real time) now without an issue.

And about the branch organization,

Most of what we nees would be in https://github.com/Field-Robotics-Lab/dave/pull/180. It would not include intlatlon, gpaviewer and stuff. So I am trying to keep the bathymetry_plugin_whoi branch at my fork.
the branch will not be in upatream dave and will not be merges into master. Dave team has decided not to include bathymetry files in the repo but make it downloadable reading the tutorial. The download file includes both bathymery examples(not buzzbay) and initlatlon/gps viewer.
The branch at my fork will include Buzzbay and some puerto rico and minor adjustings for epic-daug if needed.
In https://github.com/Field-Robotics-Lab/glider_hybrid_whoi/pull/66, the pre-release I was hoping to get it tested and merged after usjng the simulator as it ia for the puertorico, the target repo is changed from Field-Robotics-Lab/dave to woensugchoi/dave


Properly propagate exception from thread for check server

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#1035  👈
#1027
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @carolineechen and the rest of your teammates on  Graphite


Obtaining method of extracting OPenssl certificate information

Obtaining method of extracting OPenssl certificate information.
But I can't figure out the logic of the source code, the library 27M of openssl for iOS is too big for me.
Help Me,please.

You'll have to give us a bit more information about what you are trying to do. Are we talking about extracting information from a cert on the command line or in code? If the latter, have you already loaded the cert and got an X509 object handle on it? What information are you looking to extract?


Add Falcon on Together

Fixes #1717

Falcon on Together is producing a "list index out of range" error.

Closing this because Falcon on Together still doesn't work.


ModuleNotFoundError & Couldn't add tkdesigner to the PATH error

When trying to run the GUI, I get the following errors:

ModuleNotFoundError: No module named 'PIL'
RuntimeError: Couldn't add tkdesigner to the PATH.

Here are the solutions I've tried:

Downloading the latest commit & rerunning the command to install requirements (all up to date)
Running using the command 'python -m tkdesigner.cli $FILE_URL $FIGMA_TOKEN' (gives me the PIL error from before)

Could you please help me in resolving this?
Thank you in advance.

Have you added Python to the PATH?

Yes, Python is added to the PATH, and I'm running other Python scripts okay

#169 Go here

Thanks, I tried that previously (I just tried it again, to be sure).
It doesn't resolve the issue.

Hey @Kasi21
Have you tried to install pillow manually?


protectli_v*/building_manual.md: s/aof/of/

Fixed.

I'm also not sure whether "You should checkout to the same tag as in case of the coreboot repository" is a proper usage of "in case".


ENH: Channel groups

It would be nice to be able to encode channels as belonging to a particular "group".

for Neuromag MEG, this would just be each triplet of sensors that share a common spatial location
for iEEG, this is probably each sEEG shafts / ECoG grid
for OPMs, manufacturers creating one "sensor" with multiple sensitive volumes (even if spatially offset from one another) will probably want these groups

I propose we add to our new enhanced channel block (https://github.com/mne-tools/fiff-constants/pull/33) the ability to specify which group each channel belongs to. I think it makes sense to add a new entry like:
ch_coord_frame		352	str	-	"Channel group name"

@agramfort @alexrockhill @jasmainak thoughts? I think this will allow us to make visualization functions automagically work better, for example by:

channel groups each get their own color from the mpl color cycle in plot_alignment et al.
mne.channels.find_layout could construct linear layouts on a per-channel-group basis (e.g., for sEEG shafts) for use with mne.viz.plot_topo

If this makes sense, I'll open a parallel issue over in fiff-constants. But I figured we could think about and discuss it a bit here first!

Throwing some ideas: perhaps you might also want separate subplots for different channel groups in evoked.plot? Perhaps some harmonization with "channel selection" ?

That could be an interesting separable viz enhancement that could build on / require this one

My very tentative plan for the GUI for SEEG was to require channel names to be formatted like LAMY 7 and detect the electrode based on the shared pattern of string and warn that group-related functionality such as plotting 3D electrode shafts will be disabled without groups. Alternatively a dictionary of grouping could be passed.
That was just my first idea and I think this could be better but what would the API look like for defining the groups? Would they be detected automatically as for 3 MEG channels at the same location and the SEEG method describe above or would they have to be assigned manually? And would it be simpler just to make functions that do the automatic grouping in real time even though it's not as efficient since the alternative of assigning them manually seems onerous.

It would be nice to be able to encode channels as belonging to a particular "group".

+1 from me. For fNIRS this would be useful for encoding regions of interest, which are currently messy to handle. Or fibre bundles, which are often connected to different ADCs with different noise properties.
The current proposal makes sense. But would it be possible to have a single channel be part of multiple groups? For the ROI example, sometime channels fall within multiple ROIs.

you would have an int that says to which channel group a channel belongs to
and this would be optional?
yes I think it would be useful. But I think it should be a partition (you
cannot belong to 2 groups) and the
grouping should not be subjective. There should be one and only one way to
group things.

you would have an int that says to which channel group a channel belongs to and this would be optional?

I would prefer str to int as it's more general and descriptive.

I think it should be a partition

I'm not sure why we need to mandate this restriction, I'm not sure it helps with maintainability or usability (we can always have a partition=True default in set_channel_groups for example, but should support partition=False). I'd actually prefer to go the opposite direction and use a list of str (NAME_LIST) in case a channel actually should explicitly belong to more than one group. It's easy enough to add the restriction in a given I/O reader that what is created is always a partition if it should be one for that particular modality/format/sensor setup, but I don't see too much value in limiting the spec that all must be partitions just because we expect that some should be.
I could imagine a weird ECoG grid or sensor arrangement where a channel could belong to more than one group. Or for the purposes of viz, some "left temporal" channels could also be part of the "left parietal" group (i.e., the ones along the boundary) for example if you implemented layout definitions in the groups.
This is another reason list-of-str would be useful, for Neuromag you could encode both the triplet-level-group, and the selection-level-group. Given that there are multiple conceptual groupings even for Neuromag, it makes sense to me to allow multiple group definitions per channel.

There should be one and only one way to group things

Again I think this is great to implement at the I/O reader level, but I don't think we need to make this a limitation of the format spec. For example in principle there should be only one way to name channels (what the manufacturer set it to) and only one way to order them (what they were during acq) but in practice we allow quite some flexibility (rename_channels, reorder_channels, etc.) in configuring channels.
TL;DR I think the I/O readers that automatically set things can implement integers-as-strings if they want, and can make groups exclusive and singletons. But I don't think the spec should limit the definition this way, since it's easy enough to support much more (via list of str), it's easy enough to implement/check/enforce partitions when necessary, and I think there are use cases where we will want multiple groups per channel.

ok for list of str (eg I would call it tags). On neuromag this could encode
this information:
https://github.com/mne-tools/mne-python/blob/main/mne/data/mne_analyze.sel
so a channel can for example have the tag "left" and "temporal" and we
should have convenient
ways to select channels based on their tags.
thoughts?

ok for list of str (eg I would call it tags)

SGTM!

Chiming in here just cuz this feature would be great to add. It's also a metadata column in channels.tsv for iEEG-BIDS, so we could add it into downstream mne-bids.
https://bids-specification.readthedocs.io/en/stable/04-modality-specific-files/04-intracranial-electroencephalography.html#channels-description-_channelstsv

Upstream issue opened: https://github.com/mne-tools/fiff-constants/issues/36

Jw would this feature allow also tagging the "anatomical location" of the IEEG electrodes too?

I think tags could be user-configurable, so I don't see why not


Tile "6A" is labelled incorrectly. It should be labelled 5A.

Thanks, the issue is that it calls up the wrong image (so both 5 and 6 tiles use the images from 5).  Fixed for the next build.


[Vue warn]: Error when evaluating expression "function

Hello, everyone.
Just like the title said. When I tried to jump from #!/a to #!/b, Vue print a warn on the console.
[Vue warn]: Error when evaluating expression "function
aid() {
      return this.tab.aid ? 0 : this.tab.aid;
    }": TypeError: Cannot read property 'tab' of null

aid is a computed value, and it may not belong to nor #!/a or #!/b, for example, it may be a value in page #!/c.
I was puzzled and couldn't figure out what's been going on. How could this be null?

Please follow the Issue Reporting Guidelines and provide a minimal JSFiddle or Github repository containing a set of reproducible steps that can lead to the behaviour you described. Make sure to boil down the problem as much as possible. Thanks!
This should be opened in the vue-router repository, so I'll close this issue and let you open a new one there. But this time please, provide a repro


Status battery of a HUE Botton

Describe the bug
will get status of a hue botton
may be not an error oder bug, but i want to check every Botton in my house für battery status. so i make a inject with payload status an hoply wait for information. but nothing happen.
is there a way to geht battery status from a botton without waiting for the first press?

It is possible with the latest "Hue Buttons" node now


Index signature initialization

TypeScript Version:  3.5.3
Code
export class User {
  id: number = 0

  [key: string]: any
}

Expected behavior:
Should work like
export class User {
  id: number = 0; // <- semicolon

  [key: string]: any
}

export class User {
  id: number // no initialization

  [key: string]: any
}

Actual behavior:
error TS1005: ']' expected.
Playground Link:
https://www.typescriptlang.org/play/#code/KYDwDg9gTgLgBAYwDYEMDOa4FU3CnAbwCg44BLAEwC44A7AVwFsAjPOAXjgAYiS4BtANbAAnjTQwoZWgHMAujRS0RRAL5A
CC https://github.com/prettier/prettier/issues/6727 , https://github.com/prettier/prettier/pull/6728

IIRC Index signatures are not allowed in class declarations. [key part is parsed as computed property and therefore requires ](or valid exporession) instead of :

Looks like this is same problem as with class fields proposal https://github.com/tc39/proposal-class-fields/issues/7.
ASI won't insert ; if next line starts with [ and therefore your code is parsed as indexed access id: number = 0[key which leads to an error, because : won't be part of valid expression for indexed access.
See proposal source
Not sure if TS can easily avoid this requirement even if [ is part of the type and not computed property.

ASI hazard is hazardous. We don't want to do a complex lookahead here on [ to figure out if it's an index signature or element access expression (I'm not even 100% convinced it's never ambiguous).
Line-leading [ should always have an associated ; in desemicoloned style


Errors during Install - Completed with Failures

Hi! My install provides the following error:
Completed with Failures -- Success: 416, Failure: 75
This happens regardless of the version, I've tried 31.4, 36.0 an pre-release 36.1-rc2
I'm attaching the log.
saltstack.txt

@gedeon8084 unfortunately you've hit problems I've never seen before. The log indicates
Problem encountered installing package(s). Additional info follows:\n\nerrors:\n
      \   - Running scope as unit run-r9ac4691b82c94b97823d51d4c813acfa.scope.\n      E:
      dpkg was interrupted, you must manually run 'sudo dpkg --configure -a' to correct
      the problem.

For multiple packages. I'm unsure what would cause the but if you could try running the command it suggests and follow any problems then try re-running the installation, lets see if that fixes it.

Thank you Erik! I had a package "half-installed" that was breaking things. After reinstalling that package everything worked. Thanks again

Regarding this, could you tell us how to find these errors in the saltstack log? IE: What constitutes an accountable error (75 errors)? I've scoured my logs when these errors come up (14 errors) and I usually find a lot more errors than the actual failure count.

Closing this for now ... if you want to follow up just re-open with more comments.


Fix: TheDocumentFoundation.LibreOffice version <IP_ADDRESS>

Microsoft Reviewers: Open in CodeFlow

Automatic Validation ended with:

Error information:
Http Response: OK
Http Reason Phrase: OK
Error occurred while downloading installer from https://downloadarchive.documentfoundation.org/libreoffice/old/<IP_ADDRESS>/win/x86/LibreOffice_<IP_ADDRESS>_Win_x86.msi. 0x80072EE2.
Error information:
Http Response: OK
Error information:
Http Response: OK
Http Reason Phrase: OK
Error occurred while downloading installer from https://downloadarchive.documentfoundation.org/libreoffice/old/<IP_ADDRESS>/win/x86_64/LibreOffice_<IP_ADDRESS>_Win_x86-64.msi. 0x80072EE2.
Error information:
Http Response: OK
Error information:
Http Response: OK
Http Reason Phrase: OK

6/6/2024 4:35:19 AM
(Automated response - build 883.)

URL:
Invalid URI: The hostname could not be parsed.
(Automated message - build 883)


RGB Camera interface - add flag to pass images as float or int

reduces size (4x) and lowers cpu time (no / 255.0)

fixed in #77


Grouping items

Is there any functionality to display items in grid in groups?

Hi @advanced373
Currently, the grid does not support items grouping.


kernel-hci: Add support for Intel E800 series devices

Merge Checklist

All boxes should be checked before merging the PR (just tick any boxes which don't apply to this PR)

[ x] The toolchain has been rebuilt successfully (or no changes were made to it)
[x ] The toolchain/worker package manifests are up-to-date
[ ] Any updated packages successfully build (or no packages were changed)
[ x] Packages depending on static components modified in this PR (Golang, *-static subpackages, etc.) have had their Release tag incremented.
[ x Package tests (%check section) have been verified with RUN_CHECK=y for existing SPEC files, or added to new SPEC files
[x ] All package sources are available
[x ] cgmanifest files are up-to-date and sorted (./cgmanifest.json, ./toolkit/scripts/toolchain/cgmanifest.json, .github/workflows/cgmanifest.json)
[x ] LICENSE-MAP files are up-to-date (./SPECS/LICENSES-AND-NOTICES/data/licenses.json, ./SPECS/LICENSES-AND-NOTICES/LICENSES-MAP.md, ./SPECS/LICENSES-AND-NOTICES/LICENSE-EXCEPTIONS.PHOTON)
[x ] All source files have up-to-date hashes in the *.signatures.json files
[x ] sudo make go-tidy-all and sudo make go-test-coverage pass
[x ] Documentation has been updated to match any changes to the build system
[x ] Ready to merge

Summary

This PR adds kernel patches and kernel build support for Intel E810 devices for the Azure for Operators Nexus program
Change Log

Added backported kernel patches to equivalant of 5.18.55, specific to ice driver.
Updated config, kernel-hci.spec and kernel-hci.signatures.json

Does this affect the toolchain?

NO
Associated issues

#xxxx

Links to CVEs

https://nvd.nist.gov/vuln/detail/CVE-YYYY-XXXX

Test Methodology

Local build.  Some actions fail, but I the error is about git, so not sure how to fix on my end.

@microsoft-github-policy-service agree [company="Intel Corporation"]
From: microsoft-github-policy-service[bot] @.>
Sent: Wednesday, November 15, 2023 4:34 PM
To: microsoft/CBL-Mariner @.>
Cc: Wyborny, Carolyn @.>; Mention @.>
Subject: Re: [microsoft/CBL-Mariner] kernel-hci: Add support for Intel E800 series devices (PR #6770)
@cwybornyhttps://github.com/cwyborny please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.
@microsoft-github-policy-service agree [company="{your company}"]
Options:

(default - no company specified) I have sole ownership of intellectual property rights to my Submissions and I am not making Submissions in the course of work for my employer.

@microsoft-github-policy-service agree

(when company given) I am making Submissions in the course of work for my employer (or my employer has intellectual property rights in my Submissions by contract or applicable law). I have permission from my employer to make Submissions and enter into this Agreement on behalf of my employer. By signing below, the defined term “You” includes me and my employer.

@microsoft-github-policy-service agree company="Microsoft"
Contributor License Agreement
Contribution License Agreement
This Contribution License Agreement (“Agreement”) is agreed to by the party signing below (“You”),
and conveys certain license rights to Microsoft Corporation and its affiliates (“Microsoft”) for Your
contributions to Microsoft open source projects. This Agreement is effective as of the latest signature
date below.

Definitions.
“Code” means the computer software code, whether in human-readable or machine-executable form,
that is delivered by You to Microsoft under this Agreement.
“Project” means any of the projects owned or managed by Microsoft and offered under a license
approved by the Open Source Initiative (www.opensource.orghttp://www.opensource.org).
“Submit” is the act of uploading, submitting, transmitting, or distributing code or other content to any
Project, including but not limited to communication on electronic mailing lists, source code control
systems, and issue tracking systems that are managed by, or on behalf of, the Project for the purpose of
discussing and improving that Project, but excluding communication that is conspicuously marked or
otherwise designated in writing by You as “Not a Submission.”
“Submission” means the Code and any other copyrightable material Submitted by You, including any
associated comments and documentation.
Your Submission. You must agree to the terms of this Agreement before making a Submission to any
Project. This Agreement covers any and all Submissions that You, now or in the future (except as
described in Section 4 below), Submit to any Project.
Originality of Work. You represent that each of Your Submissions is entirely Your original work.
Should You wish to Submit materials that are not Your original work, You may Submit them separately
to the Project if You (a) retain all copyright and license information that was in the materials as You
received them, (b) in the description accompanying Your Submission, include the phrase “Submission
containing materials of a third party:” followed by the names of the third party and any licenses or other
restrictions of which You are aware, and (c) follow any other instructions in the Project’s written
guidelines concerning Submissions.
Your Employer. References to “employer” in this Agreement include Your employer or anyone else
for whom You are acting in making Your Submission, e.g. as a contractor, vendor, or agent. If Your
Submission is made in the course of Your work for an employer or Your employer has intellectual
property rights in Your Submission by contract or applicable law, You must secure permission from Your
employer to make the Submission before signing this Agreement. In that case, the term “You” in this
Agreement will refer to You and the employer collectively. If You change employers in the future and
desire to Submit additional Submissions for the new employer, then You agree to sign a new Agreement
and secure permission from the new employer before Submitting those Submissions.
Licenses.

Copyright License. You grant Microsoft, and those who receive the Submission directly or
indirectly from Microsoft, a perpetual, worldwide, non-exclusive, royalty-free, irrevocable license in the
Submission to reproduce, prepare derivative works of, publicly display, publicly perform, and distribute
the Submission and such derivative works, and to sublicense any or all of the foregoing rights to third
parties.
Patent License. You grant Microsoft, and those who receive the Submission directly or
indirectly from Microsoft, a perpetual, worldwide, non-exclusive, royalty-free, irrevocable license under
Your patent claims that are necessarily infringed by the Submission or the combination of the
Submission with the Project to which it was Submitted to make, have made, use, offer to sell, sell and
import or otherwise dispose of the Submission alone or with the Project.
Other Rights Reserved. Each party reserves all rights not expressly granted in this Agreement.
No additional licenses or rights whatsoever (including, without limitation, any implied licenses) are
granted by implication, exhaustion, estoppel or otherwise.

Representations and Warranties. You represent that You are legally entitled to grant the above
licenses. You represent that each of Your Submissions is entirely Your original work (except as You may
have disclosed under Section 3). You represent that You have secured permission from Your employer to
make the Submission in cases where Your Submission is made in the course of Your work for Your
employer or Your employer has intellectual property rights in Your Submission by contract or applicable
law. If You are signing this Agreement on behalf of Your employer, You represent and warrant that You
have the necessary authority to bind the listed employer to the obligations contained in this Agreement.
You are not expected to provide support for Your Submission, unless You choose to do so. UNLESS
REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING, AND EXCEPT FOR THE WARRANTIES
EXPRESSLY STATED IN SECTIONS 3, 4, AND 6, THE SUBMISSION PROVIDED UNDER THIS AGREEMENT IS
PROVIDED WITHOUT WARRANTY OF ANY KIND, INCLUDING, BUT NOT LIMITED TO, ANY WARRANTY OF
NONINFRINGEMENT, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE.
Notice to Microsoft. You agree to notify Microsoft in writing of any facts or circumstances of which
You later become aware that would make Your representations in this Agreement inaccurate in any
respect.
Information about Submissions. You agree that contributions to Projects and information about
contributions may be maintained indefinitely and disclosed publicly, including Your name and other
information that You submit with Your Submission.
Governing Law/Jurisdiction. This Agreement is governed by the laws of the State of Washington, and
the parties consent to exclusive jurisdiction and venue in the federal courts sitting in King County,
Washington, unless no federal subject matter jurisdiction exists, in which case the parties consent to
exclusive jurisdiction and venue in the Superior Court of King County, Washington. The parties waive all
defenses of lack of personal jurisdiction and forum non-conveniens.
Entire Agreement/Assignment. This Agreement is the entire agreement between the parties, and
supersedes any and all prior agreements, understandings or communications, written or oral, between
the parties relating to the subject matter hereof. This Agreement may be assigned by Microsoft.

—
Reply to this email directly, view it on GitHubhttps://github.com/microsoft/CBL-Mariner/pull/6770#issuecomment-1813517063, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AL5PGRTLDIWKY4E342DHQVTYEVNPLAVCNFSM6AAAAAA7NKIX6GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMJTGUYTOMBWGM.
You are receiving this because you were mentioned.Message ID<EMAIL_ADDRESS>

@microsoft-github-policy-service agree company="Intel Corporation"
From: microsoft-github-policy-service[bot] @.>
Sent: Wednesday, November 15, 2023 4:39 PM
To: microsoft/CBL-Mariner @.>
Cc: Wyborny, Carolyn @.>; Mention @.>
Subject: Re: [microsoft/CBL-Mariner] kernel-hci: Add support for Intel E800 series devices (PR #6770)
@cwybornyhttps://github.com/cwyborny the command you issued was incorrect. Please try again.
Examples are:
@microsoft-github-policy-service agree
and
@microsoft-github-policy-service agree company="your company"
—
Reply to this email directly, view it on GitHubhttps://github.com/microsoft/CBL-Mariner/pull/6770#issuecomment-1813520900, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AL5PGRXNZOPMBXZWKHNMKUDYEVOCRAVCNFSM6AAAAAA7NKIX6GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMJTGUZDAOJQGA.
You are receiving this because you were mentioned.Message ID<EMAIL_ADDRESS>


typstfmt --version says 0.2.7 when installing 0.2.8

typstfmt --version says 0.2.7 when installing 0.2.8

thank you fixed now :)
i had to yank that version unfortunately


Deduplicate kubectl functions and simplify retrying applies

Changes
As the title says really:

Extracted waitForXXX functions to deduplicate super long kubectl commands.
Extracted retryingApply to consistently retry on all of the remote apply applications. I didn't quite parse why the wait package was used to be honest as it seems like we'd want the applys to be retried a few times. This has the nice sideeffect of dropping a dependency.

/kind cleanup

/assign @psschwei

/unhold


update proxy and candles urls

Just a little housekeeping.
komodo.earth:3334  -> etherscan-proxy.komodo.earth
komodo.earth:3333 -> candles.komodo.earth
Old urls still work, for now. This repo is the last one still using the old ones. No rush on review / merge, but should be included in the next release.
To test:

confirm candle charts still display
confirm evm trasaction histories are updating correctly.

@kivqa Everything working as expected?

Checking of this PR blocked by issue with API. https://komodo.earth:3333/api/v1/ohlc/eth-btc returns null

We are still awaiting to find an alternate candlestick provider. The new provider is no longer available.

https://binance-docs.github.io/apidocs/spot/en/#kline-candlestick-streams is an option with wide support for coins, though due to their API limit policies, this should be implemented client side.

Due to an issue with the new API provider, this was abandoned in favour of implementing Binance's API, which includes some minor improvements/fixes by @takenagain.
#117

Due to an issue with the new API provider, this was abandoned in favour of implementing Binance's API, which includes some minor improvements/fixes by @takenagain.
https://github.com/KomodoPlatform/komodo-wallet-mobile/pull/117


[DROOLS-7396] Add github release action for VSIX development build

This PR is to upload vsix development build in github "Releases" section. Alignment with kie-tools will be addressed by https://issues.redhat.com/browse/DROOLS-7404
Confirmed with my fork repo that vscode-extension-drl-editor-1.0.0-alpha.vsix is uploaded in "Releases" section, and it works locally with code --install-extension vscode-extension-drl-editor-1.0.0-alpha.vsix.

GHA MacOS : MacOS sometimes fails to download vscode. Not related to this PR.
node:events:491
      throw er; // Unhandled 'error' event
Downloading VS Code 1.77.3 from https://update.code.visualstudio.com/1.77.3/darwin/stable
      ^

Error: read ECONNRESET

@mariofusco @caponetto Please review, thanks!

@caponetto Thank you very much for the suggestions! I'll update the PR accordingly.

@caponetto please give one last review to @tkobayas's fixes and let us know if this is ok now.


Fix failing tests due to changes in specstore

Travis build is failing due to latest changes
Acceptance Criteria

[x] travis build is fine

Tasks

[x] Update tests

FIXED


Support writing Tar archives (Debian packages) with long file names

The file name in the Tar entry header is limited to 100 characters.
When adding a file with a longer file name to a Tar archive, you need to create a new entry with the name ././@LongLink and type L (TarTypeFlag.LongName), which contains the file name in the file contents.
This PR adds support for reading/writing such tar archives.
Fixes #47

/cc @kekekeks


Fixed device rebooting by killing Frida before launching it again

Hey, I fixed the error rebooting the device. Apparently Frida crashes the device, if there are 2 processes that have the same name.

This seem to indeed resolve the issue, thank you. I tried doing that before, but I only killed the target app, not frida itself. Good job, and feel free to contribute in the future - new DroidFrida update will be released very soon


When container section is empty, you can no longer switch sections

Rancher versions: master 2.0 7/31
Steps to Reproduce:

Create an environment
Add host
Go to Container page
Switch to Load Balancer or DNS section

Results:  The menu to switch types of services is no longer available and I can't get back to containers list

This is missing:

Version - master 2.0 (8/3)
Verified fixed


Tests: KeyError in multiprocessing.resource_tracker (potential memory leak or data corruption)

Describe the bug
All unit test runs end with a KeyError in multiprocessing.resource_tracker. This suggests a bug in test or production code related to multiprocessing resources. Some resources are not correctly tracked and closed, which can lead to a memory leak or data corruption.
To Reproduce
1. tox -e py311-unit
Example from https://github.com/instructlab/instructlab/actions/runs/9916493619/job/27398827070?pr=1701#step:12:205
Traceback (most recent call last):
  File "/usr/lib64/python3.11/multiprocessing/resource_tracker.py", line 239, in main
    cache[rtype].remove(name)
KeyError: '/loky-3005084-iz9ghrnm'

Expected behavior

no warning from multiprocessing
if a warning occurs, the test suite should fail

Hello @tiran,
Having a hard time pinpointing which part of the code this error is resulting from. I was wondering if you were aware of any additional context that might help.
Also, from googling that issue, I saw this closed issue in the joblib GitHub that, upon skimming it, makes it seem that this issue isn't critical and maybe we should consider suppressing it. Would love to hear your thoughts.
Thanks!

The ticket is about 3rd party joblib. How is this related to multiprocessing in Python's stdlib?
The error message suggests that some process has rug-pulled some tracked data under the feet of another process without synchronizing the operation. That's bad. In a multi-threaded and multi-processed environment, access to shared data must be carefully synchronized.
Unfortunately there is no easy way to debug this problem. Multiprocessing does not logging to track its behavior.
First of all I would start by figuring out which test case and commit introduced the problem. Run each test module and then each test case in isolation until you found the culprit. You could try to find a commit of InstructLab without the problem and then git bisect until you find the offending commit that introduced the issue. But that's not going to work if the problem was introduced in a 3rd party package. We don't track the entire dependency tree in git.

I've identified that the test that's causing this exception is tests/test_lab_model_test.py:test_model_test_linux. Still trying to get down to what part of the code that's run is resulting in this error.
The strange thing is that the test is passing, so due to the asynchronous nature, it's likely that the error is occurring after test completion, which makes it hard to identify what line is causing it.
Will update here any further breakthroughs.

Weirdly, this line in linux_test triggers this:
    ds = load_dataset("json", data_files=os.fspath(test_file), split="train")


IndexOutOfBoundsException when changing --output to --report with RC9

Seems like the Detekt's executable lost the --output parameter with RC9. The new one that should be used is --report. After changing it I'm getting the following exception though:
Exception in thread "main" java.lang.IndexOutOfBoundsException: Index: 1, Size: 1
        at java.util.Collections$SingletonList.get(Collections.java:4815)
        at io.gitlab.arturbosch.detekt.cli.ReportPath$Companion.from(ReportPath.kt:17)
        at io.gitlab.arturbosch.detekt.cli.CliArgs$reportPaths$2.invoke(CliArgs.kt:88)
        at io.gitlab.arturbosch.detekt.cli.CliArgs$reportPaths$2.invoke(CliArgs.kt:14)
        at kotlin.SynchronizedLazyImpl.getValue(LazyJVM.kt:74)
        at io.gitlab.arturbosch.detekt.cli.CliArgs.getReportPaths(CliArgs.kt)
        at io.gitlab.arturbosch.detekt.cli.OutputFacade.<init>(OutputFacade.kt:21)
        at io.gitlab.arturbosch.detekt.cli.runners.Runner.execute(Runner.kt:24)
        at io.gitlab.arturbosch.detekt.cli.Main.main(Main.kt:24)

The reason is that I don't comply with the new format report-id:path-to-store-report. In any case, I should get a more meaningful exception message than an IndexOutOfBoundsException.
I was passing a directory path and there is no : hence the split does not split anything and index 1 ain't there.

The problem is that assert will only raise a runtime exception if explicitly enabled.
Throws an AssertionError if the value is false and runtime assertions have been enabled on the JVM using the -ea JVM option.
I will change the existing check to something else and create a PR.

@marschwar can you check if what you are describing is resolved here: https://github.com/arturbosch/detekt/pull/1145 ?

Good point. Since that commit already changed the check from assert to require it is already taken care of. In my opinion this can be closed then.


Having trouble using this plugin

Never mind, Noticed the missing executable was ripgrep.
I am using Lazy and trying to use spectre, but I have trouble right off the hop using it. My current commit is 3712ff0cdf4f9f877d9ca708d835a877d9a0abaf  .  I also see I have plenary.nvim in my lockfile at branch: f7adfc4b3f4f91aab6caebf42b3682945fbc35be
I am using a very new Arch install and the LazyVim method of setting up NeoVim.
So these files are recent. What happens for me, is I hit leader-sr and Spectre pops up, not in insert mode, so I switch to insert mode and provide some text to search on. No results pop up. So essentially, nothing is happening. OK. So I hit esc and then I get a lot of error messages popping up, starting with the plenary plugin and plenary jobs.
I am not sure at all how to go about fixing this. I am really new to the NeoVim concept, and the lazyvim setup, and I have found little in the way of things I can do to identify exactly what is wrong, but it does seem to point to Spectre and Plenary together not working at this moment.
E5108: Error executing lua .../.local/share/nvim/lazy/plenary.nvim/lua/plenary/job.lua:107: rg: Executable not found
stack traceback:
	.../.local/share/nvim/lazy/plenary.nvim/lua/plenary/job.lua:107: in function 'new'
	...share/nvim/lazy/nvim-spectre/lua/spectre/search/base.lua:122: in function 'search'
	....local/share/nvim/lazy/nvim-spectre/lua/spectre/init.lua:610: in function 'search'
	....local/share/nvim/lazy/nvim-spectre/lua/spectre/init.lua:329: in function 'on_search_change'
	[string ":lua"]:1: in main chunk
stack traceback:
	[C]: in function 'error'
	.../.local/share/nvim/lazy/plenary.nvim/lua/plenary/job.lua:107: in function 'new'
	...share/nvim/lazy/nvim-spectre/lua/spectre/search/base.lua:122: in function 'search'
	....local/share/nvim/lazy/nvim-spectre/lua/spectre/init.lua:610: in function 'search'
	....local/share/nvim/lazy/nvim-spectre/lua/spectre/init.lua:329: in function 'on_search_change'
	[string ":lua"]:1: in main chunk

How did you fix this?

I read the error message carefully. It was telling me and executable was not found. So I thought about that for a second. Aha! I need to install something. Sure enough, installed whatever plenary needed, fixed the issue. Turns out, naive me, I had no idea that this LazyVim approach does not hold your hand and install all the little Rust extras these neovim plugins depend on. Once I got all my little rusty things installed, me neovim functions without troubles. like this.

@resistorsoftware are you able to provide some more detail? i am getting exact same error. Did you just need to install the rg package?

i can confirm that i needed to add ripgrep.