linalg.norm

Proposed changes
Implemented a method for computing matrix/vector norms. Analogous to numpy.linalg.norm.
Checklist
Put an x in the boxes that apply.

[x] I have read the CONTRIBUTING document
[x] I have run pre-commit run --all-files to format my code / installed pre-commit prior to committing changes
[x] I have added tests that prove my fix is effective or that my feature works
[x] I have updated the necessary documentation (if needed)

I figured this out.

@gboduljak this looks really nice!  Regarding API we are trying to stick to NumPy unless we have a really good reason to diverge. So could you please rename vector_norm to norm?

@gboduljak this looks really nice! Regarding API we are trying to stick to NumPy unless we have a really good reason to diverge. So could you please rename vector_norm to norm?

Yes, I can rename it to norm.  For now, I kept it as vector_norm because it supports only vector normalization.
My concern is that for now, we cannot maintain full compatibility with np.norm. This is because we are missing nuclear norm and other norms that depend on the spectrum. Do we want to merge after renaming to norm even if we are not fully compatible with np.norm?
I do not think it is a good idea to implement spectrum-based norms in this PR because someone is already working on SVD. We can reuse SVD implementation for these norms. We should, however, leave other matrix norms as future work. I also have to implement Frobenious norm.
Thanks for the feedback :)

@gboduljak no worries the best way to deal with that is to throw for the cases we don't yet support. That's totally reasonable and it's totally reasonable to build out the API in steps as long as we give a helpful error message for not yet implemented cases.

@gboduljak what's the status of this PR? Would love to get mlx.linalg.norm in, let me know if you are still planning to work on it.

@gboduljak what's the status of this PR? Would love to get mlx.linalg.norm in, let me know if you are still planning to work on it.

I am working on this right now. I am confident this will be complete tomorrow.

@awni I made some progress on this PR. I implemented missing cases in C++, wrote extensive tests in C++, and updated Python bindings to match the requested changes.  However, we are missing extensive tests for Python bindings, docs, and examples. Please, take a look at the C++ logic, tests, and bindings. I will add Python tests, docs, and examples later today.

@awni I am currently struggling to determine the best possible solution for Python bindings. The problem is that there are at most 3 * 3 * 2 = 18 possible combinations of norm parameters. Assuming we want to avoid runtime dispatch in bindings, we need to account for cases when the user deliberately sets ord=None or axis=None in the function call. If we want to be fully compatible with numpy, we need to support this. However, I am not sure how to support this without C++ runtime dispatch in bindings. In addition, given the complexity of norm, we should avoid dispatch in C++, but perhaps we can use runtime dispatch in Python bindings. What do you think?

waiting for this to be merged as i have an incoming PR that also introduces linalg namespace for QR factorization

In addition, given the complexity of norm, we should avoid dispatch in C++, but perhaps we can use runtime dispatch in Python bindings

@gboduljak it's impossible to avoid runtime dispatch via python so don't worry about that! You can just have cases to choose the relevant function within the binding. That's totally reasonable. The other alternative is overloads in the bindings (which we don't usually do), but the dispatch in that case is still done at run-time but just managed by some pybind11 machinery.

PS this is looking quite impressive! I will try and get it reviewed today!

This is looking really nice, I left a few comments to start. I am happy to push some changes myself to keep style stuff consistent rather than badger you with a bunch of nits. Let me know if that's ok!

I will not be able to address some of your requested changes until Tuesday. However, it is completely fine for me that you take care of such stuff. If you need this before, please implement what is necessary and merge :)

@awni I addressed the requested changes for unused imports. However, I am not sure how should we handle infinities for different floating point types. I will be able to finish this on Tuesday.
I noticed that I left quite a few unused imports in this PR. How can I detect this better in the future? Is there any IDE-plugin or code editor plugin you use for this?

Thanks for making the changes. Will review shortly!

How can I detect this better in the future? Is there any IDE-plugin or code editor plugin you use for this?

It may exist, but I don't know of it for C++ (would love to know about it if you find something!). One thing you can do is just check your PR after you make it for these sorts of things.

use clangd vscode extension, it will notify you about unused includes and have symbol info. you will need a compile_commands.json file in your project's root dir, which is generated by clang.
before running cmake set this:
export CMAKE_EXPORT_COMPILE_COMMANDS=1

@gboduljak I pushed an update, make sure you pull before changing anything!

@awni What else we need to do to merge this PR?

@awni What else we need to do to merge this PR?

I will work on this today and tomorrow.

@gboduljak I think it's mostly good to go? I want to do one more quick pass to make sure we didn't miss anything but o/w I am ready to merge.

How can I detect this better in the future? Is there any IDE-plugin or code editor plugin you use for this?

use clangd vscode extension, it will notify you about unused includes and have symbol info. you will need a compile_commands.json file in your project's root dir, which is generated by clang.
before running cmake set this: export CMAKE_EXPORT_COMPILE_COMMANDS=1

Thank you for this suggestion. I will use it in future.

@gboduljak I think it's mostly good to go? I want to do one more quick pass to make sure we didn't miss anything but o/w I am ready to merge.

@awni I think we are good to go. The only concern I had was about frobenius norm for complex-valued matrices. I addressed this with the latest commit.


Gather Signatures for Common Cloud Components PIA

Describe the issue
Once the draft PIA is finalized and reviewed by Keleigh Annau and Julian Subda, the PIA will need to be signed.
Signature route is Holly, Keleigh, Gen, Garry M. and Hayden.
Which Sprint Priority is this issue related to?
Internal Compliance artifacts living documents (v1) signed (PIA, SoAR)
Additional context

Draft PIA is on Teams.
Garry M. has access to the Teams draft and was given a heads up that the PIA will be ready for signature soon. He was invited to start his review.

Definition of done

No further content is needed for the PIA.
All signatures are gathered on the PIA itself and the PIA file is closed by PCT.

Keleigh signed Nov 10. Sent to Gen for signature.


Cannot "Delete directory" on Windows after 5 minutes (outputtimeout)

Hello,
I am encountering an issue when trying to retry the "gitcache git clone mirror -b branch destination_folder" command after a 5 minutes timeout (outputtimeout = 5 mininute at config gitcache).
The log displays the useful information (GITCACHE_LOGLEVEL=Debug): when I using the Jenkin job:
10:11:38  Execute command '['C:\\Git\\git.exe', '-c', 'lfs.url=ssh://git@mydomain:22/repo/repo1.git/info/lfs', '-c', 'lfs.storage=D:\\Je\\gc\\mirrors\\mydomain_22\\repo\\repo1\\lfs', 'clone', 'D:\\Je\\gc\\mirrors\\mydomain_22\\repo\\repo1\\git', '-b', 'my_branch', 'D:\\Je\\wp\\job1_1\\test']' (shell=False, cwd=None) with command timeout of 3600 seconds and output timeout of 300 seconds. 10:11:38  Cloning into 'D:\Je\wp\job1_1\test'... 10:16:39  No stdout/stderr output received within 300 seconds! 10:16:40  Command '['C:\\Git\\git.exe', '-c', 'lfs.url=ssh://git@mydomain:22/repo/repo1.git/info/lfs', '-c', 'lfs.storage=D:\\Je\\gc\\mirrors\\mydomain_22\\repo\\repo1\\lfs', 'clone', 'D:\\Je\\gc\\mirrors\\mydomain_22\\repo\\repo1\\git', '-b', 'my_branch', 'D:\\Je\\wp\\job1_1\\test']' finished with return code -2000. 10:16:40  Delete directory D:\Je\wp\job1_1\test. 10:19:17  Command '['C:\\Git\\git.exe', '-c', 'lfs.url=ssh://git@mydomain:22/repo/repo1.git/info/lfs', '-c', 'lfs.storage=D:\\Je\\gc\\mirrors\\mydomain_22\\repo\\repo1\\lfs', 'clone', 'D:\\Je\\gc\\mirrors\\mydomain_22\\repo\\repo1\\git', '-b', 'my_branch', 'D:\\Je\\wp\\job1_1\\test']' failed with return code -2000. Starting retry 1 of 3. 10:19:17  Execute command '['C:\\Git\\git.exe', '-c', 'lfs.url=ssh://git@mydomain:22/repo/repo1.git/info/lfs', '-c', 'lfs.storage=D:\\Je\\gc\\mirrors\\mydomain_22\\repo\\repo1\\lfs', 'clone', 'D:\\Je\\gc\\mirrors\\mydomain_22\\repo\\repo1\\git', '-b', 'my_branch', 'D:\\Je\\wp\\job1_1\\test']' (shell=False, cwd=None) with command timeout of 3600 seconds and output timeout of 300 seconds. 10:19:17  fatal: destination path 'D:\Je\wp\job1_1\test' already exists and is not an empty directory.
When checking the folder D:\Je\wp\job1_1\test. I see that the presence of the ".git" subfolder prevents cloning again.
and no errors appear in the folder deletion job (I found it here, but don't know if it's right)
https://github.com/seeraven/gitcache/blob/ec99dcf7c175279927aea198753ff7028071f95f/src/git_cache/command_execution.py#L117
The process tries 3 times before receiving an error result with return code 128.

Hi,
the directory should be deleted after a failed attempt to clone using the shutil.rmtree() function, but it is instrumented to ignore errors. So I guess there is actually an error deleting the folder. If I recall correctly, deleting a folder on Windows is - for whatever reason - subspectible to "Permission" errors. That was the reason I had already to implement a workaround in the GitMirror class.
However, I don't think this is the initial reason the command failed. A clone from a local directory shouldn't timeout. Do you have any means to try the local clone "manually" (with no existing target directory) and paste the output? So the command according to your log would be:
C:\Git\git.exe -c lfs.url=ssh://git@mydomain:22/repo/repo1.git/info/lfs -c lfs.storage=D:\Je\gc\mirrors\mydomain_22\repo\repo1\lfs clone D:\Je\gc\mirrors\mydomain_22\repo\repo1\git -b my_branch D:\Je\wp\job1_1\test

Of course, the destination directory should be empty/non-existant before the call. ;-)

Thanks @seeraven for your information.
A clone from a local directory shouldn't timeout --> I tried to run multiple Jenkins job to check out source code on a single machine.
I also think that the folder deletion job failed, but no error details are displayed -> difficult to find the root cause (One more than, the account when using Jenkin job is different from the account to run the command as you recommend)
That was the reason I had already to implement a workaround in the GitMirror class --> Can you explain this part clearly?
Thank you.

I also think that the folder deletion job failed, but no error details are displayed -> difficult to find the root cause (One more than, the account when using Jenkin job is different from the account to run the command as you recommend)

But each user/account uses its own GITCACHE_DIR tree, right? Otherwise it could easily be that one account isn't allowed to create/delete directories created by the other one.

That was the reason I had already to implement a workaround in the GitMirror class --> Can you explain this part clearly?

In the GitMirror class there is a method _rmtree (https://github.com/seeraven/gitcache/blob/ba23b9e46042fc236bc879bdb357e7c7630dc7e0/src/git_cache/git_mirror.py#L219) that checks for permission errors while deleting a directory tree. If a permission error occurs, it tries to change the permissions on the file and deletes it. This seems to be needed on some platforms where the simple call of shutils.rmtree is not capable of deleting a directory itself.
But I am still wondering why the git call times out. If I am trying to clone a repository with git into a directory with an existing .git directory, git immediately prints the error message and quits. Perhaps the existing directory is not the real culprit here, but something like git waiting to enter a password or something. The only thing git is saying is the line Cloning into 'D:\Je\wp\job1_1\test'..., then it stays there for 5 minutes until the timeout kicks in - no error output or anything. Or did you shorten the log you've pasted?

Hi again,
I've just created the new release v1.0.18 that uses the version of rmtree with permission error handling and added more debug output to it. Can you check whether this version solves the problem? If not the debug output might help further to narrow down the problem.

I'm closing this issue as I hope it is resolved now. ;-) If the problem persists, please open a new issue.


Fixes for StreamObserverAndPublisherRx3Test

This provides fixes for problems in StreamObserverAndPublisherRx3Test as Andreas identified in pull request:  https://github.com/salesforce/reactive-grpc/pull/219
Does this by creating a new TestSubscriber subclass (to implement errorCount and a couple of other methods removed in RxJava3).

The two commits in this pr now address all the issues for successfully running all the failing tests.   Please let me know what you think, particularly of the changes to parameters to reduce the number of events in the second commit.


Track Supplies used between sessions

Would it be possible to track the supplies used between sessions? For example doing part of a slayer task before logging off for the night and closing the client, then continuing the next day. All my supplies used the previous night will be gone whereas the runelite loot tracker will still have my drops but I won't know my profit because my supplies used the night before are no longer tracked.

Added in this update tonight.


Angular 5 installation error  "npm install -g<EMAIL_ADDRESS>npm ERR! code ENOLOCAL npm ERR! Could not install from when i run npm install<EMAIL_ADDRESS><EMAIL_ADDRESS>as it does not contain a package.json file.

Bug Report or Feature Request (mark with an x)
- [ ] bug report -> please search issues before submitting
- [ ] feature request

Area
- [ ] devkit
- [ ] schematics

Versions

Repro steps

The log given by the failure

Desired functionality

Mention any other details that might be useful

Dupe of https://github.com/angular/angular-cli/issues/11589


Userbar z-index is 1

Issue Summary
The z-index of the wagtail-userbar element is now set to 1 in the pypi version of wagtail v1.13 instead of 9999 which was used in v1.12.2.  This causes the user bar to appear under page elements that use a z-index of greater than 1.
Steps to Reproduce

Download wagtail v1.13 using pip.
Open the file /wagtail/wagtailadmin/static/wagtailadmin/css/userbar.css
Locate the .wagtail-userbar CSS element.
Observe the z-index in the .wagtail-userbar CSS element:

... .wagtail-userbar{position:fixed;z-index:1; ...
In v.1.12.2 version this is:
...
.wagtail-userbar {
  position: fixed;
  z-index: 9999;
...

Technical details
The source scss file shows the z-index is set to 9999 as expected:

https://github.com/wagtail/wagtail/blob/05adf2c85deb534e213591158cecbd56571c8e84/wagtail/wagtailadmin/static_src/wagtailadmin/scss/userbar.scss#L90

I guess this might be caused by cssnano "optimizing" z-index by default in some versions:
https://github.com/ben-eb/gulp-cssnano/issues/85
Add zindex: false to the options of cssnano to stop it from messing with the z-index.

@strindhaug Good catch - thanks for the info!

Yeah, I wasted a few hours some days ago trying to figure why on earth the z-index was 1 in production when it was 999 locally (running unminified); so the  "z-index is 1" title jumped out to me when i glanced at the issue list.

Digging into the relevant code, I see that the use of cssnano (and a couple of other bits and pieces related to performance testing) is conditional on NODE_ENV=production, which will usually only happen when we're preparing the final release (or release candidate). Clearly, this vastly limits our ability to catch bugs like this during development...
ping @thibaudcolas @jjanssen @vincentaudebert - what can we do to ensure that the frontend assets on our development builds remain as close as possible to the final release version? Would it be reasonable to update our config to always apply 'production' settings on npm run build - or would this make development more difficult (e.g. loss of sourcemaps)?

@gasman it has been a while I didn't dive into wagtail FED code but I'm pretty sure that as you said if you switch to prod mode you will lose the sourcemaps and therefore it will be hard to debug anything FED wise.
Maybe @loicteixeira could confirm as he has been working on wagtail recently. Even if this is FED :)
I reckon that the quickest way to check bugs like that is to run the prod mode for each FED PR and make sure everything is like what it should be.
Just my opinion.

I'd much prefer to adopt a policy where people are using production-mode assets as the default state, and only switch to development mode when actively doing front-end dev that requires it. Relying on one-off tests during code review to catch these bugs, while spending the other 99% of the time in a development environment that doesn't match "real world" Wagtail installations, seems incredibly risky.
It looks like we already have the appropriate npm commands in place to make this happen: npm run build or npm run watch when doing front-end dev, and npm run dist at all other times - so perhaps we just need to update our build scripts and documentation to steer people towards npm run dist.
I wonder if there's any more "nudge theory" we can apply to encourage this further, without making life too annoying for front-end devs... renaming the commands to build-dev and build? Outputting a warning on the ./manage.py command line whenever development-mode assets are in use?

@gasman sorry and don't be offended but I don't see why suddenly having a dev and a prod build is becoming such a big deal.
There are plenty if not all the projects that are running that way. And they run well.
I think the issue here was a misconfiguration and it has been fixed.
I would rather spend more time making sure the config is fine and doing what we want it to do.
Also we could take the issue the other way around and fix the CSS to be z-index: 1 instead of 9999? What's the point of having 9999 if you can have 1 as the optimised config is saying so?
Again, just my opinion. Also keep in mind that running a prod build is taking slightly longer than just a dev one.

I'll see what happens when using cssnano in dev mode. Definitely want to minimise differences between environments, but source maps and compilation times are also important.
For our build scripts, we could probably remove npm run build or make it an alias of dist. These should be the scripts people use when they aren't doing front-end dev , and I think we can then presume the extra compilation time / absence of source maps isn't a problem.

Thanks for putting the time and effort into fixing this.  It's much appreciated. 👍

@mgjbroadbent Thanks for the report!


porechop does not install with gcc 4.8.5 envs

My default gcc for my OS is 4.8.5. This matters because when I went to use the yaml to create the conda environment for the artic protocol, artic's version of porechop did not install. I didn't realize that 1) artic was using their specific version of porechop, and 2) that it didn't install because there was no error message.
When I went to install artic's version of porechop in the environment, I came across this error:
error: [Errno 2] No such file or directory: 'porechop/cpp_functions.so'
I now knew that it was a compiling issue (needs >gcc 5) and added this to my environment:
conda install -c omgarcia gcc-6
pip3 install<EMAIL_ADDRESS>
Additionally, I realized that bcftools=1.9 and seqtk=1.3 didn't install in the conda environment either. I didn't realize this until after I went through each dependency after I realized the porechop issue.
It'd be helpful if there was a version check for each required package.

Hi, Just wanted to say I noticed the same issue with porechop. Your fix didn't do the trick for me though.
I ended up using the manual python3 install, which worked:
git clone https://github.com/artic-network/Porechop.git cd Porechop python3 setup.py install
In the end I discovered that the pipeline doesn't use porechop anymore (my consensus sequences are identical with / without porechop in my PATH). The pipeline now uses Guppy barcoder for demuxing. So I guess this issue is not relevant any more.

I just looked at some of their updates, and it looks like they aren't using porechop anymore. Closing the issue.


Update documentation to populate  with link to a remote license

In some of the examples in the documentation, the  tag shows a relative link, e.g.
            <licenses>                 <license>                     <name>MIT</name>                     <url>/work/bucharest-gold/szero/node_modules/commander/LICENSE</url>                 </license>             </licenses>
It would be good to show the link coming form the  lib/resources/default-unifiedlist.json file, e.g.
"3dfx Glide License": {         "fedora_abbrev": "Glide",         "fedora_name": "3dfx Glide License",         "id": "1",         "license_text": "",         "approved": "yes",         "spdx_abbrev": "Glide",         "spdx_name": "3dfx Glide License",         "url": "http://www.users.on.net/~triforce/glidexp/COPYING.txt"     },

Doc updated, thanks!
interesting the all.xml was reduced a lot for that example with szero - 664K to 188K
https://github.com/bucharest-gold/license-reporter/commit/dd56e7d60e333dc67ee4f419aa9d8e818d33d298#diff-04c6e90faac2675aa89e2176d2eec7d8R256


Web mouse gestures error: Cannot set property '_latestEvent' of undefined

I bisected to find that https://github.com/flutter/flutter/pull/44631 introduced this. This does not do anything to the application, but it does log an error whenever there is an update to the mouse (which is very often).
Steps to Reproduce

Create a widget that uses the mouse input events.
Move the mouse in a web project to get errors logged in the console

Logs

══╡ EXCEPTION CAUGHT BY GESTURE LIBRARY ╞═══════════════════════════════════════════════════════════
js_primitives.dart:49 The following UnknownJsTypeError was thrown while routing a pointer event:
js_primitives.dart:49 Error: Cannot set property '_latestEvent' of undefined
js_primitives.dart:49
js_primitives.dart:49 When the exception was thrown, this was the stack:
js_primitives.dart:49 TypeError: Cannot set property '_latestEvent' of undefined
js_primitives.dart:49     at MouseTracker._updateDevices$2$handleUpdatedDevice$targetEvent (http://localhost:8000/main.dart.js:49518:36)
js_primitives.dart:49     at MouseTracker._mouse_tracking$_handleEvent$1 (http://localhost:8000/main.dart.js:49501:12)
js_primitives.dart:49     at Object.eval (eval at Closure_forwardCallTo (http://localhost:8000/main.dart.js:3016:14), <anonymous>:1:40)
js_primitives.dart:49     at PointerRouter._dispatch$3 (http://localhost:8000/main.dart.js:49738:15)
js_primitives.dart:49     at PointerRouter__dispatchEventToRoutes_closure.call$2 (http://localhost:8000/main.dart.js:49799:20)
js_primitives.dart:49     at JsLinkedHashMap.forEach$1 (http://localhost:8000/main.dart.js:32950:16)
js_primitives.dart:49     at PointerRouter._dispatchEventToRoutes$3 (http://localhost:8000/main.dart.js:49758:20)
js_primitives.dart:49     at PointerRouter.route$1 (http://localhost:8000/main.dart.js:49755:13)
js_primitives.dart:49     at WidgetsFlutterBinding.dispatchEvent$2 (http://localhost:8000/main.dart.js:48511:45)
js_primitives.dart:49     at WidgetsFlutterBinding._flushPointerEventQueue$0 (http://localhost:8000/main.dart.js:48500:17)
js_primitives.dart:49
js_primitives.dart:49 Event:
js_primitives.dart:49   PointerHoverEvent#7b3df

[✓] Flutter (Channel master, v1.12.17-pre.41, on Linux, locale en_US.UTF-8)
    • Flutter version 1.12.17-pre.41 at /usr/local/google/home/chillers/flutter
    • Framework revision 0b2bf99491 (6 hours ago), 2019-12-03 08:13:08 -0800
    • Engine revision faa11214c0
    • Dart version 2.7.0 (build 2.7.0-dev.2.1 e4344a568f)

[!] Android toolchain - develop for Android devices (Android SDK version 29.0.2)
    • Android SDK at /usr/local/google/home/chillers/Android/Sdk
    • Android NDK location not configured (optional; useful for native profiling support)
    • Platform android-stable, build-tools 29.0.2
    • Java binary at: /opt/android-studio-with-blaze-3.5/jre/bin/java
    • Java version OpenJDK Runtime Environment (build 1.8.0_202-release-1483-b49-5587405)
    ! Some Android licenses not accepted.  To resolve this, run: flutter doctor --android-licenses

[✓] Chrome - develop for the web
    • Chrome at google-chrome

[!] Android Studio (version 3.4)
    • Android Studio at /opt/android-studio-with-blaze-3.4
    ✗ Flutter plugin not installed; this adds Flutter specific functionality.
    ✗ Dart plugin not installed; this adds Dart specific functionality.
    • Java version OpenJDK Runtime Environment (build 1.8.0_152-release-1343-b16-5323222)

[!] Android Studio (version 3.5)
    • Android Studio at /opt/android-studio-with-blaze-3.5
    ✗ Flutter plugin not installed; this adds Flutter specific functionality.
    ✗ Dart plugin not installed; this adds Dart specific functionality.
    • Java version OpenJDK Runtime Environment (build 1.8.0_202-release-1483-b49-5587405)

[✓] IntelliJ IDEA Ultimate Edition (version 2019.1)
    • IntelliJ at /opt/intellij-ue-2019.1
    • Flutter plugin version 39.0.2
    • Dart plugin version 191.8423

[✓] VS Code (version 1.39.2)
    • VS Code at /usr/share/code
    • Flutter extension version 3.6.0

[✓] Connected device (2 available)
    • Chrome     • chrome     • web-javascript • Google Chrome 78.0.3904.108
    • Web Server • web-server • web-javascript • Flutter Tools

! Doctor found issues in 3 categories.

\cc dkwingsmt do you know why this would be occurring?

@CaseyHillers There was indeed a refactor to the mouse event system that might have caused this, since it relied more on receiving normalized pointer events. That being said, I was not able to reproduce this error. I created a page with a single FAB and ran it on Web. I'd appreciate it if you can come up with a minimal example.

@dkwingsmt I did a bit more playing around. This only occurs on CanvasKit version of Flutter for web, not the DOM implementation.

flutter create mouse_errors
flutter run -d chrome --dart-define FLUTTER_WEB_USE_SKIA=true
Error is in the Chrome DevTools console

Demo: https://v324-dot-flutter-dashboard.appspot.com/build.html#/

@CaseyHillers I failed to produce any errors with your implementations, even on your demo page, when I hover mouse onto hoverable objects. The following is all errors I see, but they're one-time on page load:
Uncaught TypeError: Cannot read property 'call$3' of null
    at EngineWindow.onPlatformMessage$3 (main.dart.js:44485)
    at Keyboard._handleHtmlEvent$1 (main.dart.js:27433)
    at Keyboard$__closure0.call$1 (main.dart.js:27459)
    at invokeClosure (main.dart.js:2817)
    at main.dart.js:2836

Uncaught TypeError: Cannot read property 'call$3' of null
    at EngineWindow.onPlatformMessage$3 (main.dart.js:44485)
    at Keyboard._handleHtmlEvent$1 (main.dart.js:27433)
    at Keyboard$__closure.call$1 (main.dart.js:27453)
    at invokeClosure (main.dart.js:2817)
    at main.dart.js:2836

Uncaught Object
details: "Not a valid origin for the client: https://v324-dot-flutter-dashboard.appspot.com has not been whitelisted for client ID<PHONE_NUMBER>17-vlj9mqlm3gk1d03fb0efif1fu5nagdtt.apps.googleusercontent.com. Please go to https://console.developers.google.com/ and whitelist this origin for your project's client ID."error: "idpiframe_initialization_failed"
__proto__: Object

@dkwingsmt I am testing on Chrome 78 and reproduce on both Mac and Linux.
These's errors are just being printed to the console with console.log instead of console.error. Are you filtering the dev tools console to only show errors as that would hide this exception?

@CaseyHillers I can see the error now. It's probably the filter. Thanks for the help. Let me take a look.

I can consistently reproduce this error by refreshing the page (while the mouse is within the page).
PR https://github.com/flutter/flutter/pull/46285 should suppress this error, although it was created to avoid breaking existing tests by allowing pointers that have not been added; however this PR does not solve the root cause, which is the pointer event converter failing to guarantee certain assumptions.

I'm closing this issue. Feel free to reopen it if it reappears with the latest framework.


align package descripions

prefix all package descriptions with "abapGit - "
maybe the ajson package description will be overwritten, but lets see

#4947 changed the description. I use a bash script for my mirror adding a prefix to the descriptions in the XMLs. I also insert a copyright comment for Alexander into the class code. Both use sed. Interested or are you already working on some solution in abaplint? ;-)

not working on it, think fixing with sed would be good


[plot] Robustness on Shape.setPoints

It would be good to have a stronger setter method here.
As the computation is done by the backend, setting the data in the setter should help a lot to debug the code, else the problem occur at the rendering time.

Any input is allowed (no type, size, dim check)
I noticed, in polygon mode, the array can't be empty
I also noticed issues on polylines

Like:
Traceback (most recent call last):
  File "/home/ordinateur/workspace/silx.git/build/lib.linux-x86_64-3.8/silx/gui/plot/backends/BackendBase.py", line 357, in postRedisplay
    plot.replot()
  File "/home/ordinateur/workspace/silx.git/build/lib.linux-x86_64-3.8/silx/gui/plot/PlotWidget.py", line 2736, in replot
    item._update(self._backend)
  File "/home/ordinateur/workspace/silx.git/build/lib.linux-x86_64-3.8/silx/gui/plot/items/core.py", line 333, in _update
    self._backendRenderer = self._addBackendRenderer(backend)
  File "/home/ordinateur/workspace/silx.git/build/lib.linux-x86_64-3.8/silx/gui/plot/items/shape.py", line 70, in _addBackendRenderer
    x, y = points.T[0], points.T[1]
IndexError: index 0 is out of bounds for axis 0 with size 0

The Shape object was done at minimum, so I'm not surprise.
Another option is to make specific items of for different shapes (rect, polygone, circle...)


Reflect frames in TimeCode#toSeconds

will need to convert the return type from int to float, then.

I implemented it wrong..

I believe there is an issue with the logic in  TimeCode::toSeconds() in commit 385596b
It has the logic:
// prevent division by zero
if (0 !== $this->frames) {
      $seconds += (1 / $this->frames);
}

When it should actually be:
$seconds += ($this->frames * 0.01);


Railtie not loading

I've added Falcon to the Rails TechEmpower benchmark: https://github.com/TechEmpower/FrameworkBenchmarks/pull/9339
I had to set the isolation_level to :fiber by hand to make it work.
https://github.com/p8/FrameworkBenchmarks/blob/f7822a3d79689164e372fba05be4ee744b1f42a4/frameworks/Ruby/rails/config/application.rb#L55
Otherwise the following error would occur:
$ ./tfb --test rails-falcon --mode verify
...
rails-falcon: {"time":"2024-10-23T08:13:36+00:00","severity":"error","oid":3416,"pid":18,"subject":"Protocol::Rack::Adapter::Rack3","annotation":"Reading HTTP/1.1 requests for Async::HTTP::Protocol::HTTP1::Server.","event":{"type":"failure","root":"/rails","class":"NoMethodError","message":"\u001b[1mundefined method 'map_types!' for nil (\u001b[1;4mNoMethodError\u001b[m\u001b[1m)\u001b[m\n\n\u001b[1m              result = conn.async_exec(sql).map_types!(@type_map_for_results).values\u001b[m\n\u001b[1m                                           ^^^^^^^^^^^\u001b[m","backtrace":
["/usr/local/bundle/gems/activerecord-<IP_ADDRESS>/lib/active_record/connection_adapters/postgresql/database_statements.rb:19:in 'block (2 levels) in ActiveRecord::ConnectionAdapters::PostgreSQL::DatabaseStatements#query'",
"/usr/local/bundle/gems/activerecord-<IP_ADDRESS>/lib/active_record/connection_adapters/abstract_adapter.rb:1004:in 'block in ActiveRecord::ConnectionAdapters::AbstractAdapter#with_raw_connection'",
"/usr/local/bundle/gems/activesupport-<IP_ADDRESS>/lib/active_support/concurrency/null_lock.rb:9:in 'ActiveSupport::Concurrency::NullLock#synchronize'",
"/usr/local/bundle/gems/activerecord-<IP_ADDRESS>/lib/active_record/connection_adapters/abstract_adapter.rb:976:in 'ActiveRecord::ConnectionAdapters::AbstractAdapter#with_raw_connection'",
"/usr/local/bundle/gems/activerecord-<IP_ADDRESS>/lib/active_record/connection_adapters/postgresql/database_statements.rb:18:in 'block in ActiveRecord::ConnectionAdapters::PostgreSQL::DatabaseStatements#query'",
"/usr/local/bundle/gems/activesupport-<IP_ADDRESS>/lib/active_support/notifications/instrumenter.rb:58:in 'ActiveSupport::Notifications::Instrumenter#instrument'",
"/usr/local/bundle/gems/activerecord-<IP_ADDRESS>/lib/active_record/connection_adapters/abstract_adapter.rb:1119:in 'ActiveRecord::ConnectionAdapters::AbstractAdapter#log'",
"/usr/local/bundle/gems/activerecord-<IP_ADDRESS>/lib/active_record/connection_adapters/postgresql/database_statements.rb:17:in 'ActiveRecord::ConnectionAdapters::PostgreSQL::DatabaseStatements#query'",
"/usr/local/bundle/gems/activerecord-<IP_ADDRESS>/lib/active_record/connection_adapters/abstract/database_statements.rb:110:in 'ActiveRecord::ConnectionAdapters::DatabaseStatements#query_values'",
"/usr/local/bundle/gems/activerecord-<IP_ADDRESS>/lib/active_record/connection_adapters/abstract/schema_statements.rb:35:in 'ActiveRecord::ConnectionAdapters::SchemaStatements#data_sources'"

I wonder if it's load order dependent?
https://github.com/socketry/falcon/blob/main/lib/falcon.rb#L10

Yes, it could be that Rails isn't loaded there yet.

I wonder what the best strategy would be, e.g.
begin
  require 'railtie'
  ...
rescue LoadError
  # Ignore
end


Neovim Nightly

It seems that the neovim repo removed the nightly release and so it fails to install now

Unfortunately i can't help here, it's not neovim repository and i'm not neovim maintainer

Unfortunately i can't help here, it's not neovim repository and i'm not neovim maintainer

I'm just pointing out that there's going to be problems.  Would it be possible to provide a binary with the extension, or stop relying on it?

I'm just pointing out that there's going to be problems.  Would it be possible to provide a binary with the extension, or stop relying on it?

Would it be possible to provide a binary with the extension
No. It's possible to download the binary automatically, but it won't solve the problem when it's not available

or stop relying on it?
No

Would it be possible to provide a binary with the extension
No. It's possible to download the binary automatically, but it won't solve the problem when it's not available

or stop relying on it?
No


POC: Core Foundation based macos_userdefaults rewrite

Core Foundation based macos_userdefaults rewrite.
Note: This is a POC
Signed-off-by: Amulya<EMAIL_ADDRESS>Uses https://github.com/chef/corefoundation to interact with MacOS Core Foundation APIs, and uses preferences utils to implement a backward compatible macos_userdefaults resource.
Description

Related Issue

Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Chore (non-breaking change that does not add functionality or fix an issue)

Checklist:

[x] I have read the CONTRIBUTING document.
[ ] I have run the pre-merge tests locally and they pass.
[ ] I have updated the documentation accordingly.
[ ] I have added tests to cover my changes.
[ ] All new and existing tests passed.
[x] All commits have been signed-off for the Developer Certificate of Origin.

@logwolvy Any update on this PR?

@logwolvy Any update on this PR?

@tas50 I concluded the POC with this PR.
We did some planning around this resource and @rishichawda from desktop team is working on corefoundation side of things rn. He will probably add changes to this PR or create a new one, closing this one.

Closing this out until we get the gem all updated


fill/2 function to instantly create a tensor with all elements of same values

Codecov Report

Merging #5 (3c18a77) into main (6edd0ae) will not change coverage.
The diff coverage is 100.00%.

@@            Coverage Diff            @@
##              main        #5   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            3         3
  Lines          234       238    +4
=========================================
+ Hits           234       238    +4

Impacted Files
Coverage Δ

lib/tensorex.ex
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6edd0ae...3c18a77. Read the comment docs.

Codecov Report

Merging #5 (3c18a77) into main (6edd0ae) will not change coverage.
The diff coverage is 100.00%.

@@            Coverage Diff            @@
##              main        #5   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            3         3
  Lines          234       238    +4
=========================================
+ Hits           234       238    +4

Impacted Files
Coverage Δ

lib/tensorex.ex
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6edd0ae...3c18a77. Read the comment docs.


denied: requested access to the resource is denied

Hello, I built my binderhub using the "zero to binderhub", where as a repository I chose the docker hub. I created my docker hub account to which I can push images manually via 'docker push'. But despite having
registry:
username:
password:
in my secret.yaml and
config:
BinderHub:
use_registry: true
image_prefix: /binder-meta-
in my config. yaml (the id and password within <> brackets is what I use to login to hub.docker.com),  my image building process ends with an error message
...
Succesfully built ....
Succesfully tagged ...
denied: requested access to the resource is denied
where docker hub seems to deny the image upload request. Has anybody encountered this? I have no idea what the problem might be.

Hi :wave: This sounds like a configuration problem rather than a bug. Do you mind posting this as a support question on https://discourse.jupyter.org/ instead?
When you do so please format your configuration as code with triple backticks https://docs.github.com/en/github/writing-on-github/working-with-advanced-formatting/creating-and-highlighting-code-blocks#fenced-code-blocks
As you can see in your description some of the key formatting has been lost which means it's not possible to review your configuration properly.


Retry when PPS fails to receive job updates

This is in the same vein as #1103, except it's for jobs.

LGTM


Enhancement: Add where to the sql options

Usecase:
We're working with a deleted_at flag in our database and would
like to use this to filter out (soft) deleted rows with:
sql: {where: "deleted_at IS NULL"}
note: maybe rename the sql option to arel_options? makes it's usage more clear

Hi Leon,
Thanks for the PR. I'm not entirely against this change, but a couple of thoughts:
Firstly, the renaming suggestion would make sense, but given how established this feature is, I think I'll keep it as sql just to make upgrading less painful for everyone.
But more importantly: is there a reason why you're not filtering out these rows at a Sphinx level via a deleted_at attribute? Having this filter applied at the SQL level means that pagination isn't going to be reliable - which is a big part of why I've not had this option in there previously.

renaming the sql option: totally understand that! it's just an observation.
not filtering out at sphinx level: we're updating the live index async in a job so it's not always guaranteed that the updated model is indexed. But I understand that the pagination could be out of whack, didn't think about that. In our use case it isn't a biggie so maybe I should monkeypatch it on app level for our own use.

Hmm. At this point - given this is a rarely requested feature and it's behaviour that does muck around with the pagination, I think I'll take you up on your offer of a local monkey patch - you could subclass the middleware and replace the standard one with yours?
Still, if others clamour for it, I'll come back to this PR - but for the moment I'll close it.
I'm presuming with your async index job you're using SQL-backed indices. Have you investigated real-time indices so data in Sphinx is kept up-to-date on the fly? This would perhaps make an attribute filter viable? (Hard to make such a clear judgement without knowing the full context of your app 😄)


Testing Framework (Mock usw.)

Problem Statement
In qunicorn we have different calls to outside APIs, Database and also the Celery Worker.
How do we Test Methods within these restraints. Probably Using Mocks etc.
Expected Behavior
Documentation and functional Tests for the Methods implemented so far
Tasks

[x] Add Tests for jobmanager
[x] Add Documentation on how to create tests with Mocks, other tools
[x] Possibly guide on how to structure (do we test individual methods, or end-to-end)

Notes

Documented in Readme, created synchronous tests for #8, testing the celery task


Feature suggestion: quick search

I have thought about a feature pleasant for us who use Wikipedia on a daily basis. Instead of opening a Wikipedia browser and manually search you can now right-click on highlighted text and open in a new Wikipedia tab instantly.
Demonstration:

Right now it only works on the Wikipedia domain (://*.wikipedia.org/*) but I want to expand it for all websites ("http://*/*", "https://*/*"). For example, let's say you are browsing a news website and you want to highlight a specific term or word(s) to search for on Wikipedia.
I will publish a PR later. Any thoughts, suggestions or improvements about this @Draeggon, @Mounster-Chef, @jjderooy? I hope you are fine with being tagged and slightly involved in this project, otherwise let me know 😄

I would definitely use that feature so if can be implemented and works reliably enough I say go for.

Still researching about it, right now it only works for Wikipedia domain or all domains (this applies to the css as well). The issue is the manifest.json file and its declaration of domains to apply to. In worst case I'll have to create a separate extension for this specific feature suggestion.

Solved, will update on Firefox soon.


Step 9 - Write your own class

Step 9: Write your own class
In this step we will learn how to write our own CodeQL classes. This will help us make the logic of our query more readable, easier to reuse, and easier to refine.
We'd like to find the same results as in the previous step, i.e. the top level expressions that correspond to the ntohl, ntohs and ntohll macro invocations. It would be useful if we could refer to all such expressions directly, just like we can use MacroInvocation from the standard library to refer to all macro invocations.
We will define a class to describe exactly this set of expressions, and use it in the last step of this course.
The Expr class is the set of all expressions, and we are interested in a more specific set of expressions, so the class we write will be a subclass of Expr.

The exists quantifier
So far, we have declared variables in the from section of a query clause. Sometimes we need temporary variables in other parts of the query, and don't want to expose them in the query clause. The exists keyword helps us do this. It is a quantifier: it introduces temporary variables and checks if they satisfy a particular condition.
To understand how exists works, visit the documentation.
Then look at this example from the “Find the thief” CodeQL tutorial:
from Person t
where exists(string c | t.getHairColor() = c)
select t

This query selects all persons with a hair color that is a string. So we'll get all persons that are not bald, since we are able to find a c that defines their hair color. We don't really need c in the query except to know that it exists.

:keyboard: Activity: Write your own NetworkByteSwap class

We recommend that you first read the documentation on CodeQL classes.

Edit the file 9_class_network_byteswap.ql with the template below:
import cpp

class NetworkByteSwap extends Expr {
  NetworkByteSwap () {
    // TODO: replace <class> and <var>
    exists(<class> <var> |
      // TODO: <condition>
    )
  }
}

from NetworkByteSwap n
select n, "Network byte swap"

This class extends Expr, which means it is a subclass of Expr, and it begins by taking all values from Expr. Now you need to restrict it to only the expressions we are interested in, which satisfy the condition of step 8.

You can do this by editing the characteristic predicate NetworkByteSwap() { ... }. The template includes the exists quantifier, which will help.
Declare a temporary variable in the exists that refers to a macro invocation.
Constrain this macro invocation in the condition section of the exists. Use the same logic from the where section of your query in step 8.
How is the macro invocation related to the expression? Use the same logic from the select section of your query in step 8. You can refer to the macro invocation using the name of the variable you created, and you can refer to the expression using the this variable.

Once you're happy with the results, submit your solution.


Recursive lookup of CNAME value

Let's suppose I have the following DNS zone:
subdomain.example.com. 3600 IN CNAME cname.example.org
subdomain.example.com. 3600 IN MX mx.example.org
I now want to make a recursive query (starting from the root zone) and lookup the values for MX and CNAME in this zone.
Looking up the MX value using resolveAll() works fine - it returns the MX record containing hostname and priority ("mx.example.org").
Which API can I use to accomplish the same thing for the CNAME value? If I use the resolveAll() API with a CNAME question, it always follows cname.example.org and tries to resolve that instead of returning it.

If I understood correctly, if you try to send a DNS query for CNAME subdomain.example.com, you expect it to return CNAME cname.example.org, right? I guess in that case you can use DnsNameResolver.query() which never follows any redirection.

This doesn't work for recursive lookups. The authoritative name server for subdomain.example.com is not yet known to me, so I cant query it directly. That's why I'm currently using resolveAll() to benefit from the recursive lookup - this works for all record classes except CNAME.
What do you think about a new resolveAll() method with the option to disable following the CNAME? Would you be willing to accept a PR for this usecase?

What do you think about a new resolveAll() method with the option to disable following the CNAME?

A special method that is a special case to skip CNAME resolve seems less preferable than a generic way to stop resolutions, perhaps at each step. Anyways, happy to review if you have a PR

@gliwka I see. I agree with @NiteshKant on accepting some Predicate that determines when to stop. Thanks for exploring this option. :bow:

Hello All. Is there any solution for this issue?

@NiteshKant / @trustin Any solution/workaround for this issue?


[Web] Fix LineChart.Dot

Adds position: absolute to the Dot component. This was already implicit in its usage, but was required to work on Web. It also won't work on Web if it's nested inside of Svg (which happens if it's inside of Path.

Web issue
Kinda weird. I sometimes get this error on Web, where the dot is in the totally wrong place. Inspecting it, it shows translateY(-16px).

It usually works fine, but not always.
@jxom does any idea for why come to mind? I know I made this, but I wonder if there is anything off about the code. Maybe in the get Y for X logic?
Native
On native, however, it's correctly placed:

Ah sorry, that comment about the problem I'm having isn't specific to this PR. It's a general issue with the LineChart.Dot.

It seems that the issue happens when the data[at].value is negative. @jxom do you know if getYForX works properly if the Y is negative?

Hmm I am not too sure.

I’ll try to repro when I can


Datepicker won't hide

Datepicker won't hide when I click the document. I have to click on date in datepicker to get it hidden.

@ad1199  Fix in version 1.1.3


add json download

at the moment the export button on the search result page opens a non functioning dialog box.
remove the csv.

both json and csv export implemented for search results


Oh look, a semicolon

Seems like a semicolon sneaked in here

:+1: :shipit:

10/10

Merge it then :dart: :stuck_out_tongue_winking_eye:


fix "Array to string conversion" error

the commit fixes permanent "Array to string conversion" error

What steps do I need to follow to replicate the issue this is attempting to fix?

What steps do I need to follow to replicate the issue this is attempting to fix?

just save any TinyMCE config in Statamic CP. Example config from the documentation should reproduce the error.
The result will be error in ConfigurationDefaults.php

Righto this is really interesting... on one Statamic 5 site, I do not get the error: but on another I do.
Your PR fixes one... but for the other no PR is needed. Really odd, so looking in to this now.

An update to Statamic's core in 5.7.0 introduced this issue.
I'll merge this PR, and then update it to work with < 5.7 too, and tag it shortly after.

Ah, sorry, I forgot to note it is Statamic 5.7.x
Thanks!


Expose partition key delete in nodeJS SDK -> Delete all by partition key

Is your feature request related to a problem? Please describe.
In a partitioned collection, it would be useful to have the option delete all data with a given partitionId.
Describe the solution you'd like
Node SDK should have the capability to delete all the data for a given partition key
Additional context
.NET SDK : [PREVIEW] PartitionKeyDelete: Adds public preview by Shaleen-Kalsi · Pull Request #2948 · Azure/azure-cosmos-dotnet-v3 (github.com)
JAVA SDK : https://github.com/Azure/azure-sdk-for-java/pull/23819

@sajeetharan I see we are calling collection delete Api for supporting this case from our .NET:
https://learn.microsoft.com/en-us/rest/api/cosmos-db/delete-a-collection
but this doc doesn't mention about the payload of this Api.... Can we get it from somewhere?

@topshot99

These are the headers, let's connect offline.


Develop

What does this pull request do?
Updates the master branch with the latest content of the develop branch.
How do I test this?
Test by running
    npm test

Additional Comments / Context

Coverage remained the same at 100.0% when pulling fe2431b082b905f6c76ca8197b3a5c847b73bd3e on develop into 593720c39f68794767c8eae9bcdd43c4469e921c on master.


Support for labeling statements

:label or $: for Svelte
This is enough for Svelte compatibility (#351).
But we should also add label support to break and continue. I just think we should discuss the other potential uses mentioned in  https://github.com/DanielXMoore/Civet/discussions/312#discussioncomment-4832062 first.

We should probably add some tests for this soon.

Oops, that means I forgot to git add them. Will do once I'm on my computer!


Bug in Mapbox

Hi,
Trying to use the new MapBox visualization against Druid, the query fails with the following stack trace:
[Fri Jul 01 06:12:22.021652 2016] [:error] [pid 55345] 2016-07-01 06:12:22,021:ERROR:root:query() got an unexpected keyword argument 'columns'
[Fri Jul 01 06:12:22.021712 2016] [:error] [pid 55345] Traceback (most recent call last):
[Fri Jul 01 06:12:22.021721 2016] [:error] [pid 55345]   File "/usr/lib/python2.7/site-packages/caravel-0.10.0-py2.7.egg/caravel/views.py", line 831, in explore
[Fri Jul 01 06:12:22.021748 2016] [:error] [pid 55345]     payload = obj.get_json()
[Fri Jul 01 06:12:22.021755 2016] [:error] [pid 55345]   File "/usr/lib/python2.7/site-packages/caravel-0.10.0-py2.7.egg/caravel/viz.py", line 294, in get_json
[Fri Jul 01 06:12:22.021762 2016] [:error] [pid 55345]     'data': self.get_data(),
[Fri Jul 01 06:12:22.021768 2016] [:error] [pid 55345]   File "/usr/lib/python2.7/site-packages/caravel-0.10.0-py2.7.egg/caravel/viz.py", line 1800, in get_data
[Fri Jul 01 06:12:22.021775 2016] [:error] [pid 55345]     df = self.get_df()
[Fri Jul 01 06:12:22.021781 2016] [:error] [pid 55345]   File "/usr/lib/python2.7/site-packages/caravel-0.10.0-py2.7.egg/caravel/viz.py", line 156, in get_df
[Fri Jul 01 06:12:22.021788 2016] [:error] [pid 55345]     self.results = self.datasource.query(**query_obj)
[Fri Jul 01 06:12:22.021795 2016] [:error] [pid 55345] TypeError: query() got an unexpected keyword argument 'columns'

From a quick recognition of the code, it seems that the graph relies on the columns feature implemented for Tables but not for Druid Datasources.
The way in which the feature has been implemented is not clear to me. But for druid you could consider of checking this: http://druid.io/docs/latest/development/geo.html

@georgeke

I've played a little bit more with this feature, and I found some additional issues that probably should require a complete rethinking.
My first problem (not the biggest one, but definitively an issue for a released feature) is that it requires setting the config param MAPBOX_API_KEY but this is not documented nor it is documented How I could get a key (I have to signup for MapBox).
Furthermore, using an SQL backend, where it works, the queries with real production data are incredibly slow (using HP Vertica 7.2 and MemSQL 5.0).
Here are the issues I found:

The query function returns all the data in the timeframe selected with no regards to the shown area. This means in my case returning to the browser in the order of ten million data point for one day. It killed Vertica for few second and crashed my Chrome due to memory pressure (on a beefy Mac).
The feature ignores the optimized geospatial indexes and data structure of more modern databases (it is pretty complex to pull this out, though)
The feature also doesn't try to perform some pre-aggregation on the server to reduce the traffic to/from caravel.

As is, I'm going to disable the feature in the 0.10 deployment of Caravel since it is not suitable for production.

Just to make things clearer, at this time the Mapbox visualization does NOT work with Druid using either spatialDimensions or normal dimensions for coordinates, even after #725. Am I right?

Druid doesn't support dimensions other than String datatype as of Now, development is in progress for other datatypes in dimension then it works with same configuration.
Spatial Dimension is supported in Druid , but Mapbox visualization doesnot use it as of now.

My feeling is that this won't be a priority for us at Airbnb for a little while, help is welcomed if someone wants to add the feature!


Implement dictionary required for binary parquet data

I got this error when trying out arrow2 on Parquet data via DataFusion / TPC-H benchmark.
Error: ArrowError(External("", ArrowError(External("", Execution("Arrow error: Not yet implemented: Decoding \"RleDictionary\"-encoded, dictionary-encoded required V1 pages is not yet implemented for Binary")))))

Datafusion only benchmarks with ideal data: who uses required fields in parquet in real life? ^_^

Datafusion only benchmarks with ideal data: who uses required fields in parquet in real life? ^_^

LOL 😆
Not joking - I think IRL of data can be, especially expires from relational databases.
Also new tech like delta lake has (e.g. non null) constraints (not sure if it changes the parquet output though) now which hopefully means everyone is going to finally have good data quality 😂


Disable JWT token revocation with new token requests even though token is not expired

Is your feature request related to a problem? Please describe.
At a given time, IS is only allowing to keep one JWT token per application for the same scopes. Even though the previously issued token is not expired, a second call with the same clientID secret and scopes set will revoke the previous token.

Can we get this behavior fixed?
Describe the solution you would prefer
Instead of revoking the previous token, it's better if IS can provide a limited number of tokens (Should be able to change the limit via a config) with token calls or provide the same token which is not expired yet similar to the opaque flow.

This issue is being closed due to extended inactivity. Please feel free to reopen it if further attention is needed. Thank you for helping us keep the issue list relevant and focused!


Fix build errors due to system Ruby dependency

Fixes https://github.com/fastlane/fastlane/issues/6495

I haven't tried this out, but based on the related issue and these code changes it looks like this may solve my issue of having to rvm system when using Fastlane. 👍

Thanks @djtarazona, preparing a new release right now https://github.com/fastlane/fastlane/pull/6511


Add support for IP style endpoints for datalake

Done for others here https://github.com/Azure/azure-sdk-for-java/pull/5914


Permission help with certain plugin

Hello,
I am extremely new with how plugins with minecraft servers work. I have a server that has multiple worlds (factions and creative plots), and I want to have certain permissions for each rank for each world. I use luckperms for my permissions and I am trying to put permissions for the plugin, plotsquared. I have a few ranks and I want to know how permissions is responsible on figuring out how many plots a certain rank can claim, and how I can set it up. (Example: member - 2 plots, VIP - 4 plots, etc).

LuckPerms itself won't manage plots or anything like that, it's on PlotSquared to provide permission nodes for that.
Try looking at the documentation of the plugin, or, if that doesn't solve your issue, try using Verbose which can show you what permissions are checked in real time.
If you have found a permission to limit that, you can use Context to only have these set in a specific world.


canceling deadline context not honored

When providing a deadline context to Client.ExchangeContext(), canceling is only honored during the dial stage but not during the read or write stage.

The root cause for this is ExchangeWithConnContext using the given context's deadline (see client.go) but not the context itself.
Another issue this causes is ExchangeContext can return before the context is actually done because of the the various timer jitter. I ran into this when writing tests and asserting that ctx.Err() != nil, which wasn't the case because of jitter randomness and the underlying net.Conn timeout timer firing before the context's timer.
This specific issue could be fixed by blocking on <- ctx.Done() when a timeout occurs and  the deadline used comes from the context but I'm not sure if that's worth it.
It also means that when a timeout occurs, errors.Is(err, ctx.Err()), errors.Is(err, context.Canceled) and errors.Is(err, context.DeadlineExceeded) are always false.
I think that unfortunately doing a proper fix for this would need a change to Go's standard library since we need net.Conn to support something like ReadContext.
Then ExchangeWithConnContext could create 2 child contexts of the user provided one: one for all read operations, and one for the writes. That way the user context, and the configured time outs are all respected.
A less ideal fix that might be acceptable is to wrap the IO in a goroutine that we leave running in the background if the context ends before the exchange completes:
func (c *Client) ExchangeWithConnContext(ctx context.Context, m *Msg, co *Conn) (r *Msg, rtt time.Duration, err error) {
	type result struct {
		r   *Msg
		rtt time.Duration
		err error
	}

	ch := make(chan result, 1) // 1: prevent the sender from blocking forever ctx ended first
	go func() {
		defer close(ch)

		r, rtt, err := c.exchangeWithConnContext(ctx, m, co) // this would be the existing ExchangeWithConnContext
		ch <- result{r, rtt, err}
	}()

	select {
	case res := <-ch:
		return res.r, res.rtt, res.err

	case <-ctx.Done():
		return nil, 0, ctx.Err()
	}
}

The good news is this can be done as a workaround outside of this module :)
As writen, it doesn't fix ctx.Err() possibly being nil but that could be added.
@miekg would you be open to merging such a fix?


[Impeller] Consider removing usage of host buffer abstraction during cmd encoding.

Currently all cmd data (uniforms, vertex data) is copied into a HostBuffer, and automatically resizing CPU side buffer. Then when encoding starts, this buffer is copied into an actual device buffer. There is some additional costs with this structure, we need to allocate more memory, we may copy the data multiple times, et cetera.
In theory, all cmds should know exactly how much data they will write, and it may be cheaper to precompute the appropriate device buffer size.

This might not be possible for gl, but we could do it for metal and vulkan. The right way might be some sort of device buffer as a host buffer API

Hey we did this, closing!


xAxis interval option not works with  timeseries line graph

Version
5.0.2
Reproduction link
https://jsfiddle.net/sgLp5mqu/3/
Steps to reproduce
Just run jsfiddle then you can find that the graph interval is not set at above (timeseriese) graph.
I expect 1hour interval(3600000 millisec), however, the result is 4hour interval.
This option is work at exactly same scripts with escharts ver 4.8.0, as you can see below.
https://jsfiddle.net/29r8qdcf/4/
What is expected?
The xAxis interval option with timeseriese works file as same as ver 4
What is actually happening?
I don't know what is happening in the code, correctly.

Similar to #14298 . interval is a reference value and is not used compulsorily. Currently, we have no way to accurately set the interval of time axis but this seems to be a frequently asked feature. Further discussion is required on this topic.

I need to set interval like I add interval of 4 or more years then chart should show axis label after that time period without any other gap like leap or any.
I have added this to get interval of 4 years but due to leap year or any other its shows 1 day difference, and I want to show accurate difference in axis.
interval:new Date(1974, 0, 1, 0, 0, 0, 0).getTime(),
Please consider the below example for this above implementation.
http://jsfiddle.net/d7e09r5t/275/

it should be the same as type 'value' for xAxis, such as
option = {
    xAxis: {
        type: 'value',
        min: 0,
        max: 24,
        interval: 3,
    },
    yAxis: {
        type: 'value'
    },
    series: [{
        data: [[0, 3], [12, 5], [24, 3]],
        type: 'line'
    }]
};

but it does not work for 'time' type:
const min = new Date('2021-02-01 00:00:00');
const middle = new Date(min.getTime() + 12 * 3600 * 1000);
const max = new Date(min.getTime() + 24 * 3600 * 1000);

option = {
    xAxis: {
        type: 'time',
        min,
        max,
        interval: 3 * 3600 * 1000,
    },
    yAxis: {
        type: 'value'
    },
    series: [{
        data: [[min, 3], [middle, 5], [max, 3]],
        type: 'line'
    }]
};

the interval has no use for xTick after upgrading to v5.

I add one to this, also need interval on time axis, but it does not work.


how-to-add-record-with-pac-power-fx

Category

[x] New article

Contents of the Pull Request
Hello,
Please approve my article about adding new row by using pac power-fx. In case of question please let me know.
Thanks in advanced for your help,
Andrzej Bożyk

thank you for contributing!

Thank you for approval and I am always happy to help😃


db-ip.com schemas

Added schemas location and ISP for db-ip.com.
I've tested these schemas extensively, on Mini, Micro, and production latest scala collector and enricher.
Ideally, you should set this as a Snowplow enrichment.
See example payload below:
    "contexts_com_dbip_location_1": [       {         "city": {           "geoname_id": 5342353,           "names": {             "en": "Del Mar",             "fa": "دل مار، کالیفرنیا",             "ja": "デル・マー",             "zh-CN": "德尔马"           }         },         "continent": {           "code": "NA",           "geoname_id": 6255149,           "names": {             "de": "Nordamerika",             "en": "North America",             "es": "Norteamérica",             "fa": " امریکای شمالی",             "fr": "Amérique Du Nord",             "ja": "北アメリカ大陸",             "ko": "북아메리카",             "pt-BR": "América Do Norte",             "ru": "Северная Америка",             "zh-CN": "北美洲"           }         },         "country": {           "geoname_id": 6252001,           "is_in_european_union": false,           "iso_code": "US",           "names": {             "de": "Vereinigte Staaten von Amerika",             "en": "United States",             "es": "Estados Unidos de América (los)",             "fa": "ایالات متحدهٔ امریکا",             "fr": "États-Unis",             "ja": "アメリカ合衆国",             "ko": "미국",             "pt-BR": "Estados Unidos",             "ru": "США",             "zh-CN": "美国"           }         },         "location": {           "latitude": 32.9595,           "longitude": -117.265,           "time_zone": "America/Los_Angeles",           "weather_code": "USCA0288"         },         "postal": {           "code": "92014"         },         "subdivisions": [           {             "geoname_id": 5332921,             "iso_code": "CA",             "names": {               "de": "Kalifornien",               "en": "California",               "es": "California",               "fa": "کالیفرنیا",               "fr": "Californie",               "ja": "カリフォルニア州",               "ko": "캘리포니아 주",               "pt-BR": "Califórnia",               "ru": "Калифорния",               "zh-CN": "加利福尼亚州"             }           },           {             "geoname_id": 5391832,             "names": {               "en": "San Diego",               "es": "Condado de San Diego",               "fa": "شهرستان سن دیگو، کالیفرنیا",               "fr": "Comté de San Diego",               "ja": "サンディエゴ郡",               "ko": "샌디에이고 군",               "pt-BR": "Condado de San Diego",               "ru": "Сан-Диего",               "zh-CN": "圣迭戈县"             }           }         ]       }     ]
and ISP
    "contexts_com_dbip_isp_1": [       {         "traits": {           "autonomous_system_number": 20001,           "autonomous_system_organization": "Charter Communications Inc",           "connection_type": "Corporate",           "isp": "Charter Communications",           "organization": "Spectrum"         }       }     ]

Bump @yalisassoon !

Hi @joaolcorreia
Sorry for not dropping a note on this PR. We've been migrating the release of iglu central to Github Actions and are doing an internal only release first to check its all working as intended (R121).
We'll look to include community contributed schemas in our next release.

Ping @paulboocock ... can someone approve this?

Hi @joaolcorreia
Unfortunately, we don’t have any way to test this so that we can maintain it appropriately once it’s in Iglu Central, so our suggestion for schemas like this is to self host them in your own Iglu Server. For Schemas specific to your use case, a private Iglu Server will always be a better option than Iglu Central, as going forward we want to ensure the schemas on Iglu Central are correct and maintained, something we struggle to do with the variety of community contributed schemas.
That's not to say we're closed off to schema contributions. However we will likely only accept ones we feel we can effectively maintain and that offer a benefit to the wider Snowplow userbase. I'm not sure this one falls into that category as it's quite specific to an alternative solution that overlaps with the existing Maxmind IP Lookup Enrichment.


Adding ADAGE model to tsne visualization

Quick check if ADAGE (z=100) is learning large sources of variation in the data.

Here are my comments Greg.  This was really helpful for me to review as I start to work on my t-SNE for GTEx!

Thanks @ajlee21 - I believe I addressed all of your concerns in 05c2b5b


GEOMESA-1499,GEOMESA-2038 Download script improvements

Allows override of maven server via GEOMESA_MAVEN_URL env variable
Uses curl instead of wget
Moves download code into common function
Lists jars being downloaded before confirming
Downloads up to 4 jars simultaneously using xargs
Defaults to GEOMESA_XX_HOME/lib as the download location
Removes ability to specify versions on the command line - must edit files instead

Note: requires at least v1.1.0 of 'sphinx_tabs' installed to build docs
Signed-off-by: Emilio Lahr-Vivaz<EMAIL_ADDRESS>

@jahhulbert-ccri do you want to review this?

@elahrvivaz this has merge conflicts now...  @jahhulbert-ccri any interest in reviewing?  If not, I can skim and merge once the conflicts are sorted out.

fixed conflicts, thanks

@jahhulbert-ccri should probably review if he has time, this is based on tickets he opened so it'd be good if he verified it's what he wants.

Carp, more conflicts.  And yes, I am fine with @jahhulbert-ccri reviewing.  Sounded like he'd have some time over the holidays.

fixed conflicts


Support for Gemma 2?

What would be required to support Gemma 2?
I'd be happy to chip in and help with the code, I just need to have a bit of insight into what would need to be changed?

Hello @sdmorrey,
you should check llama2-tasks.cpp and grok1-tasks.cpp files. For different architectures DL builds a different task list. Tasks are reused of course (in grok1-tasks.cpp you can see the implementation of different tasks than Llama mode uses).
I see Gemma 2 has more norm layers. Rope layer it seems it's already implemented (FalconRopeCommand). Probably the tokenizer is something that may need more work (converter), but I'm not sure.

+1 for Gemma 2


Fetch Discord IDs

We should add a snippet for the fellowbot to fetch and log out all the Discord IDs from our MLH Fellowship server.

Closed by PR https://github.com/shu8/mlh-fellowship-0.2.1-halfway-hackathon/pull/3


listener: fix sharedSocket

Commit Message:
The background is that a tcp listener which doesn't bind to port does not own io_handle. There is a code path that using ListenSocketFactory::sharedSocket() to obtain the socket and call io handle without checking if io handle is needed.
SharedSocket now returns nullopt when the tcp listener does not bind_to_port even if reuse_port set to true.
Additional Description:
Risk Level: LOW
Testing: added test that crashes on existing code. Also fixed a ListenerManagerImplTest
Docs Changes:
Release Notes:
Platform Specific Features:
[Optional Runtime guard:]
[Optional Fixes #Issue]
[Optional Deprecated:]
[Optional API Considerations:]

/retest

Do you have any idea why the CI is not completed in time? @ggreenway
Also, what are the changes needed other than CI?

I haven't reviewed this PR yet, but if it helps you in any way, I'm in the process of getting rid of the sharedSocket() function entirely. You can see my WIP branch here (this is about changing the default of reuse_port as well as making almost all listener errors happen on the main thread vs. workers which vastly simplifies error handling): https://github.com/envoyproxy/envoy/commit/22361bc12ae1d1653e2c80b4ab9a6e5bd6583681

I haven't reviewed this PR yet, but if it helps you in any way, I'm in the process of getting rid of the sharedSocket() function entirely. You can see my WIP branch here (this is about changing the default of reuse_port as well as making almost all listener errors happen on the main thread vs. workers which vastly simplifies error handling): 22361bc

+1 for killing sharedSocket() or mutate reuse_port.  I recall the changes (was a PR IIRC).
The blocker to me is not the sharedSocket() nor the default value.  It's the crash at the rare combination listed in the added test case in this PR.
Can we merge this to fix the PR?


Invalid Configuration request on scan_bluetooth

When I press the scan_bluetooth button in HA, I get this error message
Received MQTT message: tesla_ble/config scan_bluetooth
Configuration scan_bluetooth requested
Invalid Configuration request. Topic: tesla_ble/config Message: scan_bluetooth

This one is work in progress. On my repo I intend to calculate the SxxxxxxxxxxxxxxxxC version from the VIN then can for this so the user can select the corresponding 74:B8:39:XX:YY:ZZ version
I haven't found a way of calculating the 74:B8:39:XX:YY:ZZ  version from the VIN

@raphmur I'll fix this one

@iainbullock since I had to split PR #16 , while in there I made changes to BLE_MAC and adding function to generate the value. See PR #26

Excellent work thanks. I could calculated the advertisement string but not the MAC. I will look at your code to see how you did it!

I took the code from here - did I miss something? 🤔

I haven't had time to check the code. The advertisement string will work but I think the MAC is preferable as it appears on the scan more frequently

@baylanger please do not call it MAC. Your code is computing the S...C advertisement code. It is not computing the MAC.

It is BLE_MAC just because I reused the var name :)

If the advertisement code is sufficient for detection, then great 👍 but it is still not a MAC.

Agreed on the MAC.
I was reading on this topic.

The 'MAC' in BLE world is called "Bluetooth Device Address"
I'm unclear if the "S...C" is refereed as "Bluetooth Device Name" or something else.... so I'm unclear how to rename the variable ... could always use "BLE_SC" :D

I haven't had time to check the code. The advertisement string will work but I think the MAC is preferable as it appears on the scan more frequently

When I use nRF Connect I never see a BLE Device Address. I look at the app's settings, I don't see what I could change. I do see other devices' address but definitely not from the vehicle.

I'll get a screenshot from android ble scanner tomorrow

@epenet
Please can you run this. You should get your MAC. I was going to include this in the repo but can't test it as I'm on holiday and car is not at home. Use the VIN for your case of course
VIN_HASH=echo -n "LRW3Fxxxxxxxxxxx03" | sha1sum
BLE_ADVERT=S${VIN_HASH:0:16}C
bluetoothctl --timeout 10 scan on | grep $BLE_ADVERT

I am with the car... 20km from HA. So won't be before tomorrow.
I'm also not sure how to run those commands. Is it on the HA root ssh? Or do I need to somehow jump onto the addon terminal?

Ok no problem. HA root ssh should be ok.

@epenet
Please can you run this. You should get your MAC. I was going to include this in the repo but can't test it as I'm on holiday and car is not at home. Use the VIN for your case of course
VIN_HASH=echo -n "LRW3Fxxxxxxxxxxx03" | sha1sum BLE_ADVERT=S${VIN_HASH:0:16}C
bluetoothctl --timeout 10 scan on | grep $BLE_ADVERT

It returns the S....C name not the device address:
$ VIN_HASH=$(echo -n "5YJ3E1EB6JFxxxxxx" | sha1sum | sed -e 's/ .*//g')
$ echo $VIN_HASH
bd04bf13a78c1f0e6a17f8xxxxxxxxxb4ad2
$ BLE_ADVERT=S${VIN_HASH:0:16}C; echo $BLE_ADVERT
Sbd04bxxxxxxx0eC

I'll update the PR to use that to generate the S..C name instead of the Python code.

Can you run
bluetoothctl --timeout 10 scan on | grep $BLE_ADVERT
Does that not report anything?
Thanks

I managed to run it from my phone via ssh addon
It doesn't report anything for either advert or mac
$ bluetoothctl --timeout 10 scan on | grep $BLE_ADVERT
$ bluetoothctl --timeout 10 scan on | grep $BLE_MAC

Oh it was previously working aka "reporting the presence" because of this bug now fixed in PR #22  - lol

Is it possible the Device Address is only reported when the car is awake but the "S.....C" name reported all the time?   I didn't wake up my car earlier when I went to try to see an address.

Maybe or I'm thinking I might have had another device associated with the car that I thought was the car. I can't test my situation until I get home

I'll get a screenshot from android ble scanner tomorrow

I went back to the vehicle - not sure on Android but nRF Connect allows filtering by signal strength... setting a minimum value, the S..C name shows up but no address at all.
Dig around and found out that bluetoothctl might not look by default for LE devices.
menu scan
transport le
back
scan on

bluetoothctl man page
I'm unclear if a scan off is required to change the transport. If so....
# scan off
[bluetooth]# Failed to stop discovery: org.bluez.Error.Failed

Perhaps we need to configure bluez for LE transport?!

Anyone has hcitool lescan configured on one of their box?  Apparently that one can scan for BLE devices.... it might output the device's address + the name (in our case the S...C name) but I'm not sure.
I tried adding more tools but it fails.
RUN apk add --no-cache bluez-tools
RUN apk add --no-cache rfkill
RUN apk add --no-cache rfcomm

Not pro enough to figure out if there's an easy way to add those... unless we git checkout/compile & install?

Ref: https://www.pcsuggest.com/linux-bluetooth-setup-hcitool-bluez/

I'm doing mine in a docker environment so it might produce different result to the add on situation

Hi all
Thanks for your involvement! I will try and catchup tomorrow on the PRs

Hi all Thanks for your involvement! I will try and catchup tomorrow on the PRs

Little note my PRs - To reduce as much as possible any conflict, each PR was merged with the previous one. They were all tested - Except the standalone one but I think it should be just fine.
There's an issue for bluetoothctl to scan LE devices... by default LE isn't enable and bluez might be prevented us to tell bluetoothctl to use "LE transport". See here above ^^
Can't join Discord channel... says invalid or expired :/

From here I ended up on this site explaining a bit in details Tesla BLE.
Something interesting to know:

The vehicle has a BLE connection limit of 3 devices (from what I've seen on my M3LR). If you try to connect another device, it will not be able to, and will just give an error on the device trying to connect.

What does this mean? My phone, my wife's phone and ... the bluetooth dongle and that's it?

Should be solved here https://github.com/tesla-local-control/tesla_ble_mqtt_core/pull/12 @baylanger ?

Processed in v0.1.0 release
As of today we are explicitly requiring the MAC of the car to scan for presence.
But you can use the Scan Bluetooth to search for visible devices
For the next release we will be working on a reliable solution that is all VIN based (ie. no need to provide MAC)


Added support for passing kernel options to preseed via templating

This fixes issue #62

Please, fix lint issue and add a comment to CHANGELOG.md about this change.

LGTM +1

LGTM - thanks!


FCP shows FFmpeg-generated ProRes 4444 alpha as opaque on Sonoma 14.4.1 Apple Silicon; Prores decode errors in log

This not an FCP bug and maybe not a MacOS bug. Filing this to avoid confusion because it may appear like an FCP or MacOS bug.

DESCRIPTION:
Starting with Sonoma 14.4.0 or 14.4.1 on Apple Silicon, FCP 10.7.1 will incorrectly show a transparent ProRes 4444 alpha channel as opaque if the file was generated by certain versions of FFmpeg and the associated Lavf library. Resolve Studio 18.6.6 and Premiere Pro 24.3.0 behave likewise. This does not happen on Intel.
FCP playback will also generate ProRes HW errors in the MacOS system log. There is no user-facing error. These do not appear in Console but can be seen using the terminal "log show" command. Example:
2024-05-11 10:00:27.683661-0500 0x2db      Error       0x0                  0      0    kernel: (AppleProResHW) ERROR: AppleProResHW (0x13e358d7): processDecodeFrameDone(): HW error decSatus=6 status0=0x7f043000 statusCode=63 status2=0x1
FFmpeg versions tested and behavior (Note: ALL cause ProRes HW decode errors, even if alpha transparency is OK)
FFmpeg 7.01, Lavf61.1.100 - transparent alpha channel OK
FFmpeg 7.00, Lavf61.3.103 - transparent alpha channel OK
FFmpeg 6.10, Lavf60.16.100 - transparent alpha channel shows as opaque
FFmpeg 5.??, Lavf58.43.100 - transparent alpha channel shows as opaque
This seems an interpretation problem due to something in the FFmpeg-encoded file. I inspected the alpha-channel values  in the encoded file using the QCTools datascope and they had transparent values (ie close to 0x0000) but appeared as opaque in FCP. See attached datascope screen shot.

HOW TO REPRODUCE:
(1) Use an Apple Silicon machine running Sonoma 14.4.1.
(2) Attached are four 1080p ProRes 4444 files with a transparent alpha channel. Each one is generated by one of the above four versions of FFmpeg and has the above-stated behaviors (version numbers also in the filenames).
Files: https://www.dropbox.com/scl/fo/l6388h0co0q8gwvx1ojcm/AFHdiZwt6wp5MmSKSmT6vEc?rlkey=rvf3kedtlxek4w9gf7ng7lloe&dl=0
(3) Import the four ProRes 4444 files to FCP.
(4) Add each file to a project timeline.
(5) Add beneath each clip a built-in FCP generator to observe if alpha-channel transparency exists.
(6) Examine the MacOS system log using the terminal "log show" command. Example syntax (do within 10 sec of FCP playback):
sudo log show --last 10s > ~/Documents/LogShowOutput_10s.txt
(7) The log is verbose so use BBEdit or similar to filter through the file. Look for the string "AppleProResHW".

SCREENSHOTS:
Filename: QCTools_Datascope_PR4444_AlphaChannel.jpg. QCTools Datascope showing alpha-channel value of 0x0060 (should be nearly transparent), but shows as opaque in FCP on MacOS Sonoma 14.4.1 Apple Silicon.

SPECS:

2022 M1 Ultra Mac Studio (128GB RAM, 8TB SSD)
macOS Sonoma 14.4.1
Final Cut Pro 10.7.1
Also tested: 2019 i9 MacBook Pro 16, 2023 M2 Pro Mac Mini, both running Sonoma 14.4.1

OTHER STEPS TAKEN:

Did binary diff on video files starting with name "QT4444". They are the same except encoded using two different versions of FFmpeg. No apparent differences that would account for the behavior.
Examined metadata of "good" and "bad" QT4444 video files using FFmpeg, FFprobe, ExifTool. No obvious differences at metadata level.
Ran FCP under XCode and set breakpoints to find FFImageRepFFPixelBuffer during playback. Nothing obvious.

TO DO:

Provide various statically-built versions of  FFmpeg in both Intel and Apple Silicon versions
Provide instructions and video files for encoding ProRes 4444 files using FFmpeg
Provide instructions for using the self-encoded files for testing alpha-channel transparency issue

Re-tested on MacOS Sonoma 14.5 M1 Ultra; no change. If using ProRes 4444 files generated by FFmpeg 7.01 using Lavf61.1.100 from a "known good" ProRes source file, the opaque alpha problem does not happen, but both FCP 10.7.1 and Resolve Studio 18.6.6 still get ProResHW decoding errors in the MacOS system log during playback of the FFmpeg-generated ProRes 4444 file, as shown by the terminal command "log show". Does not happen with those same versions on Intel. Whether there are other negative ramifications from the ProResHW errors (stability, performance, etc) is not currently known.


MySensors updates not working anymore - ValueError: 132 is not a valid SetReq

Home Assistant release (hass --version):
0.52.1
Python release (python3 --version):
3.5.2
Component/platform:
MySensors (serial gateway)
Description of problem:
I've had a serial Mysensors gateway running for months, and haven't made any config changes for a long long while -- however in a recent hass versions, the readings from sensors cause an error in the HA logs, and does not update that value in HA.
I'm running mysensors version 2 - and a serial gateway is an arduino uno on a usb port
When messages arrive on the USB serial, this appears in the home assistant log file:
2017-09-03 10:32:40 ERROR (MainThread) [homeassistant.core] Error doing job: Task exception was never retrieved
Traceback (most recent call last):
  File "/usr/lib/python3.5/asyncio/tasks.py", line 239, in _step
    result = coro.send(None)
  File "/usr/local/lib/python3.5/dist-packages/homeassistant/helpers/entity.py", line 247, in async_update_ha_state
    device_attr = self.device_state_attributes
  File "/usr/local/lib/python3.5/dist-packages/homeassistant/components/mysensors.py", line 584, in device_state_attributes
    attr[set_req(value_type).name] = value
  File "/usr/lib/python3.5/enum.py", line 241, in __call__
    return cls.__new__(cls, value)
  File "/usr/lib/python3.5/enum.py", line 476, in __new__
    raise ValueError("%r is not a valid %s" % (value, cls.__name__))
ValueError: 109 is not a valid SetReq
2017-09-03 10:32:43 ERROR (MainThread) [homeassistant.core] Error doing job: Task exception was never retrieved
Traceback (most recent call last):
  File "/usr/lib/python3.5/asyncio/tasks.py", line 239, in _step
    result = coro.send(None)
  File "/usr/local/lib/python3.5/dist-packages/homeassistant/helpers/entity.py", line 247, in async_update_ha_state
    device_attr = self.device_state_attributes
  File "/usr/local/lib/python3.5/dist-packages/homeassistant/components/mysensors.py", line 584, in device_state_attributes
    attr[set_req(value_type).name] = value
  File "/usr/lib/python3.5/enum.py", line 241, in __call__
    return cls.__new__(cls, value)
  File "/usr/lib/python3.5/enum.py", line 476, in __new__
    raise ValueError("%r is not a valid %s" % (value, cls.__name__))
ValueError: 132 is not a valid SetReq

The Value changes for every message - the Node_id of the sensor is apparently the interger 132 or 109 being used as a SetReq. (there are about 40 sensors that his gateway can hear)
There's one of these errors logged on every message the gateway receives.
Expected:
Problem-relevant configuration.yaml entries and steps to reproduce:
mysensors:
  gateways:
    - device: '/dev/ttyUSB0'
      baud_rate: 115200
  optimistic: true
  version: 2.0

If you have a JSON persistence file we can check that to see if we find a value type with a bad number.

This thread has a similar story:
https://community.home-assistant.io/t/mysensors-value-type-101-is-not-valid-for-mysensors-version-2-0/24884

thanks - i've mv mysensors.json mysensors.json.bak and now the readings are coming in from lots of nodes.

Alas, that only fixed it temporarily. It goes back to not saving any of the nodes after a few minutes.
ValueError: 132 is not a valid SetReq
ValueError: 109 is not a valid SetReq
ValueError: 132 is not a valid SetReq
ValueError: 109 is not a valid SetReq
ValueError: 109 is not a valid SetReq
ValueError: 132 is not a valid SetReq
ValueError: 109 is not a valid SetReq
ValueError: 109 is not a valid SetReq
ValueError: 109 is not a valid SetReq
ValueError: 132 is not a valid SetReq
ValueError: 132 is not a valid SetReq
ValueError: 101 is not a valid SetReq
ValueError: 101 is not a valid SetReq
ValueError: 132 is not a valid SetReq

These were working great for a long time -- so what's changed? it seems like whatever condition triggers this stops all mysensors nodes from being understood by HomeAssistant

We have to find out where these values come from. They are not valid value types for set or req messages according to the mysensors serial API. A serial log of a node that has the bad value and a parallel log of home assistant could shed some light.

How about the bad SetReq is caught before it's written to the file?
Cos right now, one bad presentation makes all sensors stop working.

All messages received should be validated before being passed on. I'm not sure why that doesn't happen in your case.


BFT Block Puller: A connection source that is updated immediately after a config block is sent to gossip

Right now the connection source (set of orderers) is updated when a config block is committed.  We should change that so that the connection source is updated after a config block is validated and sent to gossip.

See also review comments: https://github.com/hyperledger/fabric/pull/4292#discussion_r1281540753


fix problem with hooks

@MarceloAplanalp looks good! Merging the pull request. Feel free to email me at<EMAIL_ADDRESS>so I can send you some free Branch swag for helping us with this issue.
Best,


chore: add trimpath build flag

This adds trimpath build flag which will turn absolute file paths for each log record:
INFO[0000]/home/lzap/edge-api/pkg/jobs/memory.go:96 github.com/redhatinsights/edge-api/pkg/jobs.(*MemoryWorker).Start() Started worker with uuid fa1842d3-ee95-49ed-94ce-f77380e235ac  build_commit=8177f build_time="2024-05-17T11:06:47Z"

Into package-based one:
INFO[0000]github.com/redhatinsights/edge-api/pkg/jobs/memory.go:96 github.com/redhatinsights/edge-api/pkg/jobs.(*MemoryWorker).Start() Started worker with uuid 8bc7b52e-9a20-419c-8e39-6b59c2fe0686  build_commit=8177f build_time="2024-05-17T11:06:47Z"

That is all it does.

Well my hopes were the path will be shorter but it actually made it a bit longer. At least it is not random :-)


fricas: 1.3.2 -> 1.3.3

Semi-automatic update generated by https://github.com/ryantm/nix-update tools. These checks were done:

built on NixOS
ran /nix/store/gbxxlzids227g9xaiqyqp2hp8ccmkfvq-fricas-1.3.3/bin/fricas -h got 0 exit code
ran /nix/store/gbxxlzids227g9xaiqyqp2hp8ccmkfvq-fricas-1.3.3/bin/fricas -h and found version 1.3.3
ran /nix/store/gbxxlzids227g9xaiqyqp2hp8ccmkfvq-fricas-1.3.3/bin/efricas --help got 0 exit code
found 1.3.3 with grep in /nix/store/gbxxlzids227g9xaiqyqp2hp8ccmkfvq-fricas-1.3.3

cc @sprock for review

No attempt on x86_64-darwin
The following builds were skipped because they don't evaluate on x86_64-darwin: fricas
No log is available.

Success on aarch64-linux (full log)
Attempted: fricas
Partial log (click to expand)
patching script interpreter paths in /nix/store/jv2fpicm7xi98xdhmz7z5b1gzbmccdjj-fricas-1.3.3
/nix/store/jv2fpicm7xi98xdhmz7z5b1gzbmccdjj-fricas-1.3.3/bin/efricas: interpreter directive changed from "/bin/sh -" to "/nix/store/lnws52qanbi5vz8qg24v4ym57nznfndg-bash-4.4-p12/bin/sh -"
/nix/store/jv2fpicm7xi98xdhmz7z5b1gzbmccdjj-fricas-1.3.3/bin/fricas: interpreter directive changed from "/bin/sh -" to "/nix/store/lnws52qanbi5vz8qg24v4ym57nznfndg-bash-4.4-p12/bin/sh -"
/nix/store/jv2fpicm7xi98xdhmz7z5b1gzbmccdjj-fricas-1.3.3/lib/fricas/target/aarch64-unknown-linux-gnu/bin/fricas: interpreter directive changed from "/bin/sh -" to "/nix/store/lnws52qanbi5vz8qg24v4ym57nznfndg-bash-4.4-p12/bin/sh -"
basename: invalid option -- 'f'
Try 'basename --help' for more information.
/nix/store/jv2fpicm7xi98xdhmz7z5b1gzbmccdjj-fricas-1.3.3/lib/fricas/target/aarch64-unknown-linux-gnu/lib/htsearch: interpreter directive changed from "/bin/sh" to "/nix/store/lnws52qanbi5vz8qg24v4ym57nznfndg-bash-4.4-p12/bin/sh"
/nix/store/jv2fpicm7xi98xdhmz7z5b1gzbmccdjj-fricas-1.3.3/lib/fricas/target/aarch64-unknown-linux-gnu/lib/SPADEDIT: interpreter directive changed from " /bin/sh" to "/nix/store/lnws52qanbi5vz8qg24v4ym57nznfndg-bash-4.4-p12/bin/sh"
checking for references to /build in /nix/store/jv2fpicm7xi98xdhmz7z5b1gzbmccdjj-fricas-1.3.3...
/nix/store/jv2fpicm7xi98xdhmz7z5b1gzbmccdjj-fricas-1.3.3


[Question]: Got following error after deleting document from index and doing new query on index raise ValueError(f"doc_id {doc_id} not found.") ValueError: doc_id fd17f519-5e80-4364-a1ac-be2ebf8187f5 not found.

Question Validation

[X] I have searched both the documentation and discord for an answer.

Question
I'm executing following line of code:
new_index.storage_context.persist(persist_dir="saved_index")
 storage_context = StorageContext.from_defaults(persist_dir="saved_index")
 index = load_index_from_storage(storage_context,embed_model=embed_model,store_nodes_override=True)
 query_engine = index.as_query_engine(llm=local_llm,storage_context=storage_context,similarity_top_k=26,streaming=True)
query_engine.query(question)

it works but once I delete docmeuent with this method
index.docstore.delete_document(doc_id)
I'm getting following error:
 raise ValueError(f"doc_id {doc_id} not found.") ValueError: doc_id fd17f519-5e80-4364-a1ac-be2ebf8187f5 not found.
Can You help me how to sove this issue?

It's not helpful. If index.docstore.delete_document(doc_id) method is not erasing document from index. then what method or sequence of methods I should use to delete document and be able to query index nest?