[Bug]: flutter depends on temurin8-jdk, but it can't run on that version of JDK

Prerequisites

[X] I have written a descriptive issue title.
[X] I have searched all issues/PRs to ensure it has not already been reported or fixed.
[X] I have verified that I am using the latest version of Scoop and corresponding bucket.

Package Name
flutter
Expected/Current Behaviour
flutter depends on temurin8-jdk, but actually running the flutter command to accept the Android SDK licenses fails on that JDK version.
Steps to Reproduce
install temurin8-jdk (without any other JDK/JRE), install flutter, then try to run `flutter doctor --android-licenses` (to accept the Android SDK licenses)

PS> scoop install temurin8-jdk
PS> scoop install flutter
PS> flutter doctor --android-licenses

Possible Solution
Installing a newer JDK (i have temurin17-jdk installed personally) allows
Scoop and Buckets Version
Current Scoop version:
v0.3.1 - Released at 2022-11-15

'extras' bucket:
31469bc0a (HEAD -> master, origin/master, origin/HEAD<EMAIL_ADDRESS>Fix hash (Closes #10410)

'java' bucket:
53ffa7f8 (HEAD -> master, origin/master, origin/HEAD) temurin19-nightly-jdk: Update to version 19.0.2-7.0.202302020347

'main' bucket:
4694db89f (HEAD -> master, origin/master, origin/HEAD) keptn: Add version 1.1.0 (#4412)

'nerd-fonts' bucket:
ac2c7cb (HEAD -> master, origin/master, origin/HEAD) andika: Update to version 6.200

'versions' bucket:
14e96329b (HEAD -> master, origin/master, origin/HEAD) sharex-dev: Fix url (#974)

Scoop Config
last_update         aria2-enabled scoop_repo                              scoop_branch
-----------         ------------- ----------                              ------------
2/2/2023 8:56:03 PM          True https://github.com/ScoopInstaller/Scoop master

PowerShell Version
Name                           Value
----                           -----
PSVersion                      7.2.8
PSEdition                      Core
GitCommitId                    7.2.8
OS                             Microsoft Windows 10.0.19045
Platform                       Win32NT
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0…}
PSRemotingProtocolVersion      2.3
SerializationVersion           <IP_ADDRESS>
WSManStackVersion              3.0

Additional Softwares
No response

Please leave the full output of the installation.

❯ scoop install temurin8-jdk
Installing 'temurin8-jdk' (8.0.362-9) [64bit] from java bucket
Loading OpenJDK8U-jdk_x64_windows_hotspot_8u362b09.zip from cache
Checking hash of OpenJDK8U-jdk_x64_windows_hotspot_8u362b09.zip ... ok.
Extracting OpenJDK8U-jdk_x64_windows_hotspot_8u362b09.zip ... done.
Linking ~\scoop\apps\temurin8-jdk\current => ~\scoop\apps\temurin8-jdk\8.0.362-9
'temurin8-jdk' (8.0.362-9) was installed successfully!

❯ scoop install flutter
Installing 'adb' (33.0.3) [64bit] from main bucket
platform-tools_r33.0.3-windows.zip (5.4 MB) [=============================================================================] 100%
Checking hash of platform-tools_r33.0.3-windows.zip ... ok.
Extracting platform-tools_r33.0.3-windows.zip ... done.
Linking ~\scoop\apps\adb\current => ~\scoop\apps\adb\33.0.3
Creating shim for 'adb'.
Creating shim for 'dmtracedump'.
Creating shim for 'etc1tool'.
Creating shim for 'fastboot'.
Creating shim for 'hprof-conv'.
'adb' (33.0.3) was installed successfully!
Installing 'android-sdk' (4333796) [64bit] from extras bucket
Loading sdk-tools-windows-4333796.zip from cache
Checking hash of sdk-tools-windows-4333796.zip ... ok.
Extracting sdk-tools-windows-4333796.zip ... done.
Linking ~\scoop\apps\android-sdk\current => ~\scoop\apps\android-sdk\4333796
Creating shim for 'proguard'.
Creating shim for 'proguardgui'.
Creating shim for 'retrace'.
Creating shim for 'emulator'.
Creating shim for 'emulator-check'.
Creating shim for 'mksdcard'.
Creating shim for 'monitor'.
Persisting .knownPackages
Persisting build-tools
Persisting cmdline-tools
Persisting emulator
Persisting extras
Persisting licenses
Persisting ndk
Persisting patcher
Persisting platforms
Persisting skiaparser
Persisting sources
Persisting system-images
Running post_install script...
Warning: File C:\Users\humorce\.android\repositories.cfg could not be loaded.
License android-sdk-license:            ] 10% Computing updates...
---------------------------------------
Terms and Conditions

This is the Android Software Development Kit License Agreement
...
January 16, 2019
---------------------------------------
Accept? (y/N): y
[=======================================] 100% Unzipping... cmdline-tools/lib/RE
'android-sdk' (4333796) was installed successfully!
Installing 'flutter' (3.7.1) [64bit] from extras bucket
Loading flutter_windows_3.7.1-stable.zip from cache
Checking hash of flutter_windows_3.7.1-stable.zip ... ok.
Loading flutter-dev-setup.ps1 from cache
Checking hash of flutter-dev-setup.ps1 ... ok.
Extracting flutter_windows_3.7.1-stable.zip ... done.
Linking ~\scoop\apps\flutter\current => ~\scoop\apps\flutter\3.7.1
Creating shim for 'flutter'.
Creating shim for 'flutter-dev-setup'.
Running post_install script...
No build-tools detected. Installing the latest version... (build-tools;33.0.1)
Warning: File C:\Users\humorce\.android\repositories.cfg could not be loaded.                                        ]
Available platforms:
[1] platforms;android-7
[2] platforms;android-8
[3] platforms;android-9
[4] platforms;android-10
[5] platforms;android-11
[6] platforms;android-12
[7] platforms;android-13
[8] platforms;android-14
[9] platforms;android-15
[10] platforms;android-16
[11] platforms;android-17
[12] platforms;android-18
[13] platforms;android-19
[14] platforms;android-20
[15] platforms;android-21
[16] platforms;android-22
[17] platforms;android-23
[18] platforms;android-24
[19] platforms;android-25
[20] platforms;android-26
[21] platforms;android-27
[22] platforms;android-28
[23] platforms;android-29
[24] platforms;android-30
[25] platforms;android-31
[26] platforms;android-32
[27] platforms;android-33
For a list of platforms and what they mean, see: https://developer.android.com/about/dashboards/
No platform detected. Please select a platform to install [Default: 27]:
Platform platforms;android-28 selected. Installing...
Warning: File C:\Users\humorce\.android\repositories.cfg could not be loaded.                                        ]
All required dependencies for Android Development are installed.
Some licenses need to be accepted before developing. It is recommended to do by running 'flutter doctor --android-licenses'.
Running "flutter pub get" in flutter_tools...Test                                                                    ]
Resolving dependencies in scoop\apps\flutter\current\packages\flutter_tools... (4.9s)
  _fe_analyzer_shared 50.0.0 (52.0.0 available)
  analyzer 5.2.0 (5.4.0 available)
  archive 3.3.2 (3.3.6 available)
  args 2.3.1 (2.3.2 available)
  built_value 8.4.2 (8.4.3 available)
  checked_yaml 2.0.1 (2.0.2 available)
  collection 1.17.0 (1.17.1 available)
  completion 1.0.0 (1.0.1 available)
  coverage 1.6.1 (1.6.2 available)
  dds 2.5.0 (2.7.4 available)
  dds_service_extensions 1.3.1 (1.3.2 available)
  devtools_shared 2.18.0 (2.20.1 available)
  dwds 16.0.2 (17.0.0 available)
  fixnum 1.0.1 (1.1.0 available)
  frontend_server_client 3.1.0 (3.2.0 available)
  intl 0.17.0 (0.18.0 available)
  io 1.0.3 (1.0.4 available)
  js 0.6.5 (0.6.7 available)
  json_annotation 4.7.0 (4.8.0 available)
  logging 1.1.0 (1.1.1 available)
  matcher 0.12.13 (0.12.14 available)
  meta 1.8.0 (1.9.0 available)
  mime 1.0.2 (1.0.4 available)
  multicast_dns 0.3.2+2 (0.3.2+3 available)
  native_stack_traces 0.5.2 (0.5.5 available)
  path 1.8.2 (1.8.3 available)
  sse 4.1.1 (4.1.2 available)
  test 1.22.0 (1.22.2 available)
  test_api 0.4.16 (0.4.18 available)
  test_core 0.4.20 (0.4.22 available)
  vm_service 9.4.0 (10.1.2 available)
  web_socket_channel 2.2.0 (2.3.0 available)
  webdriver 3.0.1 (3.0.2 available)
Got dependencies in scoop\apps\flutter\current\packages\flutter_tools!
Doctor summary (to see all details, run flutter doctor -v):
[!] Flutter (Channel stable, 3.7.1, on Microsoft Windows [Version 10.0.22621.1105], locale en-US)
    ! Warning: `flutter` on your path resolves to C:\Users\humorce\scoop\shims\flutter, which is not inside your current Flutter SDK
      checkout at C:\Users\humorce\scoop\apps\flutter\current. Consider adding C:\Users\humorce\scoop\apps\flutter\current\bin to
      the front of your path.
    ! Warning: `dart` on your path resolves to C:\Users\humorce\scoop\apps\flutter\3.7.1\bin\cache\dart-sdk\bin\dart.exe, which is
      not inside your current Flutter SDK checkout at C:\Users\humorce\scoop\apps\flutter\current. Consider adding
      C:\Users\humorce\scoop\apps\flutter\current\bin to the front of your path.
[✓] Windows Version (Installed version of Windows is version 10 or higher)
[!] Android toolchain - develop for Android devices (Android SDK version 33.0.1)
    ✗ Flutter requires Android SDK 29 and the Android BuildTools 28.0.3
      To update the Android SDK visit https://flutter.dev/docs/get-started/install/windows#android-setup for detailed instructions.
    ✗ Android license status unknown.
      Run `flutter doctor --android-licenses` to accept the SDK licenses.
      See https://flutter.dev/docs/get-started/install/windows#android-setup for more details.
[✓] Chrome - develop for the web
[✓] Visual Studio - develop for Windows (Visual Studio Community 2022 17.4.4)
[!] Android Studio (not installed)
[✓] VS Code (version 1.75.0)
[✓] Connected device (3 available)
[✓] HTTP Host Availability

'flutter' (3.7.1) was installed successfully!
'flutter' suggests installing 'vscode'.

❯ $env:JAVA_HOME
C:\Users\humorce\scoop\apps\temurin8-jdk\current

Cannot reproduce. but android-sdk will not be installed correctly, under JDK11.
❯ scoop install android-sdk
Installing 'android-sdk' (4333796) [64bit] from extras bucket
Loading sdk-tools-windows-4333796.zip from cache
Checking hash of sdk-tools-windows-4333796.zip ... ok.
Extracting sdk-tools-windows-4333796.zip ... done.
Linking ~\scoop\apps\android-sdk\current => ~\scoop\apps\android-sdk\4333796
Creating shim for 'proguard'.
Creating shim for 'proguardgui'.
Creating shim for 'retrace'.
Creating shim for 'emulator'.
Creating shim for 'emulator-check'.
Creating shim for 'mksdcard'.
Creating shim for 'monitor'.
Persisting .knownPackages
Persisting build-tools
Persisting cmdline-tools
Persisting emulator
Persisting extras
Persisting licenses
Persisting ndk
Persisting patcher
Persisting platforms
Persisting skiaparser
Persisting sources
Persisting system-images
Running post_install script...
Exception in thread "main" java.lang.NoClassDefFoundError: javax/xml/bind/annotation/XmlSchema
        at com.android.repository.api.SchemaModule$SchemaModuleVersion.<init>(SchemaModule.java:156)
        at com.android.repository.api.SchemaModule.<init>(SchemaModule.java:75)
        at com.android.sdklib.repository.AndroidSdkHandler.<clinit>(AndroidSdkHandler.java:81)
        at com.android.sdklib.tool.sdkmanager.SdkManagerCli.main(SdkManagerCli.java:73)
        at com.android.sdklib.tool.sdkmanager.SdkManagerCli.main(SdkManagerCli.java:48)
Caused by: java.lang.ClassNotFoundException: javax.xml.bind.annotation.XmlSchema
        at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
        at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
        ... 5 more
'android-sdk' (4333796) was installed successfully!

❯ $env:JAVA_HOME
C:\Users\humorce\scoop\apps\zulu11-jdk\current

Exception in thread "main" java.lang.UnsupportedClassVersionError: com/android/prefs/AndroidLocationsProvider has been compiled by a more recent version of the Java Runtime (class file version 55.0), this version of the Java Runtime only recognizes class file versions up to 52.0

https://javaalmanac.io/bytecode/versions/

Should depends on openjdk17 and android-clt, Now the dependency is wrong.

I made some changes to this manifest based on the official documentation and it now no longer forces a specific JAVA, extras/android-sdk dependency. DETAILED: #11109
For Android developers, it is recommended to install main/android-clt instead of extras/android-sdk.

So far it is still wrong, flutter-cn.json should not depend on ojdkbuild8, flutter 3.19.2 is incompatible with gradle7


Refactor page/run tests that use the reference implementation

Many of the existing tests use the FormatPage.hs reference implementation of the page binary format, the type PageLogical and its QC generator.
Prior to PR #195 the PageLogical representation was always valid, for all possible values of the representation (at least for the purpose of serialisation, which doesn't care about key sort order). That's because the reference implementation used an unbounded approach to serialisation, rather than insisting that the binary format fit within a fixed disk page size (like 4k).
In PR #195 we introduce fixed disk page sizes, to make the reference implementation and real implementation closer and thus give us an opportunity to simplify tests using the reference impl. A consequence is that PageLogical now represents a superset of valid pages, rather than exactly all valid pages, and so the encodePage now has to be partial.
Furthermore, the tests for the real implementation need (or could be simpler) with a few variations on key/value sequences.
Existing tests
We review what existing tests do, or could do, to help us decide what set of types and QC generators would help us simplify and/or improve the tests. We go in rough order from low to higher level.
RawPage
The RawPage module is for decoding.
Existing tests:

a range of unit tests
a range of focused property tests for each aspect of the page format, or part of the size distribution, comparing against the reference impl

Missing tests:

A general test against the reference impl for the whole page content

The property tests want a type that represents a valid page (with total serialisation) with its logical content. This would make toRawPage total.
PageAcc
This covers a single page, with many key/ops in it, but not the single page case with overflow.
Existing tests:

general prototype test which compares the reference and real impls for a sequence of key/ops, including checking the sequences end at the same point.
several specific instances of prototype providing guaranteed coverage (could perhaps be replaced by labels & coverage conditions)

The existing prototype comparison test could be simplified if we could turn it into a bulk comparison test. Would need a reference impl page construction that returns the suffix that didn't fit.
These tests want a sequence of key/ops that may or may not fit within a page. The generator should cover:

single page, all operations
more than will fit in a page
probably wants a range of sizes: small, near page size

These tests need to exclude single value pages that overflow. This is covered by PageAcc1.
PageAcc1
This covers a single page, with a single key/op in it, including the single page case with overflow.
Existing tests:

two property test covering equal serialised pages between real and reference impl for single key with inserts or upsert
instances of the two above for specific cases (could be replaced by labels and coverage conditions)

These tests want a generator for single key/operation pairs, wants a range of (single value) sizes: small, near page size, overflow, multiple overflow pages.
IndexCompact
The tests here use their own page summary types for test case generation and it's unclear that they would benefit from improved types or generators for pages.
RunAcc
This now covers a whole run, including the bloom filter and compact index.
Existing tests:

now-redundant test about page size == 4k
general test about page matches prototype

currently uses only nearly full pages but unclear why
generates keys that are >= 6 bytes, for compact index
can probably just use the full range of sizes: small, nealy full, overflow, multi-overflow

existing RunAcc tests are a bit of a mess after prior changes, they still talk about old PageAcc.

Missing tests:

Need to test multi-page RFP partitioning
Need general test for run consisting of multiple pages

These tests want a generator for key/op sequences that need not fit one page, and should cover multiple pages.
Need a RFP sequence partitioning, using reference impl within each partition. Reference impl does not need to be taught about RFP. But could provide a simple run construction using unfoldr + concat, in terms of a page construction returning the suffix.
Run
This is like RunAcc but now does file I/O. Much the same tests should still work at this level though.
Existing tests:

some unit tests
round trip write then read, for real impl with itself
property comparing write and open, for real impl with itself

Missing tests:

comparison of serialised run against reference impl
comparison of key/ops decoded from real run, vs original key/ops serialised by reference impl

The extra tests should mirror the RunAcc ones and so need the same types and generators.
Proposal

key/op pair sequences corresponding to a valid page (thus fitting)
key/op pair sequences that may or may not fit into a page
single key/op pair for the single-value page case
key/op pair sequences corresponding to runs of multiple pages (with keys >= 6 bytes)

What would each test use:

RawPage would use 1
PageAcc would use 2
PageAcc1 would use 3
RunAcc and Run would use 4

Extend reference impl to provide a construction function that returns the unconsumed suffix.

IndexCompact
The tests here use their own page summary types for test case generation and it's unclear that they would benefit from improved types or generators for pages.
RunAcc
This now covers a whole run, including the bloom filter and compact index.
Existing tests:
* now-redundant test about page size == 4k

* general test about page matches prototype

  * currently uses only nearly full pages but unclear why

I did some digging in the git history, and I changed the generator at some point from using arbitrary :: Gen PageLogical to genFullPage, I think because the latter allows me to control how to generate keys (with >= 6 bytes), and the former doesn't. But, they don't have to be nearly full for the tests to work, I think, so

  * generates keys that are >= 6 bytes, for compact index
  * can probably just use the full range of sizes: small, nealy full, overflow, multi-overflow

* existing RunAcc tests are a bit of a mess after prior changes, they still talk about old PageAcc.

Missing tests:
* Need to test multi-page RFP partitioning

* Need general test for run consisting of multiple pages

These tests want a generator for key/op sequences that need not fit one page, and should cover multiple pages.
Need a RFP sequence partitioning, using reference impl within each partition. Reference impl does not need to be taught about RFP. But could provide a simple run construction using unfoldr + concat, in terms of a page construction returning the suffix.

If we have this generator for key/op sequences that corresponding to runs of multiple pages, and if knows about RFP and contains sorted keys, then maybe we could use that instead of the page summary generator that we use for the compact index tests


unchecked: false does not work when config.boolean_style = :inline

Notice the in the code samples below how the hidden field is not generated when using the nested boolean style.
Code generated when using the default config.boolean_style = :nested

  <input value="false" type="hidden" name="meal[completed]">

  <input class="boolean optional" type="checkbox" value="true" name="meal[completed]" id="meal_completed">Completed

Code generated when using the default config.boolean_style = :inline

  <input class="boolean optional" type="checkbox" value="true" checked="checked" name="meal[completed]" id="meal_completed">
  Completed

Expected Code generated when using the default config.boolean_style = :inline

  <input value="false" type="hidden" name="meal[completed]">
  <input class="boolean optional" type="checkbox" value="true" checked="checked" name="meal[completed]" id="meal_completed">
  Completed

Update: This bug only appears if you have custom value for unchecked_value. In this case unchecked_value: false
Example
= f.input :completed, as: :boolean, checked_value: true, unchecked_value: false

I've found a work around!
Example
= f.input :completed, as: :boolean, checked_value: true, unchecked_value: false
Change the booleans from ruby true and false to strings 'true' and 'false'
= f.input :completed, as: :boolean, checked_value: 'true', unchecked_value: 'false'

I'm experiencing the same issue without having custom checked/unchecked values. It's only when using boolean_style: :inline that it drops the unchecked value.

My workaround is to put a hidden field before the checkbox to make sure the unchecked value is included:
= f.input :my_boolean_column, as: :hidden, input_html: { value: '0', id: '' }
= f.input :my_boolean_column

Wow banged my head for 2 hrs over this. Seems to be fixed in 2.1.3 the latest/last version for rails 3 you can use. I was using simple_form 2.1.1 where I was having this issue. Could probably close this @josevalim @rafaelfranca

The bug here is that the nested boolean generates the hidden field when unchecked_value is falsey - that deviates from rails behavior since at least version 3.2 (see here: https://github.com/rails/rails/blob/4-2-stable/actionview/lib/action_view/helpers/tags/check_box.rb#L59)
So the fix would be not to create the hidden field when using the nested boolean along with unchecked_value: false. That way nested and inline booleans would behave the same. (If you want to create the hidden field nonetheless you could use unchecked_value: "false").


Simplifying base.txt

I think you can leave the prometheus_client  requirement out of the base.txt file, since that's going to be installed indirectly because it's a requirement in setup.py already.

The reason for the duplication is that we want to be as specific as possible for the Docker images but stay flexible for people installing this via pip :)


Add Collatz Conjecture exercise

Add the Collatz Conjecture exercise in Swift

@masters3d Felt like it was about time for some new exercises.
Any tips on using configlet generate? I gave up and put together the README manually.

I haven't used the config generate. I think most people are putting them together manually right now.


Move domain logic from main.rs to lib

refactoring to get the library ready for 1.0 release (#28)
WIP

Should we move OutputStyle and print_headers, print_statement, print_testcases, print_reverse_mode functions out of the library? They're very specific to the CLI and I don't think it's a good idea to commit to keeping them stable (we don't want to break the clashlib API when we tweak how the clashes are printed in the CLI tool).

Are there any more parts of main.rs that would make sense to provide as part of the clashlib API?

What should the public API of solution look like? The current API is really weird (and basically undocumented). Maybe we should just hide the entire module until we can figure out a better API later?


Some new features

Added buffer.clear() and buffer.fill()

Hi, thanks for the ideas :)
I have to ask though: why remove all the auxiliary files and the test set? I really fail to see how that's relevant to this PR.
What would you use clear and fill for, in a setting where you want a circular buffer? i.e. what use case would this help?

I'm sorry, I get the feeling that you're not sure how git(hub?) works; if you are, then I'm at a loss as to what you're doing. Please come back when you have a useful contribution.


🤝 Onboard DSO

I did a brief demo to @ministryofjustice/studio-webops who are keen to onboard and experiment on the platform
Outstanding Actions

[x] Create onboarding documenation
[ ] Onboard

GitHub: digital-studio-operations
Accounts:

nomis-test
oasys-test

Currently blocked by #16

https://github.com/ministryofjustice/modernisation-platform-environments/pull/4506 has been merged and passed over to @shajida95 🎉


Proposal: new release of DataFusion: 7.0.0

I wonder if it is time to release a new version of datafusion to crates.io?
It would be great to crowdsource:

Update readme / changelog
Update version
(maybe) a blog post?

I am happy to handle creating a release candidate / doing the official voting process.

Yeah, I think we can wait for arrow2 related tickets merged into master?
BTW, I can help write a blog!

arrow2 may be a good driver.
I don't have a good sense of how many projects use datafusion from crates.io (aka what has been released) vs how many use it via a github sha . IOx (my project) uses the sha but I realized that maybe others are waiting for an actual release

There is all sorts of good stuff in DataFusion since we last made a release. Since arrow (C++) just released a 7.0.0 I was thinking to do the same with DataFusion (as @pauldix  says the success of a project is predicated on 1. Making sweet sweet software and 2. telling people about it). We have done 1, and now we need to do a bit more of 2. ✍

Perhaps we can start crowdsourcing points for a post / blog on a google doc.  I've made one here (sry havent had chance to add anything yet but trying to help as i can):
https://docs.google.com/document/d/17uB1GIN58xOehQP5XpJH8J3qA7KDS1WQJzyHzW7L1kU/edit?usp=sharing

I won't have the time to drive the release this time, but happy to help fixing any issue with the existing release automation and guide anyone through the process.

I can drive the release

I will finish this issue https://github.com/apache/arrow-datafusion/issues/1400 before release to give our users a clearer readme

Thanks @matthewmturner  -- I'll try and give the doc another pass through later today

I went through and made more updates and added some git stats.
@alamb let me know if anything in particular I can do to help alleviate the burden on your side.  I'm happy to provide more assistance on releases in general (this one and future).

Thanks you very much @matthewmturner
Things that I think we need to do prior to release:

[ ] Make a PR to update the version in all the crates to 7.0.0
[ ] Create a PR to create a CHANGELOG (I had good luck with the github changelog generator that @jorgecarleitao  setup in arrow-rs once upon a time).
[ ] (nice to have): https://github.com/apache/arrow-datafusion/issues/1741
[ ] Take a pass through the docs site to refresh / improve it / make it "snazzy"

Making the PR to update the version would be sweet 👍
I think it is probably best if I take an initial swag at running the changelog generator thing as it requires the ability to mess with tickets titles / tags.

Here is a proposed changelog. https://github.com/apache/arrow-datafusion/pull/1807#
I guess it is probably time to cut a release branch. Does anyone know if we are waiting for anything else to be merged? @xudong963  @matthewmturner @Dandandan @houqp @Dandandan @Jimexist @andygrove ?

@HaoYang670 did you get a chance to work on #1741?
@alamb its probably too late to have any impact for this release, but for my info, can we only do updates to the user guide / website (https://arrow.apache.org/datafusion/) when we have a release?  I figure any docs.rs update will have to be linked to a release.
Otherwise, okay for me.

can we only do updates to the user guide / website (https://arrow.apache.org/datafusion/) when we have a release?

No, we can update https://arrow.apache.org/datafusion/ (the hosted version of https://github.com/apache/arrow-datafusion/tree/master/docs) any time we want 👍

I guess it is probably time to cut a release branch. Does anyone know if we are waiting for anything else to be merged?

I take a quick look at our unmerged tickets, I think no. Thanks for your nice work! @alamb

I am working on https://github.com/apache/arrow-datafusion/issues/1741
these days. And I will file a PR today.
On Fri, 11 Feb 2022 at 06:52, Matthew Turner @.***>
wrote:

@HaoYang670 https://github.com/HaoYang670 did you get a chance to work
on #1741 https://github.com/apache/arrow-datafusion/issues/1741?
@alamb https://github.com/alamb its probably too late to have any
impact for this release, but for my info, can we only do updates to the
user guide / website (https://arrow.apache.org/datafusion/) when we have
a release? I figure any docs.rs update will have to be linked to a
release.
Otherwise, okay for me.
—
Reply to this email directly, view it on GitHub
https://github.com/apache/arrow-datafusion/issues/1587#issuecomment-1035613604,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AODUWFWDLAYIZVGD37JIUD3U2Q6R5ANCNFSM5MCWOZLA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you were mentioned.Message ID:
@.***>

I am going to do a dry run today of publishing datafusion to crates.io (will use an 0.1.xx version to test)

I tested publishing 7.0.0-alpha to crates.io using https://github.com/alamb/arrow-datafusion/tree/alamb/test_publish
then going into each crate like this:
cd datafusion-common && cargo publish

https://crates.io/crates/datafusion-common/7.0.0-alpha
https://crates.io/crates/datafusion-expr/7.0.0-alpha
https://crates.io/crates/datafusion/7.0.0-alpha

One thing I noticed is that datafusion-cli depends on ballista, and so without a ballista release we can't also do a datafusion-cli release 🤔  But maybe that is ok and we can do a datafusion-cli release later (or maybe even move datafusion cli into the contrib repo, or perhaps make the ballista dependency optional)

I had thought about moving datafusion-cli to datafusion-contrib as well.  This does seem generally aligned with moving things out of the datafusion repo that arent actually datafusion (i.e. datafusion-python).  It does also seem reasonable to make ballista optional.

@Jimexist That's a really good point - I have found it helpful as well. But couldn't we do something like the below in 'cargo.toml' from the datafusion-cli repo to achieve a similar experience? Not quite as convenient but I think it's close.
'''
[dependencies]
datafusion = { path = "../path/to/datafusion" }
'''

Having a cli in repo helps a lot with debugging in my opinion

This is an excellent point @Jimexist  -- I use the cli extensively during debugging.

But couldn't we do something like the below in cargo.toml from the datafusion-cli repo to achieve a similar experience? Not quite as convenient but I think it's close.

I think we could @matthewmturner  but I think that will effectively require people to have checked out the datafusion-cli repo any time they want to build datafusion; So if it is required to build datafusion,  the benefits of putting it in a separate repo seem pretty small 🤔

Filed https://github.com/apache/arrow-datafusion/issues/1814 to see if we can solict some more help for the doc site

https://github.com/apache/arrow-datafusion/pull/1816 <-- for optional ballista feature in datafusion-cli

🤔  I don't think  https://github.com/apache/arrow-datafusion/pull/1816 is sufficient to publish datafusion-cli to crates.io -- cargo still tries to resolve the dependencies of ballista (even though it is an optional dependency)
The only way I could get it to publish was to comment out the ballista dependency all together 8750db3bea 🤔

Update here: I would like to wait for the arrow 9.0.0 release to be published (later today or tomorrow) and then update datafusion to use it: https://github.com/apache/arrow-datafusion/pull/1775
Then I'll try and make a release candidate tomorrow or Monday
Its going to be great!

I am actively working to create a release candidate for datafusion 7.0.0

@matthewmturner would you be willing to start a PR for a blog post:   https://docs.google.com/document/d/17uB1GIN58xOehQP5XpJH8J3qA7KDS1WQJzyHzW7L1kU/edit?usp=sharing ?
The DataFusion 6.0.0 announcement is here for reference:  https://github.com/apache/arrow-site/pull/160

@matthewmturner would you be willing to start a PR for a blog post: https://docs.google.com/document/d/17uB1GIN58xOehQP5XpJH8J3qA7KDS1WQJzyHzW7L1kU/edit?usp=sharing ?
The DataFusion 6.0.0 announcement is here for reference: apache/arrow-site#160

Sure - will do now!

Official mailing list post with all the details is here: https://lists.apache.org/thread/t8381y8x1t452dvqr3y7h85q4dncvwrx

Thanks, @alamb @matthewmturner https://github.com/matthewmturner!
Matthew Turner @.***> 于2022年2月14日周一 22:58写道：

@matthewmturner https://github.com/matthewmturner would you be willing
to start a PR for a blog post:
https://docs.google.com/document/d/17uB1GIN58xOehQP5XpJH8J3qA7KDS1WQJzyHzW7L1kU/edit?usp=sharing
?
The DataFusion 6.0.0 announcement is here for reference:
apache/arrow-site#160 https://github.com/apache/arrow-site/pull/160
Sure - will do now!
—
Reply to this email directly, view it on GitHub
https://github.com/apache/arrow-datafusion/issues/1587#issuecomment-1039175388,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AKAI26JYTSVTPDVZHKVWPYTU3EJAXANCNFSM5MCWOZLA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you were mentioned.Message ID:
@.***>

The release was approved and published 🎉
Mailing list thread is here: https://lists.apache.org/thread/hcpcf3shlt0l3fm2k313tq1tvrczlowf
The release is available here:
https://dist.apache.org/repos/dist/release/arrow/arrow-datafusion-7.0.0
I have also published it to crates.io here:
https://crates.io/crates/datafusion/7.0.0


feat: export additional types from service-utils

Problem solved
Short description of the bug fixed or feature added

PR-Codex overview
This PR focuses on updating the @thirdweb-dev/service-utils package by exporting additional types from the core/api.js file, enhancing type definitions for better type safety and usability.
Detailed summary

Updated @thirdweb-dev/service-utils to a patch version.
Exported types from ./core/api.js:

ApiKeyMetadata
AccountMetadata
ApiAccountResponse
ApiResponse
CoreServiceConfig
PolicyResult
UserOpData

✨ Ask PR-Codex anything about this PR by commenting with /codex {your question}

#4946  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @joaquim-verges and the rest of your teammates on  Graphite


when will the new update release?

my program needs an update to fix the item price of life savers and others. when will the new update be released?

It will be released today but next time dont ask in discussions or the discord server instead of issues


Fixing FSIM issues with FDO_SYS

Fixing FSIM issues with FDO_SYS.

Validated on PRI-FIDOIOT with Java Device, its working


Multiple node selection - no way to specify in package.json if command is part of multiple node selection

Does this issue occur when all extensions are disabled?: Yes/No

VS Code Version: 1.88.0
OS Version: Windows 11

Steps to Reproduce:
I have enabled multiple node selection of treeview. On right click of the node, they display different commands as per context value defined in package.json.
I did not find way to set context value in package.json to know if command is part of multiple node selection.
e.g. let's assume, there are three nodes N1, N2 and N3.
N1 can have three commands C1, C2 and C3 ,
N2 can have two commands C1 and C4 and
N3 can have two commands C3 and C4.
In above case C1 command can be possible on two nodes (N1 and N2) and C4 on Two nodes (N2 and N3) while C3 is unique to N1
Since C1 command and C4 command can be possible on multiple nodes so I need to know how to specify this in package. Json?

Thanks for creating this issue! It looks like you may be using an old version of VS Code, the latest stable release is 1.88.1. Please try upgrading to the latest version and checking whether this issue remains.
Happy Coding!

This issue exists on vscode version 1.88.1 as well.

but how to show commands that are applicable to all the currently selected nodes ?

If N1 supports three commands C1,C2 and C3 and
N2 supports three commands  C2,C4 and C5
If only N1 is selected then on right click on N1  we want to show three commands - C1, C2 and C3
If only N2 is selected then on right click on N2  we want to show three commands -  C2 , C4 and C5
but when both nodes N1 and N2 are selected then on right click of N1 or N2 we need to show only one common command which is C2  so how we can achieve this?

VS Code should handle this with https://github.com/microsoft/vscode/issues/210046#issuecomment-2051800095


[VL] Decouple velox benchmarks/tests build from gluten cpp benchmarks/tests build

What changes were proposed in this pull request?

Remove VELOX_BUILD_BENCHMARKS as it was removed in upstream velox. Use VELOX_ENABLE_BENCHMARKS instead.
Decouple building gluten cpp benchmark & building velox benchmark. There is no dependency between them. Added a new option --build_velox_benchmarks to control whether to build velox benchmark.
Decouple building gluten cpp tests & building velox tests. Also, there is no dependency between them. Added a new build option --build_velox_tests to control whether to build velox tests.

How was this patch tested?
Existing tests.

@JkSelf, could you please take a review? Thanks!


Moved project to root dir

@monsieurtanuki this is probably what you mentioned before, I just tried putting smooth_app into the root dir, I just fear that this isn't so great for the git history.
Also CI is probably going to fail but this isn't going to be hard to fix if we decide to merge

@M123-dev Of course that would be terrible for GIT history!
For the moment we have much more important things to do, e.g. managing to compile.
Please test locally if at least that would work (being able to run the app from Android Studio). If that doesn't work, I don't see the point of this PR. Even if it does work, that would be just a test, like "We know that if we want to run flutter from Android Studio, there's a solution". And just forget the whole thing.

Sounds good postphoning to later


BREAKING: remove RequiresApi and drop support for API 19

This PR drops support for API 19 and adds support for API 29 and can be merged after cordova-android 9 is released.

:tada: This PR is included in version 5.0.0 :tada:
The release is available on:

GitHub release
npm package (@latest dist-tag)

Your semantic-release bot :package::rocket:


engine-runner shall not depend on language-server

Pull Request Description
A step towards #10010 - avoid engine-runner dependency on language-server. Defines new module engine-runner-common that provides APIs for enginer-runner and language-server to connect - but they are just loosely coupled, they don't know about each other.
Checklist
Please ensure that the following checklist has been satisfied before submitting the PR:

[x] All code follows the
Scala,
Java,
[x] Unit tests continue to work

@hubertp requested high level documentation on the purpose of engine-runner-common module. I don't know where to put it, but here is some documentation (at the best place I could find) and a test checking the expected separation between the three modules affected by this PR: 913bde5

@Akirathan suggested to split runner.jar into the engine-runner and language-server JARs - one reason why that's not going to be simple: there will be duplicated classes among those JARs. Clearing that up is a way more work  than this small refactoring PR can handle.

Seems fine as a first step towards an independent language-server module. Please ensure that the language server can be launched both from cmdline and from within project-manager.jar. I am not sure if we have that covered by tests.

I believe launching of language server by project-manager is tested - for example by LanguageServerGatewaySpec. Yes, I also tested the IDE and it seems to work.
I see no objects, let's get this in and move on.


collecting data with longer durations

Hello Adrian, Hello folks,
I have compiled spigo on Windows and was looking at the CSV reports.
The command I am trying specifically to generate flow files is e.g.
./spigo.exe -c -d 10 -a lamp
The above works and terminates properly on my laptop with -d 2 and -d 5 but not with -d 10.
I noticed a hangup in asgard's ShutdownNodes() on the second round trying to read from listener.
Has anyone else had this? I am learning Go still and am not yet comfortable with either the language or the way pirates are handled. I was for example not sure if I had to expect the victim in the noodle list...
TIA

Hi, that's a bug. It fails for me as well on Mac. With -m option it lists the messages then hangs. It's some kind of race condition that leads to a deadlock. I tried removing the chaosmonkey entry from the arch file but it still hung. It fails whenever the -c option is used AFAIK, so the bug is probably in the flow.go package. I don't have time to look into it further right now, but will have a look soon.

Good to know between m and c options.
On Thu, Jun 23, 2016 at 1:16 PM Adrian Cockcroft<EMAIL_ADDRESS>wrote:

Hi, that's a bug. It fails for me as well on Mac. With -m option it lists
the messages then hangs. It's some kind of race condition that leads to a
deadlock. I tried removing the chaosmonkey entry from the arch file but it
still hung. It fails whenever the -c option is used AFAIK, so the bug is
probably in the flow.go package. I don't have time to look into it further
right now, but will have a look soon.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/adrianco/spigo/issues/74#issuecomment-228170269, or mute
the thread
https://github.com/notifications/unsubscribe/ACWGWER4mGvLt-YiCAeUyUUltkL2pf0tks5qOumNgaJpZM4I8HmN
.

Thank you @adrianco
I noticed a lock in denominator at flow.Instrument(msg, name, nethist) which took me inside collect.Measure. Based on what I understood from Go's mutexes not being re-entrant, I isolated a portion of Measure into an unexported function and got it to work. See if that makes sense and if outputs in csv_metrics for example make sense...
func Measure(h metrics.Histogram, d time.Duration) {
        if h != nil && archaius.Conf.Collect {
                if d > maxHistObservable {
                        h.Observe(int64(maxHistObservable))
                } else {
                        h.Observe(int64(d))
                }
                sampleLock.Lock()
                defer sampleLock.Unlock()
                myMeasure(h, d)
//              s := sampleMap[h]
//              if s != nil && len(s) < sampleCount {
//                      sampleMap[h] = append(s, int64(d))
//              sampleLock.Unlock()
//              }
        }
}

func myMeasure(h metrics.Histogram, d time.Duration) {
        s := sampleMap[h]
        if s != nil && len(s) < sampleCount {
                sampleMap[h] = append(s, int64(d))
        }
}

With this, I can run spigo -c -d 100 -a lamp for example without locking up.
I am using it with Neo4j and loved the approach! More to explore for me still!!!


vagrant up error: no implicit conversion of nil into String

I've not done a lot with vagrant, so I'm not 100% sure this is a drupalvm issue. I've also attached my terminal output which shows me running vagrant provision a couple times per your README.
Bringing machine 'drupalvm' up with 'virtualbox' provider...
/opt/vagrant/embedded/gems/gems/vagrant-1.7.4/plugins/kernel_v2/config/vm.rb:611:in `initialize': no implicit conversion of nil into String (TypeError)
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/plugins/kernel_v2/config/vm.rb:611:in `new'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/plugins/kernel_v2/config/vm.rb:611:in `block in validate'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/plugins/kernel_v2/config/vm.rb:606:in `each'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/plugins/kernel_v2/config/vm.rb:606:in `validate'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/config/v2/root.rb:68:in `block in validate'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/config/v2/root.rb:64:in `each'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/config/v2/root.rb:64:in `validate'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/builtin/config_validate.rb:15:in `call'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/warden.rb:34:in `call'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/warden.rb:95:in `block in finalize_action'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/warden.rb:34:in `call'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/warden.rb:34:in `call'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/builtin/handle_box.rb:56:in `call'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/warden.rb:34:in `call'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/warden.rb:95:in `block in finalize_action'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/warden.rb:34:in `call'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/warden.rb:34:in `call'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/builder.rb:116:in `call'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/runner.rb:66:in `block in run'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/util/busy.rb:19:in `busy'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/runner.rb:66:in `run'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/builtin/call.rb:53:in `call'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/warden.rb:34:in `call'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/plugins/providers/virtualbox/action/check_virtualbox.rb:17:in `call'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/warden.rb:34:in `call'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/builder.rb:116:in `call'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/runner.rb:66:in `block in run'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/util/busy.rb:19:in `busy'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/action/runner.rb:66:in `run'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/machine.rb:214:in `action_raw'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/machine.rb:191:in `block in action'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/environment.rb:516:in `lock'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/machine.rb:178:in `call'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/machine.rb:178:in `action'
    from /opt/vagrant/embedded/gems/gems/vagrant-1.7.4/lib/vagrant/batch_action.rb:82:in `block (2 levels) in run'

My versions:
Vagrant 1.7.4
ansible 2.1.0
VBoxManage 5.0.12r104815

vagrant-up-issues.txt

I recloned and skipped the ansible stuff. VM is up. I'm going to close this and assume I got a bit lost on the instructions.


rtm_connect() doesn't work

I've having a problem where rtm.connect() doesn't work; and any attempt to use sc.server methods fails. I'm using the correct token.
Here's my code:
import argparse
from slackclient import SlackClient

#Connect to slack--uses token assigned to releasebot user
sc = SlackClient('#REMOVED')

parser = argparse.ArgumentParser()
parser.add_argument("channel_name")
parser.add_argument("text")

args = parser.parse_args()

sc.rtm_connect()

sc.server.channels.find(args.channel_name).send_message(args.text)

It fails with:
Traceback (most recent call last):
  File "releasebot.py", line 17, in <module>
    sc.server.channels.find(args.channel_name).send_message(args.text)
AttributeError: 'NoneType' object has no attribute 'send_message'

Here's the output of some debugging with the python interpreter
Python 2.6.6 (r266:84292, Jul 23 2015, 15:22:56)
[GCC 4.4.7 20120313 (Red Hat 4.4.7-11)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> from slackclient import SlackClient
>>> sc = SlackClient('#REMOVED')
>>> sc.rtm_connect()
False
>>> sc.server
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/lib/python2.6/site-packages/slackclient/_server.py", line 41, in __repr__
    return self.__str__()
  File "/usr/lib/python2.6/site-packages/slackclient/_server.py", line 37, in __str__
    data += "{} : {}\n".format(key, str(self.__dict__[key])[:40])
ValueError: zero length field name in format
>>> sc.server.channels
[]

@sshorkey make sure your bot's in the channel before it tries to post to it. If it's not in the channel, the client will return None for the channel object.
You can see by printing the output of channels.find, right before trying to send the message:
print sc.server.channels.find(args.channel_name)
sc.server.channels.find(args.channel_name).send_message(args.text)

Output for an invalid channel:
roach$ python releasebot.py "#general2" "test"

None

Traceback (most recent call last):
  File "releasebot.py", line 17, in <module>
    sc.server.channels.find(args.channel_name).send_message(args.text)
AttributeError: 'NoneType' object has no attribute 'send_message'

Output for a valid channel:
roach$ python releasebot.py "#general" "test"
id : C2U86NC6M
name : general```


[CI] Fix for NNPack error due to misalignment with pthreadpool library

Recently NNPack SHA was modified to align with CPUInfo, which is a dependent package. Pthreadpool is another dependent library that needs SHA update to work in tandem with NNPack.
cc @Liam-Sturge @lhutton1 @neildhickey

LGTM!

@tvm-bot rerun

@tvm-bot rerun

@tvm-bot rerun

@tvm-bot rerun

Thanks @ashutosh-arm @Liam-Sturge @driazati!


Getting a "Cannot read property 'contracts_build_directory'" error.

So here is another weird one:
(yes I have restarted my machine).
zos create and zos push are giving me errors.
This is a zepkit tutorial created via the global zos unpack tutorial command.

@crazyrabbitLTC we are not being able to reproduce this. Are you trying this on a clean download of the zepkit? Could you try again adding --verbose?

Fixed in https://github.com/zeppelinos/zos/pull/1038 :slightly_smiling_face:.


alternative stage1s: could bubblewrap help?

Bubblewrap is a container run-time implementation using setuid and subset of user namespaces:
https://github.com/projectatomic/bubblewrap
Does it make sense to integrate it into rkt somehow? Maybe as an alternative stage1?

This looks promising (as a potential new stage1 execution driver) and is close to proposed some time ago setuid helpers idea.
IMO this is more featured than proposed some time ago by @ppalucki idea described in #1318 but still, very close to it.

@rhatdan @vbatts @alexlarsson Would love your help :)

I don't really know what requirements you have, but hazarding a guess I'd say it could work fine for at least some container setups if you rely on systemd to do the cgroup setup (this is how i use it in xdg-app, systemd --user creates a scope in which i launch bubblewrap).

rkt/systemd-nspawn rely on systemd (pid1) & systemd-machined to setup the cgroups when they are available. More details on: https://github.com/coreos/rkt/blob/master/Documentation/devel/cgroups.md
We have not explored using systemd --user.

Oh, i didn't mean you should use systemd --user, i just compared it with what xdg-app does, and it uses the same dbus apis, but the user, not system instance.


Streak counter should check all counters when determining if it will reset to 0

I have been tracking down an issue with the streak counter and I found the cause. When in game, I would start a new session and play a few games on one playlist. Let's say I win 2 games so my streak is +2. Then I switch playlists and I lose the next game. My streak should be -1 but it's not, it's +1. This is because only the streak counter for the current playlist is checked. Another example, I start a new game after being on a 3 game winning streak last time I played. My streak variables should be:
always.streak = 3;
session.streak = 0;
stats[current.playlist].streak = 0;
always_gm[current.playlist].streak = 3;

Let's say I lose my first game.
GameEnd -> Game Lost says:
if (stats[current.playlist].streak > 0)
            {
                always.streak = 0;
                session.streak = 0;
                stats[current.playlist].streak = 0;
                always_gm[current.playlist].streak = 0;
            }

            --always.streak;
            --session.streak;
            --stats[current.playlist].streak;
            --always_gm[current.playlist].streak;

Since stats[current.playlist].streak == 0 my variables look like this:
always.streak = 2;
session.streak = -1;
stats[current.playlist].streak = -1;
always_gm[current.playlist].streak = 2;

When they should look like this:
always.streak = -1;
session.streak = -1;
stats[current.playlist].streak = -1;
always_gm[current.playlist].streak = -1;

To confirm, were you in "Session" or "Always" mode?
And thank you very much for this feedback 👍

I'm currently in Session mode.

I just tested a change to fix this and make the code look somewhat clean. I don't program in C/C++ but this seems benign enough that it won't hurt anything.
For GameEnd -> Game Won instead of
if (stats[current.playlist].streak < 0)
            {
                always.streak = 0;
                session.streak = 0;
                stats[current.playlist].streak = 0;
                always_gm[current.playlist].streak = 0;
            }

You could use
            always.streak = std::max(0, always.streak);
            session.streak = std::max(0, session.streak);
            stats[current.playlist].streak = std::max(0, stats[current.playlist].streak);
            always_gm[current.playlist].streak = std::max(0, always_gm[current.playlist].streak);

For GameEnd -> Game Lost and GameDestroyed
            always.streak = std::min(0, always.streak);
            session.streak = std::min(0, session.streak);
            stats[current.playlist].streak = std::min(0, stats[current.playlist].streak);
            always_gm[current.playlist].streak = std::min(0, always_gm[current.playlist].streak);

Thanks, I'll try that when I have a moment :)

So I just did a test and thought about it.
The Streak is correct since it is based on a "Session" save.
If you change playlists you stay in the session until you restart the game.

I tangle my brushes...
Is it the heat xD
Yes so the streak is sence whatever happens return to 0 when we lose and we are positive, and the same for the reverse, hmm.
I will test your code in the coming days I think.

Basically this is why all 4 streaks need to be evaluated independently to see if they need to be reset since all 4 are being increased or decreased. They could still be a mixed combination of winning and losing streaks and still be correct. To be cleaner I just removed the if and turned them into min/max functions with 0.

Hey @CWO333 , thanks for your feedback
It was indeed a bug from the streak calculation, this has been fixed in https://github.com/Lyliya/RocketStats/pull/34 thanks to your suggestion
Thank you


Add a small example on how to integrate threads

Wrote a small example on how to integrate threads and use a oneshot channel to figure out if a thread is finished. It wraps that all in a way that allows for panicking threads and makes sure that you can get the thread result as you are used to.
This is my first take at it, does it make sense/is it useful?
One jarring oddity is join().await, but I didn't want to go the whole way and implement a future in whole. We could do it, though, it's just a proxy.

I feel this is somewhat superseded now that we have the task::spawn_blocking API. This example could now more or less be rewritten as:
fn main() {
    task::block_on(async move {
        let handle = task::spawn_blocking(move || {
            thread::sleep(time::Duration::from_millis(1000));
            String::from("Finished")
        });

        println!("waiting for sleepy thread");
        match handle.await {
            Ok(s) => println!("Result: {}", s),
            Err(e) => println!("Error: {:?}", e),
        }

        let handle = task::spawn_blocking(move || {
            thread::spawn(|| {
                panic!("aaah!");
                String::from("Finished!")
            }).join()
        });

        println!("waiting for panicking thread");
        match handle.await {
            Ok(s) => println!("Result: {}", s),
            Err(e) => println!("Error: {:?}", e),
        }
    });
}

I'm not sure how much we'd want to have an example of this (could be useful!) or perhaps polish the docs a bit more to make it apparent this exists (discoverability can be tricky). But overall I think it'd be nice if we could find a resolution to this PR to not keep it open indefinitely. Thanks!

Closing for now, please reopen if you want to update it to the latest version.


Extend ssm command-executed waiter to wait for all instances targeted by a command

Describe the feature
aws ssm wait command-executed --command-id $id

waits for the entire command to be executed on all instances it targets
(Maybe we should rename the original waiter to wait command-invocation-executed
Use Case
With https://github.com/boto/botocore/issues/1744 we can wait for a command to be executed on a single instance; however the SSM API has evolved and it's possible to send a command to multiple targets at the same time:
aws ssm send-command --document-name my-doc --targets 'key=tag:Name,values=my-servers' --query 'Command.CommandID'

I want to wait for all of the instances with Name=my-servers
Proposed Solution
The waiter should watch ssm:ListCommands(CommandId=id) until Commands[0].Status=Success
Other Information
My current workaround:
       tries=24
          while true; do
            sleep 5
            if [ $tries -eq 0 ]; then
              echo "Command did not finish in time"
              exit 0
            fi
            status=$(aws ssm list-commands \
                --command-id ${{ steps.send-command.outputs.command_id }} \
                --query "Commands[0].Status" \
                --output text)

            # if pending or in progress, or cancelling
            if [ "$status" = "Pending" ] || [ "$status" = "InProgress" ] || [ "$status" = "Cancelling" ]; then
              tries=$((tries-1))
              continue
            fi
            break
          done

Acknowledgements

[X] I may be able to implement this feature request
[X] This feature might incur a breaking change

SDK version used
aws-cli/2.17.56
Environment details (OS name and version, etc.)
MacOS

Thanks for the feature request. Waiter models are created and maintained upstream by service teams, as they are used across AWS SDKs. It looks like CommandExecuted has been the only SSM waiter for a while:

https://awscli.amazonaws.com/v2/documentation/api/latest/reference/ssm/wait/index.html#cli-aws-ssm-wait
https://github.com/boto/botocore/blob/develop/botocore/data/ssm/2014-11-06/waiters-2.json

To what extent does your request overlap with https://github.com/boto/botocore/issues/1744 / https://github.com/aws/aws-sdk/issues/90 ? Here is the related PR that was written: https://github.com/boto/botocore/pull/1753/files. The SSM team is still tracking the request to add this waiter, but it hasn't been prioritized. I can try checking in with them regarding this.
But I don't think the request to update a waiter's name or polling logic would be considered because of the need to maintain backwards compatible behavior. If you can, please let me know specifically what model changes you are proposing and I can share that with the SSM team.

To what extent does your request overlap with https://github.com/boto/botocore/issues/1744 / https://github.com/aws/aws-sdk/issues/90 ? Here is the related PR that was written: https://github.com/boto/botocore/pull/1753/files. The SSM team is still tracking the request to add this waiter, but it hasn't been prioritized. I can try checking in with them regarding this.

Not at all. That PR you link is the exact same code as the command-executed waiter.
The thing I am proposing is ability to wait for a command to finish instead of a specific command-invocation.
A single command can have many invocations (e.g. when targeting multiple instances using  tags). I want to wait until the entire command is finished; not just a single invocation.   When you do an aws ssm run-command --targets Name=tag:Name,Values=mytag you don't get a list of instance ids back so there is no way to use the existing aws ssm wait command-executed waiter


support the Realtime API?

OpenAI official add Realtime API these days. Any schedule to support?
https://platform.openai.com/docs/guides/realtime

I've published a client: https://pub.dev/packages/openai_realtime_dart


Add application related labels to deployment metrics

Split from https://github.com/pipe-cd/pipecd/issues/4472

I want to keep track of status and events for each application. For example, I'm considering the following:

Add labels for application(like application name, id, etc...) to deployment metrics introduced in v0.44.0

Originally I wanted to use Grafana's state timeline in order to monitor state the application.
So I believe the application name is necessary. However, I don't think the application name is unique, so it would be good to have some information that can be filtered. (This may be enough with existing labels).
ref: https://stackoverflow.com/a/72515955

Thanks! Let me make it clear. Once metric about application's state is implemented, existing deployment metrics are no longer necessary for your use case?
Actually, argocd_app_info looks nice :)

Ah, in this case, actually yes.
However, I feel that it would be useful to have labels on the deployment metrics that can identify the application, for example, to visualize the numbers of success/failure/total of deployments etc by application.

Sure. I talked with our team and we concluded that it would be better to add application-related labels to deployment metrics 👍
@kanata2 Btw, would you like to implement this? ;)

Thanks. Okay, I'll submit a PR later.

We really appreciate it!


Research and Implement a Finite State Machine

We're required to deliver UML use case, class, and state diagrams for our project. We should implement the State pattern using a Finite State Machine for our game to meet the state requirement and keep our program's execution organized.
There's multiple plugins available to implement a FSM, so we should decide on which one to use. I'm looking at this one.
At minimum we should define whether the program is in the title screen, 21 scene, or tictactoe scene and assign state accordingly since the game can only be in one of those states at any moment.

We can do this for testing; however, I have been able to get the game functioning between scenes.
What I have left is noted in #25 ...


last column sort arrow wrong display

This last commit from https://github.com/angular-ui/ng-grid/issues/1671 breaks the display of last column for us. We use no grid menu. See:
http://plnkr.co/edit/tM4e5Ng8dcJfKM6ZdKl7?p=preview The sort arrow of last column is displayed wrong.
I think:
ng-class="{'ui-grid-column-menu-button-last-col': isLastCol}"
should become:
ng-class="{'ui-grid-column-menu-button-last-col': isLastCol && grid.options.enableGridMenu}"

I like this fix. If you want to make a PR to fix this we'd probably accept it.

Created pull request.


get required fees api call

I imagine this API call would work something like this:
accept an array of operations and and an asset id and return and array of int amounts (same index as the operations in the parameter and same type of asset).  It may be beneficial to always return the fee in CORE and in the secondary asset type.

Please consider an enhancement and remove the asset_id_type from the parameter and instead obtain this from each operation.
vector<asset> get_required_fees( const vector<operation>& ops, asset_id_type id = asset_id_type() )const;

The fee asset ID is included in the operation, so you can use any asset to pay for any operation.  For example if I'm transferring you USD, I can pay the fee in USD (the asset being sent), BTS (the core asset) or even GLD (some unrelated third asset).
What we could do is read the asset ID out of each operation.  In this case, if you have a tx with two operations, and the user wants to pay for the first operation with CORE and pay for the second operation with USD, you would set ops[0].fee = core.amount(0); ops[1].fee = usd.amount(0); and then issue the API call get_required_fees(ops) which would give you the (nonzero) amounts.
It seems unlikely that a user would ever have a reason to pay different ops' fees in different assets.  I have a feeling 99% of advanced users will use CORE for all fees because going through the fee pool would just be extra cost.

I re-opened with an small enhancement but this is not needed .. the existing api works fine for any case we have now.


languaje Spanish

Description

Motivation and Context

How Has This Been Tested?

Screenshots (if appropriate):
Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

Checklist:

[ ] My code follows the code style of this project (run $ yarn lint).

@EnrikeGonzaloLegarra @chamini2
Hey guys, thank your for your translation. We have moved all the translations to http://i18n.meetfranz.com/es/franz/translate/es_ES.po#filter=all
Can you please approve the translation there?


Fixed issue where it was treating 'help' as the verb that usage info was...

 Issue by tombatron
Thursday Apr 04, 2013 at 01:55 GMT
Originally opened as https://github.com/gsscoder/commandline/pull/74

... requested for.
Let's say that I have an application called 'example' that has a verb called 'dothing'. If I entered the following on the console:
example help dothing

The usage text displayed isn't for the verb specified but the default usage text.

tombatron included the following code: https://github.com/gsscoder/commandline/pull/74/commits

 Comment by gsscoder
Thursday Apr 04, 2013 at 13:24 GMT

Hi,
you're right the correct behavior should the one described on the top.
Thanks for reporting and for the fix.
Sorry but for the moment I'm unable to accept PR (as stated in https://github.com/gsscoder/commandline/issues/67).
This will be of great help in my current 2.0 development (for the moment still unpublished); since it's a deep kernel rewrite, you can understand, that in the transitory phase this would mean maintain two branches...
The fix will be integrated in the new branch. :D
Thanks,
Giacomo Stelluti Scala

 Comment by tombatron
Thursday Apr 04, 2013 at 13:30 GMT

Awesome!

 Comment by nemec
Friday Sep 13, 2013 at 23:20 GMT

@jonnyyu this pull request can't be merged as-is since the codebase has changed radically since then. Are you still experiencing this problem?
Can you upgrade to the latest version from git (2.0) and see if it's still an issue?
On the project homepage there's a "download zip" button on the bottom right. Just extract the project folder and add it as a reference in your solution. Only @gsscoder has NuGet privileges, so I can't help there.

 Comment by jonnyyu
Friday Sep 13, 2013 at 11:09 GMT

Hi can we take a few minutes to merge this PR?
The issue is really a deal breaker for the Verb commands feature in stable <IP_ADDRESS>. Who can use Verb commands without verb specific help?
Since it already took 5 months to develop the  2.0 since then, maybe it will take another few months. Before the 2.0 is ready, can we just take a few time let current version work?
After all, this is really a one-line fix.
Thanks!

 Comment by jonnyyu
Monday Sep 23, 2013 at 15:40 GMT

No, I finally gave up using it and switch to ManyConsole instead.
On Sat, Sep 14, 2013 at 7:20 AM, Dan Nemec<EMAIL_ADDRESS>wrote:

@jonnyyu https://github.com/jonnyyu this pull request can't be merged
as-is since the codebase has changed radically since then. Are you still
experiencing this problem?
—
Reply to this email directly or view it on GitHubhttps://github.com/gsscoder/commandline/pull/74#issuecomment-24430970
.

Yingshen(Jonny) Yu

 Comment by JMerrill
Monday Jan 19, 2015 at 14:09 GMT

How different is the ManyConsole API? How long did it take you to convert from CommandLine? Thanks for any info.


IBSimulatedExecutionHandler

I was curious about the execution mechanism so I run the buy and hold example. I found the commission in calculate_ib_commission() seems not in accordance with         https://www.interactivebrokers.co.uk/en/index.php?f=1590&p=stocks1:
        commission = min(             0.5 * fill_price * quantity,             max(1.0, 0.005 * quantity)         )
which should be:
        commission = min(             0.005 * fill_price * quantity,             max(1.0, 0.005 * quantity)         )
First I thought this might be something with the PriceParser. So without any change in the codes, I just changed the SPY.csv and let the close price be 0.25, set the default quantity in position sizer as 1000, and it gives:
timestamp | ticker | action | quantity | exchange | price | commission
2000-01-03 00:00:00 | SPY | BOT | 1000 | ARCA | 0.25 | 5
in which the commission should be 1.25 as an example on the IB website.
So I changed the codes to keep consistent with IB. However, it still gives:
timestamp | ticker | action | quantity | exchange | price | commission
2000-01-03 00:00:00 | SPY | BOT | 1000 | ARCA | 0.25 | 5
So why?
Well, because the fill price has been parsed by the multiplier before calculating the commission. If you debug the code, you will find the fill_price here is 2500000 instead of 0.25. So we need to rewrite the codes as:
        commission = min(             0.005 * PriceParser.display(fill_price) * quantity,             max(1.0, 0.005 * quantity)         )
Now it gives the correct commission:
timestamp | ticker | action | quantity | exchange | price | commission
2000-01-03 00:00:00 | SPY | BOT | 1000 | ARCA | 0.25 | 1.25
I'm not sure how much speed it improves by using Price Parser, but this parser really results in some problems. My colleague and I just removed the price parser to use the original price. Be careful guys.

Hi @MagicEthan,
Thanks for pointing out these issues.
Just to let you know that our team are working on a complete rebuild of QSTrader from scratch that does away with the PriceParser and has fixed the commission issue you mention above.
Cheers,
-Mike.


STARTTLS

Laravel Version: 5.5
Adldap2-Laravel Version: 4.0
PHP Version: 7.2
LDAP Type: ActiveDirectory

Description:
Unable to get a connection using STARTTLS.

Steps To Reproduce:
Using the following options in .env
ADLDAP_CONTROLLERS=dc1srvr.domain.local
ADLDAP_PORT=389
ADLDAP_BASEDN="dc=domain,dc=local"
ADLDAP_ADMIN_USERNAME=username
ADLDAP_ADMIN_PASSWORD=password
ADLDAP_USE_SSL=false
ADLDAP_USE_TLS=true
<EMAIL_ADDRESS>ADLDAP_PASSWORD_SYNC=true
ADLDAP_LOGIN_FALLBACK=false

Then using tinker
Psy Shell v0.8.17 (PHP 7.2.3-1 — cli) by Justin Hileman
>>> Auth::attempt(['name' => 'user', 'password' => 'password'])
PHP Warning:  ldap_start_tls(): Unable to start TLS: Local error in /var/www/flex/vendor/adldap2/adldap2/src/Connections/Ldap.php on line 209
PHP Warning:  ldap_start_tls(): Unable to start TLS: Local error in /var/www/flex/vendor/adldap2/adldap2/src/Connections/Ldap.php on line 209
=> true

If I change things to SSL
ADLDAP_PORT=636
ADLDAP_USE_SSL=true
ADLDAP_USE_TLS=false

I get a connection and successfully validate.
I did have to add in the custom_options:
                'custom_options' => [
                  // See: http://php.net/ldap_set_option
                  LDAP_OPT_X_TLS_REQUIRE_CERT => LDAP_OPT_X_TLS_NEVER
                ]

But this has no marked effect on STARTTLS.
So I then used a test php script to see if  I were able to get  ldap_start_tls to work.
   $ldap="dc1srvr.domain.local";
<EMAIL_ADDRESS>   $pwd="password";

   $ds=ldap_connect($ldap);
   $ldapbind=false;
   if(ldap_set_option($ds, LDAP_OPT_PROTOCOL_VERSION, 3))
      if(ldap_set_option($ds, LDAP_OPT_REFERRALS, 0))
         if(ldap_start_tls($ds))
               $ldapbind = ldap_bind($ds, $usr, $pwd);
   ldap_close($ds);

   if(!$ldapbind)
      echo "ERROR";
   else
      echo "OK";

And this connects with no complaint about starttls.

Hi @warlord0, I think this is an issue inside tinker. Are you running your custom PHP script on the server and then testing Adldap2 in tinker?
Have you tried TLS with your application itself using Adldap2? Nothing is different in the Adldap2 library in regards to your code sample.

Yeah I tried the developed app to start with and failed to get any authentication. So decided to try in tinker to get some proper error messages. Got some success adding the option for REQCERT so I can at least auth over SSL.
As it's a warning the authentication succeeds, but I suspect that's because it's failed back to non-starttls and just bound as plain text.
I can't figure out where the warning comes from. I'm guessing straight from ldap_start_tls()


The project_options should only FetchContents of other repos with stable versions tags

Some of the other CMake git repos used by this project have no stable git tag.

Would it be possible to change this?
Would it also possible to document this dependencies too?
Is it possible to always use FetchContent_MakeAvailable()?
see https://github.com/ClausKlein/project_options/pull/5#pullrequestreview-1114348013

i.e.
  # in PackageProject.cmake
  # download ForwardArguments
  FetchContent_Declare(
    _fargs
    URL https://github.com/polysquare/cmake-forward arguments/archive/8c50d1f956172edb34e95efa52a2d5cb1f686ed2.zip)

# in VCEnvironment.cmake
# Using Windows MSVC toolchain
FetchContent_Declare(
        _msvc_toolchain URL "https://github.com/aminya/Toolchain/archive/95891a1e28a406ffb22e572f3ef24a7a8ad27ec0.zip")

@lefticus @aminya please note this brand new CMake v3.24 option I want to use:
cmake -DCMAKE_PROJECT_TOP_LEVEL_INCLUDES=$PWD/mycomp_provider.cmake -S . -B build -G Ninja -Wno-dev

see too https://discourse.cmake.org/t/fetchcontent-vs-vcpkg-conan/6578

Since v0.26.1 all the fetch contents are based on a stable tag


[bundle] update

sinatra 2.0
rack 2.0

Fixed by https://github.com/3scale/echo-api/pulls?q=is%3Apr+label%3Adepfu+is%3Aclosed


Getting Errors When following Readme Instruction on ARM server with ubuntu24.04 #74

Seems the developers forgot to commit these necessary libraries. The changes look safe for me, but I'm unable to verify it for x86 arch and Windows.
It's tested and works for MacBook Pro M3 (arm64), with TL1.
Please merge carefully.

thank you. I can confirm this fixes the compile issue.


Make exceptions to taxon name capitalization locale-specific

https://github.com/inaturalist/inaturalist/blob/master/app/assets/javascripts/ang/models/taxon.js.erb#L176
Proposal:

Add a translation key like uncapitalized_taxon_name_words and set it's value to a|and|in|o|of|on|the in English
Pre-populate the value in Crowdin for relevant locales to quell the name rage
In iNatModels.Taxon.titleCaseName, fetch uncapitalized_taxon_name_words, split by |, use those instead of the hard-coded list
Question whether or not you really made the world a better place today

FWIW we continue to get emails requesting this.


feature request: add comments to generated file

I would like to be able to add comment to the generated file, example:
/* eslint-disable no-duplicate-imports */

I can add them in ignore lists but handling from the generated file itself would be nicer.

Hi @maapteh, you can already probably do that with this

I clicked all options, but apparently not enough :) thanks!


About the "task statistics"

As we know each task has some statistics info, such as how much data it processed, how long does it last, how much data is processed successfully/fail/exception.
I think each Task should have a dict member called "stat_info", we can add any elements in it. And it can be displayed in the webpage.
That is really awesome if Luigi have that thing.

Yea I like to see something like this too. We just need to ensure however we implement it we do it in a clean way. It's easy to do it to general or too specific.

+1. This will be very useful.

yes i like this too

closing this issue.

[x] It has been inactive for +4 months.
[ ] It's not about luigi core, so not as many users are affected about this.
[ ] The change seems quite big, it's unlikely to be sporadically picked up.
[x] The owner haven't responded or disappeared.
[ ] I don't understand what this issue is about.
[ ] There exists a reasonable workaround for this.
[ ] We need to check if this hasn't been fixed by now (for old issues).
[ ] This is kind of by design and not a bug.
[ ] Resolving this would probably add a lot of complexity.

Every open issue adds some clutter, and we try to make the issues fewer and make it easier for new collaborators to find. Currently we try to close any issue that meets the first checkbox + one other.
Feel free to reopen this issue at any point if you have the intent to continue to work this. :)


Safety Data new API

API template of existing documentation using OPEN API 3.0.0 in this pr.
Existing paths: /involved, /involved/groupby, /city
Regarding hotspots and users, we will implement them in the API after we finish building the current API for the existing state.
You can play with documentation (mock data) here

Please review the API documentation created (of existing situation) together with existing tables in Mongo DB ("accidents" represent involved and "cities" represet the CBS cities)
Please suggest a modified version of API together with Design for safety data tables, based on our existing DB and tables.
You can use the API template I created with swaggerhub, or use another template for your choice.

I want you to take into consideration:

Existing mongo db table containing involved named "accidents" and can be found here) - you should have access
I assume that with the new API will need to perform some FE adjustments. That's OK, we'll adjust but we will consult Dror to make sure changes are minor and won't require a huge additional work.
In current implementation of API querying, we have "AND" between filter fields and "OR" between chosen field values
Performance should be good, just like current Safety Data API.

My suggestions and thoughts:
cbs_cities table:

In our current CBS cbs_cities table, I think we're missing only population field (other fields in mongoDB cities table are not used at the moment). believe you can add the population field from data_gov?
I suggest that FE will query cities info based on yishuv_symbol

cbs_streets table:

I suggest adding an API for it, or better - using our existing API
I suggest that FE will query streets info based on yishuv_symbol and street symbol.
There for either: this won't enable to query a specific street in multiple cities, but I think that's ok for now (if we want to enable this, we will find workaround that is still based on
streets aliasing - (dataset can be found here) - I think that if we do, it will be the last feature since it's not a requirement from the municipality at the moment.

cbs_involved_for_safety_data table:

Existing API does not enable filtering by all involved parameters (for example weather field ), even though it exists in mongoDB. I think we should enable as much flexibility as possible to filter by all relevant fields.
However, we can also start "lean" and only keep existing functionality with relevant fields, and later on to add additional fields that are not present.
Will we create a new table? (or perhaps we'll understand we want to use involved_markers_hebrew with improved structure?)
If we create a new table, I assume this table will be similar to involved_markers_hebrew, just w/o the hebrew fields. Perhaps it's better to save in this table only with integer codes and link it with relevant hebrew views (star schema) for a light table.
I wonder if pagination is needed when data is large, let's discuss our options (I believe that the curr '/accidents' API pulling from mongo's "accidents" table is not paginated).
Note the difference between current field vehicle_vehicle_type_hebrew that contains the involve's vehicle_type AND vehicles that contains a list of all involved vehicles using the following mapping that contains grouping of all vehicles from the specific accident:

vehicle_type=1 ->"רכב נוסעים פרטי"
vehicle_type=2 -> "טרנזיט"
vehicle_type=3 -> "טנדר"
vehicle_type  in (5, 6, 7, 24 ,25) -> "משאית"
vehicle_type  in (8, 9, 10, 19) -> "אופנוע"
vehicle_type in (11 ,18) -> 'אוטובוס'
vehicle_type = 12 -> 'מונית'
vehicle_type = 13 -> 'רכב עבודה'
vehicle_type = 14 -> 'טרקטור'
vehicle_type = 15 -> 'אופניים'
vehicle_type = 16 -> 'רכבת'
vehicle_type = 17 -> 'אחר ולא ידוע'
vehicle_type = 21 -> 'קורקינט חשמלי'
vehicle_type = 22 -> 'קלנועית חשמלית'
vehicle_type = 23 -> 'אופניים חשמליים'

There are mappings done in the FE, for example here in injured_type, 4,5 are mapped to motorcycle, 6,7 to cyclist. Should we keep these mapping in FE? or transfer them to BE?

Hi @atalyaalon ,
Regarding
"Existing mongo db table containing involved named "accidents" and can be found here) - you should have access"
I did not find anything there. It looks empty (I tried both my yahoo and gmail accounts).

Hi @atalyaalon ,
regarding viewing the MongoDB tables. To which of my emails did you grant access? I tried logging in with both of my emails and did not see anything. Maybe I do not know where to look

Hi @atalyaalon ,
Regarding the _id field that is returned in the /involved request: what does it identify?

Should it be the same for the same person that is involved in two different accidents that are returned in the same query?
Should it be the same for the same person that is involved in the same accident that are returned in two different queries?
Will just specifying the order of the returned items in each query suffice?

Hi @atalyaalon , @citizen-dror
Regarding the involved query parameters:

The parameters have short names, that are not always self explanatory. If we want these names to stay, I will use a translation table from these short names to the DB column names we use in Anyway.
In the API document, several parameters can be assigned a list of values. I understand that such a list will be specified in the URL using multiple appearances of the parameter name, with a single value each time.

Hi @atalyaalon , @citizen-dror
Regarding error handling,
In case of an error in a parameter, e.g. unknown parameter, or illegal value, Should the API return 404, or write error to log and return the answer as if that parameter was not specified?


load markets where user has pending orders

It's possible for the user to create and/or cancel orders and close browser. pending open orders are stored to local storage.
There is a edge case where the user can not have a open order or position in a market but is in the process or creating an order. UI needs to detect there is a pending order creation and make sure the market is loaded. That way the transaction lifecycle hooks can have needed data to process the tx and update the order in market trading page and portfolio.

Moving this to trading crit epic. It needs to be handled as part of trading.


debias gpt2 model

Hi,
I'm trying to apply context-debias to generative models (gpt2).  I tried to directly use your script but the loss is extremely large (1e10+). I notice you have an argument "mlm" in run_debias_mlm.py, but it doesn't seem to be used in the code, so I wonder whether there is something in the code I need to modify to adjust for causal language models?
Thank you!

and I notice the large losses are from neutral dataset, do you think this is the property of gpt2 embeddings or it can be fixed by adjusting codes?


selected point cannot be a routing point

Hi,I changed the map to Carla_town02 map, open the sim control, I cannot select the endpoint,
and the prompt message is as follows:

hello,Imap seems to be not very complete. After converting the map using imap, I opened the sim controller in Dreamview and the car couldn't run. I feel like there was a problem with the positioning.
Should I still choose roadrunner to convert Carla maps to Apollo maps?thank you for your reply.

Honestly roadrunner also has some conversion bugs, you know that's not their main business. of course, you can try it might work.
The error means the point is not the driving direction and heading are wrong. You can try setting points in the opposite direction

Honestly roadrunner also has some conversion bugs, you know that's not their main business. of course, you can try it might work.
The error means the point is not the driving direction and heading are wrong. You can try setting points in the opposite direction

@daohu527 ok,I'll try more.thanks.


Windows Defender flags 2.6.5 installer as Trojan:Script/Wacatac.H!ml

What happened?
Opened Vibe. Clicked on the Update prompt. Downloaded the Vibe set up. Tried to install it.
Steps to reproduce
Tried to install 2.6.5 on Windows 10 to update 2.6.3.

What OS are you seeing the problem on?
Window
Relevant log output
No response

Thank for letting know!
Can you try the latest version?
https://thewh1teagle.github.io/vibe/
Now I sign it with self signed certificate. it's not official certificate but maybe it will help

It just updated to 2.6.6. on my home computer (same version of Windows and Windows Defender). No issues. I'll check my work computer tomorrow.
__
Jonathan
On Tuesday, November 12, 2024 at 06:54:43 PM MST, thewh1teagle<EMAIL_ADDRESS>wrote:

Thank for letting know!
Can you try the latest version?
https://thewh1teagle.github.io/vibe/
Now I sign it with self signed certificate. it's not official certificate but maybe it will help
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: @.***>

Hey @Jmnd89
Does it worked?

It did. However, because my main account at work is not an administrator account, to get the app working again I had to uninstall it and then reinstall it after logging into the administrative account, which I have access to, And then authorize it to have access as an app that gets to override the control folder access. Meh. Too much work, but your app is worth it. Thank you for putting the GUI wrapper together. Much appreciated.
And yes, I understand that getting the install app signed is a pain in the shorts too.
The good news is, it didn't flag as a virus anymore.
Yahoo Mail: Search, Organize, Conquer
On Thu, Nov 14, 2024 at 9:46 AM, @.***> wrote:
Hey @Jmnd89
Does it worked?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.Message ID: @.***>


Additional Tip

When I run this script, I frequently check if it is complete.
So I have developed a intimations module which will intimate me via a telegram message once it is done.
Hope this will help others.

there are multiple tools to do that and it's not related to gobuster so we will kepp these things out of the readme


Submitting scores from /Tutorial/ redirects back to /Level0/, which 404s

If I go to http://euclidthegame.com/Tutorial/ and fill out the “Submit your score” form, I get redirected back to http://euclidthegame.com/Level0/, which doesn’t exist.

Should be addressed in #375


Add occi-abicompat, a compatibility layer for OCCI on some platforms

occi-abicompat is a small library that converts calls to OCCI that use the C++11 ABI of libstdc++ to calls using the C++98 ABI. This is needed if libocci was compiled against the C++98 ABI but one wants to use the C++11 version.
Only symbols used by xDAQ::tstore are redefined.
Since the library is very small, it is added directly to the central repository.

In order to move to GitLab, we need to merge this PR (which seems ready according to tests). Could you please rebase it on master since there are conflicts in CMakeLists.txt ?

I still need to adjust the cmake subdir. I don't mind reopening it

I still need to adjust the cmake subdir. I don't mind reopening it

So, I close it for the transition to GitLab. You will be able to reopen it there (with CI check in bonus).


incorrect position - FireFox browser

Attach (recommended) or Link to PDF file here:
Configuration:

Web browser and its version: FireFox 76.0.1(64bit)
Operating system and its version: Windows 10
PDF.js version: 2.3.200
Is a browser extension: no

Steps to reproduce the problem:

open pdf.js view.html
upload pdf file.
it looks different between Chrome and FireFox

What is the expected behavior? (add screenshot)

What went wrong? (add screenshot)
view on firefox

Link to a viewer (if hosted on a site other than mozilla.github.io/pdf.js or as Firefox/Chrome extension):
Attachted pdf
JRCHIST_wb_s1_1.1_t.pdf
it is possible to reproduce on this link
https://mozilla.github.io/pdf.js/web/viewer.html
Thanks everyone

This was improved, but not completely fixed, by PR #14175.


Implement list comprehension

Adds the OpenCypher spec for List Comprehension to AGE. Also added a commit to remove shift/reduce conflict in grammar.
Syntax
[
     <variable>   // variable to assume values from list
     IN <list>      // a list or something that creates one
     WHERE <condition>    // optional condition using the above variable
     | <mapping>     // optional mapping function
]

Example
[u IN [1,2,3] WHERE u>1 | u^2]

Known Issue
List comprehension as property constraint of MERGE clause errors out. Created issue #1611 for that.
Co-authored-by:
John Jemignani
Zainab Saad
Muhammad Taha Naveed

Looks good to me~


Update collection version on tag publish

Somehow this change is in main already: https://github.com/stackhpc/.github/commit/53db12f7846eae71df037022a34cc7d8fcb08faa

Somehow this change is in main already: 53db12f

Fantastic, let me revert - have no clue how it happened.

Somehow this change is in main already: 53db12f

Fantastic, let me revert - have no clue how it happened.

Done.

I know this is a pain - I literally just hit it :facepalm:

Wondering if we should have a GH workflow to create a release?


Many config files?

I have little knowledge in scripting. I did read the config files section.
Am I supposed to only have 1 config.json file? or could I do
config.json
config.json.pokemon
config.json.map
etc.

Will close asap.

Also, if you cannot have multiple config files, can I just forge them all into 1 config file?

The only necessary one to setup is config.json.
The others are for different features.

@mjmadsen
Mkay thanks


SETHOOK: Problem with arguments: ERR invalid argument

Hello,
I have created via an Interface a new customer command:
@Command("SETHOOK ?0 ?1 NEARBY ?2 FENCE POINT ?3 ?4")
List<Object> setHookIntersect(String webHook, String addr, String key, double Lon, double Lat);

Then i try to call it, see the example below, but I get each time an exception (see below):
List<Object> xyz = commands.setHookIntersect("myHook", "http://<IP_ADDRESS>:1001", "fleet", 89.050032, 32.102624);
Exception in thread "main" io.lettuce.core.RedisCommandExecutionException: ERR invalid argument '89.050032'
	at io.lettuce.core.LettuceFutures.awaitAll(LettuceFutures.java:85)
	at io.lettuce.core.LettuceFutures.awaitAll(LettuceFutures.java:46)
	at io.lettuce.core.dynamic.AsyncExecutableCommand.dispatchCommand(AsyncExecutableCommand.java:81)
	at io.lettuce.core.dynamic.AsyncExecutableCommand.execute(AsyncExecutableCommand.java:53)
	at io.lettuce.core.dynamic.RedisCommandFactory$CommandFactoryExecutorMethodInterceptor.invoke(RedisCommandFactory.java:227)
	at io.lettuce.core.dynamic.intercept.MethodInterceptorChain$MethodInterceptorContext.proceed(MethodInterceptorChain.java:117)
	at io.lettuce.core.dynamic.intercept.MethodInterceptorChain$PooledMethodInvocation.proceed(MethodInterceptorChain.java:194)
	at io.lettuce.core.dynamic.intercept.DefaultMethodInvokingInterceptor.invoke(DefaultMethodInvokingInterceptor.java:45)
	at io.lettuce.core.dynamic.intercept.MethodInterceptorChain$MethodInterceptorContext.proceed(MethodInterceptorChain.java:117)
	at io.lettuce.core.dynamic.intercept.MethodInterceptorChain.invoke(MethodInterceptorChain.java:79)
	at io.lettuce.core.dynamic.intercept.InvocationProxyFactory$InterceptorChainInvocationHandler.handleInvocation(InvocationProxyFactory.java:101)
	at io.lettuce.core.internal.AbstractInvocationHandler.invoke(AbstractInvocationHandler.java:80)

Could anybody tell me what is the Problem? thanks
FYI: I use Java: lettuce as client

Hi @robmir44,
It looks like you are missing a param. It should be something like:
SETHOOK myHook http://<IP_ADDRESS>:1001 NEARBY fleet FENCE POINT  89.050032 32.102624 5000

Where the 5000 represents the radius in meters around the point.

Hello, Thanks for the answer. Now it is working, but what did i do?

I changed from Java to python

redis_client = redis.StrictRedis(host, port, db)
data = redis_client.execute_command('custom redis command')

My mistake was to use the docker-container and then I called the server (docker-container) with the localhost address (<IP_ADDRESS>), with the call I mean: SETHOOK(xxxx).

My problem is similar  but with OBJECT or HAST
SETHOOK myHook http://<IP_ADDRESS>:1001 NEARBY fleet FENCE HAST xxxxxx
ERR invalid argument 'HAST'

@hmunoz do you HASH?


sui-select-option with formArray not working

Hi, I'm trying to use sui-multi-select with formArray and I could not get it to work.
I'm putting formArrayName in the sui-multi-select tag and the formControlName in the sui-select-option tag similar to this.
<sui-multi-select class="selection"
              labelField="nome" valueField="id"
	      formArrayName="modalidade"
              [hasLabels]="false">
<sui-select-option *ngFor="let option of modalidadesFiltradas"
		 formControlName="selecionado"
                 [value]="option">
</sui-select-option>
</sui-multi-select>

It informs that I can not find a control in the path modalidade -> selecionado
I seem to be missing something in the sui-select-option tag.

I saw that it was doing the wrong way, even using as the groupName in the index still of the error.
            <sui-multi-select class="selection"
                              labelField="nome" valueField="id"
                              formArrayName="modalidades"
                              [hasLabels]="false">
              <ng-container *ngFor="let option of modalidadesFiltradas;let i=index" [formGroupName]="i">
                <sui-select-option [value]="option" formControlName="selecionado">
                </sui-select-option>
              </ng-container>
            </sui-multi-select>