Execute Zebra full sync weekly on the main branch

Discussed in https://github.com/ZcashFoundation/zebra/discussions/6603

Originally posted by gustavovalverde May  3, 2023
GitHub changed the behavior of the concurrency, showing cancellation statuses as failures, rather than ignoring them and showing it as successes. Having all those :x: in the main branch is confusing, and we should decide how to handle this situation.
We have several options (including others not listed here):

Not running the full sync on each merge, as we're anyways cancelling those until a previous one finishes
Have it on its own workflow and have a more specific decision tree on when to trigger it
Schedule it to run twice a week or weekly (as it anyways takes 3+ days to complete)
Having a trigger on the PR, as we might want to validate if a critical PR runs a Full sync safely before merging it (required check for specific labels [?])

Whatever we do here, it should probably apply to:

zebra full mainnet sync
lightwalletd full mainnet sync (which depends on the zebra sync)
zebra full testnet sync

There is also a zebra checkpoint mainnet sync, it only runs when the state version changes, or we migrate to a new environment.

We have several options (including others not listed here):

Not running the full sync on each merge, as we're anyways cancelling those until a previous one finishes

This seems like a good idea.

Have it on its own workflow and have a more specific decision tree on when to trigger it

This might be tricky, because the jobs that depends on full syncs need to wait until it runs. (This only happens when we update our state version, move to a new CI environment, or delete all our cached states manually.)

Schedule it to run twice a week or weekly (as it anyways takes 3+ days to complete)

I think once a week would be fine, on a Friday so the results are ready to check before the engineering sync.

Having a trigger on the PR, as we might want to validate if a critical PR runs a Full sync safely before merging it (required check for specific labels [?])

We can already manually run these syncs using workflow dispatch, I don't think we do it often enough to make it worth using labels or any other automated tasks.


Unable to upload, required option: p

Dear Watson,
I am no longer able to upload apps using motion upload.
The error returned is as follows:
Upload: ./build/iPhoneOS-9.2-Release/TarotPoints.ipa
✗ Error: Errors uploading './build/iPhoneOS-9.2-Release/TarotPoints.ipa': (
✗ Please specify a value for required option: p

I can't reproduce your issue.
$ motion upload<EMAIL_ADDRESS>Upload: ./build/AppleTVOS-9.1-Release/HelloTV.ipa
✓ No errors uploading './build/AppleTVOS-9.1-Release/HelloTV.ipa'

I need more information to reproduce the issue.

motion-appstore version which you've used

You can get it like following
$ gem list | grep motion-appstore
motion-appstore (1.0.9)

Xcode version

$ xcodebuild -version
Xcode 7.2.1
Build version 7C1002

Can you upload it via Application Loader.app ?

Hi Watson,
My output is similar to yours:
carthage:tarot jj$ gem list | grep motion-appstore
motion-appstore (1.0.9, 1.0.7)
carthage:tarot jj$ xcodebuild -version
Xcode 7.2.1
Build version 7C1002

Le 20 mars 2016 à 23:20, Watson<EMAIL_ADDRESS>a écrit :
xcodebuild -version

you can be able to upload your app with v1.0.7 (you were using before) ?

You can try it like
$ gem uninstall moition-appstore
$ gem install motion-appstore -v '1.0.7'
$ motion upload ...

Can you tell me your Apple ID ?

Nope, same issue with 1.0.7.
Is there any way to get increase debugging information?

Le 21 mars 2016 à 19:56, Watson<EMAIL_ADDRESS>a écrit :
gem install motion-appstore -v '1.0.7'

I added debug log print at https://github.com/HipByte/motion-appstore/commit/a33d75fbcc7427f6cfcb1640bdd792f317f7e5eb
$ git clone https://github.com/HipByte/motion-appstore.git
$ cd motion-appstore
$ rake install

then, you can see debug logs if you add --verbose option in command, like
$ motion validate<EMAIL_ADDRESS>--verbose

I think wrong or empty password was retrived from Keychain.
Maybe, you need to add valid password into Keychain.
https://github.com/HipByte/motion-appstore#password-management

Thanks Watson!
Here is the log. Seems to be related to a réinstalle of itmstransporter.
COMMAND :
"/Applications/Xcode.app/Contents/Applications/Application Loader.app/Contents/Frameworks/ITunesSoftwareService.framework/Support/altool" --upload-app -f "./build/iPhoneOS-9.2-Release/TarotPoints.ipa" -u<EMAIL_ADDRESS>-p « ????????"
RETURN :
2016-03-22 09:01:29.116 altool[1223:30486]  Error:
[2016-03-22 08:57:50 CET]   INFO: Transporter is searching for updated software components.
[2016-03-22 08:57:55 CET]   INFO: Transporter has detected that new software components exist; updating.
[2016-03-22 08:57:55 CET]  DEBUG: Analyzing remote bundle resource org.apache.httpcomponents.httpclient...
[2016-03-22 08:58:02 CET]  DEBUG:   ... updated bundle successfully retrieved.
[2016-03-22 08:58:02 CET]  DEBUG: Analyzing remote bundle resource org.apache.httpcomponents.httpcore...
[2016-03-22 08:58:05 CET]  DEBUG:   ... updated bundle successfully retrieved.
[2016-03-22 08:58:05 CET]  DEBUG: Analyzing remote bundle resource com.springsource.org.apache.commons.beanutils...
[2016-03-22 08:58:05 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:05 CET]  DEBUG: Analyzing remote bundle resource com.springsource.org.apache.commons.codec...
[2016-03-22 08:58:05 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:05 CET]  DEBUG: Analyzing remote bundle resource com.springsource.org.apache.commons.collections...
[2016-03-22 08:58:05 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:05 CET]  DEBUG: Analyzing remote bundle resource com.springsource.org.apache.commons.cli...
[2016-03-22 08:58:05 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:05 CET]  DEBUG: Analyzing remote bundle resource com.springsource.org.apache.commons.digester...
[2016-03-22 08:58:05 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:05 CET]  DEBUG: Analyzing remote bundle resource com.springsource.org.apache.commons.discovery...
[2016-03-22 08:58:05 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:05 CET]  DEBUG: Analyzing remote bundle resource com.springsource.org.apache.commons.io...
[2016-03-22 08:58:05 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:05 CET]  DEBUG: Analyzing remote bundle resource com.springsource.org.apache.commons.logging...
[2016-03-22 08:58:05 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:05 CET]  DEBUG: Analyzing remote bundle resource com.springsource.org.apache.commons.net...
[2016-03-22 08:58:05 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:05 CET]  DEBUG: Analyzing remote bundle resource org.apache.felix.bundlerepository...
[2016-03-22 08:58:05 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:05 CET]  DEBUG: Analyzing remote bundle resource org.apache.felix.configadmin...
[2016-03-22 08:58:06 CET]  DEBUG:   ... updated bundle successfully retrieved.
[2016-03-22 08:58:06 CET]  DEBUG: Analyzing remote bundle resource org.apache.sanselan.sanselan...
[2016-03-22 08:58:06 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:06 CET]  DEBUG: Analyzing remote bundle resource com.springsource.org.apache.xml.resolver...
[2016-03-22 08:58:06 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:06 CET]  DEBUG: Analyzing remote bundle resource com.asperasoft.faspmanager...
[2016-03-22 08:58:13 CET]  DEBUG:   ... updated bundle successfully retrieved.
[2016-03-22 08:58:13 CET]  DEBUG: Analyzing remote bundle resource com.apple.transporter.asperasupport...
[2016-03-22 08:58:13 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:13 CET]  DEBUG: Analyzing remote bundle resource com.apple.transporter...
[2016-03-22 08:58:16 CET]  DEBUG:   ... updated bundle successfully retrieved.
[2016-03-22 08:58:16 CET]  DEBUG: Analyzing remote bundle resource com.apple.transporter.softwaresupport...
[2016-03-22 08:58:36 CET]  DEBUG:   ... updated bundle successfully retrieved.
[2016-03-22 08:58:36 CET]  DEBUG: Analyzing remote bundle resource com.apple.transporter.updater...
[2016-03-22 08:58:37 CET]  DEBUG:   ... updated bundle successfully retrieved.
[2016-03-22 08:58:37 CET]  DEBUG: Analyzing remote bundle resource com.springsource.javax.activation...
[2016-03-22 08:58:37 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:37 CET]  DEBUG: Analyzing remote bundle resource com.springsource.javax.media.jai.core...
[2016-03-22 08:58:37 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:37 CET]  DEBUG: Analyzing remote bundle resource com.springsource.javax.media.jai.codec...
[2016-03-22 08:58:37 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:37 CET]  DEBUG: Analyzing remote bundle resource com.springsource.javax.mail...
[2016-03-22 08:58:37 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:37 CET]  DEBUG: Analyzing remote bundle resource com.springsource.javax.servlet...
[2016-03-22 08:58:37 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:37 CET]  DEBUG: Analyzing remote bundle resource com.springsource.javax.xml.soap...
[2016-03-22 08:58:37 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:37 CET]  DEBUG: Analyzing remote bundle resource com.springsource.javax.xml.rpc...
[2016-03-22 08:58:37 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:37 CET]  DEBUG: Analyzing remote bundle resource com.springsource.javax.xml.stream...
[2016-03-22 08:58:37 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:37 CET]  DEBUG: Analyzing remote bundle resource com.springsource.org.jaxen...
[2016-03-22 08:58:37 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:37 CET]  DEBUG: Analyzing remote bundle resource com.springsource.org.jdom...
[2016-03-22 08:58:37 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:37 CET]  DEBUG: Analyzing remote bundle resource org.json.simple...
[2016-03-22 08:58:37 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 08:58:37 CET]  DEBUG: Analyzing remote bundle resource com.apple.jingle.leghorn...
[2016-03-22 09:01:20 CET]  DEBUG:   ... updated bundle successfully retrieved.
[2016-03-22 09:01:20 CET]  DEBUG: Analyzing remote bundle resource org.osgi.service.obr...
[2016-03-22 09:01:20 CET]  DEBUG:   ... resource is same as system bundle, skipping download.
[2016-03-22 09:01:20 CET]  DEBUG: Analyzing remote bundle resource com.signiant.interactivetransfer...
[2016-03-22 09:01:27 CET]  DEBUG:   ... updated bundle successfully retrieved.
[2016-03-22 09:01:27 CET]  DEBUG: Analyzing remote bundle resource com.apple.transporter.resources...
[2016-03-22 09:01:28 CET]  DEBUG:   ... updated bundle successfully retrieved.
[2016-03-22 09:01:28 CET]   INFO: Transporter has been successfully updated.  The updated components will be available the next time Transporter runs.
[2016-03-22 09:01:28 CET]  ERROR: Please specify a value for required option: p
2016-03-22 09:01:29.117 altool[1223:30486]  Out:
2016-03-22 09:01:29.167 altool[1223:30362] *** Error: Errors uploading './build/iPhoneOS-9.2-Release/TarotPoints.ipa': (
"Error Domain=ITunesTransporterErrorDomain Code=-18000 "Please specify a value for required option: p" UserInfo={NSLocalizedRecoverySuggestion=Please specify a value for required option: p, NSLocalizedDescription=Please specify a value for required option: p, NSLocalizedFailureReason=Please specify a value for required option: p}"
)
✗ Error: Errors uploading './build/iPhoneOS-9.2-Release/TarotPoints.ipa': (
✗ Please specify a value for required option: p

Le 21 mars 2016 à 22:02, Watson<EMAIL_ADDRESS>a écrit :
cd motion-appstore

Application Loader tool requires  p option to pass your password.
Can you check that your password will be passed as expected ?

The password seems to be passed correctly to altool.
When I run altool manually, the same issue occurs.
When I run ‘motion validate’, there is no error.

Le 22 mars 2016 à 10:32, Watson<EMAIL_ADDRESS>a écrit :
Application Loader tool requires p option to pass your password.
Can you check that your password will be passed as expected ?
—
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub https://github.com/HipByte/motion-appstore/issues/12#issuecomment-199715991

$ /usr/local/itms/bin/iTMSTransporter --version
iTMSTransporter, version 1.7.6

Le 22 mars 2016 à 20:18, John Morrow<EMAIL_ADDRESS>a écrit :
The password seems to be passed correctly to altool.
When I run altool manually, the same issue occurs.
When I run ‘motion validate’, there is no error.

Le 22 mars 2016 à 10:32, Watson<EMAIL_ADDRESS><EMAIL_ADDRESS>a écrit :
Application Loader tool requires p option to pass your password.
Can you check that your password will be passed as expected ?
—
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub https://github.com/HipByte/motion-appstore/issues/12#issuecomment-199715991

Solved !
Somehow I was mislead by a SO post to install v1.7.6 after a clean OS install.
I’ve relinked to /Applications/etc. and it’s working again.
Thanks for your help, and sorry for the trouble.

Le 22 mars 2016 à 20:19, John Morrow<EMAIL_ADDRESS>a écrit :
$ /usr/local/itms/bin/iTMSTransporter --version
iTMSTransporter, version 1.7.6

Le 22 mars 2016 à 20:18, John Morrow<EMAIL_ADDRESS><EMAIL_ADDRESS>a écrit :
The password seems to be passed correctly to altool.
When I run altool manually, the same issue occurs.
When I run ‘motion validate’, there is no error.

Le 22 mars 2016 à 10:32, Watson<EMAIL_ADDRESS><EMAIL_ADDRESS>a écrit :
Application Loader tool requires p option to pass your password.
Can you check that your password will be passed as expected ?
—
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub https://github.com/HipByte/motion-appstore/issues/12#issuecomment-199715991

I’m glad to hear that you solved the issue


Allow configuration of the SantaHost.directory_{white,black}list_regex fields

The sync server code currently supports populating those fields on preflight but Upvote offers no UI means of configuring defaults/values for these fields.
I see the path of least resistance being the following:

Add two fields to the Environment configuration struct: SANTA_DIRECTORY_{WHITE,BLACK}LIST_REGEX
For manual override, add an interface to the admin UI's host view.

if this isn't being worked on, I'm going to see if I can do this as we need this ASAP.
Also there needs to be entries in the Settings admin page.

I've added support for this in: https://github.com/farmersbusinessnetwork/upvote/commit/45aa7663fe1c46b5017ec45ca109806e6c3cadcc


drivers: i3c: Support I3C driver for STM32.

This PR introduces support for the I3C driver on STM32, enabling functionality APIs for I3C controllers.

About Sign-off (Signed-off-by: EXALT Technologies <zephyr@exalt.ps>), the names of groups are not allowed. Please provide one or several developer name. You could use :
Signed-off-by: .....
Co-authored-by: .....

Please also fix https://github.com/zephyrproject-rtos/zephyr/actions/runs/11893617721/job/33140221110?pr=81190#step:11:45

@XenuIsWatching PTAL

done

Please do not resolve comments on your own, and let the original poster do it instead.

Thanks @XenuIsWatching and @ExaltZephyr for the thorough review process!

LGTM now... but it looks like there is an unrelated CI failure, you may need to rebase back on top of main

Need to wait https://github.com/zephyrproject-rtos/zephyr/pull/82363 to be merged.

Please rebase to fix twister CI issues (fixed by https://github.com/zephyrproject-rtos/zephyr/pull/82497)

The scancode job has been stuck since yesterday.
Do you have any suggestions on how to resolve this issue?
I noticed that I do not have the permissions to retrigger it

The scancode job has been stuck since yesterday. Do you have any suggestions on how to resolve this issue? I noticed that I do not have the permissions to retrigger it

Should be back now. GitHub glitch, it would seem.


chore: use playwright to install browsers

Seems we use playwright to install chromium in some places, but not consistently for chromium and firefox. This makes for confusing/fragile stuff in the Dockerfile. Here I'm just using playwright consistently and in
the docs. Note that this bloats the dev/ci images with BOTH browsers, but people should really just build on top of lean and add their browsers and database drivers from there. We may want to have a single primary browse
r we support and just keep that one in our Dockerfile

I meant to write that I haven't tested this and was looking to comment ask for help or instructions as to how to test this.


upgrade to latest truffle-core

@orenyodfat
Would be great to have an upgrade to the latest truffle-core.  It would fix a bug that we experience in Arc.js whenever we run truffle migrate against truffle-hdwallet-provider.

Further, this is blocking upgrade to truffle 5 beta.

This entire repository/package is no longer required as it suffices to just "touch" the updatedAt property in the contract files to prevent truffle from trying to compile them.

....though it will still be needed by previous packages of arc.js


Issue when compute keyFile path?

Hi,
I have detected that, every time I restart the PC where I have homebrige+homebridge-webos-tv installed, the TV asks me again for connection confirmation.
Reviewing in the source code how the path to "keyFile" is calculated, I see that there are possible inconsistencies: https://github.com/search?q=repo%3Amerdok%2Fhomebridge-webos-tv keyfile&type=code
In "WebosTvHelper.js" not depends of keyFile config: https://github.com/merdok/homebridge-webos-tv/blob/master/lib/tools/WebosTvHelper.js#L140
Is that so?
Greetings,

Yes, that is right WebosTvHelper.js does not depend on the homebridge keyFile config as it is used for the CLI tools. For that reason i cannot get the config directory from homebridge, hence those are stored in a separate location.

thanks for your answer.
I am trying to save all the configuration generated by the plugin so that, using an sh script, I can install homebridge+webostv from scratch.
Could this be the reason that every time I restart the PC the TV asks me again for confirmation of the connection?
In what path does the webostvhelper.js file save the key? I see that it uses the env-paths library, but I can't find the file.

The final path depends on the OS which you are using, see details here https://www.npmjs.com/package/env-paths
It might be that the directory it points to on your OS might be cleared after every restart of the PC and then the TV asks again for a confirmation.

Thanks for the involvement.
I am using homebridge docker image (https://github.com/homebridge/docker-homebridge/pkgs/container/homebridge)
According to the env-paths documentation, being linux, the path should be: ~/.local/share/webostv-nodejs
It's right?
And I understand that the "mkdirSync" function (https://github.com/merdok/homebridge-webos-tv/blob/master/lib/tools/WebosTvHelper.js#L40) is not being able to create the directories due to lack of permissions.
If you confirm the path, I can try to modify my sh scripts, generating the directories of the path and copying the key file, complying with the format 'keyFile_' + ip.split('.').join('') + '_' + mac.split(':').join('') described on line 140 (https://github.com/merdok/homebridge-webos-tv/blob/master/lib/tools/WebosTvHelper.js#L140 )

I am not sure about the path in homebridge docker image, but it might indeed be correct.
Yeah, if there are no permissions then the directory will not be created.

I have already found the problem: I was recreating the keyfile and adding a \r\n at the end, generating a new line.
Now I generate the file both in the path defined in the homebridge configuration ("keyFile") and in the path "~/.local/share/webostv-nodejs"
And, for the second route, I have given permissions to the user "homebridge". And to the file. (I'm not sure if this is necessary but it works).
There is no problem in the source code.
Thanks for the help.
I close the issue.


Consider sending merge commits with "preventTransitions=true" flag

When we do squash merge, we might have all commits messages from the branch copied to the merge commit.
In this case we might potentially have:

If there were any "smart commits" commands in the branch commits messages, then they might be executed again because they occurred in the smart commit
If there are some transitions triggers by submitting new commit configured in the issue workflow, then transitions might happen again.

To prevent it, please consider sending merge commit in a separate DevInfo API request with "preventTransitions=true" flag set.

A PR for this request has been approved and will be deployed to prod in the coming week.


Warning: Encountered two children with the same key

Hi!
After some tests on my application, I saw a warning coming about duplicate keys.
After some investigations, I saw it comes from the render function of StackTransitioner.
in RCTView (at View.js:113)
in View (at StackTransitioner.js:264)
in RCTView (at View.js:113)
in View (at StackTransitioner.js:263)
in StackTransitioner (at Stack.js:54)
It appends when you re-render the component, in my case, in conjunction with:
https://github.com/react-native-community/react-native-side-menu
(using BACK, then OPEN MENU quickly).
I will send you a PR to show you how I fixed it (probably not the right solution)

Thanks for the bug report @Dallas62!  I appreciate your pull request.  Guarding against identical location keys is something I tried to do in my componentWillRecieveProps method but it seems that it's not working!  Do you happen to have some example code that reproduces the warning?

I will not have time to make a exemple of code for now, but I tried another solution that is working:
  shouldComponentUpdate(nextProps, nextState) {
    return (nextProps.location || {}).key !== (nextState.previousLocation || {}).key;
  }

Alright, I think I figured how to fix my logic to prevent the state from becoming inconsistent, let me know if you still run into problems with v0.0.5


Update azure-expressroute.md

We've just published a comprehensive ExpressRoute for Microsoft 365 guide at https://aka.ms/erguide which we intend to drive customers to for more information and learn how to ask for an exception. This update reflects that. Please reach out to paulcoll; scschnol; roshanp if more info required.

@JohanFreelancer9 - kindly do the copy editor review for this PR. Thanks

@PaulCollinge

@kelleyvice-msft Please merge this PR. Thanks.

@Kelley @.>                      @Roshan Padmanabhan Kanaka @.>
Hi all,
It looks like this change got overwritten and reverted. What's the best process to change it again?  Another Pull request?
Paul
From: Yogesh Kumar @.>
Sent: 22 March 2021 04:39
To: MicrosoftDocs/microsoft-365-docs @.>
Cc: Paul Collinge @.>; Mention @.>
Subject: Re: [MicrosoftDocs/microsoft-365-docs] Update azure-expressroute.md (#4468)
@kelleyvice-msfthttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fkelleyvice-msft&data=04|01|Paul.Collinge%40microsoft.com|54f289c263d74b4030e008d8ecec6c8c|72f988bf86f141af91ab2d7cd011db47|0|0|637519847465702739|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=KtaVCSvS%2FrCQl5bfR%2Fw7k%2BzVTMA%2BEtDfgKjbr38M2Xc%3D&reserved=0 Please merge this PR. Thanks.

You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMicrosoftDocs%2Fmicrosoft-365-docs%2Fpull%2F4468%23issuecomment-803754591&data=04|01|Paul.Collinge%40microsoft.com|54f289c263d74b4030e008d8ecec6c8c|72f988bf86f141af91ab2d7cd011db47|0|0|637519847465712733|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=GC5Z%2BDt2ecw9VFUTZMdL5RF7rb59a4hs45YcTsFDthY%3D&reserved=0, or unsubscribehttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAKXS4NLUEQCKDCI4KBU72YTTE3CWRANCNFSM4ZMHWLKA&data=04|01|Paul.Collinge%40microsoft.com|54f289c263d74b4030e008d8ecec6c8c|72f988bf86f141af91ab2d7cd011db47|0|0|637519847465712733|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=QQh3ek0%2BBDjRy5ElvxAfcYdk7kpsdvzaqhAyAruXFW0%3D&reserved=0.


OVDB-118: Add a Houdini ABI Test

I had a go at this - it was a bit trickier to achieve than I expected but I have it working.
This adds a new openvdb_houdini/abitest directory which builds two source objects where each source objects pulls the OpenVDB headers from a different place - one from the local repo and one from the Houdini-shipped version of OpenVDB and then the resulting binary links against libopenvdb and libopenvdb_sesi.
This test mirrors what happens in the VDB Primitive code in Houdini by passing around void pointers and static casting them. I tested this by reverting this commit (https://github.com/AcademySoftwareFoundation/openvdb/commit/fc3ccebd7d0cbf4d3c7f642933407de97076e91f) and I reliably get a seg fault or bus error, where it otherwise succeeds.
This is not comprehensively testing everything, but it's a starting point. I also have to update the change logs and the build documentation, so just want to get some thoughts on the approach and I'll complete this.

Minor comments - main one is to advertise the houdini vars from the setup cmake. Otherwise lgtm, thanks a lot for doing this

@Idclip - can you look over this one last time? I believe I've addressed your feedback now.

I've already approved this - still looks good

I've already approved this - still looks good

Right you are, thank you!


Get Started with Data Prepper

Migrate over https://github.com/opensearch-project/data-prepper/blob/main/docs/getting_started.md

We'll only backport this OpenSearch 2.0 and greater

Looks like this is migrated, but only back to 2.2. Is this the intention? @Naarcha-AWS


Native crashes do not include codeBundleId.

Description
Crashes that occur in native code do not include certain data points from the configuration object in javascript.
Issue
We use codepush to deliver bundles to our native app. We initialize the bugnsag client with a default configuration object, and then update it later when the codepush metatadata comes in
CodePush.getUpdateMetadata() ==> which returns JS bundle id
Then we set the property on the config object.
bugsnag.config.codeBundleId
This works great for errors thrown in Javascript. We see the codeBundleId for that error that is thrown.
However, for native crashes, this codeBundleId is missing from the error. This is because the JS Bugsnag layer never tells Native about the new property and therefore it never gets reported during a native crash. (usually the default error handler re-throws the error as a native exception, and it gets reported again)
We could try and reinitialize the bugsnag client via new Client(config), but I have some concerns about calling that constructor more than once...
https://github.com/bugsnag/bugsnag-react-native/blob/master/src/Bugsnag.js#L43-L59
If this method is called more than once, you will be unnecessarily setting the global ErrorUtils errorHandler to another instance of a bugsnag handler.

What happens to the original error handler?
Wouldn't you receive duplicate error reports? (the last registered error handler holds a reference to the previous handler (which is also bugsnag), who in turn holds a reference to the original error handler (which is the original default from React Native).

Is there an easier way to tell native about configuration changes? I don't think calling the native init methods is a great solution.
Environment
Library versions:
├─<EMAIL_ADDRESS>├─<EMAIL_ADDRESS>└─<EMAIL_ADDRESS>

cocoapods version (if any) (pod -v): 1.5.3

iOS/Android version(s): both

simulator/emulator or physical device?: physical

debug mode or production?: production

[x] (iOS only) [BugsnagReactNative start] is present in the
application:didFinishLaunchingWithOptions: method in your AppDelegate
class?

[x] (Android only) BugsnagReactNative.start(this) is present in the
onCreate method of your MainApplication class?

Example code snippet
Here is our file that handles all things related to bugsnag.

import { Client, Configuration } from "bugsnag-react-native";
import { createSelector } from "reselect";
import { getUserEmail, getUserFullName, getUserId } from "../../selectors/user";

import { cloneAndRemoveEmpty } from "../method-helpers";

let bugsnag = null;

function identifyUser() {
  identifyUserWithDetails(reduxStore.getState());
}

export function initBugsnag() {
  if (bugsnag) {
    console.log("bugsnag is already initialized. will return");
    return;
  }

  const configuration = new Configuration();
  configuration.autoCaptureSessions = true;
  configuration.consoleBreadcrumbsEnabled = true;

  configuration.registerBeforeSendCallback((report, error) => {
    if (__DEV__) {
      console.log(
        "Bugsnag caught an error, but we are a debug build, so we will not send the error to bugsnag",
        error
      );
      return false;
    }

    const sanitizedStore = sanitizeStore();

    report.metadata = {
      ...report.metadata, // merge existing metadata that could have been added by other callbacks
      sanitizedStore
    };
    return true;
  });
  bugsnag = new Client(configuration);

  console.log(
    "[Bugsnag] - initBugsnag(). Will subscribe to the root.store"
  );
  reduxStore.subscribe(identifyUser);
  identifyUser();
}

export function setCodePushRelease(codeBundleId) {
  if (bugsnag) {
    console.log("setting the bugsnag codepush config == ", codeBundleId);
    bugsnag.config.codeBundleId = codeBundleId;
  }
}

export function notifyHandledError(error) {
  if (!bugsnag) {
    console.error(
      "[Bugsnag] - trying to notify an error before bugsnag is initialized",
      error
    );
    return;
  }
  if (typeof error === "string") {
    bugsnag.notify(new Error(error));
  } else {
    bugsnag.notify(error);
  }
}

/**
 * Removes properties from the redux store that are too big, or bugsnag reports won't care about
 */
function sanitizeStore() {
  const sanitizedStore = cloneAndRemoveEmpty(reduxStore.getState());
  delete sanitizedStore.locations;
  return sanitizedStore;
}

let loggedIn = false;
const identifyUserWithDetails = createSelector(
  [getUserEmail, getUserFullName, getUserId],
  (email, name, id) => {
    if (email && name && id && bugsnag) {
      console.log("Bugsnag - identifying the user", email, name, id);
      bugsnag.setUser(`${id}`, name, email);
      loggedIn = true;
    } else if (loggedIn && bugsnag) {
      try {
        bugsnag.clearUser();
      } catch (err) {
        console.error("Error trying to log out of Bugsnag");
      }
      loggedIn = false;
    }
  }
);

Thanks for the detailed report @cpetzel. I believe the best way forward would be to expose a new API on the JavaScript side for setting the codeBundleId at a later time, similar to this:
setCodeBundleId = (id) => {
    NativeClient.setCodeBundleId(id) // add the codeBundleId to Android/iOS metadata
}

Would this address your use case?

Thanks for the response. That would be perfect!

What's the status on this, nine months later? We need such a feature as well.
We went around it by extending the bugsnag Client and adding a setCodeBundleId that reinitialises the client. On iOS this works as expected, but on Android it seems like two clients end up running instead (?) and each error gets reported twice, once with the old codeBundleId and once with the new codeBundleId 😢

This has been fixed in (v7.3.4) of the Bugsnag react native library. codeBundleId can be set in the JS, and once set subsequent native events will include it.
As of v7.3 the library itself has now become part of the bugsnag-js repository.
An upgrade guide can be found here with full documentation available here.


When a user uses Save As attributes should be kept

Attributes and Headers/Fields from the import file type are maintained and included in an export.
Some things to think about:

The first file that is imported will drive the schema
A field mapping dialog will be needed for the following files that are imported and merged into the active list.
A user can collect new point from the map; however, they will not be able to add attributes to the fields.

@topowright @NatalieCampos @ACueva @dfoll
This and #335 are part of the larger enhancement of importing/exporting coordinates. Combined, both issues hint towards a wizard like dialog. A discussion is definitely needed on how the experience will be for our users during the import/export coordinates process.


NPCs and/or Dialogs

for stories

Ideas are moved to https://github.com/eskolinaar/rpg-math/discussions


windowless offscreen rendering

Question
Hi,
is there any way to use bgfx for offscreen/windowless rendering?
I'm interested in running (mainly OpenGL in my case) applications on servers that don't always have the X system available. Creating a window on those systems will return a NULL handle, but it's usually possible to create a context for example using EGL (or CGL on mac...).
thanks for releasing bgfx to the community!

Yes and no. Servers or service apps usually don't have access to GPU, and it causes initialization to fail even if you have ability to create window. On Windows in one case I did work around by exposing software rasterizer, but I never dealt with OpenGL. Modern APIs actually allow this windowless rendering. Anyhow if you know examples of windowless OpenGL context post link with example here.

this is a decent article about how to use EGL in linux:
https://devblogs.nvidia.com/parallelforall/egl-eye-opengl-visualization-without-x-server/
A very similar concept applies macOS, with CGL:
http://renderingpipeline.com/2012/05/windowless-opengl-on-macos-x/ (a little old)
and the corresponding API explanation is at: https://developer.apple.com/library/content/documentation/GraphicsImaging/Conceptual/OpenGL-MacProgGuide/opengl_contexts/opengl_contexts.html
No idea about Windows, honestly...
thanks for looking into this!

Hi, I'm also interested in a windowless render solution (GLSL). Do you know 'Spout2' - a open source inter process communication library for OpenGL and DirectX? They do a lot of headless FBO transfers between CPU and GPU. Maybe it's worth a look: https://github.com/leadedge/Spout2
I'm in need of a backbuffer renderer (or a service daemon) for image manipulation with GLSL. Which I want to control with a JavaFX/JDK1.9 backend (via fragmentshader preprocessing and uniform variable manipulating. Transferspeed does not really matter, but processing and analyzing speed. :)

If you just want to run the application without a window on a Linux machine without doing anything with the pixel output you can just run Xvfb and initialize bgfx with the bgfx::RendererType::Noop flag.
Just run those commands before you start your bgfx app.
   export DISPLAY=':99.0'    Xvfb :99 -screen 0 1280x720x24 > /dev/null 2>/tmp/xvfb.err &

@RicoP They need GPU support without window. Noop provides no GPU support.

You can use the Mesa llvmpipe driver alongside Xvfb to do headless on a machine without a graphics card: https://github.com/OKaluza/LavaVu/wiki/Headless-rendering. According to the stats posted for the drawstress example, bgfx can run with llvmpipe: https://bkaradzic.github.io/bgfx/examples.html#drawstress.


fix(libpman): do not close cnt map in scap stats v2 in absence of error

What type of PR is this?

Uncomment one (or more) /kind <> lines:

/kind bug

/kind cleanup

/kind design

/kind documentation

/kind failing-test

/kind feature

Any specific area of the project related to this PR?

Uncomment one (or more) /area <> lines:

/area API-version

/area build

/area CI

/area driver-kmod

/area driver-bpf

/area driver-modern-bpf

/area libscap-engine-bpf

/area libscap-engine-gvisor

/area libscap-engine-kmod

/area libscap-engine-modern-bpf

/area libscap-engine-nodriver

/area libscap-engine-noop

/area libscap-engine-source-plugin

/area libscap-engine-savefile

/area libscap-engine-udig

/area libscap

/area libpman

/area libsinsp

/area tests

/area proposals

Does this PR require a change in the driver versions?

/version driver-API-version-major

/version driver-API-version-minor

/version driver-API-version-patch

/version driver-SCHEMA-version-major

/version driver-SCHEMA-version-minor

/version driver-SCHEMA-version-patch

What this PR does / why we need it:
Do not close cnt map in scap stats v2 in absence of error, else we get libpman: unable to get the counter map for CPU ... starting from the second lookup.
Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:
Does this PR introduce a user-facing change?:

NONE

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: incertum
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [incertum]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

/milestone 0.11.0

LGTM label has been added.  Git tree hash: 9bc3e570df03368e6c635a45f40b8609be43ab2e

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: FedeDP, incertum
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [FedeDP,incertum]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: Andreagit97, FedeDP, incertum
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [Andreagit97,FedeDP,incertum]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


Soap API Generation (WSDL interpreter?)

My colleagues and I enjoy how Saloon makes API integration easier, and gives us a common well documented way of interacting with them. However, we depend on some API's that use the SOAP protocol. Would it be possible to extend the SDK generator to create Saloon SDK's a la Providr.io, and their WsdlToPhp

Supporting SOAP APIs is a little bit outside of what we aim to do with this package at this time, closing this for now.


Scala CE3

sbt 1.9.0 deprecated the IntegrationTest thing so I just made the tests regular tests instead of setting up a subproject.  Technically they are integration tests but for this example I don't think it is necessary to be correct on that as I'd rather not have subprojects.  @paul-snively let me know if you'd rather go the subproject route.

On two runs now, I get a 500 response from the server on scenario 6.
Server invocation:
docker run -it -p8080:8080 ghcr.io/jamesward/easyracer --debug > easyracer.log 2>&1
Run the scala-ce3 subproject with sbt run.
Logs are attached (and not very helpful). :-)
easyracer.log

I'm not sure why we don't see it in CI but the server seems to be doing the correct thing so it seems there is something in raceSuccessAll that is not handling the first response (which is correctly a 500) as a loser.  F.race does say:
If the winner completes with Outcome.Errored, the race raises the error.
So maybe that is why?  But I'm not sure how to fix it.

Oh, I misremembered how the client code works. It raises an error at the end if any of the scenarios' results aren't "right".
OK, I've looked at everything locally again, and the code runs fine. It does log that 500 status, but that's apparently http4s logging the decoding failure from expect. The actual value/error returned is correct and raceSuccessAll handles it correctly.
So it looks like we're back to the drawing board on your CI problem. Can you tell me a bit more about what that looks like in your CI environment?

Ah. Just a red herring then. 😀
For the CI problem, in Scenario 9 the letters are not in the right order and I'm not sure why as the code looks right. And it's odd that it works fine for me locally.  Let me know if you have any ideas on how it might be possible to get those in the wrong order.

I enabled logging and see the responses and instants:
List(
  (2023-10-09T19:35:47.515385Z,t),
  (2023-10-09T19:35:47.556897Z,i),
  (2023-10-09T19:35:47.375633Z,h),
  (2023-10-09T19:35:46.856362Z,r),
  (2023-10-09T19:35:47.234961Z,g),
)

The responses should be spaced out by 1 second each as that is how the server is sending them.  I'm still not sure how that is going wrong and only in CI.  My only guess is that some amount of parallelism is being based on number of cores but I'm not sure how to try and change that.

Yep, I think I see the problem. Great detective work! I'll poke at this a bit later.

Oh, nevermind: the issue isn't on the client side, right? I added logging to my scenario9, and in running the test I saw the second between each response, as you said.

I think this has to be an issue on the client side (not 100% certain though).  None of the other clients have an issue with this.  It only happens in CI (where there are 2 cores).  I guess we could try to reproduce this locally by somehow only having 2 cores... Will have to investigate how to turn my cores off or something.

@jamesward, I've updated my branch on my fork, for what that's worth.
But it's not likely to be worth much, as a conversation I had with Daniel Spiewak on Discord explains:

fwiw -XX:ActiveProcessorCount=2 is the flag you need
so it's not entirely clear from that PR discussion thread what kind of order is being expected
are you seeing the list items out of order?
where is the ordering coming from?
oh it's because you're re-sorting by realTimeInstant
you're basically making the assumption that CE will schedule now <- Clock[IO].realTimeInstant at the moment it receives the response from the server, but that won't happen
this gets complicated and hairy, but the tldr is that the response from the server comes in as an async callback which shows up on the external pool and gets pulled off by worker threads in some order and with some timing
it's entirely possible and plausible even with a small number of workers that things can get reordered with respect to clock time
and at an absolute minimum, the responses from the server sockets goes through multiple nondeterministic linearizations, including one within the kernel itself
basically, don't expect sequencing which isn't enforced by the structure of the program 🙂

Thanks @paul-snively! I've merged this and we can do some more tweaking as needed.


Some story images not displaying until scroll

Sometimes I click on the story icon to go back-to-top of the story feed, there are some new stories with images that don't load. Then when I go to scroll they suddenly appear.

@chrismorast I believe this is now fixed for build 608.  Can you check once it pops through in testflight?

Marking complete as this seems to be fixed! cc @chrismorast

lgtm!


allow backups

I switch phones frequently for rom development and backups not being enabled is a real pain.
This one tiny change will make my life a lot easier, and presents no added security risk as you must approve on an unlocked device.

Without a backup agent configured the unencrypted account credentials make it into the backup. That's why we don't have this enabled.
I'm not opposed to supporting auto backup. But it needs to be done in a way that ensures account credentials are encrypted (or not part of the backup).

On modern android the adb backup flow works like:

Turn on developer mode
Enable adb
Plug phone into computer
Approve adb connection to that particular computer on phone
run "adb backup"
Enter password to symmetrically encrypt backup when prompted
Symmetrically encrypted backup file is saved to computer

Lets compare this flow to the only cumbersome way I am forced to use to backup k-9 mail today without rooting:

Long press account in k-9 mail main window
export settings
long press account again
Account settings > Fetching Mail > Incoming Server
Set "Security" to none
Set "Server" to ip address of my laptop
Run wireshark on my laptop and log password.

The ADB backup flow is strictly better for security and easy of use.

If it was possible to only allow adb backup but not "auto backup" I'd be all for your change. But allowBackup also controls Android's app backup mechanism. See https://developer.android.com/guide/topics/data/autobackup

Thanks for pointing out the autobackup issue.  I wonder if the account passwords can be stored in the location specified by getNoBackupFilesDir(), perhaps in a separate sqlite db.  That might then back up everything but the passwords.  But I realize this might not be compatible with earlier Android versions.  And as I read the API docs, if minsdkversion is < 23, there will be no autobackup at all.

Implementing a BackupAgent that uses the settings import/export code is probably the cleanest way to implement the backup functionality.

There is not a concept of "Auto backup" in AOSP that I know of.  Are you talking about google play services backup? While I would not use that personally, they do at least offer encryption/2fa options as good or better than those required to gain access to the phone directly.
If someone is using a totally third party backup tool known to use insecure practices I think that is outside of an app authors responsibility similarly as the user choice to automatically leak the password via a bad password manger or choosing "Security None".

Agreed about BackupAgent, and it shouldn't be too hard to do, either

I created issue #3857 for the BackupAgent solution. Closing this pull request.

Android has now option to enable backups, only if they are encrypted.
Info:
https://github.com/seedvault-app/seedvault/wiki/FAQ
And mentioned example how it was enabled in the Tranports app:
https://github.com/grote/Transportr/commit/4dc38f429f75909a088d8bd8a5b3b5ddd8030f71


News flash location extraction - Try rectify location string when google returns no results

"... "best effort"

Desperate attempt to extract some info from a news flash :)

I have nothing to add to Elazar's comments. Once they are resolved, I think this can be merged.
Pay attention that I would try something smarter to verify the ב is a connector and not part of the word itself (there are hebrew tokenizers that can help with that. YAP, HebrewNLP and more

@omesser @elazarg  can this be merged?
@omesser did you notice latest comment by @Mano3 ?

@omesser if you prefer not to address my comments about the way to avoiding recursion, and the comment about finding an end-token (period, for example), then please add a TODO in the code (probably only a link to this discussion), so these can be addressed later on (I might address it myself).

Hey folks, I was otherwise pre-occupied last week, will address the
comments in the upcoming days
On Sat, Oct 31, 2020, 11:41 PM Elazar Gershuni<EMAIL_ADDRESS>wrote:

@omesser https://github.com/omesser if you prefer not to address my
comments about the way to avoiding recursion, and the comment about finding
an end-token (period, for example), then please add a TODO in the code
(probably only a link to this discussion), so these can be addressed later
on (I might address it myself).
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/hasadna/anyway/pull/1550#issuecomment-719991955, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AEKW5KQF3OIXBVOD5SQB3YLSNSAAXANCNFSM4SYQKABA
.

@omesser no worries, whenever you have time :)

@elazarg @Mano3
Sorry for the delays, just pushed changes.
PTAL - I hope these changes address most of the comments (+black fmting because CI yelled)
@Mano3 's - wrt https://github.com/hasadna/anyway/pull/1550#issuecomment-716069718 - Thanks for the pointer! I don't have much experience (read: 0) in the NLP realm, so I took your pointers and checked out yap, NLPH and a few others and spent a few minutes messing around with them.
I think it should be easy to do something just a bit more clever by bringing up yap-api service (it got a handy all-included dockerfile) - then, like you suggested, we can narrow the ב here to one which is also a preposition.
However, If that's ok with you, I would give this a shot in a separate PR, as it requires adding another service container to the mix and has some caveats:

Resource consumption - yap-api with all its (presumably) models in mem takes up over 6Gb idle (@atalyaalon  - does that "fly"? or out of the question altogether?)
Value in this flow: I don't know if it will give much value in this flow specifically - this PR is already very edge-casy and its benefits are questionable. Google's engine deals with understanding the sentences pretty well in most cases to my understanding. Here we're just giving it a push in the right direction in some cases.

But, maybe it would be beneficial to have this running as part of the system for other (potential?) use cases - whenever you'll need to analyze a hebrew sentence you can hit it with a simple HTTP request.
In that case, this would just be a good excuse to introduce it, do this bit in a nicer way and have this facility in the system for future use.
@Mano3 @atalyaalon - if that sounds ok I would issue this PR

@omesser thank you for all of the hard work!
yap-api sounds great - and if we decide we want it we'll take care of the resources.
@Mano3 @elazarg what do you think? Is it overkill at the moment? Or a good opportunity to create the building blocks for future NLP models?

@atalyaalon I think any discussion or work on heavier NLP tools should be in a dedicated issue (and PRs).

@atalyaalon I think any discussion or work on heavier NLP tools should be in a dedicated issue (and PRs).

agreed

@atalyaalon @elazarg @Mano3  - thanks for the quick reviews and feedback.
Please let me know / mention me in the appropriate issue if you would like me to add the yap server or similar, would be glad to give a hand with that

Thinking about it again, if this is just to handle edge cases and we don't expect it to improve accuracy (I actually expect it to cause some trouble on things like סמוך לצומת משהו ליד באר שבע) should be if Google's result on first candidate is None, try trimmed candidate instead?

@Mano3  -

"if Google's result on first candidate is None, try trimmed candidate instead"? @omesser"

This is what happens.
First the original string is used: https://github.com/hasadna/anyway/pull/1550/files#diff-f852cfa8f792b2468249a302f2c3e95d435ab8c6d203b68a96ea7deeefd8be4cR334
And only if there is no geocode result at all (https://github.com/hasadna/anyway/pull/1550/files#diff-f852cfa8f792b2468249a302f2c3e95d435ab8c6d203b68a96ea7deeefd8be4cR143) we go on to the next iteration and try the trim

@omesser Oh, I didn't see the return was also in the loop.


How do I remove an Air conditioner from my cash that homebridge is looking for but I have disconnected.

Login into Homebridge UI.
Three Dots on top right.
Homebridge Settings.
Scroll down and near the bottom is "Managed Cached Accessories"
Click on the box to the right of "Remove Single Cached Accessory"
A list will pop up listing each accessory. Click on the red trash can.


Is there a UI available to configure O3R camera parameters? What is the maximum resolution supported for M03969?

Hi. I was wondering if there is a UI  available (like a web interface) to configure all of the available O3R camera parameters such as modes, filters, resolution, fov etc. or is it the case that O3R camera parameters can only be configured via json manipulation using the Get() and Set() commands in the library?
For the M03969, Is 224x172 the maximum resolution that is supported in 3D?

Hey @mehranq we are working on a support for the O3R in the ifm Vision Assistant. Please get in touch with  ifm support it is maybe possible to get a preview of the Vision Assistant.

Oh sorry I missed the question about the resolution. Yes the maximum resolution is 224x172. We have planned more heads with higher resolution. Please get in touch with the ifm sales team for more information when those will be available.

Thank you for your answer. About the support for the O3R in the ifm Vision Assistant, any estimate on when it will be officially available?

@mehranq  as @graugans mention please reached out to<EMAIL_ADDRESS>for the official release of O3R support in ifm Vision Assistant and they might  also help to get the  preview version of the same.

Will do that. Thank you.


Could not locate Gemfile ERROR: Build failed: exit code 1

facing problem with CI runner,
$ ruby -v
ruby 2.1.10p492 (2016-04-01 revision 54464) [x86_64-linux]
$ which ruby
/usr/local/bin/ruby
$ gem install bundler --no-ri --no-rdoc
Successfully installed bundler-1.13.0
1 gem installed
$ bundle install --jobs $(nproc)  "${FLAGS[@]}"
Could not locate Gemfile
ERROR: Build failed: exit code 1

This project is deprecated
But even than, you seem to be in the wrong folder or there really is no Gemfile there.


Add logging with Pino

close #23

@allcontributors please add fabnguess for code

@allcontributors please add @fabnguess for code


Dice filter logic

Closes #98.

Codecov Report
Patch coverage: 100.00% and project coverage change: -0.19 :warning:

Comparison is base (80b3349) 99.81% compared to head (b346a9f) 99.63%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
Additional details and impacted files
@@            Coverage Diff             @@
##             main      #99      +/-   ##
==========================================
- Coverage   99.81%   99.63%   -0.19%
==========================================
  Files          45       45
  Lines        2156     2164       +8
==========================================
+ Hits         2152     2156       +4
- Misses          4        8       +4

Flag
Coverage Δ

unittests
99.63% <100.00%> (-0.19%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

api/schemas/cards.py
100.00% <100.00%> (ø)

api/views/cards.py
99.43% <100.00%> (+0.01%)
:arrow_up:

... and 2 files with indirect coverage changes

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


CEPI Enhancements and Future Items to Discuss

Foundation-related data #2631
Wagtail Update

@MansiKamthan @SachinPawaskarUNO


add section in kg2-versions.md for KG2.7.1

The issue KG2.7.1 addressed was issue #97. It was run on kg2steve.rtx.ai.

Hi @acevedol any progress on this?


Improve ChainAdapter typings

This adds a ChainSpecificAdapterProps<T, U, V> type as proposed by @reidrankin in https://github.com/shapeshift/web/pull/704 and extends ChainAdapter with a single usage of it, for ChainTypes.Ethereum.
ChainSpecificAdapterProps is to be used as an intersection with ChainAdapter and allows to declare chain-specific properties for each chain.
Example usage: https://github.com/shapeshift/web/blob/65ea158bdba3623842eec4cb919bf3f650ae5bd7/src/components/Modals/Send/views/Address.tsx#L83

Recreating directly from project branch now that I got authorization for it. CI will be able to properly ran this way.


Don't pass -cmd to capture_ZWO

-cmd RPi_COMMAND is only used by capture_RPi, so don't pass to capture_ZWO.
Not a big deal, but looks better.

In next release


Issue 2 - Create simple markdown parser

Issue 2 - Create simple markdown parser
Changes:

Add Color Parser for Markdown.
Add Color Parser for Markdown.
Add unit tests for markdown
Fix Github workflow

resolves #2

Retry after fixing  build

Enable Xml Documentation for all configurations


Getting Confidence Value for Pixel Point

After going through this forum and pyrealsense2 docs; it's still not clear to me how a confidence value is obtained for a given pixel point.
I'm enabling the confidence stream like so:
config.enable_stream(rs.stream.confidence, 1024, 768, rs.format.raw8, 30)
I assume this stream would have to be aligned with the depth frame(?). And then how would I retrieve the confidence value for the depth at a given pixel location (x,y)?
I'm using Python. My end goal is to get the depth confidence value at a bunch of candidate points and then use the point with that has the highest confidence value.
Thanks in advance.

Hi @ShankarKandasamy  The old RealSense SR300 camera model (which is now retired) was able to produce a confidence map but the 400 Series range of stereo depth cameras do not.  Another 400 Series user who attempted to access the confidence stream was provided advice at https://github.com/IntelRealSense/librealsense/issues/3185#issuecomment-460540961 regarding how they could achieve something similar to confidence mapping.

Hi @MartyG-RealSense, I'm actually using the L515. Does this change anything?

Yes, the confidence stream is usable on the L515 lidar depth model.  Advice provided at https://github.com/IntelRealSense/librealsense/issues/8655#issuecomment-809603271 states that the confidence stream of L515 is already perfectly aligned with the depth stream by default without you having to align them yourself.

Thanks, @MartyG-RealSense. I was able to get the answer from  #8655 (comment). I'm not a C programmer so it took some struggle but below is the Python code that successfully prints the depth and corresponding confidence value when you left-click on a point on the depth map, incase it will be helpful to others. This code assumes the confidence stream of L515 is already aligned with the depth stream.
import pyrealsense2 as rs
import numpy as np
import cv2

# Mouse callback function to handle clicks in the depth window
def click_event(event, x, y, flags, params):
    if event == cv2.EVENT_LBUTTONDOWN:
        depth_frame = params.get('depth_frame')
        confidence_data = params.get('confidence_data')
        if depth_frame and confidence_data is not None:
            depth = depth_frame.get_distance(x, y)
            confidence_value = confidence_data[y, x]
            print(f"Clicked at ({x}, {y}) - Depth: {depth} meters, Confidence: {confidence_value}")

pipeline = rs.pipeline()
config = rs.config()
config.enable_stream(rs.stream.depth, 640, 480, rs.format.z16, 30)
config.enable_stream(rs.stream.confidence, 640, 480, rs.format.raw8, 30)

try:
    pipeline.start(config)

    cv2.namedWindow('Depth Stream', cv2.WINDOW_AUTOSIZE)

    while True:
        frames = pipeline.wait_for_frames()
        depth_frame = frames.get_depth_frame()
        confidence_frame = frames.first(rs.stream.confidence).as_frame() if frames.first(rs.stream.confidence) else None

        if not depth_frame or not confidence_frame:
            continue

        depth_image = np.asanyarray(depth_frame.get_data())
        confidence_data = np.asanyarray(confidence_frame.get_data()) if confidence_frame else None

        depth_colormap = cv2.applyColorMap(cv2.convertScaleAbs(depth_image, alpha=0.03), cv2.COLORMAP_JET)

        params = {'Depth Frame': depth_frame, 'Confidence Data': confidence_data}

        cv2.setMouseCallback('Depth Stream', click_event, params)

        cv2.imshow('Depth Stream', depth_colormap)

        key = cv2.waitKey(1)
        if key & 0xFF == ord('q') or key == 27:
            cv2.destroyAllWindows()
            break

finally:
    pipeline.stop()

You are very welcome.  I'm pleased to hear that you achieved a solution.  Thanks very much for the update and for sharing your solution!


[5.2][semantic-arc-opts] When performing load [copy] -> load_borrow on classes, do not ignore forwarding uses.

This is the first of two commits. This commit is a very simple, easily
cherry-pickable fix but does not use the LiveRange infrastructure so that we
handle forwarding uses here. Instead, we just bail if all uses of our load
[copy] are not destroy_value.
In a subsequent commit, I am going to change this to use the LiveRange
infrastructure so we will handle these cases. Sadly doing so doesn't cherry-pick
well. = /.
rdar://58289320
(cherry picked from commit 23f36a059a15f47b2a622bf16cb89557a97aa18c)

Replace this paragraph with a description of your changes and rationale. Provide links to external references/discussions if appropriate.

Resolves SR-NNNN.

@swift-ci test


[WIP] Updated project plan with MoSCoW and other stuff

For the features, you can also take a look at my section What is a REPL?.

The quality assurance section still needs to be written. When that is done, I think this can be  merged.

I have added a section on quality insurance. @gfokkema @Balletie please review.


readme:UPS and USPS shipping methods were reversed

This was just to catch a small typo incase anyone just copy/pastes out of the readme into their code.

Sorry seeing that the build is failing, let me know if I should merge this onto a different branch. It's just a text update.

@wildbillcat Thanks! No problem, the build fail is unrelated issue with the appveyor config that needs to be fixed I think.


Feature Support fast schema evolution in shared data mode

This PR is part of the PR stack to support fast schema evolution in shared data mode.
The PR itself doesn't add any new functionality, it's just a refactoring of existing code to facilitate the development of fast schema evolution in the future.

Unified analyze code between fast and non-fast schema evolution paths for consistency
Removed duplicate default value calculation logic
Eliminated unnecessary null checks
Added PartitionInfo::getPartitionColumns() to reduce schema change coupling
Added DistributionInfo::getDistributionColumns() to reduce schema change coupling

Fixes #38263
What type of PR is this:

[ ] BugFix
[x] Feature
[ ] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Does this PR entail a change in behavior?

[ ] Yes, this PR will result in a change in behavior.
[x] No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

[ ] Interface/UI changes: syntax, type conversion, expression evaluation, display information
[ ] Parameter changes: default values, similar parameters but with different default values
[ ] Policy changes: use new policy to replace old one, functionality automatically enabled
[ ] Feature removed
[ ] Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

[ ] This is a backport pr

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto-backported to the target branch

[x] 3.2
[ ] 3.1
[ ] 3.0
[ ] 2.5

@wyb @sevev PTAL

@wyb @sevev PTAL

@mergifyio rebase


fix: #1854 #1841 #1855

Summary
fix
#1854  Jira issue's epic link and story points are not correctly transformed
#1841 Postgres Support: back quotes caused error
#1855 Jira issue's original_status is empty
Key Points

[ ] This is a breaking change
[ ] New or existing documentation is updated

Does this close any open issues?
close #1854
close #1841
close #1855
Screenshots

Other Information
Any other information that is important to this PR.

LGTM


Add adminer-style compiler to single file

And offer to configure and download kint in a single php file

I decided to use classpreloader since it's far more popular and seems to work better for this use case.
Fixed in 2.0-beta2


Meet the multi-tenancy benchmarks requirements

Pass the benchmarks test as specified by SIG multi-tenancy benchmarks.
Target for Capsule should be the L2 profile, being the L3 out-of-scope:

Level 3
This profile extends the "Level 2" profile. Items in this profile:

are intended for use where a higher-level of multi-tenancy is paramount
allow usage of all Kubernetes features. For example, a tenant may install their own CRD versions.

Just saw this but pretty sure would be great to start thinking how to pass these checks.
Thanks for reporting this

I think we cannot adherer to all the benchmarks, just an example:

Block use of NodePort Services

Tenants should not be able to create services of type NodePort

With the BYOD scenario adopted also by @MaxFedotov, this is a too big limitation. What we could do is to toggle this option at Cluster Administrator level, allowing us to enable or not the policy. WDYT @bsctl @MaxFedotov?

@prometherion yeah, that's will be too big limitation for us.
What we could do is to toggle this option at Cluster Administrator level, allowing us to enable or not the policy. WDYT @bsctl @MaxFedotov?
So add additional configuration param, which will allow to enable\disable this behavior?

It's up to us, honestly.
Actually, there's no yet a real standard for the multi-tenancy model in Kubernetes, although the working group is working on that: that's a generic validation schema appliable to generic multi-tenancy projects and we should adhere to it, or at least claims what we can tackle or not. The NodePorts one is a limitation of Kubernetes, of course, but we found a way, with Capsule and the kube-proxy alternative (👀), to overcome easily in order to make this project as much as non-opinionated possible.
It's up to us to decide where to put this validation: honestly, I would make it configurable at the Tenant level, for many reasons, as follows.

I could have a Tenant on shared nodes where I cannot manage NodePorts: this means the Tenant definition will turn off the feature, as .spec.enableNodePorts=false
For Tenants with their dedicated node pools, adopting the BYOD approach, I could use the patched kube-proxy and enabling the NodePort feature with .spec.enableNodePorts=true

Adopting this way, we're not opinionated and it's up to the Cluster Administrator to set the preferred policy in a fine-grained way.

That's looks good! We already had validating webhook for services, so we can add this additional check to it. I can take this task, if you are ok :)

@prometherion @MaxFedotov I'm going to open a specific issue for this topic and leave the current one as placeholder for keeping track of the generic requirement for compliance according to SIG multi-tenancy benchmark.
What do you think? Can we address this in the coming v0.1.0 release?

That's looks good! We already had validating webhook for services, so we can add this additional check to it. I can take this task, if you are ok :)

@MaxFedotov just opened #249 . Please feel free to assign it to yourself

IMHO Minimal security requirements which toucles namespaces-as-a-service should be considered if they are not already implemented. As they are following CN Security best practices for cluster security.

@nmarcetic maybe we could consider the RBAC one, since NetworkPolicy and Pod Security Standards items are already put in place by the Tenant definition using the .spec.networkPolicies and .spec.additionalRoleBindings keys.
But I think we should address this discussion in another issue since this is just for the MT benchmark.


What is required if I wanted to connect different MSSQL onpremise servers and build a powerbi report

Can I use the data gateway for MSSQL Servers that are located in different regions and build a powerbi report by using all the data sources all together?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 5e1f5955-e5b8-9cff-873e-4a195a462e62
Version Independent ID: 12a87ce1-0e1b-f21c-bad3-09963e628d99
Content: On-premises data gateway - Power BI
Content Source: powerbi-docs/service-gateway-onprem.md
Service: powerbi
GitHub Login: @mgblythe
Microsoft Alias: mblythe

Thanks Anmo;gan81 -- will reply back on this the week of 8/20.

Hi,
Any updates???
From: Michael Blythe<EMAIL_ADDRESS>Sent: 18 August 2018 02:37
To: MicrosoftDocs/powerbi-docs<EMAIL_ADDRESS>Cc: Anmol Ganju<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [MicrosoftDocs/powerbi-docs] What is required if I wanted to connect different MSSQL onpremise servers and build a powerbi report (#153)
Thanks Anmo;gan81 -- will reply back on this the week of 8/20.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/MicrosoftDocs/powerbi-docs/issues/153#issuecomment-413988405, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AhHKp4NH0Q_5HhQPvoHa_hW3_QaBuRpjks5uRzBzgaJpZM4Vzlcv.
This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission. If verification is required please request a hard-copy version. IFI Techsolutions Pvt. Ltd. : www.ifi.tech

@Anmolgan81  - This should be possible but you will need to use a single gateway since the same Power BI report uses all these data sources
FYI @mgblythe

@Anmolgan81 - closing this out, but please reopen if necessary. Thanks!


Gates

2 input AND, OR, NAND, NOR, XOR and XNOR gates and NOT gate
RTL model using operators and structural model using gate primitives
File structure example

nand

nand_struct.v
nand_struct_tb.v
nand_rtl.v
nand_rtl_tb.v

where _struct is for the structural model and _rtl for the RTL model
This issue can be broken down and solved in multiple PRs.

Hi @adithyasunil26 Can I take up this issue?

Hey @swastik1308! Yes, you can take up one of the gates.

Can I take this up?

@KarthikL1729 Sure. Go ahead.

can i take AND,OR gates?

Can i please take up XNOR gate?


Fix std/io/io_spec.cr on FreeBSD

pipe(2) returns bidirectional file descriptors on FreeBSD, gate
corresponding tests behind the platform flag. While here, also adjust
expected error message for the invalid byte sequence test.
Fixes #12114

Thanks!
Could you please add a short comment in code to explain why these specs are disabled. The sentence from the PR description should do.

@dmgk Why did you close the PR?

Sorry, closed by mistake. I'll create a new PR.


Working with http_proxy

Hi,
Can you please let me know where to specify the http_proxy when running the installation? I am getting errors as below during install which I believe could be attributed to the proxy settings:
TASK [../../roles/kubeinit_libvirt : Download Debian cloud image] **************************************************************************************************
skipping: [localhost] => {"changed": false, "skip_reason": "Conditional result was False"}
TASK [../../roles/kubeinit_libvirt : Download CentOS cloud image] **************************************************************************************************
fatal: [localhost -> nyctea]: FAILED! => {"changed": false, "dest": "/var/lib/libvirt/images/CentOS-Stream-GenericCloud-8-20210603.0.x86_64.qcow2", "elapsed": 10, "msg": "Request failed: <urlopen error [Errno 101] Network is unreachable>", "url": "https://cloud.centos.org/centos/8-stream/x86_64/images/CentOS-Stream-GenericCloud-8-20210603.0.x86_64.qcow2"}

Just to add, curl and wget to https://cloud.centos.org/centos/8-stream/x86_64/images/CentOS-Stream-GenericCloud-8-20210603.0.x86_64.qcow2   are working fine. Thanks.


Adjust UI for Mobile

At present, we have a permanent Navigation Drawer and no way to open/close it.
On mobile, this should probably be a separate page; an Index page from which you select the note you wish to view/edit.
One way to achieve this is with CSS classes, which essentially hide/unhide elements in the browser...
...but what might be better is to achieve this programmatically so that unnecessary elements aren't rendered at all and a completely different experience is provided on smaller screens.
Vuetify has support for accessing the breakpoints programmatically in JS, so... that shouldn't be a problem. You could in fact have a totally separate set of views and components that are made for mobile and only rendered on smaller screens... buuuuut... that wouldn't necessarily be the best way about this. Worth exploring, but ultimately we probably use a mixture of JS and CSS rules to achieve the desired results.

Partially resolved by f887f3c306097ef4a63c724838e2213d431a827c
Further fixed by 7e5d97aee9b8b4d1e7f11033a6eaca3f978b2994

Partially resolved by f887f3c306097ef4a63c724838e2213d431a827c
Further fixed by 7e5d97aee9b8b4d1e7f11033a6eaca3f978b2994


Upload 5 cross-validation folds

Currently, the packaged model only contains 1 fold (fold_3). I did this to reduce the filesize from 1Gb+ to ~200Mb. However, when I was comparing the single fold predictions with the 5 fold ensembled predictions, I found a pretty big difference. The input image was taken from another group (Stanford), so there is a slight domain shift even though they are TEM images with a similar resolution. I won't post the original image for privacy reasons, but here is the single fold mask (current model release):

And this is the ensemble model applied to the same image:

The input image is not shown but this second mask is much better than the first one. It still shows undersampling, but it's less severe than with the single fold model. Also, the axon shapes are much more regular. I think that for small datasets, the ensembling in nnUNet works particularly well because it contains information from all training images, and the data was very limited (5 images).
With this being said, I think it would be best to package the 5 folds, even though it gives a much bigger model.

This was uploaded in February as a release asset.


Ignore check code.gitea.io/gitea/data on make test

LGTM

let L-G-T-M work

What is that?

It was created by some PR and there some .go files in it.

There is no data package within master branch.

Yes. It's created by some test function. Oh, It should be removed after test is over. @ethantkoenig


I want to animate the hamburger menu

As a designer, I want to animate the hamburger menu
Acceptance Criteria:

Animation like we have in the current one (hamburger to cross)

https://www.figma.com/proto/lgns6S3DT4CbCqKQrEf0z4/Oak-Design-System-2022?page-id=757%3A121514&node-id=757%3A121514&viewport=458%2C388%2C0.43&scaling=scale-down&starting-point-node-id=757%3A121795

not on the road map


Uploading 40MB File to database

Does PFFIle still have a max file limit of 10MB? If so how can I bypass this or what is the best method for uploading larger files to a database?

Hey @mocode808,
Limit was removed in the current latest version of iOS SDK (1.13.0).
Meaning that you don't actually have to do anything special on the client to upload files larger than 10MB.
On the backend you have few options:

Parse.com has a generous file upload limit, though I recommend avoiding using it for anything new and recommend migrating from it.
Parse Server has a built-in 20MB set, but it could be removed simply by using a maxUploadSize configuration option. You can find the code for it here.
Also, specifically for Parse Server - we have many solutions for files, like custom S3, Google Cloud Storage or simple on-disk files. All of this is documented here.

Let me know if this doesn't help or you are still running into issues.


NDB projection queries broken when using the datastore v3 stub

Expected Behavior
Projection queries should work as normal when using the datastore stub for testing.
Actual Behavior
Performing a simple projection query when the datastore stub is active results in the following exception:
>>> Foo.query(projection=[Foo.b]).get()
WARNING:root:suspended generator _run_to_list(query.py:1043) raised EncodeError(Message apphosting_datastore_v3_bytes.Query.Filter is missing required fields: property[0].value)
WARNING:root:suspended generator _get_async(query.py:1314) raised EncodeError(Message apphosting_datastore_v3_bytes.Query.Filter is missing required fields: property[0].value)
Traceback (most recent call last):
  Cell In [15], line 1
    Foo.query(projection=[Foo.b]).get()
  File .../google/appengine/ext/ndb/query.py:1301 in get
    return self.get_async(**q_options).get_result()
  File .../google/appengine/ext/ndb/tasklets.py:397 in get_result
    self.check_success()
  File .../google/appengine/ext/ndb/tasklets.py:394 in check_success
    six.reraise(self._exception.__class__, self._exception, self._traceback)
  File .../six.py:719 in reraise
    raise value
  File .../google/appengine/ext/ndb/tasklets.py:441 in _help_tasklet_along
    value = gen.throw(exc.__class__, exc, tb)
  File .../google/appengine/ext/ndb/query.py:1314 in _get_async
    res = yield self.fetch_async(1, **q_options)
  File .../google/appengine/ext/ndb/tasklets.py:441 in _help_tasklet_along
    value = gen.throw(exc.__class__, exc, tb)
  File .../google/appengine/ext/ndb/query.py:1043 in _run_to_list
    batch = yield rpc
  File .../google/appengine/ext/ndb/tasklets.py:527 in _on_rpc_completion
    result = rpc.get_result()
  File .../google/appengine/api/apiproxy_stub_map.py:648 in get_result
    return self.__get_result_hook(self)
  File .../google/appengine/datastore/datastore_query.py:2949 in __query_result_hook
    self._batch_shared.conn.check_rpc_success(rpc)
  File .../google/appengine/datastore/datastore_rpc.py:1365 in check_rpc_success
    rpc.check_success()
  File .../google/appengine/api/apiproxy_stub_map.py:614 in check_success
    self.__rpc.CheckSuccess()
  File .../google/appengine/api/apiproxy_rpc.py:149 in CheckSuccess
    raise self.exception
  File .../google/appengine/api/apiproxy_rpc.py:212 in _CaptureTrace
    f()
  File .../google/appengine/api/apiproxy_rpc.py:207 in _SendRequest
    self.stub.MakeSyncCall(self.package, self.call, self.request, self.response)
  File .../google/appengine/api/datastore_file_stub.py:593 in MakeSyncCall
    super(DatastoreFileStub, self).MakeSyncCall(service,
  File .../google/appengine/api/apiproxy_stub.py:143 in MakeSyncCall
    method(request, response)
  File .../google/appengine/datastore/datastore_stub_util.py:3072 in UpdateIndexesWrapper
    return func(self, *args, **kwargs)
  File .../google/appengine/datastore/datastore_stub_util.py:3362 in _Dynamic_RunQuery
    cursor = self._datastore.GetQueryCursor(query, self._trusted, self._app_id)
  File .../google/appengine/datastore/datastore_stub_util.py:2639 in GetQueryCursor
      return self._GetQueryCursor(raw_query, filters, orders, index_list)
  File .../google/appengine/api/datastore_file_stub.py:696 in _GetQueryCursor
    return datastore_stub_util._ExecuteQuery(results, query, filters, orders,
  File .../google/appengine/datastore/datastore_stub_util.py:5129 in _ExecuteQuery
    dsquery = _MakeQuery(query, filters, orders)
  File .../google/appengine/datastore/datastore_stub_util.py:5022 in _MakeQuery
    clone_pb.filter.extend(filters)
EncodeError: Message apphosting_datastore_v3_bytes.Query.Filter is missing required fields: property[0].value

Steps to Reproduce the Problem
Simple test case:
>>> from google.appengine.ext import testbed
>>> tb = testbed.Testbed()
>>> tb.activate()
>>> tb.init_datastore_v3_stub()
>>> tb.init_memcache_stub()
>>> from google.appengine.ext import ndb
>>> class Foo(ndb.Model):
...     a = ndb.StringProperty(indexed=True)
...     b = ndb.StringProperty(indexed=True)
...
>>> foo = Foo(a='a', b='b')
>>> foo.put()
Key('Foo', 1)
>>> Foo.query(projection=[Foo.b]).get()

Analysis
It seems the protobuf protocol for datastore (are these protocols documented anywhere?) expects properties in a filter to have a value, even if it's an empty value (in the case of EXISTS filters, which are created for projections).
In this version of the library, when building a query filter, the value field of projected properties are cleared here.
Whereas on the same line, in the old Python 2 app engine code, it calls:
new_prop.mutable_value()

Why the difference, I don't know.  Is it a difference in the v4 protocol?  Or just an oversight?
Specifications

Version: appengine-python-standard==1.0.0
Platform: Python 3.9

I forgot to add to this, this is my workaround for this issue via monkeypatch:
def patch_datastore():
    """
    Workaround for https://github.com/GoogleCloudPlatform/appengine-python-standard/issues/67

    TBD if this bug has runtime impact as well, or if it's only in the datastore stub used
    in testing...
    """

    if six.PY2:
        return

    from google.appengine.datastore import datastore_pb, datastore_index

    orig_Normalize = datastore_index.Normalize

    def Normalize(filters, orders, exists):
        filters, orders = orig_Normalize(filters, orders, exists)

        for filt in filters:
            if filt.op == datastore_pb.Query.Filter.EXISTS and len(filt.property) == 1:
                # This is how filters for properties in projection queries look so long
                # as there are no other filters on that property
                # Make sure they have a value field set (it can be unitialized)
                filt.property[0].value.SetInParent()

        return filters, orders

    datastore_index.Normalize = Normalize

Issue is with protobuf version 4 and above. Downgrading to the latest 3 version (3.20.3 right now) makes projection queries work again out of the box. The reason that this isn't caught by the tests is that protobuf library is set to <4 in the tests, but >=3.19.0 in setup.py.
https://github.com/GoogleCloudPlatform/appengine-python-standard/blob/31ceb17b3fb0bdbba208a6cbea904a1cd3392f0f/setup.py#L23
https://github.com/GoogleCloudPlatform/appengine-python-standard/blob/31ceb17b3fb0bdbba208a6cbea904a1cd3392f0f/tox.ini#L26
Enforcing protobuf>=3.19.0,<4 in setup.py should do the trick; but of course, that might conflict with other libraries.

Yes, the issue is with protobuf version 4 and above. That's why the unit tests were set up to use version < 4. However, it seemed too strict to restrict the version in setup.py since it might mess with existing users who are using protobuf >= 4 for their app and are not using functionalities of appengine-python-standard that break with a newer protobuf.

👋 from an appengine-python-standard user (consumer).
i just ran into this issue when upgrading a py2 service that uses projection queries. the particular error i received (google.protobuf.message.EncodeError: Message apphosting_datastore_v3_bytes.Query.Filter is missing required fields: property[0].value) caused some head-scratching and minor panic. 😅
luckily, i isolated the issue and found this thread fairly quickly (<10m). sure enough, adding the protobuf version restriction in the service's requirements.txt seems to take care of the unit test failures. 🎉
now the service's requirements.txt looks like this:
appengine-python-standard>=1.0.0
protobuf>=3.19.0,<4

# ... other runtime deps

that leads me to my first question: is it safe/appropriate to add protobuf>=3.19.0,<4 to GAE runtime deps? (i'm guessing/hoping "yes".) or must we only add protobuf>=3.19.0,<4 to our dev deps?
in any case, this leaves me (and others) with remembering to add protobuf>=3.19.0,<4 to our deps in order to avoid this issue. 😞 (i mean, there must be others who use init_datastore_v3_stub() in unit tests for methods with projection queries, right? ...right? 😬)
second question (comment/suggestion): this situation strikes me as something that should be fixed, or at least documented in the official setup instructions. would the powers that be consider such a thing?
lastly, many thanks @embray and @spiqueras for documenting the workarounds!


Shall we make RunCat only one running in taskbar?

The number of cat as same as the times I click RunCat.exe.

This should be resolved since has been implemented in commit 5fb9515e


Speech-to-text API returns empty response

I'm using Google Cloud Speech to text api in Java.
I'm getting 0 results when I call speechClient.recognize
Environment details

Specify the API at the beginning of the title. For example, "[vision]: ...").
General, Core, and Other are also allowed as types
OS type and version:
Java version: Java 17
Version(s): 4.10.0

Code example
    public void syncRecognizeFile(String fileName) throws Exception {
        CredentialsProvider credentialsProvider = FixedCredentialsProvider.create(ServiceAccountCredentials.fromStream(resource.getInputStream()));

        SpeechSettings settings = SpeechSettings.newBuilder().setCredentialsProvider(credentialsProvider).build();

        try (SpeechClient speech = SpeechClient.create(settings)) {
            Path path = Paths.get(fileName);
            byte[] data = Files.readAllBytes(path);
            ByteString audioBytes = ByteString.copyFrom(data);

            // Configure request with local raw PCM audio
            RecognitionConfig config =
                    RecognitionConfig.newBuilder()
                            .setEncoding(RecognitionConfig.AudioEncoding.LINEAR16)
                            .setLanguageCode("en-US")
                            .setSampleRateHertz(16000)
                            .build();
            RecognitionAudio audio = RecognitionAudio.newBuilder().setContent(audioBytes).build();

            // Use blocking call to get audio transcript
            RecognizeResponse response = speech.recognize(config, audio);
            List<SpeechRecognitionResult> results = response.getResultsList();

            for (SpeechRecognitionResult result : results) {
                // There can be several alternative transcripts for a given chunk of speech. Just use the
                // first (most likely) one here.
                SpeechRecognitionAlternative alternative = result.getAlternativesList().get(0);
                System.out.printf("Transcription: %s%n", alternative.getTranscript());
            }
        }
    }

From documentation:

If no speech from the supplied audio could be recognized, then the returned results list will contain no items. Unrecognized speech is commonly the result of very poor-quality audio, or from language code, encoding, or sample rate values that do not match the supplied audio.

If you're still having questions, please contact Google Cloud Support. This repo only deals with client libraries, not the actual service behavior.


tvOS Support

Please add tvos.deployment_target to podspec

Fixes as of Unbox 1.2.1 :) Thanks for highlighting this issue!


LSP-volar exited with status code 1

According to the documentation, I have installed LSP and Vue syntax highlight, but it is on node_modules project still doesn't work properly
Its tips are as follows

I want to know how to solve it

Hello :wave:
Can you paste the error messages from the Sublime Text Console (ctrl+`)?

Hello 👋
Can you paste the error messages from the Sublime Text Console (ctrl+`)?

Of course, but I don't know what information is useful for you.  Did I quote the NPM image of Taobao
.npmrc config
registry=https://registry.npmmirror.com/
ELECTRON_MIRROR=https://npmmirror.com/mirrors/electron/

I'm really sorry for my poor English. These words are machine translated

And this message
reloading python 3.3 plugin Package Control.versions
reloading python 3.3 plugin PyV8.PyV8
Traceback (most recent call last):
  File "C:\Tools\SublimeText_4126_64bit_Green\Data\Packages\PyV8\PyV8.py", line 23, in <module>
    from cStringIO import StringIO
ImportError: No module named 'cStringIO'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Tools\SublimeText_4126_64bit_Green\Lib\python33\sublime_plugin.py", line 308, in reload_plugin
    m = importlib.import_module(modulename)
  File "./python3.3/importlib/__init__.py", line 90, in import_module
  File "<frozen importlib._bootstrap>", line 1584, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1565, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1532, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 584, in _check_name_wrapper
  File "<frozen importlib._bootstrap>", line 1022, in load_module
  File "<frozen importlib._bootstrap>", line 1003, in load_module
  File "<frozen importlib._bootstrap>", line 560, in module_for_loader_wrapper
  File "<frozen importlib._bootstrap>", line 868, in _load_module
  File "<frozen importlib._bootstrap>", line 313, in _call_with_frames_removed
  File "C:\Tools\SublimeText_4126_64bit_Green\Data\Packages\PyV8\PyV8.py", line 25, in <module>
    from StringIO import StringIO
ImportError: No module named 'StringIO'
plugins loaded
Package Control: Skipping automatic upgrade, last run at 2022-02-26 18:08:00, next run at 2022-02-26 19:08:00 or after
git: using configuration from C:\Program Files\Git\cmd\git.exe
git: tracking working dir D:\github\simple-note

ImportError: No module named 'StringIO' - this error is from a different plugin, PyV8. so it is not relevant.

When I open a Vue project, its complete information is as follows

In the logs I cannot see anything suspicious,
Can you copy the logs from the LSP panel?
Here are the instructions on how to enable LSP logs https://lsp.sublimetext.io/troubleshooting/#self-help-instructions .

BTW, I updated the server and created a new release which might fix the issue.

I'm doing a configuration like this and it works fine, although I don't know why, shouldn't it automatically read tsserverlibrary.js
{
	"selector": "text.html.vue | source.ts | source.tsx | source.js | source.jsx",
	"initializationOptions": {
		"typescript": {
			"serverPath": "C:/Tools/SublimeText_4126_64bit_Green/Data/Package Storage/LSP-volar/16.13.2/server/node_modules/typescript/lib/tsserverlibrary.js"
		}
	}
}

You do not have to specify initializationOptions. typescript. serverPath.
LSP-volar will try to find the projects tsserver path.
If it doesn't find one, LSP-volar will use the tsserver bundeled with LSP-volar:
https://github.com/sublimelsp/LSP-volar/blob/dfa029f7417c5b1532a32aa37362b782cafef9cf/plugin.py#L46-L47
You can delete initializationOptions. typescript. serverPath,
unless your project uses yarn pnp, in which case the LSP-volar (currently) won't be able to find the tsserver,
so you have to explicitly tell where the tsserver path is with initializationOptions. typescript. serverPath.

Maybe the version of Typescript in the project is too old.

@coder163 Could you provide a repro for this?

There has been some changes on the server, that might fixed the bug:
https://github.com/johnsoncodehk/volar/blob/master/CHANGELOG.md#03411-2022429

fix: language server crash with low TS version (#1242)

I will close this.
If the issue is still there, reopen this issue and it would be helpful if you provide a repository that can reproduce the bug.


Redisson considers XREADGROUP and XCLAIM commands as read only but redis considers them read-write commands not allowing these commands to be executed on read-only replica

Expected behavior
In a sentinel environment with 1 master(write only), 2 slaves (Read only), Redisson Stream's readGroup and Claim method should execute commands on redis master node.
Actual behavior
The XREADGROUP and XCLAIM redis commands are actually write commands in redis but Redisson consider these as read only commands and executes on slave nodes resulting in the following error
from redis:
org.redisson.client.RedisException: READONLY You can't write against a read only replica.. channel: [id: 0x6de344ad, L:/<IP_ADDRESS>:59425 - R:<IP_ADDRESS>/<IP_ADDRESS>:8223] command: (XREADGROUP), params: [GROUP, TASK_CONSUMER_GROUP, lms_node, COUNT, 10, BLOCK, 15000, STREAMS, TASK_STORE_STREAM, >]
Steps to reproduce or test case
Use readGroups and claim  method in a  master-slave redis environment with master being write only and slaves being read only
Redis version
5.0.5
Redisson version*
3.11.5
Redisson configuration

Fixed! Thanks for report

Hi @mrniko
In RedissonStream class RedisCommands.XREADGROUP_BLOCKING_SINGLE and RedisCommands.XREADGROUP_SINGLE also need to be updated to write commands. I think you missed them in your commit

Hi @AayushyaVajpayee
Thanks for pointing out! Fixed either.


Meteor compat with meteor and Materlialize namespace

Hi
Declaring the meteor namespace as:
;var Materialize = {};

Makes it incompatible with meteor use as meteor will wrap this in its own closure (function()....)() which means the items would not be accessible
if you declare it without the "var" keyword meteor will make it a global namespace.
Materialize = {};

Thoughts please? It shouldn't have any impacts?
Thanks

Ah, I was under the impression just by exporting it in package.js it would work. Is it confirmed working after the change you referenced?

Hi
I have not tried this for Materlialize, but on other js libs i use its generally the same problem. I just looked at the source and saw the var word which i know doesnt work.
You can read the following stackover flow (its also in meteor docs somewhere as well, but will need to scratch around)
http://stackoverflow.com/questions/27509125/global-variables-in-meteor
Cheers

I can confirm this issue. Unfortunately you must place Materlialize in the global space and then have api.export('Materialize', 'client'); in your package js (which you have and is done correctly). I am using your current code, via clone, and it works. Can we get a patch so the atmo package will update?

Also I believe this. Materialize will also work if you define it in the global space. This could add some clarity for those looking at the code, instead of assuming it was a typo.

I removed the var from Materialize, so it should work properly once the release is updated.

Sounds good. For those that need this now, you can clone this repository into a packages/ directory. The name of the cloned directory will not matter and it should just work automatically.

Fixed with v0.96.1

I can confirm this fix. Thanks!

I got this issue on 0.97.1 with Meteor 1.2 (newest update).