net: silence no sources cmake warning

add ALLOW_EMPTY TRUE property to silence cmake warnings in case when no sources are added to subsys__net library

Can you elaborate in what configuration you hit this problem? The net subdirectory is only added if CONFIG_NETWORKING is enabled, and it seems a bit odd to me that we might end up with an empty net library in such case, I have an impression at very least we should have net_core etc. added. Perhaps we have a bug elsewhere?


Can't subscribe to issue without commenting

Doesn't appear in any menus I've seen.

+1 for this one. Really useful feature to (un)subscribe to/from an individual issue or PR.
I looked it there is an API for this, but I could not find it (but maybe I looked at the wrong place)


bug(tree): tree memory leak in ivy

Reproduction
Use StackBlitz to reproduce your issue:

Editor: https://stackblitz.com/edit/components-issue-c6s9kr?file=src%2Fapp%2Fexample-component.ts
Application: https://components-issue-c6s9kr.stackblitz.io/

Steps to reproduce:
This problem emerges with angular-cli@11/ivy turned on. Stackblitz is using angular-cli@9 with ivy turned off,  to reproduce the issue, you have to test on your local

click the button for like 20 times
take a memory heap snapshots
search detached in the class filter

Expected Behavior
few detached elements
Actual Behavior
many detached elements

Environment

Angular: 11.2.3
CDK/Material: 11.2.2
Browser(s): Chrome latest
Operating System (e.g. Windows, macOS, Ubuntu):  macOS

I wasn't able to reproduce it against our local dev app running Angular 11 with Ivy enabled. Is the screenshot above from your app or the Stackblitz? Have you tried looking at where the detached DOM nodes are being retained?

It's caused by a Chrome extension I installed, sorry 😳

It's caused by a Chrome extension I installed, sorry 😳

And which extension was it?

It's caused by a Chrome extension I installed, sorry 😳

And which extension was it?

keysmith https://chrome.google.com/webstore/detail/keysmith/igfbafcgnaemgipnngnppdhilhpmmnoh


accent mark

Using Windows 10 with spanish-Spain language, spanish keyboard (QWERTY).
When I press accent mark (tilde) over a vowel several anomalous behaviors occur:

Duplicate the vowel in question, showing once without tilde, and other tilde.
Eliminate the previous characters of the word where I press the accent, to show, either only the vowel with a tilde, or the duplicate vowel, in this case, the first time with a tilde, followed without a tilde.

Thank you for your report.
This is a duplicate of #650 (see comments there).

Please test #1426 (works on Android >= 7).


Add information which Mono & Xamarin versions support .NET Standard 2.0

This aligns the version table with what we just accepted here: https://github.com/dotnet/standard/pull/438
@mairaw @akoeplinger

@terrajobst,
Thanks for having already signed the Contribution License Agreement. Your agreement was validated by .NET Foundation. We will now review your pull request.
Thanks,
.NET Foundation Pull Request Bot


fix: infinite recursion in unix-read

Fixes #162
According to man 2 read:

On success, the number of bytes read is returned (zero indicates end of file)...

According to node fs:

If the file is not modified concurrently, the end-of-file is reached when the number of bytes read is zero.

If I understand this correctly (maybe there are some edge cases in the serialport read API?), we should never recurse if read returns zero.
Also, the @serialport/stream package (correctly) contains checks for zero-sized reads here, which could never be the case if we keep recursing on zero.
I had the problems described in #162 with a USB serial port (/dev/ttyUSB0). When I unplugged it during runtime, my program went into this infinite recursion and crashed due to memory. With this fix, it worked as expected.

As I understand, this is an implementation of pulling logic to wait until there is a data to grub. Endless loop is better thou.

Yet, a zero-sized read indicates end of file, or in this case, disconnect of the device. So even if you refactor to a "loop", and add some delays, you will not be able to detect the disconnect. I think this was designed with devices in mind, that don't support hot plugging. But then again, those should never give you zero sized reads...

On linux, after disconnect the file will just disappear. But while connection is established and no data is receiving, there will be just an empty file with 0 bytes. In this case recursion will go as deep as you have available memory and crush your app, unless you receive some data.
I've refactored this part to be while (true) {} loop with some delay & exit conditions, it solved high cpu usage & out of memory crushes.

Where did you solve it? In this case, this would be in violation of the documentation, as cited in my original post. What exactly are the exit conditions you use? What kind of serial port shows this behaviour?

I fixed it in my personal project, by pre-building library and replacing this file with fixed one. I can create PR with my solution, so you can take a look.

https://github.com/serialport/bindings-cpp/pull/175


fix(docs): correct the influxdb - gateway startup order

Description
Remove the influxdb related environment variables when starting the kong gateway as at the point of the doc the influxdb instance hasn't been started yet (It's started at a later step in the doc).
Another option to correct this is to move the steps of starting an influxdb instance before the gateway start steps. This requires some rewording of the steps so I'd leave the change to the docs team.

Testing instructions
Preview link:
Checklist

[ ] Review label added
[ ] PR pointed to correct branch (main for immediate publishing, or a release branch: e.g. release/gateway-3.2, release/deck-1.17)

Another option to correct this is to move the steps of starting an influxdb instance before the gateway start steps. This requires some rewording of the steps so I'd leave the change to the docs team.

I think this would probably be the better option, unless you think those environment variables that you removed aren't necessary at all.

Another option to correct this is to move the steps of starting an influxdb instance before the gateway start steps. This requires some rewording of the steps so I'd leave the change to the docs team.

I think this would probably be the better option, unless you think those environment variables that you removed aren't necessary at all.

Yes, I agree it's a better option. I may draft an initial version later and send it for review.

Hi @lena-larionova, I've updated the doc to reorder the startup steps. Please help and take a look. Thanks.


Slow internet causes formula.jws.json download to fail

brew doctor output
Your system is ready to brew.

Verification

[X] My "brew doctor output" above says Your system is ready to brew. and am still able to reproduce my issue.
[X] I ran brew update twice and am still able to reproduce my issue.
[X] This issue's title and/or description do not reference a single formula e.g. brew install wget. If they do, open an issue at https://github.com/Homebrew/homebrew-core/issues/new/choose instead.

brew config output
HOMEBREW_VERSION: 4.0.18-38-g111f504
ORIGIN: https://github.com/Homebrew/brew
HEAD: 111f50492585a58324563107453ac7e043351157
Last commit: 2 hours ago
Core tap origin: https://github.com/Homebrew/homebrew-core
Core tap HEAD: 24406867a7ba978bbb18eb89a51523cd454271c7
Core tap last commit: 42 minutes ago
Core tap branch: master
Core tap JSON: 16 May 20:10 UTC
HOMEBREW_PREFIX: /opt/homebrew
HOMEBREW_CASK_OPTS: []
HOMEBREW_MAKE_JOBS: 10
HOMEBREW_NO_INSTALL_FROM_API: set
Homebrew Ruby: 2.6.10 => /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/bin/ruby
CPU: 10-core 64-bit arm_firestorm_icestorm
Clang: 14.0.3 build 1403
Git: 2.40.1 => /opt/homebrew/bin/git
Curl: 7.87.0 => /usr/bin/curl
macOS: 13.3.1-arm64
CLT: <IP_ADDRESS>.1.1679647830
Xcode: 14.3
Rosetta 2: false

What were you trying to do (and why)?
Run brew upgrade (to upgrade formulas) or really any other brew command, even brew doctor.
What happened (include all command output)?
The output begins with Downloading https://formulae.brew.sh/api/formula.jws.json and a progress bar.
I am on slow internet (DSL plus others using bandwidth) so the download takes a while (upwards of a minute), and then fails with the error Warning: Failed to set filetime<PHONE_NUMBER> on '/Users/isaac/Library/Caches/Homebrew/api/formula.jws.json': No such file or directory.
The issue seems to be directly related to internet speed, because if I move to faster internet everything works fine.
The workaround here (https://github.com/Homebrew/brew/issues/14516#issuecomment-1418593313) works, preventing the download of the formula.jws.json file at all, but this is obviously suboptimal. Removing the cache directory as suggested here (https://github.com/Homebrew/brew/issues/14516#issuecomment-1418546734) does not work, and reinstalling homebrew does not work.
Full output:
brew upgrade
==> Downloading https://formulae.brew.sh/api/formula.jws.json
############################################################################################################################################ 100.0%
Warning: Failed to set filetime<PHONE_NUMBER> on
Warning: '/Users/isaac/Library/Caches/Homebrew/api/formula.jws.json': No such
Warning: file or directory
==> Downloading https://formulae.brew.sh/api/formula.jws.json
############################################################################################################################################ 100.0%
==> Downloading https://formulae.brew.sh/api/formula.jws.json
############################################################################################################################################ 100.0%
Error: Cannot download non-corrupt https://formulae.brew.sh/api/formula.jws.json!

What did you expect to happen?
brew upgrade or brew doctor to complete successfully, or at least get past the Downloading https://formulae.brew.sh/api/formula.jws.json step.
Step-by-step reproduction instructions (by running brew commands)
1. Throttle your internet or otherwise move to very slow internet.
2. Run `brew upgrade`.
3. Observe as the `formula.jws.json` download fails and homebrew exits with an error.

Setting HOMEBREW_NO_INSTALL_FROM_API is the only real alternative right now to the using the API if you have very slow internet.
The only real options here for us are to consider not using Github as a CDN (this would be a lot of work and just isn't in the cards at least in the short-term) or provide better messaging around when users are on slow internet to direct them not to use the API.

Setting HOMEBREW_NO_INSTALL_FROM_API is the only real alternative right now to the using the API if you have very slow internet.

Is this due to the fact that the API times out or something? The error message made me think there was some sort of race condition going on between the set filetime operation and the json download... but maybe not?

Setting HOMEBREW_NO_INSTALL_FROM_API is the only real alternative right now to the using the API if you have very slow internet.

This seems like an odd solution, since downloading the JSON should be more reliable than git pull on a slow connection.
I wonder if the flags we use to download the API data can be tweaked to handle this better.

How slow are we talking? There is some tolerance of slow connections though there is a lower bound (<100 bytes/s for 5s, though we can adjust that if it improves things).

Actually, it appears curl is reporting a successful download but the file doesn't exist? If the download failed and the file doesn't exist locally, it should abort with an entirely different message.
Do you get any more info with HOMEBREW_CURL_VERBOSE=1?

This seems like an odd solution, since downloading the JSON should be more reliable than git pull on a slow connection.

I disagree here, in my experience git is significantly more reliable on very slow connections, despite being a bit slower.


Add a custom scroll bar in all pages of website

Hey, I've made such custom scroll bar for my website earlier. Would love to work on this. Please assign this to me.

I will start assigning issues from 10th July when DCP will start.

Sure @QAZIMAAZARSHAD .
Just commenting as issues are given on fcfs basis.

Sure @QAZIMAAZARSHAD .
Just commenting as issues are given on fcfs basis.

No, I don't think that would be the case because organizers will release some guidelines and contributed will have to select projects.
Also, I won't be assigning all the issues to only a few participants if others are also in line.

Hey @QAZIMAAZARSHAD , can you please suggest the color for the thumb and for the track ?

Dark and light blue like the theme of the website.

Is this one fine ?

Make blue colour more dark like navbar.

Like this ?

Ya fine.
Make PR after 10th.

@QAZIMAAZARSHAD is this issue still require or should i close it


Since 4.2.0 many fediverse ActivityPub pushes to /inbox fail with rule 941100, 932130 or 932260

Description

Since the update to CRS 4.2.0 I have a lot of false positives on rules 941100, 932130 or 932260.

Logs

This is an example:

---1uH9j8WB---A--
[09/May/2024:13:43:27 +0200]<PHONE_NUMBER>34.383247 <IP_ADDRESS> 0 <IP_ADDRESS> 8080
---1uH9j8WB---B--
POST /inbox HTTP/1.1
Date: Thu, 09 May 2024 11:43:27 GMT
X-Forwarded-For: <IP_ADDRESS>
User-Agent: http.rb/5.2.0 (Mastodon/4.3.0-nightly.2024-04-30; +https://mastodon.social/)
X-Forwarded-Proto: https
X-Forwarded-By: <IP_ADDRESS>:8443
Content-Length: 759
X-Real-IP: <IP_ADDRESS>
Digest: SHA-256=sqBn4yiEipMD2hz+tANpxtrKgu3UYjY7LQDr4bPuT2A=
Host: fedi.0x42.ch
X-Forwarded-Port: 8443
Accept-Encoding: gzip
Forwarded: for=<IP_ADDRESS>; proto=https; by=<IP_ADDRESS>
Content-Type: application/activity+json
Signature: keyId="https://mastodon.social/users/x23u5#main-key",algorithm="rsa-sha256",headers="(request-target) host date digest content-type",signature="k97gCb7kdq2iiERiX/o5kvghHOZ3J0+FN06AqA69J6ExLevPMmmlYZLo9hp+MlNcr/8/2cOQbTQDAjw/m6RpZAo9y26WZbaZPyj7KWjq7Ln94haQ/GrHWwZmJs3WVsi5ARzaZdILYQdcIdgJxAIEgy4EhMcBFeHrVF/EEVA388xgmAdOtKYl9/gt6SMrw1zdOgSk223fWGkphgFbsfSJsG2SPXLhThtB6XTmREHnRdSvrzUtg33Cm01/2JSPJ+m67Q0WfCqC5HId2/LddLfZuck/9cJv0i2tky5Ojcvf8koOUrQuP143zEHvbF0ejBzeYJe0kmFcvlLKZ/j27ONtqQ=="

---1uH9j8WB---E--
\x0d\x0a<title>403 Forbidden</title>\x0d\x0a\x0d\x0a
403 Forbidden
\x0d\x0a
nginx\x0d\x0a\x0d\x0a\x0d\x0a

---1uH9j8WB---F--
HTTP/1.1 403
Server: nginx
X-Robots-Tag: noindex, nofollow
Date: Thu, 09 May 2024 11:43:27 GMT
Content-Length: 146
X-Download-Options: noopen
Content-Type: text/html
Connection: keep-alive
Referrer-Policy: same-origin
Strict-Transport-Security: max-age=31536000;  includeSubDomains

---1uH9j8WB---H--
ModSecurity: Warning. detected XSS using libinjection. [file "/etc/modsecurity.d/owasp-crs/rules/REQUEST-941-APPLICATION-ATTACK-XSS.conf"] [line "82"] [id "941100"] [rev ""] [msg "XSS Attack Detected via libinjection"] [data "Matched Data: XSS data found within ARGS:json.signature.signatureValue: SjaigkOd CVr5dDpDbd7xcIQZgZTPDYv 4dsptCh3Js9MW4yjs0POYxqjbUzKg07WfSoP/0mAsoR/rBkdDJ2XdpL3HIJBfBn8t1F06wD5Hwr6hJUwfAhCMZ8H20Ptshs (216 characters omitted)"] [severity "2"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "application-multi"] [tag "language-multi"] [tag "platform-multi"] [tag "attack-xss"] [tag "xss-perf-disable"] [tag "paranoia-level/1"] [tag "OWASP_CRS"] [tag "capec/1000/152/242"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "171525500734.383247"] [ref "v30,344t:utf8toUnicode,t:urlDecodeUni,t:htmlEntityDecode,t:jsDecode,t:cssDecode,t:removeNulls"]
ModSecurity: Access denied with code 403 (phase 2). Matched "Operator `Ge' with parameter `5' against variable `TX:BLOCKING_INBOUND_ANOMALY_SCORE' (Value: `5' ) [file "/etc/modsecurity.d/owasp-crs/rules/REQUEST-949-BLOCKING-EVALUATION.conf"] [line "222"] [id "949110"] [rev ""] [msg "Inbound Anomaly Score Exceeded (Total Score: 5)"] [data ""] [severity "0"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "anomaly-evaluation"] [tag "OWASP_CRS"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "171525500734.383247"] [ref ""]

---1uH9j8WB---I--

---1uH9j8WB---J--

---1uH9j8WB---K--

---1uH9j8WB---Z--

---LGD1H8QS---A--
[09/May/2024:19:02:37 +0200]<PHONE_NUMBER>53.829804 2a01:4f8:231:3eb::2 0 <IP_ADDRESS> 8080
---LGD1H8QS---B--
POST /inbox HTTP/1.1
Date: Thu, 09 May 2024 17:02:37 GMT
X-Forwarded-For: 2a01:4f8:231:3eb::2
User-Agent: http.rb/5.1.1 (Mastodon/4.1.15; +https://mstdn.jp/)
X-Forwarded-Proto: https
X-Forwarded-By: fd00::1:8:4:8443
Content-Length: 767
X-Real-IP: 2a01:4f8:231:3eb::2
Digest: SHA-256=+C5C/4qoWchFxAxbQ8mUBqeb6yNKW34nb+bKLIYvYrQ=
Host: fedi.0x42.ch
X-Forwarded-Port: 8443
Accept-Encoding: gzip
Forwarded: for=2a01:4f8:231:3eb::2; proto=https; by=fd00::1:8:4
Content-Type: application/activity+json
Signature: keyId="https://mstdn.jp/users/usernamegasfww#main-key",algorithm="rsa-sha256",headers="(request-target) host date digest content-type",signature="movHkrda46+uAnvGhutHiXtUwryAUYRtTWllrCnMfErX/IBY0DMgtWTaHVP21BAiP6FeChfkEH5CCC2WtvLeLZB/PWmiJPAtsTx8QUiqZ+7di30gAk2nj4/A5Z1rZ1lVd1ak8KEF9XYEFbzwxT9OlXik5vZeYw3JZAb5kTAiiaQbfDS9A8+QhB4vdcSqSbgMh+kIr+nfVsxzYItFWO+9se8aI34gawFuAdz1xRRR/7SSOe1CrAsshW1SpZFvm2w9Ee1NjPRfvBPOoTgLUTtoAKJiu57Fps3hSDCB/0AEYeu0A6vadtkbfreiWnJM7t2ZTjRPTeDiZK1Eyj6PGRng1g=="

---LGD1H8QS---E--
\x0d\x0a<title>403 Forbidden</title>\x0d\x0a\x0d\x0a
403 Forbidden
\x0d\x0a
nginx\x0d\x0a\x0d\x0a\x0d\x0a

---LGD1H8QS---F--
HTTP/1.1 403
Server: nginx
X-Robots-Tag: noindex, nofollow
Date: Thu, 09 May 2024 17:02:37 GMT
Content-Length: 146
X-Download-Options: noopen
Content-Type: text/html
Connection: keep-alive
Referrer-Policy: same-origin
Strict-Transport-Security: max-age=31536000;  includeSubDomains

---LGD1H8QS---H--
ModSecurity: Warning. Matched "Operator `Rx' with parameter `(?i)(?:^|b[\"'\)\[\x5c]*(?:(?:(?:\|\||&&)[\s\x0b]*)?\$[!#\(\*\-0-9\?@_a-\{]*)?\x5c?u[\"'\)\[\x5c]*(?:(?:(?:\|\||&&)[\s\x0b]*)?\$[!#\(\*\-0-9\?@_a-\{]*)?\x5c?s[\"'\)\[\x5c]*(?:(?:(?:\|\||&&)[\s\x0b]*)? (4195 characters omitted)' against variable `ARGS:json.signature.signatureValue' (Value: `SIkEHJOH7XWoTi/6F7v76mVcE9/3YOP2OhMH/PIgzD/UI6lj+WnfxvECaGj7sUSXPQ8ptskKU2izTobLSBtFIZr/z2iK6UlJ/bAL (244 characters omitted)' ) [file "/etc/modsecurity.d/owasp-crs/rules/REQUEST-932-APPLICATION-ATTACK-RCE.conf"] [line "478"] [id "932260"] [rev ""] [msg "Remote Command Execution: Direct Unix Command Execution"] [data "Matched Data: SIkEHJOH7XWoTi/6F7v76mVcE9/3YOP2OhMH/PIgz found within ARGS:json.signature.signatureValue: SIkEHJOH7XWoTi/6F7v76mVcE9/3YOP2OhMH/PIgzD/UI6lj+WnfxvECaGj7sUSXPQ8ptskKU2izTobLSBtFIZr/z2iK6Ul (249 characters omitted)"] [severity "2"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "application-multi"] [tag "language-shell"] [tag "platform-unix"] [tag "attack-rce"] [tag "paranoia-level/1"] [tag "OWASP_CRS"] [tag "capec/1000/152/248/88"] [tag "PCI/6.5.2"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "171527415753.829804"] [ref "o0,41v30,344"]
ModSecurity: Access denied with code 403 (phase 2). Matched "Operator `Ge' with parameter `5' against variable `TX:BLOCKING_INBOUND_ANOMALY_SCORE' (Value: `5' ) [file "/etc/modsecurity.d/owasp-crs/rules/REQUEST-949-BLOCKING-EVALUATION.conf"] [line "222"] [id "949110"] [rev ""] [msg "Inbound Anomaly Score Exceeded (Total Score: 5)"] [data ""] [severity "0"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "anomaly-evaluation"] [tag "OWASP_CRS"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "171527415753.829804"] [ref ""]

---LGD1H8QS---I--

---LGD1H8QS---J--

---LGD1H8QS---K--

---LGD1H8QS---Z--

---MXiYuMLM---A--
[09/May/2024:18:55:21 +0200]<PHONE_NUMBER>61.820626 2a01:4f9:3080:19d6::2 0 <IP_ADDRESS> 8080
---MXiYuMLM---B--
POST /inbox HTTP/1.1
Date: Thu, 09 May 2024 16:55:21 GMT
X-Forwarded-For: 2a01:4f9:3080:19d6::2
User-Agent: http.rb/5.1.1 (Mastodon/4.2.8; +https://social.tchncs.de/)
X-Forwarded-Proto: https
X-Forwarded-By: fd00::1:8:4:8443
Content-Length: 3917
X-Real-IP: 2a01:4f9:3080:19d6::2
Digest: SHA-256=f1dR7re9IhoCELVta6PA/v5jOJlXIq7tdmCw96XbUbw=
Host: fedi.0x42.ch
X-Forwarded-Port: 8443
Accept-Encoding: gzip
Forwarded: for=2a01:4f9:3080:19d6::2; proto=https; by=fd00::1:8:4
Content-Type: application/activity+json
Signature: keyId="https://social.tchncs.de/users/sequundi#main-key",algorithm="rsa-sha256",headers="(request-target) host date digest content-type",signature="nmoEuN6GH01yD921fNxTmTeKfg21S3zSINbUqgW/MRYn7T/Ai5zntXzlotCnOchDjj9qDtRjoH6xgXZD/4qnga+3yUPdZVnvmxUrv6YmB8iR81PXB9PsdzT6hvjIOhzw+dOpMGTbU3zpAY2ZbMXWO1ipZnrQUODIXFAOIbJMcCIUhyWBgECHnkA+wAYrJWcmXsuSSasqBn1CYdMmuJlQetq1rojIzAy1R8c/zGVmJiISAIB348cDJjnpowyf+UahAucrxhPLy0jGOvrmCZq0DRspqWw+NN+6X7JJ3yVSqZqRy/GzgRfIF+WeEWxmvLynYInH3L0ZzmflcYEOMt3Y+g=="

---MXiYuMLM---E--
\x0d\x0a<title>403 Forbidden</title>\x0d\x0a\x0d\x0a
403 Forbidden
\x0d\x0a
nginx\x0d\x0a\x0d\x0a\x0d\x0a

---MXiYuMLM---F--
HTTP/1.1 403
Server: nginx
X-Robots-Tag: noindex, nofollow
Date: Thu, 09 May 2024 16:55:21 GMT
Content-Length: 146
X-Download-Options: noopen
Content-Type: text/html
Connection: keep-alive
Referrer-Policy: same-origin
Strict-Transport-Security: max-age=31536000;  includeSubDomains

---MXiYuMLM---H--
ModSecurity: Warning. Matched "Operator `Rx' with parameter `\$(?:\((?:.*|\(.*\))\)|\{.*\})|[<>]\(.*\)|/[0-9A-Z_a-z]*\[!?.+\]' against variable `ARGS:json.object.content' (Value: `
(#m\xc3\xbcnchen) found within ARGS:json.object.content:
< (380 characters omitted)"] [severity "2"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "application-multi"] [tag "language-shell"] [tag "platform-unix"] [tag "attack-rce"] [tag "paranoia-level/1"] [tag "OWASP_CRS"] [tag "capec/1000/152/248/88"] [tag "PCI/6.5.2"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "171527372161.820626"] [ref "o292,110v26,440t:cmdLineo292,110v20,440t:cmdLine"]
ModSecurity: Access denied with code 403 (phase 2). Matched "Operator `Ge' with parameter `5' against variable `TX:BLOCKING_INBOUND_ANOMALY_SCORE' (Value: `10' ) [file "/etc/modsecurity.d/owasp-crs/rules/REQUEST-949-BLOCKING-EVALUATION.conf"] [line "222"] [id "949110"] [rev ""] [msg "Inbound Anomaly Score Exceeded (Total Score: 10)"] [data ""] [severity "0"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "anomaly-evaluation"] [tag "OWASP_CRS"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "171527372161.820626"] [ref ""]

---MXiYuMLM---I--

---MXiYuMLM---J--

---MXiYuMLM---K--

---MXiYuMLM---Z--

Your Environment

CRS version (e.g., v3.3.4): 4.2.0
Paranoia level setting (e.g. PL1) : 1
ModSecurity version (e.g., 2.9.6): 3.0.12
Web Server and version or cloud provider / CDN (e.g., Apache httpd 2.4.54): owasp/modsecurity-crs:nginx docker image
Operating System and version: Debian Bookworm with Podman

Confirmation
[x] I have removed any personal data (email addresses, IP addresses,
passwords, domain names) from any logs posted.

Hi @ne20002,
thank you for your feedback. Sorry to hear about these FP's.
Rule 941100 uses the operator @detectXSS, so unfortunately we have no influence on its behavior.
In case of other two rules, namely 932130 and 932260, as you can see the rules do what they are supposed to do (see comments - for 932260 please take a look at the comment of 932250 too).
Unfortunately the only thing what you can do is the exclusions.
Do you think these rules are too strict? May be we should move them to higher PL?

I'm not sure. I have a few more FPs like this one on rule 932120:
---3hjQ85yJ---A--
[10/May/2024:06:31:59 +0200]<PHONE_NUMBER>91.538011 <IP_ADDRESS> 0 <IP_ADDRESS> 8080
---3hjQ85yJ---B--
POST /inbox HTTP/1.1
Date: Fri, 10 May 2024 04:31:59 GMT
X-Forwarded-For: <IP_ADDRESS>
User-Agent: http.rb/5.2.0 (Mastodon/4.3.0-nightly.2024-04-30; +https://mastodon.social/)
X-Forwarded-Proto: https
X-Forwarded-By: <IP_ADDRESS>:8443
Content-Length: 835
X-Real-IP: <IP_ADDRESS>
Digest: SHA-256=Ms+vNYBH+NSQU+bW+P6Oor3Ozj+SK4wS9ryoywmtBpY=
Host: fedi.0x42.ch
X-Forwarded-Port: 8443
Accept-Encoding: gzip
Forwarded: for=<IP_ADDRESS>; proto=https; by=<IP_ADDRESS>
Content-Type: application/activity+json
Signature: keyId="https://mastodon.social/users/SecurityInANutPowerShell#main-key",algorithm="rsa-sha256",headers="(request-target) host date digest content-type",signature="Pubzqbfh74oNTjs6/sFjOtJEKWmN6qcuf+HzQCcqDifyK4SbjtnksDOW6gInXyP3p82YWpavlifGLmRQ9DzRzaai87hmKvk+BsZz+YBb7x32C5vwvgEEzzrrYg+P44boye+LpPc5GENj/I4+01u8k/QihpgQXaZfkpMzerF8DxDTzLr5WHlj+yW/iYpG+KUQO78lBCsm5MFoQc/xrtwYDq364W0cRacl3n/blmiNnvodVBROUF8uJUVEzSbUoVhXRxQdC2bnRYkhzizpKHivqexvCmYYpvuTE99VPQcRW4NDtmangvvFZTzR2cmvany1FfWo7vFIeEoL3lx4Xrxizw=="

---3hjQ85yJ---E--
\x0d\x0a<title>403 Forbidden</title>\x0d\x0a\x0d\x0a
403 Forbidden
\x0d\x0a
nginx\x0d\x0a\x0d\x0a\x0d\x0a

---3hjQ85yJ---F--
HTTP/1.1 403
Server: nginx
X-Robots-Tag: noindex, nofollow
Date: Fri, 10 May 2024 04:31:59 GMT
Content-Length: 146
X-Download-Options: noopen
Content-Type: text/html
Connection: keep-alive
Referrer-Policy: same-origin
Strict-Transport-Security: max-age=31536000;  includeSubDomains

---3hjQ85yJ---H--
ModSecurity: Warning. Matched "Operator `PmFromFile' with parameter `windows-powershell-commands.data' against variable `ARGS:json.signature.creator' (Value: `https://mastodon.social/users/SecurityInANutPowerShell#main-key' ) [file "/etc/modsecurity.d/owasp-crs/rules/REQUEST-932-APPLICATION-ATTACK-RCE.conf"] [line "213"] [id "932120"] [rev ""] [msg "Remote Command Execution: Windows PowerShell Command Found"] [data "Matched Data: powershell found within ARGS:json.signature.creator: https://mastodon.social/users/securityinanutpowershell#main-key"] [severity "2"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "application-multi"] [tag "language-shell"] [tag "language-powershell"] [tag "platform-windows"] [tag "attack-rce"] [tag "paranoia-level/1"] [tag "OWASP_CRS"] [tag "capec/1000/152/248/88"] [tag "PCI/6.5.2"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "171531551991.538011"] [ref "o44,10v8,61t:cmdLineo44,10v11,54t:cmdLineo44,10v12,54t:cmdLineo44,10v23,63t:cmdLine"]
ModSecurity: Access denied with code 403 (phase 2). Matched "Operator `Ge' with parameter `5' against variable `TX:BLOCKING_INBOUND_ANOMALY_SCORE' (Value: `20' ) [file "/etc/modsecurity.d/owasp-crs/rules/REQUEST-949-BLOCKING-EVALUATION.conf"] [line "222"] [id "949110"] [rev ""] [msg "Inbound Anomaly Score Exceeded (Total Score: 20)"] [data ""] [severity "0"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "anomaly-evaluation"] [tag "OWASP_CRS"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "171531551991.538011"] [ref ""]

---3hjQ85yJ---I--

---3hjQ85yJ---J--

---3hjQ85yJ---K--

---3hjQ85yJ---Z--

Most are somehow related to elements of a json signature, some of a json object. All requests are of content-type 'application/activity+json'. I'm not in the details but it seems as if this is not a json only object and this is causing problems as they are treated as json by ModSecurity?
This one though might not be a FB as I believe the content is including some power-shell command (in a text for reference). But it is still problematic to block it though.
I thought that ActivityPub is activity is only including links to the object on the original system and the system is then resolving/loading it. Seems as if there is also some data in there (and if so filtering will be really difficult).
I need to figure out how to log the whole request in case the rule is triggered to have a deeper look on this. It's just for understanding, I'm not developer of any of those systems.

Thank you for reporting @ne20002. We get relatively few reports given the amount of installations and supposed number of false positives.
Lacking the exact payload, it is very difficult to help you though. If we have the individual payloads, we can check them against the patterns and see whether we can do something about it or not. Like this, it's too blurry.

Hi @dune73
Sure, I have updated the OP with two new examples including the request data. I will continue to update as soon as I get other examples logged.

hi @ne20002,
thanks for details,

At least I find this in the Warning a bit suspicious: [msg "Remote Command Execution: Unix Command Injection (command without evasion)"] [data "Matched Data: enVTCsH found within ARGS:json.signature.signatureValue:

this is the rule 932235, right? (You didn't mention the rule at the last example - I assume you use CRS on PL1 and only this rule has the quoted msg.)

Findig enVTCsh as part of a string is triggering the rule?

Unfortunately yes. See the regex and it's included source, which has the sub-string tcsh.
May be this is too strict on PL1 (I mean a sub-string matches with a pattern, it's not necessarily an attack - not on PL at least). I think we have to investigate this.

Same for [msg "PHP Injection Attack: High-Risk PHP Function Name Found"] [data "Matched Data: mkdir found within ARGS:json.signature.signature

Well, mkdir could be a valid attack.

Maybe I need to disable inspection of the request body for POSTs to /inbox?

Do you think about of using SecRequestBodyAccess in case of libmodsecurity3, please DON'T DO THAT. Libmodsecurity3 has a known bug: if you disable the request body inspection, the engine skips the whole phase:2.
Instead of this, please make an exclusion with ctl:ruleRemoveByTag=OWASP_CRS.

Hi @airween

Well, mkdir could be a valid attack.

As could other strings .. this again is just a substring in the signature which possibly can include nearly any of the substrings checked by this kind of rules.
I thought of checking for the path /inbox and then ctl:requestBodyAccess=Off.
Maybe I need to exclude the signature arg only? Is this possible?

I thought of checking for the path /inbox and then ctl:requestBodyAccess=Off. Maybe I need to exclude the signature arg only? Is this possible?

yes, eg:
SecRule REQUEST_FILENAME "@beginsWith /inbox" \
    "id:100001,\
    phase:1,\
    t:none,\
    pass,\
    nolog,\
    ctl:ruleRemoveTargetByTag=OWASP_CRS;ARGS:json.signature.signature"

@airween, thank you
I have aplied the rule accordingly.

May be this is too strict on PL1 (I mean a sub-string matches with a pattern, it's not necessarily an attack - not on PL at least). I think we have to investigate this.

I aggree. A simple substring match in PL1 seems to strict for me. At least as this check is not checking word boundaries. Maybe a PL1 rule should do a substring match on e.g. ' mkdir ' where a PL2 rule may check for 'mkdir'?
But I'm not an expert in this field.

I aggree. A simple substring match in PL1 seems to strict for me. At least as this check is not checking word boundaries. Maybe a PL1 rule should do a substring match on e.g. ' mkdir ' where a PL2 rule may check for 'mkdir'? But I'm not an expert in this field.

I've added this issue to our next monthly meeting (20th of May, next Monday): https://github.com/coreruleset/coreruleset/issues/3694 (see "Separate 2nd Meeting" block)). Would you like to attend this meeting?

I got another interessting one:

---zSV10vK8---A--
[13/May/2024:12:51:19 +0200]<PHONE_NUMBER>7.339923 <IP_ADDRESS> 0 <IP_ADDRESS> 8080
---zSV10vK8---B--
POST /inbox HTTP/1.1
Date: Mon, 13 May 2024 10:51:19 GMT
X-Forwarded-For: <IP_ADDRESS>
User-Agent: http.rb/5.2.0 (Mastodon/4.3.0-nightly.2024-05-13; +https://mastodon.social/)
X-Forwarded-Proto: https
X-Forwarded-By: <IP_ADDRESS>:8443
Content-Length: 4031
X-Real-IP: <IP_ADDRESS>
Digest: SHA-256=Tn7U+YL5GF1o6PVARttne8hkD4iXD1zK5Rlt6ZvA358=
Host: fedi.0x42.ch
X-Forwarded-Port: 8443
Accept-Encoding: gzip
Forwarded: for=<IP_ADDRESS>; proto=https; by=<IP_ADDRESS>
Content-Type: application/activity+json
Signature: keyId="https://mastodon.social/users/Tusky#main-key",algorithm="rsa-sha256",headers="(request-target) host date digest content-type",signature="p5MLdGyqv3IcUfHlmqr25pRrezFij2ukKq6NB+5mYweZlOsZ8p3m/IG5EuK6rPBcC0ccrvSokrw7LAZhnKQiC6VlpePyPoX6yFNWiiurom8ANfgRiVvN3tK1bZNnnY69/IFDTLbtvBMaCHOZO2dKkzGGeKJtOuxWTxcfF1BDdlq+Xf8inl9jHKSaYJ4S8tmy6ojAcnrsILCMOImFovgQ4GqBjBLtnQ32hXFsxRwf1OgW9hvXz/b3rAOhqdUSUqks/eF0ch2pwcZzbqDit5+BS1mgPEfUTEPY/Q9Gct/JzyMxV9cPDSEacBA3rICWb6FqwhqYWM1xGkJqnumeUctUxA=="

---zSV10vK8---C--
{"@context":["https://www.w3.org/ns/activitystreams","https://w3id.org/security/v1",{"manuallyApprovesFollowers":"as:manuallyApprovesFollowers","sensitive":"as:sensitive","Hashtag":"as:Hashtag","movedTo":{"@id":"as:movedTo","@type":"@id"},"alsoKnownAs":{"@id":"as:alsoKnownAs","@type":"@id"},"toot":"http://joinmastodon.org/ns#","Emoji":"toot:Emoji","featured":{"@id":"toot:featured","@type":"@id"},"featuredTags":{"@id":"toot:featuredTags","@type":"@id"},"schema":"http://schema.org#","PropertyValue":"schema:PropertyValue","value":"schema:value","ostatus":"http://ostatus.org#","atomUri":"ostatus:atomUri","inReplyToAtomUri":"ostatus:inReplyToAtomUri","conversation":"ostatus:conversation","focalPoint":{"@container":"@list","@id":"toot:focalPoint"},"blurhash":"toot:blurhash","discoverable":"toot:discoverable","indexable":"toot:indexable","memorial":"toot:memorial","votersCount":"toot:votersCount","Device":"toot:Device","Ed25519Signature":"toot:Ed25519Signature","Ed25519Key":"toot:Ed25519Key","Curve25519Key":"toot:Curve25519Key","EncryptedMessage":"toot:EncryptedMessage","publicKeyBase64":"toot:publicKeyBase64","deviceId":"toot:deviceId","claim":{"@type":"@id","@id":"toot:claim"},"fingerprintKey":{"@type":"@id","@id":"toot:fingerprintKey"},"identityKey":{"@type":"@id","@id":"toot:identityKey"},"devices":{"@type":"@id","@id":"toot:devices"},"messageFranking":"toot:messageFranking","messageType":"toot:messageType","cipherText":"toot:cipherText","suspended":"toot:suspended"}],"id":"https://chaos.social/users/wmd/statuses/112433396306350018/activity","type":"Create","actor":"https://chaos.social/users/wmd","published":"2024-05-13T10:51:17Z","to":["https://www.w3.org/ns/activitystreams#Public"],"cc":["https://chaos.social/users/wmd/followers","https://mastodon.social/users/Tusky"],"object":{"id":"https://chaos.social/users/wmd/statuses/112433396306350018","type":"Note","inReplyTo":"https://mastodon.social/users/Tusky/statuses/112433308732459217","published":"2024-05-13T10:51:17Z","url":"https://chaos.social/@wmd/112433396306350018","attributedTo":"https://chaos.social/users/wmd","to":["https://www.w3.org/ns/activitystreams#Public"],"cc":["https://chaos.social/users/wmd/followers","https://mastodon.social/users/Tusky"],"sensitive":false,"atomUri":"https://chaos.social/users/wmd/statuses/112433396306350018","inReplyToAtomUri":"https://mastodon.social/users/Tusky/statuses/112433308732459217","conversation":"tag:chaos.social,2024-05-12:objectId=182049045:objectType=Conversation","content":"
@Tusky boosts disabled before updating, boosts enabled after update, so had to deactivate them again.

(for the home timeline)
","contentMap":{"en":"
@Tusky boosts disabled before updating, boosts enabled after update, so had to deactivate them again.

(for the home timeline)
"},"attachment":[],"tag":[{"type":"Mention","href":"https://mastodon.social/users/Tusky","name":"@Tusky@mastodon.social"}],"replies":{"id":"https://chaos.social/users/wmd/statuses/112433396306350018/replies","type":"Collection","first":{"type":"CollectionPage","next":"https://chaos.social/users/wmd/statuses/112433396306350018/replies?only_other_accounts=true&page=true","partOf":"https://chaos.social/users/wmd/statuses/112433396306350018/replies","items":[]}}},"signature":{"type":"RsaSignature2017","creator":"https://chaos.social/users/wmd#main-key","created":"2024-05-13T10:51:18Z","signatureValue":"sBqesrkZ/lPZ19FD9JDishLSyjNSpEmgAiPQw4FbM6n4tP1x/GSebepKpySkxp0iRFI9uEb8J7GUrswbcb1VXxTgTalLB33OM/rt78KT2CxBAb5xMnYu9AwEg/nEwkVKkOnWuV/5AmCyWYFEmBZyGEao7KfpNA9Bo4ANO4Kfu+vmPN6yladnMCl9agy9Maya8igHLFIRZzSi2QNoGjj0ROvdnP20FNxfEeGtmiYGe7RhQhHN/2Xz0w0XQp76YnLSnlULjqziEQ++hESGtfd7m9SCiOEdeqYzGWS1yTYjnsYdWORPUud68zyaBk6QG8glNblSIxHzJq+KGGIfdb4KBA=="}}

---zSV10vK8---E--
\x0d\x0a<title>403 Forbidden</title>\x0d\x0a\x0d\x0a
403 Forbidden
\x0d\x0a
nginx\x0d\x0a\x0d\x0a\x0d\x0a

---zSV10vK8---F--
HTTP/1.1 403
Server: nginx
X-Robots-Tag: noindex, nofollow
Date: Mon, 13 May 2024 10:51:19 GMT
Content-Length: 146
X-Download-Options: noopen
Content-Type: text/html
Connection: keep-alive
Referrer-Policy: same-origin
Strict-Transport-Security: max-age=31536000;  includeSubDomains

---zSV10vK8---H--
ModSecurity: Warning. Matched "Operator `Rx' with parameter `\$(?:\((?:.*|\(.*\))\)|\{.*\})|[<>]\(.*\)|/[0-9A-Z_a-z]*\[!?.+\]' against variable `ARGS:json.object.contentMap.en' (Value: `
(for the home timeline) found within ARGS:json.object.contentMap.en:
@tusky</a (135 characters omitted)"] [severity "2"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "application-multi"] [tag "language-shell"] [tag "platform-unix"] [tag "attack-rce"] [tag "paranoia-level/1"] [tag "OWASP_CRS"] [tag "capec/1000/152/248/88"] [tag "PCI/6.5.2"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "17155974797.339923"] [ref "o223,24v20,261t:cmdLineo223,24v26,261t:cmdLine"]
ModSecurity: Access denied with code 403 (phase 2). Matched "Operator `Ge' with parameter `5' against variable `TX:BLOCKING_INBOUND_ANOMALY_SCORE' (Value: `10' ) [file "/etc/modsecurity.d/owasp-crs/rules/REQUEST-949-BLOCKING-EVALUATION.conf"] [line "222"] [id "949110"] [rev ""] [msg "Inbound Anomaly Score Exceeded (Total Score: 10)"] [data ""] [severity "0"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "anomaly-evaluation"] [tag "OWASP_CRS"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "17155974797.339923"] [ref ""]

---zSV10vK8---I--

---zSV10vK8---J--

---zSV10vK8---K--

---zSV10vK8---Z--

Here is another one:

---r21NI3wg---A--
[16/May/2024:00:05:28 +0200]<PHONE_NUMBER>52.916713 2a03:2880:ff:2::face:b00c 0 <IP_ADDRESS> 8080
---r21NI3wg---B--
POST /inbox HTTP/1.1
User-Agent: facebookexternalua
X-Forwarded-Proto: https
X-Forwarded-By: fd00::1:8:c:8443
Accept: */*
Content-Length: 2322
X-Real-IP: 2a03:2880:ff:2::face:b00c
Digest: SHA-256=70w50fg3CzRPcN9Mwbvx1QuZzWcR/RbvF6os37SnDAo=
Host: fedi.0x42.ch
X-Forwarded-Port: 8443
X-Forwarded-For: 2a03:2880:ff:2::face:b00c
Date: Wed, 15 May 2024 22:05:27 GMT
Accept-Encoding: deflate, gzip
Forwarded: for=2a03:2880:ff:2::face:b00c; proto=https; by=fd00::1:8:c
Content-Type: application/ld+json; profile="https://www.w3.org/ns/activitystreams"
Signature: keyId="https://threads.net/ap/users/17841401411590012/#main-key",algorithm="rsa-sha256",headers="(request-target) host date digest",signature="a28N7E9qIhV8VZgXkZw+YmcwNT9QI7STPhgy00iX+bIkJkeFLCXvdgSAf79d44ES0QdbXcMD14jm4oCu1HZj2LZyqSXlQn7ZpvNuzT41Mu/UuSUCmCU7inTI7UvS9YPux4Lga2UR8Gsuxmfs+LloatItx2Wd7HHdduDcQmuX/MvnUIXPVmAsHRDZOhu3Pav4lpNTUqLt9dZgKl6cRsJuNMy7lxIfX9JUtQAwBQV5DmTnHY6HYPrvZhP+8ft6qUmt5lLHYigNssNLsC+Iu5vbDQhLXkHjELxOdwLjJvXryjqlucbtVwndtrfDgvDm/XC9a38jeC86KFQsTVwo4s7RvQ=="

---r21NI3wg---C--
{"\u0040context":["https:\/\/www.w3.org\/ns\/activitystreams"],"id":"https:\/\/threads.net\/ap\/users\/17841401411590012\/post\/17896983660004930\/activity\/","type":"Create","object":{"id":"https:\/\/threads.net\/ap\/users\/17841401411590012\/post\/17896983660004930\/","type":"Note","content":"\u003Cp>One of the most shocking parts about how the YouTube experience has degraded is search. YouTube is one of the biggest search engines on the internet and search on the website is now nearly worthless. It's really hard to believe they'd destroy one of the best and most valuable things the site had going for it but here we are.\u003Cbr \/>\u003Cbr \/>Great video on the subject by \u003Ca href=\"https:\/\/threads.net\/\u0040eposvox\/\" class=\"u-url mention\">\u0040\u003Cspan>eposvox\u003C\/span>\u003C\/a> \u003Cbr \/>\u003Ca href=\"https:\/\/www.youtube.com\/watch?v=ib3E8rBsT60\">https:\/\/www.youtube.com\/watch?v=ib3E8rBsT60\u003C\/a>\u003C\/p>","contentMap":{"en":"\u003Cp>One of the most shocking parts about how the YouTube experience has degraded is search. YouTube is one of the biggest search engines on the internet and search on the website is now nearly worthless. It's really hard to believe they'd destroy one of the best and most valuable things the site had going for it but here we are.\u003Cbr \/>\u003Cbr \/>Great video on the subject by \u003Ca href=\"https:\/\/threads.net\/\u0040eposvox\/\" class=\"u-url mention\">\u0040\u003Cspan>eposvox\u003C\/span>\u003C\/a> \u003Cbr \/>\u003Ca href=\"https:\/\/www.youtube.com\/watch?v=ib3E8rBsT60\">https:\/\/www.youtube.com\/watch?v=ib3E8rBsT60\u003C\/a>\u003C\/p>"},"published":"2024-05-15T15:00:17-07:00","attributedTo":"https:\/\/threads.net\/ap\/users\/17841401411590012\/","url":"https:\/\/www.threads.net\/\u0040davechensky\/post\/C7AU5FByDQQ","to":["https:\/\/www.w3.org\/ns\/activitystreams#Public"],"cc":["https:\/\/threads.net\/ap\/users\/17841401411590012\/followers\/"],"tag":[{"href":"https:\/\/threads.net\/ap\/users\/17841400625863685\/","name":"\u0040eposvox","type":"Mention"}]},"actor":"https:\/\/threads.net\/ap\/users\/17841401411590012\/","published":"2024-05-15T15:00:17-07:00","to":["https:\/\/www.w3.org\/ns\/activitystreams#Public"],"cc":["https:\/\/threads.net\/ap\/users\/17841401411590012\/followers\/"]}

---r21NI3wg---E--
\x0d\x0a<title>403 Forbidden</title>\x0d\x0a\x0d\x0a
403 Forbidden
\x0d\x0a
nginx\x0d\x0a\x0d\x0a\x0d\x0a

---r21NI3wg---F--
HTTP/1.1 403
Server: nginx
X-Robots-Tag: noindex, nofollow
Date: Wed, 15 May 2024 22:05:28 GMT
Content-Length: 146
X-Download-Options: noopen
Content-Type: text/html
Connection: keep-alive
Referrer-Policy: same-origin
Strict-Transport-Security: max-age=31536000;  includeSubDomains

---r21NI3wg---H--
ModSecurity: Warning. Matched "Operator `Pm' with parameter `=' against variable `MATCHED_VARS:ARGS:json.object.content' (Value: `
One of the most shocking parts about how the YouTube experience has degraded is search. YouTube i (477 characters omitted)' ) [file "/etc/modsecurity.d/owasp-crs/rules/REQUEST-933-APPLICATION-ATTACK-PHP.conf"] [line "112"] [id "933120"] [rev ""] [msg "PHP Injection Attack: Configuration Directive Found"] [data "Matched Data: engine found within MATCHED_VARS:ARGS:json.object.content:
One of the most shocking parts about how the YouTube experience has degraded is search. YouTube is one of the biggest search (450 characters omitted)"] [severity "2"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "modsecurity"] [tag "application-multi"] [tag "language-php"] [tag "platform-multi"] [tag "attack-injection-php"] [tag "paranoia-level/1"] [tag "OWASP_CRS"] [tag "capec/1000/152/242"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "171581072852.916713"] [ref "o128,6v26,580t:normalisePatho128,6v20,580t:normalisePatho388,1v1046,577o388,1v1046,577"]
ModSecurity: Access denied with code 403 (phase 2). Matched "Operator `Ge' with parameter `5' against variable `TX:BLOCKING_INBOUND_ANOMALY_SCORE' (Value: `10' ) [file "/etc/modsecurity.d/owasp-crs/rules/REQUEST-949-BLOCKING-EVALUATION.conf"] [line "222"] [id "949110"] [rev ""] [msg "Inbound Anomaly Score Exceeded (Total Score: 10)"] [data ""] [severity "0"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "anomaly-evaluation"] [tag "OWASP_CRS"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "171581072852.916713"] [ref ""]

---r21NI3wg---I--

---r21NI3wg---J--

---r21NI3wg---K--

---r21NI3wg---Z--

Another one:

---46DTz1Hg---A--
[17/May/2024:17:11:46 +0200]<PHONE_NUMBER>30.624273 <IP_ADDRESS> 0 <IP_ADDRESS> 8080
---46DTz1Hg---B--
POST /inbox HTTP/1.1
Date: Fri, 17 May 2024 15:11:46 GMT
X-Forwarded-For: <IP_ADDRESS>
User-Agent: http.rb/5.1.1 (Mastodon/4.2.8; +https://social.growyourown.services/)
X-Forwarded-Proto: https
X-Forwarded-By: <IP_ADDRESS>:8443
Content-Length: 3634
X-Real-IP: <IP_ADDRESS>
Digest: SHA-256=Ar06NAtR7HqsaXXbEE9OYlPH3oVJ3cvTn9jIX5bUlko=
Host: fedi.0x42.ch
X-Forwarded-Port: 8443
Accept-Encoding: gzip
Forwarded: for=<IP_ADDRESS>; proto=https; by=<IP_ADDRESS>
Content-Type: application/activity+json
Signature: keyId="https://social.growyourown.services/users/homegrown#main-key",algorithm="rsa-sha256",headers="(request-target) host date digest content-type",signature="O9NipbIhvONEbwvLZruFjLKw8Co5nB8q2BJz6U/MiYrRikTYMgLGzwj7qRcUPcrp6AQPpxmgRHfBFG9E8c/hby7pHC6VGkR5vpKLCGP7/51bDKWGgZXib8qJQpzTWj8n1rZo6+nibhCmSlKBRpVM0qMTnnl1lfe1ObDIudAvzN6Lexdt+dpzjjE96zBf3NhGoYP3+sEqTzWRqJjjdVNC1pY4wq5lnLEX81EkHU8PAXl3jps7QWsiVRrW4RToLwtK4eB1QG3VvUayuHSEWbpyQZlon2r8APVMHs2ldHZM2FlA0bHGifaRTDuH/K/iVYgCo5ooYxzf56l4eUCI6sABjg=="

---46DTz1Hg---C--
{"@context":["https://www.w3.org/ns/activitystreams",{"ostatus":"http://ostatus.org#","atomUri":"ostatus:atomUri","inReplyToAtomUri":"ostatus:inReplyToAtomUri","conversation":"ostatus:conversation","sensitive":"as:sensitive","toot":"http://joinmastodon.org/ns#","votersCount":"toot:votersCount","Hashtag":"as:Hashtag"}],"id":"https://social.growyourown.services/users/homegrown/statuses/112457068911512452/activity","type":"Create","actor":"https://social.growyourown.services/users/homegrown","published":"2024-05-17T15:11:33Z","to":["https://www.w3.org/ns/activitystreams#Public"],"cc":["https://social.growyourown.services/users/homegrown/followers"],"object":{"id":"https://social.growyourown.services/users/homegrown/statuses/112457068911512452","type":"Note","summary":null,"inReplyTo":null,"published":"2024-05-17T15:11:33Z","url":"https://social.growyourown.services/@homegrown/112457068911512452","attributedTo":"https://social.growyourown.services/users/homegrown","to":["https://www.w3.org/ns/activitystreams#Public"],"cc":["https://social.growyourown.services/users/homegrown/followers"],"sensitive":false,"atomUri":"https://social.growyourown.services/users/homegrown/statuses/112457068911512452","inReplyToAtomUri":null,"conversation":"tag:social.growyourown.services,2024-05-17:objectId=228540:objectType=Conversation","content":"
PeerTube admins, you don't need to federate with entire instances. You can be a lot more selective if you want to:

1. Log in on PeerTube with your admin account
2. Click "Administration" on the left
3. Click "Federation" at the top, select "Following" from the dropdown menu
4. Click "Follow", then add all the accounts you want to federate to your PeerTube instance with one account per line
5. Click the "Follow" button at the bottom to confirm the accounts

#PeerTubeAdmin #PeerTube
","contentMap":{"en":"
PeerTube admins, you don't need to federate with entire instances. You can be a lot more selective if you want to:

1. Log in on PeerTube with your admin account
2. Click "Administration" on the left
3. Click "Federation" at the top, select "Following" from the dropdown menu
4. Click "Follow", then add all the accounts you want to federate to your PeerTube instance with one account per line
5. Click the "Follow" button at the bottom to confirm the accounts

#PeerTubeAdmin #PeerTube
"},"attachment":[],"tag":[{"type":"Hashtag","href":"https://social.growyourown.services/tags/peertubeadmin","name":"#peertubeadmin"},{"type":"Hashtag","href":"https://social.growyourown.services/tags/peertube","name":"#peertube"}],"replies":{"id":"https://social.growyourown.services/users/homegrown/statuses/112457068911512452/replies","type":"Collection","first":{"type":"CollectionPage","next":"https://social.growyourown.services/users/homegrown/statuses/112457068911512452/replies?only_other_accounts=true&page=true","partOf":"https://social.growyourown.services/users/homegrown/statuses/112457068911512452/replies","items":[]}}}}

---46DTz1Hg---E--
\x0d\x0a<title>403 Forbidden</title>\x0d\x0a\x0d\x0a
403 Forbidden
\x0d\x0a
nginx\x0d\x0a\x0d\x0a\x0d\x0a

---46DTz1Hg---F--
HTTP/1.1 403
Server: nginx
X-Robots-Tag: noindex, nofollow
Date: Fri, 17 May 2024 15:11:46 GMT
Content-Length: 146
X-Download-Options: noopen
Content-Type: text/html
Connection: keep-alive
Referrer-Policy: same-origin
Strict-Transport-Security: max-age=31536000;  includeSubDomains

---46DTz1Hg---H--
ModSecurity: Warning. Matched "Operator `Rx' with parameter `(?i)(?:[\n\r;`\{]|\|\|?|&&?)[\s\x0b]*[\s\x0b\"'\(,@]*(?:[\"'\.-9A-Z_a-z]+/|(?:[\"'\x5c\^]*[0-9A-Z_a-z][\"'\x5c\^]*:.*|[ \"'\.-9A-Z\x5c\^_a-z]*)\x5c)?[\"\^]*(?:a[\"\^]*(?:c[\"\^]*c[\"\^]*c[\"\^]*h[\"\^ (8443 characters omitted)' against variable `ARGS:json.object.contentMap.en' (Value: `
PeerTube admins, you don't need to federate with entire instances. You can be a lot more sele (704 characters omitted)' ) [file "/etc/modsecurity.d/owasp-crs/rules/REQUEST-932-APPLICATION-ATTACK-RCE.conf"] [line "778"] [id "932370"] [rev ""] [msg "Remote Command Execution: Windows Command Injection"] [data "Matched Data: ; at the top, select "Following" from the dropdown menu
4. Click "Follow", then add all the accounts you want to federate to your PeerTube instance with one acco (1205 characters omitted)"] [severity "2"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "application-multi"] [tag "language-shell"] [tag "platform-windows"] [tag "attack-rce"] [tag "paranoia-level/1"] [tag "OWASP_CRS"] [tag "capec/1000/152/248/88"] [tag "PCI/6.5.2"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "171595870630.624273"] [ref "o262,541v26,804"]
ModSecurity: Access denied with code 403 (phase 2). Matched "Operator `Ge' with parameter `5' against variable `TX:BLOCKING_INBOUND_ANOMALY_SCORE' (Value: `5' ) [file "/etc/modsecurity.d/owasp-crs/rules/REQUEST-949-BLOCKING-EVALUATION.conf"] [line "222"] [id "949110"] [rev ""] [msg "Inbound Anomaly Score Exceeded (Total Score: 5)"] [data ""] [severity "0"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "anomaly-evaluation"] [tag "OWASP_CRS"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "171595870630.624273"] [ref ""]

---46DTz1Hg---I--

---46DTz1Hg---J--

---46DTz1Hg---K--

---46DTz1Hg---Z--

I'm not sure what exactly matched here, but the regex match for a Windows Command Injection muts be in here:
PeerTube admins, you don't need to federate with entire instances. You can be a lot more selective if you want to:1. Log in on PeerTube with your admin account2. Click "Administration" on the left3. Click "Federation" at the top, select "Following" from the dropdown menu4. Click "Follow", then add all the accounts you want to federate to your PeerTube instance with one account per line5. Click the "Follow" button at the bottom to confirm the accounts#PeerTubeAdmin #PeerTube

And another one:

---C1PUrM8M---A--
[17/May/2024:20:15:40 +0200]<PHONE_NUMBER>46.281855 2a03:2880:3ff:6::face:b00c 0 <IP_ADDRESS> 8080
---C1PUrM8M---B--
POST /inbox HTTP/1.1
User-Agent: facebookexternalua
X-Forwarded-Proto: https
X-Forwarded-By: fd00::1:8:d:8443
Accept: */*
Content-Length: 2118
X-Real-IP: 2a03:2880:3ff:6::face:b00c
Digest: SHA-256=7UX3aCU5lvAXRO79NneY5NR9VCg4Uzy1Fxx/uMMQBH4=
Host: fedi.0x42.ch
X-Forwarded-Port: 8443
X-Forwarded-For: 2a03:2880:3ff:6::face:b00c
Date: Fri, 17 May 2024 18:15:39 GMT
Accept-Encoding: deflate, gzip
Forwarded: for=2a03:2880:3ff:6::face:b00c; proto=https; by=fd00::1:8:d
Content-Type: application/ld+json; profile="https://www.w3.org/ns/activitystreams"
Signature: keyId="https://threads.net/ap/users/17841400220650482/#main-key",algorithm="rsa-sha256",headers="(request-target) host date digest",signature="VJk7JL8npqudSyAZkfiX6lx2hGMRKhDYAcWATS7maz9qycKhSgFtTRuZJ9KBmVd6uQ/wtGx5sZK4XPzZIj5+M1Z1/JpTUrdh0txXaoI3fkTsZYa3pzl/MjSzNCF5Zn2l4zbDfvu2SR33IyQmu1RLtSlsR545hjNCVesY767yulrdqROHNn53MBNXrLI1c++lX7JuH10/mFZTSjCWlQxZGhQXNNJHpws+SgsAdpR63ciyOaiwuu4WVvRpUYjyHAT/pFV2KGwGLKdupnem3xhNTD1iXwZO3MeyVu7duf8cq3dqcuL7k2HNpRM6Z9aU5Z5LOKoOg+w9py2YdDTzl4Wl7A=="

---C1PUrM8M---C--
{"\u0040context":["https:\/\/www.w3.org\/ns\/activitystreams"],"id":"https:\/\/threads.net\/ap\/users\/17841400220650482\/post\/17921290316804335\/activity\/","type":"Create","object":{"id":"https:\/\/threads.net\/ap\/users\/17841400220650482\/post\/17921290316804335\/","type":"Note","content":"\u003Cp>It\u2019s drizzly but otherwise nice today, which makes it a fine time to peruse a stack of new books and ARCs that have come to the Scalzi Compound. Which of these books are particularly catching your eye today?\u003C\/p>","contentMap":{"en":"\u003Cp>It\u2019s drizzly but otherwise nice today, which makes it a fine time to peruse a stack of new books and ARCs that have come to the Scalzi Compound. Which of these books are particularly catching your eye today?\u003C\/p>"},"published":"2024-05-17T11:10:28-07:00","attributedTo":"https:\/\/threads.net\/ap\/users\/17841400220650482\/","url":"https:\/\/www.threads.net\/\u0040jscalzi\/post\/C7FELp2JGaQ","to":["https:\/\/www.w3.org\/ns\/activitystreams#Public"],"cc":["https:\/\/threads.net\/ap\/users\/17841400220650482\/followers\/"],"tag":[],"attachment":[{"type":"Image","url":"https:\/\/scontent.cdninstagram.com\/v\/t51.29350-15\/444828096_767615788841609_7014261427382823099_n.jpg?_nc_cat=105&ccb=1-7&_nc_sid=18de74&_nc_ohc=aU1ZlLHPEQAQ7kNvgHFv_Ho&_nc_ad=z-m&_nc_cid=0&_nc_ht=scontent.cdninstagram.com&oh=00_AYA0tEqVSi5U--BRrnsV86YqKkYLVxYypage5mPYWnSfTQ&oe=664D5829","width":1080,"height":1349,"name":"Logical Fantasy: The Many Worlds of John Wyndham, David Byte, ed; Lincoln's Dreams, Connie Willis; Time Out, Michael Marshall Smith; Little Fuzzy, H. Beam Piper; Voices Carry, Raven Oak; Cursed Under London, Gabby Hutchison Crouch; One Hundred Shadows, Hwang Jungeun; Where I End, Sophie White; Welcome to Boy.Net, Lyda Morehouse; The Proper Thing and Other Stories, Seanan McGuire; Fall of Light, Steve Erikson"}]},"actor":"https:\/\/threads.net\/ap\/users\/17841400220650482\/","published":"2024-05-17T11:10:28-07:00","to":["https:\/\/www.w3.org\/ns\/activitystreams#Public"],"cc":["https:\/\/threads.net\/ap\/users\/17841400220650482\/followers\/"]}

---C1PUrM8M---E--
\x0d\x0a<title>403 Forbidden</title>\x0d\x0a\x0d\x0a
403 Forbidden
\x0d\x0a
nginx\x0d\x0a\x0d\x0a\x0d\x0a

---C1PUrM8M---F--
HTTP/1.1 403
Server: nginx
X-Robots-Tag: noindex, nofollow
Date: Fri, 17 May 2024 18:15:40 GMT
Content-Length: 146
X-Download-Options: noopen
Content-Type: text/html
Connection: keep-alive
Referrer-Policy: same-origin
Strict-Transport-Security: max-age=31536000;  includeSubDomains

---C1PUrM8M---H--
ModSecurity: Warning. Matched "Operator `Rx' with parameter `(?i)(?:[\n\r;`\{]|\|\|?|&&?)[\s\x0b]*[\s\x0b\"'\(,@]*(?:[\"'\.-9A-Z_a-z]+/|(?:[\"'\x5c\^]*[0-9A-Z_a-z][\"'\x5c\^]*:.*|[ \"'\.-9A-Z\x5c\^_a-z]*)\x5c)?[\"\^]*(?:a[\"\^]*(?:s[\"\^]*s[\"\^]*o[\"\^]*c|t[\" (7602 characters omitted)' against variable `ARGS:json.object.attachment.array_0.name' (Value: `Logical Fantasy: The Many Worlds of John Wyndham, David Byte, ed; Lincoln's Dreams, Connie Willis; T (311 characters omitted)' ) [file "/etc/modsecurity.d/owasp-crs/rules/REQUEST-932-APPLICATION-ATTACK-RCE.conf"] [line "815"] [id "932380"] [rev ""] [msg "Remote Command Execution: Windows Command Injection"] [data "Matched Data: ; Where found within ARGS:json.object.attachment.array_0.name: Logical Fantasy: The Many Worlds of John Wyndham, David Byte, ed; Lincoln's Dreams, Connie Willis; Time Out, Michael Marsha (288 characters omitted)"] [severity "2"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "application-multi"] [tag "language-shell"] [tag "platform-windows"] [tag "attack-rce"] [tag "paranoia-level/1"] [tag "OWASP_CRS"] [tag "capec/1000/152/248/88"] [tag "PCI/6.5.2"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "171596974046.281855"] [ref "o266,7v36,411"]
ModSecurity: Access denied with code 403 (phase 2). Matched "Operator `Ge' with parameter `5' against variable `TX:BLOCKING_INBOUND_ANOMALY_SCORE' (Value: `5' ) [file "/etc/modsecurity.d/owasp-crs/rules/REQUEST-949-BLOCKING-EVALUATION.conf"] [line "222"] [id "949110"] [rev ""] [msg "Inbound Anomaly Score Exceeded (Total Score: 5)"] [data ""] [severity "0"] [ver "OWASP_CRS/4.2.0"] [maturity "0"] [accuracy "0"] [tag "modsecurity"] [tag "anomaly-evaluation"] [tag "OWASP_CRS"] [hostname "<IP_ADDRESS>"] [uri "/inbox"] [unique_id "171596974046.281855"] [ref ""]

---C1PUrM8M---I--

---C1PUrM8M---J--

---C1PUrM8M---K--

---C1PUrM8M---Z--

Decisions taken in issue chat meeting on May 20 2024:

We agree that this should be solved with a plugin.
As for the RCE rules, they have a couple of open issues. We need to tackle those as a group and conceptually decide what we want to do with them.

Can we close this issue?

We can.


Added some more functionality.

…ontinue to function if the user wants to.

Hey! Thank you for contributing to my mini project! I do have a small change in your code. The calculate_logarithm and calculate_exponentation arent working i.e they arent defined in the code. I have never got a pull request on my repos so i dont know how to propose these changes in the platform. So here's the updated code and edit these in your branch/repo and I will merge them! I know I am a bit dumb in this thing. but if you know how to do it, please tell me, that would be helpful!
https://pastebin.com/dRCdhc5a

Hey! Thank you for contributing to my mini project! I do have a small change in your code. The calculate_logarithm and calculate_exponentation arent working i.e they arent defined in the code. I have never got a pull request on my repos so i dont know how to propose these changes in the platform. So here's the updated code and edit these in your branch/repo and I will merge them! I know I am a bit dumb in this thing. but if you know how to do it, please tell me, that would be helpful!
https://pastebin.com/dRCdhc5a

Hello, Thanks for replying. I changed the code as you wanted.

Also I am not sure how to add the log and expo to your code since I don't have much knowledge about the math module.


Error: Extension is not compatible with Code 1.85.2. Extension requires: ^1.87.0

Good day, I'm getting an error saying Extension is not compatible with Code 1.85.2. Extension requires: ^1.87.0. Funny enough, VS Code does not have an update to upgrade to 1.87.0 as I'm already using the latest version.

@yaddly You are using an old VSCode editor. Install the latest one and try it again.


Class loading problem in test mode

serialization.zip
Attached code runs fine in normal mode, but failes if it was run as test. Internally the code uses classloader to perform deserialization using XStream.
XStream internally uses the following code to obtain classloader:
static {
 if (JVM.is17()) { <
            // see http://www.cs.duke.edu/csed/java/jdk1.7/technotes/guides/lang/cl-mt.html
            try {
                Method m = ClassLoader.class.getDeclaredMethod("registerAsParallelCapable", (Class[])null);
                if (!m.isAccessible()) {
                    m.setAccessible(true);
                }
                m.invoke(null, (Object[])null);
            } catch (Exception e) {
                // ignore errors, JVM will synchronize class for Java 7 or higher
            }
        }
}
 public CompositeClassLoader() {
        addInternal(Object.class.getClassLoader()); // bootstrap loader.
        addInternal(getClass().getClassLoader()); // whichever classloader loaded this jar.
    }

Adding
value cl = xstream.classLoader;
assert(is CompositeClassLoader cl);
cl.add(javaClass<Test>().classLoader);

fixes, so probably the problem is that Test is prematurely unloaded by classloader obtained by XStream.

Actually, the problem is that the classloader used to load xtream does import your own module, which is why it does not work. We can't really fix that, though, so you'll have to make sure you tell it what your module's class loader is.
TBH I would have thought that it would also fail in non-test mode, unless you're running in a flat classpath mode.


Cannot set auto exposure to True on D405 in Python after FW update to 5.15.1

Required Info

Camera Model
D405

Firmware Version
5.15.1

Operating System & Version
Ubuntu 22.04

Kernel Version (Linux Only)
Linux 6.5.0-26-generic x86_64

Platform
PC

SDK Version
<IP_ADDRESS>84

Language
Python

Segment
Robot

Issue Description
When I start the realsense using this code:
    def __init__(self, name, serial_number, dim=(640, 480), fps=15, depth=False):
        self.name = name
        assert serial_number in self.get_device_serial_numbers()
        self.serial_number = serial_number
        self.depth = depth
        self.pipe = rs.pipeline()
        self.cfg = rs.config()
        self.cfg.enable_device(self.serial_number)
        self.cfg.enable_stream(rs.stream.color, dim[0], dim[1], rs.format.bgr8, fps)
        if self.depth:
            self.cfg.enable_stream(rs.stream.depth, dim[0], dim[1], rs.format.z16, fps)
        self.profile = self.pipe.start(self.cfg)

        # Create an align object
        # rs.align allows us to perform alignment of depth frames to others frames
        # The "align_to" is the stream type to which we plan to align depth frames.
        align_to = rs.stream.color
        self.align = rs.align(align_to)

on a D405 with 5.15.1 I get over-exposed images. When using a D405 that had FW <IP_ADDRESS>, the images were correctly exposed.
When I tried adding
self.profile = self.pipe.start(self.cfg)

depth_sensor = self.profile.get_device().query_sensors()[0]
depth_sensor.set_option(rs.option.enable_auto_exposure, True)

The camera froze. After closing the program, I entered realsense viewer and couldn't receive a video stream for the colour image. Only after playing around with the controls/turning the camera off and on again did I get a stream for the colour image.
edit: added Linux kernel version
edit2: Added code snippet

Hi @elishafer  Are you using your D405 on a USB 2.1 or USB 3.2 connection, please?  There was a past case at the link below where a D405 experienced over-exposure on USB 2 only.  You can tell which type of connection the camera is being detected as being on by looking at the number beside the camera name at the top of the RealSense Viewer's options side-panel (2.1 or 3.2).
https://support.intelrealsense.com/hc/en-us/community/posts/12707550490259-D405-Color-Instability-on-USB-2-0-and-Outdoor-lighting
I note though that exposure is correct for you on firmware <IP_ADDRESS>.
We have not had a similar case reported where exposure works better on an older firmware on D405.  So if you are confirmed to be on a USB 3.2 connection then I would recommend continuing with the older firmware <IP_ADDRESS> until the next release of the RealSense SDK and an updated firmware is released to see whether the next firmware resolves your issue.

@MartyG-RealSense It's USB3.2, I bought a PCIe card with 5Gb/s per USB port and Delock cables to make sure of it and checked it on the realsense-viewer. btw, when two cameras with diffferent FW versions are working at the same time the old FW has good exposure while the old is overexposed.
I didn't know you can downgrade the firmware. I'll check it out, thanks!

@MartyG-RealSense Quick question: Do I understand correctly that FW ver <IP_ADDRESS> the same as <IP_ADDRESS>? ref
Also that there is a limited amount of FW downgrades that I can do?

<IP_ADDRESS> is 5 months newer than 5.12.14.  Sometimes the changes in firmware versions are very minor.  You should not downgrade your D405 to a version older than the 5.12.14 one that is currently installed.  The ideal situation is to use the firmware recommended for the particular SDK version that you are using, though that is causing you over-exposure on your D405.
There is a limit of 20 downgrades before downgrading becomes locked and you can only upgrade to a newer version than the currently installed one.

Just updating that downgrading the FW to <IP_ADDRESS> worked

I'm pleased to hear that you achieved a solution, @elishafer - thanks very much for the update!


Doxygen configuration cleanup

Is your feature request related to a problem? Please describe.

The EXTRACT_ALL flag set to YES defeats the WARN_IF_UNDOCUMENTED and WARN_NO_PARAMDOC enabled errors
Warning files should be unique to each doxygen created doc (currently set in the cfe-common.doxyfile.in) to allow parallel runs and unique responses in CI

Describe the solution you'd like
Set EXTRACT_ALL to NO (likely will need a follow-on ticket to resolve all the new warnings)
Define WARN_LOGFILE in each top doxyfile.in
Describe alternatives you've considered
None
Additional context
None
Requester Info
Jacob Hageman - NASA/GSFC

Note the warning file updates will require updating CI that checks those files.

Note the warning file updates will require updating CI that checks those files.

Note the warning file updates will require updating CI that checks those files.

Which update?

Note the warning file updates will require updating CI that checks those files.

Which update?

Note the warning file updates will require updating CI that checks those files.

Which update?

If the warning file name is updated to be unique per document build (suggestion in 2. above).

Note the warning file updates will require updating CI that checks those files.

Which update?

If the warning file name is updated to be unique per document build (suggestion in 2. above).


Reply/resolution times in business hours not matching up with Zendesk

When comparing reply/resolution times in business hours from the zendesk_ticket_metrics model to those in Zendesk Explore or the Zendesk Support API, the metrics do not match for the majority of tickets.
A couple of issues:

Time in business hours is calculated in both dbt and Zendesk, but does not match
Time in calendar and business hours is calculated in Zendesk, but time in business hours is null in dbt

Is fivetran planning to add the ticket_metrics table from the Zendesk Support API? A direct connection would be great to have, as Zendesk provides these business hour metrics.

Hi @prestonhsiao thanks for this info.  This is very interesting to hear. Can you please provide me some examples of times when this isn't calculating correctly? I'd love to dig in further... perhaps we can get on a call and troubleshoot together?  You can book time with me here: http://5tran.co/office-hours

Hi @fivetran-kristin I just booked a time for next week. In the meantime, here are some examples (zendesk being a direct export from Zendesk Explore, and dbt being from the dbt zendesk_ticket_metrics model):
1. Mismatching dbt first reply time (hrs) business hours

zendesk first reply time (hrs) calendar hours: 90.01
zendesk first reply time (hrs) business hours: 53.8
dbt first reply time (hrs) calendar hours: 90.01
dbt first reply time (hrs) business hours: 41.7

2. NULL dbt first reply time (hrs) business hours

zendesk first reply time (hrs) calendar hours: 3.83
zendesk first reply time (hrs) business hours: 0.033
dbt first reply time (hrs) calendar hours: 3.83
dbt first reply time (hrs) business hours: NULL

3. Mismatching dbt first reply time (hrs) calendar and business hours

zendesk first reply time (hrs) calendar hours: 2.15
zendesk first reply time (hrs) business hours: 2.15
dbt first reply time (hrs) calendar hours: 313.43
dbt first reply time (hrs) business hours: 105.23

Happy to continue the conversation here before our call.

@prestonhsiao thanks. It's going to be a little hard for me to dig in without access to your data. I can open some additional availability for this week if you'd like to meet earlier than this coming Monday. Let me know what time/date works for you and I'll try to accommodate.

@fivetran-kristin thank you for trying to accommodate! Would you have a 30 min time block from 10 - 5 on Wednesday or 12 - 5 on Thursday?

Yeah, of course. Would love to figure out what's going on here asap.  I rescheduled our mtg to 10:30am on Wednesday.

Discussed what is going on here and Preston is happy using the logic in the package.  Will consider adding both options in the future, however I'm going to close this issue for now.

Discussed what is going on here and Preston is happy using the logic in the package.  Will consider adding both options in the future, however I'm going to close this issue for now.


changing dot radius scaling? (3.x)

Going to take a pass at doing some documentation for all of the layers + examples.
The logic for scaling the dots in scatterplots changed in the latest 3.x beta. Is there any info about how this works/is configured?
I know before the radius was a flat pixel size, I think now it works as meters width. Is this configurable? I can't seem to figure out how to override the scaling to do my own logic (min width/max width in pixels)

@contra - Correct. The projection shaderlib now enables all layers to work in both meters and lng/lat, and this also enabled us to specify extents in meters, so we tried that.
As you say it is of course also sometimes desirable to specify extents in pixels, but there is no prebuilt mechanism for doing this yet - it will require a touch of hand coding in the vertex shader.
I've not quite made up my mind what I think is the best approach. I was leaning towards preferring to have radius specified in meters, while allowing the app to specify a minimum pixel size for the point using a prop... that should be pretty easy to add to the current layer. What do you think?

@ibgreen Size in meters with min/max pixel size solves all of my use cases. Biggest issue right now is being zoomed way out and having the dots be non-existent, and zooming way in and having them consume 50% of the viewport.

How does all of this play in with strokeWidth for choropleth/arc/line? Is the plan to move those to the same system as well?

strokeWidth is a little harder to change, since it currently uses gl.lineWidth which is specified in screen pixels.
We do have an enhanced-choropleth-layer that extrudes lines to thin triangle strips and yes this gives us that level of control (an also allows us to get clean "mitering"), so it is probably the way to go (i.e. eventually replace choropleth-layer with enhanced-choropleth-layer)

@ibgreen Would that work for arcs too?

Would that work for arcs too?

Arcs require 3D extrusion (think a thin "tube" rather than just a flat strip), so we need to create more triangles, and mitering (joining) tubes requires a bit more care than joining flat strips. But yes, we could absolutely have a layer that "tessellates" arcs.

Couple of examples with 3.x:
There's 25K dots on this map, but none of them are visible due to the scaling.

Zooming in more makes them kind of visible, but still way too small.

Zoom in a little bit more and they become huge.

@contra There are two ways to set the radius - getRadius accessor returns radius in meters of that particular point (default 1) and radius is a multiplier (default 30).
You can make them visible in the zoomed out mode by making the radius bigger, but they will of course become even bigger as you zoom in.
We could change the layer to work differently, or have more options - we just need to agree on how we want it to work.

Do you want the points to always occupy a certain number of screen pixels, regardless of zoom?
Would you like to be able to specify min and max sizes for them?
etc...

@ibgreen How do you feel about this? Feels a little funny mixing units but can't think of any other way.
new ScatterPlot({
  radius: 3, // meters
  minRadiusPixels: 10 // pixels
  maxRadiusPixels: 10 // pixels
})

@contra - Yes this looks reasonable.

Maybe radiusMinPixels etc in case we need to specify screen size limits on multiple props.
These props could default to 0 and say 10000 (something big enough to cover today's screens).

Will work on a PR, hopefully I can do this without having to mess with the shaders - no idea how to work on that stuff.

@contra Looking forward to the PR, but I do suspect it needs to be done in the shaders.
You need to make sure the props get set as uniforms when they change, declare the new uniforms in the vertex shader, then clamp the intermediate scaled radius value in the shader.
You can always give it a try - it should be easy to just extend the existing code - and I have seen several people here getting hooked on shader programming after having their first ever go at modifying an existing deck.gl layer.
If not - maybe you can put together some of those layer docs we talked about, and I could give this a whirl :)

I wanna plus one @ibgreen suggestion to modify the radius. I've have reasonably good success with correlating the zoom level the radius multiplier level


Adding the isle of scilly as a test tier locations for gatling tests

As the yaml file defining tiers will be dynamic we cannot rely on it for
performance test purposes.
This change means we will concatenate a yaml file that specifies the
isle of scilly on to the end of the tier lad file is in lockdown. This
was picked as it is less likely to be in lockdown and will therefore not
interfere with legitimate entries but also will not likely be used for
hand testing purposes.
This also changes all the gatling test users to use an isle of scilly
postcode.
Very much a proof of concept.

To test this do the following. Checkout the branch
Then create a maven docker container as concourse does.
docker run -v pwd:/gatling -ti maven:3.6.3-ibmjava-8-alpine  /bin/bash
Inside the docker container run the following
cd /gatling/loadtests
mvn gatling:test  -DinjectUsersPerSecond=1         -DinjectDurationSeconds=1         -DpauseBetweenRequestsInSecondsMax=1         -DpauseBetweenRequestsInSecondsMin=1         -DnumberOfRepetitions=1         -Dgatling.simulationClass=svp.SvpSimulationConstantUsersPerSec         -Dgatling.data.writers.0=file         -Dgatling.data.charting.indicators.lowerBound=1000         -Dgatling.data.charting.indicators.higherBound=1500 -Durl=https://gds-shielded-vulnerable-people-service-sandbox.london.cloudapps.digital

The real values can be found here https://github.com/alphagov/govuk-shielded-vulnerable-people-service/blob/master/concourse/tasks/gatling-workflow-load-test.yml


Removed CSV parsing and added Google Sheet support

hi fur

Deleting code, that's what I like to see!


feat(client): handle GQL errors

[!CAUTION]
Do not merge

What/Why?
GQL requests that respond as 200 but have an errors field will now be properly handled by the client and throw a proper BigCommerceGQLError response with the message reason from the API. This will provide a more detailed description of why the GQL request errored out.
API errors will still be handled and attribute the errored status as the message with this change as BigCommerceAPIError.
Testing
Tested this and now our requests will actually throw now if they error from the GQL request and show a valid reason.

Closing for now, @jorgemoya we can always come back to this one.


i get this error after deploying the code to gcloud

`TypeError: Class constructor CoreMongooseArray cannot be invoked without 'new'
at .initCloneArray ( /usr/src/app/node_modules/lodash.clonedeep/index.js:1235 )
at .baseClone ( /usr/src/app/node_modules/lodash.clonedeep/index.js:854 )
at undefined. ( /usr/src/app/node_modules/lodash.clonedeep/index.js:897 )
at .arrayEach ( /usr/src/app/node_modules/lodash.clonedeep/index.js:140 )
at .baseClone ( /usr/src/app/node_modules/lodash.clonedeep/index.js:891 )
at undefined. ( /usr/src/app/node_modules/lodash.clonedeep/index.js:897 )
at .arrayEach ( /usr/src/app/node_modules/lodash.clonedeep/index.js:140 )
at .baseClone ( /usr/src/app/node_modules/lodash.clonedeep/index.js:891 )
at .cloneDeep ( /usr/src/app/node_modules/lodash.clonedeep/index.js:1399 )
at .clone ( /usr/src/app/node_modules/cache-manager/lib/stores/memory.js:9 )
at Object.self.set ( /usr/src/app/node_modules/cache-manager/lib/stores/memory.js:57 )
at .UserMiddleware. ( /usr/src/app/main.js:8727 )
at .Generator.next
at .fulfilled ( /usr/src/app/node_modules/tslib/tslib.js:112 )
at .processTicksAndRejections ( `internal/process/task_queues.js:95)``

Can you please paste the output of npm ll cache-manager ?  The 3.6.2 version started using lodash.clonedeep (which appears in your log output) instead of the full lodash library.

Strange.  Does npm install work?

yeah
that error appears after deploying in the google  cloud app engine
Locally it work just fine

Sorry, I have no idea how google cloud app engine works, so it's hard to tell what's going on.  Maybe it's using a different version of nodejs than you are?

Do you get the npm ll cache-manager error when running that locally?

that one I sent you is from the  local environment

I'm guessing that error is related.  You might try rm -Rf node_modules && rm package-lock.json && npm install --save to get a fresh install.

I had the same issue. This is an issue with deep copy which is trying to initialize an object (in-memory object). What I did to solve quickly was to execute JSON.parse(JSON.stringify({ ... my object ... })) on the object to be cached. Don't know a more elegant solution yet.

This should be fixed with #203. In my coverage it works correctly. I wait to get version and integrate it in Nestjs to close it. Any news after the refactor, please comment.

There seems to be no tracking. I close, and reopen in case it happens again.


Planner Directory Structure

With the nearly finished port of plan nodes (#312), we discussed in the weekly meeting how we want to organize the directories involved in the terrier planner. #312 will create the src/planner directory, where the plan nodes will live under src/planner/plannodes. Currently, the other planner directories are:
src/parser
src/parser/expression

When #312 is merged, these should be moved to:
src/planner/parser
src/planner/expressions

@apavlo hi, is the issue still needed to be contributed?
For this issue, what should I do is moving source code and unit test code from parser to planer, right?

Just going to close this issue.


[Bug] [v3.1.0] SP task cannot be triggered by normally

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened
when I create a workflow , and want to let it run by schedule , but the first job (sp job) can not by triggered
What you expected to happen
I expected the first job on the workflow can be triggered auto
How to reproduce
when I try to create  workflow , and the workflow contain some  sqlserver sp jobs , and I create a schedule job on it by time ,
but it cannot be  triggered by time
Anything else
I try to find some logs  , it is below
[ERROR] 2022-11-07 01:55:00.732 +0000 TaskLogLogger-class org.apache.dolphinscheduler.server.master.runner.task.CommonTaskProcessor:[125] - [WorkflowInstance
-95][TaskInstance-0] - submit task error
java.lang.NullPointerException: null
at org.apache.dolphinscheduler.service.expand.CuringGlobalParams.paramParsingPreparation(CuringGlobalParams.java:154)
at org.apache.dolphinscheduler.server.master.runner.task.BaseTaskProcessor.getTaskExecutionContext(BaseTaskProcessor.java:336)
at org.apache.dolphinscheduler.server.master.runner.task.CommonTaskProcessor.dispatchTask(CommonTaskProcessor.java:113)
at org.apache.dolphinscheduler.server.master.runner.task.BaseTaskProcessor.dispatch(BaseTaskProcessor.java:241)
at org.apache.dolphinscheduler.server.master.runner.task.BaseTaskProcessor.action(BaseTaskProcessor.java:212)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitTaskExec(WorkflowExecuteRunnable.java:976)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitStandByTask(WorkflowExecuteRunnable.java:1816)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.submitPostNode(WorkflowExecuteRunnable.java:1349)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable.call(WorkflowExecuteRunnable.java:695)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[ERROR] 2022-11-07 01:55:00.732 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[978] - [WorkflowInstance-95][TaskInstance-0]

process id:95 name:wf_dws_ps_hps-13-20221107015500540 dispatch standby task id:231 name:sp_dim_organization_hier_d failed!
[ERROR] 2022-11-07 01:55:00.732 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1830] - [WorkflowInstance-95][TaskInstance-0]
Task submitted failed, workflowInstanceId: 95, taskInstanceId: 231, taskCode:<PHONE_NUMBER>744
[INFO] 2022-11-07 01:55:00.733 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1498] - [WorkflowInstance-95][TaskInstance-0]
The current process has failed task, the current process failed
[INFO] 2022-11-07 01:55:00.733 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1601] - [WorkflowInstance-95][TaskInstance-0]
The workflowInstance is failed, the workflow status is WorkflowExecutionStatus{code=6, desc='failure'}
[INFO] 2022-11-07 01:55:00.733 +0000 org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnable:[1645] - [WorkflowInstance-95][TaskInstance-0]
Update workflowInstance states, origin state: WorkflowExecutionStatus{code=0, desc='submit success'}, target state: WorkflowExecutionStatus{code=6, desc='f
ailure'}

Version
3.1.x
Are you willing to submit PR?

[X] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

I also encountered this problem. I tried to remove the custom parameters in the task node, so that the task can run.

thanks ikiwixx ， yes ， after I removed the custom parameters ， the job can be triggered normally ， but I still need the custom parameters in project ， I also the issue also happen on sql task node


⚠ Bofrost.at has degraded performance

In c331582, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1802 ms

Resolved: Bofrost.at performance has improved in c38a232 after 1 hour, 7 minutes.


fast-extend 0.0.2

Type: Missing
Summary:
fast-extend 0.0.2
Details:
ClearlyDefined package.json has no license info
NPM license field indicates NONE
The NPM page includes a license field that indicates Unlicense but the link is broken
Resolution:
NONE
Affected definitions:

fast-extend 0.0.2

Later versions include the Unlicense license file in the package. Also, I found the source repo, which is also Unlicense.
https://github.com/streamich/fast-extend
@ariel11 What do you think?


[GlobalOptimization] Add pass for transpose propagation

This adds a pass for propagating transposes already present in the model, or those that were introduced in earlier passes, before data tiling. The important note with this pass is that it does not do any real analysis. Data tiling is the de facto place where layout decisions are made, and similarly is the place where we would want to universally propagate such layouts (and potentially do an analysis). This pass is intended just to do local propagation of transposes only in cases that are universally lucrative, or resolvable by data tiling.
With that note, the idea is that the passes/patterns themselves should be relatively simple. It is organized into 4 phases. 1) Specialize all transpose-like ops to linalg.transpose. This makes the
propagation patterns significantly easier to write.
2) Sink transposes down. A few of the patterns for this are described
below.
[2.5) We will want to add bubbling patterns as the need arises, but that
only run for transposes we don't mark as "terminal" after sinking]
3) Combine adjacent transposes.
4) Re-generalize all transposes because the pipeline expects it.
The currently implemented propagation patterns are:

Sinking through tensor.expand_shape. This is always free and helps reveal new propagation opportunities
Sinking through tensor.extract_slice. Currently this restricts to cases where the resulting transposed slice is known to be contiguous, however we could choose to always do this as a transpose on a slice is likely to be cheaper than on the whole thing.
Named op -> named op conversions

linalg.matmul -> linalg.matmul_transpose_b/matmul_transpose_a
linalg.batch_matmul -> linalg.bmm_transpose_b/bmm_transpose_a

Generic input fusion. This simply does an in-place rewrite of the generic by transposing the results of the associated input's indexing map.

Additionally a flag for aggressive transpose propagation is added that allows for named op -> generic rewrites when there is no equivalent named op to rewrite to. In the fullness of time, this should be turned on by default, but there are places in the code that currently expect certain named ops.

Nice!
Something you may want to extend this with is global load/stores (transpose->store->load->transpose, function calls (caller/callee transposes), and the cfg/scf (back edges that have transposes on both sides). Would be interesting to see if the stateful models we have do transposes on the state. Whenever we get around to it the Explorer is useful for this - Explorer::walkDefiningOps and Explorer::walkTransitiveUses let you walk up into callers/branches/global stores and down into all callees/branch targets/global loads (it's what we use in other whole-program/IPO analysis).

Nice!
Something you may want to extend this with is global load/stores (transpose->store->load->transpose, function calls (caller/callee transposes), and the cfg/scf (back edges that have transposes on both sides). Would be interesting to see if the stateful models we have do transposes on the state. Whenever we get around to it the Explorer is useful for this - Explorer::walkDefiningOps and Explorer::walkTransitiveUses let you walk up into callers/branches/global stores and down into all callees/branch targets/global loads (it's what we use in other whole-program/IPO analysis).

Yeah there is a lot more work to do here for the orchestration of the patterns. What I'm doing here is basically twiddling transposes to avoid whole program rewrites that are hard to reason about without taking some sort of opinion on a preferred layout (data tiling). I'm guessing that the case you're suggesting will be really important though because in practice, users (or us) will let most of the model happen in one layout, and then weirdness happens at the edges, especially with stateful models. Definitely will be good to evolve into that, and we can do it case by case.

Some good dispatch count improvements, but doubling the total dispatch sizes in some cases probably not.

This overall looks good to me.
@hanhanW can you help review the details and land this change.

Yes, I can review the details. @qedawkins is it ready for review? I was waiting it for becoming "ready".

This overall looks good to me.
@hanhanW can you help review the details and land this change.

Yes, I can review the details. @qedawkins is it ready for review? I was waiting it for becoming "ready".

Not ready just yet, I want to find time to look at the regressions first. I'll let you know once ready for a full review, but I put it up as an fyi first.

@hanhanW this is ready for review. I'm still looking at one more regression but it's mostly done.

I took a closer look at the regressing cases and it's coming from a lack of data-tiling support for batch_matmul_transpose_b and matmul_transpose_b.


The selected label is not distinguished by color bars

The selected label is not distinguished by color bars

Could you please elaborate on what you mean by "selected label"? I'm not quite sure what you're talking about. :/

Could you please elaborate on what you mean by "selected label"? I'm not quite sure what you're talking about. :/

Sorry for not expressing clearly. I mean I have opened a lot of webpages, but at the top I can't distinguish which webpage I am staying on, under the dark theme.
I did not show the green indicator bar for distinguishing such as the introduction picture

Ooh, I see! These colour bars are Container Tabs.
You can use them to seperate certain things like cookies depending on the container you're opening the site in. It's a simplified way to use mutliple Profiles.
They don't mark your current tab, but mark the specific container that tab is opened in. Your active tab should be highlighted by a darker shade of grey. If the contrast isn't high enough you can change secondary colour on line 52.

Ooh, I see! These colour bars are Container Tabs. You can use them to seperate certain things like cookies depending on the container you're opening the site in. It's a simplified way to use mutliple Profiles.
They don't mark your current tab, but mark the specific container that tab is opened in. Your active tab should be highlighted by a darker shade of grey. If the contrast isn't high enough you can change secondary colour on line 52.

i got it, thank u~


Remove articles / media past their expiration date

Purge articles / data that are beyond their expiration. Don't remove items marked as favorites.
We could trigger this method during background fetch operations, and (non-blocking) when the user manually launches the app.

What is our expiration date? 30 days?

Added a setting for this in [SCRSettings articleExpiration] now.


Main_ColorStat in Main_PCA_Colors.m

Hi,
I was trying to run the codes in Main_PCA_Colors.m inside the folder Main_PCA_Colors.m
At around line 193, I come across
Main_ColorStat(M, SCORE, 1, S)

I understand that it is a function. However, I do not know where is the location of this function and got this error message
Unrecognized function or variable 'Main_ColorStat'.

Is it possible to provide some guidance on where this function is called (which m file is used) ?
Thank you.

Thanks for letting me know, please check out Matlab_code_V4.zip.

Thank you. With the additional Main_ColorStat.m, things are able to run.


🌱 Add preflight check to update-codegen-clients.sh

Summary
This PR adds a preflight check to hack/update-codegen-clients.sh,
objecting if the local repo pathname is not good for code-generator.
This PR also fixes a little organizational bug in packaging.md.
Related issue(s)
Fixes #

/cc @pdettori
/cc @namasl
/cc @ezrasilvera
/cc @nirrozenbaum

Thanks
/lgtm

/approve


FEATURE REQUEST: Save Audio

Hi there,
This looks a great project and with a couple of quick tweaks it generates some decent results. Would you be able to add the ability to save the audio from the generated speech?

PLEASE! I would also find use for the same feature. Am experimenting to see if I can get anything to work and will let you know if I find anything

I added the ability to output audio by editing speaker.py. See the fork on my github to download the updated speaker.py.

Hi guys, sorry for the delay, please take a look at "yapper/speaker.py -> PiperSpeaker.say()" to find out how text is converted to speech and saved to a file try to replicate that. if that doesn't work out, let me know and I'll drop some code, Thank you @Supernovuh for stepping in to help.
Let me know if the issue is resolved and I'll close it.

Also, @NebularNerd What tweaks did you have to make?

I was referring to altering the parameters by following your examples to get a nice sounding voice. Looking at speaker.py I can see that it does save a temp .wav so I can adapt that to my needs. @Supernovuh's solution looks good, a PR to merge it would make it easily accessible for other users.

Hey @Supernovuh, can you raise a PR to merge your changes?

@n1teshy Done

Hey @NebularNerd , I've added the feature you asked for, PiperSpeaker now has a 'text_to_wave' method to save speech into a wave file. Also, I've added some other fixes, a new, free, LLM API that can be used with the 'GroqEnhancer' class, and there are british voices now, I assume the issue is resolved and I'll close it now. The new features are pushed with the new (0.2.3) release.

Thanks @n1teshy and @Supernovuh
I'll give them a try later and see how it goes, I was happy with the output, being able to take a .wav and dump it into a video editor makes things handy for various projects. The British accents will be a nice touch as I'm British.
Merry Xmas to you both. 🎄


Overwrite SW language pack snippets with own theme snippet files don't work (only for DE and EN)

PHP Version: 8.2   | Shopware Version: <IP_ADDRESS>  | Affected area / extension: Platform(Default)

Expected behaviour:
It should be possible to overwrite the language pack plugin (v4.9.0) snippets with own theme. But it does only work for DE and EN. For FR and NL for example it doesn't work.
Actual behaviour:
The language pack plugin overwrites existing shopware snippets from own theme. This happens for every language the plugin sets its own snippets so any language beside DE and EN. The only way at the moment is to override them through the Shopware backend.
How to reproduce:
Please use SW <IP_ADDRESS> and language pack plugin 4.9.0 with languages FR or NL.

[public] Shopware automated response: This issue is linked to the internal issue: NEXT-38477
[created from NEXT-38477, comment 498290]

[public]Thank you for your report. However this ticket has been created for the wrong project. We decided to close this one and recreate it in the correct project (Language Extensions). You can find the new ticket here: https://github.com/shopware/shopware/issues/4906
[created from NEXT-38477, comment 498779]

Probably, this is correct, since a theme ist technically an app and apps aren’t allowed to override snippets,
Do you get any error message?
Which snippets are affected? Storefront or administration?
You sure it is just LanguagePack snippet or is it just overriding via app? Can rather imagine the later one than the first.

Hi Marcel,
why is it not possible to overwrite the language files from the language pack plugin (https://store.shopware.com/en/swag338126230916f/shopware-language-pack.html) via external snippet files via my own theme (app)? This is possible for the standard languages like German and English. Is there another way to overwrite these language files?

Hi Marcel,
why is it not possible to overwrite the language files from the language pack plugin (https://store.shopware.com/en/swag338126230916f/shopware-language-pack.html) via external snippet files via my own theme (app)? This is possible for the standard languages like German and English. Is there another way to overwrite these language files?

Would you be so kind to answer the questions of my last message? Depending on your answers this could be a bug, even if I don't believe the language pack, as I said before, would be the culpit. Since I did not notice any misbehaviour, precise steps to reproduce are very important.

Hi Marcel,
I don't get any error messages. I'm trying to overwrite storefront snippets.
Overwriting working for
my-theme/src/Resources/snippet/de_DE/storefront.de-DE.json
but not with this language pack snippet files
my-theme/src/Resources/snippet/fr_FR/storefront.fr-FR.json
my-theme/src/Resources/snippet/nl_NL/storefront.nl-NL.json

After a deeper investigation, I do not see any faulty behaviour.
I used an existing theme to create snippets for en-GB & de-DE (system languages), fr-FR & ko-KR (plugin languages) and jp-JP (new language). The path is custom/apps/swagshapetheme/Resources/snippet/<locale>/shapeTheme.<locale>.json, except japanese, named messages.jp-JP.base.json, so my Resource folder has no src in its hierachy.
The snippets were always visible, as long as the corresponding theme is active. This behaviour is correct and intended.
I tested this especially with the LanguagePack, but this does not alter the process in any way.
Therefore, I'll close this ticket. If there's something, please provide precise steps to reproduce, so we can see this behaviour for ourselves.

Yup, works perfectly. There's two things I have the feeling could be wrong. They're described in the post before, please make sure the path is correct and the theme is active 😃

My theme is installed via composer and is located in the vendor directory, not in the custome/apps directory like yours.
Like this
../vendor/pzsysteme/medel-shop-theme/src/Resources/snippet/fr_FR/storefront.fr-FR.json
Theme is active. Everything else in the theme works. The new self-defined texts in the snippet files are also displayed correctly.

I can already see, this won't work because the path is still not right. I guess that's the fault of the dependency, if they path is not correct.  You can see this in core's \Shopware\Core\System\Snippet\Files\AppSnippetFileLoader::getSnippetDir.

I don't get it. It does work with
../vendor/pzsysteme/medel-shop-theme/src/Resources/snippet/de_DE/storefront.de-DE.json
and not with
../vendor/pzsysteme/medel-shop-theme/src/Resources/snippet/fr_FR/storefront.fr-FR.json


CC-16 # --prune flag to remove items from remote that are missing locally

Added --prune option
Updated @blinkmobile/aws-s3 to 2.0.0
Updated tests for new ava api

I just re-queued a rerun of the failed build. I think it might just be a random thing.

There are a few t.deepEqual()s where the simpler t.is() would suffice, but not a dealbreaker.
LGTM 👍