Bedrock to Java (1.20): Hoppers don't move items until opened

I have discovered that hoppers do not move items until opened (right clicked by the player)
The world used in my survival world converted from Bedrock 1.20 to Java 1.20

I've added this to our backlog to fix in the future, thank you for reporting it!

Thank you for your feedback! As per the comments, it seems that this issue can be closed. Have a great day!


build / Rosly typo

build / Rosly -> build / Roslyn

aha, yes, it is a typo, thanks.
do you want to contribute? I can add you to contributor list

Typo fixed, thanks


forge script --broadcast hangs with "waiting for receipts"

Component
Forge, Cast
Have you ensured that all of these are up to date?

[X] Foundry
[X] Foundryup

What version of Foundry are you on?
forge 0.2.0 (293fad7 2024-01-14T00:19:24.272194000Z)
What command(s) is the bug in?
No response
Operating System
macOS (Apple Silicon)
Describe the bug
I'm running a fairly heavy script (deploying the OP stack contracts), and when doing this, forge script sometimes hang on "Waiting for receipts."
After inspecting the geth logs, it seems that 5 out of the 50 sent transactions simply linger in the mempool (marked as "executable" but not "queued").
My hunch is that this is due to the basefee being set too low by forge. Some of the contracts being deployed are really large.
The problem does not appear every time, I believe it is due to how the transactions are split in blocks. In the instance I was debugging, there was one block with 7 txs and 4M gas and one block with 38 txs and 28M gas.
Because geth --dev doesn't produce blocks when there is no txs that can be included in a block, the basefee never goes down and the remaining txs are stuck in limbo forever.
It's possible that the problem is something else, but this seems like the simplest explanation.
The problem is also solved when setting --dev.period 1 on the geth node. It could also probably be solved by manually specifying a high basefee with --with-gas-priceon forge script (since it's a local devnet).
Nevertheless, it seems like a pretty annoying issue, and it's hard to debug, it would be great if forge script could poll the RPC for the basefee and check if it needs to reprice the transactions.
This might  also cause issues on non-dev setups. I'm usually not able to use this deploy script for deployments of the OP stack on testnets, resorting to using the --slow flag. I had those issues pinned on the RPC being flaky, but now I'm wondering if it's not the same problem after all.

experiencing the same issue using a mainnet forked anvil node.
wasn't experience this in nightly-5b7e4cb3c882b28f3c32ba580de27ce7381f415a
script hanging on "waiting for receipts"

increase gas-price-limit

increase gas-price-limit

How? Please help me out, having trouble finding online resources. What's the right gas price to set, how do I increase it?
forge script script/DeployScript.s.sol --rpc-url $ETHEREUM_SEPOLIA --broadcast --account bob --priority-gas-price 1 -vvvv
Running the above currently and it hangs on waiting for receipts

Same here. Trying to run a script which does several transactions, but it gets stuck waiting for receipts.

Encountering this in Arbitrum, haven't tested on other networks. Scripts can only be broadcasted fully with the help of --resume. Sometimes a receipt or two is received before the hang.
I am using following justfile scripts for this:
@deploy script sig:
  forge script $1 --sig "$2()" --ffi --broadcast \
  --chain arbitrum \
  --fork-url "$RPC_ARBITRUM" \
  --verify

@resume script sig:
  forge script $1 --sig "$2()" --ffi --broadcast \
  --chain arbitrum \
  --skip-simulation \
  --rpc-url "$RPC_ARBITRUM" \
  --verify \
  --resume

@norswap @panukettu could you pls try with latest version, waiting for receipt was changed to better handle errors and avoid inginite loop (https://github.com/foundry-rs/foundry/pull/9253). Thank you!

optimistically closing it as waiting for receipt should not get stuck anymore after the fix. please reopen if you hit this again, thank you!

Hey there, I don't have the use-case set up right now, but if this recurs I'll be sure to input here and/or re-open an issue.
Thanks for looking into this!


send data from js to html

http://stackoverflow.com/questions/24160493/how-to-pass-data-from-express-js-to-a-javascript-code-related-to-a-html-page

http://stackoverflow.com/questions/35076608/easiest-way-to-pass-variables-to-routes-templates-in-express


Do update when add is called on existing cluster

When the "add" event is triggered on existing cluster (for example during controller restart) it is currently ignored. We should instead in such situation change the event to "update" and do a cluster update. This might allow to detect faster changes to the underlying ConfigMaps.

@ppatierno @tombentley I guess this will be resolved with #171 or? When we call reconcile for each Watch event it should be handled.

That's my expectation, yes

Ok. I will assign it to @ppatierno so that he can close it when he is finished with it.

closed by #263


Move new message headers to message properties

These header can cause issues in current flows after an update, because users ignore headers in the outbound http component or remove particular headers. The new headers are not part of this actions after the update to the new version.
If these headers can be changed to properties, possible issues will be avoided.

DOVETAIL_OriginalHttpMessageVariableId
DOVETAIL_RetryAttempts
flowId
flowVersion

Because of the technology and expected functionality, these new headers cannot be a property.
The DOVETAIL_ headers are used for HTTP retries, so only visible if that functionality is used.
The flowId and flowVersion headers are always visible in tracing and using as a header variable. These headers cannot be deleted by using the remove headers component.


Progress bar keeps on running even after successful token generation

At few rare instances, broadcast message is sent before registration of the broadcast-receiver. Hence, on such instances, the ProgressBar keeps on running as broadcast-receiver never recieves the broadcast-message.
Fixed- Broadcast-receiver is resistered in onCreate method before hitting GCM-Registration-Service.

@googlebot

I have already signed LCA. Please see screenshot. Same email id is set with git commit as well. Please verify about its consistency and let me know if I miss anything.

@navneetnks You signed the Android Individual CLA, but you need to sign the Google Individual CLA to contribute to this repo. When you sign the agreement, under You plan to submit contributions to you should select the Any other Google project option.

I signed it!
I appreciate your help and guidance.. :)

It looks like we'd need to reregister the receiver in onResume wouldn't we?

@ianbarber The same question I asked to myself that why registering a broadcast receiver every-time in onResume when nobody is suppose to send any message to this receiver (except the onCreate which executes once it its life-cycle).
So in my opinion, broadcast-receiver should be registered only once and it should be done in onCreate.
Kindly let me know if I miss any anything.

Hi @navneetnks thank you for the PR. Registering the receiver before starting the service is a good fix.
Since the text on the main activity could be updated as a result of a later failed getToken call. We should have the receiver registered in onResume. See the comments in your PR.

Hi @kroikie thank you for the detailed notes and explanation. I incorporated all the changes you suggested.. :)

Thanks @navneetnks, looks good to me.


Geolocation orientation does not work properly

Issue with Mobile Geolocation Tracking with Orientation
Describe the bug
When you press the "simulate" button from a computer, or the "Geolocate Me!" button from a mobile, there is the same problem. The tracking works for about a second then the map freezes. It is then necessary to touch the map (zoom or drag) so that the tracking resumes about one second and freeze again.
While the map is blocked, tracking continues to work, so when you touch the map again you are teleported.
To Reproduce

Go to Mobile Geolocation Tracking with Orientation.
Click on "simulate button".
The tracking works for about a second then the map freezes.

Tested with :

Chromium and Firefox on Ubuntu Mate 18.04
Chrome on Android 9

Expected behavior
I think the normal operation is that the tracking works without interruption all along the route.

I found the same (in Brave and Chrome). Also 'geolocate me' does not work for me.
When zooming in or out, the simulation starts working again after a freeze.
The other problem with this example I have, is that there is no code shown, like with the other examples. And looking into the code with DevTools is not very helpfull, because it is uglyfied.

#10777 fixes the simulation.

Why does this example not have the normal explanation like the other examples?

@flexjoly Because someone decided to make it fullscreen. Which it does not have to be. If you want to provide a pull request to use the example template instead, that would be welcome.


Build on Ubuntu could not find Nettle.

I build Daemon on Ubuntu 20.04LTS, the following error occurred:
CMake Error at /usr/share/cmake-3.16/Modules/FindPackageHandleStandardArgs.cmake:146 (message):
Could NOT find Nettle (missing: NETTLE_LIBRARY HOGWEED_LIBRARY
NETTLE_INCLUDE_DIR)
Call Stack (most recent call first):
/usr/share/cmake-3.16/Modules/FindPackageHandleStandardArgs.cmake:393 (_FPHSA_FAILURE_MESSAGE)
cmake/FindNettle.cmake:11 (FIND_PACKAGE_HANDLE_STANDARD_ARGS)
CMakeLists.txt:630 (find_package)
-- Configuring incomplete, errors occurred!
On my system, there is libnettle7 is installed, no libnettle package available, can someone help me to build?
Thanks a lot !

sudo apt install nettle-dev

You may also find more details there: https://wiki.unvanquished.net/wiki/Compiling_the_source#Debian.2FUbuntu

sudo apt install nettle-dev

thanks you help! it's my stupid, I thought all packages had a lib prefix...

You may also find more details there: https://wiki.unvanquished.net/wiki/Compiling_the_source#Debian.2FUbuntu
(Except you may ignore debian packaging and use the cmake instructions from the README like you already do)

Thanks for your replay! the instruction is very detail, I regret finding Daemon engine too late and salute for your great work!
In addition, the authors of ET:XreaL is seems to working on RBDoom3BFG, what do you think and do you have an idea for upgrading the renderer to doom3's renderer?
Have a good day!


Draft: remove dependency to messytables

:warning: Work in progress :warning:
For the record: messytables is unmaintained, so the goal is to move out of it in order to prepare compatibility with python 3.10.
This is a first draft.
One first question: import_xls.py seems not to be used anymore (since https://github.com/gristlabs/grist-core/commit/6c90de4d62e91df0a954cd73e8b826ca275fb0d4 ?), can I just delete it or am I missing something ?
Thanks in advance for your feedback! :)

Thanks @yohanboniface! Hopefully we'll get a chance to look at this properly soon.
import_xls is very much used, it's just a bad filename. 'xls' used to mean 'xls and xlsx' in the code, and now really just means 'xlsx'.

import_xls is very much used, it's just a bad filename. 'xls' used to mean 'xls and xlsx' in the code, and now really just means 'xlsx'.

Ha ha! OK, I'll go through this module too then :)

But maybe we can focus on CSV for a first move ? So to try to make it as small as possible ?

But maybe we can focus on CSV for a first move ? So to try to make it as small as possible ?

That's fine.

@yohanboniface is this still a WIP draft or is it ready for proper review?

Hi @alexmojaki I'd like a proper review, thanks! It all needs a review, but specifically I need your thinking on how we want to detect encoding.

I think I resolved all your comments/suggestions :)

While testing this on my side, I noticed that the guessed lineterminator has changed from \n to \r\n. I don't know exactly how this affects things, but it seems better to avoid the change. I think I can see the logic in messytables that wasn't recreated here. It's also worrying is that this wasn't caught by the Python tests. Please can you do the following so we can make sure that no other similar changes happen unnoticed?

Make a new branch and PR from master
Add a method to the TestImportCSV class to check the options returned by parse_file. If possible, it should expect the most common option values by default, so tests only need to specify option values that differ from the norm.
Use the new method as much as possible in the CSV tests so that the option values are asserted and changes can be noticed.
Once that PR is merged, rebase/merge master into this PR branch. The updated tests should then fail.

Everytime that commit gets pushed, I get a fresh notification specifically of that comment in addition to the usual, and my personal setup makes it more difficult to clear than others.

Oh! Ok, sorry, now I get it, it's the mention in the commit, sorry, I'll remove it if I push it again!

Thank you! Are you happy for me to merge?

Sure! So I can proceed with the xsl(x) part without overloading this PR :)

BTW, did you find the opportunity to talk with the team about running Black on the code base ? :)


Can't start npm start because of missing joi package in core

@farisT I'm getting this error, so I can't run the server :-(

It looks like joi is deprecated! https://www.npmjs.com/package/joi

Resolved with version 1.1.0 of @liftr/core. Please update your version :)


As of 2017, the domestic cat was the second-most popular pet in the United States by number of pets owned, after freshwater fish,[14] with 95 million cats owned.[15][16] In the United Kingdom, around 7.3 million cats lived in more than 4.8 million households as of 2019.[17]

INHANDS AND TILES UPDATE

Updates tile.rsi by giving tiles inhands and separating a bunch of unused sprites into their own folder.
Material inhands
Removes plasma and adds Phoron
First pass of food inhands
Soda inhands
Flashlight Inhands
Beaker Inhands

Autolathes/Protolathes were broken when I made this pr via #1219 so I don't know if they work or not. They should.

Removes plasma and adds Phoron

cringe


Remove Requirement on getopt for Windows

As far as I can tell, getopt is only required for bin and test stuff, and not the basic library. For Windows code that wants to simply depend on the library and not all that other stuff, it'd be nice to get away without that dependency.

I have validated (here) that this unblocks Windows consumers of ls-qpack. It builds without vcpkg.


Overlapping MarkerCluster popups?

I use your application and it works very successfully.

Pop-up popups overlap as shown in the picture. Is there a solution for this?
I have one more question when clicking on a classification, the other clicked classifications are closed. Is it possible to open both by clicking?
Thank you.

Hi @doctor343434,
I am truly sorry as I realize that I failed to reply to your message in a timely manner... 😖
As for popups overlapping, this is a common limitation of Leaflet unfortunately. Nothing really specific to Leaflet.markercluster or this sub-plugin.
Regarding your 2nd question "when clicking on a classification, the other clicked classifications are closed", I am not sure I understand what you mean by "classification"? In case you refer to the "spiderfication" of Leaflet.markercluster, then I guess it is the same as this next question on another sub-plugin: https://github.com/ghybs/Leaflet.MarkerCluster.Freezable/issues/15

Hi @doctor343434,
I am truly sorry as I realize that I failed to reply to your message in a timely manner... 😖
As for popups overlapping, this is a common limitation of Leaflet unfortunately. Nothing really specific to Leaflet.markercluster or this sub-plugin.
Regarding your 2nd question "when clicking on a classification, the other clicked classifications are closed", I am not sure I understand what you mean by "classification"? In case you refer to the "spiderfication" of Leaflet.markercluster, then I guess it is the same as this next question on another sub-plugin: https://github.com/ghybs/Leaflet.MarkerCluster.Freezable/issues/15

Closing due to lack of activity.


Update enum serialization for UI and formatter

Updates the serialization format for TokenTree, Token, and Source for use in the VM user interface and Prettier plugin.
Deployed UI (includes a basic continuation source visualization)

The UI experience is wonderful.  It's so much nicer to use this way of inspecting the VM behavior compared with the raw terminal output (by 1000x).  I see that I need to help some edge cases, including the initial source info, where I punted and didn't try to combine and expand the top-level Dec_ source list.  I have a way to do that now.


qvim, vim_configurable: get rid of composableDerivation

Use stdenv.mkDerivation directly instead of composableDerivation.
Some configure flags may have changed as the conversion wasn't exactly
straightforward.

Please test this change. I am no user of this package. Will merge in a week from now.
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Fits CONTRIBUTING.md.

cc contributors @Ma27 @LnL7 @bjornfor @7c6f434c @vcunat

Success on x86_64-linux (full log)
Attempted: vim_configurable
Partial log (click to expand)
/nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146/share/vim/vim81/macros/less.sh: interpreter directive changed from "/bin/sh" to "/nix/store/z9qg7lpkrajdnlgw5pxp9yx984prl1fi-bash-4.4-p23/bin/sh"
/nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146/share/vim/vim81/tools/demoserver.py: interpreter directive changed from "/usr/bin/python" to "/nix/store/r99pik3abzrizbka8906ccs7vj837356-python-2.7.15/bin/python"
basename: invalid option -- 'w'
Try 'basename --help' for more information.
/nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146/share/vim/vim81/tools/vimspell.sh: interpreter directive changed from "/bin/sh" to "/nix/store/z9qg7lpkrajdnlgw5pxp9yx984prl1fi-bash-4.4-p23/bin/sh"
/nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146/share/vim/vim81/tools/ref: interpreter directive changed from "/bin/sh" to "/nix/store/z9qg7lpkrajdnlgw5pxp9yx984prl1fi-bash-4.4-p23/bin/sh"
/nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146/share/vim/vim81/tools/vimm: interpreter directive changed from "/bin/sh" to "/nix/store/z9qg7lpkrajdnlgw5pxp9yx984prl1fi-bash-4.4-p23/bin/sh"
/nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146/bin/vimtutor: interpreter directive changed from " /bin/sh" to "/nix/store/z9qg7lpkrajdnlgw5pxp9yx984prl1fi-bash-4.4-p23/bin/sh"
checking for references to /build in /nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146...
/nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146

Success on x86_64-darwin (full log)
Attempted: vim_configurable
Partial log (click to expand)
patching script interpreter paths in /nix/store/rdg9y2b5wqpqsi503idf5bfnq2665vsd-vim_configurable-8.1.0146
/nix/store/rdg9y2b5wqpqsi503idf5bfnq2665vsd-vim_configurable-8.1.0146/bin/vimtutor: interpreter directive changed from " /bin/sh" to "/nix/store/mdzgfbangzw62b6cb48dg0q83sxdy12y-bash-4.4-p23/bin/sh"
/nix/store/rdg9y2b5wqpqsi503idf5bfnq2665vsd-vim_configurable-8.1.0146/share/vim/vim81/macros/less.sh: interpreter directive changed from "/bin/sh" to "/nix/store/mdzgfbangzw62b6cb48dg0q83sxdy12y-bash-4.4-p23/bin/sh"
/nix/store/rdg9y2b5wqpqsi503idf5bfnq2665vsd-vim_configurable-8.1.0146/share/vim/vim81/tools/demoserver.py: interpreter directive changed from "/usr/bin/python" to "/nix/store/rr41xvzb7jsvbzh35waxmzhj2bbipgad-python-2.7.15/bin/python"
basename: invalid option -- 'w'
Try 'basename --help' for more information.
/nix/store/rdg9y2b5wqpqsi503idf5bfnq2665vsd-vim_configurable-8.1.0146/share/vim/vim81/tools/ref: interpreter directive changed from "/bin/sh" to "/nix/store/mdzgfbangzw62b6cb48dg0q83sxdy12y-bash-4.4-p23/bin/sh"
/nix/store/rdg9y2b5wqpqsi503idf5bfnq2665vsd-vim_configurable-8.1.0146/share/vim/vim81/tools/vimm: interpreter directive changed from "/bin/sh" to "/nix/store/mdzgfbangzw62b6cb48dg0q83sxdy12y-bash-4.4-p23/bin/sh"
/nix/store/rdg9y2b5wqpqsi503idf5bfnq2665vsd-vim_configurable-8.1.0146/share/vim/vim81/tools/vimspell.sh: interpreter directive changed from "/bin/sh" to "/nix/store/mdzgfbangzw62b6cb48dg0q83sxdy12y-bash-4.4-p23/bin/sh"
/nix/store/rdg9y2b5wqpqsi503idf5bfnq2665vsd-vim_configurable-8.1.0146

Success on aarch64-linux (full log)
Attempted: vim_configurable
Partial log (click to expand)
/nix/store/zx4x3awlz1i6j33hxwhykdppdidx109v-vim_configurable-8.1.0146/bin/vimtutor: interpreter directive changed from " /bin/sh" to "/nix/store/3swzdhnphnbxjcyx2bkk1gh9k8gi3kl6-bash-4.4-p23/bin/sh"
/nix/store/zx4x3awlz1i6j33hxwhykdppdidx109v-vim_configurable-8.1.0146/share/vim/vim81/tools/vimspell.sh: interpreter directive changed from "/bin/sh" to "/nix/store/3swzdhnphnbxjcyx2bkk1gh9k8gi3kl6-bash-4.4-p23/bin/sh"
/nix/store/zx4x3awlz1i6j33hxwhykdppdidx109v-vim_configurable-8.1.0146/share/vim/vim81/tools/vimm: interpreter directive changed from "/bin/sh" to "/nix/store/3swzdhnphnbxjcyx2bkk1gh9k8gi3kl6-bash-4.4-p23/bin/sh"
/nix/store/zx4x3awlz1i6j33hxwhykdppdidx109v-vim_configurable-8.1.0146/share/vim/vim81/tools/ref: interpreter directive changed from "/bin/sh" to "/nix/store/3swzdhnphnbxjcyx2bkk1gh9k8gi3kl6-bash-4.4-p23/bin/sh"
basename: invalid option -- 'w'
Try 'basename --help' for more information.
/nix/store/zx4x3awlz1i6j33hxwhykdppdidx109v-vim_configurable-8.1.0146/share/vim/vim81/tools/demoserver.py: interpreter directive changed from "/usr/bin/python" to "/nix/store/0bxsz2pw8n2f11lwwxwwbb8cdzaw2l9j-python-2.7.15/bin/python"
/nix/store/zx4x3awlz1i6j33hxwhykdppdidx109v-vim_configurable-8.1.0146/share/vim/vim81/macros/less.sh: interpreter directive changed from "/bin/sh" to "/nix/store/3swzdhnphnbxjcyx2bkk1gh9k8gi3kl6-bash-4.4-p23/bin/sh"
checking for references to /build in /nix/store/zx4x3awlz1i6j33hxwhykdppdidx109v-vim_configurable-8.1.0146...
/nix/store/zx4x3awlz1i6j33hxwhykdppdidx109v-vim_configurable-8.1.0146

Then only qvim is left that uses this obscure function.

@GrahamcOfBorg build vimNox ezquake vim_configurable vimHugeX vimPlugins.pluginnames2nix

Failure on x86_64-darwin (full log)
Attempted: vimNox, vim_configurable, vimHugeX, vimPlugins.pluginnames2nix
The following builds were skipped because they don't evaluate on x86_64-darwin: ezquake
Partial log (click to expand)
int     sigaltstack(const stack_t * __restrict, stack_t * __restrict)  __DARWIN_ALIAS(sigaltstack) __WATCHOS_PROHIBITED __TVOS_PROHIBITED;
        ^
1 warning and 1 error generated.
make[1]: *** [Makefile:2638: objects/os_unix.o] Error 1
make[1]: Leaving directory '/private/tmp/nix-build-vim_configurable-8.1.0146.drv-0/nix_repository_manager/src'
make: *** [Makefile:29: first] Error 2
builder for '/nix/store/0j4qkns37vlql4nfj6vrpkqigm839c4w-vim_configurable-8.1.0146.drv' failed with exit code 2
building '/nix/store/kcaa0b6fa0hs27mg5p3rpxzxplc78kwc-vimrc.drv'...
building '/nix/store/61l7k7axy495nrvl1q6m7y20jkkskwd3-vim-plugin-names-to-nix.drv'...
error: build of '/nix/store/0j4qkns37vlql4nfj6vrpkqigm839c4w-vim_configurable-8.1.0146.drv' failed

Success on x86_64-linux (full log)
Attempted: vimNox, ezquake, vim_configurable, vimHugeX, vimPlugins.pluginnames2nix
Partial log (click to expand)
./cd_linux.c
./com_msg.c
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/svfamhrk6kqralsdi8jnr4a2plsffyfp-ezquake-3.0.1
shrinking /nix/store/svfamhrk6kqralsdi8jnr4a2plsffyfp-ezquake-3.0.1/bin/ezquake
strip is /nix/store/90vmpr41dzsx350k5argycaf693hnl1l-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/svfamhrk6kqralsdi8jnr4a2plsffyfp-ezquake-3.0.1/bin
patching script interpreter paths in /nix/store/svfamhrk6kqralsdi8jnr4a2plsffyfp-ezquake-3.0.1
checking for references to /build in /nix/store/svfamhrk6kqralsdi8jnr4a2plsffyfp-ezquake-3.0.1...
building '/nix/store/g8m68w30jix2bakanx95qgg8d5iq914n-vim-plugin-names-to-nix.drv'...

Failure on aarch64-linux (full log)
Attempted: vimNox, ezquake, vim_configurable, vimHugeX, vimPlugins.pluginnames2nix
Partial log (click to expand)
                 from common.h:35,
                 from qwsvdef.h:26,
                 from pr_cmds.c:22:
/nix/store/ffq01cfahpgz03kvanhiipn3gkab7zxh-glibc-2.27-dev/include/bits/stdio2.h:64:10: note: '__builtin___snprintf_chk' output between 4 and 209 bytes into a destination of size 64
   return __builtin___snprintf_chk (__s, __n, __USE_FORTIFY_LEVEL - 1,
          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
        __bos (__s), __fmt, __va_arg_pack ());
        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
builder for '/nix/store/nndrinngaws9mzclimviql2cxaaaa0y1-ezquake-3.0.1.drv' failed with exit code 2
error: build of '/nix/store/nndrinngaws9mzclimviql2cxaaaa0y1-ezquake-3.0.1.drv' failed

@Mic92 don't forget php. That one is big...

I thought php and vim_configurable where the only remaining.

I've also added qvim to this PR. cc @ttuegel @grwlf
The expressions are quite similar, so it would also be good to afterwards get them more in line with each other.

Success on aarch64-linux (full log)
Attempted: vim_configurable
Partial log (click to expand)
/nix/store/zx4x3awlz1i6j33hxwhykdppdidx109v-vim_configurable-8.1.0146

Success on x86_64-linux (full log)
Attempted: vim_configurable
Partial log (click to expand)
/nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146/share/vim/vim81/macros/less.sh: interpreter directive changed from "/bin/sh" to "/nix/store/z9qg7lpkrajdnlgw5pxp9yx984prl1fi-bash-4.4-p23/bin/sh"
/nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146/share/vim/vim81/tools/vimm: interpreter directive changed from "/bin/sh" to "/nix/store/z9qg7lpkrajdnlgw5pxp9yx984prl1fi-bash-4.4-p23/bin/sh"
/nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146/share/vim/vim81/tools/ref: interpreter directive changed from "/bin/sh" to "/nix/store/z9qg7lpkrajdnlgw5pxp9yx984prl1fi-bash-4.4-p23/bin/sh"
/nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146/share/vim/vim81/tools/vimspell.sh: interpreter directive changed from "/bin/sh" to "/nix/store/z9qg7lpkrajdnlgw5pxp9yx984prl1fi-bash-4.4-p23/bin/sh"
basename: invalid option -- 'w'
Try 'basename --help' for more information.
/nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146/share/vim/vim81/tools/demoserver.py: interpreter directive changed from "/usr/bin/python" to "/nix/store/r99pik3abzrizbka8906ccs7vj837356-python-2.7.15/bin/python"
/nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146/bin/vimtutor: interpreter directive changed from " /bin/sh" to "/nix/store/z9qg7lpkrajdnlgw5pxp9yx984prl1fi-bash-4.4-p23/bin/sh"
checking for references to /build in /nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146...
/nix/store/sq3j6kfg31ymz5rpcjz0rcqwzpgl7n1l-vim_configurable-8.1.0146

Success on x86_64-darwin (full log)
Attempted: vim_configurable
Partial log (click to expand)
/nix/store/rdg9y2b5wqpqsi503idf5bfnq2665vsd-vim_configurable-8.1.0146


fix: fixed icon size

#227  👈
develop

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @bob-obringer and the rest of your teammates on  Graphite


Bug in listing all available subtitle tracks

Hi, I've discovered a bug in listing all available subtitle tracks for videos with more manually created transcripts with same language code. I'm using latest Python on latest Windows and PyCharm, but it does not care, with online services like repl.it is exactly the same.
Only as example, you can test with the following video Trump campaign sets sights on another deep-blue state and in general with all videos published on the Fox News channel, but the same for quite a few channels of broadcast networks, as they have all the following caption tracks:

You can run the below code:
from youtube_transcript_api import YouTubeTranscriptApi
subs = YouTubeTranscriptApi.list_transcripts('STjvfE4HVXY')
for sub in subs:
   print(f'code:<{sub.language_code}> auto:<{sub.is_generated}> lang:<{sub.language}>')

to obtain the next result:

This is the PyCharm debug view:

As you can see the track CC1 is missing from the list of tracks available for the video which I believe is not present as among the manually created tracks both track CC1 and track DTVCC1 have same language code 'en' which is used as the only key for the dictionary separated only for autogenerated and manually generated tracks. So given track CC1 - as shown below in the JSON extracted from the HTML video page - is listed first than track DTVCC1, the code saves CC1 in the dictionary with key 'en' among the manually generated tracks and when it later finds DTVCC1 with same code 'en' again in manually generated it overwrites CC1 which then no longer appears.
  "captions": {
    "playerCaptionsTracklistRenderer": {
      "captionTracks": [
        {
          "baseUrl": "...",
          "name": {
            "simpleText": "Inglese (generati automaticamente)"
          },
          "vssId": "a.en",
          "languageCode": "en",
          "kind": "asr",
          "isTranslatable": true,
          "trackName": ""
        },
        {
          "baseUrl": "...",
          "name": {
            "simpleText": "Inglese - CC1"
          },
          "vssId": ".en.uYU-mmqFLq8",
          "languageCode": "en",
          "isTranslatable": true,
          "trackName": "CC1"
        },
        {
          "baseUrl": "...",
          "name": {
            "simpleText": "Inglese - DTVCC1"
          },
          "vssId": ".en.JkeT_87f4cc",
          "languageCode": "en",
          "isTranslatable": true,
          "trackName": "DTVCC1"
        },
        {
          "baseUrl": "...",
          "name": {
            "simpleText": "Inglese (Stati Uniti)"
          },
          "vssId": ".en-US",
          "languageCode": "en-US",
          "isTranslatable": true,
          "trackName": ""
        }
      ],

This bug I believe can be solved by using 'trackName' as an addition to the dictionary tracks key so that keys such as 'en CC1' and 'en-DTVCC1' would no longer cause loss of tracks with same language code and both manually generated.
Thank you and let me know please.

Hi @Angel756984,
sorry for the late reply. This bug has already been reported and discussed in #150. While I agree that including the trackname in the key could provide a potential solution, I would consider this a breaking change, as track names would have to be included in the language code from that point on, which could potentially break existing code.


Statsd and multi imports

opening this as requested here by @nsano-rururu

Interesting idea of supporting multiple imports. I checked the docs and it has a blurb about this, in docs/source/ruletypes.rst (around line 248), which states only one import is supported. Should that be updated with this PR?

Interesting idea of supporting multiple imports. I checked the docs and it has a blurb about this, in docs/source/ruletypes.rst (around line 248), which states only one import is supported. Should that be updated with this PR?

good point, updated now


PATCH to update metadata of a file in DocumentLibrary results in 409 response; Code: resourceModified

Category

[ ] Question
[ ] Documentation issue
[x] Bug

Expected or Desired Behavior
I am using Microsoft Graph SDK to upload a file to SharePoint's DocumentLibrary (..DocumentSet) and then update the metadata.   The code used to upload and update metadata is as below,
var created = await _graphServiceClientFactory.GetClient().Drives[driveId].Root.ItemWithPath($"{id}/{fileName}").Content.Request().PutAsync<DriveItem>(stream);
if (created != null)
{
    await _graphServiceClientFactory.GetClient().Drives[driveId].Root.ItemWithPath($"{id}/{fileName}").ListItem.Fields.Request()
               .UpdateAsync(new FieldValueSet { AdditionalData = dataDictionary });
}

Since the call to update metadata happens only after successful response from the file upload the expectation is that the metadata to be updated successfully.  The metadata (part of dataDictionary) contains few of the custom fields.
Observed Behavior
The file upload works as expected, however once in a while updating metadata of a file fails with 409 error.  The error details returned on failed scenarios is below:

Code: resourceModified
Message: The resource has changed since the caller last read it; usually an eTag mismatch
Inner error:
AdditionalData:
date: 2020-12-16T16:00:05
request-id: 87b6fddb-eed0-4454-8550-5db28b919c29
client-request-id: 87b6fddb-eed0-4454-8550-5db28b919c29
ClientRequestId: 87b6fddb-eed0-4454-8550-5db28b919c29

Flow as observed in Application insight,

Additional information
The implementation described above is part of a middleware exposed as REST API's.
Thank you.

@spmanjunath are you making the same request to the same file concurrently?

@spmanjunath are you making the same request to the same file concurrently?

There are no concurrent requests.  The request for patch that does the metadata update happens only after the file upload (PUT) request is completed.

There are no concurrent requests.  The request for patch that does the metadata update happens only after the file upload (PUT) request is completed.

More information:  Since the issue appeared to be transient in nature, i retried the request using Polly, and across several tests the observation was that PATCH call was consistently failing.  Please note that the PATCH call is done sequentially i.e., after the success response from the PUT call (for file upload).  Although, retry seem to fix this issue, i am concerned on the frequency of PATCH failing, in my tests past 10 calls consistently displayed the below behaviour.
Note:  The second PATCH call below is a retry call using Polly.

More information:  Since the issue appeared to be transient in nature, i retried the request using Polly, and across several tests the observation was that PATCH call was consistently failing.  Please note that the PATCH call is done sequentially i.e., after the success response from the PUT call (for file upload).  Although, retry seem to fix this issue, i am concerned on the frequency of PATCH failing, in my tests past 10 calls consistently displayed the below behaviour.
Note:  The second PATCH call below is a retry call using Polly.

@spmanjunath is this still reproducing? like I mentioned in the other issue, there was a bug fix that went in that could have resolved this issue

I couldn't find a failed PATCH request that occurs immediately after the PUT (file upload) request - earlier PATCH requests were failing due to resourceModified (eTag) error .  It is difficult to conclude if the issue has been fixed as it was an intermittent issue, but from the current data it appears that it is no longer occurring.  Importantly, I am also noticing a different error, which i had not noticed earlier, this error too occurs immediately after the PUT (file upload), the error details are as below, not sure if it is result of the recent fix.
Code: timeout
Message: The request timed out.
 The operation was canceled. Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request.. The I/O operation has been aborted because of either a thread exit or an application request.

HostInstanceId | 1b0d0257-5b45-495e-ba11-1bd7af7c9931 |
-- | -- | --
InvocationId | 98d1dd9a-d133-46bd-a500-67ba6696a519 |
ProcessId | 6876 |
Category | Function.UploadFileWithMetadata |
LogLevel | Information |

@spmanjunath This issue should be fixed now, the new timeout error is unrelated

I have been noticing this issue again (not sure if it was resolved earlier), this error occurs intermittently after uploading of file is completed,

There are 4 retries, the first exception is '409 eTag mismatch', the next 2 is '504 Gateway timeout' response, the last is again the '409 etag mismatch'.  Across several calls the same set of errors are observed.  This seems to happen even in scenarios where there is only one call updating the file.  What could be contributing to this error?  Is this an issue in Microsoft graph?
Operation ID: 8ce787b083141a4aaf3d6389e4d2300f
eTag mismatch error:
Code: resourceModified
Message: The resource has changed since the caller last read it; usually an eTag mismatch
Inner error:
	AdditionalData:
	date: 2023-03-10T08:59:07
	request-id: 57a09998-6af2-4b42-9878-cfbce0fe80e8
	client-request-id: 57a09998-6af2-4b42-9878-cfbce0fe80e8
ClientRequestId: 57a09998-6af2-4b42-9878-cfbce0fe80e8


Compiling TypeScript on Windows fails

Moving forward without SASS I get the following:
Action failed to execute: java.io.IOException: CreateProcess(): %1 is not a valid Win32 application

C:\Users\gbown\Documents\bazel-angular\angular-bazel-example>bazel build src --verbose_failures
INFO: Found 1 target...
ERROR: C:/users/gbown/appdata/local/temp/bazel_gbown/afpn2gxi/external/build_bazel_rules_typescript/internal/tsc_wrapped/BUILD.bazel:26:1: Compiling TypeScript (devmode) @build
zel_rules_typescript//internal/tsc_wrapped:tsc_wrapped failed (Exit -1). Note: Remote connection/protocol failed with: execution failed: tsc failed: error executing command
cd C:/users/gbown/appdata/local/temp/_bazel_gbown/afpn2gxi/execroot/main
bazel-out/host/bin/external/build_bazel_rules_typescript/internal/tsc_wrapped/tsc -p bazel-out/host/bin/external/build_bazel_rules_typescript/internal/tsc_wrapped/tsc_wrapped_es5
sconfig.json.
Action failed to execute: java.io.IOException: CreateProcess(): %1 is not a valid Win32 application.
Target //src:src failed to build

Should be solved as part of https://github.com/bazelbuild/rules_nodejs/pull/24
It is currently failing with the same error:
http://ci.bazel.io/blue/organizations/jenkins/PR%2Frules_nodejs/detail/rules_nodejs/4/pipeline/19

Will resolve in #10


REQUEST: New Committer rights request for  aswinsuryan

GitHub Username
@aswinsuryan
Code you are requesting Committer rights for
lighthouse/*
Requirements

[x] I have reviewed the community membership guidelines (https://submariner-io.github.io/en/contributing/community-membership/)
[x] I have enabled 2FA on my GitHub account (https://github.com/settings/security)
[x] I have subscribed to the submariner-dev e-mail list (https://groups.google.com/forum/#!forum/submariner-dev)
[x] I have been actively contributing to Submariner for at least 3 months
[x] I have two sponsors that meet the sponsor requirements listed in the community membership guidelines
[x] I have spoken to my sponsors ahead of this application, and they have agreed to sponsor my application

Sponsors

@mangelajo
@tpantelis

List of required reviews to Submariner project PRs

At least 20 PRs to the relevant codebase that you reviewed
At least 5 PRs to the relevant codebase for which you were the primary reviewer
https://github.com/submariner-io/lighthouse/pulls?q=is%3Apr+reviewed-by%3Aaswinsuryan

This was taken care of a while ago.


put stock assessment data into one large filterable table

too many tables when split by watershed group.  being able to filter will be really helpful for more than just the watershed

@lucy-schick -  you could do this as per the method in nrp-vis-2024 . copy local gt interactive table function and replace all tables with just  1 (total) large filterable table somewhere appropriate in background.  Put into gitbook_on = TRUE chunk and put gitbook_on conditional statement for pdf pointing pdf user to online report.

got a draft that can be found here https://github.com/lucy-schick/fish_passage_skeena_2023_reporting/blob/final_memo/0200-background.Rmd#L227C1-L259C4
things that still need to be done/figured out:

change theme to match other tables, info here https://gt.rstudio.com/reference/data_color.html?q=themes#color-palette-access-from-paletteer
make column widths to match header widths, i think we can use this https://gt.rstudio.com/reference/cols_width.html?q=column wi#null
cross refencing still not working, should be possible, issue here tho https://github.com/rstudio/gt/issues/818

looks like total_return_to_river filter has us losing everything after 1997 so will remove that filter
caption provided with ltab_caption() function

okay nevermind I see whats going on now. The All Areas NuSEDS.csv in the Skeena repo had already been filtered to only contain waterbodies in the study area (this was done here http://htmlpreview.github.io/?https://github.com/NewGraphEnvironment/restoration_wedzin_kwa_2024/blob/main/memos/dfo_stock_assess.html) and then copied over.
I will redo this process for the fraser repo. Maybe we could rename All Areas NuSEDS.csv so its clear that it contains only the waterbodies in the study area?

Most important thing is not to try to commit an oversized file to GitHub as that can be a huge pain to deal with. Resizing the original file without renaming it is one way to not have a straggler file that can be accidentally committed. Obviously many ways to deal with the same issue though (.gitignore, script removing original download completely after filter/rename, store original file on cloud like aws vs locally, Etc) so as long as it is dealt with, clearly documented and consistent (not requiring custom name choice prone to errors every time)- renaming filtered file works.


Link to atomic design principles

It seems atomic design is a fundamental piece in the reasoning behind this framework. It would be beneficial IMO to have links to it in the readme where it makes sense to link to it. If not full links to atomic design, it might be useful to have a section in the readme outlining the main points?

That sounds like a very good idea :)

On 6 Apr 2020, at 09:12, Kerr Marin Miller<EMAIL_ADDRESS>wrote:
It seems atomic design is a fundamental piece in the reasoning behind this framework. It would be beneficial IMO to have links to it in the readme where it makes sense to link to it. If not full links to atomic design, it might be useful to have a section in the readme outlining the main points?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub https://github.com/design-ops/stylable-swiftui/issues/2, or unsubscribe https://github.com/notifications/unsubscribe-auth/AB4FSD737JCXORXPUZW4A63RLGFFFANCNFSM4MCBZWKA.


add empty op and fix passes error

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 2 committers have signed the CLA.:white_check_mark: max-niu:x: MyAngelAyaseYou have signed the CLA already but the status is still pending? Let us recheck it.


pod_mutator supports multiple injections; pod_mutator refactoring

DataIngest is another capability (alongside OneAgent) that can be injected to pods by webhook.
pod_mutator must be extended to support multiple injections.
Using this opportunity, some refactoring was done, too.
Changes

DataIngest is injected by default if OneAgent is injected
DataIngest injection can be explicitly disabled or enabled (so that it can be injected even if OneAgent is not) using annotation: data-ingest.dynatrace.com/inject=true|false
Annotation dynakube.dynatrace.com/injected now holds a lexical sorted, comma separated, list of injected capabilities intsead of "true"
pod_mutator.Handle() implementation simplified
init.sh supports both injections
new UT created: TestPodPartialInjection
existing UT aligned with changes

Just a general question:
I see a lot of methods that don't need to be methods because they don't use the struct they are the methods of.
Is there a reason for it ? Because it would make testing these 'methods' easier (not having to create a dummy struct) if they were not methods to begin with. :smile:
Or maybe storing more things in the struct that we have to pass into multiple methods would make these 'not-really-methods' make more sense (I kinda prefer the not-having-them-as-methods way but I'm not 100% decided on it :sweat_smile:)
(I didn't want to litter the PR with pointing out each 'not-really-a-method')

to get only data-ingest injected I have to create a dynakube that has some kind of application injection + data-ingest configured AND add the annotation on the pod to disable app injection ?

Just a general question: I see a lot of methods that don't need to be methods because they don't use the struct they are the methods of. Is there a reason for it ? Because it would make testing these 'methods' easier (not having to create a dummy struct) if they were not methods to begin with. smile Or maybe storing more things in the struct that we have to pass into multiple methods would make these 'not-really-methods' make more sense (I kinda prefer the not-having-them-as-methods way but I'm not 100% decided on it sweat_smile) (I didn't want to litter the PR with pointing out each 'not-really-a-method')

Ah, working on it - forgot to fix IDE suggestions.

to get only data-ingest injected I have to create a dynakube that has some kind of application injection + data-ingest configured AND add the annotation on the pod to disable app injection ?

dynakube should have applicationMonitoring or cloudNativeFullStack enabled. No need to mention data-ingest there.
AND
pods should be annotated:
annotations:
        oneagent.dynatrace.com/inject: "false"
        data-ingest.dynatrace.com/inject: "true"


Issue with "return self.results.get()" in "Processor().run()" causing processing to hang forever

Thank you for writing scrapyscript; it's been very helpful!
However, I have a script that looks something like the below, written in Python 3.5. I noticed that when I run Process().run() as below, the spider runs to completion, but hangs after the scrape is done (which causes my Celery 4 jobs to hang and never finish).
I verified that in the scrapyscript code, in the run() method, processing makes it through p.start(), p.join(), p.terminate(), but hangs on the return statement. I noticed that the return statement is looking up results in a Queue.  If I comment out the return statement (I personally don't care about the returned results), the processing finishes.
from scrapy.utils.project import get_project_settings

from scrapyscript import Job, Processor
from myproject.spiders.myspider import MySpider

scraper_args = dict(arg1="1", arg2="2")

config = get_project_settings()
spider = MySpider(**scraper_args)
# The api for scrapyscript requires us to pass in the
# scraper_args a second time. The constructor for the spider
# is called twice: once above and once again in the Job.
job = Job(spider, payload=scraper_args)
Processor(settings=config).run(job)

Impacted area:
https://github.com/jschnurr/scrapyscript/blob/master/scrapyscript.py#L118
(As an aside, I also overrode the init() method in my spider to accept arguments, but noticed that I have to pass in the custom arguments to both MySpider and as the payload, but maybe I should open a different ticket for that?)

+1

@JoeJasinski, I was not able to reproduce the problem. However, I've made some other changes based on your feedback; can you please review v1.0.0 and post a complete, non-working example if there is still an issue?

@jschnurr I have the same issue - scrapy job hangs forever on the process join line, here:
.env/lib/python3.6/site-packages/billiard/popen_fork.py in wait(self, timeout)
     55                     return None
     56             # This shouldn't block if wait() returned successfully.
---> 57             return self.poll(os.WNOHANG if timeout == 0.0 else 0)
     58         return self.returncode
     59

This happens only when I include creation of an HTMLParser for some reason, I assume that some memory is not being released or something.
Here's the offending code that makes the process hang:
def _parse_historical_data(self, response):
       data = response.xpath('//tr[@class="text-right"]').extract()
       hist_data = []
       if data:
           for item in data:
               p = HistoricalDataHTMLParser()
               p.feed(item)
               hist_data.append(p.tds)
               # p.close()
               # del p
       return hist_data

class HistoricalDataHTMLParser(HTMLParser):
   def __init__(self, *args, **kwargs):
       super().__init__(*args, **kwargs)
       self.in_td = False
       self.tds = []

   def handle_starttag(self, tag, attrs):
       if tag == 'td':
           self.in_td = True

   def handle_data(self, data):
       if self.in_td:
           self.tds.append(data.strip())

   def handle_endtag(self, tag):
       self.in_td = False

calling _parse_historical_data method causes the above hang. These close() and del lines aren't helping.
Note: I've had the same problem happen in another scraper, where some PDF parser was involved which uses the pdfminer.six library.

@vidakDK what were you trying to return?
This rather contrived example exhibits the same symptom; the spider runs to completion (logging INFO: Spider closed (finished), but never exits:
class TestBadSpider(Spider):
    name = 'badspider'

    def start_requests(self):
        yield scrapy.Request('http://www.python.org')

    def parse(self, response):
        return {'payload': response}

The same thing happens using Nosetests and Scrapyscript, but not with scrapy runspider.
What I don't understand is why we would ever get into this situation; why are you returning data bound to Scrapy objects?

Closed due to inactivity.

Well Scrapyscript combines the results of multiple calls into a single return object, which I then wanted to store in the database, in order to split up the scraping and database actions in the code.
However,  Scrapyscript was unable to end jobs when its response was tied to outside objects, so I added database storing logic to each call, and removed all data from "return" option of Scrapyscript.
I would either try to edit the logic of those twisted calls to be able to make some deep copies of data which would enable it to kill the process normally, or just remove the return functionality.

@jschnurr, @vidakDK
I can confirm this issue and also experienced that it has something to do with the size of the data that is returned by
processor.run(job)
I send all scraped data through a pipeline, which maps it to a database and then returns this converted data to the main process. If I remove the last return statement in my pipeline, the problem disappears.
In Addition, the problem only occurs, when I scrape bigger amounts of data. It seems to get critical(On my machine) when the size of returned data exceeds ~ 50000 bytes. This is a totally fine cause to fail, but it would be nice to get some Exception, if it happens.

@vidakDK this does seem to happen when data returned from Spiders is bound to Scrapy objects, as you suggested. As a simple example, returning scrapy.Item() objects from a basic Spider hangs, while returning a dict with the same data does not.
For now, I recommend returning dict from Spiders to workaround the problem.

Same problem here when I try to run from a Flask endpoint.
It hangs forever in Processor().run(), even when I try with/without returning values (dict) from the scraper.
As a standalone script, It works.

I have encountered the same problem as others here. I took a copy of the code and found that it hangs indefinitely either when enqueing results or dequeing results: e.g on self.results.put(self.items) or return self.results.get(). I have seen that this is code in billiard queues.
As others have noted it hangs either when a scrapy.Item or dict is returned from the parse method in scrapy. So @vidakDK the workaround you mentioned doesn't work in all situations. I think I saw a deadlock Exception in my IDE at somepoint, but I no longer see that and the code just hangs.
Also as noted above by someone it is something to do with the size of the data returned. There is a threshold data size below which the run completes irrespective of whether a scrapy item or dict is returned from the parse method.
One "workaround" which did work consistently for me when using scrapy items was to update the scrapyscript code to convert the item to a dict in the _item_scraped  method instead: self.items.append(dict(item)). The code does not hang with this change. Of course this change is not idea as the expected return type is being changed from a scrapy item to a dict.
No idea why the code does not hang with this change and does hang if a dict is returned directly from the parse method in scrapy. Maybe others have an idea what is going on? I feel that this is a critical defect and I'm surprised it hasn't been fixed for many years.

I just had a look at this again and think I've got a fix @vidakDK. The problem seems to be a deadlock. The python documentation states:
"that a process that has put items in a queue will wait before terminating until all the buffered items are fed by the “feeder” thread to the underlying pipe"
and further says:
"This means that whenever you use a queue you need to make sure that all items which have been put on the queue will eventually be removed before the process is joined"
and then gives the following example of a deadlock:
from multiprocessing import Process, Queue

def f(q):
    q.put('X' * 1000000)

if __name__ == '__main__':
    queue = Queue()
    p = Process(target=f, args=(queue,))
    p.start()
    p.join()                    # this deadlocks
    obj = queue.get()

See Joining processes that use queues.
This is the same situation that is in the run method code. Switching the code around to read like below allows the code to run to run to completion returning the results:
p = Process(target=self._crawl, args=[jobs])
p.start()
# p.join()
# p.terminate()

res = self.results.get()
p.join()
p.terminate()
return res

The code needs to be tested with multiple jobs as I was not looking at that scenario.
More information about the deadlock situation is given in the second pink box in the pipes and queues python documentation. It states an alternative way is to use a manager as one using this does not have the same problem.
As an aside, the data size issue seems like it is related to the size of the buffer as described in this stackoverflow thread.

@covuworie Could you provide a more detailed explanation about how to manage to make the code work? I have built a scraper for google patents in order to extract some fields, and when the description fileld is big I take the hang forever situation. My code is this:
`import logging
import scrapy
from scrapyscript import Job, Processor
processor = Processor(settings=None)
class PythonSpider(scrapy.spiders.Spider):
name = "myspider"
def start_requests(self):
    yield scrapy.Request(self.url)

def parse(self, response):
    data = str(''.join(response.xpath('//section[@itemprop="description"]/descendant::*/text()').getall()).replace('\n', '').replace('  ', '').strip())
    return {'title': data}

#for this https://patents.google.com/patent/EP2348838B1/en?oq=EP2348838B1 terminates normally
job = Job(PythonSpider, url="https://patents.google.com/patent/US20210272010A1/en?oq=US20210272010A1")
results = processor.run([job])
print(results)`

@christosmito I thought I had provided a detailed explanation already 😃. There are a few ways to fix this according to the python documentation so I didn't provide a pull request as @vidakDK may want to fix it in a different way.
The main issue is that all the items need to be removed from the queue before the process gets joined otherwise the code deadlocks. So the run method in __init__.py should actually read like this instead:
def run(self, jobs):
        """Start the Scrapy engine, and execute all jobs.  Return consolidated results
        in a single list.
        Parms:
          jobs ([Job]) - one or more Job objects to be processed.
        Returns:
          List of objects yielded by the spiders after all jobs have run.
        """
        if not isinstance(jobs, collections.abc.Iterable):
            jobs = [jobs]
        self.validate(jobs)

        p = Process(target=self._crawl, args=[jobs])
        p.start()
        res = self.results.get()  # This line has moved from the bottom of the method. This is the only change.
        p.join()
        p.terminate()

        return res

Take a copy of the code, try this change and see if it works in your scenario also. It worked for me with more complex scrapy Items (and even with simpler dicts) and a lot of data.

@covuworie I think you found the source of the problem and the easiest solution. Your idea also resolved my scenario, so I made a PR with your proposed change.

@vidakDK I was able to write a failing test based on your findings:
https://github.com/jschnurr/scrapyscript/blob/f6eb381c46239ed887fb3b4935cfaf016c7ebd76/tests/test_scrapyscript.py#L112
I'll merge your PR and update the package shortly.


bwd_bypass kernel is empty on AMD HW

I've been looking at the disassembly of the bwd_bypass kernel when run with MIOpen on AMD HW, and I'm noticing that the Bwd kernel for this run is empty:
(literally the entire program)
MIOpenNeuronBwd:
s_endpgm
I've checked the resultant code on multiple generations of AMD HW and multiple versions of MIOpen, and all of them are generating similar kernels.  Thus, I was wondering if this is intentional?  Is it really expected that the Bwd pass does nothing?
Thanks,
Matt

Wanted to ping you all about this again.
Matt

@mattsinc Sorry that I just saw your message. The bypass layer is just moving data from one place to another. It is originally used as a template to develop new layers. So it is doing nothing.
Hope this helps.
Shi

Hi @doody1986,
Thanks for getting back to me.  I don't know if I quite understand your response though.  I went through the OpenCL kernel that is being used to generate this kernel (MIOpen/src/kernels/MIOpenNeuron.cl). It turns out that every single #if and #elif will evaluate to false given the above environment variables for bwd_bypass. Given this, only the following lines of code will actually be used in the compilation:
    int x = get_global_id(0);
    _FLOAT_ bot_diff_data[MLO_READ_UNIT];
    _FLOAT_ top_diff_data[MLO_READ_UNIT];
    _FLOAT_ bot_data[MLO_READ_UNIT];
    _FLOAT_ top_data[MLO_READ_UNIT];

     for (int i = 0; i < MLO_READ_UNIT; ++i)
    {
            {
                top_diff_dat[i] = top_diff[dyOffset + x * MLO_READ_UNIT + i];
                bot_dat[i]      = bot_data[xOffset + x * MLO_READ_UNIT + i];
                top_dat[i]      = top_data[yOffset + x * MLO_READ_UNIT + i];
            }
    }
     for (int i = 0; i < MLO_READ_UNIT; ++i)
    {
         {
              bot_diff[dxOffset + x * MLO_READ_UNIT + i] = bot_diff_dat[i];
         }
    }

All of the above code is initializing arrays based on input args to the kernel. However, none of this code is used subsequently. Thus, my guess is that the compiler is optimizing out everything in the kernel, which explains why it's empty.
But your response indicates that that it should be moving data from one place to another -- if the code is being optimized out, that wouldn't happen.  Are you expecting that the arrays will be outputted?
Thanks,
Matt

@doody1986, wanted to ping you again about the above.

@mattsinc Thanks for pointing this out. Really appreciate! I went back to the code and figured it out. For the bypass layer when MIOpen is enabled, I use the activation function of MIOpen with a special flag indicating bypassing. You can refer to the link here for more information https://rocmsoftwareplatform.github.io/MIOpen/doc/html/activation.html#miopenactivationmode-t
The code you present must be corresponding to this part.
What I explained before is corresponding to the Nvidia implementation rather than the one for AMD, so it was not correct. Sorry about that. But when cuDNN is enabled, the copy actually happens.
I was expecting this layer to bypass the input data without any computations involved. The way AMD does seems like a bug, but if we think of it as an in-place bypass, it is exactly the behavior - doing nothing.
May I ask why this is bothering you?
Thanks
Shi

Hi @doody1986,
Thanks for getting back to me!  I had noticed this because the profiler was telling me the kernel used 0 vector registers ... which seemed implausible.  So I was trying to figure out how that was possible.  The above explanation is helpful in that regard.
So is there a next step from here?  Is it something wrong on your end?  Do I need to open a ticket with the MIOpen folks?  Is it just an optimization on the part of the MIOpen folks?
Thanks,
Matt

@mattsinc
Since I am just calling this API from MIOpen, there isn't too much things I can do in DNNMark and I am not quite familiar with their implementation detail for now.
If you think this part might affect your own work, then opening a ticket might be a good option. This is only my personal suggestion though. :)
Shi

@doody1986, thanks.  It doesn't really affect my work, but it does bother me that there are known problems with unknown solutions.  Anyways, will close.
Matt

FYI: https://github.com/ROCmSoftwarePlatform/MIOpen/issues/42


Linking only gets URL if app is already running

Description
I have successfully set up deep linking in my iOS app following the instructions in the docs, and if I put a custom URL into Safari, my running app gets focus again and receives the URL as expected.
However, if I double-tap the home button and swipe up on my app (to close it), then put my custom URL into Safari, my app launches but it doesn't get the URL.
I started with this in my Navigator:
componentWillMount() {
    Linking.addEventListener('url', (event) => this.handleLink(event.url));
}

componentWillUnmount() {
    Linking.removeEventListener('url', this.handleLink);
}

handleLink(url) {
    this._navigator.resetTo({name: Constants.EMAIL_LOGIN});
}

render() {
    return Navigator({
        initialRoute: {name: Constants.LAUNCH},
        ref: (component) => this._navigator = component,
        renderScene: (route, navigator) => {
            if (route.name === Constants.LAUNCH) {
                return React.createElement(LaunchView, {navigator: navigator});
            } else if (route.name === Constants.EMAIL_LOGIN) {
                return React.createElement(EmailLoginView, {navigator: navigator});
            }
        }
    });
}

When that didn't work, I thought maybe I needed to call Linking.getInitialURL()...
componentWillMount() {
    let url = Linking.getInitialURL().then((url) => {
        if (url) {
            this.handleLink(url);
        } else {
            console.log('Opened without a url...');
        }
    }).catch((err) => console.log('An error occurred:', err));
    Linking.addEventListener('url', (event) => this.handleLink(event.url));
}

...but it doesn't make a difference. Am I doing anything wrong? How can I get the URL when my app is not already running?
Reproduction
Obviously this cannot be reproduced on rnplay.org because it's not possible to add a custom URL scheme to the app's info.plist file.
Additional Information

React Native version: 0.37.0
Platform: iOS
Operating System: MacOS

To follow up, I also got linking working on my Android device; however my app never gets the URL, regardless of whether it was already running or not.

Turns out this is a duplicate of #11191. I'm not using universal links, but I got linking fully working in iOS and Android with the code in that bug.

hayy ,,
why Linking only gets URL if app is already running is closed ??
it is Solved

on IOS, app can recieve url scheme if application on foreground, this system protection from Airdrop.
this say's Guide Ios
"After transferring an eligible document to your app’s container, iOS launches your app (if needed) and calls the application:openURL:sourceApplication:annotation: method of its app delegate. If your app is in the foreground, you should use this method to open the file and display it to the user. If your app is in the background, you might decide only to note that the file is there so that you can open it later. Because files transferred via AirDrop are encrypted using data protection, you cannot open files unless the device is currently unlocked. "
reference : https://developer.apple.com/library/content/documentation/iPhone/Conceptual/iPhoneOSProgrammingGuide/Inter-AppCommunication/Inter-AppCommunication.html

it's still doesn't get the URL if application terminated just open application on iOS device.
why close this problem, are you any solved for this ?

Hi - I am having this problem too and not sure what you mean by with the code in that bug as the code you posted above seems to be the same as the solution in that bug?


⚠ Bofrost.lu has degraded performance

In 4a40fc2, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 1350 ms

Resolved: Bofrost.lu performance has improved in d9057ba after 312 days, 18 hours.


Added column layout to form auto template

Added column layout to form auto template,
added example for columns in form auto template,
updated form fields documentation,
optimized offset access in checkIfMoved() in w2utils

this didn't work as expected ... closing.


use flag -march=native may cause trouble

So I got 2 different instances, both CPU supports AVX2, I was expecting the shared library built from one instance can be used in another, however that's not the case. I was able to narrow the issue down to the -march=native flag: When replace it with -mavx2 -mpclmul it works perfectly in both instances. Just a note for anyone who may got same issue.

It is definitively the case that if you use the -march=native flag, then the resulting binary is not portable to other hardware. The flags you propose (-mavx2 -mpclmul) are better but note that if the hardware does not support AVX2, then you will likely get a crash. That's arguably a minor concern in 2022 since most x64 processors support AVX2.


[Bug Report] el-tree update default-checked-keys but view don't change properly

Element UI version
2.12.0
OS/Browsers version
macos10.14.6  / chrome78
Vue version
2.6.10
Reproduction Link
https://codepen.io/caaalabash/pen/gOORKWZ?editors=1111
Steps to reproduce

init data: default-checked-keys = [8]
try to update: default-checked-keys = []   or default-checked-keys = [1,2,3]
view don't change properly,  key 8 still be checked

What is Expected?
update default-checked-keys, only the newValue should be checked
    data: () => ({
     defaultCheckedKeys: [8]
    }),
    methods: {
      change() {
        console.log(this.$refs['tree'].getCheckedKeys()) // [8]
        this.defaultCheckedKeys = []
        this.$nextTick(() => {
          console.log(this.$refs['tree'].getCheckedKeys()) // [8]
        })
      },
    },

What is actually happening?
oldValue still be checked

you should use setCheckedNodes to set certain nodes to be checked.
        this.$refs.tree.setCheckedNodes([5, 9]);

@nile52 you are right


Fix Windows 'fs' issue on webpack

-- Added npm run build and npm run extract commands.
-- Added Japanese samples

Good stuff! One little suggestion re <option>, also I'd like to see if we can track down the fs/noParse stuff ... the smaller we can keep webpack.config.js, the better :smile:

Updated to fit the little nuances.

awesome, thx :+1:


Shortcut improvements

Is it possible to define shortcuts like:

cmd+k cmd+u (convert selection to uppercase)
cmd+k cmd+l (convert selection to lowercase)
cmd+l when selected multiple lines, create a cursor at the end of each line
ctrl+cmd+up(arrow) move selection up/down

What would be the best way to implement these, and if you don't mind I can make a PR for this?

@matejkramny You can write an extension for all of them using our API and Commands. Please refer here
https://code.visualstudio.com/docs/extensions/overview
https://code.visualstudio.com/docs/extensionAPI/overview

For lowercase and uppercase transformation you can use https://marketplace.visualstudio.com/items?itemName=florianloch.text-transform

Thanks! I'll have a look and write an extension.
I found the Microsoft/vscode-sublime-keybindings package but it doesn't cover these bindings.


respond('404'...) example on wiki broken

respond('404', function ($request) {
$page = $request->uri();
echo "Oops, it looks like $page doesn't exist..\n";
});
throws a uri() on non-object whereas the same code will work sans 404.

Fixed thanks to @abackstrom

Closing.


How to run the library in old browsers?

How to run the library in old browsers without BigInt support?

there is no way. the library specifically targets modern browsers, which represent 90% of all https://caniuse.com/bigint


guv not remove stopped processes from process list?

Not sure if this is a feature or not:
$ guv
PID  User Group Name    Uptime   Restarts CPU  RSS    Heap size Heap used Status  Type
5748 alan staff serv.js a minute 0        0.00 29.2MB 17.2MB    8.5MB     running Process
$ guv stop 5748
$ guv
PID User Group Name    Uptime Restarts CPU RSS Heap size Heap used Status  Type
?   alan staff serv.js ?      0        ?   ?   ?         ?         stopped Process
$ guv start serv.js
$ guv
PID  User Group Name    Uptime        Restarts CPU  RSS    Heap size Heap used Status  Type
?    alan staff serv.js ?             0        ?    ?      ?         ?         stopped Process
5990 alan staff serv.js a few seconds 0        0.00 29.4MB 17.2MB    7.9MB     running Process
$ guv stop 5990
$ guv
PID User Group Name    Uptime Restarts CPU RSS Heap size Heap used Status  Type
?   alan staff serv.js ?      0        ?   ?   ?         ?         stopped Process
?   alan staff serv.js ?      0        ?   ?   ?         ?         stopped Process

It's a feature, otherwise if you stop a process from the web interface it vanishes forever and I didn't want the CLI and web monitor to diverge too far in terms of behaviour.
You shouldn't get two processes with the same name though - should have been fixed in 3.1.x or thereabouts.  What version are you using?

3.3.5

Can I explicitly remove a process from the list?

guv remove processNameOrPid

Are you in the same directory as the serv.js file when you start it after it's been stopped?

Yes

That would be it then.

So, wait, is that ok?

Probably not, it should try to start the existing process instead of starting another.


[Feat] Zen Theater Mode - Non-Fullscreen fullscreen

I will try to work on this but I'm putting this here in case someone wants to give it a go as well.
It would be a feature that would make the theater mode view act as a tabbed full screen mode. Meaning that all the space in the tab (not screen) would be the video).

I'd suggest renaming this, something like Full Window mode or Zen Mode because there is a Theater mode already and it would cause confusion.

Yeah, the intent is to replace theater mode with this mode. (probably)

I'd highly advise against that. I use the current theater mode as is and prefer it over YouTube's default player. This extension is all about using YouTube in any way you want to, so taking away a feature to replace it with something else wouldn't really be wise.
Instead of replacing theater mode, implement this as a new one. Another new feature to make YouTube's experience more personal.

The thing is that you need some view to replace, you cannot simply create another view unless you can tie it to a key bind or something.

Well, why not tie it to a UI button in the extension's menu, in that case? Or even better, add that UI button straight in the video player next to the other view buttons.


bump golang.org/x/crypto dependency

sam.cheung in ~/rpm on branch bump_x_net > go test ./... ok  	github.com/cavaliergopher/rpm	(cached) ?   	github.com/cavaliergopher/rpm/cmd/rpmdump	[no test files] ?   	github.com/cavaliergopher/rpm/cmd/rpminfo	[no test files]


github integration not working with 1.4.0?

Hi @orhun, I realize github integration is currently experimental, but shouldn't this work? I'm using git-cliff 1.4.0.
$ GITHUB_TOKEN=$(gh auth token) git cliff --verbose -c config/cliff.toml --include-path "my-service/**"

I'm using  {% if commit.github.username %} (by [@{{ commit.github.username }}](<GITHUB>{{ commit.github.username }})) in my macro commit but the github integration is not getting picked up.
If I add the --github-repo user/repo args, I get the following:
error: unexpected argument '--github-repo' found

  tip: to pass '--github-repo' as a value, use '-- --github-repo'

Usage: git-cliff [FLAGS] [OPTIONS] [--] [RANGE]

The docs mention building from source but it sounds as if that's optional. Thoughts?

Hello!
The action is not using the git version of git-cliff - and I haven't released this feature.
You can install git-cliff from source to try it out in your workflow:
$ cargo install --git https://github.com/orhun/git-cliff git-cliff

$ git cliff --github-repo ...

Or please wait for the new release in a couple of weeks 🐻

Sounds good, thanks @orhun! I'll try it out locally and wait for the action to be updated with the new release.


Question: Running plugin in Gitlab CI/CD pipeline in a multimodule project

Question:
I would like to lint my entire multimodule kotlin project and add the linting results in file(s) on the Gitlab CI/CD pipeline (similar to adding unit test results). Currently, the job in the pipeline fails on the first module that has linting violations and does not continue (same behavior on the local command line), even though the failOnViolation configuration is set to false. What is the correct configuration to accomplish what I am trying to do? This is my current configuration, set in the parent pom of the modules in my project.
Current behavior:
Continues past modules with no linting errors. Lints modules with linting errors, prints linting violations to the console, fails the maven command, does not continue to subsequent modules. Does not produce file containing linting summary.
Even when I cd into a particular module and perform the linting command, a file containing the violations is not produced.
Hopeful behavior:
Lints all modules, even when failures occurs. Creates files containing the failures.
    <profiles>
        <profile>
            <id>linting</id>
            <build>
                <plugins>
                    <plugin>
                        <!-- Applies linting-->
                        <!-- run with command   mvn -Plinting com.github.gantsign.maven:ktlint-maven-plugin:1.16.0:check-->
                        <groupId>com.github.gantsign.maven</groupId>
                        <artifactId>ktlint-maven-plugin</artifactId>
                        <version>1.16.0</version>
                        <executions>
                            <execution>
                                <id>check</id>
                                <goals>
                                    <goal>check</goal>
                                </goals>
                                <configuration>
                                    <failOnViolation>false</failOnViolation>
                                    <reporters>
                                        <reporter>
                                            <name>plain</name>
                                            <output>${project.build.directory}/ktlint.txt</output>
                                            <properties>
                                                <property>
                                                    <name>group_by_file</name>
                                                    <value>true</value>
                                                </property>
                                            </properties>
                                        </reporter>
                                    </reporters>
                                </configuration>
                            </execution>
                        </executions>
                        <dependencies>
                            <dependency>
                                <groupId>com.segmint</groupId>
                                <artifactId>ktlint-rules</artifactId>
                                <version>1.0.0-SNAPSHOT</version>
                            </dependency>
                        </dependencies>
                    </plugin>
                </plugins>
            </build>
        </profile>
    </profiles>
    ```

Thank you!

Hi, @bnbalint. There is a test for the failOnViolation functionality and it does appear to be working https://github.com/gantsign/ktlint-maven-plugin/blob/main/src/it/checkstyle/pom.xml. Your configuration looks correct, but I noticed you have the linting config in a Maven profile, which isn't configured with activation. Perhaps the Maven profile isn't activated in your GitLab pipeline (https://maven.apache.org/guides/introduction/introduction-to-profiles.html)? Running mvn with -X should reveal what configuration is active at runtime.

Does the test handle a multimodule project? I think that is where the issue is coming in, since the behavior is also happening locally. Both local and in the pipeline, I run the plugin with: mvn -Plinting com.github.gantsign.maven:ktlint-maven-plugin:1.16.0:check to activate the profile. This is what the output looks like:
INFO] ------------------< com.segmint:springboot-hibernate >------------------
[INFO] Building springboot-hibernate 2.5.10_0-SNAPSHOT                   [7/23]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO]
[INFO] --- ktlint-maven-plugin:1.16.0:check (default-cli) @ springboot-hibernate ---
[ERROR] src/main/kotlin/com/segmint/hibernate/usertype/IntegerArrayUserType.kt:42:22: Usage of NotNullAssertion operator
[ERROR] src/main/kotlin/com/segmint/hibernate/usertype/DecimalArrayUserType.kt:43:22: Usage of NotNullAssertion operator
[ERROR] src/main/kotlin/com/segmint/hibernate/usertype/LongArrayUserType.kt:42:22: Usage of NotNullAssertion operator
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for springboot-reactor 2.5.10_0-SNAPSHOT:
[INFO]
[INFO] springboot-reactor ................................. SUCCESS [  0.435 s]
[INFO] config-poms ........................................ SUCCESS [  0.003 s]
[INFO] segmint-bom ........................................ SUCCESS [  0.001 s]
[INFO] springboot-kotlin-lib-starter ...................... SUCCESS [  0.119 s]
[INFO] gizmo .............................................. SUCCESS [  0.729 s]
[INFO] springboot-configs ................................. SUCCESS [  0.037 s]
[INFO] springboot-hibernate ............................... FAILURE [  0.101 s]
[INFO] springboot-metrics ................................. SKIPPED
[INFO] swagger-ui ......................................... SKIPPED
[INFO] springboot-swagger ................................. SKIPPED
[INFO] springboot-jdbi .................................... SKIPPED
[INFO] springboot-kafka ................................... SKIPPED
[INFO] springboot-client-util ............................. SKIPPED
[INFO] springboot-rest .................................... SKIPPED
[INFO] springboot-logging ................................. SKIPPED
[INFO] springboot-mail .................................... SKIPPED
[INFO] springboot-security ................................ SKIPPED
[INFO] springboot-security-core ........................... SKIPPED
[INFO] springboot-test .................................... SKIPPED
[INFO] springboot-redis ................................... SKIPPED
[INFO] springboot-event-consumer-starter .................. SKIPPED
[INFO] springboot-service-starter ......................... SKIPPED
[INFO] starters ........................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  1.643 s
[INFO] Finished at: 2023-06-05T08:59:36-07:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.github.gantsign.maven:ktlint-maven-plugin:1.16.0:check (default-cli) on project springboot-hibernate: Kotlin source failed ktlint check.

It executes the linting on the modules in order, but it fails when the first module fails the linting. Ideally I would like it to note the failure and then continue through the other modules so that I end up with a report of all of the linting failures for the entire mmp.

Running mvn -Plinting com.github.gantsign.maven:ktlint-maven-plugin:1.16.0:check will ignore your configuration under the execution as you're running the plugin, not that execution.
To run the execution you can run:
mvn -Plinting com.github.gantsign.maven:ktlint-maven-plugin:1.16.0:check@check (where @check is @ followed by the execution ID).
Alternatively, you could move the configuration directly under <plugin> so the configuration applies anytime the plugin is run (this can be problematic if you want a different config for check and format).
If that doesn't help run  mvn -X -Plinting com.github.gantsign.maven:ktlint-maven-plugin:1.16.0:check@check and provide the output between:
[DEBUG] Configuring mojo 'com.github.gantsign.maven:ktlint-maven-plugin:1.16.0:check' with basic configurator -->

and
[DEBUG] -- end configuration --

Oh perfect, thank you so much for the help! It was totally user error 🤦

No problem, happy to help


Potential (very unlikely) Overflow in WouldReadPastEnd

bool WouldReadPastEnd( int bits ) const
{
    return m_bitsRead + bits > m_numBits;
}

In WouldReadPastEnd it is possible to overflow the lhs of the comparison if a crafted packet gives an extremely large value for bits. This is pretty much impossible in the codebase as-is. The only place where the user can give a large bits value is serialise_string and only if the buffer_size parameter is unreasonably large.
However it seems that it's probably best to remove the potential overflow from WouldReadPastEnd.
Similarly bits is signed, so a negative number would also cause the same issues, however I think it's quite a lot easier to screw up an upper bound than it is to accidentally allow negative lengths though.
Something like the following would address both issues, provided I've not messed up along the way?
bool WouldReadPastEnd( unsigned bits ) const
{
    return bits > (unsigned)(m_numBits - m_bitsRead);
}

Thanks I'll take a look!

Um I think bits is only ever in the range [1,32].

I've thought this through. I don't think anything is required to fix it. The only codepath with a variable length bytes for the WouldReadPastEnd comes in from a serialize macro that already checks on read that the string size is within the buffer size, and will return false if it isn't, so a maliciously crafted packet could not be created to exploit this integer overflow.
I don't think anybody would ever intentionally try to serialize a string that is large enough to overflow signed integer on # of bits, so I'm closing this issue out. Nothing needs to be done.
Thanks for checking through the code though. I appreciate tips like this.


Installation on Windows fails to install win32api

Describe the bug
Installation on Windows does not install all required packages, it seems to be missing win32api.
When running the following simple code fragment:
from pandasgui import show

I get the following exception:
Traceback (most recent call last):
  File "C:\Users\admin.jonathan\Documents\tx-records\venv3.9\lib\site-packages\IPython\core\interactiveshell.py", line 3441, in run_code
    exec(code_obj, self.user_global_ns, self.user_ns)
  File "<ipython-input-6-488ae1300181>", line 1, in <module>
    from pandasgui import show
  File "C:\Program Files\JetBrains\PyCharm Community Edition 2020.3.4\plugins\python-ce\helpers\pydev\_pydev_bundle\pydev_import_hook.py", line 21, in do_import
    module = self._system_import(name, *args, **kwargs)
  File "C:\Users\admin.jonathan\Documents\tx-records\venv3.9\lib\site-packages\pandasgui\__init__.py", line 15, in <module>
    from pandasgui.gui import show
  File "C:\Program Files\JetBrains\PyCharm Community Edition 2020.3.4\plugins\python-ce\helpers\pydev\_pydev_bundle\pydev_import_hook.py", line 21, in do_import
    module = self._system_import(name, *args, **kwargs)
  File "C:\Users\admin.jonathan\Documents\tx-records\venv3.9\lib\site-packages\pandasgui\gui.py", line 17, in <module>
    from pandasgui.widgets.navigator import Navigator
  File "C:\Program Files\JetBrains\PyCharm Community Edition 2020.3.4\plugins\python-ce\helpers\pydev\_pydev_bundle\pydev_import_hook.py", line 21, in do_import
    module = self._system_import(name, *args, **kwargs)
  File "C:\Users\admin.jonathan\Documents\tx-records\venv3.9\lib\site-packages\pandasgui\widgets\navigator.py", line 18, in <module>
    import win32api
  File "C:\Program Files\JetBrains\PyCharm Community Edition 2020.3.4\plugins\python-ce\helpers\pydev\_pydev_bundle\pydev_import_hook.py", line 21, in do_import
    module = self._system_import(name, *args, **kwargs)
ModuleNotFoundError: No module named 'win32api'

Package seems not installed since the output of pip list | Select-String -Pattern "pywin32" is empty
When I explicitly install it manually it seems to work OK:
pip list | Select-String -Pattern "pywin32"

pywin32                           301

from pandasgui import show
Environment
OS: Windows Server 2019 10.0 (See PyCharm output)
Python:
sys.version
'3.9.7 (tags/v3.9.7:1016ef3, Aug 30 2021, 20:19:38) [MSC v.1929 64 bit (AMD64)]'

IDE: PyCharm
PyCharm 2021.2 (Community Edition)
Build #PC-212.4746.96, built on July 27, 2021
Runtime version: 11.0.11+9-b1504.13 amd64
VM: OpenJDK 64-Bit Server VM by JetBrains s.r.o.
Windows Server 2019 10.0
GC: G1 Young Generation, G1 Old Generation
Memory: 1024M
Cores: 2
Non-Bundled Plugins: com.andrey4623.rainbowcsv (2.0), com.chesterccw.excelreader (2.0.0), net.seesharpsoft.intellij.plugins.csv (2.17.1), org.sonarlint.idea (<IP_ADDRESS>150), ru.meanmail.plugin.requirements (2021.4.1-212), com.intellij.ideolog (<IP_ADDRESS>)

Package versions
Windows does not have bash, but this should yield the equivalent:
 pip list | Select-String -Pattern "pyqt|pandasgui|plotly|ipython|jupyter|notebook"

ipython                           7.27.0
pandasgui                         0.2.13
plotly                            5.3.1
PyQt5                             5.15.4
PyQt5-Qt5                         5.15.2
PyQt5-sip                         12.9.0
PyQtWebEngine                     5.15.4
PyQtWebEngine-Qt5                 5.15.2

Perhaps the solution can be as simple as adding the following to requirements.txt:
pywin32; platform_system=="Windows"
following the Environment Markers section in PEP 508.


Question: Updated typings

I'm looking at working with AJS as part of a new project and this project appears to be the only project that has any TypeScript definitions.
Is there a newer version of these definitions somewhere?
If not, do you have any information on how you went about generating the definitions?
Thanks!

Alright so I checked with our teams and this is the case: We currently use this package in most of our Atlassian server apps. Yes, they're sorta out of date, but nothing much changed. It was mostly new additions, and didn't get in the way. So that's why this repo wasn't updated much. I just created #2 to fix some inconveniences and once that's merged I'll push it to npm too.
In the mean time, if you want to contribute to this project (either with convenience features or additional typings), feel free to open a PR. Ideally also mention for which version of AJS those changes are. Further info in the README section Contributing. Since this repo has to account for versioning both external (AJS versions) and internal (patches on typings within a single AJS version), tagging and npm packaging is a little complex, so I'll continue to manage that for you.
As for generating typings, unfortunately that's a bunch of manual effort. Also the script we used to generate the existing typings may not work any longer. Here's how you do it: You'll want to use the generator-script.ts. You can build it by running npm run build. This will generate JavaScript which you can copy into the index.d.ts and manually change typings until they're correct or you're satisfied that they fulfill your requirements.
I suspect this being left relatively untouched for quite a while is partly due to this effort, and now with Atlassian having announced they're sunsetting their server applications, it's likely this repo will still not see a lot of love. If you're nonetheless interested in using ajs-type and run across further issues, do feel free to open further issues / PRs or contact me at jrost at seibert dash media dot com. Google Chat or simply e-mail.

Just realized I neglected to comment on this last week.
A belated thank you for the insights! :)


iOS testing account

create a test account for the iOS testing procedure

solved by switching urls depending on extension


💡 The EmailAddress type

📝 Description
Like suggested by @MichaelStH in #55, we would like to introduce a new EmailAddress type representing an email address on the Internet.
Here's the goal of API that we should provide after completing this topic:
interface EmailAddress {
    override fun equals(other: Any?):

The following issues are nice-to-have but not required for completing the minimum viable API of this type:

#595

See https://github.com/kotools/types/discussions/55#discussioncomment-8812680 for improving the API of this type.

A solution for providing the pattern used for validating an EmailAddress to Kotlin and Java is to declare it as a String instead of a Regex.
// Before
val EmailAddress.Companion.regex: Regex
// After
val EmailAddress.Regex.pattern: String

Another idea for improving this type is to make it comparable alphabetically like the NotBlankString type.

A better approach to validating email addresses is to use a simpler regular expression by default, like<EMAIL_ADDRESS>and to provide an overload of the factory functions accepting a customized regular expression.
For validating the customized regular expression, the trick is to check that the given pattern matches the default regular expression. If that's the case, then we should consider the customized regular expression valid.
<EMAIL_ADDRESS>// uses the default regular expression
<EMAIL_ADDRESS>Regex("^[a-z]+@[a-z]+\.[a-z]+$")) // uses the specified regular expression

For making the factory functions accepting a custom regular expression available on Kotlin and on Java, we could change their signature for accepting a custom pattern as Any. This way, these functions will use the string representation of the specified pattern as regular expression.
fun EmailAddress.Companion.create(text: String, pattern: Any): EmailAddress
fun EmailAddress.Companion.createOrNull(text: String, pattern: Any): EmailAddress?

[!IMPORTANT]
Due to the unique behavior of the Regex.toString() function on Kotlin/JS, it is recommended to use the Regex.pattern property instead.

Here are some examples of calling these functions from Kotlin code:
val regex =<EMAIL_ADDRESS><EMAIL_ADDRESS>regex.pattern) // passes
EmailAddress.create(" @kotools.org", regex.pattern) // fails

For hiding implementation details, an option is to remove the EmailAddress.Companion.regexPattern property from the public API, and indicate the pattern used for validating email addresses directly in the documentation of the factory functions.
Here's an example of documentation for the EmailAddress.Companion.create(String) function:
/**
 * Creates an email address from the specified [text], or throws an [IllegalArgumentException]
 * if the [text] doesn't match the following regular expression<EMAIL_ADDRESS> */
fun EmailAddress.Companion.create(text: String): EmailAddress = TODO()

For improving the consistency of our API, we could rename the text argument of the factory functions as value.
Here's an example for the EmailAddress.Companion.create(String) function:
fun EmailAddress.Companion.create(value: String): EmailAddress = TODO()

It may be interesting to mark the factory functions of this type with the JvmStatic function for improving their usage experience on Java.

Topics not being a single unit of work, we close this issue as stale.


Remove need to call passport.initialize()

This PR continues the work started in #848, completing the refactor away from using req._passport.
Following the patterns of other middleware, the HTTP request is now extended when it passes through authenticate() middleware, rather than initialize().  This removes the need to use passport.initialize() entirely, which simplifies the app-level middleware stack.  It should also make it easier to adapt Passport to non-Express web frameworks.

This shouldn't really be marked as a patch.
It has breaking changes and will break anybody that has it listed in the package.json with ^0.5.0 and show this error:
passport.initialize() middleware not in use

Can you provide details?  You shouldn't be getting that error, so there must be some other unexpected condition occurring.  I'm confident that there should be no breaking changes here.

To add to my rationale:  The error string you mention, "passport.initialize() middleware not in use", is only present in the passport package itself, prior to 0.5.1.  If you upgrade to the latest release, the error string has been removed (since passport.initialize() is no longer required).  If you are still seeing this error message, it suggests that you haven't updated to 0.5.1.  Perhaps a package-lock.json is pinning you to a prior release?

@RealDrewKlayman Can you provide a list of the strategies you use in your application?  As discussed in #877, passport-azure-ad pulls in an older version of passport, which can trigger this issue.  I'm working on a fix, but I'd like to assemble a list of strategies that require a compatibility layer.  Thanks!

I am working on the same project as @RealDrewKlayman. Our package.json had passport: "^0.5.0" (which resulted in<EMAIL_ADDRESS>being used according to npm list passport on the server), as well as<EMAIL_ADDRESS>which has a dependency of<EMAIL_ADDRESS>It's possible that some interaction between these caused the problem, but the problem was resolved by changing our package.json to passport: "0.5.0", which prevented<EMAIL_ADDRESS>from being installed on the server.
The project also includes<EMAIL_ADDRESS>and<EMAIL_ADDRESS>

@jaredhanson I just read through #877 and that does appear to be the same problem we're experiencing

Thanks for confirming @sonofole .  I've published<EMAIL_ADDRESS>which should resolve the issue.  Could you upgrade and confirm that works?

@jaredhanson Yes it appears to be working with 0.5.2, thanks for the quick fix!


removed unused dependencies

implements #51

Note: I opted to keep the joblib dependency.  It's pure python (low-overhead for install) and actually does a lot of non-trivial things for us in terms of exception handling.


corerad: 0.2.2 -> 0.2.3

Motivation for this change
New beta release of CoreRAD.
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Built and tested on NixOS:
[matt@routnerr-2:~/src/nixpkgs]$ nix-build -A corerad
these derivations will be built:
  /nix/store/3051m551fmdhyfcziqd0idp5qn6z2gnh-corerad-0.2.3.drv
building '/nix/store/3051m551fmdhyfcziqd0idp5qn6z2gnh-corerad-0.2.3.drv'...
unpacking sources
unpacking source archive /nix/store/sh1pnvwd3n4ani5kiy39n8aaaiih7rxw-source
[...]

[matt@routnerr-2:~/src/nixpkgs]$ ./result/bin/corerad -h
CoreRAD v0.2.3 BETA (2020-04-14)
flags:
  -c string
        path to configuration file (default "corerad.toml")
  -init
        write out a default configuration file to "corerad.toml" and exit

New timestamp magic number obtained from git log:
✔ ~/src/github.com/mdlayher/corerad [master|✔]
12:50 $ git log -1 --format=%ct v0.2.3
1586881022

/cc @jonringer @danderson

@GrahamcOfBorg test corerad


Test assertions are backwards

🤦♂
I generally don't use minitest and it looks like I got the assertions backwards. Currently I'm doing:
assert_equal actual, expected

but it should be
assert_equal expected, actual

I got it!


Bottom of AgGrid disappears - pagination and horizontal scrolling gone

Bottom of my AgGrid component disappears - I cannot use pagination nor scroll horizontally.

The code I am using is:
def AgGrid_with_display_rules(df):     gd = GridOptionsBuilder.from_dataframe(df)     gd.configure_pagination(enabled=False, paginationAutoPageSize=False, paginationPageSize=3)     gd.configure_default_column(editable=False, groupable=True)     gd.configure_selection(selection_mode='multiple', use_checkbox=True)     gridoptions = gd.build()     grid_table = AgGrid(df, gridOptions=gridoptions,                         update_mode=GridUpdateMode.SELECTION_CHANGED,                         height=400,                         allow_unsafe_jscode=True                         )     sel_row = grid_table["selected_rows"]     return grid_table, sel_row
And then I am calling the function with:
            with st.container():                 grid_table, sel_row = AgGrid_with_display_rules(df)                 sel_row_for_map = pd.DataFrame(sel_row)
I was hoping that st.container might resolve the issue, but not. Same problem with and without st.container. Also I don’t have any CSS that could be causing a problem.
I have also tried this: St-aggrid horizontal scroll bar disappears when I define a height - #9 by Egos but without success.
I am currently on AGgrid: 0.3.4.post3 - the 0.3.3 does cause my app to crash so I cannot downgrade.
I have also raised this on Streamlit Forum:
https://discuss.streamlit.io/t/bottom-of-aggrid-disappears-pagination-and-horizontal-scrolling-gone/49417
Will be grateful for any hints on how to handle this! Thanks.

someone posted the solution here  add custom_css={"#gridToolBar": {"padding-bottom": "0px !important"}}  in the aggrid build options

Thanks, that solves the problem!