Quadratic time to first iteration in Stencil code

I'm seeing quadratic time to complete the first iteration of the Stencil code. I've run this in a couple of configurations now, on Crusher and Cori Haswell, REALM_NETWORKS=mpi and REALM_NETWORKS=gasnetex.
Here's an example from a set of runs I did on Crusher. This is REALM_NETWORKS=gasnetex with a DEBUG=0 runtime, tracing, etc. The runs use 8 ranks per node but otherwise follow all our usual best practices and settings.

nodes
time to first iteration (seconds)

1
0.0862

2
0.1616

4
0.4364

8
1.4192

16
5.1646

32
16.5056

64
66.02

128
302.2614

Here are profiles at 8 and 16 nodes for comparison:

8 nodes (64 ranks): http://sapling.stanford.edu/~eslaught/crusher_startup_time_2022-08-30/legion_prof_8x8_r0
16 nodes (128 ranks): http://sapling.stanford.edu/~eslaught/crusher_startup_time_2022-08-30/legion_prof_16x8_r0

What sticks out to me about these profiles is that fill_ triggers a lot of Send Index Space Request on node 0.
Here's the region tree at 1 node (8 ranks): http://sapling.stanford.edu/~eslaught/crusher_startup_time_2022-08-30/region_graph.pdf
The region tree clearly shows that:

Every region tree has at least one distjoint/complete partition.
The specific partition used in the fill_ launch is disjoint and complete. You can tell because the only other partition of the region is aliased, and would be rejected by both Regent and Legion.

For posterity, here is the corresponding application code. If you scroll back, you can see that each direction region (x/y * p/m) is partitioned twice and the disjoint partition goes into the fill_ launch.
https://gitlab.com/StanfordLegion/legion/-/blob/crusher-freeze-repro-2-gasnet/language/examples/stencil_fast.rg#L646-657
This is the crusher-freeze-repro-2-gasnet branch, which is based on Legion version 7d6c32e1fe36707a7e6b054002ed6835a232194a.
Has there been a regression in Legion? I'm really surprised that this application would see this behavior.

This looks to me like someone has asked Legion to compute either the disjointness or the completeness of a partition in the logical dependence analysis on the other nodes (hence the need to do something quadratic and all the index space communications). If I had to bet, then I would say that the application information about the disjointness or completeness of a partition is not making it to Legion.

The application did not specify completeness, so you're right that Legion is computing it. I'm checking what impact this has now.

Was that the case before? If we know the partitions are disjoint then it's usually not hard to check completeness.

At the time this code was originally written, Regent did not support complete and incomplete annotations. As a hack, I marked one incomplete partition as aliased: this is very important for Regent's SCR optimization in order to optimize the initialization of the SCR copy-in phase. Even though we are using DCR and not SCR, the aliased annotation has stuck around.
However, I just tried using correct annotations (all partitions correctly marked disjoint and with complete or incomplete as appropriate). The startup time has not changed.
I can get a new set of profiles.

For posterity, the change: https://gitlab.com/StanfordLegion/legion/-/commit/daa728f9321127b9ff340ba76dc146ac8350f88a
I ran with -lg:partcheck when I was debugging this and I'm pretty sure it's working because I initially made a few mistakes, and the part check caught them.

It would be better to make a reproducer on sapling so we can actually poke at it at a smaller scale. The quadratic behavior should still be there just less noticeable without a profiler.

Here's a profile on 8 nodes on Crusher:
http://sapling.stanford.edu/~eslaught/crusher_startup_time_2022-08-30/legion_prof_8x8_r0_complete
The pattern actually looks different now. Instead of being triggered by fill_, it is now being triggered by stencil. I'll have to double check the application, but it may be that the application does not write to the complete partition of the main grid initially.

No, I was wrong. Even for the main grid the application uses the complete partition exclusively; the incomplete partitions are only used for their bounds and are not used as region requirements anywhere in the code.
I'll get the reproducer on Sapling next.

If you go to /scratch2/eslaught/legion_compute/language/stencil.run1_cpu_complete there is a binary built against the crusher-freeze-repro-2-gasnet branch. You can run it with a command like:
salloc -N 1 -p gpu --exclusive
LD_LIBRARY_PATH=$PWD mpirun -n 2 ./stencil.idx -nx 2000 -ny 2000 -ntx 4 -nty 4 -tsteps 50 -tprune 30 -hl:sched 1024 -ll:cpu 4 -ll:util 1 -ll:bgwork 2 -ll:csize 15000  -ll:rsize 512

Feel free to change the -ntx and -nty depending on how many subregions you want to create.
If you want to rebuild, go to /scratch2/eslaught/legion_compute/language and run:
srun -N 1 -p gpu --exclusive --pty bash --login # to get on a compute node
CMAKE_PREFIX_PATH=/scratch2/eslaught/sw/llvm/llvm-11/install_g_nodes GASNET=$PWD/gasnet/release ./install.py --gasnet
./pldi22_scripts/build_stencil_cpu.sh stencil.run1_cpu_complete # choose a new directory for this so it doesn't conflict

This is a debug build?

No, do you want that?

If you do, you can either rebuilt (the install.py line, and add --debug), or let me know and I can do it.

If you can do it, then please do so and I'll look at it later today.

You can find it here: /scratch2/eslaught/legion_compute/language/stencil.run1_cpu_debug

I don't think this is a regression. If it is you'll need to point me at an earlier commit where it was performing better.
Here is what is happening: a partition is being made in a non-control-replicated task (e.g. not the top-level task). This partition has as many subspaces as there are processors. However, because it is made in a leaf task running on just one node, all of it's subregions are made on just one node (node 0). Now, when we get back to the top-level task and issue the fill_ index task that is projecting over this newly created partition that was returned up the tree. Legion sees that it needs to issue a refinement operation to make the equivalence sets for this field of the region tree because it's never been used before. Legion attempts to shard these equivalence sets because the refinement is being done in a control replicated context and we want them to be distributed (all good). Now we hit the problem: all the index spaces for the partition have been made on node 0, so all the nodes start hammering node 0 asking for the specific subspaces that they need, and as you scale up, node 0 becomes a sequential bottleneck trying to distribute these subspaces out to all the nodes to make the equivalence sets. Moral of the story for the moment: make big partitions in control-replicated tasks, or control-replicate more levels of the task-tree (probably could use an important optimization here to make this more efficient if the parent task is also control replicated, but it should work alright).

I modified the application to __demand(__inline) the partition tasks. It required some Regent changes that I'll have to upstream. But in the crusher-freeze-repro-2-gasnet this appears to be fixed.

The optimization I had planned for this is not actually safe, so I'm not going to do it. Mentioning #481 as an example of a case where the profiler might be able to be smarter and decode the performance bug.


Implement RNG property

Per-cell RNG would be in common use for many Xentica models in future. So we have to implement a property yielding random value each time it is accessed. The property should have an interface allowing to draw the next value from different distributions, at least uniform, normal and binomial for 0.2.

The property is implemented and working well with uniform distribution, that is all we need for EvoLife. Let improve it (other distributions etc.) in other issues.


templates: Add internationalization.

This PR adds internationalization to the following files:

view_all_subscribers.hbs
view_all_users.hbs
web/templates/draft_table_body.hbs is missing a tag on "Other drafts"
web/templates/login_to_view_image_button.hbs
web/templates/settings/add_new_bot_form.hbs and web/templates/settings/edit_bot_form.hbs: "Avatar" is missing a translation tag.
web/templates/settings/admin_emoji_list.hbs, "Unknown author" is missing a translation tag.

Screenshots and screen captures:

Self-review checklist

[ ] Self-reviewed the changes for clarity and maintainability
(variable names, code reuse, readability, etc.).

Communicate decisions, questions, and potential concerns.

[ ] Explains differences from previous plans (e.g., issue description).
[ ] Highlights technical choices and bugs encountered.
[ ] Calls out remaining decisions and concerns.
[ ] Automated tests verify logic where appropriate.

Individual commits are ready for review (see commit discipline).

[ ] Each commit is a coherent idea.
[ ] Commit message(s) explain reasoning and motivation for changes.

Completed manual review and testing of the following:

[ ] Visual appearance of the changes.
[ ] Responsiveness and internationalization.
[ ] Strings and tooltips.
[ ] End-to-end functionality of buttons, interactions and flows.
[ ] Corner cases, error conditions, and easily imagined bugs.

I didn't like the commit messages, so squashed these and wrote a better one describing the situation, since it felt like a reasonable commit in that form as well.
In particular, generally you should never spend your commit message description listing file names that were changed; that information is obvious from the diff itself, so it just adds extra words to read.
Merged, thanks for noticing the first of these and fixing the rest @kuv2707!


[WIP] Java duration (#694)

Thanks for your pull request.  Please review the following guidelines.

[x] Title includes issue id.
[x] Description of the change added.
[ ] Commits are squashed.
[ ] Tests added.
[x] Documentation added/updated.
[x] Also please review CONTRIBUTING.md.

It's still WIP, but I want to discuss some of the changes.

The time display in milliseconds is a little disturbing to me. Let me think it over and see what I can do. Otherwise I'm all good with this PR.

Looks like there is a good amount of merge conflict with the previously approved PR on Scala 2.11 support. Pulling code down and fixing those conflicts.


Download gif for github readme

Hi, I want to add a GIF to my readme that shows how the binary search algorithm works, is anybody know a website where I can find gifs like this and download them?

Look for a short/clip on YouTube
Speed it up a little if need to
Convert to gif - there are various convertors online

Hi, I want to add a GIF to my readme that shows how the binary search algorithm works, is anybody know a website where I can find gifs like this and download them?

Look for a short/clip on YouTube
Speed it up a little if need to
Convert to gif - there are various convertors online

thanks


how to print output with pretty json

i like this extensions but could you add --prettyjson ?
thanks

I don't think the json format feature should be included in this package.
The users can use different tech to format the json string.
For me, I use Emacs package: gongo/json-reformat to reformat result.
There're many methods to reformat the json string, but it depends which tool the developer used.

I see good idea for custom json output, thanks for quick response...

You're very welcome.


i f*** up i need help

ok so i couldn't start the tapeworm job and i didnt know that they changed it to start with honaka so i played with the console code and added the debugs and now when i finish the main missions ecsept takemora she did not call me for the first time ( first call with her) like she did before in thelast save before the debug codes
because i started the save befor her call to see if the tapeworm will start like in 2020
when you puke but they changed it and now hanako wont call me

For end use support please ask on discord.


DISPLAY_SWAP_BGR was not swapping colours, according to pg 192 of (In…

…terface Control), MADCTL is set to XOR of IFCTL and MADCTL, setting 0 to IFCTL before MADCTL is set to ensure passed MADCTL byte is set.
Was having issues with BGR colours on my Pi Zero and generic ILI9341, I believe this is the root of the issue. Fixed it for me.

Thanks for the contribution. It is odd that toggling MADCTL_BGR_PIXEL_ORDER did not invert BGR, because like the spec says, it is treated as an XOR of the bit value. Then passing either 0 or 1 should cause a flipped value.
If this PR works, it seems as if the result is more like a NAND ratherthan XOR, i.e. a ~IFCTL & MADCTL instead of IFCTL ^ MADCTL?
Without this PR, did both enabled and disabled cases of DISPLAY_SWAP_BGR produce the same wrong colors?

I will have it another test over the weekend. My guess was that IFCTL was not always zero'd out when setting MADCTL.


Generate fixture dbs on azure

@WilliamHPNielsen

@WilliamHPNielsen it looks like test_perform_actual_upgrade_1_to_2 is always skipped even on travis?

@jenshnielsen, that makes sense, since generate_version_1.py must be run to generate a .db-file for that test to consume. Seems like I forgot to add that before merging #1277
It would be good to add that here, also for Travis.

@WilliamHPNielsen done and the tests still pass :)


Unable to set a custom night style for navigation map

In the current version, 0.0.18, you can only customise the map's day style. The night style will always be Mapbox's own style. This is a problem for me because I want to use my own style all the time. Currently my own map style will only be used between sunrise and sunset — which, in the winter at 64°N, is not that long ;)
In the iOS code, line 205 in SwiftFlutterMapboxNavigationPlugin.swift only includes the custom style in the day style:
NavigationOptions(styles: [CustomDayStyle(url: strongSelf._mapStyleURL), CustomNightStyle()])

I didn't manage to track down the equivalent Kotlin code, so I'm not sure if there's the same problem there.
I'd like to see the map style be included in the night style (CustomNightStyle(url: strongSelf._mapStyleURL)), although there's also a case for being able to set two styles, night and day.

Wait, a minute ! You're able to set a custom map style ?!  Do you have a public style that I can try using ?

I've only tried this out on the iOS simulator, while the comments on #87 are focused on Android. Having said that, yes, it works for me (see screenshot). The style I'm using covers Iceland only and isn't for commercial use, but feel free to use it to test this: https://tiles.ja.is/vector/styles/v3/ja-streets/ja-streets.json.

😔 Still crashes...thanks though.
However, out of curiosity, was this particular style made in mapbox style editor and then hosted on an nginx server ? Because the url doesn't start with mapbox, as compared to mine mapbox://styles/pransypansy/ckenyljlg06xs19ppveli6bgf

Correct. I actually wrote this style by hand in a code editor instead of using Mapbox's tools. You can see it in action at ja.is/kort. It's still in the Mapbox Style Spec format and we still use Mapbox GL JS to render it in the browser, but we host it — and our custom vector tile data — on our own servers.
The mapbox:// schema is a mock schema that's really just shorthand for a real https:// URL. Mapbox perhaps use it for some optimistions somewhere in their libraries.

Much thanks ! Hopefully when I get to college they'll teach me all that !

You can now set Day and Night MapStyleUrl in v 0.0.19

Thanks for looking into this @eopeter. Looking at commit c24b1356 though, it seems you can only set the night style for Android, not for iOS. Am I right to say that in the Swift code it's still fixed to Mapbox's night style?

This is corrected sand published to pubspec.

On Dec 14, 2020, at 8:48 AM, Matt Riggott<EMAIL_ADDRESS>wrote:

Thanks for looking into this @eopeter. Looking at commit c24b1356 though, it seems you can only set the night style for Android, not for iOS. Am I right to say that in the Swift code it's still fixed to Mapbox's night style?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.


add tests

resolves #23

I think #23 requires much more than this. But it's good to get started.

Seems I cannot dismiss the linked issue.

I think #23 requires much more than this. But it's good to get started.

Yeah I'm working on more commits. :)

I'm working on monkey patching ModelzClient.inference, will push when it passes tests on my machine.


Fix spawn fallback

Note that using unittest.mock doesn't fix the env in the subprocess.
For eg:
import unittest.mock
import os
import subprocess
with unittest.mock.patch('os.environ', {"FOO": "bar"}):
     print(os.environ["FOO"])
     subprocess.check_call("echo FOO=$FOO", shell=True)

outputs
bar
FOO=

What is the issue this change is attempting to fix?

env variable has changes to PATH that is ignored because of the way mock.patch worked. This made code depending on numpy fail. See the linked issue above.

Has this code ever worked?

This code worked before https://github.com/pypa/distutils/commit/360aadc4c2a9941a68a3f3f63375ce5380fef6a0, but when the fallback was introduced in 6e92cdabaff71ab2bab3300763101fb8f84c367f, this stopped working.

Reading through the issue reported in Numpy, the fix for #15 was incomplete (did not have the intended effect), but no one noticed because SETUPTOOLS_USE_DISTUTILS=stdlib became the default again... until earlier this week when the local copy of distutils was reintroduced by default.

Yep. Another reason is that for this issue to appear you need to have an environment without Visual Studio tools activated which is something done in most CI scripts and the lack of a PATH update doesn't matter.

Using the example, it seems that patch.dict works as expected:
import unittest.mock
import os
import subprocess
with unittest.mock.patch.dict(os.environ, {"FOO": "bar"}):
    print(os.environ["FOO"])
    subprocess.check_call("echo FOO=$FOO", shell=True)

outputs
bar
FOO=bar

Thanks


chore(main): release 1.3.7

:robot: I have created a release beep boop
1.3.7 (2023-03-30)
Performance Improvements

添加exceptionHandling优化代码提升性能 (1fa5b45)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/School-of-Website-Engineering/future-front-end/releases/tag/v1.3.7 :sunflower:


Fix compatibility with OSX 10.8 Mountain Lion and Ruby 1.8.7

cmd/brew-services.rb:183: syntax error, unexpected '.', expecting kEND
        .map { |formula|  Service.new(formula) }
         ^
cmd/brew-services.rb:184: syntax error, unexpected '.', expecting kEND
        .select { |service|  service.plist?  }
         ^
cmd/brew-services.rb:185: syntax error, unexpected '.', expecting kEND
        .map { |service|
         ^

Thanks for the fix.


Green Theme

I have added green theme and made some changes in the color codes for a better look of the site.

changes made in repo for better design


Storybook missing some controls

There are some controls missing in the storybook and sometimes also the properties are not complete.
It would be nice if we can see all properties and controls for every component
For example the panel has no controls

The controls for pd-panel and pd-slider are now all in the storybook.


Ignored files are not ignored when using --staged or explicitly specified in CLI

Environment information
CLI:
  Version:                      1.8.3
  Color support:                true

Platform:
  CPU Architecture:             aarch64
  OS:                           macos

Environment:
  BIOME_LOG_DIR:                unset
  NO_COLOR:                     unset
  TERM:                         "xterm-256color"
  JS_RUNTIME_VERSION:           unset
  JS_RUNTIME_NAME:              unset
  NODE_PACKAGE_MANAGER:         unset

Biome Configuration:
  Status:                       Loaded successfully
  Formatter disabled:           false
  Linter disabled:              false
  Organize imports disabled:    false
  VCS disabled:                 false

Workspace:
  Open Documents:               0

What happened?
Files specified in the Biome configuration's "ignore" list are still being linted when:

Using the --staged flag
Explicitly specifying the file in the CLI command

This behavior occurs even when VCS is enabled in the Biome configuration. The ignored files are not present in the .gitignore file.
Steps to reproduce:

Set up a project with Biome.js
Create a biome.json configuration file with the following "ignore" setting:{
    "files": {
        "ignore": [
            "file.ts",
            "other_file.js"
        ]
    }
}

Create the files specified in the "ignore" list (file.ts and other_file.js)
Run biome check --staged
Run biome check file.ts
Observe that the ignored files are still being linted

Expected result
Files specified in the "ignore" list should be ignored in all scenarios, including:

When using the --staged flag
When explicitly specifying the file in the CLI command

The current behavior makes it difficult to use Biome with external tools like lefthook, Husky or in custom scripts. Ignoring specific file is a critical feature when using GraphQL or other tool that will create auto-generated files.
Possible solution:

Ensure that ignored files are consistently skipped in all scenarios, including when using --staged or specifying files directly in the CLI.
Consider implementing an --include-ignored flag for cases where users explicitly want to lint ignored files.

Code of Conduct

[X] I agree to follow Biome's Code of Conduct

I'm not too sure about evaluating ignores when files are explicitly provided via cli args. As a user, I would expect all files provided via cli args to be processed, regardless of ignores because I explicitly pointed biome to the file.
Doing this for --staged definitely makes sense though.

Thank you for your prompt attention to this issue. I appreciate your perspective on how CLI arguments might be interpreted.
While I understand the logic behind processing explicitly provided files, this approach can lead to unexpected behavior, especially when integrating Biome with other tools or scripts. Consistent handling of ignored files across all scenarios would provide several benefits:
Consistency: It's easier to reason about and maintain a system where ignore rules are always respected.
Unintended consequences: Tools like lefthook, husky, custom scripts, or other use case often rely on consistent behavior, including respects for ignores.
I agree that addressing this for --staged is crucial. Considering an optional --include-ignored flag for cases where users want to override ignore rules is the only option giving consistency by maintaining expected behavior without unintended consequences while offering flexibility when needed.
Very interested to also have others opinion, @ematipico what do you think of it?

Based on your reproduction, that's the expected behaviour because ignoring files from VCS is an opt-in operation. However, from the rage summary, I can see that's enabled. Can you please update your instructions?

Update: I've identified the root cause while reproducing the issue in a monorepo setup like ours.

The issue occurs when biome.json is at the root level, but the command is run in a subfolder where the package is installed.
File paths in biome.json are interpreted relative to the command execution location, not the JSON file location.
The ignore functionality itself works as expected, correctly ignoring specified files.

The main problem:
Relative paths in biome.json don't work as expected when the config is not in the same directory as the command execution. This is particularly problematic for monorepo architectures.
Reproduction:
I've created a minimal reproduction in a CodeSandbox: https://codesandbox.io/p/devbox/adoring-wilbur-dxckdw?file=%2Fbiome.json%3A19%2C3
To reproduce:

Open the CodeSandbox
Run npx biome check --staged in the terminal

Expected behavior:
Biome should interpret paths in biome.json relative to the config file's location, ensuring consistent behavior across monorepo subfolders.
This issue mainly impacts monorepo setups and needs addressing for better usability in complex project structures.

Relative paths in biome.json don't work as expected when the config is not in the same directory as the command execution.

That's the expected way, we document this: https://biomejs.dev/guides/configure-biome/#ignore-files

Biome resolves the globs relatively from the working directory. The working directory is the directory where you usually run a CLI command. This means that you have to place particular attention when the configuration file is placed in a different directory from where you execute your command. In the case of an editor (LSP) the working directory is the root directory of your project.


Development

Codecov Report
Attention: Patch coverage is 96.00000% with 1 line in your changes missing coverage. Please review.

Project coverage is 99.35%. Comparing base (7baf9a8) to head (a1f7840).

Files
Patch %
Lines

src/estimators.jl
92.85%
1 Missing :warning:

Additional details and impacted files
@@            Coverage Diff             @@
##             main      #66      +/-   ##
==========================================
- Coverage   99.69%   99.35%   -0.35%
==========================================
  Files          10        9       -1
  Lines         663      618      -45
==========================================
- Hits          661      614      -47
- Misses          2        4       +2

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Hello, I am very interested in your work. Could you please tell me if you will be updating the repository later?

Hi there, thanks for being interested in my work. I'll update the code repo within the next 2 weeks, please check back later!


Add charging point info in outputs

This adds the column use_case to the vehicle output csv, as well as an option for a regional combined output csv by usecase.
The former can be tested by running any scenario, the latter requires changing the config option grid_timeseries_by_usecase to true.
Availability of private work or home charging infrastructure is randomly (according to config options private_charging_home and
private_charging_work) determined once per car.

This PR closes #33


bug: Image gallery swipe buttons look incorrect on small images

Describe the bug
Uploading multiple images of which one or more are small results in styling issues.

To Reproduce
Steps to reproduce the behavior:

Go to https://getstream.io/chat/demos/messaging/
Go to https://picsum.photos/100.jpg to get 2+ random images of 100w/100h
Download these images
Upload these images to the demo app.
Click on the image to open the GalleryModal
Notice the styling issues

Expected behavior
The GalleryModal to be useable by users when they try to view small images.
Package version

stream-chat-react: 10.6.0
stream-chat-css: 3.9.0
stream-chat-js: 8.3.0

Desktop (please complete the following information):

OS: Windows
Browser Chrome
Version 109

This is a copy of issue: https://github.com/GetStream/stream-chat-react/issues/1943


Support non-equijoin predicate for EliminateCrossJoin #4866

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Follow on to https://github.com/apache/arrow-datafusion/issues/4844
The fix for incorrect answers in https://github.com/apache/arrow-datafusion/pull/4869 was to skip the optimizaton if non equijoins were present.
This ticket tracks actually supporting removing crossjoins when filters are present
Currently datafusion will loss the join filter of inner join when run EliminateCrossJoin rule. Following are query and optimized logical plan:
explain verbose select t1.t1_id,t2.t2_id,t3.t3_id
                 from t1
                 inner join t2 on t1.t1_id > t2.t2_id
                 cross join t3
                 where t3.t3_int > t1.t1_int and t1.t1_int > t2.t2_int;

This is because EliminateCrossJoin only consider equijoin predicate.
The idea is to rewrite EliminateCrossJoin, and choose the right input of join based on both equijoin and  non-equijoin predicate. After this pr, the logical plan will be:
      Projection: t1.t1_id, t2.t2_id, t3.t3_id
        Inner Join:  Filter: t3.t3_int > t1.t1_int
          Inner Join:  Filter: t1.t1_int > t2.t2_int AND t1.t1_id > t2.t2_id
            TableScan: t1 projection=[t1_id, t1_int]
            TableScan: t2 projection=[t2_id, t2_int]
          TableScan: t3 projection=[t3_id, t3_int]

The join filter should not be lost.

I am looking into this together with https://github.com/apache/datafusion/pull/12985

Looks like this already gives this result based filter pushdown after https://github.com/apache/datafusion/pull/5770/


Installation failed !! aborted !!

Hi,
want to install yang-explorer as first time user on a MAC. Did start the installation with sudo -H bash setup.sh.
At some point installation failed:
Collecting ncclient==0.4.7 (from -r requirements.txt (line 12))
Using cached ncclient-0.4.7.tar.gz
Complete output from command python setup.py egg_info:
Traceback (most recent call last):
File "", line 1, in
File "/private/tmp/pip-build-5kl0lt6t/ncclient/setup.py", line 24
print "Sorry, Python 3 is not supported (yet)"
^
SyntaxError: invalid syntax
----------------------------------------

Command "python setup.py egg_info" failed with error code 1 in /private/tmp/pip-build-5kl0lt6t/ncclient/
Installation failed !! aborted !!
I do have python 2.7.10 and 3.5.1 running. Paython 2.7.10 is default. Any tipp ?
Ralf

You may be able to edit setup.sh
53 else
54     virtualenv v
55     source v/bin/activate
56 fi
First find the path to 2.7 python
bash-3.2$ which python
/Library/Frameworks/Python.framework/Versions/2.7/bin/python
bash-3.2$ ls /Library/Frameworks/Python.framework/Versions/
2.7 3.4 Current
bash-3.2$
Change line 53 to this
virtualenv -p <full path to 2.7 python> v
In my example it would be:
53 else
54     virtualenv -p /Library/Frameworks/Python.framework/Versions/2.7 v
55     source v/bin/activate
56 fi
Michael
From: rkumcs <notifications<EMAIL_ADDRESS>Reply-To: CiscoDevNet/yang-explorer <reply<EMAIL_ADDRESS>Date: Tuesday, July 5, 2016 at 12:29 PM
To: CiscoDevNet/yang-explorer <yang-explorer<EMAIL_ADDRESS>Subject: [CiscoDevNet/yang-explorer] Installation failed !! aborted !! (#32)
Hi,
want to install yang-explorer as first time user on a MAC. Did start the installation with sudo -H bash setup.sh.
At some point installation failed:
Collecting ncclient==0.4.7 (from -r requirements.txt (line 12))
Using cached ncclient-0.4.7.tar.gz
Complete output from command python setup.py egg_info:
Traceback (most recent call last):
File "", line 1, in
File "/private/tmp/pip-build-5kl0lt6t/ncclient/setup.py", line 24
print "Sorry, Python 3 is not supported (yet)"
^
SyntaxError: invalid syntax

Command "python setup.py egg_info" failed with error code 1 in /private/tmp/pip-build-5kl0lt6t/ncclient/
Installation failed !! aborted !!
I do have python 2.7.10 and 3.5.1 running. Paython 2.7.10 is default. Any tipp ?
Ralf

You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/CiscoDevNet/yang-explorer/issues/32, or mute the threadhttps://github.com/notifications/unsubscribe/ACMGWh9kBXLF-bzs7oEyOgLDlLciCmlMks5qSrCDgaJpZM4JFcpu.

Also, if possible please avoid using sudo with setup.sh

Hope this issue is solved.


Missing launch flags

https://greendu.de/i/vBT.png
D2 Vid Test forces the game to use whatever is saved in the registry by d2vidtest app. so this one might not be useful to linux.
DDraw is very important and is the default way to play now as it supports smooth upscaling shaders.
Widescreen needs to be on by default now that it is stable because many players look for 1068x600 in the video options but it wont show up without this enabled.
-cpufix prevents the game from running unlimited fps and locks the fps at a lower amount to reduce %cpu usage.
-sndbkg means the game sounds continues even when alt tabbed
we made the video modes radial options instead of checkboxes because only one can truly be enabled at once and players may not not the priority order the game uses.
please consider removing the option to skip updates. the reason we want every1 using pod launcher and same files is because ppl come to use with issues and they dont immediately tell us things like "im not running latest update" or "im on linux" until later. its a huge waste of time for our team. if we catch a bug and patch it, we want to know all our users have the fix.
optional: we added sound notifications for loot filter so u may want to add that support in ur jinja generator.
thanks

Thank you for such amount of useful information, I will make changes soon (even if only I use this project 🥲 ).

D2 Vid Test forces the game to use whatever is saved in the registry by d2vidtest app. so this one might not be useful to linux.

Wine is look alike full windows, so it of course have registry in runtime and you can run d2vidtest, so do glide.exe to change glider settings.

DDraw is very important and is the default way to play now as it supports smooth upscaling shaders.

Am I right, that ddraw mode is only for fullscreen?

please consider removing the option to skip updates

Do you mean «check for updates on start» checkbox?

we added sound notifications for loot filter so u may want to add that support in ur jinja generator

I know only about color notifications. Where can I read about this?

Am I right, that ddraw mode is only for fullscreen?
No you can config it in ddraw.ini. it can do anything like glide but also shaders
Do you mean «check for updates on start» checkbox?
yes id like it removed

Fixed in new release, thank you for information.


Fix Home Assistant p1_dsmr_to_SmartEVSE_API configuration

The shell command in configuration.yaml contains templates with sensor values. These need to be prefixed with 'sensor.', otherwise Home Assistant cannot parse them. The prefix is now added.

@dingo35, please review.
Thanks for these scripts. They worked fine after finding out how to fix the template.

I am sorry but my fellow developers seem to have revoked my authorization to accept Pull Requests. Could you please refile it at https://github.com/dingo35/SmartEVSE-3.5  so it can be corrected in the new version 3.5.0 ?

New pull request created at https://github.com/dingo35/SmartEVSE-3.5/pull/9.


Randomize UA

Fixes https://github.com/codemanki/cloudscraper/issues/77
@pro-src i first created a randomizeUserAgent flag on defaultParams, but then decided to just randomize the UA by default, as that flag was brining more confusion than actual value

@codemanki I think that if this is going to be on by default then there should be at least a minor version bump. There also needs to be a warning in the README to inform people that sending a cookie that was acquired with a different user agent is a bad idea. The user agent should always be stored with the session cookie. This could very well be a breaking change if anybody is already using v3 and is storing session cookies for reuse.

@pro-src so you are saying that it should be actually a flag that is off by default?

@codemanki, what about adding a method to apply a random user agent?
// Somewhere in the custom defaults function
cloudscraper.setUserAgent = setUserAgent;

// Pseudo definition
function setUserAgent(ua) {
  if (ua === 0) {
    ua = this.defaultParam.headers['User-Agent'];
    var old = ua;
    while (ua === old) ua = randomUA();
  }

  if (!ua || typeof ua !== 'string') {
    throw new TypeError('Expected userAgent to be a non-empty string, got ' +
      typeof (ua) + ' instead.';
  }

  this.defaultParam.headers['User-Agent'] = ua;
}

// Usage
var cloudscraper = require('cloudscraper');
cloudscraper.setUserAgent(0);

@codemanki, I'm curious as to how unique those user agents are. We won't them to be as common/popular as possible. Can you switch out your browser's UA and check them with the EFF's https://panopticlick.eff.org/

@codemanki

so you are saying that it should be actually a flag that is off by default?
I'm saying it should be off by default but it doesn't necessarily have to be a flag.

I'm saying it should be off by default but it doesn't necessarily have to be a flag.
Then I would just leave it as it is and add a notice to the readme, saying that UA randomization is a nice to have but should be handled manually by user.
If user wants to use UA headers in more advanced way, they would want to use something like https://www.npmjs.com/package/random-ua
The suggested by you random UA filling looks like a workaround, that is not very obvious and is limited to the defined list of 10-15 UAs.

@codemanki Actually, I'd rather have this on by default and release it now in the patch version then to not have it all, lol. No convenience methods necessary. However we could just document the method as only randomly returning one of the ~5 most popular user agents. Because they won't be aware of the method unless they read the readme anyway...

@pro-src but if it is on by default, then users should also keep a track of selected UA. But on other hand, if cloudscraper is used in non-advanced way, users won't probably save cookies to reuse them and etc.
So should it be a method as you suggested, or a flag? :)

@codemanki I think a method would better so we can change the user agent on the demand. If getting a captcha, you might be able to circumvent it just by changing the UA. See this issue: https://github.com/Anorov/cloudflare-scrape/issues/190
So, we only really need either a flag or method but if you wanted to you could add both. I'm neutral on it.

According to the EFF's panopticlick:

one in 220600.0 browsers have this value: Ubuntu Chromium/34.0.1847.116 Chrome/34.0.1847.116 Safari/537.36
one in 220609.0 browsers have this value: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.21 (KHTML, like Gecko) konqueror/4.14.10 Safari/537.21
one in 220617.0 browsers have this value: Mozilla/5.0 (iPad; CPU OS 5_1 like Mac OS X) AppleWebKit/534.46 (KHTML, like Gecko ) Version/5.1 Mobile/9B176 Safari/7534.48.3
one in 220628.0 browsers have this value: Mozilla/5.0 (iPad; U; CPU OS 3_2 like Mac OS X; en-us) AppleWebKit/531.21.10 (KHTML, like Gecko) Version/4.0.4 Mobile/7B334b Safari/531.21.10

I was just checking them in order of appearance. I didn't check all of them. The user agent's found at http://www.browser-info.net/useragents (Most Popular User Agents section) appear to be way more common.
For example:

one in 9193.79 browsers have this value: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; FSL <IP_ADDRESS>01)

:thinking: Hmm, something does seem right about IE6 being that popular.

@codemanki Did you decide on what to do with this?

@pro-src oh snap. yes, i want to continue with a flag, as it looks like we are currently using this kind of strategy for configuration. 👍  ?

@codemanki :thinking: If a flag is introduced, the UA would have to be set during the first performRequest?

@codemanki :thinking: If a flag is introduced, the UA would have to be set during the first performRequest and kept for all future calls to cloudscraper? Or would it be the case that you could only enable/disable this by using the defaults function?

@codemanki See my https://github.com/codemanki/cloudscraper/issues/62#issuecomment-472130328 about adding a flag that should apply to all requests.

I'm just noting this here since changing the UA can potentially bypass a captcha.
var cloudscraper = require('cloudscraper');
var errors = require('cloudscraper/errors');

cloudscraper.get('http://example-site.dev')
  .catch(function(error) {
    if (error instanceof errors.CaptchaError) {
      cloudscraper.defaultParams.headers['User-Agent'] = 'new UA';
      return cloudscraper.get('http://example-site.dev');
    }
  })
  .then(doSomethingWithBody)

@pro-src hey. sorry, i was out for some time, now i'm back. I will take a look at your comments and will adjust my PR

@codemanki Thanks for the update!

To reopen this PR. Do we want to set a new UA on errors? Or on each request?

Do we want to set a new UA on errors?

I like the idea of having an option that causes the UA to be changed if we get a captcha. However, you can already do that using the current API.

Or on each request?

Changing the UA on a per-request basis is definitely a bad idea.
I really don't want to delay this PR any further, can we just merge it as is?
I do have a couple concerns:

This is changing the default behavior which is not an issue if users have to explicitly enable it.
The user should reuse the user-agent if cookies are reused in later sessions which complicates things.

The first concern could normally be resolved by a major version bump but users have to update to the latest version otherwise cloudscraper won't work for the latest challenge. Once the parsing methods are separated from the main library, we should consider backporting so breaking changes aren't forced on users.
The second concern would be addressed by updating the README but maybe later we could add a method to get the cookies and UA together?

@codemanki I just realized that we haven't updated the project markdown to mention saving the UA with the cookies. Probably should do that...


send help to stdout without "less"

For use with demos, documentation, it can be handy to have -help flag send the help to stdout without piping through less.

conda-env-mod.txt


Add option for strongly connected components

Have an option in cluster that produces strongly connected component clusters.
A use case for this was when there is a sample or two with low distance to a sample from a different lineage. This caused two clusters from separate lineages to get joined because the two samples had lots of masked variants due to low FRS

Okay so I've just realised that this is only possible on directed graphs - which don't make sense in our context.


Why it keep reloading settings every minute?

I am Sublime Text build 3114/Windows 10.
All the time this plugin keep reloading the setting files, but I do not understand why it does that while I am neither programming on java.
reloading settings Packages/User/Javatar.sublime-settings
reloading settings Packages/User/Javatar.sublime-settings
indexing [queue 27]: no files were indexed out of the 1 queued, abandoning crawl
reloading settings Packages/User/Javatar.sublime-settings
reloading settings Packages/User/Preferences.sublime-settings
reloading settings Packages/User/Javatar.sublime-settings
reloading settings Packages/User/Javatar.sublime-settings
reloading settings Packages/User/Javatar.sublime-settings
reloading settings Packages/User/Javatar.sublime-settings
reloading settings Packages/User/Javatar.sublime-settings

Can it be disabled? It is mostly spamming the console.
I think it is a message from Sublime Text, but why Javatar keeps triggering it?

Javatar has a feature to restore the project settings upon hot exit for unsave project which require to save the project settings every now and then. You can disable it in the Javatar preferences.
And if possible, could you show me what settings did Javatar set for you (just dump all Javatar settings from your user's settings)?

Thanks. Is this the settings you mention?
    // Time interval to update project data for restoration (in milliseconds)
    "project_update_interval": 60000,

I think it is nice to continually saving, so can just Javatar save it elsewhere, so Sublime Text stops reloading the file?
My setting file SublimeText\Data\Packages\User\Javatar.sublime-settings is:
{
	"jdk_version":
	{
		"JDK1.8.0u131":
		{
			"path": "C:\\Program Files (x86)\\Java\\jdk1.8.0_131\\bin",
			"update": "131",
			"version": "1.8.0"
		},
		"JDK1.8.0u65":
		{
			"path": "C:\\Program Files\\Java\\jdk1.8.0_65_old\\bin",
			"update": "65",
			"version": "1.8.0"
		},
		"JDK1.8.0u71":
		{
			"path": "C:\\Program Files\\Java\\jdk1.8.0_71\\bin",
			"update": "71",
			"version": "1.8.0"
		},
		"use": ""
	},
	"message_id": 20,
	"project_data":
	{
		"2":
		{
			"build_systems":
			[
				{
					"cmd":
					[
						"galileo.bat",
						"$project_path/plugins/addons/amxmodx/scripting/galileo.sma",
						"galileo",
						"$packages"
					],
					"file_regex": "^(.+)\\(([0-9]+ ?.*)\\) : (.*)",
					"name": "Galileo Installer",
					"variants":
					[
						{
							"cmd":
							[
								"galileo.bat"
							],
							"name": "Clean Setup"
						}
					],
					"working_dir": "$project_path/installers"
				},
				{
					"cmd":
					[
						"sh",
						"$project_path/installers/install_multimod_plugins.sh"
					],
					"name": "Install Multimod Plugins",
					"working_dir": "$project_path/"
				},
				{
					"cmd":
					[
						"sh",
						"$project_path/installers/install_multimod_server.sh"
					],
					"name": "Install Multimod Server",
					"working_dir": "$project_path/dependencies/"
				}
			],
			"folders":
			[
				{
					"folder_exclude_patterns":
					[
						"installers/clean_setup",
						"dependencies/amxmodx/plugins"
					],
					"path": "."
				},
				{
					"path": "D:/User/Dropbox/Applications/SoftwareVersioning/SublimeText/Data/Packages"
				}
			]
		},
		"3": null
	}
}

Yes, that's exactly what's it doing. Right now, Javatar has no settings for output path for project data so that's why it save into the user's preferences instead.


BAU: Build packages for puppet 6->5.4.0 downgrade

With Ubuntu bionic beaver as the target, let's prepare for Puppet 5.4.0 and
package gems suitable for that version.
Puppetlabs' 5.4.0 puppet-agent package does not bundle hiera-eyaml, so we need
to resume packaging all the dependencies of hiera-eyaml-gpg and ruby_gpg

Context that I was missing:
Bionic has a puppet package which is 5.4
We can use the OS package rather than Puppetlabs package which should hopefully reduce the packaging burden for other things


Comparison to https://github.com/twop/ts-union

Why should I use this project over that one: https://github.com/twop/ts-union

ts-union and many other similar libraries derive types from constructor functions. That works for most cases. However, once you run into recursive or generic union types, you will have to jump through a lot of hoops.
This project derives constructor functions from types by using Proxies. That solves all those issues.
If you don't need generic or recursive unions, pick whichever you think has the nicer API / more features.

Thanks!


error[E0463]: can't find crate for core

when run "cargo build" within blog-02,
it reports "can't find crate for core
i have already used nightly.
blog_os git:(post-02) rustc --version
rustc 1.46.0-nightly (346aec9b0 2020-07-11)

You need to use cargo xbuild, not cargo build.

You need to use cargo xbuild, not cargo build.

when run cargo xbuild,  error still reported:
error[E0461]: couldn't find crate `core` with expected target triple x86_64-blog_os-10958214645806601562

Run cargo clean once. After that cargo xbuild should work fine.

Run cargo clean once. After that cargo xbuild should work fine.

thanks for helping me so patiently!
i did as what you said, but the error still exsits, as follows:

  blog_os git:(post-02) cargo clean
➜  blog_os git:(post-02) cargo xbuild
   Compiling compiler_builtins v0.1.32
   Compiling core v0.0.0 (/home/lfn/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/src/rust/src/libcore)
   Compiling rustc-std-workspace-core v1.99.0 (/home/lfn/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/src/rust/src/tools/rustc-std-workspace-core)
   Compiling alloc v0.0.0 (/tmp/cargo-xbuildkSeMac)
    Finished release [optimized] target(s) in 12.42s
   Compiling bootloader v0.9.8
   Compiling rlibc v1.0.0
error[E0461]: couldn't find crate `core` with expected target triple x86_64-blog_os-10958214645806601562
  |
  = note: the following crate versions were found:
          crate `core`, target triple x86_64-blog_os-6028079494216025267: /home/lfn/Documents/rust/projects/blog_os/target/sysroot/lib/rustlib/x86_64-blog_os/lib/libcore-8db6693f79383387.rmeta
          crate `core`, target triple x86_64-blog_os-6028079494216025267: /home/lfn/Documents/rust/projects/blog_os/target/sysroot/lib/rustlib/x86_64-blog_os/lib/libcore-8db6693f79383387.rlib

error: aborting due to previous error

error: could not compile `rlibc`.

To learn more, run the command again with --verbose.
warning: build failed, waiting for other jobs to finish...
error: build failed

Strange. I don't know what could be the problem.

Strange. I don't know what could be the problem.

thx all the same~~

Sorry for the confusion all! I just updated the blog to use standard cargo build instead of cargo-xbuild in https://github.com/phil-opp/blog_os/pull/835. However, this only works on the latest nightlies, so this is likely the problem here.
On https://os.phil-opp.com/minimal-rust-kernel/#building-our-kernel I put some note about this:

Note: The unstable.build-std configuration key requires at least the Rust nightly from 2020-07-15. Right now, the rustfmt component is not available on these recent nightlies, so you might need to use rustup update nightly --force to update your nightly, which skips the rustfmt component if it's not available.

I will also add this note to the Readme to try to prevent this confusion in the future.

I will also add this note to the Readme to try to prevent this confusion in the future.

Done.

Sorry for the confusion all! I just updated the blog to use standard cargo build instead of cargo-xbuild in #835. However, this only works on the latest nightlies, so this is likely the problem here.
On https://os.phil-opp.com/minimal-rust-kernel/#building-our-kernel I put some note about this:

Note: The unstable.build-std configuration key requires at least the Rust nightly from 2020-07-15. Right now, the rustfmt component is not available on these recent nightlies, so you might need to use rustup update nightly --force to update your nightly, which skips the rustfmt component if it's not available.

I will also add this note to the Readme to try to prevent this confusion in the future.

It work!
Thx a lot!!


Maintain link between resources created by chart, and chart release

We would like to be able to distinguish between resources that were part of a chart release (enacted by the helm operator) and other resources.
Here's some possibilities:

You can add ownerReference structs to a resource to tell Kubernetes it belongs to another resource or controller. You can also get the resources that are part of a release via the Helm API; so, every time we release a chart, we could ask helm to give us the resources, and make the FHR an owner.  If it turns out ownerRefs aren't good for us, we can annotate the resources.

It's recommended -- but only recommended -- that templates in a chart include labels indicating where they came from. Provided those are used, it's an alternate way to see just from the labels which resources came from a release. (Possibly it's what the helm status API uses, even).

Fixed in #1134.


[Question]: Online MongoDB error

Contact Details
<EMAIL_ADDRESS>What is your question?
Online MongoDB instruction do not exist : https://github.com/danny-avila/LibreChat/blob/main/docs/deployment/..\install\mongodb.md
More Details
Can't open this link : https://github.com/danny-avila/LibreChat/blob/main/docs/deployment/..\install\mongodb.md
What is the main subject of your question?
No response
Screenshots
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

Here's the doc
https://github.com/danny-avila/LibreChat/blob/main/docs/install/mongodb.md

Where did you find this link?

As was said, we would need to know where the incorrect link is. The doc you're looking for is here: https://docs.librechat.ai/install/mongodb.html#create-an-account

Thanks I found the link here
[(https://github.com/danny-avila/LibreChat/blob/main/docs/deployment/render.md)

Thanks I found the link here (https://github.com/danny-avila/LibreChat/blob/main/docs/deployment/render.md)
on the part : "Create and Configure your Database"

thank you i fixed it!


Fix: Asynchronous Supplier Fetching Issue in Search Component

Fix: Asynchronous Supplier Fetching Issue in Search Component

Problem
The Search component was not rendering properly due to asynchronous data fetching (await) at the top level, which blocked the initial rendering of the component. This caused the UI to break or not show data correctly because the suppliers were being fetched before the component could render.
Solution
Refactored the supplier fetching logic into a useEffect hook. By moving the asynchronous call to SupplierService.getAllSuppliers() inside useEffect, the component now fetches suppliers after the initial render without blocking the UI. Also, the suppliers' IDs are flattened and stored in the state after the data is successfully fetched.
Additionally:

Introduced proper state management for suppliers and supplierIds.
Improved error handling and loading state to give feedback during data fetching.
Ensured the onLoad function is properly invoked after location changes using useEffect.

This approach ensures that the component is rendered correctly while maintaining responsiveness, solving the issue of delayed or broken rendering.

?


Programming Exercises: Fix repository reset for individual due dates

Checklist
General

[x] This is a small issue that I tested locally and was confirmed by another developer on a test server.
[x] I chose a title conforming to the naming conventions for pull requests.

Client

[x] Important: I implemented the changes with a very good performance, prevented too many (unnecessary) REST calls and made sure the UI is responsive, even with large data.
[x] I followed the coding and design guidelines.
[x] I added multiple integration tests (Jest) related to the features (with a high test coverage), while following the test guidelines.

Motivation and Context

Fix #7649
Description

The reset button was not shown for students after the due date of an exercise, even though their individual due date was still in the future. This is now changed to no longer rely on the ability to start the exercise, which does not take individual due dates into account.
Steps for Testing

Follow steps from #7649 (The reset button should be below the problem statement)
Additionally make sure that resetting actually works after the exercise due date but before the individual due date.
Testserver States

[!NOTE]
These badges show the state of the test servers.
Green = Currently available, Red = Currently locked

Review Progress

Performance Review

[ ] I (as a reviewer) confirm that the client changes (in particular related to REST calls and UI responsiveness) are implemented with a very good performance

Code Review

[x] Code Review 1
[ ] Code Review 2

Manual Tests

[x] Test 1
[ ] Test 2

Test Coverage

Client

Class/File
Line Coverage
Confirmation (assert/expect)

reset-repo-button.component.ts
89.28%
✅

Tested on Artemis test1: Everything working as expected now, I can see the reset Button and can also reset.


Explore using a lambda adapter in the pipeline, instead of an ECS service

In order to explore options for a simpler & faster catalogue pipeline architecture we should look at the advantages of using Lambdas in a new adapter vs following the existing pattern of ECS services.
We should write an RFC exploring the advantages and add this to https://github.com/wellcomecollection/docs/tree/main/rfcs
This work could be done as part of the upcoming EBSCO / e-journal work.

This is done as part of https://github.com/wellcomecollection/platform/issues/5712


[lambda]array_map(append_trailing_char_if_absent) function error in external table

Steps to reproduce the behavior (Required)

CREATE TABLE '...'

create external catalog hive_catalog_2e3394f0_59b2_11ed_91ff_00163e0e550b PROPERTIES("type" = "hive","hive.metastore.uris" = "thrift://ip:port");

SELECT  '....'

select col_int,array_map(x ->append_trailing_char_if_absent('', 'a'),col_array_string) from hive_catalog_d75112be_58f0_11ed_b73c_00163e0e550b.hive_extbl_test_arra

Expected behavior (Required)
['a']
Real behavior (Required)
['']

StarRocks version (Required)

You can get the StarRocks version by executing SQL select current_version()

+----------------------+
| current_version()    |
+----------------------+
| MAIN-RELEASE c1b178c |
+----------------------+

Root cause:
SR cannot identify empty strings from hive, no matter with lambda function.
hive
hive> select * from s;
OK

NULL

abc
Time taken: 0.159 seconds, Fetched: 4 row(s)

hive> select count(*) from s where a = '';
OK
2
Time taken: 34.251 seconds, Fetched: 1 row(s)

SR
mysql> select count(*) from s;
+----------+
| count(*) |
+----------+
|        2 |
+----------+
1 row in set (0.12 sec)

mysql> select count(*) from s where a = '';
+----------+
| count(*) |
+----------+
|        0 |
+----------+
1 row in set (0.07 sec)

the reason is that append_trailing_char_if_absent('', 'a') treat arg[0] as const column and add 'a' when the arg[0].length=0 while on the col is not constant, it check the length and skip the row that src_length=0

append_trailing_char_if_absent's behavior is different when the first arg is an empty string by from columns or not.
mysql> Create table t ( a int, name char(20), pv double) ENGINE=OLAP DUPLICATE KEY(a)  DISTRIBUTED BY HASH(a) BUCKETS 10 PROPERTIES("replication_num" = "1");
Query OK, 0 rows affected (0.01 sec)

mysql> insert into t values (1,'',3);
Query OK, 1 row affected (0.03 sec)
{'label':'insert_a4e0c3d6-670e-11ed-b25b-00163e1f2aee', 'status':'VISIBLE', 'txnId':'5640284'}

mysql> select append_trailing_char_if_absent(name,'a') from t;
+-------------------------------------------+
| append_trailing_char_if_absent(name, 'a') |
+-------------------------------------------+
|                                           |
+-------------------------------------------+
1 row in set (0.01 sec)

mysql> select append_trailing_char_if_absent(name,'a') from t;
+-------------------------------------------+
| append_trailing_char_if_absent(name, 'a') |
+-------------------------------------------+
|                                           |
+-------------------------------------------+
1 row in set (0.00 sec)

mysql> select append_trailing_char_if_absent('','a') from t;
+-----------------------------------------+
| append_trailing_char_if_absent('', 'a') |
+-----------------------------------------+
| a                                       |
+-----------------------------------------+
1 row in set (0.00 sec)


Infinite scroll

Exist something form that i can replace pagination of the table for infinite scroll?

Did you tried to set settings.pager = false ?
Should help

Thank you, i will try with this option and the library ngx-infinite-scroll.


Add internal -> external transactions

TODO:

Design failure handling, e.g. internal transaction completed but blockchain transaction part failed.
Adjust EWallet.BlockchainTransactionGate to support internal-to-blockchain transactions
Add tests for the new gate functions
Add controller tests


[feature request] bugreport generator

It would be nice to have a form for generating bugreports.
This way all bugreports from us would have the same structure.

we should have a button/page to automate the creation of a standardized bug report to our tracker including a back reference to the security trackers AVG link for the package maintainers.

Our bugreport template is located here: https://wiki.archlinux.org/index.php/Security_Advisories/Examples
ArchWeb uses this simple code, to generate an bugreport url
def bug_report(package):
    url = "https://bugs.archlinux.org/newtask"
    data = {
        'project': package.repo.bugs_project,
        'product_category': package.repo.bugs_category,
        'item_summary': '[%s] PLEASE ENTER SUMMARY' % package.pkgname,
    }
    return link_encode(url, data)

https://bugs.archlinux.org/newtask?project=1&product_category=10&item_summary=[linux]+PLEASE+ENTER+SUMMARY&detailed_desc=the bug description


Regexp error when sa-learn is run by amavisd-new-cronjob

This error is triggered every time amavisd-new-cronjob runs on my Debian Jessie server:
Use of uninitialized value in regexp compilation at /usr/local/share/perl/5.20.2/Mail/SpamAssassin/Plugin/HashBL.pm line 101.
I'm running the .003 code with Spamassassin 3.4.2.
Any ideas or workarounds?
Thanks,
Joel

Line 101 is blank in my version.
As HashBL is now part of SA - you should raise the ticket in SA rather than here.


Add support for Github's application/json webhook option

When a new build starts, the following function is executed:
$this->build->sendStatusPostback();
However, there is an error in the b8\HttpClient class and the build fails immediately.
Warning: json_decode() expects parameter 1 to be string, array given in /var/www/tools/PHPCI/vendor/block8/b8framework/b8/HttpClient.php line 88
The error happens on the following line:
$res['body']      = json_decode($res['body'], true);
Maybe it's best to check if $res['body'] is an array before calling json_decode on it ?

Support for the JSON request type was implemented a couple of releases ago. :)


[5.2] Skip confirmation on non-interactive mode

The Symfony Input interface supports isInteractive(), which is the true by default, unless running in non-interactive mode (--no-interaction or -n).
While in this case, the effect is the same as --force, it can be expected behaviour (eg. for deployments, scripts etc) to continue without asking questions.
Current behaviour is that the command is cancelled. After this PR, non-interactive mode will always continue.

Yeah probably want to stop running unless force is provided I think?


Fix race condition in TaskThrottler

We waited for tasks to complete inside the loop, which meant that if cancelation of the loop was requested while it was in the part of the code after that (for example waiting on the mutex), they would never be awaited.
There is no real reason to wait inside the loop, we can just wait outside it, it is effectively the same.

Checkmarx scan completed with the following findings

Lines
Severity
Category
File
Link

68
Medium
Heap_Inspection
Cognite.Metrics/MetricsConfig.cs
Checkmarx


Introduce zstd & brotli compression + output buffering

This PR will allow FOSSBilling to provide zstd, brotli, gzip, and deflate output compression on any webserver so long as the needed extensions are installed & opens up the ability for us to have programmatic control of it within the application.
The most interesting of these would be zstd which doesn't have official support by either NGINX or Apache. It's faster than any of the other options and overall matches brotli for compression, making it by far the superior choice for output compression.
This does have the chance to break stuff, however due to introducing output buffering. Essentially any instance where code uses exit will first need to use ob_end_flush to ensure the output is sent to the client.
Also output compression in FOSSBilling can be disabled so it can instead be handled by the webserver if desired, although I personally am in favor of being able to control as many aspects of FOSSBilling's behavior within the app itself as it helps minimize potential changes to config files once we have more webservers we provide support for (further down the line, I presume after most of the routing has been rewritten).
I plan on leaving this as a draft till others comment on what they think, as I am not entirely sure if there is perhaps a better way to make these changes.
For example: since this would already be messing with how the app outputs data, maybe we should go one step further and port a lot of the core functionality to a micro-framework such as Flight & eliminate most of the custom routing / response handling in FOSSBilling which would benefit the app in the long-run.

FWIW, while I see this has now been closed and I'd hoped to provide a more comprehensive response, I don't think this is within our purview to worry about given limited resources.

FWIW, while I see this has now been closed and I'd hoped to provide a more comprehensive response, I don't think this is within our purview to worry about given limited resources.

I actually only closed this because I think such changes are better suited to if / when we rebuild the routing & app as this fundamentally needs to change how output is sent to the client (utilizing an output buffer).
CompressionBuffer is my own thing that I maintain and use in other projects so from that front it's not any additional work. The only usage of our resources is actually implementing it which is just about zero work once an output buffer is in use.
Additionally CompressionBuffer itself handles interpreting the client headers, selecting the best encoding, and outputting the proper headers needed so we wouldn't even need to worry about that from a FOSSBilling side of things.
In terms of our time investment, It's a lot like AntLoader package I built and then incorporated into FOSSBilling since composer's autoloader didn't fit our needs.
(It's also worth noting that I really do want us to eventually port the app to a micro framework & replace the existing routing, I think in the long-term that'd be good for the app & at that time I will likely be interested in revisiting this idea, even if not fully committed to it)


Can't amplify push due to symlink issue

Before opening, please confirm:

[X] I have installed the latest version of the Amplify CLI (see above), and confirmed that the issue still persists.
[X] I have searched for duplicate or closed issues.
[X] I have read the guide for submitting bug reports.
[X] I have done my best to include a minimal, self-contained set of instructions for consistently reproducing the issue.
[X] I have removed any sensitive information from my code snippets and submission.

How did you install the Amplify CLI?
npm
If applicable, what version of Node.js are you using?
14.17.6
Amplify CLI Version
7.6.24
What operating system are you using?
Mac
Did you make any manual changes to the cloud resources managed by Amplify? Please describe the changes made.
no
Amplify Categories
function
Amplify Commands
push
Describe the bug
I updated to the latest amplify, and attempted a push. I got this error:
hisham@mb3 ess-app % amplify push
✖ There was an error pulling the backend environment hishamdev.
🛑 An error occurred during the push operation: EEXIST: file already exists, symlink '../acorn/bin/acorn' -> '/Users/hisham/src/ess-app/amplify/.temp/#current-cloud-backend/function/essappCliLambdaLayer/lib/nodejs/node_modules/.bin/acorn'
⚠ Please refer Amplify CLI troubleshooting guide at : https://docs.amplify.aws/cli/project/troubleshooting/

Expected behavior
amplify push should work fine
Reproduction steps
I didn't do anything special except update a package my layer uses.
It seems this is a dupe of https://github.com/aws-amplify/amplify-cli/issues/2948?
The proposed fix or workaround seems ambigious / hacky. Needs more looking into.
https://docs.amplify.aws/cli/project/troubleshooting doesn't cover this use case.
GraphQL schema(s)

# Put schemas below this line

Log output

# Put your logs below this line

Additional information
No response

Hey @hisham :wave: thanks for raising this! And apologies for the inconvenience, I do agree symlink issues can be handled better. I took a look through the linked issue and although the workarounds should be sufficient I wrote a few steps to show how we can edit the #current-cloud-backend folder contents and re-deploy. From the steps, instead of editing a GraphQL schema we will be removing the symlink. Can you try running through the workaround steps and see if that alleviates the issue? And for subsequent pushes we'll want to ensure the symlink is not created and packaged

Hey I ended up deleting the .temp folder within my amplify directory then push worked, closing. Thanks for all the help!


feat(rust): improve error definitions within ockam command and error handling within ockam enroll

Current behavior

Example of an error happening during enroll setup.
Proposed changes
       Enrolling with Ockam Orchestrator

       No default identity was found.
     ✔ Creating default identity default
       Setting identity default as default for local operations...

       To enroll we need to associate your local identity with an Orchestrator account

     │ First copy your one-time code:  NPKR-RVHT
     │ Then press  ENTER ↵  to open https://account.ockam.io/activate in your browser...

     │ Opening https://account.ockam.io/activate to begin authentication
     │ Authenticated

       Getting available spaces for default
       Found space 52293cb6...
     ✔ Setting space 52293cb6 as default for local operations

       Getting avaiable projects for default
       Found project default...
     ✔ Setting project default as default for local operations

OCK500 Unable to set the local identity as enrolled with project default:
       Unable to read state directory, /Users/chris/.ockam/identities. No such file or directory (os error 2)

       Please report this issue, with a copy of your logs, to https://github.com/build-trust/ockam/issues
       https://docs.ockam.io/errors/OCK500
       Version 0.87.0, hash: 0c80923fea6cf05af6d073147ae36f9336fdfc90

Checks

[ ] All commits in this Pull Request are signed and Verified by Github.
[ ] All commits in this Pull Request follow the Ockam commit message convention.
[ ] I accept the Ockam Community Code of Conduct.
[ ] I have accepted the Ockam Contributor License Agreement by adding my Git/Github details in a row at the end of the CONTRIBUTORS.csv file in a separate pull request to the build-trust/ockam-contributors repository. The easiest way to do this is to edit the CONTRIBUTORS.csv file in the github web UI and create a PR, this will mark the commit as verified.

@etorreborre and/or @adrianbenavides  would love another re-review when you have the chance.


Support four arguments for satisfiesAnyOf()

In a recent project this was necessary/useful and since there was no particular reason not to support it other than a missing use case, this seemed a good reason to support it from now on.
Fixes : NA
Unit tests : YES
Javadoc with a code example (on API only) : YES

Nice PR thanks @Jakzi666!


⚠ Bofrost.de has degraded performance

In b12e598, Bofrost.de (https://www.bofrost.de) experienced degraded performance:

HTTP code: 200
Response time: 1185 ms

Resolved: Bofrost.de performance has improved in cbf1343.


[issue-98] Register GuiceServletContextListener

Please see https://github.com/HubSpot/dropwizard-guice/issues/98

Can't add reviewers.
@jhaber @chrisburke1 see this PR

ping?

pong?

anyone?

Sorry for the delay, this lgtm (looks like it was already added to dropwizard-guicier here)


Inconsistent AADAdditionalData JSON structure in Get-AADTenantDetail

🐛 Summary
This issue was discovered during the escapades of last week.
Get-AADTenantDetail is using a pipe to do the | ConvertTo-Json rather than using ConvertTo-Json @().
As we discovered in the past, piping to ConvertTo-Json leads to inconsistent JSON structure.
This issue is impacting efforts on other tasks which are creating scripts to omit sensitive information from the Provider.json.

Offending code in ExportAADProvider.psm1
function Get-AADTenantDetail {
     .....
    $TenantInfo = $TenantInfo | ConvertTo-Json -Depth 4
    $TenantInfo
}

To reproduce
Steps to reproduce the behavior:
Run Invoke-SCuBA -ProductNames aad against Test Tenant 1 (G5) and Test Tenant 5 (E3)
Expected behavior
Consistent JSON structure for the tenant data across different tenants.
Any helpful log output or screenshots
@nanda-katikaneni for specifics.

One correction the JSON structure for the tenant details when assessing AAD is inconsistent with other products JSON structure - but it is consistent across tenant types.
Get-AADTenantDetail for Test-Tenant#1/G5 or Test-Tenant#5/E3 results in the following object format:
"tenant_details": {
"AADAdditionalData": {
},
"TenantId":  "xxxxx",
"DisplayName":  "yyyyy",
"DomainName":  "cisaent.onmicrosoft.com"
},
While for other products, the Get-TenantDetail results in the following array format:
"tenant_details": [
{
"TenantId":  "xxxxx",
"EXOAdditionalData":  "yyyy",
"DisplayName":  "zzzzz",
"DomainName":  "cisaent.onmicrosoft.com"
}
],


Add nilike support in comparison

Which issue does this PR close?
Closes #1845.
Rationale for this change
comparison kernel has functions like and nlike, which perform LIKE and NOT LIKE operations. There was also an addition of ilike back in late 2021, which allows to performe ILIKE (case-insensitive LIKE) operations. However, nilike, which is what nlike to like is, respectively (NOT ILIKE), has been missing. It is a useful addition to perform similar NOT operation with already supported ILIKE.
What changes are included in this PR?
This PR adds nilike functions to comparison kernel that perform SQL left NOT ILIKE right operation on arrays and scalars, as well as related tests and benches.
Are there any user-facing changes?

Codecov Report

Merging #1846 (49b5eae) into master (c396dfb) will increase coverage by 0.00%.
The diff coverage is 95.83%.

@@           Coverage Diff           @@
##           master    #1846   +/-   ##
=======================================
  Coverage   83.48%   83.49%
=======================================
  Files         201      201
  Lines       56838    56886   +48
=======================================
+ Hits        47452    47496   +44
- Misses       9386     9390    +4

Impacted Files
Coverage Δ

arrow/src/compute/kernels/comparison.rs
92.55% <95.83%> (+0.09%)
:arrow_up:

parquet_derive/src/parquet_field.rs
65.75% <0.00%> (-0.46%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c396dfb...49b5eae. Read the comment docs.

Would you like me to get this PR in and we can maybe follow up with feedback in another PR? I think as is this is a good step forward?

I am up for making the changes you suggested, although if you think it's good to have this faster and improve on later, I can rebase now.

Merging this one in to keep the queue down -- Thank you @MazterQyou and @tustvold . I would love to see a refactor PR that reduced the code duplication


avoid unnecessary copy in setXLen

the fix for #27 done in #35 introduced a copy in setXLen that has some impact in the performance in some cases (see benchmark on chainAddition in this comment).
In principle it is possible to fix the issue in self addition without introducing a new copy but it requires more effort.
Note that legacy usage of setXLen remains accessible through a compile time switch bigintsLegacySetXLen.

not relevant anymore given the recent merge (#40).


Mobile Compatibility

We aren't very mobile compatible. Sure, Google thinks we are, but we actually arent.

Lol Google says a lot of things are mobile compatible. Not exactly reliable.
@nywillb is right, we really should do something about this. Besides, what is preventing us from doing so or have we just not really tried?

@nywillb @RobotXLabs

we just not really tried

Pretty much. There are repos for iOS and Android apps, though they aren't much.

@nywillb @RobotXLabs This is mostly done and has been pushed to production. There still is some stuff to do with the planner tab (right now, you have to scroll around, but it works and is legible on mobile), though.


Updated pandoc-citeproc handling after downloading

This pr changes the handling of pandoc-citeproc, to check if it's Included.If it is, copy like normal.
If not, do nothing

@AbdealiJK let me know how this works for ya :)

Makes sense :+1:


Yi/Orca/ChatML

I have not been able to use a ChatML based on Orca or Yi.  I am not entirely sure how different ChatTemplates are detected and used by llama.cpp. All work except when it comes to Yi or Orca base models that use the ChatML format. Words run together as well as other issues.
Perhaps you have some clue what needs to be done.

Which HF models are you referring to? Can you provide the HF links to the models? I can take a look.

This for one would be a good example.
dolphin-2.9.3-Yi-1.5-34B-32k-GGUF
output looks like this.
Hello!HowcanIassistyoutoday?

Ah yes, I made a new commit try again and let me know if this is fixed.

Yes, totally fixed. This 01.ai model is very interesting. It is 34B but has the speed of a 7B. But also 32K context. And the only openSource AI out there. It also uses a very different set of Corpora for pure reasoning. Thank you for fixing this!  I have not tried any of the older Orca models, but I suspect they would be fixed with this patch!

Yes, this should fix it for the other models as well.


Test Fails to End when Run with Istanbul (ends fine without it)

For some reason running the tests through istanbul fails. :disappointed:
But, given that the tests aren't really exercising any code, its not a big problem.

Closing for now. When we decide to display coverage for this tutorial we can re-visit.


JIRA Ticket: ModuleNotFoundError: No module named 'onnxruntime'

Investigate DLM issue of ModuleNotFoundError: No module named 'onnxruntime' .

I tried running it with recent builds (14386, 14379, 14372) and but I saw the same error No module named 'onnxruntime'. I tried the failing and passing driver as reported in the ticket (14291 & 14223), but that also shows the same error.
I had checked out the latest version of DLM (330619ef) for the above runs.
For what it's worth, I had to do downgrade numpy version to workaround the error for trying all these builds: UserWarning: A NumPy version >=1.17.3 and <1.25.0 is required for this version of SciPy. Without this, I kept hitting the numpy incompatability error for all the runs.

The issue seems to be happening during installation of the whl file. The newer pip version expects the name to be in a different format (first - needs to be before the version name) and fails with the below error due to this:
ERROR: Invalid requirement: 'onnxruntime-rocm==inference':
Expected end or semicolon (after name and no valid version specifier)
onnxruntime-rocm==inference

PR to downgrade pip version to fix the issue with installation of whl file: https://github.com/ROCm/DeepLearningModels/pull/1624

PR merged in.


[Android]  couldn't find "libbugsnag-ndk.so"

Description
I upgraded Bugsnag-react-native to the latest version, and some users are getting crash when they tried to open the app. I am getting an error in bugsnag :
java.lang.UnsatisfiedLinkErrorMainApplication.java:146
What did I miss in the configuration ? I am using RN 0.59 with gradle 5.4.1 and useAndroidX set to true.
Thanking you in advance,
Regards
Issue
java.lang.UnsatisfiedLinkError · dalvik.system.PathClassLoader[DexPathList[[zip file "/data/app/com.appchoose.choose.android-1/base.apk"],nativeLibraryDirectories=[/data/app/com.appchoose.choose.android-1/lib/arm64, /system/lib64, /vendor/lib64]]] couldn't find "libbugsnag-ndk.so"

Environment

simulator/emulator or physical device?: Physical

debug mode or production?: production

[X ] (Android only) BugsnagReactNative.start(this) is present in the
onCreate method of your MainApplication class?

Error messages:
ava.lang.UnsatisfiedLinkError · dalvik.system.PathClassLoader[DexPathList[[zip file "/data/app/com.appchoose.choose.android-1/base.apk"],nativeLibraryDirectories=[/data/app/com.appchoose.choose.android-1/lib/arm64, /system/lib64, /vendor/lib64]]] couldn't find "libbugsnag-ndk.so"

Thanks for the report, @tgensol. What version of Android is on the device?

I have errors with :
5.0.2 (XT320)
7.1.1 (samsung SM-G930F)
7.1.2 (Pixel)
9 (ONEPLUS A6003)

Hi @tgensol - I've tried following the integration instructions in our examples/plain sample app in this project and wasn't able to reproduce this behaviour on a Nexus 4 running API 22. I'm using bugsnag-react-native v2.21.0, v4.4.0 of the bugsnag gradle plugin, and gradle 4.10.2.
I also decompiled the APK using Android Studio's APK analyzer which confirmed that the SO files are in the lib directory of the APK. Would you be able to confirm whether you can reproduce this behaviour consistently, or whether your app differs from this setup at all?
If your app uses APK splits or App Bundles that would also be very useful to know, and particularly what architectures you build for if so. This error can sometimes be caused by users side-loading an APK split which is the wrong architecture for their device, so it'd be good to rule that out.

Hi @fractalwrench ,
Thanks for your help ! I also tried myself to reproduce it, but I cannot... It only happens on ~50 users (over thousands of users),

I am using gradle 5.4.1
I am using App Bundles

Maybe my build.gradle file is mis-configured ?
I am using
  ndk {
            abiFilters  "armeabi-v7a", "x86", "arm64-v8a", "x86-64"
        }
and

splits {
        abi {
            reset()
            enable enableSeparateBuildPerCPUArchitecture
            universalApk false  // If true, also generate a universal APK
            include "armeabi-v7a", "x86", "arm64-v8a", "x86-64"
        }
    }

whereas in your examples you are using :
        ndk {
            abiFilters "armeabi-v7a", "x86"
        }
    }
    splits {
        abi {
            reset()
            enable enableSeparateBuildPerCPUArchitecture
            universalApk false  // If true, also generate a universal APK
            include "armeabi-v7a", "x86"
        }
    }

I will put an example of error I got today :
batteryLevel   0.4
brand   samsung
charging false
cpuAbi  [
  "armeabi-v7a",
  "armeabi"
]
dpi 420
emulator false
freeDisk<PHONE_NUMBER>2
freeMemory 125098104
manufacturer  samsung
model SM-A510F
networkAccess cellular
orientation portrait
osName android
osVersion 7.0
runtimeVersions {
  "osBuild": "NRD90M.A510FXXU8CSC3",
  "androidApiLevel": "24"
}

Uploading bugsnag_error_stacktrace_java.lang.UnsatisfiedLinkError_event_5d079e9100441e60ec760000.txt…
Best regards

Hi @tgensol - your build.gradle seems configured correctly. If you're using App Bundles then sometimes this can result in an UnsatisfiedLinkError if a user side-loads an APK with the wrong architecture, as no native library will be found by Android. Keepsafe wrote a great post explaining this in more detail here.
Would you be able to send in a URL of an UnsatisfiedLinkError from your bugsnag dashboard to<EMAIL_ADDRESS>and a link to this issue for context? I'll then be able to view additional information that's available in the error report, which might reveal whether this is a different issue from APK side-loading.

Hi @fractalwrench , our app also encountered this issue. Here is the issue link to our dashboard.

Hi @pqkluan
We've taken a look at your error and the occurrences fall into two cases.

Error message: ... couldn't find "libbugsnag-ndk.so"
We believe this error is due to users side-loading an APK split generated from an App Bundle which is the wrong architecture for their device. Keepsafe wrote a great blog post where they found similar behaviour was caused by users downloading the wrong APK from a 3rd party source.

Error message: dlopen failed: couldn't map "/.../split_config.arm64_v8a.apk!/lib/arm64-v8a/libbugsnag-ndk.so" segment 0: Permission denied
Another customer was able to reproduce this error by installing from an APK built from an App Bundle using Google Play and moving the app to SD card storage. They found the issue went away when they downgraded Android Gradle Plugin to 3.2. We believe this is likely an issue with Android Gradle Plugin as even removing the Bugsnag library, they found the issue persisted with a different native library.

Hi, @mattdyoung Thanks for the advice, but I don't think the 1st theory is possible since there are more than 150 users affected by this issue, and there shouldn't be not that much people willing to manually install our app outside of PlayStore.
For the 2nd one, downgrading the Android Gradle Plugin is also not a possible solution for us since there are other dependencies require newer gradle version.

Hi @pqkluan
Regarding 1, roughly what percentage of your userbase are the 150 users? Are you seeing this only on particular devices?
For 2, there is very little we can do as this is an issue with Android Gradle Plugin:
https://issuetracker.google.com/issues/127691101
That thread suggested that using android.bundle.enableUncompressedNativeLibs=false should work around the issue.

I encounter the same error on my dev build since Android Studio 3.5 and gradle update...

@ben-j69 thanks for your comment. I don't know if you saw @mattdyoung response above?

Another customer was able to reproduce this error by installing from an APK built from an App Bundle using Google Play and moving the app to SD card storage. They found the issue went away when they downgraded Android Gradle Plugin to 3.2. We believe this is likely an issue with Android Gradle Plugin as even removing the Bugsnag library, they found the issue persisted with a different native library.

seeing the same issue as @ben-j69 with 2.23.1, it did not reproduce on 2.22.4

With react-native 60, build tools is now at 3.5.0: https://github.com/facebook/react-native/blob/4763000554c71be40b82a740651706781acad2e3/template/android/build.gradle#L15

Hi @benoitdion
Which error are you seeing?
Is it one of the errors referred to in my previous response here?
https://github.com/bugsnag/bugsnag-react-native/issues/369#issuecomment-517284896
Or something different?
Would you be able to write in to<EMAIL_ADDRESS>with a link to the related error in your Bugsnag dashboard so we can examine the full stacktrace and see if we can identify the cause?

I have same issue.

@khonkaengame
Are you seeing one of the 2 errors described in my previous response here?
https://github.com/bugsnag/bugsnag-react-native/issues/369#issuecomment-517284896
Also v4.6.5 of which library?

It's Bugsnag.unitypackage library.
On Wed, Sep 25, 2019 at 8:35 PM Matt Young<EMAIL_ADDRESS>wrote:

@khonkaengame https://github.com/khonkaengame
Are you seeing one of the 2 errors described in my previous response here?
#369 (comment)
https://github.com/bugsnag/bugsnag-react-native/issues/369#issuecomment-517284896
Also v4.6.5 of which library?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/bugsnag/bugsnag-react-native/issues/369?email_source=notifications&email_token=AKCBWDACGSLOHTSRAQHZHWTQLNSLZA5CNFSM4HYU4UW2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD7R5R7Y#issuecomment-535025919,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AKCBWDBQYXI6PIKJWWODAJDQLNSLZANCNFSM4HYU4UWQ
.

@khonkaengame are you able to say which of the errors you are seeing?
Are you getting
Error message: ... couldn't find "libbugsnag-ndk.so"
or
Error message: dlopen failed: couldn't map "/.../split_config.arm64_v8a.apk!/lib/arm64-v8a/libbugsnag-ndk.so" segment 0: Permission denied

@abigail-bugsnag
I am getting couldn't find "libbugsnag-ndk.so"

Hi @khonkaengame
We've seen this error caused by users side-loading an APK split generated from an App Bundle which is the wrong architecture for their device.
Are you able to reproduce this error on an app installed from the play store, rather than an APK downloaded from an unofficial source?

Hi @khonkaengame @pqkluan @ben-j69 @benoitdion (and anyone else seeing this error).
We've been investigating further and there are a few scenarios where linkage errors can occur which would result in you seeing the error message ... couldn't find "libbugsnag-ndk.so":

User side-loading an APK from an installation source other than Google Play with the wrong architecture
Android's PackageManager not always copying native libs when installing, further details here: https://medium.com/keepsafe-engineering/the-perils-of-loading-native-libraries-on-android-befa49dce2db
A now resolved gradle plugin bug that caused some app bundles not to contain the correct native library

These intermittent linkage errors can occur particularly on older versions of Android. Our suggested approach to avoid them would be to preload the SO file with ReLinker:
ReLinker.loadLibrary(this, "bugsnag-ndk");
Bugsnag.init(this);

If you're also using our ANR detection you may see a similar error message ... couldn't find "libbugsnag-plugin-android-anr.so" for which we'd recommend the same approach:
ReLinker.loadLibrary(this, "bugsnag-plugin-android-anr");
Bugsnag.init(this);

We did consider including and using ReLinker directly in bugsnag-android but decided against it as this would have had an impact on the size of the library, even for customers unaffected by this issue.

Sorry for my ignorance.
How to use ReLinker in unity project?

@mattdyoung  Thank you i will try.


🦾it's possible to have or develop line spiner bar like material line spinner ?[feat]:

Feature description
Hello, i like shadcn ui, and i use for many project, i want to suggest or if it possible to have line spinner bar for loading animation (indeterminate, determinate).
Affected component/components
No response
Additional Context
Additional details here...
Before submitting

[X] I've made research efforts and searched the documentation
[X] I've searched for existing issues and PRs

This issue has been automatically closed because it received no activity for a while. If you think it was closed by accident, please leave a comment. Thank you.


Static files problem in Django 1.10.4

It could be a good app, but I had to uninstall it.
I followed all the instructions, but the following pages just don't show up - http 404:
{% static 'django_js_routing/router.min.js' %}
{% url 'django_js_routing:routes' %}

The command:
./manage.py findstatic django_js_routing/router.min.js

returns:
No matching file found for 'django_js_routing/router.min.js'.

And the url /django_js_routing/ returns:

Request Method: | GET
http://[mywebsite.com]/django_js_routing/
1.10.4
TemplateDoesNotExist
django_js_routing/routes.js
c:\virtualenvs...\lib\site-packages\django\template\loader.py in get_template, line 25

Did you try install with pip using this way:
pip install -e https://github.com/magdkudama/django-js-routing.git@master#egg=django_js_routing
or in your requirements file, add the following line:
-e git+https://github.com/magdkudama/django-js-routing.git@master#egg=django_js_routing


I can't launch it in android studio

Error: Not found: 'dart:ui'
import 'dart:ui' show lerpDouble;

https://stackoverflow.com/questions/52483773/dartui1-error-not-found-dartui-flutter-dart

yeah i got it, thx

thank you @l-k22 ! now I think it's safe to close it.


Multiple queries from a topic caused multiple reads

Example:
--read flows_traffic
load kafka.`base_features` options
`kafka.bootstrap.servers`="test:6667"
and `failOnDataLoss`="false"
and valueFormat="json"
and valueSchema="st(field(name,string),
field(age,integer))"
as kafka_post_json;

select * from kafka_post_json as cache_table;

--query1
select
count(*) as cnt from cache_table
group by name, window(timestamp,"1 minutes","60 seconds") as query_table1;

--query2
select
count(*) as cnt_age
from cache_table
group by age, window(timestamp,"1 minutes","1 minutes") as query_table2;

Query 1 and Query 2 will read the same kafka data twice. This is a design problem for spark, but is there any solution?

This situation seems no harm.

ok.thanks


[Content provider]Return cifmw_operator_build_output var to child job

The child job depends on content provider. The content provider
needs to return cifmw_operator_build_output var to the child job
so that child job should consume the proper operator images
to do the deployment.
This patch also removes the hardcoded content provider ip
and replace it with var. It also moves the tasks to discover
the content provider ip in pre and pass it as a var to
the inner ansible call.
Note: It also fixes the operator_build role to include
the operator image during make_bundle.
Signed-off-by: Chandan Kumar<EMAIL_ADDRESS>
This PR has:

[ ] Appropriate testing (molecule, python unit tests)
[ ] Appropriate documentation (README in the role, main README is up-to-date)

/approve
This will make the whole work far, far better, with a 1:1 match of the "late" content-provided job used in tripleo env. Thank you Chandan!


Use eslint instead of jshint

I have add more flexible linter eslint with initial config. In future this config will be updated to suit our needs, anyway now it supports all backbone base es6/es7 features including gulp tasks.

:ok:

:+1:


Flag doesn't work for address

Somehow the -webhook flag works for new blocks (bithook blocks -webhook=http://webhook/path), but it doesn't for address subscription, as in
bithook address 1xxxxxxxx -webhook=http://webhook/path
I've changed the code to parse the url as an arg (not a flag), and it works fine.
What could be wrong?

Hi @off-bank,
Sorry for the late response. According to https://golang.org/pkg/flag/:

Flag parsing stops just before the first non-flag argument ("-" is a non-flag argument) or after the terminator "--".

I updated the code to check if the last argument is a url and use that as the webhook. So the following example should now work:
bithook address 1dice8EMZmqKvrGE4Qc9bUFf9PX3xaYDp http://requestb.in/nt5bcnnt
Thanks for reporting this!


Docker container produces zombies

TODO: Have a look into that to see how and why this happens.
=> Hacky solution here: https://aymericbeaumet.com/prevent-chromedp-chromium-zombie-processes-from-stacking
Problem with the solution there is, that possibly we will have multiple instances running in parallel and killing Chrome will be trouble.

9765f6f71627e19601443b562ed278ae28d8bbbd did not work out... still trying


Sprint B: Components Library User Journey Map

Description
Specify which part of the system we're working in.
User Story
As a member of the Button Innovation Team,
I want a visualization of the process users go through when using the Toolkit Components Library.
So that I can reference it as the project evolves.
Acceptance Criteria

Column 1 Header
Column 2 Header
Column 3 Header

Row 1 Column 1
Row 1 Column 2
Row 1 Column 3

Row 2 Column 1
Row 2 Column 2
Row 2 Column 3

Row 3 Column 1
Row 3 Column 2
Row 3 Column 3

Given
When
Then
Pass/Fail (TBD by reviewer)

I'm on the Innovation Team Miro Board
When I navigate to the components library research section,
I find a Journey Map for toolkit components library users
---:

---:

N/A
N/A
N/A
---:

N/A
N/A
Alec has signed off on the Journey Map
---:


QA: change in issue creator multiplier

Lorem Ipsum is simply dummy text of the printing and typesetting industry. Lorem Ipsum has been the industry's standard dummy text ever since the 1500s, when an unknown printer took a galley of type and scrambled it to make a type specimen book. It has survived not only five centuries, but also the leap into electronic typesetting, remaining essentially unchanged. It was popularised in the 1960s with the release of Letraset sheets containing Lorem Ipsum passages, and more recently with desktop publishing software like Aldus PageMaker including versions of Lorem Ipsum.

one
two
three
four

console.log(`hello world`);

Lorem Ipsum is simply dummy text of the printing and typesetting industry. Lorem Ipsum has been the industry's standard dummy text ever since the 1500s, when an unknown printer took a galley of type and scrambled it to make a type specimen book. It has survived not only five centuries, but also the leap into electronic typesetting, remaining essentially unchanged. It was popularised in the 1960s with the release of Letraset sheets containing Lorem Ipsum passages, and more recently with desktop publishing software like Aldus PageMaker including versions of Lorem Ipsum.

/start


Various micro-optimizations

Scope & Purpose
This PR contains a zoo of small changes:

Adds new metric arangodb_transactions_expired to track the total number of expired and then garbage-collected transactions
Clarifies scope of another metric in the CHANGELOG
Improves debug and warning log messages, by providing a bit more context
Downgrades some log messages for recoverable errors into warnings (to comply with our log levels policy)
micro-optimization for arangodump (no allocation of StringBuffer for masking data when no masking is used)
micro-optimization for /_api/import handling: we can turn off returnOld even in case onDuplicate=update or onDuplicate=replace, because we are only using the "old" attribute in the return to distinguish inserts from updates/replaces. Setting returnOld is overkill here however, because it will return the full previous version of the document(s), which can be large. Instead, go with the much small _oldRev attribute that is also set when a document is updated/replaced.

[ ] :hankey: Bugfix (requires CHANGELOG entry)
[x] :pizza: New feature (requires CHANGELOG entry, feature documentation and release notes)
[ ] :fire: Performance improvement
[x] :hammer: Refactoring/simplification
[ ] :book: CHANGELOG entry made

Backports:

[x] No backports required

Testing & Verification

[x] This change is already covered by existing tests, such as shell_client, shell_server, importing, dump.

Link to Jenkins PR run:
http://<IP_ADDRESS>:8080/view/PR/job/arangodb-matrix-pr/13760/

Tests blue

Tests blue

http://<IP_ADDRESS>:8080/view/PR/job/arangodb-matrix-pr/13775/

http://<IP_ADDRESS>:8080/view/PR/job/arangodb-matrix-pr/13775/

Tests blue again after merging a substantial devel change.

Tests blue again after merging a substantial devel change.