Use cobra for parsing multiple env variables

Fixes: https://github.com/openshift/source-to-image/issues/417
@bparees this one is tricky :-) Basically, you can specify a multiple environment variables, by providing multiple -e FOO=BAR flags. The syntax we supported before was that you can use something like: -e FOO=BAR,TEST=FOO.
So this is introducing a backward incompatible change. I wonder if we want to make it backward compatible (basically do additional string.Split() in the Set() function) or leave it as this (which is consistent with other flags).

@GrahamDumpleton FYI

[test]

bleah.  I don't like our options here :)
but yes, maybe continuing to support comma as well is the best thing to do.  though it means you can't have a comma in your env variable value still, right?

@bparees yes that was always the case... you can workaround that by using -e FOO=bar, -e BOO=far

@bparees updated :-)

@bparees bump

[merge]


META: Features to be added to this repo

@MarkPieszak we chatted about having a running list of branches with "add-ons" to this repo. Let's list them here for visibility

[ ] JWT Auth
[ ] Cleanup HomeController

Have code in a separate file so that the Controller itself is very clean and only contains any additions, maybe transferData they want to pass from C# -> Angular.

[ ] Make Webpack even more extensible for those coming from JSServices.

Somewhat done, might be easier to basically rename the existing one, webpack.base and have the config file extend and merge everything in from it with the overrides we want.

It would be useful to include routing management (Angular 2 routing and Asp.Net core routing) in case of a controllers with Area (https://docs.microsoft.com/en-us/aspnet/core/mvc/controllers/areas)

@isaac2004 can you please share if there is any progress with above?

@naveedahmed1what are you looking for?

Since the old Http in Angular has been marked as depreciated. So I was wondering if there is any update on:
HttpInterceptors  , Utilize new TransferState (which is now in Core) and Re-work aspnetcore-engine.

@naveedahmed1not officially part of the repo, but there is an issue with a ton of code in it.

Sounds great! Can you please share the link? Specifically with update on HttpInterceptors and new TransferState in Core?

@naveedahmed1 look at the issue list in this repo


Sample image with network tiling

Hi Moagrius ,
First like to thank for real quick answer and appreciate that . I am not able to find out what cause performance issue when i use online tiling with sample (preview) image . File paths are correct but the memory keep increasing. For lower memory devices such as s3 , note 2 which i tested on , got app hang.
Btw i used , my own customBitmapDecoder

What large is your sample image?  Both dimensions and file size

it is 4000 x 4000 and the size is 422.6k .

yeah that's way too big.  i normally use about 500x500, and even then it's a noticeable performance hit.  unfortunately, i don't know any way around this - in fact lately, i've been not using downsamples at all (and in version 2, that API will be removed - you can still do it, but it won't be built in).
Sorry I don't better news

yeah that's sound doesn't too good . my intention is to show map scale image instead of blank image and waiting for tile to b redrawn .

The only thing I can suggest is go with a much smaller image.  Like I said, I use 500x500 (roughly) and let them stretch - it's definitely distorted, but the goal is just to give the user an idea of position while the tiles render.  Managing all that image data is a big ask of the device.


Add detection if 'dotnet' is not on the path on RHEL

Steps to reproduce
Machine: Red Hat Enterprise Linux 7.2

Follow instructions on https://github.com/Microsoft/MIEngine/wiki/Logging#using-shipping-bits to install the CLI
Install VS Code
Install the C# extension

Expected  behavior
Debugger should restore, projects should build, OmniSharp should be able to run dotnet restore, etc.
Actual behavior
None of these work because 'dotnet' isn't on PATH
Work around
Launch VS Code from the .NET environment with:
scl-enable rh-dotnetcore10 code

Hi! Since you make calls to dotnet restore (what about dotnet run?) I wouldn't recommend workaround 2 or 3. Both of them add the dotnet binary to path, but miss out on other things.
For example, currently on RHEL 7, /path/to/dotnet run will use the system version of libcurl.so, which is linked against nss compared to the rh-dotnetcore10-libcurl version of libcurl.so which is linked against openssl. The scl command overrides LD_LIBRARY_PATH to make this happen.
In the future, using scl may also set up additional NuGet repositories for dotnet to use, so that may cause an additional difference between invoking dotnet directly compard to using scl.
Yet another workaround is to do something like scl list-collections | grep dotnet and then try and use scl enable <name from previous command> -- dotnet instead of the dotnet command from VS Code. This way, you can do things like scl enable rh-dotnetcore10 -- dotnet restore -v which works just like dotnet restore -v should. And the user doesn't have to launch VS Code in an scl session.

Thanks @omajid
I removed those work arounds from the original list (they are listed here in case someone wants to understand what your comment referred to in the future).
Old work arounds (not recommended)
2: setpath.sh
Add a setpath.sh script to /etc/profile.d directory with the contents: export PATH=$PATH:<path-to-directory-containing-dotnet>. Make it executable (i.e. chmod 777). Log out and log back in and dotnet is now always on the path.
3: Create a symlink to dotnet from a directory on PATH

I'm running into the same issues, but with VS Code Remote Development extension.
As a workaround I could create a symlink from dotnet to ~/bin/dotnet and it starts working fine.
But how can we actually use the suggested solution scl-enable rh-dotnetcore10 code with VS Code Remote Development extesion?

@Swimburger your issue is similar, but NOT the same. The command you are quoting is specific to the RedHat distribution of the .NET Core SDK, and is therefore NOT at all what you want. I am not sure why the VS Code extension host you are using isn't seeing the PATH changes that the .NET SDK installer would make. But if you want to open another issue we can see if we can help. Note that this isn't a problem with this extension, but we will see if there is something we can advise on.

Closing this as a lot has changed since this issue was opened.


Create 2022-05-26.md

Announcement about synced_at deprecation and the return of the 2 new fields in our API
Title of the change and version
Products affected

[x] SDK
[x] API
[ ] Admin UI
[ ] Nodes

Is this a breaking change?

[x] yes
[ ] no

Description of the change
Text Description
What exactly can break?
Write some sentences about what could go wrong if people don't upgrade their logic. Give some examples.
How to ensure my app won't break?
Explain what needs to be done to avoid the apps breaking.
When will this change go live and be mandatory?
Exact date
Link to Moralis Forum for disucssions
Create a thread in Moralis forum in this category (https://forum.moralis.io/c/changelog/20) and name the thread with the same TITLE as this MR and link it here
We have staff monitoring forum 24/7 - while we don't monitor github as much - so we need everyone to discuss in the forum
Code Examples
Give as many code examples as possible for different scenarios.
Best practices
Explain best practices

Hi - I noticed that the new system/procedure is working, as I've been
notified of a functionality 'breaking' change? - However, in this instance,
I have NO knowledge of the breakage mentioned, as the relevant fields are
not filled in...  :(
Getting there though, cheers!
Den.
On Thu, May 19, 2022 at 2:51 PM Ivan Liljeqvist @.***>
wrote:

Merged #2 https://github.com/MoralisWeb3/changelog/pull/2 into main.
—
Reply to this email directly, view it on GitHub
https://github.com/MoralisWeb3/changelog/pull/2#event-6642737314, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AL7ZJGHQ2RQYVOCQXHNJEEDVKZBPXANCNFSM5WMJPRGQ
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>


API Server Foundation

Issue Number

#96
Overview

[x] I have define a new module Cardano.Wallet.Api.Server containing handlers and servant server foundation to implement the API
[x] I have moved some types from 'Cardano.Wallet.Primitive.Model' to 'Cardano.Wallet.Primitive.Types'
[x] I have (partially) implemented the getWallet and postWallet handlers from the API, leveraging what's already available in the wallet layer
[x] I have slightly reviewed the signatures of methods in the wallet layer to make them less polymorphic (removed the monad parameter, turned out to not be useful since everything runs in IO anyway. So, I've kept the parameterization actually focused on what matters --> the wallet state)
[x] I have added the WalletMetadata to the return type of getWallet in the wallet layer, but haven't implemented it so far (relying on lazyness here to not break everything). I'll do in a next PR.

Comments

the compilation error is strange :


AsyncView http request loops inside a TabView

The http request keeps on looping if i place this inside a TabView. What is the workaround for this? Please advise.

The http request keeps on looping if i place this inside a TabView. What is the workaround for this? Please advise.

@chitgoks oh, i'm having the same problem.
I think the root cause is adding task (or refreshable) to View.
So, render view -> task call -> task finished -> render view -> .... and loops
public var body: some View {
        AsyncResultView(
            result: model.result,
            reloadAction: { Task { await model.load() } },
            content: content
        )
        .task {
            await model.loadIfNeeded()
        }
        .refreshable {
            await model.load()
        }
    }

Ref: async-function-swiftui

I fixed by:

Remove task and refreshable
Handle Task in init function of model

public init(asyncOperation: AsyncOperation? = nil) {
        if let asyncOperation {
            asyncOperationBlock = asyncOperation
        }
        Task {
            await load()
        }
    }

p/s: I'm happy if this package gets fixed, it's worth looking forward to

I actually got this to work. but seeing as im new to ios, my knowledge is limited.
I placed the AsyncView inside another container, say, a ZStack. Works good.
But i do not understand why.

I also tried as you said but it only solves the infinite loop problem.
When i switch to another tab and come back again, api is called again and view will re-render and view's state not kept.
Anyway congrats on solving your problem. ✌✌✌

also us3d to have that problem. i guess inside your body is only the async view?
what i did was something like
if let obj then show ui
else show asyncView block code


Which the cell will be unlocked and why?

NervosDAO withdrawal must be completed within 42 epochs(~ 7 days) since the withdrawal started; otherwise, anyone can unlock the cell.

I am not sure why there is the limitation when this idea implemented, could you explained more ?
I love this idea so much!

Good question! I write a document to explain this https://github.com/jjyr/DCKB/wiki/Half-withdrawal

Many thanks,could I translate it into Chinese?

Sure.


cmd/server: clarify shutdown logging

Issue: https://github.com/moov-io/watchman/issues/214

Codecov Report

Merging #216 into master will decrease coverage by 1.11%.
The diff coverage is 0%.

@@            Coverage Diff            @@
##           master    #216      +/-   ##
=========================================
- Coverage   68.31%   67.2%   -1.12%
=========================================
  Files          31      31
  Lines        2964    2964
=========================================
- Hits         2025    1992      -33
- Misses        744     785      +41
+ Partials      195     187       -8


get token labels in Google Sheets

Inspect manually the current token classification that we have.

Confirm whether the current categories make sense.
Think about other obvious categories

In practice, this involves looking at the .csv file where each row is a token, and the categories it belongs.
Report insights.

Done!
The token labels are not quite right.
So we should try to re-label the categories semi-manually.


Porting Beast web server app to WebAssembly (Not sure if this is okay to ask here)

I'm done with building my application, but I'm having some trouble deploying (would be nice if I knew of a free web hosting site that accepted an app that also has its own web server where said server actually worked as intended--would also be good to have shell access so that I can set environment variables).  So I was wondering if I could port the web server app to WebAssembly.  I need to know if there's a way to execute the server app correctly in that case, like as a web server extension to Node.js or something like that.
I read that WebAssembly requires networking code to be asynchronous, so I know I have to switch to the asynchronous HTTP server from the synchronous one.  First, though, I'll just show the code (as before, I have it on Gist).
C++ code: https://gist.github.com/DragonOsman/d00ea7ec3d49c128ad7789293f156a09
HTML code: https://gist.github.com/DragonOsman/506bd2bae1dfe4c03a4bbe2a6d830324
CSS code: https://gist.github.com/DragonOsman/3f3ba56ffd58476c6defaea95b066dc2
JavaScript code: https://gist.github.com/DragonOsman/c6e8fb15343544e662f474c5a526d1c2
Is this a good question to ask here, or should I keep it to the WebAssembly support forums?  Hopefully I can at least find some web hosting advice here (note: I know neither my router's password nor how to find it, so I can't serve it from my own machine (can't do port forwarding)--which also crosses out reverse proxy).

I don't think Boost.ASIO supports web assembly at this time, so you might find it extremely hard to use that as a deployment option. Honestly, I think you're going to have better luck finding a service that accepts docker images. I know Heroku has a free plan (with a monthly runtime limit) and it accepts docker images, so you might have better luck with it.

I'll have to compile the code for Linux for that, right?  Right now I only have a .exe file.

A project that has a valid CMake list should be buildable (and installable) on Linux with
mkdir build
cd build
cmake -DCMAKE_BUILD_TYPE=Release ..
cmake --build . --config Release --target install

When it comes to building boost, here's an example of how you might get boost in your docker image:
https://github.com/djarek/boost-docker/blob/master/gcc/7/Dockerfile
It's not ideal, but should get the job done. Note that that is a development/CI dockerfile, in a release image you might want to only install the release libraries (no headers).

Someone on a C++ GitHub server that I know gave me a Dockerfile before for my app, but when I tried to use it, I had some errors.  Nlohmann JSON's path is probably different from the one my code needs, for example.  And the file also doesn't include the static assets (HTML/CSS/JavaScript).
This is that guy's message on GitHub from back then:
Here is the Dockerfile https://gist.github.com/kevinkjt2000/bcc9bdbf457007a47720b65f967c7e57
Use it by building it docker build -t currency . and run it with something like docker run -d --name -p 8080:80 currency currency.  Logs can be read with docker logs currency.  I have to make a grocery run now, but I will gladly answer questions when I return if I see any here.

Error and warning messages from back then (when I tried to deploy my app to Docker with that Dockerfile:
[WARNING]: Empty continuation line found in:
    RUN apk --no-cache add      boost-dev       cmake   git     g++     make
[WARNING]: Empty continuation line found in:
    RUN git clone --branch v${JINJA_2_CPP_VERSION} --depth 1    https://github.com/flexferrum/Jinja2Cpp.git /tmp/Jinja2Cpp
[WARNING]: Empty continuation line found in:
    RUN apk --no-cache add      boost-dev       g++
[WARNING]: Empty continuation line found in:
    RUN apk --no-cache add      boost-system    libstdc++
[WARNING]: Empty continuation lines will become errors in a future release.

Cloning into '/tmp/Jinja2Cpp'...
Note: checking out '84af922ca27586b97123dcb7ee2306af5fabacfb'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:

  git checkout -b <new-branch-name>

Connecting to github.com (<IP_ADDRESS>:443)
Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (<IP_ADDRESS>:443)
json.hpp               2% |                               | 16975   0:00:34 ETA
json.hpp              37% |***********                    |   219k  0:00:03 ETA
json.hpp             100% |*******************************|   581k  0:00:00 ETA

currency_converter.cpp:28:29: fatal error: nlohmann/json.hpp: No such file or directory
 #include <nlohmann/json.hpp>
                             ^
compilation terminated.

Could I see how to write this Dockerfile correctly, including the part for Boost that you linked?  I need to get all of the dependencies to work correctly, so: Boost.Beast (not standalone, and version 1.68.0), NlohmannJSON (https://github.com/nlohmann/json/ ), and Jinja2Cpp (https://github.com/flexferrum/Jinja2Cpp/ ).  I'm new to Docker and Dockerfiles, so please help me out here.
Would be good if I could just deploy my .exe with the static assets as they are to a Docker image and use that, but I'm worried about whether I'll have to buy a license for a Windows Server image.

@DragonOsman you're missing installation step for nlohmann json. I'd also recommend writing a CMake file for your own project to get rid of the hassle of managing all these include/linker flags.

Nlohmann JSON is a header-only library, isn't it?  We just have to build tests and stuff, right?
Anyway, I have a Dockerfile right now that I'm trying to use to build a Docker image.  I'm having problems building Boost.Build, though, and I don't know how to check bootstrap.log (it says to check bootstrap.log).
 -DCMAKE_INSTALL_PREFIX=../install \
    && cmake --build . --target all
RUN git clone https://github.com/nlohmann/json.git
RUN apt-get install g++
RUN apt-get install build-essential
RUN g++ -std=c++17 -Wall -pedantic -I /usr/local/jinja2cpp/install/include -I /usr/local/boost_1_68_0/ -I /usr/local/json/single_include/ -L /usr/local/jinja2cpp/build/ -llibjinja2cpp.a -L /usr/local/boost_1_68_0/stage/lib/ -llibboost_system.a currency_converter.cpp -o currency_converter
EXPOSE 80
ENV apikey **************************************************
ENV accesskey ****************************************
CMD ["./currency_converter", "<IP_ADDRESS>", "8080", "."]

[I hid the API Key and Access Key using those asterisks.  Don't mind that.]
I also want to know if my include and library directory compiler flags are correct, but I can't worry about that until I've fixed the Boost installation issues.

I looked around and made some changes to the Dockerfile:
FROM ubuntu:18.04
WORKDIR /app
COPY . /app
USER root
RUN apt-get update
RUN apt-get install -y wget
RUN apt-get install cat
RUN wget https://dl.bintray.com/boostorg/release/1.68.0/source/boost_1_68_0.tar.bz2 \
    && tar -xjf boost_1_68_0.tar.bz2 \
    && rm -rf boost_1_68_0.tar.bz2 \
    && cd boost_1_68_0 \
    && ./bootstrap.sh \
    && cat bootstrap.log \
    && ./b2 install
RUN apt-get install git
RUN git clone https://github.com/flexferrum/jinja2cpp.git
RUN git submodule -q update --init
RUN cd jinja2cpp
RUN mkdir build
RUN cd build \
    && cmake .. -DCMAKE_INSTALL_PREFIX=../install \
    && cmake --build . --target all
RUN git clone https://github.com/nlohmann/json.git
RUN apt-get install g++
RUN apt-get install build-essential
RUN g++ -std=c++17 -Wall -pedantic -I /usr/local/jinja2cpp/install/include -I /usr/local/boost_1_68_0/ -I /usr/local/json/single_include/ -L /usr/local/jinja2cpp/build/ -llibjinja2cpp.a -L /usr/local/boost_1_68_0/stage/lib/ -llibboost_system.a currency_converter.cpp -o currency_converter
EXPOSE 80
ENV apikey AIzaSyDpOhTTtJXh6EyO_iyH26tV5tSPTH5FgDo
ENV accesskey 6118470d67d40caf1f4db130ec67e1e8
CMD ["./currency_converter", "<IP_ADDRESS>", "8080", "."]

If the cat command works, I'll view that log file.

Okay, I got that problem fixed but need help in figuring out where the Boost libraries got installed in the container.  It seems like the headers are somewhere in /usr/local/include, but I want to know if they're in /usr/local/include/boost.  And I also don't know where in /usr/local/lib the compiled library files are, exactly.  Are they going to be in boost/stage/lib inside /usr/local/lib?  Thanks for replies and help.


[WFLY-12371] Upgrade H2 to 1.4.199

https://issues.jboss.org/browse/WFLY-12371

Closing; causes failures.


Entrypoint in app.yaml doesn't work for flexible env on nodejs

Describe the bug
The docs here and here show that you can use entrypoint as a setting in app.yaml for flexible environments, but I have not been able to get it to work on nodejs.
Instead of executing the command in the entrypoint, it instead executes npm start, or if not available, will try to execute the index.js in the root of the project.
Additional context
How are you using GCP buildpacks?

[ ] pack and the gcr.io/buildpacks/builder
[ ] Cloud Functions
[ ] Cloud Run
[ ] Cloud Build
[ ] App Engine Standard
[x] App Engine Flex
[ ] Firebase App Hosting

Did this used to work?
Unknown
What language is your project primarily written in?
Node.js
Steps To Reproduce
Steps to reproduce the behavior:

setup hello world project
add entrypoint option to app.yaml file with entrypoint: echo "Entry point has executed"
Update npm start in package.json to "start": "echo \"Package.json npm start has executed\"",
Deploy to app engine

Full app.yaml file for reference:
runtime: nodejs
env: flex
entrypoint: echo "Entry point has executed"
runtime_config:
  operating_system: ubuntu22
  runtime_version: 20
automatic_scaling:
  min_num_instances: 1
  max_num_instances: 1

Expected behavior
Expect logs to show "Entry point has executed"
Actual behavior
Logs show Package.json npm start has executed
If applicable, add screenshots / logs / error messages

I have the same issue.
I'm using flexible env with nodejs and it still runs with the "npm start" command.
In my case my entrypoint is
node dist/main.js


Improve @nb_extract macro

Hi @ederag, thinking back at the discussion on zulip and how Base.eval is always executed in the toplevel, I tried modifying the macro to have a more graceful behavior on that regard.
Now the function itself is evald inside the __module__ with a gensym'd name so that it's still at top level but you are not really polluting the module with sensible names.
The macro itself then just performs a forward to the gensym'd function call like so
fun(a) = MODULE.#xxx#fun(a)

This way you get the reactivity of Pluto without the need of a if false block and you also only bring into the current scope the escaped function name (so it's global only within a begin/end block but not within a let block).
I also added the strip_types function in order to correctly forward function signatures with typed arguments
Here is a small gif of the behavior:

This is awesome, what a smart way to solve the problem of local scope with macros evaluating only in global scope !
The tests run fine, but there is a regression on a real use case, where the function accepts a keyword argument
(if this is indeed the issue, it should be fixable, but I'll first try to replicate with a smaller test tomorrow)

So it seems that if you pass a default value to one of the arguments my strip_type does not work as the expression is different:

The fix should not be difficult, if you want I can try fixing it

I think I saw a function in some package that did exactly this removal of function types, let me search a bit and report back ?

Just tried a simple fix to see if tests pass now. If you find something more true and tested ofc it would be good to swap out strip_types

Maybe this one: name_only,
from Expronicon.jl which seems powerful.
using ExproniconLite

def = @expr JLFunction function foo(x::Int, y::Real=2; z = 3)
end

name_only.(def.args)
[:x, :y]

name_only.(def.kwargs)
[:z]

But it might be as easy to deepcopy the dict,
use splitarg and just dump the type and default ?
This require more thoughts, and this PR is already a huge improvement, so I'd be tempted to merge as is.

I believe any option you put is about polishing the internals but wouldn't change the user facing API.
Especially if that would require some more though, I am in favor of merging this and just polishing the internal as a subsequent PR


Remove exception logging in queryMaterial

I removed an unnecessary Throwable#printStackTrace call and included the caught exception with the raised exception.
I had an issue with it polluting my console window because of my library usage (I have other behavior for null values).
[02:23:24 WARN]: java.lang.IllegalArgumentException: WATER material could not be queried!

Thanks!


Separating unconditional throttle cfg b/w inter & intra dc replica threads

Fixes #1055
Also removes a superfluous arg in the ReplicaThread constructor
Setting values for inter > intra also allows for a coarse way of preferring local replication over remote

Codecov Report

Merging #1056 into master will decrease coverage by 0.07%.
The diff coverage is 84.84%.

@@             Coverage Diff              @@
##             master    #1056      +/-   ##
============================================
- Coverage     68.56%   68.49%   -0.08%
+ Complexity     4805     4799       -6
============================================
  Files           382      382
  Lines         30408    30446      +38
  Branches       3867     3869       +2
============================================
+ Hits          20849    20853       +4
- Misses         8526     8543      +17
- Partials       1033     1050      +17

Impacted Files
Coverage Δ
Complexity Δ

...m.github.ambry.replication/ReplicationManager.java
37.83% <ø> (ø)
11 <0> (ø)
:arrow_down:

...ava/com.github.ambry/config/ReplicationConfig.java
100% <100%> (ø)
1 <0> (ø)
:arrow_down:

...m.github.ambry.replication/ReplicationMetrics.java
75.12% <100%> (+0.56%)
15 <0> (ø)
:arrow_down:

...va/com.github.ambry.replication/ReplicaThread.java
72.5% <66.66%> (-0.52%)
60 <0> (ø)

...java/com.github.ambry.store/CompactionManager.java
86.75% <0%> (-3.32%)
19% <0%> (ø)

...rc/main/java/com.github.ambry.store/BlobStore.java
81.64% <0%> (-3.2%)
68% <0%> (-4%)

...github.ambry.rest/AsyncRequestResponseHandler.java
88.59% <0%> (-2.29%)
23% <0%> (ø)

...b.ambry.network/BlockingChannelConnectionPool.java
63.47% <0%> (-2.18%)
8% <0%> (ø)

.../java/com.github.ambry.router/DeleteOperation.java
92.19% <0%> (-1.42%)
47% <0%> (-1%)

...in/java/com.github.ambry.store/BlobStoreStats.java
70.41% <0%> (-1.08%)
101% <0%> (-1%)

... and 6 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8ca33b4...593b89c. Read the comment docs.


Unable to execute bash/zsh functions in --bind

[x] I have read through the manual page (man fzf)
[x] I have the latest version of fzf
[x] I have searched through the existing issues

Info

OS

[ ] Linux
[x] Mac OS X
[ ] Windows
[ ] Etc.

Shell

[x] bash
[x] zsh
[ ] fish

Problem / Steps to reproduce
I feel like this must have come up before but was unable to find an issue!
I'm trying to bind a key to execute a function set in the shell—set locally for demo purposes but the same happens in .zshrc files.
It fails in zsh:

It fails in bash too:

I've tried to look into the source to figure it out myself but am unfamiliar with how Go works so struggled to make any progress: https://github.com/junegunn/fzf/blob/cd2340141100e057005d31e653c0ce7a0f7a4af7/src/util/util_unix.go#L12

foo() {
  echo foo
}

# You should export the function
export -f foo

fzf --preview 'foo'

Thanks!
For anyone else who finds this issue, the problem was that functions aren't available to child processes.
Unfortunately in ZSH, it looks like you can't export functions - the recommended alternative is to use autoloaded functions instead, or you could make a proper script and add it to your $PATH.
I just put all my scripts in big strings 🤷♂


Move log functions into new file + Add docstring and type annotations for each log functions

I move all of the log functions logger.py to categorize the function so the code looks cleaner and easier to be working with
and I also add a docstring and add type annotations to all of the log functions to help you work with the function easier with type intellisense.

Great improvement, definitely needed some organization! Thanks!


feat: support split-chunks-max-size

Summary

Checklist

[ ] Tests updated (or not required).
[ ] Documentation updated (or not required).

!bench


attestation-agent: fail fast on broken AMD certs

Currently the milan vendor certs from AMD are bundled and parsed each time there is verification in process attestation. While this should never fail, we cannot panic! as it would impact healthy TEE implementations.
As an alternative we can fail fast on init of the verifier, indicating a problem at an earlier point. We also don't need to process the raw bytes multiple times, the vendor certs can be cached once parsed.
This impacts both SNP verifiers (snp + az-snp-vtpm)

Needs a rebase


ENG-1158 | Skip formula flow-chart generation

Skip formula flow-chart generation.

Will added option to generate flow-charts


Remove collections from a media model if it's bool | null | empty-string | empty-array

This is applicable for:

$media->syncCollection()
$media->detachCollection()

Tasks:

[x] Functionality
[x] Tests

Resolved in #8


iRep and bPTR values lower than one

Dear all,
When we analyzed our dataset using your pipeline, we got values lower than 1 for samples in bPTR analysis. Can you explain me what is the meaning of having values lower than one both for iRep and bPTR? Any thought will be useful. Thank you so much.
Best wishes,
Bahti

Hi Bahti,
Values lower than one are an artifact of the PTR method. This happens when coverage at the origin and terminus are very similar, and random variation in coverage causes the terminus to be higher than at the origin. It also indicates that there may have been an issue correctly identifying the location of the origin and/or terminus of replication.
iRep is calculated differently, and as such it is not possible to have values lower than one. Values of one, or close to it, indicate a lack of replication.
Hope this helps!
Chris

On Oct 23, 2019, at 5:56 AM, Bahtiyar YILMAZ<EMAIL_ADDRESS>wrote:

Dear all,
When we analyzed my data using your pipeline, we got values lower than 1 for samples in bPTR analysis. Can you explain me what is the meaning of having values lower than one both for iRep and bPTR? Any thought will be useful. Thank you so much.
Best wishes,
Bahti
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

Hey Chris,
Thank you so much for your help and explanation. This is really helpful. I think those samples of mine should be lack of replication.
Thanks a lot for your time.
All the best,
Bahti


'Add text' - Double scroll appears when a long text is entered into the "Text editor" window

Affected versions:
Remote, Standalone
Steps to reproduce:

Launch Ketcher.
Click on the 'Add text' button.
Click on the canvas.
Enlarge the "Text editor" window till the vertical and horizontal scrolls appear.
Insert the following text into the "Text editor" window:
New Text Document.txt
Scroll down.

Expected result:
5. The text is inserted into the "Text editor" window. It's possible to see the whole text using the horizontal scroll.
6. Only two scrolls (1 horizontal and 1 vertical) are present in the "Text editor" window
Actual result:
5. The text is inserted into the "Text editor" window. Only part of the text can be seen with horizontal scrolling.
6. Three scrolls (2 horizontal and 1 vertical) are present in the "Text editor" window.

The issue is closed as fixed


Bugfix for Steam games with old branches that lack "timeupdated"

fix #9
From issue:
Some games with old branches lack a timeupdated timestamp.
One example is Kenshi (ID 233860)

LGTM. Will be merged in #13.


Is this generator a recommended boilerplate for feathers database adapters?

thanks for reply

Yes. It doesn't really matter where the resource comes from. Could also be an API, file system, etc.

To add a little to it, this generators is the base for all the Feathers plugins that we publish to npm, including if you would like to provide an adapter for another database to the community. To create your own adapter the application service generator (feathers generate service and then choosing that you want to write your own) would be sufficient.


Fix 5625 - fix observer volume

Document that the observer origin is in world space.
Update the observer volume update to properly transform the coordinate space.

@fast-slow-still, can you please validate this change (review the code and test your scenario)?
Fixes: #5625

/azp run

@fast-slow-still,
There is a test failure that appears to be related to this change. It feels like the transform is causing the meshes to not be placed correctly... I will add you as a collaborator to my fork. please feel free to push any changes.

/azp run

/azp run

It looks like the test failure was a red herring. After running the failing test both in isolation and in the full suite several times locally without error, I re-ran the tests on CI and all three passed. That was before any code changes.
I did push a few minor tweaks. Mostly I clarified the distinction between camera space and the camera's parent's space, and took advantage of the camera's parent being known to be the MixedRealityPlayspace.
I also added the rotation of the ObserverVolume's orientation from world to Playspace.
These are all pretty minor, so if you want to rollback my push, I'm fine with that. My situation was already fixed by your changes.
I do want to stress that this only affects the region of the world in which spatial meshes are generated, but does not affect the positioning of meshes.

Thanks @fast-slow-still! I love your changes.


ignoreLocation=true does not apply when useExtendedSearch=true

Describe the bug
The scoring logic is not ignoring Field Norm when using extended search. When not doing pattern matching, ignoreFieldNorm works as expected but with extendedSearch, it returns results with shorter string scoring higher.
Version
v6.4.0
Is this a regression?
Not sure
🔬Minimal Reproduction
data = [ longest string, longer string, long string];
fuse.search('string');
// with extendedSearch=false & ignoreLocation= true
result = [ longest string, longer string, long string];
// with extendedSearch=true & ignoreLocation= true
result = [ long string, longer string, longest string ];
Additional context
We are sorting data alphabetically, and so we want to use IgnoreFieldNorm to maintain this order and show matches while ignoring length of strings it matches with.

Is this still an issue? It seems the be case for me too!

Also seeing this issue. It's a bit of a problem because without the flag the search defaults to only 60 characters

6.4.3 fixes this!


Large repo size due to binary files change history

Thank you for your great work with this project, it is a good tool that is useful to improve syzcaller-based bug detection!
However, there is a problem with downloading the repo originally: as of now, the history of auto-pushed binary corpora is quite large. The corpora themselves are not huge, but being binary and being auto-pushed to repo frequently by robot, it leads to naively-cloned repo being quite large (13 GB, about 2 times larger then linux kernel repo). This leads not only to large hdd used space (which could be limited on a syzcaller-based-fuzzer machine) but to long cloning time. As the robot keeps pushing binary corpora, the problem might get even worse in the future.
My solution was to use git clone --filter=blob:none option while clonning, which leads to much more manageable 581 MB repo size.
I would suggest adding blobless-clone recommendation to the DIY section in the README file.

You do not need to clone the repo to use the artifacts. You may just download the releases directly. Also, you might just be able to download the latest source from https://github.com/cmu-pasta/linux-kernel-enriched-corpus/archive/refs/heads/main.zip which is currently 243 MB.


Override path formatting method for data-URIs

This PR fixes an issue where UPath.stat is broken for data-URIs:
>>> from upath import UPath
>>> UPath('data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAIAAACQd1PeAAAADElEQVQI12PYeuECAASTAlbqXbfWAAAAAElFTkSuQmCC').stat()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/josiah/.local/share/hatch/env/virtual/euporie/afiNbXov/euporie/lib/python3.11/site-packages/upath/core.py", line 339, in stat
    return self._accessor.stat(self)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josiah/.local/share/hatch/env/virtual/euporie/afiNbXov/euporie/lib/python3.11/site-packages/upath/core.py", line 66, in stat
    return self._fs.stat(self._format_path(path), **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josiah/.local/share/hatch/env/virtual/euporie/afiNbXov/euporie/lib/python3.11/site-packages/fsspec/spec.py", line 1514, in stat
    return self.info(path, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josiah/.local/share/hatch/env/virtual/euporie/afiNbXov/euporie/lib/python3.11/site-packages/fsspec/implementations/data.py", line 34, in info
    mime = pref.split(":", 1)[1].split(";", 1)[0]
           ~~~~~~~~~~~~~~~~~~^^^
IndexError: list index out of range

This occurs because fsspec.implementations.data.DataFileSystem.info expects the full URI including the scheme as a parameter, while currently only the path component is passed.

Thank you for your contribution ❤
I made a few changes and ported it to the soon to be released UPath version.


UI changes - Tosha

Folder structure setup with basic ui form

React hooks - dynamic dropdown
https://www.codegrepper.com/code-examples/javascript/How+do+I+update+states+onchange+in+an+array+of+object+in+React+Hooks
https://www.carlrippon.com/drop-down-data-binding-with-react-hooks/

Pros of using hooks:

Easy to test and maintain (Functional components are easier to read and test with less code, before hooks the functional component had a limitation, since it couldn't have its local state and lifecycle-hooks)
Huge classes can be broken down into smaller functional components
Functional components make it easy to create reusable, isolated components to avoid redundant logic
Hooks might reduce your bundle size

Cons of using hooks:

Have to respect hooks rules using linter plugin
Takes time to learn and practice
Hooks don't access specific lifecycle methods, hooks use useEffect which uses all lifecycle methods in one

References:

<EMAIL_ADDRESS>https://medium.com/@mateuszroth/react-hooks-advantages-and-comparison-to-older-reusable-logic-approaches-in-short-f424c9899cb5
https://medium.com/@garyncookie/react-hooks-pros-and-cons-c0b151b4d950

How to use componentDidMount in React Hooks? https://medium.com/@felippenardi/how-to-do-componentdidmount-with-react-hooks-553ba39d1571#:~:text=The equivalent of componentDidMount in hooks is the useEffect function.&text=Functions passed to useEffect are,a second argument to it.

Overriding CSS: https://stackoverflow.com/questions/51928722/how-to-override-bootstrap-theme-colors-in-bootstrapped-react-redux-app


Sublime text functionality not the same as tern.js website demo

Hi there, I might be asking something stupid but I'm a newbie so bear with me :)
In the tern.js website demo (http://ternjs.net/doc/demo/), if I type, for instance:
var x = pr
and then press CTRL + SPACE, the autocompletion dialog pops up and I can get:
var x = prompt
then if I add a parenthesis, as in:
var x = prompt(
I can get the documentation for that function:

prompt(message: string, value: string) -> string

So I end up with something like this:
var x = prompt("Foo");
Then I can type:
x.
Press CTRL + SPACE and I will get all the string functions:

charAt, indexOf...

In ST3 I can't get any of this functionality. If I type:
var x = pr
And press CTRL + SPACE it won't show the prompt() function.
Also, if I have:
var x = prompt("Foo");
And then type:
x.
It won't recognize var x as a string so it won't show the string functions autocompletion.
Is this the expected behaviour or is my instalation not working properly?

This sounds a lot like you're forgetting to include the "browser" type definitions, and thus Tern doesn't know about prompt.
Add a .tern-project file containing something like {"libs": ["browser"]} to your project directory.


How to deal with fragments that are not anchored on the chromosome, after I ran run-asm-pipeline-post-review.sh.

Hello,
After I ran run-asm-pipeline-post-review.sh,I found that there are still many fragments(about 10%) that are not anchored on the chromosome.Can you give me some suggestions for improvement, or artificially anchor it on the chromosome?
Thanks!

Thank you very much for your quick reply！
I have an idea: because 3d-dna needs to interrupt and correct contig, it also depends on the quality of HiC data. So, I want to last the interrupted sequence to contig (many broken sequences are dropped from contig), and then anchor the interrupted sequence to the chromosome based on the contig information without interruption.

I do not understand what you mean. Perhaps you are describing sealing which is performed by the pipeline, but I am not sure. Note that if those sequences are indeed due to misassemblies, you should not be reincorporating them.

On Nov 16, 2018, at 8:35 AM, fantasticair<EMAIL_ADDRESS>wrote:
Thank you very much for your quick reply！
I have an idea: because 3d-dna needs to interrupt and correct contig, it also depends on the quality of HiC data. So, I want to last the interrupted sequence to contig (many broken sequences are dropped from contig), and then anchor the interrupted sequence to the chromosome based on the contig information without interruption.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub https://github.com/theaidenlab/3d-dna/issues/30#issuecomment-439307139, or mute the thread https://github.com/notifications/unsubscribe-auth/AJYGG3n3oM_es6g0_K8dVycLlj2vGhujks5uvmq8gaJpZM4YlnLt.

Also, since this is not really a bug or code issue, I suggest that this discussion is moved to aidenlab.org/forum.html http://aidenlab.org/forum.html where we try to give user support. There may be some discussions threads already there that may be relevant to your case.
Best,
Olga

On Nov 16, 2018, at 9:00 AM, Olga Dudchenko<EMAIL_ADDRESS>wrote:
I do not understand what you mean. Perhaps you are describing sealing which is performed by the pipeline, but I am not sure. Note that if those sequences are indeed due to misassemblies, you should not be reincorporating them.

On Nov 16, 2018, at 8:35 AM, fantasticair<EMAIL_ADDRESS><EMAIL_ADDRESS>wrote:
Thank you very much for your quick reply！
I have an idea: because 3d-dna needs to interrupt and correct contig, it also depends on the quality of HiC data. So, I want to last the interrupted sequence to contig (many broken sequences are dropped from contig), and then anchor the interrupted sequence to the chromosome based on the contig information without interruption.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub https://github.com/theaidenlab/3d-dna/issues/30#issuecomment-439307139, or mute the thread https://github.com/notifications/unsubscribe-auth/AJYGG3n3oM_es6g0_K8dVycLlj2vGhujks5uvmq8gaJpZM4YlnLt.

Ok,thanks for your suggestion.


XeGTAO not working correctly underwater

When im underwater with XeGTAO enabled, I get a shadowy outline of my character which is offset up and left a little bit

Yeah there's no way to fix this since reshade doesn't know when you're underwater, sorry.


[Doc] 3.1-add-shared-data-related-feature

Fixes #issue
What type of PR is this:

[ ] BugFix
[ ] Feature
[ ] Enhancement
[ ] Refactor
[ ] UT
[x] Doc
[ ] Tool

Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] This pr will affect users' behaviors
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto-backported to the target branch

[x] 3.1
[ ] 3.0
[ ] 2.5
[ ] 2.4

@mergify backport branch-3.1


Bug: Theming - using mat-color(background, hue) where hue is a palette property results in sass compile error

Bug, feature request, or proposal:
Enhance background and foreground palettes on generated themes to include
all properties that a palette is featuring usually.
What is the expected behavior?
The foreground and background palettes are complete, e.g.
$mat-grey: (
  0: #ffffff,
  50: #fafafa,
  100: #f5f5f5,
  200: #eeeeee,
  300: #e0e0e0,
  400: #bdbdbd,
  500: #9e9e9e,
  600: #757575,
  700: #616161,
  800: #424242,
  900: #212121,
  1000: #000000,
  A100: #ffffff,
  A200: #eeeeee,
  A400: #bdbdbd,
  A700: #616161,
  contrast: (
    0: $black-87-opacity,
    50: $black-87-opacity,
    100: $black-87-opacity,
    200: $black-87-opacity,
    300: $black-87-opacity,
    400: $black-87-opacity,
    500: $black-87-opacity,
    600: $white-87-opacity,
    700: $white-87-opacity,
    800: $white-87-opacity,
    900: $white-87-opacity,
    1000: $white-87-opacity,
    A100: $black-87-opacity,
    A200: $black-87-opacity,
    A400: $black-87-opacity,
    A700: $white-87-opacity,
  )
);

What is the current behavior?
The scss will not compile because the foreground and background palettes feature only
some magic constant values like background, raised-button, card among others.
What are the steps to reproduce?
Define and include a scss file that uses mat-color, e.g.
@import '~@angular/material/theming';

@mixin my-custom-component-theme($theme) {

    $background: map-get($theme, background);
    $foreground: map-get($theme, foreground);

    my-custom-component {
        background-color: mat-color($background, 300, 0.3);
        color: mat-color($foreground, A400, 0.9);
    }
}

What is the use-case or motivation for changing an existing behavior?
Expectation that foreground and background are a full palettes on a theme and available when applying custom theming to custom material components. Otherwise its hard to find out what is available, especially since all the other palettes primary, accent and warn are fully available.
Which versions of Angular, Material, OS, TypeScript, browsers are affected?
beta.5

Foreground and background palettes are a different format from the primary/accent/warn palettes because the Material Design spec is more specific on those colors. Neither is just "grey" or similar; they're their own thing.
https://material.io/guidelines/style/color.html#color-themes


crypto/tls: Upgrade draft-ietf-tls-esni-12 to 13

Drops support for the previous version of ECH and adds support for the
latest. Changes include:

An optional GREASE extension for the acceptance signal in the
HelloRetryRequest. Our server implements it.

The rules for parsing the "encrypted_client_hello" extension are
stricter.

@Lekensteyn can you please take a look?


update link to EllipsisNotation repo

These should all become internal links to the docs, but I'll take that for now.


Adding contributing guidelines

resolves #99
I used puppet and atom docs as examples. The filename CONTRIBUTING.md is standard.
We are missing something like a CLA or Certificate of origin like nodejs. It's not clear to me how critical is to have one, and must it be explicitly signed (using a tool like clahub perhaps?) or is it enough to mention that by contributing, you allow to abide by the CLA.
@mccanne @demmer @dmajda

Looks like a great start to me.

TL;DR. Seriously.
I totally appreciate the effort that went into this, but the contribution guidelines need to be really short, otherwise they will discourage contributions and people wouldn’t read them before opening an issue or a PR, which defeats their purpose.
I think the main goals of the guidelines are:

Help users to create meaningful bug reports and feature requests.
Help developers to create good PRs.
Direct anyone who needs a question answered or needs to get in touch with developers to the right place.

Ideal guidelines would be a minimal document satisfying these goals. But the suggested guidelines are more of a comprehensive overview of our organization, development process, etc. Writing these things down is important, but IMO they should not be part of the guidelines. I’d much rather see something short & sweet, like Nette guidelines. Another example is YaST contribution guidelines I wrote some time ago (but there I would do several things differently today).
So, what about splitting some parts out of the guidelines as separate documents, putting them into the wiki, and just linking them? Beside shortening the guidelines, this would lead to less duplication (and later divergence) between CONTRIBUTING.md files in our various repos.
I’d separate at least these documents:

Project organization (mainly the repo descriptions)
Development workflow (Waffle, issue lifecycle and labels used)

And I’d structure the remaining content as:

Asking questions
Reporting bugs
Requesting enhacements
Contributing code

I’d make these as short as possible (by moving all that can be moved to Development workflow and writing the content from the “minimum the external user needs to know to do X” perspective). Than decide whether these should stay in the guidelines or also be separated.
In any case, the result should be a document where the user who wants e.g. to file a bug quickly finds the relevant section, can read it quickly, and so the right thing. If interested, he can follow the links and read further on how we do things more generally.
@dmehra @demmer Thoughts?

Simplified the doc and took out project organization info to the wiki, https://github.com/juttle/juttle/wiki
I'm going to commit this, otherwise the links back from wiki to CONTRIBUTING.md would 404, but happy to do another pass or have you @dmajda make changes as you see fit.

Eek [TOC] is not a thing in Github markdown... i guess that only works with mkdocs-published documentation. Will fix.

Thanks! I’ll have another look but not an immediate priority.


[Toolkit feature]: Simultaneous multiple Light setup, e.g Stage light + Autoshop

Contact Details (Optional)
No response
What is the context of the feature/improvement?
Ability to select multiple options under Light setup menu, e.g Stage light + Autoshop simultaniously. To see better darkness, without having to rely on the (not yet implemented Camera light) Especially useful when going from indoors to outdoors. Whereas indoors Stage light lets us see, while outside requires One of the Light Rigs to see.
Please describe the feature/improvement?
Include an option to choose two or more light setups/systems. For viewing convenience.
What would be your solution? (optional)
...
Version
2024.1.1

Hi @PappaSlask ,
Would adding the camera light filter solve your problem please?

Hi @PappaSlask ,
Would adding the camera light filter solve your problem please?

I'd say not really. But it would make things a lot better. I already opened an issue about the missing camera light. But that won't make it easier when going from inside a house or room to the outside to view the exteriors. For exterior view Stage lights are still superior. But they won't work inside, so having both of them at the same time would help a lot. Thanks!

Hey,
Perhaps I didn't understand but I believe the initial problem is:

To see better darkness,

Is there a reason that the camera light will not work please? Camera light is an (infinite) light in front of the camera, which would light everything in the front.

Hey,
Perhaps I didn't understand but I believe the initial problem is:

To see better darkness,

Is there a reason that the camera light will not work please? Camera light is an (infinite) light in front of the camera, which would light everything in the front.

You know what, you're absolutely right. But thinking of this in hindsight, it would still be a nice feature to have, instead of having that black void when using the camera light. At least I think we should be able to use both at the same time.

To explain how things work, if you go in this folder:
deps\content\rtx-remix-lookdev-lighting\presets
You will see some USD stages. Those are basic USD stages that you see in the menu, with different lighting.
If an preset is not bright enough, it means he is not well calibrated.
So the solution would not be to "combine" lightings, but to fix the initial problem: the presets are too dark (?).
Also, bonus, but I believe that if you add any USD stage (with lights) in this folder, it will be picked up automatically. From here, you will have your custom lighting. Feel free to create a preset (with USD Composer for example)


Add lost connectivity error

This PR adds a mapping of the ERRCODE_LOST_CONNECTIVITY as it is documented here:
https://www.vertica.com/docs/9.2.x/HTML/Content/Authoring/ErrorCodes/SqlState-V1001.htm
I considered just mapping this error code to the previous one that was mapped (08006 - ConnectionFailure) or just using the generic ConnectionError class. However based on the documentation is seems Vertica treats this condition as a very unique case and I preferred to add an additional class for it.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

QUERY_ERROR_CLASSES does not list all valid errors, it is reasonable to add this new error class if you need it.
Please sign our Contributor License Agreement so that I can merge your PR. Thanks!

@sitingren Thank you for the quick reply! I signed the CLA right after submitting the PR however it still didn't update the status on the PR itself.
If I try to go to the link to sign it again it says it is already signed, and hitting the link to recheck status does not help.
Any way I can help troubleshoot it?

@ianze You signed the CLA with your gmail email, but you push your commit with your @ibm.com email. Try to sign with your @ibm.com email address again.

@vertica-cla sorry about that and thanks for the tip. Should be all set now.


Use language as role

At the moment objects require roles for all supported languages in order to be displayed when selected language version is not available.

This can be solved by reverse roles.
Reverse roles should be prefixed with ! just like regular JS clause reversal.
User A roles are [JP, KR].
User B roles are [DE, ES].
User C roles are [EN].
Tests
[JP]; User A
[EN]; User C
[EN, !JP]; User B & C
[!JP]; User B & C
[EN, DE]; User B & C
This can be done by adding following line to the role check:
  locale.layers = Object.entries(locale.layers)
    .map(layer => {

      if (!layer[1].roles) return layer[0]

      // check whether the layer is available for roles in token.
      if (Object.keys(layer[1].roles).some(
        role => req.params.token && req.params.token.roles
          && req.params.token.roles.includes(role)
          || (role.match(/^\!/) && !req.params.token.roles.includes(role.replace(/^\!/, '')))
      )) return layer[0]
    })
    .filter(layer => !!layer)

The key is to check whether a role starts with an exclamation mark match(/^\!/); And if so check whether that role is not included with the exclamation mark removed from the role !roles.includes(role.replace(/^\!/, ''))

so if I want to show a japanese layer to a japanese user I write on it
 ja: true
but not show the equivalent english layer then on the english layer:
!ja: true
?

Yes.
I added this to the last commit but for layer in get workspace only. https://github.com/GEOLYTIX/xyz/commit/7861bb231153d849ffdc01b959e0ea4228af61d5

You have two ways to control... Either list all the roles for which an object should pass or list a reverse role which should pass if the role is not found.
This way that role can even have filter. It's not specific to languages but should apply to any form of role.

For example:
      "layers": {
        "Mapbox Base JP": {
          "template": "Mapbox Base",
          "roles": {
            "jp": null
          }
        },
        "Mapbox Base Not JP": {
          "template": "Mapbox Base",
          "roles": {
            "!jp": null
          }
        },
        "Mapbox Base": {
          "display": true,
          "template": "Mapbox Base"
        }
      }

Mapbox Base will always be seen by anyone. Logged in to English or Deutsch I see the Base and Not JP layers. Logged in to Japanese I see the Base and JP layer, but not the 'Not JP' layer.

added to docs.


[Feature]: add a test for duplication in the current database with CKAN

Guidelines

[X] I agree to follow this project's Contributing Guidelines.

Description
We are allowing data to go up onto CKAN but there is currently no way to validate that someone else didn't change the record on there since other people can have access. We should store data in a more secure place and then create a mechanism to check it.
Problem
No way to validate that CKAN data isn't changed or reverse it if it is.
Proposed Solution
Send data to S3 then create a batch script to alert if database is changed on CKAN.
Alternatives Considered
USE internal CKAN features.

Implemented in https://github.com/Moore-Institute-4-Plastic-Pollution-Res/Microplastic_Data_Portal/commit/73216ae7e8ab824b0c34742bfa61bb13541a36ad


Tidying up a few pages of documentation.

Redirect test/simple.mlir to test/iree-run-[module,mlir].mlir in docs (split in https://github.com/google/iree/commit/32b3101ba74d0283b49304d1e8062ba9a2db2585, https://github.com/google/iree/issues/4667 has other ideas for how to address this)
Use ../iree-build/ consistently in getting started linux cmake doc.
Fix link to moved file and delete old RenderDoc instructions. (integration was dropped as part of https://github.com/google/iree/issues/4369)

Fixes https://github.com/google/iree/issues/4667
Fixes https://github.com/google/iree/issues/4704 (as filed - there are likely more outdated docs)

Note that no changes will be published to https://google.github.io/iree/ until https://github.com/google/iree/issues/5124 is fixed.


Demarcate routes for roles inside ['middleware' => ['auth']] group and correctly reassign route

1st issue
I have this:
Route::group(['middleware' => ['auth']], function() {

    Route::group(['prefix' => 'admin'], function() {
        Route::get('/', 'HomeController@index');

        Route::resource('/users','UserController');
        Route::resource('/blog','BlogController');
    });
});

How'd I make access to /users only for superadmin?
Route::resource('/users','UserController',['middleware' => 'role:superadmin']);

doesn't work(
2nd issue
I had
Route::get('/home', 'HomeController@index');

I want to change home to admin, I changed accordingly in controller, views and in routes, but console still show me home for this route. I already cleared route cache, it didn't help.

What Laravel version are you using?  Also, I am curious why you would put routes to the HomeController in  the Admin namespace/Auth middleware; are you requiring a login to see anything in your site? (not saying you are wrong, just curious).

@manzwebdesigns I'm using Laravel 5.2. I already changed home to admin (that was by default from guide where I found about this package).

@Tarasovych Okay, so I am making the assumption that you have a superadmin role and that the link I gave didn't help you.  Did you look at this link: https://laravel.com/docs/5.2/authentication#protecting-routes? I am wondering if you have your middleware and/or your authentication set up correctly.
For issue 2, are you using the Home controller index method to service the route or did you move it into an Admin controller or ...?  It would make sense to me if you would set up the index method in an Admin controller to handle admin stuff.
HTH,
Bud

@manzwebdesigns about 2nd issue
I used HomeController@index for /home URI.
Now I want to use it for / URI, I did some changes and now I have:
web                                                                                |
|        | GET|HEAD                       | /admin                                  |                               | App\Http\Controllers\HomeController@index

web                                                                                |
|        | GET|HEAD                       | home                                         |                               | App\Http\Controllers\HomeController@index                                 |

for routes:
Route::group(['middleware' => ['auth']], function () {

    Route::group(['prefix' => 'admin'], function () {
        Route::get('/', 'HomeController@index');
    });
});

hmmm, I am not sure with 5.2, I have no experience with it.  Sorry!


DOC: Add grid-in-grid example.

An example inspried by Melinda's use case at XPD

Don't merge quite yet -- there is a sphinx problem.

Sphinx issues fixed. Self-merging this docs-only PR.
@tacaswell You mentioned you made an improved version of this using Poisson noise for your APS talk. I failed to easily reverse-engineer that so please submit the patch if you still have it.


Computer crashes after a few hours

Computer randomly turns off and back on after a few hours of using HD plugin. Plugin runs seemingly completely fine up until that point, then crashes when it's about to load a new area in game.
I played a few days without HD with no problems so I'm assuming it's a problem with HD and my computer together.  I didn't have any crashes for days without the HD plugin and I get multiple per day with it.
Specs;
Windows 10 pro 64-bit 10.0 build 19042
Intel core i7-7700k cpu
16 gb ram
AMD radeon rx 480 gpu
driver version: 30.0.13017.5006
I checked my runelite logs and there aren't any logs at the time of crashing, probably because it's a full computer crash, not just Runelite.

This sounds more like an instability with your system rather than plugin itself. A couple of things you can try:

Update your graphics drivers
Run a CPU/GPU stress test to rule out any system instability
Run a memory test

It may also be a problem with your PSU.

I'll run the tests. I wanna note that it only happens with rl running the
hd plugin though. It doesn't matter if rl is all I'm playing or if I have
it in the background and I play other seemingly more stressed games like
Rust often. I had also previously checked my task manager periodically
while playing rl and the CPU, gpu, and power consumption were all fairly
low. Below 40% with normal power usage. They were high before turning down
shader settings, but I crashed either way.
On Tue, Nov 9, 2021, 3:41 PM Fraser-Watson @.***> wrote:

This sounds more like an instability with your system rather than plugin
itself. A couple of things you can try:

Update your graphics drivers
Run a CPU/GPU stress test to rule out any system instability
Run a memory test

It may also be a problem with your PSU.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/RS117/RLHD/issues/170#issuecomment-964525135, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AJEHM73NI6DR5EMLNJWA3GTULGBN7ANCNFSM5HDFN4MA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

I have since some time the same issues, however I have the error. This makes my pc shut down too
2022-01-07 17:32:10 [Client] INFO  rs117.hd.HdPlugin - Using device: NVIDIA GeForce RTX 3070/PCIe/SSE2
2022-01-07 17:32:10 [Client] INFO  rs117.hd.HdPlugin - Using driver: 4.6.0 NVIDIA 497.29
2022-01-07 18:00:58 [Client] ERROR injected-client - Game crash: null
com.jogamp.opengl.GLException: Error swapping buffers
at jogamp.opengl.windows.wgl.WindowsWGLDrawable.swapBuffersImpl(WindowsWGLDrawable.java:93)
at jogamp.opengl.GLDrawableImpl.swapBuffers(GLDrawableImpl.java:88)
at rs117.hd.HdPlugin.drawFrame(HdPlugin.java:1995)
at rs117.hd.HdPlugin.lambda$draw$10(HdPlugin.java:1491)
at rs117.hd.HdPlugin.invokeOnMainThread(HdPlugin.java:2549)
at rs117.hd.HdPlugin.draw(HdPlugin.java:1491)
at am.onPost(GameEngine.java:90)
at am.t(GameEngine.java)
at am.run(GameEngine.java:316)
at java.base/java.lang.Thread.run(Thread.java:834)


apache-airflow: fix dependencies

Motivation for this change
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[ ] Fits CONTRIBUTING.md.

chardet update likely breaks things

I have locally run git rebase --onto=upstream/staging --onto=upstream/master HEAD~2 to prevent a ping to many people but somehow it still happened.

chardet update likely breaks things

Which packages would be most likely affected? I could split out the version if required.

@dotlambda Thanks! Applied all your suggestions.
After #115375 I want to check how big the breakage will be for the chardet update by building some packages eg home-assistant.

@SuperSandro2000 Why was this closed?

Because I didn't feel like fixing apache-airflow which I am not using and regularly breaks.


Rename repo

I suggest to rename the repo to flame-docs. Why it is needed? - Well first of all, that would be simpler to fork, especially when you might have already some repos named "docs". Also it is easier to clone.

for what, @FedorLap2006?


[WIP] Qasm2 functional interface to qasm translation

Summary
Add a load() / unload() interface to qasm translation as a first step to untangling qasm from QuantumCircuit.
Details and comments
Suggested by @1ucian0
Reviewers will likely suggest more work, but this is pr is pretty self-contained and complete and supplements the existing code without yet changing QuantumCircuit itself.

Thanks for bringing this up! This is a good first step towards #1742 . Once up a time, @jaygambetta suggested this API:
from qiskit.converter import load, export
circuit = load(import_object, type='openqasm')
export_object = export(circuit, type='openqasm')

I think something like closer to what you have here is better indeed:
from qiskit import qasm
circuit = qasm.load(import_object, include_path=<opt,str>, format=['filename', 'string',...])
export_object = qasm.export(circuit, filename=<opt,str>)

I'm not fully sure about the export/unload API. ideas @ajavadia, @kdk ?
I will try to find some time to also push some code in the branch so we remove the 2 in qasm2.

circuit = qasm.load(import_object, include_path=<opt,str>, format=['filename', 'string',...])

I guess import_object is str or List{str]
What is format=['filename', 'string',...]

export_object = qasm.export(circuit, filename=<opt,str>)

I can proceed with this change.

I'm not fully sure about the export/unload API. ideas @ajavadia, @kdk ?

Let me know.

I will try to find some time to also push some code in the branch so we remove the 2 in qasm2.

Thanks, qasm2 was just a way for me to make sure I didn't pollute the extant code base.

What's the philosophy? Should I trap file errors and make them QiskitError or just let it blow up?

The latest change provides for exporting qasm to a file object as well as a file name.

Build seems to have gone completely nuts. I haven't changed my code and now the builds are failing with this error:
Traceback (most recent call last):
testtools.testresult.real._StringException: Traceback (most recent call last):
  File "D:\a\1\s\test\python\test_qasm2.py", line 37, in setUp
    self._circ_draw = y_f.read()
  File "c:\hostedtoolcache\windows\python\3.7.6\x64\lib\encodings\cp1252.py", line 23, in decode
    return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: 'charmap' codec can't decode byte 0x90 in position 22: character maps to <undefined>

There is no 0x90 in the position described. What is this, please?

It seems like an encoding error in the input file. Did you change the input file?

It seems like an encoding error in the input file. Did you change the input file?

I haven't changed anything. The tests are being triggered by me merging changes periodically from Qiskit/qiskit-terra master branch. My code hasn't changed. I have even examined the file in a hex editor. The supposed error in test_qasm2.py, line 37, position 22, is the letter a in self._circ_draw, hex 0x61.

I think the test failure is only happening on Windows testing.

This is some kind of problem with the Windows build conveyor.
$ od -hc test_qasm2.py  | grep 90
# returns nothing

# in Midnight Commander hex dump shows this.
5F 63 69 72 │ 63 5F 64 72 │ 61 77 20 3D │ 20 79 5F 66 │ 2E 72 65 61 │ 64 28 29 0A │ 20 20 20 20 │ 20 20 20 20  _circ_draw = y_f.read().

The error is UnicodeDecodeError: 'charmap' codec can't decode byte 0x90 ...
There is no 0x90 in the entire file. There's something wrong in the Windows build.

The error you're hitting isn't in the qasm file it's in the text drawer. the 0x90 character is in the text visualization, which is not part of the windows character encoding. See: https://github.com/Qiskit/qiskit-terra/issues/2616

The error you're hitting isn't in the qasm file it's in the text drawer. the 0x90 character is in the text visualization, which is not part of the windows character encoding. See: #2616

Thanks for clarifying, @mtreinish ... that was driving me nuts! w/r/t #2616 ... well, I guess we have more information now ;)

The error you're hitting isn't in the qasm file it's in the text drawer. the 0x90 character is in the text visualization, which is not part of the windows character encoding. See: #2616
So should I just disable some of my test cases so this goes through?

This is still in my ToDo. It needs some refactors but it's not high priority for now.

This is still in my ToDo. It needs some refactors but it's not high priority for now.

Not something you can describe in few words simply enough that I can do the work?

Mostly merging qasm and qasm2 modules. I also need to have a deeper look. Hopefully I will find some time soon-ish.

This PR is moving towards https://github.com/1ucian0/qiskit-openqasm2


Feature: implement Dockerfile

Closes https://github.com/hsjoberg/dunder-lsp/issues/21

Nice LGTM 💯


Update delete command

Update the delete command to delete on the basis of both index and name

Other than maybe including some more tests, LGTM


[Spotify Player] add warning for adding a duplicate song to a playlist

Extension
https://www.raycast.com/mattisssa/spotify-player
Description
It would be nice to have a visual warning if I add the same song twice to one playlist.
Who will benefit from this feature?
People who add one song to multiple playlists.
Anything else?
No response

I'll pick this one up

So I've been looking into this one this evening and I'm not sure that it is worth implementing. TLDR there isn't a very good API query for this use case and so it would be super slow.
You can check whether a song is in a user's saved tracks by a using the /me/tracks/contains endpoint. However, there is no equivalent for a playlist. So, the next best option I can see is to get the list of tracks and check the IDs of the tracks against the ID of the track we are trying to add. There is a GraphQL esque input on the playlist tracks API calls which means we can save on the amount of data we are fetching. However, even when only fetch track IDs, it's capped to 50 tracks per call.
This means that we would have to make two sequential API calls.

Fetch total tracks count
Fetch all tracks (in batches of 50 concurrently)

So, it's possible and I don't think it would be unusably slow, but I don't think it's worth giving up the snappy experience for. Plus, I'd imagine the use case for adding to a playlist via Raycast is primarily for new songs that wouldn't already be in their playlist. If they are managing their playlists I would've thought they'd more likely go the full app.
@mattisssa @peduarte Is it justifiable to close this issue?

Thanks a lot for looking into it @RowMur, let's close this out then. It's better to have a snappy experience! ☺


Unkown firmware Arduino MFRC522

Hello Everyone,
When I open Dump info in MFRC522 I get the following message and couldn't read the card.

Would you please help?
Thank you in advance.

See https://github.com/miguelbalboa/rfid#troubleshooting , do the points of "I don't get input from reader or WARNING: Communication failure, is the MFRC522 properly connected?".
If the problem is not solved you got a broken reader.


question on removal of BPMN.io watermark

Hi, according to https://bpmn.io/license/ -

The source code responsible for displaying the bpmn.io project watermark that
links back to https://bpmn.io as part of rendered diagrams MUST NOT be
removed or changed. When this software is being used in a website or application,
the watermark must stay fully visible and not visually overlapped by other elements.

Can we safely use your code (MIT) without "BPMN.io" watermark? Thanks!

It doesn't matter to me,but I think you should keep it.


fix: fallback to utf-8 encoding if missing

When using this plugin together with clear-action.nvim, the file encoding doesn't get set properly when adding a word to Vim's dictionary. I'm guessing that this is because ltex-utils.nvim tries to get the clear-action.nvim's floating code-action window encoding (nil), instead of the buffer that ltex-ls is in, causing the error attempt to concatenate a nil value.
My fix is to default to "utf-8" if the encoding is nil.

Related: https://github.com/jhofscheier/ltex-utils.nvim/issues/13


Does not support export as "string literal"

🔎 Search Terms
"export as", "string literal"
🕗 Version & Regression Information

This is the behavior in every version I tried, and I reviewed the FAQ for entries about [syntax]

⏯ Playground Link
https://www.typescriptlang.org/play?ts=5.3.0-dev.20231023#code/MYewdgzgLgBAbgQwDYFcCmMC8MCMBuAKDQA8AHEAJ1gG95l0YEIYAiBMGE8qlmAXzxA
💻 Code
const value = 1;
export { value as "an export" };

🙁 Actual behavior
Cannot find module 'an export' or its corresponding type declarations.(2307)

🙂 Expected behavior
It should compile correctly and emit a parseable .d.ts if configured in the project's settings.
See plain JavaScript example:
lib.mjs
const value = 1;
export { value as "an export" };

main.mjs
import * as lib from "./lib.mjs";
console.log(lib);

node main.mjs
[Module: null prototype] { 'an export': 1 }

Additional information about the issue
This fails the "TypeScript is a superset of JavaScript" assertion in the project's description.
Relevant syntax documentation can be found here:
https://developer.mozilla.org/en-US/docs/web/javascript/reference/statements/export#syntax
And in the language specification, 16.2 Modules:
https://tc39.es/ecma262/#prod-ModuleExportName
[...]
ModuleExportName:
  IdentifierName
  StringLiteral

It seems like an exotic request but has benefits for CSS modules which export classes as named exports.

Duplicate of #40594.

Thanks! It didn't turn up in my queries.


64 airdrop addresses

Related Safe Addresses
Full safe address and creator address.
1-address list.csv
2-update, new address..csv
3-update, new address.csv
A total of three forms contain 217 addresses.

Hunting other addresses can be done by observing their USDT receiving addresses, and checking the contract creator addresses.
Check out SSV, it will give you a better understanding.
Reasoning
All safes are created within 250 days, and safe transfer records interact with other creator safes.
After the safes are set up, each safe has executed transactions in close time.

Methodology
View a large number of addresses that create safes, check the token transfer records of their safes, and easily find illegal transfers. The safes created by other addresses have the same USDT receiving address.
And I have collected their addresses to transfer out to other addresses. You can easily find out that he is breaking the rules.
Because he has created a safe with other addresses and has sent USDT to the same receiving address record.
Model:
A creates a safe deposit box - executes transactions with other addresses - safe deposit box sends USDT to C address.
B creates a safe deposit box - executes transactions with other addresses - safe deposit box sends USDT to C address.
When they use safes created at different addresses and send USDT to the same receiving address, it is a violation.
Safe Address
0x3B928329f3dA134c1D72123B7731330D88068777

Waiting for my update tomorrow because I haven't found it all, I only found part of it.

I have completed the statistics, this time the total address is 217 addresses.

All addresses are valid hunting addresses, and the proof is done by checking the USDT receiving address and the contract creator address.

The ssv is created by the creator of the 0x3B928329f3dA134c1D72123B7731330D88068777 contract.
0x7c48b3308f27Ce45EA40BB0593b1355bef17F992

All addresses I have mentioned in #107 , and I am the first to mention valid evidence, hoping to pass the review.

After I did a full relationship chain check, the valid addresses reached 217 addresses.

Although they made a large USDT transaction, it is still impossible to deny that they are doing airdrop farming, and the address listed in my CSV clearly tells us that this is indeed airdrop farming.

Airdrop farming cannot deny him just because he made a large USDT transaction.

Because he himself already has the conditions for airdrop agriculture.
Contracts with different deployment addresses are finally transferred to the same address.

meet the conditions

Safes deployed at different addresses.

Use the safe to transfer USDT to the same address (created by a different address).

You cannot deny your own agricultural behavior because of the large amount of USDT.

Because I think you're right, but I checked #107 and the team has closed it, Lol, for the large USDT transfer.
So why are there so many large USDT transfers? Now that the address is relevant, it proves to be an agricultural practice!

These are Safes storing significant amounts of USD stable coins. Store of value is legitimate use.


There is a bug while adding password to the register form

https://github.com/user-attachments/assets/b89d9875-4b0c-464b-bb20-a92817012d29

ohh okay is it for devices with less width? anyway you can work on it @SuperexMack

nah this happend while i was checking it on pc but the problem with the small devices the password section is not properly responsive

i know it is not a big issue but i mentioned it in case i don't have info regarding this

yeah sure you can work on this, i literally didn't knew this @SuperexMack

@Luson045  Sure, just give me two days. If I can't resolve it within that time, I'll let you know.

@Luson045 I initially worked on the first issue and discovered that it was browser-specific. I was using Microsoft Edge, but after testing it on Chrome, everything worked fine. So, there's no need to fix the first issue. I'll focus on resolving the second one now(that responsive one)

Ohh okay 👍🏻

The password type and the visibility button below conflict with each other.


Please change examples to funnel, not new Funnel

In short, documenting Funnel as a class is leading some devs to treat Funnel differently than other Broccoli and even Node modules. Look how Funnel sticks out like a sore thumb:
var mergeTrees = require('broccoli-merge-trees'),
    Funnel = require('broccoli-funnel'),
    concat = require('broccoli-concat'),
    path = require('path'),
    find = require('lodash/collection/find'),
    fs = require('fs');

If I made a brief PR to change example usages in README, would you accept it?

New should be used with all of them. We are making this te default for all official plugins (and the vast majority of plugins work fine when used with new already).

Fine.


Rename

[x] Update the UI code to reflect the rename.
[x] Update README to reflect rename

[ ] Update screenshots with the new name

updating the screenshot on next release


improving CLI JSON code to deal in cases only IDs been provided + fix…

…ing unit tests to work also on Linux

 Here is an overview of what got changed by this pull request:

Issues
======
- Added 4

Complexity decreasing per file
==============================
+ Ginger/GingerCoreNET/RunLib/DynamicExecutionLib/DynamicExecutionManager.cs  -4

See the complete overview on Codacy


feat: redirect the page for the model generation app conditions

ℹ Based on our team's decision, we no longer require approval of the refactoring pull request. Instead, we will review and approve the refactoring once all changes related to a specific component have been completed.
To test: https://process-analytics-process-analytics-dev-site_preview-pr-1179.surge.sh/model-generation-application-conditions
Covers #1170

See my previous comment


Do not copy codeDir when submit trial in Kubeflow and Frameworkcontroller mode

Fix issue https://github.com/microsoft/nni/issues/1224

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: SparkSnail sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.


[SPARK-40039][SS] Introducing a streaming checkpoint file manager based on Hadoop's Abortable interface

What changes were proposed in this pull request?
Currently on S3 the checkpoint file manager (called FileContextBasedCheckpointFileManager) is available which is based on the rename operation. So when a file is opened for an atomic stream a temporary file will be used behind the scenes and when the stream is committed the file is renamed to its final location.
But on S3 the rename operation will be a file copy so it has some serious performance implication.
On Hadoop 3 there is new interface introduce called Abortable and S3AFileSystem has this capability. When the file is small (<= the block size) this will be a single PUT as commit and no operation if it is aborted. When the file is bigger then S3's multipart upload is used: so when the file is committed a POST is sent and when aborted a DELETE will be sent (asynchronously).
This avoids the file copying altogether.
Why are the changes needed?
For improving streaming performance.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
Unit test
I have refactored the existing CheckpointFileManagerTests and run against a test filesystem which supports the Abortable interface (see AbortableFileSystem which is based on RawLocalFileSystem).
This way we have a unit test.
Integration test
Moreover the same test can be run against AWS S3 by using an integration test (see AwsS3AbortableStreamBasedCheckpointFileManagerSuite):
-> S3_PATH=<..> AWS_ACCESS_KEY_ID=<..> AWS_SECRET_ACCESS_KEY=<..> AWS_SESSION_TOKEN=<..>  ./build/mvn install -pl hadoop-cloud  -Phadoop-cloud,hadoop-3,integration-test

Discovery starting.
Discovery completed in 346 milliseconds.
Run starting. Expected test count is: 1
AwsS3AbortableStreamBasedCheckpointFileManagerSuite:
- mkdirs, list, createAtomic, open, delete, exists
CommitterBindingSuite:
AbortableStreamBasedCheckpointFileManagerSuite:
Run completed in 14 seconds, 407 milliseconds.
Total number of tests run: 1
Suites: completed 4, aborted 0
Tests: succeeded 1, failed 0, canceled 0, ignored 0, pending 0
All tests passed.

Performance test
I have run a small performance app which uses a rate stream and foreach sink with an empty body. The results:
➜  spark git:(SPARK-40039) ✗ ./bin/spark-submit ../spark-ss-perf/target/scala-2.12/performance-spark-ss_2.12-0.1.jar s3a://mybucket org.apache.spark.sql.execution.streaming.FileContextBasedCheckpointFileManager  2>&1 | grep "walCommit took" | awk '{print $7}' |  datamash max 1 min 1 mean 1 median 1 perc:90 1 perc:95 1 perc:99 1
4143    3286    3528.6  3500    3742.8  3840    4076.04

➜  spark git:(SPARK-40039) ✗ ./bin/spark-submit ../spark-ss-perf/target/scala-2.12/performance-spark-ss_2.12-0.1.jar s3a://mybucket org.apache.spark.internal.io.cloud.AbortableStreamBasedCheckpointFileManager  2>&1 | grep "walCommit took" | awk '{print $7}' |  datamash max 1 min 1 mean 1 median 1 perc:90 1 perc:95 1 perc:99 1
3765    1447    2187.0217391304 1844.5  2867    2976.5  3437.85

This is basically https://github.com/apache/spark/pull/37687 (including the Scala style fix) and the fix build issue commit contains the fixing of the build issue with hadoop-2.

$ ./build/mvn -Phadoop-2 -Phadoop-cloud -pl hadoop-cloud test
...
Discovery starting.
Discovery completed in 62 milliseconds.
Run starting. Expected test count is: 0
DiscoverySuite:
Run completed in 77 milliseconds.
Total number of tests run: 0
Suites: completed 1, aborted 0
Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0

$ ./build/mvn -Phadoop-3 -Phadoop-cloud -pl hadoop-cloud test
...
Discovery starting.
Discovery completed in 354 milliseconds.
Run starting. Expected test count is: 5
CommitterBindingSuite:
- BindingParquetOutputCommitter binds to the inner committer
- committer protocol can be serialized and deserialized
- local filesystem instantiation
- reject dynamic partitioning
AbortableStreamBasedCheckpointFileManagerSuite:
- mkdirs, list, createAtomic, open, delete, exists
AwsS3AbortableStreamBasedCheckpointFileManagerSuite:
Run completed in 711 milliseconds.
Total number of tests run: 5
Suites: completed 4, aborted 0
Tests: succeeded 5, failed 0, canceled 0, ignored 0, pending 0
All tests passed.

$ ./build/sbt -Phadoop-3 -Phadoop-cloud "project hadoop-cloud;testOnly"
[info] CommitterBindingSuite:
[info] - BindingParquetOutputCommitter binds to the inner committer (160 milliseconds)
[info] - committer protocol can be serialized and deserialized (9 milliseconds)
[info] - local filesystem instantiation (2 milliseconds)
[info] - reject dynamic partitioning (1 millisecond)
[info] AwsS3AbortableStreamBasedCheckpointFileManagerSuite:
[info] AbortableStreamBasedCheckpointFileManagerSuite:
[info] - mkdirs, list, createAtomic, open, delete, exists (161 milliseconds)
[info] Run completed in 1 second, 389 milliseconds.
[info] Total number of tests run: 5
[info] Suites: completed 3, aborted 0
[info] Tests: succeeded 5, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.
[success] Total time: 21 s, completed Aug 27, 2022 12:52:30 AM

$  ./build/sbt -Phadoop-2 -Phadoop-cloud "project hadoop-cloud;testOnly"

cc @HeartSaVioR

Merged to master.


[BUG] Issue when importing more than one library generated with prefabPublishing

Describe the bug
I have issues importing more than one library generated with prefabPublishing enabled.
When I only add library a or b to the project it builds fine.
When I both add library a and b to the project it throws the error message
2 files found with path 'lib/armeabi-v7a/libc++_shared.so'. If you are using jniLibs and CMake IMPORTED targets, see https://developer.android.com/r/tools/jniLibs-vs-imported-targets
To Reproduce
I have created 3 commits to a basic example project that show the issue.
Commit 1 adds library a and works fine.
Commit 2 adds library b and works fine.
Commit 3 adds both library a and b and throws the error from above:
Here is the github repository
And here are the 3 commits:
https://github.com/Consti10/ndk-samples/commit/f776f647756221218a80f3bbaf82d27509670c5f
https://github.com/Consti10/ndk-samples/commit/4f5d73767a2c4218bb8f3595000fc0caa9c22391
https://github.com/Consti10/ndk-samples/commit/8fb426ebfab6cecf6d05162036329d63c290df17

#116

I especially mentioned prefabPublishing as the curl-ssl example adds more than one prefab library (curl and ssl ) and does not have these issues.
However, as far as I know both curl and ssl were generated by 'ndkPorts' and not via prefabPublishing

This isn't related to prefab. You'll need to file an AGP bug. For future reference, everything related to gradle probably belongs there, not here. This is just for the prefab command line tool, whose only job is creating the cmake/ndk-build scripts from a prefab directory such as is in an AAR; and the prefab package format. None of the integration with AGP lives here.
When you file that bug, the problem is that adding the dependency is causing the libraries in the jni directory of the AAR to be included even though they are not used. The error is correct that there is a duplicate in what is trying to be installed to the APK, but afaik there is no way to depend on an AAR without depending on all of an AAR.

All you need, add to your app's build.gradle
android.packagingOptions.pickFirst("lib/*/libc++_shared.so")

That will work around the bug, yes. I still think it's an AGP bug that you can't do this though.

Thanks for the workaround. I forgot to link the agp bug, it is here:
https://issuetracker.google.com/issues/168777344

That will work around the bug, yes. I still think it's an AGP bug that you can't do this though.

You probably refer to https://issuetracker.google.com/issues/154133927.
Actually, there is another workaround, which may help sometimes: add to library build.gradle
android.packagingOptions.exclude("**.so")

Now the AAR will come with no jni directory, and the app will build flawlessly.

See also https://issuetracker.google.com/issues/181046700 and https://issuetracker.google.com/issues/178594839.

All you need, add to your app's build.gradle
android.packagingOptions.pickFirst("lib/*/libc++_shared.so")

It wasn't for this package, but it managed to fix an issue I couldn't find an answer to any where else.


Uncaught SyntaxError: Unexpected token <<

https://github.com/segmentio/analytics.js/blob/master/analytics.min.js#L13
Wth? Looks like there's a slight git conflict issue. lol

this https://github.com/segmentio/analytics.js/blob/76b51fb210f818b2a10c64aff4e187765b81fd43/analytics.min.js#L13
is fixed


Pycobertura diff breaks on non-ascii characters

Traceback (most recent call last):
   File "/usr/local/bin/pycobertura", line 11, in <module>
     sys.exit(pycobertura())
   File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 664, in __call__
     return self.main(*args, **kwargs)
   File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 644, in main
     rv = self.invoke(ctx)
   File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 991, in invoke
     return _process_result(sub_ctx.command.invoke(sub_ctx))
   File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 837, in invoke
     return ctx.invoke(self.callback, **ctx.params)
   File "/usr/local/lib/python2.7/dist-packages/click/core.py", line 464, in invoke
     return callback(*args, **kwargs)
   File "/usr/local/lib/python2.7/dist-packages/pycobertura/cli.py", line 117, in diff
     report = reporter.generate()
   File "/usr/local/lib/python2.7/dist-packages/pycobertura/reporters.py", line 311, in generate
     return template.render(**render_kwargs)
   File "/usr/local/lib/python2.7/dist-packages/jinja2/environment.py", line 969, in render
     return self.environment.handle_exception(exc_info, True)
   File "/usr/local/lib/python2.7/dist-packages/jinja2/environment.py", line 742, in handle_exception
     reraise(exc_type, exc_value, tb)
   File "/usr/local/lib/python2.7/dist-packages/pycobertura/templates/html-delta.jinja2", line 79, in top-level template code
     {{ render_source(hunk) }}
   File "/usr/local/lib/python2.7/dist-packages/pycobertura/templates/macro.source.jinja2", line 15, in template
     {{ line.source|escape }}
 UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 71: ordinal not in range(128)

Thanks for reporting, fixed in #64 and released pycobertura==0.7.2.


[Bug] Invalid column name in issue_field_history_columns

Is there an existing issue for this?

[X] I have searched the existing issues

Describe the issue
When using the issue_field_history_columns with a column having a leading numeric character in the name, the package fails. E.g. column name "1st reply date"
Relevant error log or model output
23:23:22  Database Error in model int_jira__pivot_daily_field_history (models/intermediate/field_history/int_jira__pivot_daily_field_history.sql)
23:23:22    001003 (42000): SQL compilation error:
23:23:22    syntax error line 29 at position 110 unexpected '1'.
23:23:22    compiled SQL at target/run/jira/models/intermediate/field_history/int_jira__pivot_daily_field_history.sql

Expected behavior
I expect the packages to succeed and create a column for the custom field in the jira__issues_enhanced and jira__daily_issue_field_history models with the corresponding values from the custom field.
dbt Project configurations
vars:
  # jira settings
  jira_database: <database>
  jira_schema: jira
  jira_using_sprints: false
  jira_using_components: false
  issue_field_history_columns: [
    '1st reply date'
  ]

Package versions
  - package: fivetran/jira
    version: 0.8.2
  - package: fivetran/jira_source
    version: 0.4.2

What database are you using dbt with?
snowflake
dbt Version
1.2.0
Additional Context
No response
Are you willing to open a PR to help address this issue?

[X] Yes.
[ ] Yes, but I will need assistance and will schedule time during our office hours for guidance
[ ] No.

Hi @crowemi thanks so much for sharing this detailed description of the bug you are experiencing. I am sorry to see you are experiencing it.
My one question is how this solution would impact the use of the data? My understanding is that the solution will remove the number from the name of the field. Would this cause confusion? For example, in your field shared above it would change from 1st reply date to st reply date. Is my understanding correct? I would just want to make sure that a solution we implement doesn't cause more confusion.

it actually prefixes an '_' to the name, so it would be _1st reply date -- we could put this behind a flag so that the functionality is disabled by default. It seems like a one-off, but you could also add additional logic or dynamic regex to configs which might come in handy for someone down the line -- you never know what type of config you're gonna get on these things 😆🤷♂

Thanks for the clarification @crowemi! With this, I actually think your suggestion may be a great addition to the package. Especially since we already handle a similar renaming with the slugify macro in this part of the package.
I noticed you are open to creating a PR. If you wanted to open one we can review in more detail and provide any additional notes in the process.

Hi @crowemi, to give you an update, our packages team is participating in a dbt hackathon this week and thought this could be a great fix to apply to a wider application outside of the jira packages. We would love to collaborate with you if you're on board! We were thinking our team would handle opening a PR against the slugify macro in `dbt_utils' and then tag you for feedback and as a contributor. Let me know what you think!

sounds great - thank you, @fivetran-catfritz 😄

Thanks, @crowemi! We should be submitting this sometime this week!

@crowemi Wanted to provide an update here. I think you saw that this change was merged into the dbt_utils v1 branch, so when dbt releases it, that should effectively close out that issue! Thanks again for your collaboration on this!


Selectively disable redirects to prefixless for default locale routes with prefix_and_default strategy

Problem
We are using the prefix_and_default strategy with a default locale set to en-us.
If we visit a route with the default locale as the prefix, e.g. /en-us/about-us, we are redirected to the prefixless route, /about-us. This is acceptable for most of our pages.
In a handful of cases, we don't want to redirect - we want to specifically use the /en-us prefix.
Desired Solution
There might be two ways we could configure this.

A new property on the page component:

export default {
    disableDefaultRedirect: true
};

A configuration that accepts a boolean or an array of prefixless paths:

// Applies to all routes
i18n: {
    disableDefaultRedirect: true
}

// Applies to /about-us and /products only
i18n: {
    disableDefaultRedirect: [
        '/about-us',
        '/products'
    ]
}

That seems very useful

This feature is still relevant....

nice!!

I'm looking for this feature as well!

we need this! thanks

Closing this as v7 is not being actively worked on (critical hotfixes only), if this still applies to v8 and later please open a new issue!


Add Outlines in LangChain

We should open a PR on the LangChain repo to add Outlined as a model / guided generation provider.

Yes it was supposed to be LangChain, thank you 😅

Is this happening soon?

If we could have an integration to langchain that would be really handy indeed.

@MightyGoldenJA I think you can use the outlines integration in vllm and pass it as an argument to the vllm integration in langchain (I hope I used the right phrasing). Something like this:
from langchain_community.llms import VLLM
from vllm.model_executor.guided_decoding.outlines_logits_processors import RegexLogitsProcessor
import vllm
from transformers import PreTrainedTokenizerFast

def placeholder_func(model_name, regex_string):
    llm = VLLM(
        model=model_name,
        trust_remote_code=True,
        # top_k=10,
        # top_p=0.95,
        temperature=0,
        vllm_kwargs={
            "sampling_params": vllm.SamplingParams(
                temperature=0.0,
                max_tokens=8_000,
                logits_processors=[
                    RegexLogitsProcessor(
                        regex_string=regex_string,
                        tokenizer=PreTrainedTokenizerFast.from_pretrained(model_name),
                    )
                ],
            ),
        },
    )
    return llm