[Feature Request]  Support shuffle server decommissioned

kill process is not graceful, so we need shuffle server support decommissioned

+1. Now the decommission could be used by exclude node file in coordinator side.
Besides, the exclude-node-file could be stored in HDFS.

I understand that you need  a rolling upgrade feature.  In our plan, we want to  accomplish this feature by k8s operator. For the standalone mode, we don't have the plans,. And it's also necessary to do some surveys about this feature, I think we should have more discuss about this problem.

I understand that you need a rolling upgrade feature. In our plan, we want to accomplish this feature by k8s operator. For the standalone mode, we don't have the plans,. And it's also necessary to do some surveys about this feature, I think we should have more discuss about this problem.

Depoly on k8s is a good choice. But one more choice is not a bad thing. Not all team willing to use k8s . I have create a pr.

Could you write a design doc's (use google doc) ? Because this issue is a little complex.

If we want to add some interface to control shuffle server's behavior,  we should have a complete design, and we think we need detailed discussions. We ever have similar mind in issue #37

Yarn node's decommission. https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/GracefulDecommission.html Maybe, we should also realize other system decommission implement.

Yarn node's decommission. https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/GracefulDecommission.html

Yes. In #85, I follow the rule of YARN decommission mechanism. So i think it's better to control the decommission by coordinator. Feel free to discuss more

Maybe, we should also realize other system decommission implement.

I looked the HDFS datanode decommission, it's also like YARN decommission. refer: https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HdfsDataNodeAdminGuide.html

I think we should consider more things, such as

Is it easy to use if we deploy on k8s and IP is not fixed?
Split-brain. If pass commands through heartbeat, shuffle server may receive different messages meanwhile and how do we ensure correctness. The decommission function can be solved. What about other functions in the future?
Compatibility. If pass commands through heartbeat, we need to modify this interface frequently.

cc @colinmjj . What do you think? I remember that you want to use coordinator to dispatch the configuration to shuffle servers. It's similar to use coordinator to decommission.

I think such feature is about command line or some API to manage the behavior of coordinator/shuffle server.

Besides decommission, how about update some configuration in shuffle server, clear shuffle data(which maybe useful for streaming jog), etc.
All above feature is management related, so I prefer to have a framework which can involve all these things.

@jerqi @colinmjj  I want to know if you have plan recently.  We have some functions that need to be built on the function of decommission, such as auto scaling We don't want to deviate too much from the community.

@jerqi @colinmjj I want to know if you have plan recently. We have some functions that need to be built on the function of decommission, such as auto scaling We don't want to deviate too much from the community.

We have no  related plan recently. If you have interest about this topic, we can start a offline meeting to discuss this issue.

@jerqi @colinmjj I want to know if you have plan recently. We have some functions that need to be built on the function of decommission, such as auto scaling We don't want to deviate too much from the community.

We have no  related plan recently. If you have interest about this topic, we can start a offline meeting to discuss this issue.

+1.

we can start a offline meeting to discuss this issue.

I am looking forward to it.

@zuston @xianjingfeng There are some other issues which we need to discuss, so I will send a email to our dev mail list, and select a proper date to start the meeting.

@xianjingfeng  I have already send an email https://lists.apache.org/thread/2jlm3fswmsxy619ldyo4px700p3ybnvc. Do you have time at 11 am (UTC +8) Thursday this week?

@xianjingfeng I have already send an email https://lists.apache.org/thread/2jlm3fswmsxy619ldyo4px700p3ybnvc. Do you have time at 11 am (UTC +8) Thursday this week?

Yes, i have time.

@xianjingfeng I have already send an email https://lists.apache.org/thread/2jlm3fswmsxy619ldyo4px700p3ybnvc. Do you have time at 11 am (UTC +8) Thursday this week?

Yes, i have time.

Meeting link is https://meeting.tencent.com/dm/oR95wASCNe91

@xianjingfeng I have already send an email https://lists.apache.org/thread/2jlm3fswmsxy619ldyo4px700p3ybnvc. Do you have time at 11 am (UTC +8) Thursday this week?

Yes, i have time.

Meeting link is https://meeting.tencent.com/dm/oR95wASCNe91

Get

Offline Discussion Result:
Coordinator provide admin rest api, Coordinator is only used as proxy, Coordinator redirect the request to shuffle server by rpc.
Currently, we need the api

Decommission
UpdateConfiguration
Upgrade
cc @zuston, you can give your advice for us.

Design doc: https://docs.google.com/document/d/1p1PksBN2LJ-OtGEHvdyEuH9b1Mv1aD_exMPl4TNaTs0/edit?usp=sharing
PTAL @jerqi @zuston

Thanks a lot for proposing this, I will take a look ASSP

Design doc: https://docs.google.com/document/d/1p1PksBN2LJ-OtGEHvdyEuH9b1Mv1aD_exMPl4TNaTs0/edit?usp=sharing PTAL @jerqi @zuston

Commented. @xianjingfeng PTAL

As we discuss in design doc, i will make the following adjustments:

Add concrete rest api list in the design doc.
Remove token in this design.

Any other suggestions? @jerqi @zuston @advancedxy

I'm OK.

As we discuss in design doc, i will make the following adjustments:

Add concrete rest api list in the design doc.
Remove token in this design.

Any other suggestions? @jerqi @zuston @advancedxy

+1. Thanks for your effort

Thanks @xianjingfeng for working on this feature.
I'm closing this issue now. Please feel free to reopen it if there is more work.


update script to use the correct one

Summary

update script to use the correct one
follow up of #556

ah thank you! i can't believe I made such a silly typo :)


PWM voltage generator

I am working for a PWM voltage generator at Pyleecan. This generator can produce 9 different PWM strategies with several variables. The output voltage can power machine models to observe and research the impact of harmonics from PWM signals on e-NVH.
PWM generator can provide the following PWM strategies:
GDPWM
DPWMMIN
DPWMMAX
DPWM0
DPWM1
DPWM2
DPWM3
SVPWM
SPWM
Several variables are available for SPWM:
Variable fundamental frequency
Variable switching frequency
Three different fixed switching frequency modes

The first version code has been updated in the EEC branch

Done in #377


How to get download speed in Mb/s

Hello friend, I am developing a one application
and I want to show download speed in Mb/s.
So, anyone knows then help me please 🥺

Not the use-case of the library as of now. If we want to implement this, please refer to this.


scoop.sh is down

404 error, default nginx error page.

Apparently it was some sort of DNS attack. Scoop.sh should be back online now.
https://news.gandi.net/en/2017/07/report-on-july-7-2017-incident/


Missing "possible values" and sf.user.attributes for SCIM API

Issue description

Hi,
On the page: https://help.sap.com/docs/cloud-identity-services/cloud-identity-services/list-of-properties?locale=en-US filter = sf.user.attributes
are no "possible values" listed.
Also the entry references to OData API, what about the SCIM API?
Best regards
Feedback Type (Optional)
content gaps
Page Title on SAP Help Portal (prefilled)
List of Properties
Page URL on SAP Help Portal (prefilled)
https://help.sap.com/docs/cloud-identity-services/cloud-identity-services/list-of-properties?locale=en-US

Thank you for your feedback. The documentation for sf.user.filter property has been adjusted.
Note that when listing possible values, the Identity Provisioning documentation refers to the SAP SuccessFactors APIs documentation where all supported filtering attributes are described. In most cases we provide only examples. The full list is maintained by the corresponding SAP solution.
Best regards,
Ivelina


error in main.yml

I'm unfamiliar with ansible so this is the error that was given. Trying to setup an old pi with new software. Could not run
pip3 install ansible
As it would download to 99% and then be killed. (no idea why).
I ended up installing ansible via apt
So this might be the source of the problem.
ERROR! no action detected in task. This often indicates a misspelled module name, or incorrect module path.
The error appears to have been in '/home/pi/internet-pi/main.yml': line 15, column 7, but may
be elsewhere in the file depending on the exact syntax problem.
The offending line appears to be:
handlers:
- name: Include handlers.
^ here

@iplayfast - Likely you have an older version of Ansible installed. Check with ansible --version. Make sure you're running at least 2.9. See the README for some basic install instructions via pip3.

It would be helpful to us if you'd put a list of requirements and versions in the README.  I ran into the same issue and came to the same conclusion, but not without a fair bit of time and some outside help in figuring that out.

How do you run ansible-galaxy using pip?

I am using pi2 an this helped me install ansible from the newest version https://www.theurbanpenguin.com/installing-ansible-on-the-raspberry-pi/

Same issue here, just starting to get into the Ansible mood.
I'm running Kubuntu 20.04 LTS as Ansible controller linking to my rPi3b+ as target host in inventory.ini, I also installed ansible via APT (below the version), tho the error differs a bit on the culprit line:
ERROR! this task 'ansible.builtin.import_tasks' has extra params, which is only allowed in the following modules: win_shell, raw, include_tasks, script, set_fact, include_role, include_vars, group_by, import_role, import_tasks, shell, include, add_host, command, win_command, meta

The error appears to be in '/home/bryanpedini/projects/internet-pi/main.yml': line 26, column 7, but may
be elsewhere in the file depending on the exact syntax problem.

The offending line appears to be:

  handlers:
    - name: Include handlers.
      ^ here

Output of ansible --version:
ansible 2.9.6
  config file = /home/bryanpedini/projects/internet-pi/ansible.cfg
  configured module search path = ['/home/bryanpedini/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
  ansible python module location = /usr/lib/python3/dist-packages/ansible
  executable location = /usr/bin/ansible
  python version = 3.8.10 (default, Jun  2 2021, 10:49:15) [GCC 9.4.0]

I hope it helps!

UPDATE
(Google is your friend for issues, GitHub issues are your friend for history keeping, but I digress)
I removed ansible.builtin. from the handlers section and just left import_tasks, and the error modified in these terms:
ERROR! couldn't resolve module/action 'community.docker.docker_compose'. This often indicates a misspelling, missing collection, or incorrect module path.

The error appears to be in '/home/bryanpedini/projects/internet-pi/tasks/handlers.yml': line 2, column 3, but may
be elsewhere in the file depending on the exact syntax problem.

The offending line appears to be:

---
- name: Restart pi-hole
  ^ here

UPDATE:
(GG for ansible documentation and a little bit of common sense, source)
It seems something changed in ansible-galaxy (or whatever, not an ansible guru, yet 😅), error modified in these terms (tho I suppose I already know how to solve it):
ERROR! this task 'ansible.builtin.import_tasks' has extra params, which is only allowed in the following modules: meta, include_role, win_shell, shell, set_fact, group_by, add_host, import_role, command, script, include_vars, import_tasks, raw, win_command, include_tasks, include

The error appears to be in '/home/bryanpedini/projects/internet-pi/main.yml': line 30, column 7, but may
be elsewhere in the file depending on the exact syntax problem.

The offending line appears to be:

  tasks:
    - name: Setup Docker.
      ^ here

@bryanpedini - Ah, that's because with Ansible 2.9.6 (an older release), it didn't have the fix to allow you to install collections and roles by default when you run the ansible-galaxy command. Using 2.9.x (latest) or 2.10 or 3.0/4.0+, this problem should not happen.
I guess the apt repo for Ubuntu 20.04 has a really out of date version of Ansible :(

UPDATE
It's working (after fixing #107 also), @geerlingguy would you like me to open a PR to look into?

I don't think it's anything that we can fix in the playbook (and I don't want to override ansible_python_interpreter because that can be radically different depending on how you install Python and what type of computer you're on)... but if there's something you think we can improve in documentation, please feel free to suggest something there.

I was more thinking on selectively adding to the commit (and PR) only the removal of ansible.builtin. in the various files.
Perhaps if that's something for documentation and not code, I'll be happy to contribute there instead, at least we have a "fix" now.

@bryanpedini - ansible.builtin. should not need to be removed if you are running the latest version of Ansible (2.9.23, or 3.0 or 4.0).

got it, it seems then that this was only caused by older version of Ansible on my apt repos.
@iplayfast IMHO this can be closed then, if Jeff thinks that since with older versions it works but requires some modification, it can be added as documentation, I'll be happy to provide sources and solutiuons there.

STFU stale


Fixed active 'Home' link on navbar

"active" class used to not be set on Home link in Home page

This would only work if site.baseurl is empty.  I'm not sure of the proper syntax, but it should probably be something like:
Home


Midjourney From Web

Is it possible to send command to Midjourney on discord server from my app and fetch back the generated image? Without using replicate

There's definitely better solutions out there than Replicate, if you're willing to pay a little bit. Would advise using Google Cloud Platform.


0.71 react native support

@gghangura is this interface change supporting only newer versions of RN and iOS ?
If not, and its backwards compatible then just confirm.
if so, can we just add a quick table to the Readme.md  to highlight package version support < or > this version of RN


If an action package has (DEV) in the name a run will fail from the action server UI.

This issue has been moved here, under Sema4AI/actions repository.


[SPARK-36487][CORE] Modify exit executor log logic

What changes were proposed in this pull request?
Adjust the log logic of CoarseGrainedExecutorBackend
Why are the changes needed?
When exit executor with system code 0, coarseGrainedExecutorBackend will print ERROR log.
That doesn't make sense, because it seems to me that executor's normal decommission is not caused by an exception.
Does this PR introduce any user-facing change?
no
How was this patch tested?
local

Can one of the admins verify this patch?

can you file a JIRA please? Also it would be great to show the console output you got from the manual test.

can you file a JIRA please? Also it would be great to show the console output you got from the manual test.

OK, i will do it later.

Write a unit tests to reflect exitExecutor method

Using code 0 can print info log

Please take a check, thank you. @HyukjinKwon

ok to test

Test build #142427 has started for PR 33718 at commit 357ba65.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46934/

Strictly speaking, I think this should be a user-facing change.

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46934/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46934/

Test build #142427 has finished for PR 33718 at commit 357ba65.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142427/

Merged to master


feat(ingestion): Support for displaying history of CLI ingestion runs in the "Manage Ingestion" UI

Checklist

[x] The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
[ ] Links to related issues (if applicable)
[ ] Tests for the changes have been added/updated (if applicable)
[ ] Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
[ ] For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

I was hoping we can also add the 'sourceType' field to IngestionSourceInfo.pdl so we can capture the fact that this is CLI only ingestion!

only downside is that forces the UI to be >= a model that has this new field and doesn't work with older UI servers

I was hoping we can also add the 'sourceType' field to IngestionSourceInfo.pdl so we can capture the fact that this is CLI only ingestion!

only downside is that forces the UI to be >= a model that has this new field and doesn't work with older UI servers

So either way if the server is a lesser version the UI experience for CLI ingestion will be wonky (It will look like a normal ingestion source).
If we add an optional field we'll use it if its there, ignore otherwise on the UI side. Somehow going forward we need to differentiate and ultimately the client needs to announce itself as the CLI, so either we do this commit, then come back after a model change has gone in to update this code or we just do it now... right?


Remove version: Jackett.Jackett version 0.20.3681

404 - release deleted
Microsoft Reviewers: Open in CodeFlow

URL: https://github.com/Jackett/Jackett/releases/download/v0.20.3681/Jackett.Installer.Windows.exe
Response Error: The remote server returned an error: (404) Not Found.
(Automated message - build 918)


prep for v0.21.0

Add PR links and the version number to changelog.md

Codecov Report

Merging #99 (565fb77) into main (0f63885) will increase coverage by 0.05%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main      #99      +/-   ##
==========================================
+ Coverage   74.58%   74.64%   +0.05%
==========================================
  Files          29       29
  Lines        5592     5592
==========================================
+ Hits         4171     4174       +3
+ Misses       1177     1175       -2
+ Partials      244      243       -1

see 1 file with indirect coverage changes
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Is it possible to store and load the model to .h5 format ?

First of all - when I use the model by training and then later loading its checkpoint weights - everything works ok.
However I would like to store the entire model to .h5 format and then be able to load the model successfully.
Right now I seem to be able to save the model to .h5 by using model.save() but I get errors upon trying to load it.
What are you experiences ?
Ultimatively my goal is to transfer the model to onnx and for that I seem to be need .h5...

I have also tried exporting yolo to SavedModel format by using tensorflow2 example code_
model.save('path_to_saved_model', save_format='tf')
# Recreate the exact same model
new_model = keras.models.load_model('path_to_saved_model')

I can save the model but upoon loading it I get exceptions such as:
File "C:\Program Files\Python37\lib\site-packages\tensorflow_core\python\keras\engine\network.py", line 1851, in process_node
    output_tensors = layer(input_tensors, **kwargs)
  File "C:\Program Files\Python37\lib\site-packages\tensorflow_core\python\keras\engine\base_layer.py", line 773, in __call__
    outputs = call_fn(cast_inputs, *args, **kwargs)
  File "C:\Program Files\Python37\lib\site-packages\tensorflow_core\python\keras\engine\network.py", line 712, in call
    raise NotImplementedError('When subclassing the `Model` class, you should'
NotImplementedError: When subclassing the `Model` class, you should implement a `call` method.

Could anybody else export this model succesfully ?

Ok, so even if it is not possible to store the model in .h5 format - one can alternatively store it in the savedModel format which seem to work ok. So I will close this issue.


Chi2 hypothesis test

Take a look at the test which failed - it has nothing to do with the hypothesis test at all. Might be worth looking into.

it's just yet another place where uncontrolled randomness leads to spurious test failures. I thought I had most of them hammered out, but it's a whack-a-mole kind of thing

if you'd promote your comments to scaladoc, lgtm

fix merge conflicts?

Done

thanks!


cmd/cue/cmd: remove unused func mustParseFlags

All users of mustParseFlags were removed in commit 0489caa3a13c
("cmd/cue/cmd: use testscript for top level command testing")

The tests on Windows seem to be broken due to spaces in testdata file names:
"C:\Program Files\Git\bin\git.exe" checkout --progress --force refs/remotes/pull/373/merge
##[error]error: invalid path 'cue/testdata/basicrewrite/020_resolved self-reference cycles: Issue 19.txtar'
##[error]The process 'C:\Program Files\Git\bin\git.exe' failed with exit code 128

https://github.com/cuelang/cue/pull/373/checks?check_run_id=634989639
I've sent #374 with a possible fix.


feat(server): dropping a Response will write out to the underlying stream

Coverage increased (+1.15%) to 85.45% when pulling 5176922a7d4fd59c69bcf9426695935aecc6aa7e on drop-res into 7f5e0382d958da2f0bf4636cdab9a6e9827cd8bb on master.

The drop tests don't seem to actually test the body itself is flushed?
The branching on PhantomData looks like a neat technique!

@Ryman what do you mean? That flush was called on the MockStream?

@seanmonstar I mean that the tests seem to only check with a zero byte body in the response, I wonder if it's a benefit to include a test that actually ensures a body is dealt with appropriately?

@Ryman ah sure. Though, since it's a chunked the response, that last chunk written before flushing must be the 0\r\n\r\n chunk, which the tests are checking for.


dpt_hybrid-midas-501f0c75.pt was in the wrong position in readme.md

In Currently readme.md ,the origin project structure was wrong
StableVideo
├── ...
├── ckpt
│   ├── cldm_v15.yaml
|   ├── dpt_hybrid-midas-501f0c75.pt
│   ├── control_sd15_canny.pth
│   └── control_sd15_depth.pth
├── data
│   └── car-turn
│       ├── checkpoint # NLA models are stored here
│       ├── car-turn # contains video frames
│       ├── ...
│   ├── blackswan
│   ├── ...
└── ...

the correct project structure should be like
StableVideo
├── ...
├── annotator
│   └── ckpts
│       ├── cdpt_hybrid-midas-501f0c75.pt
├── ckpt
│   ├── cldm_v15.yaml
│   ├── control_sd15_canny.pth
│   └── control_sd15_depth.pth
├── data
│   └── car-turn
│       ├── checkpoint # NLA models are stored here
│       ├── car-turn # contains video frames
│       ├── ...
│   ├── blackswan
│   ├── ...
└── ...

Besides, in case people need to install the cdpt_hybrid-midas-501f0c75.pt from huggingfacehub , we have to install these packages below
pip install tb-nightly
pip install basicsr

what's more,i install the tb-nightly from the whl file from pypi.org

I have also faced the same issue.


Error when setting trust line flag in Stellar Lab

What version are you using?
I am using the currently released version of the Stellar labs that is currently available at https://lab.stellar.org/
What did you do?
Attempted to set a trust line flag on an account via Stellar lab, received an error message and had to find a workaround
Navigate to https://lab.stellar.org/
Select the transaction tab
Build a "Set Trust Line Flag" transaction
Select "Alphanumeric 4" for Asset , enter an "Asset Code", "Issuer Account ID" and "Trustor"
Select "Authorized" for Set Flags
Notice that the "Transaction Envelope XDR Error:" = missing field clear_flags at line 1 column 438
Select "Authorized" for Clear Flags
Notice that XDR now = Success! Transaction Envelope XDR:
De-select "Authorized" for Clear Flags
Notice that XDR still = Success! Transaction Envelope XDR:
Expected Behaviour ?
I expected to be able to "Set Flags" when building a trust line for an account without having to select and de-select "Authorized" for "Clear Flags" in order to get rid of the unexpected error message.
Actual Behaviour
When building a trust line for an account if you want to "Set Flags" you get an unexpected error which you can only resolve by selecting and de-selecting "Authorized" for "Clear Flags"
Related issue
There is a second variant of this bug, if you wanted to set a "Clear Flag" you would get a similar error which you can then resolve by selecting and de-selecting "Authorized" for "Set Flags".

@Gurumahajava, thanks for opening this issue. Is your intent to create a trustline for an account that doesn't have this trustline yet? Or modify an existing trustline?

Set trustline flags is to modify a trustline.
Change trust create new trustline.

P.S. The link to Opeation type docs was wrong in the Lab. Fixed in this PR.

Hello quietbits, my intention was to create a trustline for an account that doesn't have a trustline. You can also simply recreate this error by following the steps for the Stellar Quests, Level 02, Configuration Operations, Set Flags. https://quest.stellar.org/learn

Thanks for the extra details, @Gurumahajava , that's very helpful. I see that it's not working as expected.


Windows Auto Open on Virtual Desktop

Description of the new feature / enhancement
The tool can list all open applications or it can be integrated into the taskbar. By clicking on a certain program, it would be possible to select whether it will always be opened in one of the certain virtual desktops.
When running the program, it will automatically open on this virtual desktop.
Scenario when this would be used?
It can be used for multitasking and for more productivity due the organization of virtual desktops
Supporting information
No response

This is talking about a implementation before really talking about what it the concept is, i'm not totally sure i understand exactly what is being asked for.
You want a set of apps to open on a new VD via some sort of shortcut?  correct?

/needinfo

Not exactly!
Is more like a setting to "By default, open this program on  VD!"
Em qua., 20 de abr. de 2022 às 01:49, Clint Rutkas @.***>
escreveu:

/needinfo
—
Reply to this email directly, view it on GitHub
https://github.com/microsoft/PowerToys/issues/16233#issuecomment-1103468392,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AKTW5UDLA6OSLVOII5RCCADVF6EG3ANCNFSM5OAYDVYA
.
You are receiving this because you authored the thread.Message ID:
@.***>

this is actually /dup #24


cmake: Regular rebasing of the cmake-staging branch

This is the cmake-staging branch rebased on the recent bitcoin/master one, which includes the main build system changes, with the squashed "!fixup" commits.
Steps to reproduce:

Run the command as follows:

git checkout 4561f7603f97955db5adab54d35a830264f35b8f
git rebase -i --autosquash 19865a8350a8181ab658bef48976a728bae6a8bd

There are a few conflicts that have to be resolved.

Reorder the recent commits to pop up the CI one.

The build system related changes from the following PRs (labeled "Needs CMake port"):

https://github.com/bitcoin/bitcoin/pull/29774
https://github.com/bitcoin/bitcoin/pull/29890
https://github.com/bitcoin/bitcoin/pull/29904

are to be backported in dedicated PRs shortly after approving this one.
UPD. Cross-compiling for macOS CI jobs are broken due to https://github.com/bitcoin/bitcoin/pull/29890. This is currently under further investigation and should not be a blocker for this PR.

Friendly ping @vasild @m3dwards @TheCharlatan @pablomartin4btc :)

My Guix builds (except for two macOS hosts):
x86_64
40dcba9af2f3220e21edd1480cbe9bbc4c82f4b3c4701b8930b43b3981d79701  guix-build-101f3ef12da1/output/aarch64-linux-gnu/SHA256SUMS.part
8d3cd86cb00ef332fb244841a792d5f1e3c847a462dea6c2af2486c82b457aa1  guix-build-101f3ef12da1/output/aarch64-linux-gnu/bitcoin-101f3ef12da1-aarch64-linux-gnu-debug.tar.gz
b3943ca1ed48576daccb63eaefc9fad9b2d975324ccc9c97cbf1e164170f3d67  guix-build-101f3ef12da1/output/aarch64-linux-gnu/bitcoin-101f3ef12da1-aarch64-linux-gnu.tar.gz
1c9f3628977e916f44aaf36fc3ebcdd6f9de58ed8aaad26c9eaac58ffe448fb0  guix-build-101f3ef12da1/output/arm-linux-gnueabihf/SHA256SUMS.part
7f4cc330cdbc28c40ebdb0f930df75c96c45ba138633ee1879030b816b5fcdc4  guix-build-101f3ef12da1/output/arm-linux-gnueabihf/bitcoin-101f3ef12da1-arm-linux-gnueabihf-debug.tar.gz
8755b525fe8233629082136cad235eaeb6901edc14bd135cc32af336d5c66d4b  guix-build-101f3ef12da1/output/arm-linux-gnueabihf/bitcoin-101f3ef12da1-arm-linux-gnueabihf.tar.gz
04a06cbd2f0a9e1c8c53f4068464b9ef3d834202e94228a6e40689372f8c0ba8  guix-build-101f3ef12da1/output/dist-archive/bitcoin-101f3ef12da1.tar.gz
611c69da54c984b7597b4003ab8eaab131aed803d6d40f983e8687314591c96a  guix-build-101f3ef12da1/output/powerpc64-linux-gnu/SHA256SUMS.part
eae74197798cbe1142026a777de2c1975d2c4916bb9470ea8ed84fbde29ebfdb  guix-build-101f3ef12da1/output/powerpc64-linux-gnu/bitcoin-101f3ef12da1-powerpc64-linux-gnu-debug.tar.gz
a06b24426a99374815c5753b3cab98fa9a78c4d9bb0d8b60996c20bc2ac87997  guix-build-101f3ef12da1/output/powerpc64-linux-gnu/bitcoin-101f3ef12da1-powerpc64-linux-gnu.tar.gz
8d7cdfd5401fd82339f4765567b3078625d493a8e7447a70f207816f5c2ca387  guix-build-101f3ef12da1/output/riscv64-linux-gnu/SHA256SUMS.part
b6a059c415ee4c52264a74b542cc353ba4301c65d076583c4ae82d3d5060b474  guix-build-101f3ef12da1/output/riscv64-linux-gnu/bitcoin-101f3ef12da1-riscv64-linux-gnu-debug.tar.gz
0e2671b607a6a9cc518fe3a5f2c1d0e86156cc79f4094d960ec55fed521ebccb  guix-build-101f3ef12da1/output/riscv64-linux-gnu/bitcoin-101f3ef12da1-riscv64-linux-gnu.tar.gz
be7a9b35c2fbf15964c22691092796c2d3936f71f40d402caed98058ee0adaa0  guix-build-101f3ef12da1/output/x86_64-linux-gnu/SHA256SUMS.part
55869202ee8f23e35a1472da8235b79aa7521aa2441b6292d5a460f7f43cf3c7  guix-build-101f3ef12da1/output/x86_64-linux-gnu/bitcoin-101f3ef12da1-x86_64-linux-gnu-debug.tar.gz
79622931cea202cef272508e46336a852f711583c82d97c86c5f902920ce3c8e  guix-build-101f3ef12da1/output/x86_64-linux-gnu/bitcoin-101f3ef12da1-x86_64-linux-gnu.tar.gz
9242a4bf9658b19ccb0e449ec6078f1a9b89dbfe0f0f288bab4e701cb4875200  guix-build-101f3ef12da1/output/x86_64-w64-mingw32/SHA256SUMS.part
ff548a7375a57c5d1d3ef4c930992371fb9aae3700e9f65a62af7e53d792aa72  guix-build-101f3ef12da1/output/x86_64-w64-mingw32/bitcoin-101f3ef12da1-win64-debug.zip
c3dc149b1be0ad7d12bff801b7ccebde3babb8f480a74d788f6ae8dfafccb6c0  guix-build-101f3ef12da1/output/x86_64-w64-mingw32/bitcoin-101f3ef12da1-win64-setup-unsigned.exe
48c95652056fd75832112c1e0604aa8ea5d9fb3b8ef69a87869ea44080129756  guix-build-101f3ef12da1/output/x86_64-w64-mingw32/bitcoin-101f3ef12da1-win64-unsigned.tar.gz
eda9345142f0997302184f8fa7317528adb21e1f8b73bb3831d6a6e896d11c24  guix-build-101f3ef12da1/output/x86_64-w64-mingw32/bitcoin-101f3ef12da1-win64.zip

I tried this but ended up with a different tree.

Reorder the recent commits to pop up the CI one.

Can you post a diff between before and after you reordered the commits in git rebase -i --autosquash 19865a8350a8181ab658bef48976a728bae6a8bd? That is, it looks like this initially:
pick 27ac23d8de cmake: Add root `CMakeLists.txt` file
fixup 558f396023 fixup! cmake: Add root `CMakeLists.txt` file
pick 4c265fb23e cmake: Introduce core interface libraries to encapsulate common flags
pick 60265f214c cmake: Add `config/bitcoin-config.h` support
pick 3600bd6abe cmake: Check system headers
pick 50d3dfcb5c cmake: Check system symbols
fixup 6d4584b22f fixup! cmake: Check system symbols
fixup 5caf5a8c75 fixup! cmake: Check system symbols
fixup 49a902a59e fixup! cmake: Check system symbols
pick 86b6ebb223 cmake: Check compiler features
pick 7586f328e6 cmake: Add position independent code support
pick 14356ef75e cmake: Add platform-specific definitions and properties
pick 31be0d375d cmake: Build `crc32c` static library
pick eef89ef23f cmake: Build `leveldb` static library
pick 42fa94647d cmake: Build `minisketch` static library
fixup fd71331ef1 fixup! cmake: Build `minisketch` static library
pick 9024a0d215 cmake: Build `secp256k1` static library
pick de4540eb69 cmake: Build `univalue` static library
pick feeeb5d751 cmake: Build `bitcoin_crypto` library
fixup 074fa1c3b6 fixup! cmake: Build `bitcoin_crypto` library
pick df9f0e7f0d cmake: Build `bitcoin_util` static library
pick 89eb30fb47 cmake: Build `bitcoin_consensus` library
pick 21f969ef80 cmake: Build `bitcoind` executable
pick e98f4e0a6e depends: Amend handling flags environment variables
pick ee43cfe3a0 build: Generate `share/toolchain.cmake` in depends
fixup dc20cdfd3e fixup! build: Generate `share/toolchain.cmake` in depends
pick 18098040af cmake: Add cross-compiling support
pick 2457f17e74 cmake: Add `TristateOption` module
pick 965f29e07d cmake: Add `ccache` support
pick 43a33e43ad cmake: Add `libnatpmp` optional package support
pick e404924142 cmake: Add `libminiupnpc` optional package support
pick f6f1d2f7b0 cmake: Add `libzmq` optional package support
pick ef3d53b4de cmake: Add `systemtap-sdt` optional package support
pick e22f5075be cmake: Build `bitcoin-cli` executable
pick 50295e561a cmake: Build `bitcoin-tx` executable
pick b751995c04 cmake: Build `bitcoin-util` executable
pick ca25cd1daf cmake: Add wallet functionality
fixup 9a2d9d6c22 fixup! cmake: Add wallet functionality
pick e3aaf2c461 cmake: Add test config and runners
pick 74cfa74fbd cmake: Build `bench_bitcoin` executable
pick 3f65e61aab cmake: Build `test_bitcoin` executable
fixup 4d58b5212c fixup! cmake: Build `test_bitcoin` executable
pick 50feec9eab cmake: Include CTest
pick e56be56299 cmake: Add `TryAppendCXXFlags` module
pick ee1938a7ef cmake: Add `TryAppendLinkerFlag` module
pick 92796e952c cmake: Add platform-specific compiler flags
pick 06a46791fd cmake: Add platform-specific linker flags
pick a251873f42 cmake: Redefine/adjust per-configuration flags
pick 0e4533e718 cmake: Add general compile options
pick ceffa0db78 cmake: Add `HARDENING` option
pick 519b5a77d8 cmake: Add `REDUCE_EXPORTS` option
pick 871ed453e9 cmake: Add `WERROR` option
pick 6ab95b1cdb cmake: Implement `make install`
pick c3b0bf789e cmake: Generate `obj/build.h` header
pick 9e44e3d022 Revert "build, qt: Do not install *.prl files"
pick ed8e76bf9c qt, build: Drop `QT_STATICPLUGIN` macro
pick d0cbb07ad5 cmake: Build `bitcoin-qt` executable
pick 34739c27cf cmake: Build `test_bitcoin-qt` executable
pick fa5669750b qt: Drop `Q_IMPORT_PLUGIN` macros
pick ae90440a2a cmake: Add `libqrencode` optional package support
fixup 8fe37b0f3a fixup! cmake: Add `libqrencode` optional package support
pick f0afe0d776 cmake: Add `SANITIZERS` option
pick 1c6e6041c8 cmake: Add external signer support
fixup b8fd28543e fixup! cmake: Add external signer support
pick 89bd9afaae cmake: Add fuzzing options
pick 9d60eae905 cmake: Add `AddWindowsResources` module
pick c07825d319 cmake: Add `Maintenance` module
fixup 721251ad33 fixup! cmake: Add `Maintenance` module
pick 814092d54a cmake: Migrate Guix build scripts to CMake
pick 29d900ad8c cmake: Add vcpkg manifest file
pick 91ceed2c6a cmake: Add preset for MSVC build
pick 2d67d4427a Fix MSVC warning C4273 "inconsistent dll linkage"
pick 1a8c964ceb cmake, doc: Update `release-process.md`
pick 7bc28ac145 cmake: Add compiler diagnostic flags
pick 7a3f391c83 test: Fix MSVC warning C4101 "unreferenced local variable"
pick 1d56d8fa97 cmake: Build `bitcoinkernel` library
fixup 132cd549f3 fixup! cmake: Build `bitcoinkernel` library
pick 3ccc740492 cmake: Build `bitcoin-chainstate` executable
pick 022408854d cmake, docs: Update MSVC build docs
pick<PHONE_NUMBER> cmake: Remove legacy MSVC build system
pick bca4d31e87 depends: Bump libmultiprocess source
pick 7d69bba466 cmake: Add `MULTIPROCESS` option
pick af998da072 ci: Test CMake edge cases
fixup 1e7a579e6a fixup! ci: Test CMake edge cases
fixup c08acdbfed fixup! ci: Test CMake edge cases
fixup 8fd40d4247 fixup! ci: Test CMake edge cases
pick 0eda1c2ef5 cmake, doc: Update `build-freebsd.md`
pick 63bbe26e95 cmake: Add CI-specific presets
pick a4d6a0cd88 cmake [KILL 3-STATE]: Switch `WITH_NATPMP` to boolean w/ default OFF
pick 5bfecf4462 cmake [KILL 3-STATE]: Switch `WITH_MINIUPNPC` to boolean w/ default OFF
pick 732b4e9727 cmake [KILL 3-STATE]: Switch `WITH_ZMQ` to boolean w/ default OFF
pick df4e46bfaf cmake [KILL 3-STATE]: Switch `MULTIPROCESS` to boolean w/ default OFF
pick 2dc664cad1 cmake, doc: Update `build-osx.md`
pick ece2ffc372 ci: Workaround Microsoft mirror issue for GitHub Action
pick 5aed6975d3 depends: Fix Autotools-generated `libzmq.pc` file
pick 1818593cd6 depends: Fix Autotools-generated `libevent*.pc` files
pick 20f83ae67c [FIXUP] cmake: Use `pkg-config --static` when building w/ depends
pick f8994d142f cmake, doc: Update `build-openbsd.md`

how to reorder exactly?

I tried this but ended up with a different tree.

Reorder the recent commits to pop up the CI one.

Can you post a diff between before and after you reordered the commits in git rebase -i --autosquash 19865a8350a8181ab658bef48976a728bae6a8bd?

It is a zero diff for the commits reordering step.

how to reorder exactly?

I've put the CI stuff at the top. Then all docs related commits. That's all.

I mean diff of that commits list. I tried this and other combinations as well:
@@ -80,12 +80,7 @@
 pick<PHONE_NUMBER> cmake: Remove legacy MSVC build system
 pick bca4d31e87 depends: Bump libmultiprocess source
 pick 7d69bba466 cmake: Add `MULTIPROCESS` option
-pick af998da072 ci: Test CMake edge cases
-fixup 1e7a579e6a fixup! ci: Test CMake edge cases
-fixup c08acdbfed fixup! ci: Test CMake edge cases
-fixup 8fd40d4247 fixup! ci: Test CMake edge cases
 pick 0eda1c2ef5 cmake, doc: Update `build-freebsd.md`
-pick 63bbe26e95 cmake: Add CI-specific presets
 pick a4d6a0cd88 cmake [KILL 3-STATE]: Switch `WITH_NATPMP` to boolean w/ default OFF
 pick 5bfecf4462 cmake [KILL 3-STATE]: Switch `WITH_MINIUPNPC` to boolean w/ default OFF
 pick 732b4e9727 cmake [KILL 3-STATE]: Switch `WITH_ZMQ` to boolean w/ default OFF
@@ -96,6 +91,11 @@
 pick 1818593cd6 depends: Fix Autotools-generated `libevent*.pc` files
 pick 20f83ae67c [FIXUP] cmake: Use `pkg-config --static` when building w/ depends
 pick f8994d142f cmake, doc: Update `build-openbsd.md`
+pick af998da072 ci: Test CMake edge cases
+fixup 1e7a579e6a fixup! ci: Test CMake edge cases
+fixup c08acdbfed fixup! ci: Test CMake edge cases
+fixup 8fd40d4247 fixup! ci: Test CMake edge cases
+pick 63bbe26e95 cmake: Add CI-specific presets

I mean diff of that commits list.

I've reordered commits after completing the git rebase -i --autosquash 19865a8350a8181ab658bef48976a728bae6a8bd command. So the commit list was changed to the current branch.

I got changes in build_msvc/fuzz/fuzz.vcxproj also. Is this expected?

I got changes in build_msvc/fuzz/fuzz.vcxproj also. Is this expected?

➜  bitcoin git:(0b5f323cc3) ✗ git --no-pager diff hebasto/240429-linear

diff --git a/build_msvc/fuzz/fuzz.vcxproj b/build_msvc/fuzz/fuzz.vcxproj

new file mode 100644

index<PHONE_NUMBER>..fb77251a17

--- /dev/null

+++ b/build_msvc/fuzz/fuzz.vcxproj

After reordering of commits, the commit, which removes the entire build_msvc directory, goes after the commit, which adds fuzz.vcxproj file.

ACK https://github.com/hebasto/bitcoin/pull/179/commits/101f3ef12da1e998ebcb80e1bd2b8cea97fd4cde

@vasild @m3dwards
Thank you for your reviews!

This branch has been force pushed into the https://github.com/hebasto/bitcoin/tree/cmake-staging.
Closing.


mkdir error: permission denied

Not sure if this is a problem:
hacker-news-cleanser (master) $ admin/start.sh
Log directory cleaned
Starting Hacker News Cleanser...
mkdir: /var/lib/mongo: Permission denied
MongoDB started
Server started
All started successfully

I'm self-hosting on a Mac running macOS 10.14.6.

mongod error:
{"t":{"$date":"2021-02-03T13:17:50.652-05:00"},"s":"E",  "c":"STORAGE",  "id":20568,   "ctx":"initandlisten","msg":"Error setting up listener","attr":{"error":{"code":9001,"codeName":"SocketException","errmsg":"Address already in use"}}}

Hi Craig!
The start.sh script starts both MongoDB and the Hacker News Cleanser, one right after the other.
What you're seeing at mkdir: /var/lib/mongo: Permission denied is a MongoDB failure to initialize the database at that directory due to a permissions issue.
To resolve, you can do either of the following:

Set a different directory (one that does not require root write permissions, like at ~/developer/mongo) to persist your Mongo database to by changing the MONGO_DB setting in admin/init.sh.
Or, create_ the /var/lib/mongo directory manually with root permissions, then set the owner to yourself, like so: sudo mkdir /var/lib/mongo ; sudo chown -R $(whoami) /var/lib/mongo

I failed to detect this oversight on my own machine since I had already manually set up MongoDB for another service, so this snag wasn't called out in the instructions. To prevent this in the future, I'll remove the default value from the init.sh script and add a step in INSTALL.md clarifying to set a directory the user account has write permissions to.
Thanks for catching this!

While I'm confident this specific issue will be resolved with the steps above, if any other issues during setup reveal themselves please don't hesitate to open another Issue, I'll be happy to give them a look.

Thanks for the clarification. Any idea what is causing this fatal error reported in the mongodb log?
"Error setting up listener","attr":{"error":{"code":9001,"codeName":"SocketException","errmsg":"Address already in use"}}}

The error message Address already in use tells me you most likely have a Mongo process already running (either orphaned or healthy, unsure with just this log). You should stop any previously Mongo processes before trying to start it back up again.


[FLINK-7619] Improve abstraction in AbstractAsyncIOCallable to better fit

What is the purpose of the change
This PR improves the abstractions around resource management for async backend snapshots.
Brief change log

return value when removing streams from {{CloseableRegistry}} to not rely in idempotent close, but enforce close to be called exactly once.

Introduces {{AbstractAsyncCallableWithResources}} as a more general abstraction to manage resources in async checkpointing.

Verifying this change
This change is already covered by existing tests.
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (yes)
The public API, i.e., is any changed class annotated with @Public(Evolving): (no)
The serializers: (no)
The runtime per-record code paths (performance sensitive): (no)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes)

Documentation

Does this pull request introduce a new feature? (no)
If yes, how is the feature documented? (not applicable)

CC @aljoscha

@aljoscha Thanks for the reviews of this and PR #4639 ! I addressed your comments and will proceed to merge both.

Merged in 5af463a9c0.


[BUG] Can't open las2peer node frontend

I was not able to access the las2peer node frontend after launching the service.
Logs
The logs on the node only show File not found: '/webapp/images/manifest/icon-192x192.png' while all other resources load just fine when inspecting the network tab in the browser
Steps to reproduce

clone repository
build the service using gradle
launch localhost:8080 in your browser

I could launch the  localhost:8080  in the browser now

If you got the issue fixed you can also close the issue. Ill close it for you this time


1.10: Send emails after LDB form submission

When LDB employee submits a form, 3 emails have to be sent to

recipient
complainant
LDB mailbox

Copy is needed for all 3 emails.

No longer needed


Chained operator syntax does not work if there is no space after dot on a new line

from Standard.Base import all
main =
    Vector.new_builder
        . append 1
        . to_vector

Works, but
from Standard.Base import all
main =
    Vector.new_builder
        .append 1
        .to_vector

fails with:
Execution finished with an error: Method `append` of type Integer could not be found.
        at <enso> tmp.main<arg-1>(tmp.enso:21:9-17)
        at <enso> tmp.main(tmp.enso:20-22)

This is per spec: https://github.com/enso-org/design/blob/wip/wd/enso-spec/epics/enso-spec-1.0/03. Code format and layout.md#chained-operator-code-blocks
Without the spaces it is the syntax for passing operator sections as arguments in an argument-list block.

Yeah, I thought this is the specified behavior. But people do these mistakes as your fix to my https://github.com/enso-org/enso/pull/8671/commits/bc05faa86b22db3a60f789454d9d74db16aaa6a9 test shows, @kazcw ;-)


Non-G2 MS SQL database

Pull requests:

https://github.com/Senzing/docker-init-container/pull/161


Camera Loop

Hi,
Great integration and card. Is there any way I can set a group of cameras to loop in a card in Home Assistant?
Essentially I want a single window on a touch screen that loops between several feeds?
Thanks.

You can do this with manual click to card. Using the streams setting.
If you want automatic switching, you can look for a custom card that supports it.
I think you can find a card that supports scripts based on the current time.


How can I click?

How can I click on a certain element?
I know this plugin is not puppeter, but is there a way to do it?

This is my recipe, I hope it would be helpful:
// Find the element you want to click
let element = await DOM.performSearch({query: "//button[@data='test']"});
let results = await DOM.getSearchResults({searchId: xelement.searchId, fromIndex: 0, toIndex: element.resultCount});

// Get the first element from the results array to get an objectID by using DOM.resolveNode
let remoteObject = await DOM.resolveNode({nodeId: results.nodeIds[0]});
// Scroll to the element
await Runtime.callFunctionOn({objectId: remoteObject.object.objectId, functionDeclaration: "function(){this.scrollIntoViewIfNeeded(!0)}", silent: true});
// then release the element
await Runtime.releaseObject({objectId: remoteObject.object.objectId});

// Get the BoxModel of the element
let boxModel = await DOM.getBoxModel({nodeId: results.nodeIds[0]});
// then the BoxModel center
let coords = {x: Math.round(boxModel.model.content[0] + boxModel.model.width / 2), y: Math.round(boxModel.model.content[1] + boxModel.model.height / 2)};

// We need the coords
let eleClick = await DOM.getNodeForLocation({x: coords.x, y: coords.y});

// Finally, the click event needs three steps:
await Input.dispatchMouseEvent({type: "mouseMoved", x: coords.x, y: coords.y});
await Input.dispatchMouseEvent({type: "mousePressed", x: coords.x, y: coords.y, button: "left", clickCount: 1})
await Input.dispatchMouseEvent({type: "mouseReleased", x: coords.x, y: coords.y, button: "left", clickCount: 1})

I guess there should be better ways to handle this, but this works for me at the moment

Thank you @Darkensses!

I want to highlight that it's necessary to call DOM.getDocument before using DOM.performSearch, as explained here: https://github.com/cyrus-and/chrome-remote-interface/issues/165#issuecomment-377016861

yup, you're right @macabeus , it's important to get the DOM first, before click any element


Fix Non contiguous event nonce issue

Context:
For each iteration (Duration = 1minute), Peggo Oracle queries 2000 blocks on Ethereum, filters Claim Events and and broadcasts them to injective chain.
Problem:
As peggo oracle sends all the events available in 2000 blocks at once in a for loop,
The CheckTx call for 2nd event fails with non contiguous event nonce error as 1st event is still in execution.
Solution

Peggo should send events sequentially with a delay of 2-3seconds.
Considering 3 second delay, it can send only 20 events for each iteration.
So better to search only 20 blocks to ensure all the events gets broadcasted to injective chain without missing in each iteration.

The CheckTx call for 2nd event fails with non contiguous event nonce error as 1st event is still in execution.

Hm, shouldn't actually happen with QueueBroadcasTx, but yeah I agree it is safer to reduce the scope.
Since getting too many msgs into one Tx can hit the limits


TableCacheTest is flaky

Can you please link a failed Actions run?

Still flaky https://github.com/apache/pinot/runs/5399161242?check_suite_focus=true

🤞🏻


Feat/back/connect with front

Implmented changes:
Corrections to endpoints, and handling error cases.

@josent19 Hi buddy, this is what I've done so far, take a look just in case is there something useful, so far this is working with the front-end but unfortunately I haven't finished all yet.


Artifacts

So, here, I wrote an implementation of artifacts support/storage. I love Integrity so much that I decided to implement something that I really thought would be cool. I've got a copy with my modifications running at http://ci.maio.me/ if you want to check it out.
When you set up a project, you can configure a list of artifacts to link to from the build page. I added support for using *'s as wildcards of files to preserve. I'm not completely sure if you can use artifacts buried within the directory structure, I haven't had to preserve a buried artifact. But they for sure work for artifacts generated in the root directory.

Buried artifacts do break it, I'll attempt to fix it later.

Ok, as you can probably see from the commit log, I fixed buried artifacts breaking artifact display. It does a much better job of handling those now :p it can also handle buried wildcarded artifacts now, as well.

* is basically a wildcard character. You use it in artifacts path the same way you'd use it in, say, bash. Like, ‘ls ./*.jar‘ lists all the files in a directory that end with .jar. The usage and point is the same. There really is no need to document something as simple as that, in my honest opinion. As you can maybe tell from my last commits, I maybe answered some questions or changed some things that should have been different from the start or just shouldn't have been there.

Do you think you could provide me with an example of an artifact pattern which would allow access to arbitrary files? I've tried multiple different ways to get data from arbitrary files, but to no avail.

I can work on that but it will take some time as I currently have no integrity installations.

Cleaned up history: https://github.com/richmeyers/integrity/compare/artifacts
What is your use case for wildcards in artifacts?

What do you mean by "use case"?

If I understand what you are asking correctly, basically, wildcards in artifacts work like this:
Say you have a project which, when built, generates multiple files you may want to let others download, and say they're all placed in /artifacts/ under the build directory each time. In the artifacts field, you'll use "artifacts/" to provide all of those as an artifact. Or maybe, you only want to provide .gem files as artifacts: "artifacts/.gem"
For one of my projects, Integrity runs a compile script, which generates a jar file with a different name, depending on the version of the project, so I just have "*.jar" as an artifact.


fix(Documentation): Re-enable story source and use top level organization

Changes:

Fixes story-source (code unavailable).
Reorganizes a few misplaced stories.
Adds top level sectioning for the two packages of Gamut (Core) and Brand (Labs) - these are subject to change (I picked alphabetical because reorganizing Sections is a PITA afaik).

Notes:

Story source stopped working since the AST parser expects an object literal as the default export (https://github.com/storybookjs/storybook/blob/master/lib/source-loader/src/server/abstract-syntax-tree/traverse-helpers.js#L170), and unfortunately there seems to be no way around this in the interim.  I've replaced all default story exports with the literals in the interim, but left decoratedStories in as a hopeful alternative.

🚀 Styleguide deploy preview ready!https://5eacafd80ecc6b8521d0b209--codecademy-styleguide.netlify.appDeploy Logs

RIP enforced consistent formatting... I guess we'll just have to trust ourselves 😄. Or maybe use lint rules...
Love the sidebar!

RE: Gonna double check to see if there are any open issues.  AFAIK from the ones I saw they do not have active plans to fix or make this work 🤷

🚀 Styleguide deploy preview ready!https://5eb06e87ece4a80188eef526--codecademy-styleguide.netlify.appDeploy Logs

🚀 Styleguide deploy preview ready!https://5eb071d7c120470221c9c75d--codecademy-styleguide.netlify.appDeploy Logs

🚀 Styleguide deploy preview ready!https://5eb07e4e4c4d78017c2c417a--codecademy-styleguide.netlify.appDeploy Logs

🚀 Styleguide deploy preview ready!https://5eb085118d929a025541f8d9--codecademy-styleguide.netlify.appDeploy Logs


plot_1d_hist is not tested

Currently we have no tests that hit the plot_1d_hist function. In #15 I found that when trying a naive test on the travis and circle servers they were failing due to a keyword error that arose when astropy was not installed. It would be good to add some explicit tests of the plot_1d_hists for these purposes.

Do you want this to be added to #15? Or should I start a new PR for this?

Resolved by #15


stylua added with github workflow

Added some format styling that is checked on push.
column_width = 120
line_endings = "Unix"
indent_type = "Spaces"
indent_width = 2
quote_style = "AutoPreferDouble"
call_parentheses = "Always"

Closing due to inactivity


Update codecov.yml

adds feature where code coverage cannot decrease with new merges, also can generate codecov comments

The codecov bot does take a couple of minutes to generate the data before appearing on this page

update: the codecov bot comment at the top should update within 5 minutes of each new commit with stats.


Godot 3.5 + C#10 ;)

Upgrade to C#10 and Godot 3.5 (was just released today)
Make use of file scoped namespaces and global usings 😄
Remove redundant usings deprecated by global usings

*I renamed all public vars to start with a capital letter but this wiped your export values so I reverted these changes. So you can ignore 1426d4435178e2a793683bd9d250a76c31f88dda 56cd85d9ec1890fbb2075084ffe9dd49bf2acf01 fc4310a51d10a0ebaea5933a03c853669d3d850f and c46ed2f67345512883552d40a733692ea21e3d51 I always have trouble when trying to delete commits from GitHub. I have tested your game in Godot and it works 100% as it did before.

Awesome, thanks!


Sample App Asks for Unnecessary Info on Register

The sample app registration page looks like this:

This is confusing because: why do I need to supply first name / last name / favorite color if that info is not used anywhere else in this demo? Seems unnecessary, and just adds confusion.

Well, it is shown on the "profile" page, but it's the lamest profile page ever because you can't actually edit anything :)
I actually want to remove this example application in favor of the Stormpath Angular + Express Fullstack Sample Project.  See #166 for the full plain I'm setting out.
Closing issue, please follow up if that plan doesn't address the concern.


VM creation fails on OSX 10.8.5

I installed Boot2Docker-1.4.1.pkg on OSX 10.8.5 and afterwards opened Applications/boot2docker.app. After the SSH key was generated, I see the following error:
error in run: Failed to initialize machine "boot2docker-vm": exit status 2
bash-3.2$ /usr/local/bin/boot2docker up
Waiting for VM and Docker daemon to start...
..........................................................................ooooo

~/VirtualBox VMs/boot2docker-vm/Logs/VBox.log shows that the VM was hung because there's no harddisk connected. Sure enough, in ~/VirtualBox VMs/boot2docker-vm/boot2docker-vm.vbox, under <MediaRegistry>, I see <HardDisks/> and <DVDImages/>, confirming there's no bootable media mounted.
What fixed it (hit ctrl-c to stop the waiting and typed it into the same terminal):
boot2docker poweroff
boot2docker delete
boot2docker init
boot2docker start

This seems similar to the issue at https://github.com/boot2docker/boot2docker-cli/issues/148 but I don't think it's anything to do with DYLD_LIBRARY_PATH

Sorry, this repository is long-since deprecated in favor of Docker Toolbox (whose usage is now also discouraged in favor of Docker for Windows and Docker for Mac).


mobile-load.png

This is not working?

I can't find the mobile-load.png?
Thanks

Hello John,
Thanks for the feedback. That image was removed. Just updated the header.php on Github. Check it out: https://github.com/milohuang/reverie/blob/master/header.php
--
Zhen Huang
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
On Monday, February 27, 2012 at 6:14 AM, John Arce wrote:

This is not working?

I can't find the mobile-load.png?
Thanks

Reply to this email directly or view it on GitHub:
https://github.com/milohuang/reverie/issues/23

Welcome, I'm using reverie at http://webgeek.ph It's a really great HTML5-powered framework.
I have few questions & need some help, Can I post it here?


[Impeller] rendering engine after enable in flutter android Webview stops working.

Steps to reproduce

In my Flutter app Project Enable the impeller engine via this code in the AndroidManifest.xml file under the tag.

After that Enable My Existing In-AppWeb view stop to load the url its show the blank page during InAppWebview load after enable impeller.

if i remove the impeller then in-appWebview load work perfactly in my app. but i want to load webview with the enable impeller.
Please give me a as soon as solution to fix this...
Thanks🙏

Expected results
i want to load webview with the enable impeller.
Actual results
After that Enable My Existing In-AppWeb view stop to load the url its show the blank page during InAppWebview load after enable impeller.
Code sample
Code sample
https://docs.flutter.dev/perf/impeller#android

I am using this link to Enable impeller. and i am using Flutter sdk version: 3.13.5.

Screenshots or Video

Screenshots / Video demonstration
[Upload media here]

Logs
Logs
[Paste your logs here]

Flutter Doctor output
Doctor output
[Paste your output here]

Hi @Khizar-crewLogix, according to the information you have provided, you are running a very old version of flutter. Kindly upgrade to the latest version of flutter stable (3.24.0 at the time of writing) to see if you still experience this issue. If you do, please provide a complete minimal reproducible code sample so that we can properly investigate this.
PS: In the future, when filing an issue, please provide all the relevant information requested in the template.
Thank you


Custom Trigger + Transition ( Dropdown )

Add parent div on slot to allow custom trigger on Dropdown and transition prop + element to Dropdown content

I forgot to remove the conditional class hidden on dropdown not visible, cause it would break the transition, just did it

@CaptainZiboo Great work!
I think we should provide default transition then, I've added 4 transitions which depends on placement)

@Chank1e I think transition depending on placement are a good idea, but we should also let people use custom transitions, then they can define they own transitions in their App.vue or View.vue, style a transition and pass it as a props to the dropdown, such as fade transitions or anything else, what do you think about that ?

ye, exactly) But you can do it with transition prop now. If no transition prop provided - default transition picked.
Also added null to type and to default value of transition prop. Now if you don't provide transition prop - default used, if you provide some name - using provided transition or if you pass empty string(:transition="" or just transition) no default transition would be used

kk perfect ! Thanks for your help on that ! I'm also learning typescript and Flowbite Vue helps me a lot on that ! :p

Awesome) Merging


competing attempt to bump mathlib and update blueprint

@gio256 we were working in parallel. Help me figure out which to merge?

Note the blueprint is actually broken: this version can't find Nerve.quasicategory in mathlib.

@emilyriehl apologies for the lack of coordination. I would say just merge this one, as it does all the work I have yet to do (updating the blueprint and moving ForMathlib/AlgebraicTopology/SimplicialSet/Quasicategory.lean)

@pitmonticone sorry to bug you again. I'm having another issue with a mathlib declaration that the blueprint is having trouble finding. This is from a relatively new PR by @gio256.

@emilyriehl fixed


IPv6 requests support

Hello @JustinAzoff,
Thanks for this package.
It works great for IPv4 requests, but not for IPv6 (contrary to capacities shown on https://asn.cymru.com/cgi-bin/whois.cgi):
>>> import socket
>>> import cymruwhois

>>> socket.getaddrinfo("google.com", None, socket.AF_INET6)
[(<AddressFamily.AF_INET6: 10>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('2a00:1450:4007:810::200e', 0, 0, 0)), (<AddressFamily.AF_INET6: 10>, <SocketKind.SOCK_DGRAM: 2>, 17, '', ('2a00:1450:4007:810::200e', 0, 0, 0)), (<AddressFamily.AF_INET6: 10>, <SocketKind.SOCK_RAW: 3>, 0, '', ('2a00:1450:4007:810::200e', 0, 0, 0))]

>>> socket.getaddrinfo("google.com", None, socket.AF_INET6)[0][4][0]
'2a00:1450:4007:80b::200e'

>>> d = socket.getaddrinfo("google.com", None, socket.AF_INET6)[0][4][0]

>>> vars(cymru_resolver.lookup(d))
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/root/venvs/venvredflagpub/lib/python3.11/site-packages/cymruwhois.py", line 190, in lookup
    return list(self.lookupmany([ip]))[0]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/venvs/venvredflagpub/lib/python3.11/site-packages/cymruwhois.py", line 201, in lookupmany
    for rec in self._lookupmany_raw(not_cached):
  File "/root/venvs/venvredflagpub/lib/python3.11/site-packages/cymruwhois.py", line 232, in _lookupmany_raw
    r=asrecord(*parts)
      ^^^^^^^^^^^^^^^^
TypeError: asrecord.__init__() missing 2 required positional arguments: 'cc' and 'owner'

Any plan to support IPv6 ?
Cheers!

Nevermind, by instanciating a new cymru_resolver = cymruwhois.Client(), IPv6 worked!


Conda install error, incomplete output from deepbgc pipeline, and IndexError: tuple index out of range

Hello DeepBGC developers,
I learned about this software from Geoffrey Hannigan's recent microseminar - fantastic. I just had a quick test on the software. I tried conda install the software but it didn't work. Conda output something like this:
UnsatisfiableError: The following specifications were found to be in conflict:
  - deepbgc
Use "conda search <package> --info" to see the dependencies for each package.

Anyways, I proceeded with creating an empty conda environment, conda install the dependencies and pip install deepbgc. DeepBGC worked so far, although there was a lot of deprecation warning from tensorflow. I downloaded the trained classifier with deepbgc download. Here is the output for deepbgc info:
 _____                  ____    ____   ____
 |  _ \  ___  ___ ____ | __ )  / ___) / ___)
 | | \ \/ _ \/ _ \  _ \|  _ \ | |  _ | |
 | |_/ /  __/  __/ |_) | |_) || |_| || |___
 |____/ \___|\___| ___/|____/  \____| \____)
=================|_|===== version 0.1.7 =====
INFO    27/07 23:14:23   Available data files: ['Pfam-A.31.0.hmm', 'Pfam-A.31.0.hmm.h3m', 'Pfam-A.31.0.hmm.h3f', 'Pfam-A.31.0.hmm.h3i', 'Pfam-A.31.0.hmm.h3p', 'Pfam-A.31.0.clans.tsv']
INFO    27/07 23:14:23   ================================================================================
INFO    27/07 23:14:23   Available detectors: ['clusterfinder_geneborder', 'clusterfinder_retrained', 'deepbgc', 'clusterfinder_original']
INFO    27/07 23:14:23   --------------------------------------------------------------------------------
INFO    27/07 23:14:23   Model: clusterfinder_geneborder
INFO    27/07 23:14:23   Loading model from: /home/zarul/.local/share/deepbgc/data/0.1.0/detector/clusterfinder_geneborder.pkl
INFO    27/07 23:14:23   Type: GeneBorderHMM
INFO    27/07 23:14:23   Version: 0.1.0
INFO    27/07 23:14:23   Timestamp:<PHONE_NUMBER>.1564941 (2019-03-01T22:17:43.156494)
INFO    27/07 23:14:23   --------------------------------------------------------------------------------
INFO    27/07 23:14:23   Model: clusterfinder_retrained
INFO    27/07 23:14:23   Loading model from: /home/zarul/.local/share/deepbgc/data/0.1.0/detector/clusterfinder_retrained.pkl
INFO    27/07 23:14:23   Type: DiscreteHMM
INFO    27/07 23:14:23   Version: 0.1.0
INFO    27/07 23:14:23   Timestamp:<PHONE_NUMBER>.734045 (2019-03-01T22:18:45.734045)
INFO    27/07 23:14:23   --------------------------------------------------------------------------------
INFO    27/07 23:14:23   Model: deepbgc
INFO    27/07 23:14:23   Loading model from: /home/zarul/.local/share/deepbgc/data/0.1.0/detector/deepbgc.pkl
Using TensorFlow backend.
/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/tensorflow/python/framework/dtypes.py:516: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint8 = np.dtype([("qint8", np.int8, 1)])
/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/tensorflow/python/framework/dtypes.py:517: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint8 = np.dtype([("quint8", np.uint8, 1)])
/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/tensorflow/python/framework/dtypes.py:518: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint16 = np.dtype([("qint16", np.int16, 1)])
/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/tensorflow/python/framework/dtypes.py:519: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint16 = np.dtype([("quint16", np.uint16, 1)])
/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/tensorflow/python/framework/dtypes.py:520: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint32 = np.dtype([("qint32", np.int32, 1)])
/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/tensorflow/python/framework/dtypes.py:525: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  np_resource = np.dtype([("resource", np.ubyte, 1)])
/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:541: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint8 = np.dtype([("qint8", np.int8, 1)])
/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:542: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint8 = np.dtype([("quint8", np.uint8, 1)])
/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:543: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint16 = np.dtype([("qint16", np.int16, 1)])
/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:544: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint16 = np.dtype([("quint16", np.uint16, 1)])
/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:545: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint32 = np.dtype([("qint32", np.int32, 1)])
/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/tensorboard/compat/tensorflow_stub/dtypes.py:550: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  np_resource = np.dtype([("resource", np.ubyte, 1)])
WARNING: Logging before flag parsing goes to stderr.
W0727 23:14:23.820647<PHONE_NUMBER>89184 deprecation_wrapper.py:119] From /home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:74: The name tf.get_default_graph is deprecated. Please use tf.compat.v1.get_default_graph instead.

W0727 23:14:23.829619<PHONE_NUMBER>89184 deprecation_wrapper.py:119] From /home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:517: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.

W0727 23:14:23.830600<PHONE_NUMBER>89184 deprecation_wrapper.py:119] From /home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:4138: The name tf.random_uniform is deprecated. Please use tf.random.uniform instead.

W0727 23:14:24.130435<PHONE_NUMBER>89184 deprecation_wrapper.py:119] From /home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:133: The name tf.placeholder_with_default is deprecated. Please use tf.compat.v1.placeholder_with_default instead.

W0727 23:14:24.134406<PHONE_NUMBER>89184 deprecation.py:506] From /home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:3445: calling dropout (from tensorflow.python.ops.nn_ops) with keep_prob is deprecated and will be removed in a future version.
Instructions for updating:
Please use `rate` instead of `keep_prob`. Rate should be set to `rate = 1 - keep_prob`.
W0727 23:14:24.515460<PHONE_NUMBER>89184 deprecation_wrapper.py:119] From /home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/keras/backend/tensorflow_backend.py:174: The name tf.get_default_session is deprecated. Please use tf.compat.v1.get_default_session instead.

I0727 23:14:24.652741<PHONE_NUMBER>89184 info.py:26] Type: KerasRNN
I0727 23:14:24.652947<PHONE_NUMBER>89184 info.py:27] Version: 0.1.0
I0727 23:14:24.653012<PHONE_NUMBER>89184 info.py:28] Timestamp:<PHONE_NUMBER>.986168 (2019-02-28T06:14:27.986168)
I0727 23:14:24.653129<PHONE_NUMBER>89184 info.py:22] --------------------------------------------------------------------------------
I0727 23:14:24.653177<PHONE_NUMBER>89184 info.py:23] Model: clusterfinder_original
I0727 23:14:24.653223<PHONE_NUMBER>89184 wrapper.py:174] Loading model from: /home/zarul/.local/share/deepbgc/data/0.1.0/detector/clusterfinder_original.pkl
I0727 23:14:24.655262<PHONE_NUMBER>89184 info.py:26] Type: ClusterFinderHMM
I0727 23:14:24.655326<PHONE_NUMBER>89184 info.py:27] Version: 0.1.0
I0727 23:14:24.655377<PHONE_NUMBER>89184 info.py:28] Timestamp:<PHONE_NUMBER>.5101252 (2019-03-01T22:18:24.510125)
I0727 23:14:24.655647<PHONE_NUMBER>89184 info.py:67] ================================================================================
I0727 23:14:24.655702<PHONE_NUMBER>89184 info.py:68] Available classifiers: ['product_class', 'product_activity']
I0727 23:14:24.655784<PHONE_NUMBER>89184 info.py:22] --------------------------------------------------------------------------------
I0727 23:14:24.655827<PHONE_NUMBER>89184 info.py:23] Model: product_class
I0727 23:14:24.655869<PHONE_NUMBER>89184 wrapper.py:174] Loading model from: /home/zarul/.local/share/deepbgc/data/0.1.0/classifier/product_class.pkl
/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/sklearn/base.py:306: UserWarning: Trying to unpickle estimator DecisionTreeClassifier from version 0.18.2 when using version 0.21.2. This might lead to breaking code or invalid results. Use at your own risk.
  UserWarning)
/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/sklearn/base.py:306: UserWarning: Trying to unpickle estimator RandomForestClassifier from version 0.18.2 when using version 0.21.2. This might lead to breaking code or invalid results. Use at your own risk.
  UserWarning)
I0727 23:14:24.696886<PHONE_NUMBER>89184 info.py:26] Type: RandomForestClassifier
I0727 23:14:24.696993<PHONE_NUMBER>89184 info.py:27] Version: 0.1.0
I0727 23:14:24.697047<PHONE_NUMBER>89184 info.py:28] Timestamp:<PHONE_NUMBER>.019103 (2019-03-05T18:23:30.019103)
I0727 23:14:24.700250<PHONE_NUMBER>89184 info.py:22] --------------------------------------------------------------------------------
I0727 23:14:24.700344<PHONE_NUMBER>89184 info.py:23] Model: product_activity
I0727 23:14:24.700432<PHONE_NUMBER>89184 wrapper.py:174] Loading model from: /home/zarul/.local/share/deepbgc/data/0.1.0/classifier/product_activity.pkl
I0727 23:14:24.710430<PHONE_NUMBER>89184 info.py:26] Type: RandomForestClassifier
I0727 23:14:24.710538<PHONE_NUMBER>89184 info.py:27] Version: 0.1.0
I0727 23:14:24.710602<PHONE_NUMBER>89184 info.py:28] Timestamp:<PHONE_NUMBER>.886473 (2019-03-05T18:23:53.886473)
I0727 23:14:24.710908<PHONE_NUMBER>89184 info.py:78] ================================================================================
I0727 23:14:24.710979<PHONE_NUMBER>89184 info.py:80] All OK

I tried to run deepbgc on a file containing 25 contigs, all above 20kb but it didn't complete (I specified only deepbgc detector). There was a tmp directory containing all the prodigal and pfam files. There was an empty evaluation directory - not expected based on your example results notebook. Here is the last few lines of LOG.txt:
Detected 36 total BGCs using deepbgc model
Number of BGCs with predicted product_class:
 no confident class: 22
 Polyketide: 8
 Saccharide: 3
 RiPP: 3
 Terpene: 1
 NRP: 1
Number of BGCs with predicted product_activity:
 antibacterial: 26
 no confident class: 9
 cytotoxic: 1
 antifungal: 1
tuple index out of range
Traceback (most recent call last):
  File "/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/deepbgc/main.py", line 113, in main
    run(argv)
  File "/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/deepbgc/main.py", line 102, in run
    args.func.run(**args_dict)
  File "/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/deepbgc/command/pipeline.py", line 187, in run
    writer.close()
  File "/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/deepbgc/output/evaluation/pfam_score_plot.py", line 28, in close
    self.save_plot()
  File "/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/deepbgc/output/evaluation/pfam_score_plot.py", line 59, in save_plot
    axes[i].plot(x, y, lw=0.75, alpha=0.6, color=color, label=column)
  File "/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/matplotlib/axes/_axes.py", line 1666, in plot
    lines = [*self._get_lines(*args, data=data, **kwargs)]
  File "/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/matplotlib/axes/_base.py", line 225, in __call__
    yield from self._plot_args(this, kwargs)
  File "/home/zarul/Zarul/Software/anaconda3/envs/bgc/lib/python3.7/site-packages/matplotlib/axes/_base.py", line 399, in _plot_args
    ncx, ncy = x.shape[1], y.shape[1]
IndexError: tuple index out of range
================================================================================
DeepBGC failed with IndexError: tuple index out of range
================================================================================

Thank you.

Hi Zarul,
glad to hear about Geof's seminar and thanks for the bug report!
Have you tried installing deepbgc using conda in the empty environment or just in your base conda environment? And did that fail? I am having trouble reproducing the error.
The TF and sklearn deprecation warnings should not impact the results, we used to specify the exact TF version in our dependencies, but then we figured users might find it limiting if they are using other tools in the same environment. Feel free to use pip install tensorflow==1.12.0 scikit-learn==0.18.2 to avoid the deprecation warnings.
As for the error, that was probably caused by trying to plot a sequence with just a single detected pfam domain. I added new tests for that functionality and fixed the error https://github.com/Merck/deepbgc/pull/12. Please try upgrading using pip install deepbgc==0.1.18 and running deepbgc again with the same parameters (the pfam annotation results should be reused using the tmp folder).
Cheers,
David

Hello David,
Thank you for replying. Conda kept reminding me to update from 4.7.7 to 4.7.10, so I tried to update conda but failed. So I did a new conda installation, and now deepbgc installation with conda easily works! And the plots also appear, with deepbgc 0.1.8! Everything worked simply with a new conda version (why?).
Anyways, thank you very much David for your help.
Regards,
Zarul

Hi Zarul, great to hear that. I fixed the plotting bug in version 0.1.8 after you reported this issue so that's why it works now 😄About the conda issue, it's hard to see what was going on but I am glad it was resolved by updating. I am closing this issue, please let us know if you bump into anything else.


[Microsoft.DocumentDB] CosmosDB - New API version 20240515

Contributing to the Azure SDK
Please see our CONTRIBUTING.md if you are not familiar with contributing to this repository or have questions.
For specific information about pull request etiquette and best practices, see this section.

API change check
APIView has identified API level changes in this PR and created following API reviews.
Azure.ResourceManager.CosmosDB


Job tracking improvements

add helper methods to support fetching started/updated timestamps
do not discard started timestamp on update
simplify job id mapping
sanity check update() to accept valid statuses only

all tests still pass :persevere:

how about it, then? :)

ping...

It's been a while, any chance of getting this merged?

@danhunsaker, @Aeon - what was the conclusion on this change breaking interop? I had a quick look through, and nothing immediately stands out?

@chrisboulton I rolled back the interop breaking change, so this should be entirely safe at this point

On Nov 21, 2016, at 1:50 PM, Chris Boulton<EMAIL_ADDRESS>wrote:
@danhunsaker, @Aeon - what was the conclusion on this change breaking interop? I had a quick look through, and nothing immediately stands out?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

Let me know if there's any other concerns with this pull request :)

@chrisboulton - In its first incarnation, it changed the way jobs are stored in Redis, but once that was pointed out, those changes were removed.  I looked through the rest and it looks good, now.
@Aeon - Nothing I'm aware of that should block this change being merged.  Just waiting for Chris to have the time to review and merge.
:+1:


REddis best /1

Fixes #28698

Internal previews

📄 File
🔗 Preview link

aspnetcore/performance/caching/distributed.md
aspnetcore/performance/caching/distributed

@CawaMS  please review.

#sign-off


Considering to add free learning/practicing resources on a new related section

Why not to ad a section whit free learning or practicing resources like for example:

coding practice: exercism, edabit, codekata
frontend practice: frontend mentor
ui practice: daily ui

Hey @vinc86,
it is a simple list of "design resources for developers". Learning/practice material would not fit these criteria.


Fix clippy lints and deprecation warnings in the examples

The title explains everything.
I am planning on making some more PRs in the near future and wanted to get these upstreamed so that I don't have to search through clippy output every time.

Thanks! I should integrate clippy inside the CI
Before merging it can you modify the commit style in according with the docs?
https://github.com/laanwj/cln4rust/blob/master/docs/MAINTAINERS.md#commit-style


Speed up system tests

Context
I was investigating the performance of our system tests when I noticed a large number of log lines like this:
[Webpacker] Everything's up-to-date. Nothing to do

I think this is Webpacker trying to compile the assets and then telling us that no CSS/JS changes were detected.
Turns out this system is super expensive. Turning the compile flag off in test causes a preposterous speedup in the tests:
Before: Finished in 2 minutes 36.5 seconds
After: Finished in 57.61 seconds

Changes proposed in this pull request
Because compile: true does a compile on each request, we have to make sure that our assets are compiled before running the tests, similarly to how production works. We can do this by sprinkling the compile task in relevant places:
RAILS_ENV=test rails webpacker:compile

I’ve also added a reminder that shows every test run, so that if you run bundle exec rspec you won’t get caught out. I think this is a reasonable trade-off for the speed up that we’re seeing.
Note that there’s something I don’t understand in the compilation - the current compilation saves the result in public/packs-test, but running our rake task saves it in public/packs. But it still works.
Guidance to review
Not sure.
Link to Trello card
https://trello.com/c/OEjmIn3C
Things to check

[x] This code doesn't rely on migrations in the same Pull Request
[x] If this code includes a migration adding or changing columns, it also backfills existing records for consistency
[x] API release notes have been updated if necessary
[X] New environment variables have been added to the Azure config

:100: preposterously faster!


calling methods with "tuple" type return gives error

I'm trying to get data for an EAS attestation, but i can't because the result is a tuple and it's giving error.
The ABI
{
"inputs": [{ "internalType": "bytes32", "name": "uid", "type": "bytes32" }],
"name": "getAttestation",
"outputs": [
    {
    "components": [
        { "internalType": "bytes32", "name": "uid", "type": "bytes32" },
        { "internalType": "bytes32", "name": "schema", "type": "bytes32" },
        { "internalType": "uint64", "name": "time", "type": "uint64" },
        { "internalType": "uint64", "name": "expirationTime", "type": "uint64" },
        { "internalType": "uint64", "name": "revocationTime", "type": "uint64" },
        { "internalType": "bytes32", "name": "refUID", "type": "bytes32" },
        { "internalType": "address", "name": "recipient", "type": "address" },
        { "internalType": "address", "name": "attester", "type": "address" },
        { "internalType": "bool", "name": "revocable", "type": "bool" },
        { "internalType": "bytes", "name": "data", "type": "bytes" }
    ],
    "internalType": "struct Attestation",
    "name": "",
    "type": "tuple"
    }
],
"stateMutability": "view",
"type": "function"
}

the error
NoMethodError: undefined method `none?` for nil:NilClass

          elsif base_type == "tuple" && components.none?(&:dynamic?)
                                                  ^^^^^^
from ~/.rbenv/versions/3.1.5/lib/ruby/gems/3.1.0/gems/eth-0.5.11/lib/eth/abi/type.rb:118:in `size'

Can you give me an address or test data that makes this fail?
Can you confirm this also happens with latest main branch? Just clone the repository, run bin/console and create your client / contract there.

@q9f  I see this happening too; I think it's because in the ABI file, the components are nested.
Here's an example.
Eth::Contract.from_abi using the ABI below
and calling contract with address "0xbb505c54d71e9e599cb8435b4f0ceec05fc71cbd" on Base.
eg. client.call(contract_instance, "getReserveStatus", [64]
client.call_raw which is ultimately is called gets types like this types = func.outputs.map { |i| i.type }
but from the ABI, func.outputs is an array with a single hash [ { components: "" } ]
https://github.com/q9f/eth.rb/blob/4182fa7993a9a6c6648e065dcf6748fb8d738895/lib/eth/client.rb#L455
  {
    "inputs": [
      {
        "internalType": "uint256[]",
        "name": "reserveIdArr",
        "type": "uint256[]"
      }
    ],
    "name": "getReserveStatus",
    "outputs": [
      {
        "components": [
          {
            "internalType": "uint256",
            "name": "reserveId",
            "type": "uint256"
          },
          {
            "internalType": "address",
            "name": "underlyingTokenAddress",
            "type": "address"
          },
          {
            "internalType": "address",
            "name": "eTokenAddress",
            "type": "address"
          },
          {
            "internalType": "address",
            "name": "stakingAddress",
            "type": "address"
          },
          {
            "internalType": "uint256",
            "name": "totalLiquidity",
            "type": "uint256"
          },
          {
            "internalType": "uint256",
            "name": "totalBorrows",
            "type": "uint256"
          },
          {
            "internalType": "uint256",
            "name": "exchangeRate",
            "type": "uint256"
          },
          {
            "internalType": "uint256",
            "name": "borrowingRate",
            "type": "uint256"
          }
        ],
        "internalType": "struct ILendingPool.ReserveStatus[]",
        "name": "statusArr",
        "type": "tuple[]"
      }
    ],
    "stateMutability": "view",
    "type": "function"
  }

Thank you. I used this ABI to ensure the Abi::Type parser works correctly, it has all types, names, and components correctly.
# name
"statusArr"
# type
<Eth::Abi::Type:0x000062dd59c2e4f0 @base_type="tuple", @dimensions=[0], @name=nil, @sub_type="">
# data
{"components"=>
  [{"internalType"=>"uint256", "name"=>"reserveId", "type"=>"uint256"},
   {"internalType"=>"address", "name"=>"underlyingTokenAddress", "type"=>"address"},
   {"internalType"=>"address", "name"=>"eTokenAddress", "type"=>"address"},
   {"internalType"=>"address", "name"=>"stakingAddress", "type"=>"address"},
   {"internalType"=>"uint256", "name"=>"totalLiquidity", "type"=>"uint256"},
   {"internalType"=>"uint256", "name"=>"totalBorrows", "type"=>"uint256"},
   {"internalType"=>"uint256", "name"=>"exchangeRate", "type"=>"uint256"},
   {"internalType"=>"uint256", "name"=>"borrowingRate", "type"=>"uint256"}],
 "internalType"=>"struct ILendingPool.ReserveStatus[]",
 "name"=>"statusArr",
 "type"=>"tuple[]"}

The problem is that while decoding the result, the type somewhere loses the components, thus the error. I suspect that a recent bug fix did not cover all cases. I just need to find out where it fails.
So, good news (for me) is the module works correctly, it just is not invoked correctly (in a yet unknown location).
I'm sorry if this takes a bit as this specific code was added by a contributor and I'm still getting warm with the mechanics.


Obsolete FallbackTypeMappingSource

Since in 3.0 we will remove everything associated with the already obsolete ITypeMapper.

It's internal, so no need to obsolete. Removal is covered by #12835


Right-justify Sankey diagram

The Sankey diagram should be right-justified. This will have implications for how the height of the diagram is calculated.

Done in 92798357af55183da19fecbf75b3c1b24f843d7f.


Hold LOCKs only as long as necessary

As outlined in #84,gettransactions_MP and other parts currently lock certain sections longer than necessary.
In case of gettransactions_MP an additional improvement could be to restructure the command, such that we lock the wallet, collect the wallet transactions, release the lock, and then process the transactions, instead of holding the lock for the whole time.
I'm going to tackle it, once the RPC branch is in.

currently lock certain sections longer than necessary.
additional improvement could be to restructure the command, such that we lock the wallet, collect the wallet transactions, release the lock, and then process the transactions, instead of holding the lock for the whole time.

I'm not sure if this is possible mate - how would you go about it?
Let's say we do a listtransactions_MP and we're looking for the most recent 10 Omni transactions - we don't know if we'll have to look at the last 10, the last 100, or the last 1000 wallet transactions to find them.
I'm of course open to any ideas you have here mate, but I didn't think we could optimize any more until we changed architecture for data storage.

Very good point about not knowing how wallet transactions are really relevant.
Let's look at it this way: we do a lot of things, like querying the database, parsing transactions, converting some data into JSON objects, and all this has basically nothing to do with the wallet, so the lock is "unused" (or unjustified) during that time.
I haven't really thought about specifics yet. A probably straight forward approach could be to lock the wallet, fetch the wallet transactions, and release the lock. If, for some reason, this isn't safe, because the wallet may interfere with the pointers to these wallet transactions, we could create copies of them before going on.

That's the issue - you don't want to be creating say 10,000 copies of wallet transactions (you never know if you'll need them)...  I have another approach in mind, bear with me for a few hours and I'll push up an update to walletcache.cpp which will provide a cached list of transactions that affect the wallet, which can be used to optimize these other calls :)

Haha, this is slowly getting out of hands: we have a transaction history cache, one for trades, probably soon another one for the overview transactions (they could share the other cache actually), I have a coins view cache pending, and you one for wallet balances. Oh well.. :)
Jokes aside: all this provided very, very significant speed boosts, so it's a good thing. :)
However, I suggest to hold back (non trivial) structural updates of the RPC stuff until your RPC branch is in.

Indeed hehe - FYI the idea is to provide a data source via walletcache.cpp that is a drop in replacement for iteration - instead of all wallet transactions we iterate only Omni wallet transactions.
Let me see what I come up with, I'm on a roll here I think hehe ;)

Might be easier to cache CMPTransactions then?

That's probably a little more in depth than I was going for, but we could do I guess?
FYI I was simply going to add a vector of uint256 that gets updated via the transaction handler when processed if it was in the wallet.
What do you propose?  Perhaps a map of uint256 & CMPTransaction that cached each transaction object?

FYI I was simply going to add a vector of uint256 that gets updated via the transaction handler

Ah, this sounds pretty straight forward approach.

... when processed if it was in the wallet.

Keep in mind: there are also STO transactions.
Maybe we should get something like bool InvolvesMe(theTransaction) or so?

What do you propose? Perhaps a map of uint256 & CMPTransaction that cached each transaction object?

I'm not really sure, and this was just an idea, but I initially assumed you wanted to cache CWalletTx instead of hashes.

I'm not really sure, and this was just an idea, but I initially assumed you wanted to cache CWalletTx instead of hashes.

Ahh, for the initial I figured we'd get away with just the hashes.  If I exaggerate a scenario hopefully it'll help explain:

I send 10 Omni transactions
I send 10,000 Bitcoin transactions
I call listtransactions_MP with the default params (returns 10 most recent txs)

The code as present will need to loop through all 10K transactions from 2) and still hasn't found any recent Omni transactions.  After going through those 10K transactions it'll then find those 10 Omni transactions I sent first.  It'll do this every time I make the listtransactions_MP call.
A list of hashes is sufficient to avoid that I believe :)

Sounds good! :)

Speaking of locks.. currently all Omni RPC commands are tagged as non-threadsafe, and as result, every call auto-locks cs_main and cs_wallet.
We should ultimately lock on a case-by-case basis, and only for as long as necessary, so multiple RPC threads have an effect.

Oh, look at this, when fetching simple send wallet transactions on mainnet, then around 99 % of the time is spent to populate the transaction object, and:
populateRPCTransactionObject():

  - GetTransaction():         0.191 ms
  - p_txlistdb->exists():     0.025 ms
  - ParseTransaction():       0.884 ms
  - getValidMPTX():           0.089 ms
  - isCrowdsalePurchase():   89.296 ms  <---
  - JSON conversion:          0.049 ms
  - anything inbetween:       0.096 ms

Total: 90.63 ms

Yeah that call is horribly inefficient (see the comment hehe) - there is a large amount of work that is done to essentially "find" any crowdsales that the simple send could have been involved in because we don't currently store a list of atomic actions per message.  This would be one of those things that comes in with the discussion on restructuring the stored data, where we have direct access to xyz rather than reconstructing it from the blockchain.

Note, I can cache this too (using a map holding a matching between simple send txids & property ids their respective crowdsale purchase) which drastically would cut down on the amount of iterating SP databases and make the call much faster.

I pushed up a couple of commits by the way, one with walletcache.cpp extended to cover a TXID cache and a second to demo it via the listtransactions_MP call.

Yeah that call is horribly inefficient (see the comment hehe)

I digged deeper, and it's pretty surprising, but not unexpected:
Most of the time goes into 205 getSP(), but only one call takes about 90 % of all: MaidSafeCoin.
To drill it further down, and locate the actual source:

16 ms for json_spirit::read_string
57 ms for CMPSPInfo::Entry::fromJSON()


Fails building ARR package

Hey, wanted to thank for such great project!
After latest update ( v0.2.0 ), aurcache fails to build sonarr, radarr, prowlarr.
Haven't noticed any problem with other packages, for example pi-hole-ftl or rsyslog
Can confirm i had no issues with previous version ( v0.1.5 ), as i was successfully using it.
Seems like in new version something doesn't work right, as it timeouts and fail, although it should be successful build
Build succeeded.
    0 Warning(s)
    0 Error(s)

Time Elapsed 00:00:58.98
Shutting down MSBuild server...
Shutting down VB/C# compiler server...
MSBuild server shut down successfully.
Build #4 timed out for package 'sonarr'
No files found in build directory

Also added ps faux output during failed build, and full log of sonarr build.
If i can provide some meaningful information let me, i would gladly help
psfaux_sonarr.txt
sonarr_fail.log

Hey,
thanks for reporting the issue, i'll have a look at it.


react-bootstrap-table2-overlay old dependency

The last version of react-bootstrap-table2-overlay 1.0.0 has an old dependecy
"dependencies": {
"react-loading-overlay": "0.2.8"
},
it's possibile to update it?

@LucaNitti  sure, I will update it ASAP, thanks

Fixed it and please upgrade below packages to newest:
https://react-bootstrap-table.github.io/react-bootstrap-table2/blog/2019/05/19/version-bump.html


Update chart coroot to 0.11.0

This PR contains the following updates:

Package
Update
Change

coroot
minor
0.10.23 -> 0.11.0

Release Notes

coroot/helm-charts (coroot)
v0.11.0
Compare Source
A monitoring and troubleshooting tool for microservice architectures.

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

Edited/Blocked Notification
Renovate will not automatically rebase this PR, because it does not recognize the last commit author and assumes somebody else may have edited the PR.
You can manually request rebase by checking the rebase/retry box above.
⚠ Warning: custom changes will be lost.


TINKERPOP-1109 Make Gremlin Console better suited for system level installs

gremlin.sh now handles user-defined ext/ directories (tinkerpop.ext). If the user specified directory doesn't exist, it will
a) create it and
b) copy the contents of gremlin-console/ext to it

Just pushed in a minor change to not bother to default to user home since we can always expect tinkerpop.ext to be set or defaulted. even if it isn't it now defaults to the local ext directory.
Tested this manually a bunch of different ways at this point and console integration tests work well still (though i'm not sure they hit the code paths that were changed).
VOTE +1

VOTE +1

VOTE: +1


Publish new release?

Greetings,
I see that there's some fixes in the source, but they haven't been published to NPM yet. Can we make that happen? It's been awhile since there was a release.

Sorry, just published 0.8.0!

Published 0.2.0


Error fix. Cannot find property match of null

If the project opened on atom, was not a github repo, then it was throwing an error with the message 'Cannot find property match of null'. This fixes this error and prints the correct message when it tries to retrieves its issues

Ouch! I can't believe I wrote that. Thanks for catching the bug!