Update cinder standalone install script in ansible.

Coverage remained the same at 60.745% when pulling 458b6ce1a1e7d0e794830b5f405af79ac35cd82d on wisererik:master into 4a3ae92254625f4939fbd7e601c37ff0a6593105 on opensds:master.


[Issue] HealthChecker - Exception when DisabledComponents is set to 0xffffffff

Describe the issue
Customers reported the following issue:
Exception setting "IPv6DisabledComponents": "Cannot convert value "0xffffffff" to type "System.Double". Error: "Input
string was not in a correct format.""
At C:\Temp\HealthChecker.ps1:2947 char:5
+     $osInformation.NetworkInformation.IPv6DisabledComponents = Invoke ...
+     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (:) [], SetValueInvocationException
    + FullyQualifiedErrorId : ExceptionWhenSetting

at Get-OperatingSystemInformation, C:\Temp\HealthChecker.ps1: line 2947
at Get-HealthCheckerExchangeServer, C:\Temp\HealthChecker.ps1: line 2787
at Main, C:\Temp\HealthChecker.ps1: line 5615
at <ScriptBlock>, C:\Temp\HealthChecker.ps1: line 5655
at <ScriptBlock>, <No file>: line 1

This can be caused when DisabledComponents is set to 0xffffffff which is -1.  We don't recommend to set this value as it can cause a system startup delay:
Additionally, system startup will be delayed for five seconds if IPv6 is disabled by incorrectly, setting the DisabledComponents registry setting to a value of 0xffffffff. The correct value should be 0xff. For more information, see Internet Protocol Version 6 (IPv6) Overview.
Expected behavior
We should not run into an exception. We should instead display a warning that the current value may cause issues.
Script Output
Exception setting "IPv6DisabledComponents": "Cannot convert value "0xffffffff" to type "System.Double". Error: "Input
string was not in a correct format.""
At C:\Temp\HealthChecker.ps1:2947 char:5
+     $osInformation.NetworkInformation.IPv6DisabledComponents = Invoke ...
+     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (:) [], SetValueInvocationException
    + FullyQualifiedErrorId : ExceptionWhenSetting

at Get-OperatingSystemInformation, C:\Temp\HealthChecker.ps1: line 2947
at Get-HealthCheckerExchangeServer, C:\Temp\HealthChecker.ps1: line 2787
at Main, C:\Temp\HealthChecker.ps1: line 5615
at <ScriptBlock>, C:\Temp\HealthChecker.ps1: line 5655
at <ScriptBlock>, <No file>: line 1

Additional context
More information about the problematic value: https://docs.microsoft.com/en-US/troubleshoot/windows-server/networking/configure-ipv6-in-windows#use-registry-key-to-configure-ipv6
Migrated From: https://github.com/dpaulson45/HealthChecker/issues/533

Will take care of this issue.

@lusassl-msft did you just see that in your lab or in someone's environment? Do you think we need to check for this if it isn't set to DWORD?

I've tried to reproduce the issue with the correct value type DWORD (as documented) but was not able to do so. I then checked the customer report again and noticed that they used the wrong value type String.
That was the only issue report from a customer in this regard.
A long-term solution would be to optimize the Invoke-RegistryGetValue function by adding an optional parameter ValueType which then can be used to check for the requested value type via RegistryKey.GetValueKind(String) Method and only return a matching result.
What do you think?

Long term solution would be to improve Get-RemoteRegistryValue in the Shared location, as that is where we are going to be moving the extern files to and have them be that style.

Okay, let's close this issue and file a work item for the Get-RemoteRegistryValue work.


Add ParamId to output_ui & value_widget{,_connected} methods

Currently, only the name is provided. I added to InputId or OutputId.
It's problematic on my side as I handle multiple many-to-many relation with multiple inputs with the same name.
Warning : This is a breaking change, all client code must add this parameter to these 3 methods. This would be possible to avoid that at the cost of complexity.

I feel like the signatures of those methods are getting bloated, maybe we could make param_name be a member of {Input,Output}Param which is easily accessible in O(1) and drop it from the Vec? Also, considering that we introduce a breakage into the signatures of these functions we could also re-order the fields to make stuff a bit more consistent.
Other than that I like this change, param ids are certainly more fundamental than names and I've personally found myself recovering the id from the name a couple of times.


<EMAIL_ADDRESS>is deprecated.

Laravel Mix Version<EMAIL_ADDRESS>Node Version: 9.2.1
NPM Version:  5.6.0
OS: MacOS 10.13.2

Description:
<EMAIL_ADDRESS>is deprecated.
https://medium.com/gulpjs/gulp-util-ca3b1f9f9ac5.
installing a new laravel project and running npm install results in these warnings, not sure if the EINTEGRITY is related to gulp-util though. It seems a dependency of laravel-mix dependencies is using this (gulp-decompress).
npm WARN deprecated<EMAIL_ADDRESS>gulp-util is deprecated - replace it, following the guidelines at https://medium.com/gulpjs/gulp-util-ca3b1f9f9ac5
WARN registry Unexpected warning for https://registry.npmjs.org/: Miscellaneous Warning EINTEGRITY: sha1-aALmJk79GMeQobDVF/DyYnvyyUo= integrity checksum failed when using sha1: wanted sha1-aALmJk79GMeQobDVF/DyYnvyyUo= but got sha512-Y9J6ZjXtoYh8RnXVCMOU/ttDmk1aBjunq9vO0ta5x85WDQiQfUF9sIPBITdbiiIVcBo03Hi3jMxigBtsddlXRw==. (3526 bytes)
WARN registry Using stale package data from https://registry.npmjs.org/ due to a request error during revalidation.
WARN registry Unexpected warning for https://registry.npmjs.org/: Miscellaneous Warning EINTEGRITY: sha1-+PLIh60Qv2f2NPAFtph/7TF5qsg= integrity checksum failed when using sha1: wanted sha1-+PLIh60Qv2f2NPAFtph/7TF5qsg= but got sha512-nne9/IiQ/hzIhY6pdDnbBtz7DjPTKrY00P/zvPSm5pOFkl6xuGrGnXn/VtTNNfNtAfZ9/1RtehkszU9qcTii0Q==. (2301 bytes)
WARN registry Using stale package data from https://registry.npmjs.org/ due to a request error during revalidation.
WARN registry Unexpected warning for https://registry.npmjs.org/: Miscellaneous Warning EINTEGRITY: sha1-qRlH2h9KUW6jjltOwOw3c2deCIY= integrity checksum failed when using sha1: wanted sha1-qRlH2h9KUW6jjltOwOw3c2deCIY= but got sha512-dwVUVIXsBZXwTuwnXI9RK8sBmgq09NDHzyR9SAph9eqk76gKK2JSQmZARC2zRC81JC2QTtxD0ARU5qTS25gIGw==. (4568 bytes)
WARN registry Using stale package data from https://registry.npmjs.org/ due to a request error during revalidation.
WARN registry Unexpected warning for https://registry.npmjs.org/: Miscellaneous Warning EINTEGRITY: sha1-QKBQ7I3DtTsz2ZCUFcAsC/Gr+60= integrity checksum failed when using sha1: wanted sha1-QKBQ7I3DtTsz2ZCUFcAsC/Gr+60= but got sha512-c0yTD2rbQzXtSsFSVhtpvY/vS6u066PcXOX9kBB3mSO76RiUQzL340uJkGBWnlBg4/HZzqiUXtaVA7wcRcJgEw==. (49753 bytes)
WARN registry Using stale package data from https://registry.npmjs.org/ due to a request error during revalidation.

Steps To Reproduce:
install a new laravel project and run npm install

Problem persists as of laravel-mix 2.1.1 via<EMAIL_ADDRESS>Please reopen this issue for resolution.
└─┬<EMAIL_ADDRESS>  └─┬<EMAIL_ADDRESS>    └─┬<EMAIL_ADDRESS>      └─┬<EMAIL_ADDRESS>        └─┬<EMAIL_ADDRESS>          └─┬<EMAIL_ADDRESS>            └─┬<EMAIL_ADDRESS>              └──<EMAIL_ADDRESS>

I'm also having this issue. npm install stops working after this warning is shown.

I only install gulp, gulp-sass, and create an gulpfile.js into the proyect, then use the directives. see this video, it help me: https://www.youtube.com/watch?v=e1G7ZpwoRe4

From fresh install of Laravel Framework 5.6.24. With no changes made. fails at "npm install",


Rails 3: ActiveModel::MassAssignmentSecurity::Error

I installed the Impressionist on my rails 3 application. After configuring the model and the controller to use Impressionist, I get the following error when I access the app online.
ActiveModel::MassAssignmentSecurity::Error
I want to add 'attr_accessible' to the Impression model but I am unable to reopen the class Impression in my app. I tried adding the dollowing code to the initializer/impression.rb
Impression.class_eval do
attr_accessor  :impressionable_type
def hi
puts 'you got me!'
end
end
But that doesn't work. Can anyone help?
Thanks,
Kavita

I did the following modification to make my code work. Under initializers I create a file -> initializer/my_monkey_patch.rb with following code
class Impression < ActiveRecord::Base
attr_accessible :impressionable_type, :impressionable_id, :controller_name, :action_name, :user_id, :request_hash, :session_hash, :ip_address, :referrer
    def hello
        "hello WORLD!"
    end

end


chore: simplify CreateDemand implementation

Either way it's breaking change, so we must decide whether to include end date or not (the default value on backend)

What's the reason for this change and what does this simplify? It was actually explicitly added here https://github.com/energywebfoundation/origin/pull/1342

What's the reason for this change and what does this simplify? It was actually explicitly added here #1342

I know, let's wait for @JosephBagaric with specific explanation, because I'm not entirely sure. I just got info what should be done :)


Reproduce SD (& other models') results

Hello,
I was wondering if there's any way to reproduce your results from your main table? I didn't find any information about seed/generator usage from your codebase/report so I'd really appreciate if you could provide some insights on reproducing these numbers. Thanks!
Also, a side question, for all SD that is mentioned from the codebase and the report, are you using stable diffusion 1.4 or 1.5?

Hi,
we directly used the open-source versions of the models that we have tested in our benchmarking. We used SD 1.4 and the default parameters from https://github.com/CompVis/stable-diffusion/blob/main/scripts/txt2img.py
Note that we have provided the outputs of our object detector in ./objdet_results . All of our generated images are available here: https://huggingface.co/datasets/tgokhale/sr2d_visor/tree/main
Happy to provide more information if needed.

Thanks for the response and the additional information!
Another question that we had is how accurate is the detector for ground truth images? i.e., by setting the threshold to 0.1, do you provide a VISOR reference to ground truth image-prompt (or image-caption) pairs, such as all captions relating to spatial relationships from the COCO dataset?


#3129 - Full template preview following mouse cursor

How the feature works? / How did you fix the issue?
https://github.com/epam/ketcher/assets/16281184/14d0b744-43dd-4a33-9462-4b4dab9dcce2
Check list

[ ] unit-tests written
[x] e2e-tests written
[x] documentation updated
[x] PR name follows the pattern #1234 – issue name
[x] branch name doesn't contain '#'
[x] PR is linked with the issue
[x] base branch (master or release/xx) is correct
[x] task status changed to "Code review"
[x] reviewers are notified about the pull request

The current issue is that after selecting the template - if the user presses undo - the template preview will be left on the canvas instead of hiding the preview and undoing the last action.
I have started re-doing the approach in branch: 3129-full-template-preview-following-mouse-cursor-draft-4

16 tests fail. Please add screenshots of local run

Pre-tested. Bug is fixed. And fixed comments added by @rrodionov91


TITLE CHANGED + REGISTRATION LINK

Added titles for the events allotted as well as updated the registration link for them.

Good Work!
I see you have now learnt that there is no need for you to create a separate pull request for every change you do, but you can make changes collectively across the entire repo and then send a single PR 🥇 🎉

Thanks for acknowledging.
@co16353sidak.


Use description embeddings for disambiguation

If you reconcile a dataset against Wikidata and have a name column in your dataset with a name like "Michael Jackson" and match this again type human (Q5), there will be many matches. Since there are a number of notable people named Michael Jackson, you may need to go through them manually, typically disambiguating using the Description field from Wikidata.
Proposed solution

Creating an embedding vector of the Description from Wikidata is a useful way to automate disambiguation of similarly named entities using the Description field.
If your dataset has a "Description" or "about" field, that can then be embedded with the same embedding model and they can be compared using cosine similarity or similar.
I have tried this in a custom reconciliation service (not using OpenRefine at all) that I made and found it to work quite well. For the dataset it was tried on it automatically disambiguated correctly in most cases, saving lots of manual work.
I'm not sure if this is the correct place to propose this? It would require Wikidata to implement an LLM model to create embeddings of the Description field too.

That sounds interesting! But as you guessed, this would probably be outside OpenRefine's scope. Any chances your custom reconciliation service could expose the web API that OpenRefine uses to query reconciliation services? This way, one could use your approach via OpenRefine.

So it is actually just an alternative way of comparing string properties. Instead of doing Levenshtein distance, compare an embedding for each string and then the cosine distance. The embeddings can be computed on the fly and cached if needed. I might try adding it to the wikibase reconciliation service next time I need it. I'm not entirely sure yet to what extent property comparisons are/should be done in just the reconciliation service, OpenRefine or both.

Closing as it's something that could rather be implemented in reconciliation services.
By the way feel free to join the W3C group, for instance to suggest changes to the protocol that would make your use case easier: https://www.w3.org/community/reconciliation/

Where a similar feature could be useful in OpenRefine itself is for clustering. There's now token-based clustering and character-based clustering, so that would add semantic clustering. The actual feature in that case would be clustering of vectors, also useful for finding geographical clusters such as duplicate entities for locations, that have had their entities added by multiple people adding coordinates that are almost, but not entirely identical.
For embedding vectors I think in this case one would either just have them in the dataset already or add by "Add Column By Fetching URLs"
There is already support for k-nearest neighbor clustering, but as I understand it this is only for strings, no vector support at the moment? What would be needed for geo and semantic clustering is just support for vectors in addition to strings. Or is it already somehow possible using arrays?

Sure, those sorts of techniques could also be used for clustering. One would need to figure out a way to make the underlying model configurable: obviously we can't just bundle a big trained model inside OpenRefine directly.
So far our clustering aren't very easy to extend / improve. I have proposed https://github.com/OpenRefine/OpenRefine/issues/4301 which could perhaps help.

Yeah, I think having #4301 implemented would be a good start.


Fix broken doc links, clean up irrelevant/old docs

Fixes https://github.com/pachyderm/pachyderm/issues/1769.
Also:

Updates the Getting Started overview doc, which was actually broken in multiple ways.
Get rid of irrelevant and old docs including FAQ and troubleshooting under getting started (Note that troubleshooting in getting started was not up-to-date.  If we want to have this, we should redo it. It was more confusing than anything).
Fixes formatting issues in the pachctl docs.
Adds copy-file to the pachctl docs.

What do you mean by Troubleshooting was more confusing than helpful? it's true that it needs updating, but I feel like the goal there was add all the common beginner questions? What would you want it to be instead -- I guess something more like stack overflow?

LGTM. I'm not opposed to taking out troubleshooting, but I worry we'll see an uptick of very common user issues so we'll likely need something similar

@JoeyZwicker I agree that we should probably generate something new for beginner troubleshooting.  I was just meaning that if they are already struggling, and then they see stuff about grep and fruit stand, it might be worse than just removing them for now and revisiting.


0 ohms resistor not mentionned in ESP S3 DevKitM 1 documentation (IDFGH-11528)

Answers checklist.

[X] I have read the documentation ESP-IDF Programming Guide and the issue is not addressed there.
[X] I have updated my IDF branch (master or release) to the latest version and checked that the issue is present there.
[X] I have searched the issue tracker for a similar issue and not found a similar issue.

General issue report
I'm not sure to be at the right place, but I noticed a 0 Ohm resistor on the  ESP-S3-DevKitM-1 schematics. I didn't find any mention about the purpose of this resistor in the documentation. Could someone tell me what this resistor is made for ?

Thank you for the reply. I know a 0 Ohm resistor is a wire. My question is what configuration does it change on the ESP32-S3-DevKitM-1 ?

For example, GPIO48 is present in the pin header and is also connected to the RGB LED. If you desolder R17, you can get rid of the connection with this LED.
For the connection between USB-UART Bridge and ESP32, R7 (RX) and R9 (TX) are used.
R24 may be for insulation purposes. By desoldering this, it is possible to power only ESP32-S3-MINI-1 via the ESP_3V3 pin on the header.

I think we can consider this ticket closed, as it is not really related to ESP-IDF.
Thanks to @atemiz for providing the answer!


Question about api endpoints

Is there any difference in implementation, response and/or request parameters  between "api.onedrive.com" vs "graph.microsoft.com" ?
Since Microsoft Graph is the preferred endpoint for accessing OneDrive personal, is it better to switch from api.onedrive.com to graph.microsoft.com.
Will api.onedrive.com still be supported in the future if there will be an upgraded version ?

Thanks,

A lot of those questions are covered here: https://dev.onedrive.com/direct-endpoint-differences.htm
It is recommended that you use Microsoft Graph, although if you have a lot of existing code that calls api.onedrive.com, then you can continue to maintain that code. We support and maintain the OneDrive API and the Microsoft Graph API together.
It's likely that if we need to make breaking changes to the API in the future (say, adding a new v2.0 version) then we would only make those changes available via Microsoft Graph. However, v1.0 will continue to work until it is deprecated.


Show how OIDC ModelAuthProvider can be used with Azure OpenAI

Replaces #634.
This PR aims to show how to use multiple model providers (Vertex AI Gemini, Azure OpenAI) and how they can access models using OIDC access tokens authorized by users authenticated to Quarkus with either Google or Microsoft Entra ID.
I've confirmed the updated demo still works for Vertex AI Gemini but unfortunately I did not have time yet and a bit vague about how to setup my Azure tenant correctly, the earlier tries with #634 did not succeed. I'll look into it a bit later and might ask the community for some help, and once it is confirmed, by myself or someone else independently, the PR should be ready to go...

I'll try to get back to it after PTO and resolve conflicts as well

🙏🏼

This will need to be rebased when it's picked up again

@geoand I've made it working for Azure OpenAI and the user authentication token, it will be quite nice once a few things are cleaned up and we can show both Gemini and Azure Open AI without configuring shared API keys, I had to do some workaround though related to ModelProvider resolution, I'll open another issue to discuss

Something did not workout with the rebase, somehow I picked up the pgvector related code here, but I'll recreate a PR later, not  a problem

Thanks @sberyozkin

Closing it, will open a new one soon


bindata: enable podsecurity plugin

This is an attempt to enable the PodSecurity plugin to enable https://github.com/kubernetes/enhancements/tree/master/keps/sig-auth/2579-psp-replacement
This can be merged once 4.10 master opens, the earliest.
/hold

Now let's see how the world burns.... :fire: :fire: :fire:
/lgtm

/hold cancel

/lgtm
/hold
(for @sttts final ack)

/retest

above e2e failures all look like flakes, I don't see a consistent failure :thinking:

/hold cancel
all green, as discussed with @sttts OOB this is good to go :crossed_fingers:


Some earthquakes not detected

Hi! I've tried the EQTransformer using our local mseed file and its works fine like in the tutorial, but I observed that some local earthquakes were not detected. Any recommendations to improve the result? I also tried applying different filters.

with highpass filter

but still, some EQs were not detected. Example in 1450z

Did you try with different models? It seems one model is suited for mid to large regional earthquakes while the other one is for small local events. BTW, I had the same issue, i guess probably the package is still suffering from false negative detection. There is an updated version of EQT which claims he can fix this problem. Here is the link: https://github.com/MrXiaoXiao/SiameseEarthquakeTransformer .

@PPS101 @saeedsltm sorry for the delay in the response. I missed these.
These are some suggestions:

try larger overlapping windows like 0.9. This will help detect the larger events or those that are far away from the station.
try the original model (with a threshold level of ~ 0.3 for phases and 0.8 for detection). This would catch all smaller events that were missed initially but with the cost of some false positives (similar to other packages out there). If your final goal is to locate and build a catalog, this is not an issue since most of the false positives will be removed in the association and location steps.
you can also try the SeisBench implementation of EQTransformer.


Roll Packages from bc0c22d57910 to 3458b423386e (1 revision)

https://github.com/flutter/packages/compare/bc0c22d57910...3458b423386e
2024-11-28<EMAIL_ADDRESS>Roll Flutter from fae695ed6198 to 08e26a3ffcd7 (19 revisions) (flutter/packages#8197)
If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-packages-flutter-autoroll
Please CC<EMAIL_ADDRESS>on the revert to ensure that a human
is aware of the problem.
To file a bug in Flutter: https://github.com/flutter/flutter/issues/new/choose
To report a problem with the AutoRoller itself, please file a bug:
https://issues.skia.org/issues/new?component=1389291&template=1850622
Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+doc/main/autoroll/README.md

Commit queue failed; closing this roll.


Resizing the macOS runner by changing the screen resolution while the app is maximised leads to freaked out app

Steps to reproduce

Maximise a Flutter app
Change the resolution of the monitor the app is on (for me, this happens due to the OS changing the monitor configuration when it thinks a monitor has gone away)
Watch Flutter app beachball itself

Expected results
Adapting to updated reality would be nice
Actual results
Like I said. Beach ball
Code sample
Code sample
[Paste your code here]

Screenshots or Video

Screenshots / Video demonstration
[Upload media here]

Logs
Logs
[Paste your logs here]

Flutter Doctor output
Doctor output
$ flutter doctor -v
[✓] Flutter (Channel beta, 3.21.0-1.0.pre.2, on macOS 14.4 23E214 darwin-arm64, locale en)
    • Flutter version 3.21.0-1.0.pre.2 on channel beta at /Users/brettmorgan/flutter
    • Upstream repository https://github.com/flutter/flutter
    • Framework revision c398442c35 (5 days ago), 2024-03-12 22:26:24 -0700
    • Engine revision 0d4f78c952
    • Dart version 3.4.0 (build 3.4.0-190.1.beta)
    • DevTools version 2.33.1

[✓] Android toolchain - develop for Android devices (Android SDK version 34.0.0)
    • Android SDK at /Users/brettmorgan/Library/Android/sdk
    • Platform android-34, build-tools 34.0.0
    • Java binary at: /Applications/Android Studio.app/Contents/jbr/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 17.0.9+0-17.0.9b1087.7-11185874)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 15.3)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Build 15E204a
    • CocoaPods version 1.15.0

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 2023.2)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 17.0.9+0-17.0.9b1087.7-11185874)

[✓] IntelliJ IDEA Community Edition (version 2023.3.2)
    • IntelliJ at /Applications/IntelliJ IDEA CE.app
    • Flutter plugin version 77.0.1
    • Dart plugin version 233.13135.65

[✓] VS Code (version 1.87.2)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.84.0

[✓] Connected device (3 available)
    • macOS (desktop)                 • macos                 • darwin-arm64   • macOS 14.4 23E214 darwin-arm64
    • Mac Designed for iPad (desktop) • mac-designed-for-ipad • darwin         • macOS 14.4 23E214 darwin-arm64
    • Chrome (web)                    • chrome                • web-javascript • Google Chrome 122.0.6261.129

[✓] Network resources
    • All expected network resources are available.

• No issues found!

We'll need to wire up a handler for CGDisplayRegisterReconfigurationCallback I suspect.


Homework 2

Completed Homework -2
Drift : https://video.drift.com/v/abl5tBWCZzLClpwwsHKxQuaCIZgeE4nx8tIrg1flbdE/

Metric
Value

alert_status
:white_check_mark: OK

bugs
2

code_smells
16

reliability_rating
C (at least 1 Major Bug)Note: A being best, E being worst

security_rating
A (0 Vulnerabilities)Note: A being best, E being worst

vulnerabilities
0

Metric
Value

alert_status
:white_check_mark: OK

bugs
2

code_smells
14

reliability_rating
C (at least 1 Major Bug)Note: A being best, E being worst

security_rating
A (0 Vulnerabilities)Note: A being best, E being worst

vulnerabilities
0

Metric
Value

alert_status
:white_check_mark: OK

bugs
2

code_smells
13

reliability_rating
C (at least 1 Major Bug)Note: A being best, E being worst

security_rating
A (0 Vulnerabilities)Note: A being best, E being worst

vulnerabilities
0

Metric
Value

alert_status
:x: ERROR

bugs
2

code_smells
11

reliability_rating
C (at least 1 Major Bug)Note: A being best, E being worst

security_rating
A (0 Vulnerabilities)Note: A being best, E being worst

vulnerabilities
0

Metric
Value

alert_status
:x: ERROR

bugs
2

code_smells
4

reliability_rating
C (at least 1 Major Bug)Note: A being best, E being worst

security_rating
A (0 Vulnerabilities)Note: A being best, E being worst

vulnerabilities
0

Metric
Value

alert_status
:x: ERROR

bugs
2

code_smells
4

reliability_rating
C (at least 1 Major Bug)Note: A being best, E being worst

security_rating
A (0 Vulnerabilities)Note: A being best, E being worst

vulnerabilities
0


Please invite me to the GitHub Community Organization

Name
Rita Mwangi
Discord Username (if applicable)
Miss Mwangi#4673
Additional Context
Hello Eddie,
Came to know about you and this community on twitter.
My name is Rita, from Kenya and just starting my tech journey. I am 3 months into a software development program and just started on Python.
I would love to know more on how I can learn by practicing and that is why i am joining this community. For guidance on starting out and grow and learn in the process

I do not know how to contribute to open source yet. I am a fast learner and would like to know my way around open source contribution


The link has expired

The link provided on github and youtube for joining has expired and also plz accpet my friend request.

Thank you for letting me know!
I have redesigned the Readme as well updated the Discord server link.
Sure,i will accept the friend req.


Some attributes do not appear to accumulate during unification via the Go API

What version of CUE are you using (cue version)?
v0.4.0

Does this issue reproduce with the latest release?
Yes
What did you do?
package main

import (
	"fmt"

	"cuelang.org/go/cue"
	"cuelang.org/go/cue/cuecontext"
)

const src = `
base: "foo" @base(attr)

refwithout: base
refwith: base @attr(refwith)

s: {
	refwithout: base
	refwith: base @attr(srefwith)
}

unif: string @attr(unif)
sunif: {
	@sunif(decl)
	...
} @sunif(field)
`

func main() {
	ctx := cuecontext.New()

	v := ctx.CompileString(src)

	base := v.LookupPath(cue.ParsePath("base"))
	refwithout := v.LookupPath(cue.ParsePath("refwithout"))
	refwith := v.LookupPath(cue.ParsePath("refwith"))
	s := v.LookupPath(cue.ParsePath("s"))
	unif := v.LookupPath(cue.ParsePath("unif"))
	sunif := v.LookupPath(cue.ParsePath("sunif"))

	printAttrs("base", base)
	printAttrs("refwithout", refwithout)
	printAttrs("refwith", refwith)
	printAttrs("s.refwithout", s.LookupPath(cue.ParsePath("refwithout")))
	printAttrs("s.refwith", s.LookupPath(cue.ParsePath("refwith")))
	printAttrs("base & unif", base.Unify(unif))
	printAttrs("sunif", sunif)
	printAttrs("s & sunif", s.Unify(sunif))
	printAttrs("(s & sunif).refwithout", s.Unify(sunif).LookupPath(cue.ParsePath("refwithout")))
	printAttrs("(s & sunif).refwith", s.Unify(sunif).LookupPath(cue.ParsePath("refwith")))
}

func printAttrs(name string, v cue.Value) {
	fmt.Printf("ATTRS FOR: %s\n", name)
	for _, a := range v.Attributes(cue.ValueAttr) {
		fmt.Printf("\tNAME: %s\n", a.Name())
		fmt.Printf("\tCONTENTS: %s\n", a.Contents())
	}
	fmt.Println()
}

What did you expect to see?
The spec says that attributes accumulate during unification, but this appears to only be the case for decl attributes.
So, i expect something like this:
ATTRS FOR: base
	NAME: base
	CONTENTS: attr

ATTRS FOR: refwithout
	NAME: base
	CONTENTS: attr

ATTRS FOR: refwith
	NAME: base
	CONTENTS: attr
	NAME: attr
	CONTENTS: refwith

ATTRS FOR: s.refwithout
	NAME: base
	CONTENTS: attr

ATTRS FOR: s.refwith
	NAME: base
	CONTENTS: attr
	NAME: attr
	CONTENTS: refwith

ATTRS FOR: base & unif
	NAME: base
	CONTENTS: attr
	NAME: attr
	CONTENTS: unif

ATTRS FOR: sunif
	NAME: sunif
	CONTENTS: field
	NAME: sunif
	CONTENTS: decl

ATTRS FOR: s & sunif
	NAME: sunif
	CONTENTS: decl

ATTRS FOR: (s & sunif).refwithout
	NAME: base
	CONTENTS: attr

ATTRS FOR: (s & sunif).refwith
	NAME: base
	CONTENTS: attr
	NAME: attr
	CONTENTS: srefwith

What did you see instead?
The only attribute that appeared to actually accumulate through unification was the @sunif(decl) attribute on the sunif struct. Everything else is only the (value) attributes declared directly on the fields.
ATTRS FOR: base
	NAME: base
	CONTENTS: attr

ATTRS FOR: refwithout

ATTRS FOR: refwith
	NAME: attr
	CONTENTS: refwith

ATTRS FOR: s.refwithout

ATTRS FOR: s.refwith
	NAME: attr
	CONTENTS: srefwith

ATTRS FOR: base & unif

ATTRS FOR: sunif
	NAME: sunif
	CONTENTS: field
	NAME: sunif
	CONTENTS: decl

ATTRS FOR: s & sunif
	NAME: sunif
	CONTENTS: decl

ATTRS FOR: (s & sunif).refwithout

ATTRS FOR: (s & sunif).refwith
	NAME: attr
	CONTENTS: srefwith

As I recall, this is expected behavior for FieldAttrs, they do not pass through unification or references.
The example given by @mpvl to me was Protobuf inspired
foo: int @protobuf(1,int)

st: {
  a: string @protobuf(1,string)
  f: foo @protobuf(2,int)
}

If it passed through, then you would have a conflict for the 1 position between fields, and a field with two position values.

Most likely the spec needs to be updated.

Hmm, reference vs. unification distinction is interesting. It appears that my goal of making a clearer illustration of the underlying problem, i may have obscured the actual behavior i was seeing - which does indeed appear to contradict this assertion:

It is worth pointing out that FieldAttrs do pass through unification

i'll work on a new repro that illustrates the problem - though also, my concern here is with what the Go API returns, not with what cue eval produces.

my concern here is with what the Go API returns, not with what cue eval produces

They should be the same. If they are not, that is an issue

Verified, they are indeed the same! I'm gonna close this.
I'm still seeing an issue where an interstitial unification of a schema with its attribute-declaring meta-schema causes some difference that affects attribute-governed output vs. when i put the attributes directly on the schema. But until i have a more isolated repro, i'm happy to blame it on sloppiness in our implementation in cuetsy. Which is, indeed, quite sloppy.
That said, i do think it's worth clarifying some of these distinctions in the spec.


[Feature]: Adding a Support Page For Support and Feedback Mechanism

User Support and Feedback Mechanism
Problem Statement
Currently, the ElectroKart platform lacks a dedicated support page for users to submit inquiries and feedback. This gap prevents users from easily communicating their questions or issues, which can lead to frustration and dissatisfaction with the platform.
Why We Need a Support Page
Having a support page with contact forms is essential for enhancing user experience. It allows users to:

Communicate their concerns or inquiries effectively.
Receive timely responses from the support team.
Feel valued and heard, which can increase overall customer satisfaction.

Benefits

Improved User Satisfaction: By providing a straightforward way for users to reach out, we enhance their experience and increase the likelihood of repeat business.
Efficient Inquiry Management: Implementing multi-department routing allows for more efficient handling of inquiries by directing them to the appropriate team.
Enhanced Communication: Automated confirmation and follow-up emails keep users informed about the status of their inquiries, improving transparency.

Technical Tasks
To implement the contact forms for general inquiries, the following technologies will be utilized:

HTML: For structuring the contact form.
CSS: For styling the form to ensure it is visually appealing and user-friendly.
JavaScript: For dynamic form fields and handling form submission, including validation and user feedback.

Key Features to Implement

Dynamic Form Fields: Allow users to add additional information dynamically (e.g., additional comments or specific product details).
Multi-Department Routing: Implement routing based on the subject or category selected by the user, directing inquiries to specific departments (e.g., Sales, Technical Support).

Task Assignment
This task is open for contribution under the following initiatives:

Hacktoberfest
GSSoC-EXT

I will be linking this suppot page to the support anchor.

@yeshwanth-ds, thank you for raising the issue, the Support will be replaced by FAQs. Please do consider raising another issue or contributing to other issue. Happy Coding!


Fix typos in prompt example Self_ask_prompting.ipynb

Fix a couple of small typos in the examples given in the prompt.

Just noticed I’ve introduced a new problem! Closing for now.


Create Observer and Observable classes

Pushed in this commit 11b04c9
Character and Map just need to be made observable now. GUI for observer is underway

Based on our discord discussion for Assignment 3, the part involving game logger could fall under this issue. Whereby there needs to be a Game and GameLogger class that are the observable and observer respectively.

Game is a class that contains the logic as well as the events that are outlined in assignment 3 that when done, notify the logger observable
GameLogger is a concrete observer that gets the states of the game to then output events into a log file (txt)

Assignment 3, Part 4

Implement a game log using the observer pattern. The log should record game events
from different observables in real-time as they are happening: 1) the game controller
records the events happening in every game phase (game setup, map loading, player
turns switching, end phase) 2) the map records every movement made on the map, 3)
the character records every attack attempted and its result 4) the dice records every
dice roll. All the log entries should be recorded in a unified log. It should be possible to
switch on/off any of the different logging sources.


Myriad of Conflicts:   Everything SignalR Core wants is >= 4.3.0 Everything Universal App wants is = 4.0.10

Ive been going 1 by one and adding the packages the error output advises to manually.
but keeps asking for more and more.   here is the current conflict.
Version conflict detected for System.Collections. Reference the package directly from the project to resolve this issue.
Assembly-CSharp -> Microsoft.AspNetCore.SignalR.Client 1.0.0-alpha2-final -> Microsoft.AspNetCore.SignalR.Client.Core 1.0.0-alpha2-final -> Microsoft.AspNetCore.Sockets.Abstractions 1.0.0-alpha2-final -> System.Threading.Tasks.Channels 0.1.0-alpha-001 -> NETStandard.Library 1.6.1 -> System.Collections (>= 4.3.0)
Assembly-CSharp -> Microsoft.NETCore.UniversalWindowsPlatform 5.0.0 -> Microsoft.NETCore.Runtime 1.0.0 -> Microsoft.NETCore.Runtime.CoreCLR-arm 1.0.0 -> System.Collections (= 4.0.10).

wow this is hard work.  so only 1 conflict exposes itself at a time.  So im sitting here doing the following

right click on "Assembly-CSharp" universal project
manage nuget.
select Microsoft.AspNetCore.SignalR.Client 1.0.0-alpha2-final
Look in the Output window for the conflict.
manually add the lower one that universal wants  ( hoping that doesnt eventually break signalr )
repeat for all Signalr dependency chain which in a seperate project i see brings 70 Dlls

:( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :( :(

I cant even get useSIgnalR() or addSignalR() to work correctly.... wtf is wrong with it?

i had that problem back in august bro.   ended up being something about getting ASP.net core from one place (nuget) and Signalr Core was coming from another (myget).  and something was missing but you would only get the error at runtime not at build time.  :( :(

I dont even know how to use myget or what that is lol. I wish theyd just update it.

dude i just got beat cause some guy in the hololens forum told me he was running .net core client from a package he downloaded from unity assets store.   hes like "I just checked a Unity project I used it, and the server it is talking to is running SignalR.Core v2.2.2. You should be good to go"
So i download the package and as i suspected it has nothing to do with Core.  :( :( :(

Damn, I might as well start scamming and quit coding

you would think the worlds "First Holographic Device" would get more love.  Im gonna have to not send Satya Nadella a xmas card this year ;)   i tried everything.  I even downloaded the source for signalr thinking .. you know its just a simple messaging app right?   cant be that much code.  Dude all the dependencies is like 5 different githubs and like 50 projects LOL

can you pleeeassseee help me with my issues since you fixed them

whats your issue?

the useSignalR and addSignalR and basically the using of aspnetcor.signalr.xxx being messed up

open powershell and type dotnet --info

not inside your project directory.. somewhere nuetral

we can use the phone too if you want<PHONE_NUMBER> ( google voice )

so i just downloaded it and typed it in... it tells me the versions and stuff?

call me and cut and paste the info here

i tried your number but I guess I need google voice, i cant really talk right now

.NET Command Line Tools (2.1.2)
Product Information:
Version:            2.1.2
Commit SHA-1 hash:<PHONE_NUMBER>
Runtime Environment:
OS Name:     Windows
OS Version:  10.0.16299
OS Platform: Windows
RID:         win10-x64
Base Path:   C:\Program Files\dotnet\sdk\2.1.2\
Microsoft .NET Core Shared Framework Host
Version  : 2.0.3
Build    : a9190d4a75f4a982ae4b4fa8d1a24526566c69df

ive got this
PS C:\Users\fogbr> dotnet --info
.NET Command Line Tools (2.2.0-preview1-007814)
Product Information:
Version:            2.2.0-preview1-007814
Commit SHA-1 hash:  d833eaa657
Runtime Environment:
OS Name:     Windows
OS Version:  10.0.16299
OS Platform: Windows
RID:         win10-x64
Base Path:   C:\Program Files\dotnet\sdk\2.2.0-preview1-007814\
Microsoft .NET Core Shared Framework Host
Version  : 2.1.0-preview1-26016-07
Build    : b61508038835f31a099ce44f1b1c970878211fcd

damn how do you update those?

you can reach my levels by the following links
.NET Core Runtime & Host Setup Repo
repo contains the code to build the .NET Core runtime, libraries and shared host (dotnet) installers for all supported platforms.
https://github.com/dotnet/core-setup#daily-builds
Installers and Binaries
.NET Core SDK as either an installer (MSI, PKG) or a zip (zip, tar.gz).
https://github.com/dotnet/cli#installers-and-binaries

get the windows 64 installer master branch and install that for both the dotnet cli (link2) and the sdk (link1 )
then also use the visual studio installer to get to version 15.5.2 of visual studio 2017

once you got all that working create a fresh .NET Core MVC project and just run it to see if it works without signalr

then download the latest node.js from https://nodejs.org/en/  im using v9.2.1

your gonna use nodes package manager tool to download the signalr javascript . by using the command from powershell inside the root of your project folder.
type npm install @aspnet/signalr-client

this will put the javascript file signalr-client inside a directory called node_modules

copy the whole signalr folder from the node-modules directory into the lib folder under your wwwroot
create an HTML file and put it inside the WWW directory and add the line

heres my hello world HTML file.

 Simple Chat

    <input type="text" id="message" />
    <input type="button" id="sendMessage" value="Send" />

some of the tags were stripped off of my html file but you get the picture.
now go to your Startup.cs
    public void ConfigureServices(IServiceCollection services)
    {
        services.AddMvc();

        services.AddSignalR();

    }

 public void Configure(IApplicationBuilder app, IHostingEnvironment env)
    {
        if (env.IsDevelopment())
        {
            app.UseDeveloperExceptionPage();
            app.UseBrowserLink();
        }
        else
        {
            app.UseExceptionHandler("/Home/Error");
        }

        app.UseStaticFiles();

        app.UseFileServer();

        app.UseSignalR(routes =>

        {

            routes.MapHub<ChatHub>("chat");

        });

        app.UseMvc(routes =>
        {
            routes.MapRoute(
                name: "default",
                template: "{controller=Home}/{action=Index}/{id?}");
        });
    }
}

ok i cant get the .net core runtime to download because of avast but ill try everything else

you need everything.

.NET Command Line Tools (2.2.0-preview1-007835)
Product Information:
Version:            2.2.0-preview1-007835
Commit SHA-1 hash:  6894eb0e6e
Runtime Environment:
OS Name:     Windows
OS Version:  10.0.16299
OS Platform: Windows
RID:         win10-x64
Base Path:   C:\Program Files\dotnet\sdk\2.2.0-preview1-007835\
Microsoft .NET Core Shared Framework Host
Version  : 2.1.0-preview1-26015-04
Build    : 8485f1ee2416d900d57074e2ae21f287b0c2c3b2

maybe you can download it to your phone then email yourself from your phone or something crazy like that

your program.cs should look like this...
    public static void Main(string[] args)
    {
        BuildWebHost(args).Run();
    }

    public static IWebHost BuildWebHost(string[] args) =>
        WebHost.CreateDefaultBuilder(args)
            .UseStartup<Startup>()
            .UseUrls("http://*:5005")
            .Build();

no i got it

i literally just updates nodejs so do i need to download?

ok you good with node.
your chat hub should look like this...
using System;
using System.Collections.Generic;
using System.Linq;
using System.Threading.Tasks;
using Microsoft.AspNetCore.SignalR;
namespace IoTDemo2.Web1.Hubs
{
public class ChatHub : Hub
{
public async Task Send(string name, string message)
    {

        // Call the broadcastMessage method to update clients.

        for (int i = 0; i < 20; i++)

        {

            //observer.OnNext($"sending...{i}");
            await Clients.All.InvokeAsync("broadcastMessage", name, message);

            await Task.Delay(1000);

        }

    }

    public override Task OnConnectedAsync()
    {
        Clients.All.InvokeAsync("broadcastMessage", "system", $"{Context.ConnectionId} joined the conversation");
        return base.OnConnectedAsync();
    }

    public override Task OnDisconnectedAsync(System.Exception exception)
    {
        Clients.All.InvokeAsync("broadcastMessage", "system", $"{Context.ConnectionId} left the conversation");
        return base.OnDisconnectedAsync(exception);
    }
}

}

your csproj file should look similar to this..

netcoreapp2.0
..\docker-compose.dcproj

<PackageReference Include="Microsoft.AspNetCore.All" Version="2.0.3" />
<PackageReference Include="Microsoft.AspNetCore.SignalR" Version="1.0.0-alpha2-final" />
<PackageReference Include="Microsoft.AspNetCore.SignalR.Common" Version="1.0.0-alpha2-final" />

netcoreapp2.0

let me know if you have any problems

open 2 browsers to http://<IP_ADDRESS>:5005/  and test    ( whatever your local lan ip is )

omg this might work

so I just build from here?

just run the project and hit your local ip.

use chrome browser is the best cause it has the dev tools you can watch for any signalr errors with ctrl-shift-i

what do you mean hit my local ip?

when you run your project its going to host the kestrel webserver at http://<IP_ADDRESS>:5005/   or whatever the ip address was given to your computer by DHCP   you can find this address by typing ipconfig at the cmd prompt   mine is http://<IP_ADDRESS>:5005/

ok

put that into the web browser and it will hit your signalr hub.  open up another browser and the real test is wether browser 1 receives data from browser 2

it does localhost do ii change it?

okok

i dunno bro just try different things

lol gotcha thanks

np let me know if you score a touchdown :)

which ip do you use though?
sorry im dumb

ok youre pulling my leg now bro.   lol  gnite.

tell your buddies to stop playing tricks and help a brother out over here.

im not haha you said goodnight

im goign to delete this post and repost my original problem.   this message will self destruct soon.


Convert {BaseViewer, PDFThumbnailViewer}._pagesRequests from an Array to a WeakMap

Obviously the _pagesRequests functionality is mainly used when disableAutoFetch is set, but it will also be used during ranged/streamed loading of documents.
However, the _pagesRequests property is currently an Array which seems a bit strange:

Arrays are zero-indexed, but the first element will never actually be set in the code.
The _pagesRequests Array is never cleared, unless a new document is loaded, and once the PDFDocumentProxy.getPage call has resolved/rejected the element is just replaced by null.
Unless the document is browsed in order the resulting _pagesRequests Array can also be arbitrarily sparse.

All in all, I don't believe that an Array is an appropriate data structure to use for this purpose.

/botio-linux preview

Good improvement, thanks!


Docker stack deploy services not accessible by name

What you expected to happen?
Tried a "voting app" docker-compose.yml sample https://github.com/dockersamples/example-voting-app. It deploys services to Docker Swarm manager and worker nodes.
I expected endpoints to work and behave the same whether deploying with weave or the built-in "overlay" network. I.e. if a service publishes container port 80 as 6001 then SERVICE-NAME:80 should be accessible from within the network and the outside world should be able to access the service at either the docker server manager or worker node's ip address on port 6001.
Unfortunately the ip address for the compose "service" name is not reaching a container's ports when "weave" is used.
I don't know if Docker Swarm or the Weave v2 Plugin is at fault.
Now that I'm filing this it seems https://github.com/weaveworks/weave/issues/3382 is the same issue? But maybe this example is helpful.
What happened?
Did docker stack deploy -c ./docker-compose.yml voteapp and found the container containing one of the services, the "result-app" service:
51cd972f5d24        gaiadocker/example-voting-app-result:latest      "node server.js"         6 minutes ago       Up 5 minutes              80/tcp                                                                             voteapp_result-app.1.ul21a6dyz1ghgjtlkry33m3jg

I exec into that docker exec -ti 51cd972f5d24 sh expecting to be able to curl the service name, but it fails:
root@7873f2393e8a:/app# curl http://result-app:80

curl: (7) Failed to connect to result-app port 80: No route to host
root@7873f2393e8a:/app#
root@7873f2393e8a:/app# ping result-app
PING result-app (<IP_ADDRESS>): 56 data bytes
92 bytes from 7873f2393e8a (<IP_ADDRESS>): Destination Host Unreachable
92 bytes from 7873f2393e8a (<IP_ADDRESS>): Destination Host Unreachable
92 bytes from 7873f2393e8a (<IP_ADDRESS>): Destination Host Unreachable
^C--- result-app ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
root@7873f2393e8a:/app# ip addr show
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet <IP_ADDRESS>/8 scope host lo
       valid_lft forever preferred_lft forever
41026: eth0@if41027: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UP group default
    link/ether 02:42:0a:ff:01:75 brd ff:ff:ff:ff:ff:ff
    inet <IP_ADDRESS>/16 brd <IP_ADDRESS> scope global eth0
       valid_lft forever preferred_lft forever
41028: eth1@if41029: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default
    link/ether 02:42:ac:12:00:07 brd ff:ff:ff:ff:ff:ff
    inet <IP_ADDRESS>/16 brd <IP_ADDRESS> scope global eth1
       valid_lft forever preferred_lft forever
41030: ethwe0@if41031: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1376 qdisc noqueue state UP group default
    link/ether 16:23:5a:f1:a2:d9 brd ff:ff:ff:ff:ff:ff
    inet <IP_ADDRESS>/24 brd <IP_ADDRESS> scope global ethwe0
       valid_lft forever preferred_lft forever
root@7873f2393e8a:/app# curl --head <IP_ADDRESS>:80
HTTP/1.1 200 OK
X-Powered-By: Express

What is it about deploying to weave that makes  the service name not publish the port on its ip?
It works fine when I deploy the compose file with the "overlay" network instead of weave:
root@311b7d60c7cd:/app# curl --head http://result-app:80
HTTP/1.1 200 OK
X-Powered-By: Express

root@311b7d60c7cd:/app# ping result-app
PING result-app (<IP_ADDRESS>): 56 data bytes

root@311b7d60c7cd:/app# ip addr show
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet <IP_ADDRESS>/8 scope host lo
       valid_lft forever preferred_lft forever
17499: eth0@if17500: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UP group default
    link/ether 02:42:0a:ff:01:6e brd ff:ff:ff:ff:ff:ff
    inet <IP_ADDRESS>/16 brd <IP_ADDRESS> scope global eth0
       valid_lft forever preferred_lft forever
17501: eth2@if17502: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default
    link/ether 02:42:ac:15:00:06 brd ff:ff:ff:ff:ff:ff
    inet <IP_ADDRESS>/16 brd <IP_ADDRESS> scope global eth2
       valid_lft forever preferred_lft forever
17503: eth1@if17504: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UP group default
    link/ether 02:42:0a:00:04:0f brd ff:ff:ff:ff:ff:ff
    inet <IP_ADDRESS>/24 brd <IP_ADDRESS> scope global eth1
       valid_lft forever preferred_lft forever

How to reproduce it?
Compare:
NETWORK_DRIVER=overlay docker stack deploy -c ./docker-compose.yml voteapp
NETWORK_DRIVER-weaveworks/net-plugin:latest_release docker stack deploy -c ./docker-compose.yml voteapp

This is the docker-compose.yml:
https://gist.github.com/jamshid/bf5dcdb0ae1b505a636b33ca5ebfba4b
Anything else we need to know?
Deploying to a swarm manager + swarm worker cluster:
$ docker info
Client:
 Debug Mode: false

Server:
 Containers: 20
  Running: 14
  Paused: 0
  Stopped: 6
 Images: 1337
 Server Version: 19.03.4
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Native Overlay Diff: true
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay weaveworks/net-plugin:latest_release
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: active
  NodeID: X
  Is Manager: true
  ClusterID: X
  Managers: 1
  Nodes: 3
  Default Address Pool: <IP_ADDRESS>/8
  SubnetSize: 24
  Data Path Port: 4789
  Orchestration:
   Task History Retention Limit: 5
  Raft:
   Snapshot Interval: 10000
   Number of Old Snapshots to Retain: 0
   Heartbeat Tick: 1
   Election Tick: 10
  Dispatcher:
   Heartbeat Period: 5 seconds
  CA Configuration:
   Expiry Duration: 3 months
   Force Rotate: 0
  Autolock Managers: false
  Root Rotation In Progress: false
  Node Address: <IP_ADDRESS>
  Manager Addresses:
   <IP_ADDRESS>:2377
 Runtimes: runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: b34a5c8af56e510852c35414db4c1f4fa6172339
 runc version: 3e425f80a8c931f88e6d94a8c831b9d5aa481657
 init version: fec3683
 Security Options:
  apparmor
  seccomp
   Profile: default
 Kernel Version: 4.4.0-166-generic
 Operating System: Ubuntu 16.04.6 LTS
 OSType: linux
 Architecture: x86_64
 CPUs: 4
 Total Memory: 31.34GiB
 Name: X
 ID: X
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Registry: https://index.docker.io/v1/
 Labels:
  provider=generic
 Experimental: false
 Insecure Registries:
  <IP_ADDRESS>:5000
  <IP_ADDRESS>/8
 Live Restore Enabled: false

WARNING: No swap limit support

Versions:

sudo weave version
weave script 2.6.0
weave 2.6.0

# docker version
Client: Docker Engine - Community
 Version:           19.03.4
 API version:       1.40
 Go version:        go1.12.10
 Git commit:        9013bf583a
 Built:             Fri Oct 18 15:53:51 2019
 OS/Arch:           linux/amd64
 Experimental:      false

Server: Docker Engine - Community
 Engine:
  Version:          19.03.4
  API version:      1.40 (minimum version 1.12)
  Go version:       go1.12.10
  Git commit:       9013bf583a
  Built:            Fri Oct 18 15:52:23 2019
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          1.2.10
  GitCommit:        b34a5c8af56e510852c35414db4c1f4fa6172339
 runc:
  Version:          1.0.0-rc8+dev
  GitCommit:        3e425f80a8c931f88e6d94a8c831b9d5aa481657
 docker-init:
  Version:          0.18.0
  GitCommit:        fec3683

$ uname -a
Linux X 4.4.0-166-generic #195-Ubuntu SMP Tue Oct 1 09:35:25 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

$ kubectl version
#N/A, hope you still support Docker Swarm?

Logs:
# docker logs weave
Error: No such container: weave

$ journalctl -u docker.service --no-pager
Nov 09 15:05:07 jimbo dockerd[1178]: time="2019-11-09T15:05:07.873921418-06:00" level=error msg="addLBBackend wuaj2lfwwhck02ia0ywznjn49/mynetwork: Unable to find load balancing endpoint for network wuaj2lfwwhck02ia0ywznjn49"
?
-->
Network:
# ip route
default via <IP_ADDRESS> dev enp0s31f6
<IP_ADDRESS>/16 dev docker0  proto kernel  scope link  src <IP_ADDRESS> linkdown
<IP_ADDRESS>/16 dev br-868f72a86652  proto kernel  scope link  src <IP_ADDRESS>
<IP_ADDRESS>/16 dev br-d5998c4fbd81  proto kernel  scope link  src <IP_ADDRESS>
<IP_ADDRESS>/16 dev docker_gwbridge  proto kernel  scope link  src <IP_ADDRESS>
<IP_ADDRESS>/16 dev br-ba650310e704  proto kernel  scope link  src <IP_ADDRESS>
<IP_ADDRESS>/23 dev enp0s31f6  proto kernel  scope link  src <IP_ADDRESS>

$ ip -4 -o addr
1: lo    inet <IP_ADDRESS>/8 scope host lo\       valid_lft forever preferred_lft forever
3: enp0s31f6    inet <IP_ADDRESS>/23 brd <IP_ADDRESS> scope global enp0s31f6\       valid_lft forever preferred_lft forever
5: docker0    inet <IP_ADDRESS>/16 brd <IP_ADDRESS> scope global docker0\       valid_lft forever preferred_lft forever
6: docker_gwbridge    inet <IP_ADDRESS>/16 brd <IP_ADDRESS> scope global docker_gwbridge\       valid_lft forever preferred_lft forever
7: br-868f72a86652    inet <IP_ADDRESS>/16 brd <IP_ADDRESS> scope global br-868f72a86652\       valid_lft forever preferred_lft forever
8: br-ba650310e704    inet <IP_ADDRESS>/16 brd <IP_ADDRESS> scope global br-ba650310e704\       valid_lft forever preferred_lft forever
9: br-d5998c4fbd81    inet <IP_ADDRESS>/16 brd <IP_ADDRESS> scope global br-d5998c4fbd81\       valid_lft forever preferred_lft forever

$ sudo iptables-save

Thanks for the detail; I do think it sounds similar to #3382.
Does changing the DNS mode to round-robin help?
Have you asked Docker whether this is supposed to work?

Thanks, I updated the sample stack if you want to try:
https://gist.github.com/jamshid/bf5dcdb0ae1b505a636b33ca5ebfba4b
Unfortunately, no, endpoint_mode: dnsrr changes behavior but ports are still not published correctly.
The built-in "overlay" network does work. Shouldn't weave also expose container ports on their internal service name and publish ports on all Docker Swarm nodes?
Do you still support and test against Docker Swarm? I seem to remember this kind of thing working over a year ago, maybe recent versions broke?
Any suggestion or what to try? I should be able reproduce on a couple of digitalocean servers if that would help.

The fact that a built-in feature works is hardly comparable. If it worked with a different plugin that would be more interesting.
The Docker network plugin interface deals with attaching a container and assigning an IP address. There is nothing about ports or publishing. https://github.com/docker/libnetwork/blob/master/docs/remote.md
My suggestion remains to take this question to Docker. People have said it works with older versions of Docker, so perhaps they changed something.

When you deploy using a stack the service name becomes _. You can check that by using docker stack services <stack_name> the name presented in the collumn "name"


Create CODE_OF_CONDUCT.md

[ ] Make OSS friendly

I couldn't find a .stickler.yml file in this repository. I can make one for you, or you can create one by following the documentation.

I couldn't find a .stickler.yml file in this repository. I can make one for you, or you can create one by following the documentation.


Stock.peers() returns NameError

Calling the peers method does not return a list of Stock objects; instead errors.
def peers(self, as_string=False):
  if as_string:
    return [x for x in self._get("peers")]
  else:
    return [stock(x) for x in self._get("peers")]

` NameError: name 'stock' is not defined
However, using the as_string=True parameter does successfully return the list which can then be looped through to get each peer's info.

Fixed -- https://github.com/danielecook/iex-api-python/pull/16


data stopping at<PHONE_NUMBER>

System info: [Include InfluxDB version, operating system name, and other relevant details]
ubuntu 16.04.lts and on windows os  influxd 1.6.1
Steps to reproduce:
it use to work fine on older version of influx, but now it stopping at<PHONE_NUMBER>
I wrote a piece of software that reads collectd CSV and processes them and sends them to influxd
if i send multi value  csv
example:
timestamp,rx,tx
2018-08-16 22:02:02,578527857,12037843403
the data stops  when it reaches<PHONE_NUMBER>  for each value
if i use a single value csv
example:
timestamp, value
2018-08-16 22:02:02,57852785712037843403
it will publish with out any limit of<PHONE_NUMBER>  I tried with values up to 30 digits long  no problems. it only happens when I send multiple values , then the value caps at<PHONE_NUMBER> for some reason
profiles.tar.gz
vars.txt

@krywenko what architecture are you running on? Is it a 32bit system?<PHONE_NUMBER> is the largest 32 bit signed integer value. You could be hitting a limit somewhere.

locally Ubuntu 16.04.5 LTS (GNU/Linux 4.15.0-32-generic x86_64)  just a fresh install of ubuntu  and newly downloaded influx from influx webpage
how does one tell the arch type of influx  maybe  for some reason the 32bit is installing  on the ubuntu instead of the 64 bit version... but  it is also having the same issue on a remote 64 bit windows  version also a fresh install, may they are installing a 32 bit by mistake too . ( I have no direct access to that computer as it 1/2 around the world so I am taking them at their world )
currently I wrote a small work around converted my   integer values  to float and it all goes through fine

@krywenko run od -An -t x1 -j 4 -N 1 influxd. If it outputs 01 it's 32-bit and 02 means 64-bit.
I'm going to close this. If it turns out that you're running 64-bit everywhere and this is still an issue, reply here and we can re-open the issue.


Question: Can we expect WinUI 3 Controls Gallery 1.0 in Store?

Question: Can we expect WinUI 3 Controls Gallery 1.0 in Store?

Yes @get-flat ! We are currently working on one and it should be available within the next couple of weeks. Stay tuned!

Hey @get-flat! The new version of the WinUI 3 Controls Gallery is out in the Store right now! It uses the WinAppSDK 1.0 that was recently released + a bunch of control updates. We will update the code on the WinUI 3 branch of the XAML Controls Gallery  in early Jan as we are still working out some small details.


very slow on cpu

I have tried four models on desktop cpu Intel(R) Core(TM) i7-10700 CPU
moondream-0_5b-int4.mf.gz
moondream-0_5b-int8.mf.gz
moondream-2b-int4.mf.gz
moondream-2b-int8.mf.gz
it will cost much time to inference, at least 7s, int4 is faster than int8, can you improve the speed?

@vikhyat


installation of antfs-cli failed - error in py library reference

Hi, antfs-cli installation seems to fail, mixing up library directories and distribution package.
I have python 3.10 and latest antfs-cli from github
when starting antfs-cli I get this error message that seem to try to use a distribution package (antfs_cli-0.4-py3.10.egg) as library reference...
sudo pip install openant
sudo python setup.py install

~/sw/Garmin-Forerunner-610-Extractor> antfs-cli
Traceback (most recent call last):
  File "/usr/local/bin/antfs-cli", line 33, in <module>
    sys.exit(load_entry_point('antfs-cli==0.4', 'console_scripts', 'antfs-cli')())
  File "/usr/local/bin/antfs-cli", line 25, in importlib_load_entry_point
    return next(matches).load()
  File "/usr/lib/python3.10/importlib/metadata/__init__.py", line 171, in load
    module = import_module(match.group('module'))
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/usr/local/lib/python3.10/dist-packages/antfs_cli-0.4-py3.10.egg/antfs_cli/program.py", line 34, in <module>
ModuleNotFoundError: No module named 'ant'

Here is the installation log :
~/sw/Garmin-Forerunner-610-Extractor> sudo python setup.py install
running install
/usr/lib/python3/dist-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
  warnings.warn(
/usr/lib/python3/dist-packages/setuptools/command/easy_install.py:158: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.
  warnings.warn(
running bdist_egg
running egg_info
writing antfs_cli.egg-info/PKG-INFO
writing dependency_links to antfs_cli.egg-info/dependency_links.txt
writing entry points to antfs_cli.egg-info/entry_points.txt
writing requirements to antfs_cli.egg-info/requires.txt
writing top-level names to antfs_cli.egg-info/top_level.txt
reading manifest file 'antfs_cli.egg-info/SOURCES.txt'
adding license file 'LICENCE'
writing manifest file 'antfs_cli.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
creating build/bdist.linux-x86_64/egg
creating build/bdist.linux-x86_64/egg/antfs_cli
copying build/lib/antfs_cli/scripting.py -> build/bdist.linux-x86_64/egg/antfs_cli
copying build/lib/antfs_cli/utilities.py -> build/bdist.linux-x86_64/egg/antfs_cli
copying build/lib/antfs_cli/__init__.py -> build/bdist.linux-x86_64/egg/antfs_cli
copying build/lib/antfs_cli/program.py -> build/bdist.linux-x86_64/egg/antfs_cli
byte-compiling build/bdist.linux-x86_64/egg/antfs_cli/scripting.py to scripting.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/antfs_cli/utilities.py to utilities.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/antfs_cli/__init__.py to __init__.cpython-310.pyc
byte-compiling build/bdist.linux-x86_64/egg/antfs_cli/program.py to program.cpython-310.pyc
creating build/bdist.linux-x86_64/egg/EGG-INFO
copying antfs_cli.egg-info/PKG-INFO -> build/bdist.linux-x86_64/egg/EGG-INFO
copying antfs_cli.egg-info/SOURCES.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying antfs_cli.egg-info/dependency_links.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying antfs_cli.egg-info/entry_points.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying antfs_cli.egg-info/requires.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying antfs_cli.egg-info/top_level.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
zip_safe flag not set; analyzing archive contents...
creating 'dist/antfs_cli-0.4-py3.10.egg' and adding 'build/bdist.linux-x86_64/egg' to it
removing 'build/bdist.linux-x86_64/egg' (and everything under it)
Processing antfs_cli-0.4-py3.10.egg
Removing /usr/local/lib/python3.10/dist-packages/antfs_cli-0.4-py3.10.egg
Copying antfs_cli-0.4-py3.10.egg to /usr/local/lib/python3.10/dist-packages
antfs-cli 0.4 is already the active version in easy-install.pth
Installing antfs-cli script to /usr/local/bin

Installed /usr/local/lib/python3.10/dist-packages/antfs_cli-0.4-py3.10.egg
/usr/lib/python3/dist-packages/pkg_resources/__init__.py:116: PkgResourcesDeprecationWarning:  is an invalid version and will not be supported in a future release
  warnings.warn(
Processing dependencies for antfs-cli==0.4
Searching for openant==1.3.2
Best match: openant 1.3.2
Adding openant 1.3.2 to easy-install.pth file
Installing openant script to /usr/local/bin

Using /usr/local/lib/python3.10/dist-packages
Searching for pyusb==1.2.1
Best match: pyusb 1.2.1
Adding pyusb 1.2.1 to easy-install.pth file

Using /usr/local/lib/python3.10/dist-packages
Finished processing dependencies for antfs-cli==0.4


UnexpectedEndOfStream exception when downloading and uploading files

Describe the bug
When we upload 50 files as part of integration tests and then immediately download 50 files we see an end of stream error
06-19 13:47:46.107 17791 19872 E AndroidRuntime: Caused by: java.lang.Exception: aws.smithy.kotlin.runtime.http.HttpException: java.io.IOException: unexpected end of stream on https:.../...
06-19 13:47:46.107 17791 19872 E AndroidRuntime: 	at com.amplifyframework.storage.s3.transfer.worker.BaseTransferWorker.doWork$suspendImpl(BaseTransferWorker.kt:119)
Expected behavior
IOException should not arise when you are trying to download a large amount of files.
Current behavior
aws.smithy.kotlin.runtime.http.HttpException: java.io.IOException
One thing I have noticed is that if I remove the upload task from the setup and put it inside the actual test case this issue does not arise. (potentially something to do with the delay after upload that the download starts)
Steps to Reproduce

Create an integration test suite
Upload 50 small files in the setup once method
Download the same 50 small files in the test case (it fails after the 5 try and sometimes after the 9th try)

Code can be found here : https://github.com/aws-amplify/amplify-android/blob/e824356ef187a7a43f509116acda58a8767cf35c/aws-storage-s3/src/androidTest/java/com/amplifyframework/storage/s3/StorageStressTest.kt#L41
Possible Solution
No response
Context
No response
AWS Kotlin SDK version used
0.27.0-beta
Platform (JVM/JS/Native)
Native
Operating System and version
Android Pixel 5 API 32

I cannot reproduce the issue with the steps given (create a test, upload 50 files in setup method, download 50 files in test case). The linked code is also not very helpful because it doesn't reference any classes/methods from the AWS SDK for Kotlin (e.g., there's no S3 client, no putObject/getObject calls, etc.). I'm guessing they're called behind various abstractions but they're not apparent from a quick read.
Can you provide a minimal example of this?


Error: Could not find module ember-qunit

Hi,
I got this messages when I runned the 'ember test --serve':
Global error: SyntaxError: Use of reserved word 'import' at http://localhost:7357/assets/test-support.js, line 6800

Global error: Error: Could not find module `ember-qunit` imported from `my_project/tests/test-helper` at http://localhost:7357/assets/vendor.js, line 233

SyntaxError: Use of reserved word 'import' at http://localhost:7357/assets/test-support.js, line 6800
Error: Could not find module `ember-qunit` imported from `my_project/tests/test-helper` at http://localhost:7357/assets/vendor.js, line 233

Someone know what it is?
My versions:

ember-cli: 2.12.1
http_parser: 2.7.0
node: 4.7.2
v8: <IP_ADDRESS>
uv: 1.9.1
zlib: 1.2.8
ares: 1.10.1-DEV
icu: 57.1
modules: 46
openssl: 1.0.2g
os: linux x64
4.4.4

Sorry my poor English and Thanks.

A reproduction of your issue would help us debug. In general, module load failures could be caused by a myriad of issues, so without a reproduction it is unlikely we'll be able to provide much help.

@trentmwillis  Thanks. I solved this problem with new ember init to update my dependencies versions.
After this update the problem not occurred any more.


How to send arguments in node red

The windowControl function apparently needs a command/argument but I don't see where to enter that in the node.  Can you explain how to vent/close the windows with this node?  Thanks.

I can send commandArgs from an inject node, but I haven't been able to figure out what to send it as.

Saw the Args detail at the bottom.  Working now.


Inverse of sqrt(2) * 4th root(x)

presumably applies to any n^pow * x^pow

fixed in dcb21aa154c22a9f54c36d4dfe38414b8730bf30


Added Automation for OCVS using Terraform example

Added terraform example of how to automate OCVS operations. In this example how to create a VLAN and assign it to all hosts in an OCVS environment

OCA should now be fixed


use param instead of magic number for compaction threshold

Problem
In the analysis I wrote yesterday I mentioned that there is a magic number 10 for compaction and @hlinnaka pointed out that it should be the compaction threshold. I remembered I saw this magic number somewhere instead of using the correct parameter and it turned out that my memory is good.
Summary of changes
Use compaction_threshold instead of 10.
Checklist before requesting a review

[x] I have performed a self-review of my code.
[ ] If it is a core feature, I have added thorough tests.
[ ] Do we need to implement analytics? if so did you add the relevant metrics to the dashboard?
[ ] If this PR requires public announcement, mark it with /release-notes label and add several sentences in this section.

Checklist before merging

[ ] Do not forget to reformat commit message to not include the above checklist

That's a different constant. The "repartition threshold" defines how often we calculate the "partitioning" of the keyspace. The partitioning in turn will be used the next time the image layers are created.
The tradeoff is that with a more recent partitioning, we can create image layers with a higher LSN, which is good because it makes the image layers more useful for avoiding WAL replay. On the other hand, calculating it is not free, so we don't want to do it too often. The current value is totally ad hoc and not based on any analysis or testing, though.
I don't remember why we don't do compute the partitioning "just-in-time" when we are about to create the image layers. That would be more straightforward. Maybe it's used for something else that I don't remember right now as well. Or maybe there is no good reason and we should change it :-)

I don't remember why we don't do compute the partitioning "just-in-time" when we are about to create the image layers. That would be more straightforward. Maybe it's used for something else that I don't remember right now as well. Or maybe there is no good reason and we should change it :-)

We don't do this. Instead we check if we should repartition at each compaction iteration by calling Timeline::repartition, which might do a repartitioning or not, then create the image layers on the latest partitioned LSN.
Heuristics on whether to create image layers or not are separate, currently depending on number of deltas.

Thanks for reviews! Now this PR is simply lifting the const into a global variable (with some comments) so that it is not a magic number.


Aws bulk loading

PR Description
Adds support for bulk loading of secp256k1 keys in AWS for Eth1 mode. This allows for easier configuration when using AWS KMS for storing keys when using transaction signing.
This adds the following new command line options. These are similar in meaning the aws parameters in Eth2 mode.

--aws-kms-enabled
--aws-kms-auth-mode
--aws-kms-access-key-id
--aws-kms-secret-access-key
--aws-kms-region
--aws-endpoint-override
--aws-kms-tag-names-filter
--aws-kms-tag-values-filter
--aws-connection-cache-size

Fixed Issue(s)

Documentation

[x] I thought about documentation and added the doc-change-required label to this PR if updates are required.

Changelog

[x] I thought about adding a changelog entry, and added one if I deemed necessary.

Testing

[x] I thought about testing these changes in a realistic/non-local environment.

Still LGTM ✅


Deconvolving HRF step takes a huge amount of time

The HRF estimation seems to be quite fast (particularly with microtime resolution 1 and AR off), but the "deconvolving HRF" step always takes very very long, even for just 300 volumes.
Is there a way to make this step faster?

Thanks a lot for your message.
Could you please specify the architecture of the machine you are running
the toolbox on?
Also, can you please specify "very long"?
The Matlab SPM plugin takes a couple of minutes to run on a standard
desktop pc for one subject in native space.
On Sun, Dec 2, 2018 at 2:00 AM Stephen L<EMAIL_ADDRESS>wrote:

The HRF estimation seems to be quite fast (particularly with microtime
resolution 1 and AR off), but the "deconvolving HRF" step always takes very
very long, even for just 300 volumes.
Is there a way to make this step faster?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/compneuro-da/rsHRF/issues/51, or mute the thread
https://github.com/notifications/unsubscribe-auth/AFEKfr2pipgR_Nm_Zn4QV6ph3n_Jtjdtks5u0yYbgaJpZM4Y9LYd
.

Something else came to our minds, it might be that you do not use a mask, and then remove the outliers and replace these missing values (including a huge number of voxels outside the brain).
this step can take very very long, and it's useless.

Dear Daniele,
Thank you very much for your fast replies and also for your email! I take this opportunity to link to the solution to combine CONN and rshrf.
About the time it takes, I reworked further my pipeline to generate additional info that might be useful to you. Here is the log I get:
`
=== HEMODYNAMIC RESPONSE FUNCTION USING RSHRF TOOLBOX ===
---- PROCESSING CONDITION ket SUBJECT 1 (ana_5896) SESSION S2 ----

Running job #1
Running 'Voxel-wise HRF deconvolution'
Reading NIFTI Data ...
1739757 voxels inside defaut mask ...
Reading Covariates ...
Removing regressors & Detrend.................
Frequency filter....................
#1739757
Starting parallel pool (parpool) using the 'local' profile ...
connected to 6 workers.
...................................................................................................................................................................................................................................................
Done HRF estimation   195.60 seconds
Deconvolving HRF ...
Elapsed time is 254.491797 seconds.

Reading Covariates ...
Removing regressors & Detrend.................
Frequency filter....................
#1658904
Starting parallel pool (parpool) using the 'local' profile ...
connected to 6 workers.
...............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
Done HRF estimation   185.79 seconds
Deconvolving HRF ...
Elapsed time is 88.535682 seconds.

Reading Covariates ...
Removing regressors & Detrend.................
Frequency filter....................
#1473874
Starting parallel pool (parpool) using the 'local' profile ...
connected to 6 workers.
............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
Done HRF estimation   163.17 seconds
Deconvolving HRF ...
Elapsed time is 5416.796399 seconds.
Save HRF deconvolution results....
height outlier: negative/zeros #3459 + extreme #13968, [180.705 1833.208];
Done    'Voxel-wise HRF deconvolution'
Done
---- PROCESSING CONDITION ket SUBJECT 2 (ana_5913) SESSION W1 ----

Running job #1
Running 'Voxel-wise HRF deconvolution'
Reading NIFTI Data ...
1431272 voxels inside defaut mask ...
Reading Covariates ...
Removing regressors & Detrend.................
Frequency filter....................
#1431272
Starting parallel pool (parpool) using the 'local' profile ...
connected to 6 workers.
...............................................................
Done HRF estimation   142.70 seconds
Deconvolving HRF ...
Elapsed time is 22804.829655 seconds.
Save HRF deconvolution results....
height outlier: negative/zeros #63 + extreme #18985, [53.059 1353.533];
Done    'Voxel-wise HRF deconvolution'
Done
---- PROCESSING CONDITION ket SUBJECT 3 (ana_5925) SESSION S2 ----

Running job #1
Running 'Voxel-wise HRF deconvolution'
Reading NIFTI Data ...
1578974 voxels inside defaut mask ...
Reading Covariates ...
Removing regressors & Detrend.................
Frequency filter....................
#1578974
Starting parallel pool (parpool) using the 'local' profile ...
connected to 6 workers.
............
Done HRF estimation   101.43 seconds
Deconvolving HRF ...
`
This is a post-processing on 9 subjects with 2 sessions (S2 and W1) for each. As you can see, the first deconvolution is quite quick, then for each session it becomes longer and longer, approximately 10x more time for each. I tried several times, modifying some parameters until I came back to near the default settings in rshrf, and it still happens the same, I never went beyond subject 3 session S2 (first session), because if the exponential increase is true, it would approximately take 50hours to complete (currently it's been running since 30 hours to no avail).
More precisely, here are the deconvolution runtimes so far from the log: 254s, 88s, 5416s, 22804s.
Your hypothesis that I don't use a mask is correct, but can this explain why the time is increasing between sessions? If it's because of the mask, I would expect the time increase to be constant for the same number of volumes and voxel resolution, which hold for my dataset.
I attach the jobs that my script is dynamically generating, maybe you can find more info from this? jobs.zip
I can also make available anything else if it can help, just let me know.
Thank you very much for taking the time to help me on this!

Dear Stephan
thanks a lot for the update on the interface with CONN, I'm sure it will be useful to others.
The info that you provided indeed allows to understand that the issue is in the deconvolution phase.
We will look into the jobs.
For the moment, can you just try to run one subject/session per time, or change the order? Just to see if there is actually an increasing/accumulating delay (as it seems), or if some subjects/sessions are problematic.

Thank you Daniele for this great idea, I'm running now the pipeline by beginning with the 3rd subject, so far it still did not finish, so it seems something in the data is making rshrf deconvolution go wild.
I let it run for the night to make sure and if it did not finish, tomorrow I can send you an excerpt of the dataset if you agree.

BTW my pipeline is here: https://github.com/lrq3000/csg_mri_pipelines/blob/master/preprocessing/fmri/script_preproc_fmri_csg.m#L571
It's temporary as I will change it to process after CONN (currently it's done just before, which is wrong).

matlabbatch{1}.spm.tools.HRF.vox_rsHRF.rmoutlier = 1;  % remove outlier
matlabbatch{1}.spm.tools.HRF.vox_rsHRF.mask = {''};  % no mask included
matlabbatch{1}.spm.tools.HRF.vox_rsHRF.outdir = {''};  % save to current folder
I suggest you try to set
*.rmoutlier = 0;
*.mask = {fullfile(spm(‘Dir’),’tpm’,'mask_ICV.nii')};

On 2 Dec 2018, at 09:00, Stephen L<EMAIL_ADDRESS><EMAIL_ADDRESS>wrote:
The HRF estimation seems to be quite fast (particularly with microtime resolution 1 and AR off), but the "deconvolving HRF" step always takes very very long, even for just 300 volumes.
Is there a way to make this step faster?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub https://github.com/compneuro-da/rsHRF/issues/51, or mute the thread https://github.com/notifications/unsubscribe-auth/ATmXf0YqoarbLxzA0kZrDnsquLQkJGXoks5u0yYbgaJpZM4Y9LYd.

@guorongwu Thank you very much! Adding the mask indeed solved the issue (rmoutlier can be set to 1).
May I suggest to add this template as the default value in the rshrf batch?
I thought that rmoutlier was necessary, what would you guys advise for a typical resting state functional connectivity analysis? And what about AR correction?
Thank you very much!
Best regards

in your pipeline, it's performed on normalized MNI space, I think you can
add it as default value.
I will also remove outlier, but if too much 'outlier' include, this step
may 'change' the final deconvolved signals (similar to bad EEG channels for
EEG analysis).
we can use AR correction, I do not suggest you set a high AR order. the
code may run faster if no AR correction. it will not achieve convergence in
some signals, then without AR correction are better for these singals.
On Thu, Dec 6, 2018 at 5:14 AM Stephen L<EMAIL_ADDRESS>wrote:

@guorongwu https://github.com/guorongwu Thank you very much! Adding the
mask indeed solved the issue (rmoutlier can be set to 1).
May I suggest to add this template as the default value in the rshrf batch?
I thought that rmoutlier was necessary, what would you guys advise for a
typical resting state functional connectivity analysis? And what about AR
correction?
Thank you very much!
Best regards
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/compneuro-da/rsHRF/issues/51#issuecomment-444650879,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ATmXf2eKio0X8yi9M8WbmNxQH25c7eWPks5u2Dc-gaJpZM4Y9LYd
.

Thank you very much @guorongwu for the info!
I am not sure I understand about the remove outlier option, if I enabled it (inpainting outliers with NaN) this can change the final deconvolved signal (or is it the other way around?).
For the default template, yes my pipeline is using MNI space, but since most SPM based pipelines do the same I think it would really ease newcomers to get a hang of the rshrf toolbox if this template was provided as the default, or if not, at least in the help message?
I have a final but very crucial question: can the rshrf toolbox work on smoothed data? Because the way CONN author advised to combine CONN + rshrf is to use rshrf after CONN denoising, which is done on smoothed data. If rshrf cannot work on smoothed data, would it be possible/mathematically meaningful to do the hrf deconvolution calculation, save it and apply it on the smoothed data?

it only change the outlier signals (outlier detected from response height)
actually, we include several demo jobs, which provide example to include
different masks (native or MNI space).
sure, you can use the smoothed data, it can increase SNR.
On Fri, Dec 7, 2018 at 9:45 AM Stephen L<EMAIL_ADDRESS>wrote:

Thank you very much @guorongwu https://github.com/guorongwu for the
info!
I am not sure I understand about the remove outlier option, if I enabled
it (inpainting outliers with NaN) this can change the final deconvolved
signal (or is it the other way around?).
For the default template, yes my pipeline is using MNI space, but since
most SPM based pipelines do the same I think it would really ease newcomers
to get a hang of the rshrf toolbox if this template was provided as the
default, or if not, at least in the help message?
I have a final but very crucial question: can the rshrf toolbox work on
smoothed data? Because the way CONN author advised to combine CONN + rshrf
is to use rshrf after CONN denoising, which is done on smoothed data. If
rshrf cannot work on smoothed data, would it be possible/mathematically
meaningful to do the hrf deconvolution calculation, save it and apply it on
the smoothed data?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/compneuro-da/rsHRF/issues/51#issuecomment-445093852,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ATmXf9EepuXYaxyL8FdKMqBa05wtvZHtks5u2cgvgaJpZM4Y9LYd
.


FileFilter unworking on Android

The following code:
var settings = new OpenFileDialogSettings
{
    Filters = new List<FileFilter>()
    {
        new FileFilter("Text Files", new[]{"txt"})
    }
};
var result = await _dialogService.ShowOpenFileDialogAsync(this, settings);

On Windows, successfully shows an OpenFile dialog that only allows you to select text files. On Android, it allows you to select anything. Seems like the FileFilter is unworking on mobile. Is that unsupported?

Android and iOS use MEME type instead
https://docs.avaloniaui.net/docs/concepts/services/storage-provider/file-picker-options

Ahh - gotcha, thanks