[qt5] Rebuild for openssl3

Pick up patches from ubuntu, see discussion in #63 & https://github.com/conda-forge/conda-forge-pinning-feedstock/issues/3773
Closes #73
Closes #62

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

That patch didn't apply cleanly as-is because the file paths need to be prefixed with qtbase/. I've pushed an update to fix that.
I'm wondering if we'll need to make the patch conditional on the OpenSSL version. It's not clear to me whether that will be necessary, nor do I know off the top of my head how to implement that in the meta.yaml, so let's see what happens in the builds with the fixed-up patch ...
Also. it may not be relevant to our builds (it's a 32bit/64bit fix), but while we're at it we may wish to also pick up the patch in this bug, which according to the discussion looks like it has also been merged upstream. Presumably it will also need its file paths munged.

That patch didn't apply cleanly as-is because the file paths need to be prefixed with qtbase/. I've pushed an update to fix that.

Thanks, I saw that too, and thought I'd clean up the patch situation in general a bit. However, git is taking really long to initialise a nearly 3GB single commit... 😅

I'm wondering if we'll need to make the patch conditional on the OpenSSL version. It's not clear to me whether that will be necessary, nor do I know off the top of my head how to implement that in the meta.yaml, so let's see what happens in the builds with the fixed-up patch ...

If we need to, it's very easy -- openssl is a variable that's known to the jinja selectors, so we can just do # [openssl == "3"]

Also, it may not be relevant to our builds (it's a 32bit/64bit fix), but while we're at it we may wish to also pick up the patch in this bug, which according to the discussion looks like it has also been merged upstream. Presumably it will also need its file paths munged.

I don't think it's worth the hassle to carry patches for 32bit arches, since we haven't been building those for years.

I'm not sure whether it already does what we want.
From the logs:
2022-11-29T16:05:22.7729708Z   OpenSSL ................................ yes
2022-11-29T16:05:22.7730062Z     Qt directly linked to OpenSSL ........ no
2022-11-29T16:05:22.7730410Z   OpenSSL 1.1 ............................ yes
...
2022-11-29T16:05:22.7908885Z Note: Overriding option 'openssl' with 'yes' (was: 'linked')
...
2022-11-29T18:04:59.7037373Z WARNING (qt-main): run-exports library package conda-forge::openssl-3.0.7-h166bdaf_0 in requirements/run but it is not used (i.e. it is overdepending or perhaps statically linked? If that is what you want then add it to `build/ignore_run_exports`)

I cannot see the linker linking in openssl3 anywhere, either.

Also note that on osx we don't use openssl at all:
https://github.com/h-vetinari/qt-main-feedstock/blob/49fb856bb77f196a3e2f16e58c515f738e2f4e04/recipe/build.sh#L241

I'm not sure whether it already does what we want.

Interesting... Does qt bring its own openssl? If it didn't I'd expect the builds to fail...

2022-11-29T16:05:22.7729708Z   OpenSSL ................................ yes
2022-11-29T16:05:22.7730062Z     Qt directly linked to OpenSSL ........ no
2022-11-29T16:05:22.7730410Z   OpenSSL 1.1 ............................ yes
...
2022-11-29T16:05:22.7908885Z Note: Overriding option 'openssl' with 'yes' (was: 'linked')

I don't have much experience with building qt; I see build.sh already uses:
configure ... \
                -openssl-linked \
                -openssl \

bld.bat OTOH uses:
configure ... ^
     -openssl ^
     -openssl-runtime ^

but this similarly warns:
Note: Overriding option 'openssl' with 'runtime' (was: 'yes')

Based on the digging I've done, I think your latest commits should be doing the right thing here — the configuration options are not very intuitive!
A rerender should be able to eliminate some of the OSX matrixing, no?

A rerender should be able to eliminate some of the OSX matrixing, no?

I've tried, but it doesn't. I think it's the presence of the selector # [openssl == "3"] that prevents it.

Couldn't even get it to collapse the osx-job with:
diff --git a/recipe/meta.yaml b/recipe/meta.yaml
index 43cd4b7..87aba02 100644
--- a/recipe/meta.yaml
+++ b/recipe/meta.yaml
@@ -29,7 +29,11 @@ source:

       # Patch for openssl 3 compatibility, picked up from ubuntu, see
       # https://git.launchpad.net/ubuntu/+source/qtbase-opensource-src/commit/?h=applied/ubuntu/devel&id=6f147c166539b23792515445beadc02fb5565d0c
+      {% if not osx %}
+      # write as jinja so smithy doesn't uselessly multiply
+      # osx builds based on seeing openssl in the selector
       - patches/0013-upstream-fixes-to-support-OpenSSL-3.0.patch        # [openssl == "3"]
+      {% endif %}

   - url: https://download.qt.io/development_releases/prebuilt/llvmpipe/windows/opengl32sw-64-mesa_12_0_rc2.7z     # [win64]
     sha256: 2a0d2f92c60e0962ef5f6039d3793424c6f39e49ba27ac04a5b21ca4ae012e15                                      # [win64]

The only thing that I think would work is an explicit skip: true  # [osx and openssl == "3"] or hand-modifying the migrator.

Looks like this worked (despite still showing "yes" to 1.1):
   OpenSSL ................................ yes
     Qt directly linked to OpenSSL ........ yes
   OpenSSL 1.1 ............................ yes

on linux:
   INFO (qt-main,lib/libQt5Network.so.5.15.6): Needed DSO lib/libssl.so.3 found in conda-forge::openssl-3.0.7-h166bdaf_0
   INFO (qt-main,lib/libQt5Network.so.5.15.6): Needed DSO lib/libcrypto.so.3 found in conda-forge::openssl-3.0.7-h166bdaf_0

resp. on windows:
   INFO (qt-main,Library/bin/Qt5Network_conda.dll): Needed DSO Library/bin/libssl-3-x64.dll found in conda-forge::openssl-3.0.7-hcfcfb64_0
   INFO (qt-main,Library/bin/Qt5Network_conda.dll): Needed DSO Library/bin/libcrypto-3-x64.dll found in conda-forge::openssl-3.0.7-hcfcfb64_0

I was working to backport (forwardport?) https://github.com/conda-forge/qt-main-feedstock/pull/72/commits/2a5c64ee29129fabf3597e2844c8d2b0d88feebc to the qt6 branch, but there -openssl-linked is already done consistently.

Do you mind adding the changes from https://github.com/conda-forge/qt-main-feedstock/pull/74
I can build aarch on a multi-core x86 machines so it should finish in finite time.

Do you mind adding the changes from #74

WDYT about merging #74 and I rebase on that?

I can build aarch on a multi-core x86 machines so it should finish in finite time.

Sounds great, thanks!

I built with 2 CPUs last night, so the build didn't finish. It can wait until things finish tonight i guess.

I built with 2 CPUs last night, so the build didn't finish. It can wait until things finish tonight i guess.

I meant we don't have to rebuild aarch for every PR (would be enough to do it for this one), but we could keep the PR separate from a non-aarch perspective.
In any case, I rebased and will push now (with option to rebase again if/once #74 gets merged), and you can choose which way you prefer to approach it.

aarch_openssl_rebuild.zip
 $ anaconda upload --user conda-forge build_artifacts/linux-aarch64/qt-main-5.15.6-h44831fa_3.conda

Using Anaconda API: https://api.anaconda.org
Using "conda-forge" as upload username
Processing 'build_artifacts/linux-aarch64/qt-main-5.15.6-h44831fa_3.conda'
Detecting file type...
File type is "Conda"
Extracting conda attributes for upload
Creating package "qt-main"
Creating release "5.15.6"
Uploading file "conda-forge/qt-main/5.15.6/linux-aarch64/qt-main-5.15.6-h44831fa_3.conda"
[ERROR] ('"qt-main" could not be found', 404)

hmm, seems the upload command has changed?

@hmaarrfk
Thanks a lot!
Did you build aarch just for OpenSSL 3 (the main point), just for 1.1.1 (would be missing the point, so I don't expect that) or both?

both. i also wanted topin on libsqlite instead of sqlite.

With the sed commands, the logs are about 16 MB instead of 50.

Ah, never mind, I see the upload worked and you built both - cool! :)


Implement relay nn.bias_add compute in C++

Relay nn.bias_add now has a compute implementation in Python, which is inconvenient for C++ flow given many of the Relay nodes already are implemented in C++. This PR ports the compute from Python to C++.

@hlu1 @ajtulloch

Comments addressed.


Replacing Font Awesome and Image Sprites

https://github.com/Vekseid/FontReaper
After I get finished with the .css segregation, I was thinking of going through and excising every last sprite and other raster image from the css. Font Awesome has most everything as-is.
Given the issues icon fonts have, I wrote a small tool to make them into something a bit more robust. : )

Sorry, these days I'm either totally :sleepy: or doing something else.
You mean replace sprites with FA or replace everything with something else?

I think the idea is to replace them with FA icons, but to use SVG versions of those icons ?

Right. I made the script above, which dismantles and icon font and makes an embedded .css version that works across all modern browsers, and returns to the font fallback for IE 7-8.
Right now the situation is a bit ridiculous. You are loading Font Awesome, which has icons for nearly everything you use images for, and yet they go unused. >_>

Yup somewhat selective use to date ... and old discussion here: https://github.com/elkarte/Elkarte/issues/1321

One question that came to my mind: you are converting to svg only part of the fontawesome stuff, correct?
So if someone want to use other icons the FA it may be worth considering something along the lines of the jQuery-UI stuff? (i.e. keep FA in the core and have a flag to enable it, mainly for addons I think.)

Might be worth it to leave as a toggle, yeah. One of the perks of picking a new naming scheme means it is an option. : )

Just to avoid opening another issue (unless you prefer so, in that case I'll do ;D), the unread and unreadreplies icons are black, on BeSocial becomes rather difficult to see them.
For a total newbie, how do I change the background color of the SVG?
Is it necessary to edit the path, or is it possible to style it somehow?

You can style SVG through regular CSS. Actually I'd propose to add in relevant style hooks for easy styling through custom CSS without having to perform any JS hacks.
Specifically, you'd add a little stylesheet link in every SVG
<?xml-stylesheet type="text/css" href="whatever.css" ?>

Then it's probably best to work with some class attributes in the SVGs themselves.
Finally you'd have your whatever.css with a couple of quick styles like
.whatever {stroke:black; fill:white;}

That way you could easily adjust the SVGs to your theme.

@emanuele45 yeah I was kindof wondering what to do with those two, so I left them black for now. Suggestions welcome.
@Frenzie embedded css cannot be currently styled. Instead, you see me embedding stroke and fill colors into the data urls directly.
.i-female::before { 	content: url("data:image/svg+xml,%3Csvg xmlns='http://www.w3.org/2000/svg' stroke='black' stroke-width='6em' fill='%23ff80c8' viewBox='0 0 3584 3584'%3E%3Cpath d='M2816 1152q0 442-295 769t-729 375v520h448q28 0 46 18t18 46v128q0 28-18 46t-46 18h-448v448q0 28-18 46t-46 18h-128q-28 0-46-18t-18-46v-448h-448q-28 0-46-18t-18-46v-128q0-28 18-46t46-18h448v-520q-300-32-543-206t-372-448-105-584q22-268 161-498t364-376 491-176q340-38 638 108t472 424 174 612z m-2048 0q0 370 263 633t633 263 633-263 263-633-263-633-633-263-633 263-263 633z'/%3E%3C/svg%3E"); }
Note: stroke='black' stroke-width='6em' fill='%23ff80c8'
stroke and fill take any color parameter, plus transparent. If you want to specify a specific hexadecimal color, the hash needs to be url encoded (%23)
The easiest solution here would be to have a lightweight css compilation script for the color file(s) (plural if we split out the icons for minification ease). The stroke and fill parameters take the same colors css does, plus transparent.
Going to be going in for another pass on Elkarte in a few days here, hopefully clean up some of these issues, add some more icons, etc. : )

@Vekseid Yes, you're restating the obvious and I'm not sure why. ;)
Now for just adjusting stroke and fill colors what I proposed isn't that interesting, but think of all the cool stuff you could do with it if you have a proper stylesheet. Take our little home icon
data:image/svg+xml,<svg xmlns='http://www.w3.org/2000/svg' stroke='black' stroke-width='6em' fill='white' viewBox='0 0 3584 3584'><path d='M2944 1984v960q0 52-38 90t-90 38h-768v-768h-512v768h-768q-52 0-90-38t-38-90v-960q0-2 1-6t1-6l1150-948 1150 948q2 4 2 12z m446-138l-124 148q-16 18-42 22h-6q-26 0-42-14l-1384-1154-1384 1154q-24 16-48 14-26-4-42-22l-124-148q-16-20-14-47t22-43l1438-1198q64-52 152-52t152 52l488 408v-390q0-28 18-46t46-18h384q28 0 46 18t18 46v816l438 364q20 16 22 43t-14 47z'/></svg>

Instead we add a quick style override
data:image/svg+xml,<svg xmlns='http://www.w3.org/2000/svg' stroke='black' stroke-width='6em' fill='white' viewBox='0 0 3584 3584' style="fill:black;stroke:pink;stroke-width:15em;stroke-dasharray:500,50"><path d='M2944 1984v960q0 52-38 90t-90 38h-768v-768h-512v768h-768q-52 0-90-38t-38-90v-960q0-2 1-6t1-6l1150-948 1150 948q2 4 2 12z m446-138l-124 148q-16 18-42 22h-6q-26 0-42-14l-1384-1154-1384 1154q-24 16-48 14-26-4-42-22l-124-148q-16-20-14-47t22-43l1438-1198q64-52 152-52t152 52l488 408v-390q0-28 18-46t46-18h384q28 0 46 18t18 46v816l438 364q20 16 22 43t-14 47z'/></svg>

That is imo one of the big advantages over using font icons, but only if you enable it somehow. Of course that can happen just as well with a compiler as with a linked stylesheet. I'm kind of thinking it might be easiest to compile the whole thing into fragment identifiers.

There's no benefit to using a style override when the fill and stroke attributes are right there for anyone to add or edit.
We do desperately need at least a lightweight compiler, but that was a part of why I broke out the color data in the first place. Makes a first pass of that much simpler.

The benefit is you can easily override it all at once from one stylesheet.
It's the same principle as custom_whatever.css. The example is only inline
for illustration purposes.
On Thu, Apr 21, 2016 at 6:33 PM, Vekseid<EMAIL_ADDRESS>wrote:

There's no benefit to using a style override when the fill and stroke
attributes are right there for anyone to add or edit.
We do desperately need at least a lightweight compiler, but that was a
part of why I broke out the color data in the first place. Makes a first
pass of that much simpler.
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/elkarte/Elkarte/issues/2375#issuecomment-213001410

Also, fragment identifiers don't work right in Safari 9. We'd need to swap between img and embed. Maybe have a discussion about that once we've got all icons ready.

Well, I just threw that out there as a means of possibly reducing some overhead in HTTP requests and filesize. I'm not convinced how well it'd work for the latter purpose anyway, or if it's worth the extra effort even if it did work in Safari.[1] After all, for filesize all of the extra viewports probably more or less even out with added stylesheet links. Similarly, by leaving out the whole stroke='black' stroke-width='6em' fill='white' part you'd probably end up roughly equal as well, or possibly slightly larger if some strategic classes or ids are desirable. (Also note that the type="text/css" I added is purely advisory and can be safely left out.)
I think there's a very interesting easy customization/theming potential here, possibly never before implemented anywhere before. I think it's kind of Elk's style too, with all of the hooks and custom_.css and such. ;)
[1] Incidentally, it's really sad that Opera/Presto is still top of the line in SVG support almost four years after active development ceased.

The filesize difference is not very appreciable. You only gain from a handful of html encoded characters when you do it properly (since IE9 does not need to encode spaces... thankfully).

Apart from the usual "complete what was started", is there anything else left here?

Still have all of the current sprites to go for B4

Did we do any?
Otherwise we can have that as a usual "W.i.P." issue and continue with the release?

Nope ... the sprites are still in place (basically menu things) ... we did finish removing all of FA at this time.  So I guess its still a WIP not a stopper.

Much of what is left requires some degree of refactoring, so it's a bit tricky.

Then maybe leave as it is for 1.1 and break everything for 2.0?

The forum topic icons are pretty easy to convert. Everything else would be best for a future version.

The forum topic icons are pretty easy to convert. Most everything else would be best for a future version.

I just discovered, that the (SVG?) arrow icons in selecting massages to split are not shown in Firefox but they are visible in Chrome.
v1.1 RC1

Its a mistake in the CSS ... if you look for fill='#000000' change it to fill='black' ditto for fill='#000'

I guess we can close this one and work on the remaining with new issues.


Added onClick function for making the entire state row clickable for …

…district view and reduced the spacing between state -> district view

This pull request is raised for https://github.com/covid19india/covid19india-react/issues/165

#165


[WIP] auth: only support root login tikv mode

Signed-off-by: sebo<EMAIL_ADDRESS>
What problem does this PR solve?
add sub command to set and clear dashboard kv mode password
What is changed and how it works?
add dashboard sub command to pd-ctl
Release note
Check List
Tests

Integration test

Code changes

Has configuration change
Has HTTP API interfaces change (Don't forget to add the declarative for API)
Has persistent data change

Side effects

Possible performance regression
Increased code complexity
Breaking backward compatibility

Related changes
https://github.com/pingcap-incubator/tidb-dashboard/issues/88
https://github.com/pingcap-incubator/tidb-dashboard/pull/308

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Hi @SSebo s this PR still needed? I see the UCP issue is done in the dashboard.

@nolouch thanks for asking,  I will re-open this if need to.


Segmentation Fault (SIGSEGV) in middle of Training due to Runtime-statistics calculation ops.

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow):
Custom code. The full code can be accessed here at GitHub
OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
CentOS Linux release 7.5.1804 (Core)
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device:
TensorFlow installed from (source or binary):
Binary
TensorFlow version (use command below):
('v1.8.0-0-g93bc2e2072', '1.8.0')
Python version:
Python 2.7.5 (default, Apr 11 2018, 07:36:10)
Bazel version (if compiling from source):
GCC/Compiler version (if compiling from source):
CUDA/cuDNN version:
cuda-9.0-cudnn-7
GPU model and memory:
2 Tesla V100 Nvidia GPUs, ~15 Gb each
Exact command to reproduce:
Please go through this instruction here to run the code.
The training runs without error on small dataset. The problem arises when number of minibatches are
more per epoch keeping the batch size constant. (i.e more number of sess.run call per epoch)

Describe the problem
The training crashes with the error Segmentation Fault (Core Dumped) in the middle of the training after around 14-18 epochs (with ~800 minibatches in each) even though I have sufficient RAM (~12-20% utilization holding steadily before crash).

Possible Memory Leak Checked
Initially, I suspected a memory leak due to the addition of new ops after each iteration, so I finalized the graph in the training session. But this was not the source of the problem. No new nodes were added at each iteration.
Attempt 2: Locating the problem
After that, I ran the training on gdb (see the stack trace in logs section) and along with some commenting of the code I have almost pinpointed the source of error.
Currently every 30 minibatch training I am saving the summary here in the code. The full code can be found here

The train_track_op in line number 415 is a list of which looks like this:
[gradient_update_op, loss_GPU1, loss_GPU2, merged_summary_op]
If I comment out the section in lines 406-438 the training runs without error.
Attempt 3: Exact Location
Now I comment out line 422 to 438,(the part where I save timeline and summary). I have checked there is no problem due to these lines.
Now if, I run merged_summary op along with rest of the training op and comment out line 418 and 419,
i.e removing the run_options and run_metadata, the training goes without error. And if I leave these two lines uncommented the Segfault comes back.

So, It seems some memory is being leaked when calculating the runtime statistics using  run_options and run_metadata when doing the full trace of the graph.
Source code / logs
Stack Trace
Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7ff2d3fff700 (LWP 138819)]
0x00007ff2b8b00d6f in ?? () from /usr/local/cuda-9.0/extras/CUPTI/lib64/libcupti.so.9.0
(gdb) backtrace
#0  0x00007ff2b8b00d6f in ?? () from /usr/local/cuda-9.0/extras/CUPTI/lib64/libcupti.so.9.0
#1  0x00007ff2b8b04fd0 in ?? () from /usr/local/cuda-9.0/extras/CUPTI/lib64/libcupti.so.9.0
#2  0x00007ff2b8d10c39 in ?? () from /usr/local/cuda-9.0/extras/CUPTI/lib64/libcupti.so.9.0
#3  0x00007ffff77fae25 in start_thread () from /lib64/libpthread.so.0
#4  0x00007ffff6e1bbad in clone () from /lib64/libc.so.6

Nagging Assignee @azaks2: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

CC @nluehr
This looks like an issue with CUPTI. Nathan, could you help us triage this issue?
Thanks in advance!

@azaks2 The bug is not related to CUPTI.
The problem is that ExecutorState caches a raw pointer to the TraceCollector here. The cached copy then outlives the owning unique_ptr created in DirectSession::RunInternal().
Either a shared_ptr should be used (if multiple TraceCollectors can coexist) or a mutex is needed to keep direction_session from destroying the TraceCollector while it is in use by ExecutorState.

I'm having the exact same problem with run_options and run_metadata on tensorflow-gpu==1.12.0 (pip), CUDA 9.0, cuDNN 7.1, CentOS Linux release 7.4.1708, Python 3.6.2.

@nluehr  thanks for debugging this. I see your point that things are horribly broken when there are concurrent RunInternal() calls. However, with one RunInternal() call things should work since RunInternal() waits for all executors to finish.
@BigBang0072 do you have concurrent session runs?

Not sure I see synchronization of runners in RunInternal.
In TF 1.12 I add two prints: one of (traceing::TraceCollector*)this in ~DeviceTracerImpl() after https://github.com/tensorflow/tensorflow/blob/v1.12.0/tensorflow/core/platform/default/device_tracer.cc#L400 and the second of trace_collector after https://github.com/tensorflow/tensorflow/blob/v1.12.0/tensorflow/core/common_runtime/executor.cc#L1578.
Then I run train_multi_gpu.py provided above and the following output is generated before triggering a SEGFAULT at https://github.com/grasseau/HAhRD/blob/master/GSOC18/train_multi_gpu.py#L443-L447.
Using trace_collector=0x12d87c380 at tensorflow/core/common_runtime/executor.cc:1585
Using trace_collector=0x12d87c380 at tensorflow/core/common_runtime/executor.cc:1585
Using trace_collector=0x12d87c380 at tensorflow/core/common_runtime/executor.cc:1585
Using trace_collector=0x12d87c380 at tensorflow/core/common_runtime/executor.cc:1585
Using trace_collector=0x12d87c380 at tensorflow/core/common_runtime/executor.cc:1585
Using trace_collector=0x12d87c380 at tensorflow/core/common_runtime/executor.cc:1585
Destroying DeviceTracerImpl=0x12d87c380 at tensorflow/core/platform/default/device_tracer.cc:404
Using trace_collector=0x12d87c380 at tensorflow/core/common_runtime/executor.cc:1585
Using trace_collector=0x12d87c380 at tensorflow/core/common_runtime/executor.cc:1585
Using trace_collector=0x12d87c380 at tensorflow/core/common_runtime/executor.cc:1585
Using trace_collector=0x12d87c380 at tensorflow/core/common_runtime/executor.cc:1585
Using trace_collector=0x12d87c380 at tensorflow/core/common_runtime/executor.cc:1585
Using trace_collector=0x12d87c380 at tensorflow/core/common_runtime/executor.cc:1585
Using trace_collector=0x12d87c380 at tensorflow/core/common_runtime/executor.cc:1585
Using trace_collector=0x12d87c380 at tensorflow/core/common_runtime/executor.cc:1585
Using trace_collector=0x12d87c380 at tensorflow/core/common_runtime/executor.cc:1585

So the destructor seems to be called before the executor has completed.

@azaks2 No, I just initiate one session while training.
You can see this here:
https://github.com/grasseau/HAhRD/blob/7eacc002672da28a1f53015227497469eb2af69d/GSOC18/train_multi_gpu.py#L368

I was able to reproduce the problem and have a fix. The problem was the data pipeline running concurrently with the training steps.

Thanks for all your time.
But we have to run the data pipeline concurrently with the training. Otherwise, it will critically slow down our performance. Also, how is data pipeline affecting the tracing of the tensorflow graph?
Maybe I am missing something. Could you please elaborate on what you have found?
Thanks again for your help and time.

Nagging Assignee @azaks2: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

I just fixed the lifetime of internal profiling related objects so they do not get GCed at the end of session.run

I'm encountering a really similar issue with multi gpu (replicate_model_fn) training and a parallel data pipeline. Several hours into the training loop, and with no warning/error message, we get a segmentation fault from tf, and the training halts. Is this a known issue and if so, is it solved in a newer release?

Dont log metadata for now, or log it very infrequently (mostly when you want to debug).
I dont know about the newer release, but this will temporarily fix the problem.


angularRequireDependencyOrder only catching once

angularRequireDependencyOrder is only catching the first violator when using ui-router resolve blocks.
The following structure:
$stateProvider
  .state('a', {
    resolve: {
      func: function (a, b, c, d, $http) {}
    }
  })
  .state('b', {
    resolve: {
      func: function (foo, bar, baz, $q, $stateParams) {}
    }
  })

Would result in jscs-angular throwing;

Angular dependency $q (or $stateParams) should be defined before baz at app/assets/boot.js :

The $http violator would not be caught.

Thank you, will look into it!

Thank you @kasperlewau. This issue has been fixed and released as v1.1.0. Please report back if it works as intended.

:heart:


self proxying with docker

Opening more ports on reproxy container leads to voluntary proxying additional routes to  himself on this ports 👎
version: '3.3'
services:
  reproxy:
    image: umputun/reproxy:master
    container_name: reproxy
    ports:
      - "80:8080"
      - "443:443"
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock
    environment:
      - LISTEN=<IP_ADDRESS>:8080
      - DOCKER_ENABLED=true
      - DEBUG=true

Shows this in logs (look at the port 🤷
reproxy    | 2021/04/11 01:07:22.156 [INFO]  {discovery/discovery.go:73 discovery.(*Service).Run} match for docker: * ^/api/reproxy/(.*) http://<IP_ADDRESS>:443/$1

This is an interesting one. After considering some heuristic to detect reproxy container from within the container itself (a surprisingly tricky thing to do) I picked a more explicit solution - added a label reproxy.enabled and set it to false in reproxy dockerfile. In addition to this particular problem, it gives users more control without overcomplicating the code and the configuration.
This is the commit https://github.com/umputun/reproxy/commit/9462170cd13cf6564117ad9626554080766a4990, pls take a look

👍 WFM


Vijcheru scan grafano promo handler

Description

This PR fixes #770
Notes to reviewers:
Signed-off-by: Vijay<EMAIL_ADDRESS>Checklist

[] DCO signed.
[] Title of the PR starts with area name, e.g. meshery:, mesheryctl:, ui:.

See #805


add owners

/assign @KevinFCormier

@ldpliu This repository is not Prow-enabled, so the OWNERS file is not really serving any purpose at the moment. Are you looking to contribute something? (There is more focus on implementing new features in https://github.com/open-cluster-management/cm-cli currently.)

@ldpliu This repository is not Prow-enabled, so the OWNERS file is not really serving any purpose at the moment. Are you looking to contribute something? (There is more focus on implementing new features in https://github.com/open-cluster-management/cm-cli currently.)

OK, thank you.
We are just working on CLC repo skill transfer, so assign each member some repos, and we need to add us to owners file.
https://docs.google.com/spreadsheets/d/1oh204BdZdtzU7_MZ7mGsFidQXrpN3befZMvpLbXf2Lg/edit#gid=0

@ldpliu Thanks. This repo isn't really part of CLC. It's a CLI I created to help teams coordinate their usage of ClusterPools for cost management.

@ldpliu Thanks. This repo isn't really part of CLC. It's a CLI I created to help teams coordinate their usage of ClusterPools for cost management.

ok, thank you


Fixes the issue of displaying success message  even after switching to other settings.

Fixes the issue of displaying success message  even after switching to other settings on Org settings > Users.
The commit removes the old method of showing success message
("Updated Successfully").The new message shows "saving" along
with a spiral ,which then turns into a "saved" and then disappears.
This is implememnted by using the method 'settings_ui.do_settings_change()'
instead of direct 'ui_report'.
Fixes: #11177

https://github.com/zulip/zulip/issues/11177
Testing Plan:
Manually through browser.
GIFs or Screenshots:

#11208 PR has broke the real-time sync users page I guess, I've asked @pragatiagrawal31 to fix them rather than creating a new issue for that.
Also it would be great if we could make update_view_on_* general for users and bots table rather than hard-coding them for bot case.


Use Socket.IO for message transport

All Submissions:

[x] Have you followed the guidelines stated in CONTRIBUTING.md file?
[x] Have you checked to ensure there aren't any other open Pull Requests for the desired changed?

Type of change
Please delete options that are not relevant.

[x] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)

New Feature Submission:

[x] Does your submission pass the tests?
[x] Have you linted your code locally prior to submission?

Description
A rework of the websocket implementation in Pynecone.
Benefits

Socket.IO is a modern socket library used by major companies
Starts connections using long polling (http/https) and upgrades to websocket as a fallback if websockets are blocked for some reason
It fixes the issues with Safari iOS and mobile devices (more testing needed for edge cases), potentially closes #258
Allows for seamless connections even when WiFi connection is lost and device switches to data
Removes need for reconnections on focus fix, which closes #424
Works on Brave browser which closes #423
It is now theoretically possible to make websockets optional as a config option, as in #287, without separate code paths
Because this PR uses AsyncServer, it will be easier to implement implement server side / async events in the future
It is easy to create events which are emitted to all users, or groups of users ("rooms"), making it possible to build chat apps or even a Discord clone in Pynecone in the future
Requires no change in server setup to deploy, the default /socket.io endpoint has been replaced with the usual /event endpoint

I've tested this PR locally and on a production server.

Also, can you update the pynecone/.templates/web/pcversion.txt file to v0.1.15 - then it will let people know they have to pc init again

Thanks for the feedback. Please see the latest commits and let me know if there's anything else!

Magnifique, you're the boss @advo-kat
I can confirm it completely fixes the linked issue
You rock !


[7.0] Export Selected Rows Datatables Service Provider

Export the selected rows exports all of the rows not only selected ones
i would like to select a few rows and export the selected rows over i have implemented the select js and it seems to be working as it tells me howmany rows are selected etc. however when i go and export the data it exports everything even after adding the selected modifier in the code
Code snippet of problem
 'buttons' => [
                            'extend' => 'print',
                            'exportOptions' => [
                                'modifier'=> [

                                    'selected' => true
                                ]

                            ], 'print'

System details

Operating System  ubuntu
PHP Version 7.0
Laravel Version 5.3
Laravel-Datatables Version 6.0

@prolonginc export selected is not yet supported by the package. You may need to write your own export handler for this atm. Thanks!

Did this ever get implemented? Or are there any known workarounds?


Base Env test cases

Description:
Adds new test cases for the base_env class's functions.
Functions Tested:

InstanceObject(), ClearScene(), and LoadSceneAsync() are tested by test_save_and_load(). I guess this also technically tests PreLoadAssetsAsync().
SendObject() and AddListenerObject() are tested by test_object_listener()
LoadURDF(), LoadCloth(), LoadMesh() are tested by test_load_objects(). To get this to pass, I needed to have the GitHub Actions run sudo apt-get install libminizip1; not sure why.

Just updated the readme to add this as a pre-install instruction!


Add percent to progress bar

Expected Behavior
Percent to accompany the progress bar for rebuses completed
...
Actual Behavior
No percent bar
...
Just thought it would be cool to add a percent to accompany the progress bar

I will add this to the application

I would like to add this feature

Seems this issue is also resolved?

Is this issue resolved?
If not I can contribute to this feature

Sure thing.
Get Outlook for Androidhttps://aka.ms/ghei36

From: Jatin Panjwani<EMAIL_ADDRESS>Sent: Saturday, August 31, 2019 9:02:21 AM
To: ollelauribostrom/rebus<EMAIL_ADDRESS>Cc: JonnyN<EMAIL_ADDRESS>Comment<EMAIL_ADDRESS>Subject: Re: [ollelauribostrom/rebus] Add percent to progress bar (#220)
Is this issue resolved?
If not I can contribute to this feature
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Follelauribostrom%2Frebus%2Fissues%2F220%3Femail_source%3Dnotifications%26email_token%3DALW3LDCPA4VZXXBIZ4QPTQTQHJ2W3A5CNFSM4G3IGCJKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD5TNK7I%23issuecomment-526833021&data=02|01||a2576a23e358418e742108d72e1bd812|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637028569424997389&sdata=%2F6RjdgIVP38fjZoHzmSal7JjlJqcuYL3pFc1W7qcHmQ%3D&reserved=0, or mute the threadhttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FALW3LDAWNHLQROQ2QQXMXV3QHJ2W3ANCNFSM4G3IGCJA&data=02|01||a2576a23e358418e742108d72e1bd812|84df9e7fe9f640afb435aaaaaaaaaaaa|1|0|637028569425007411&sdata=T9PVNQ9GcI9KkR26owpgX0DWBMqxdjFeRqt%2B7cKSf8g%3D&reserved=0.

Hi guys, I´m interested, can I help?

Hey, seems like this issue has not been resolved yet. Can I work on it?


Collections that have a required license set as 'no license' should have that setting migrated.

After reviewing all the migrated collections and their settings, I discovered that in all cases, collections that had selected a required license and that required license is set to "no license" did not have the "no license" option migrated. This results in all of these collections missing the required license assignment.

Related to #1252

@jcoyne thanks for pointing this out. We appear not to have accounted for this Hydrus option. I'll talk with @hannahfrost about the best way to deal with these, but they are generating a problem in H2. Back to you soon, hopefully, with a solution.

@amyehodge This sounds right to me.  Also, I never noticed that Hydrus has two ways of requiring no license. Does H2?

@hannahfrost No, it doesn't. We removed the plain "no license" check box in H2.


UVI Request

--- UVI JSON ---
{
  "vendor_name": "Linux",
  "product_name": "Kernel",
  "product_version": "versions from  to before v5.4.129",
  "vulnerability_type": "unspecified",
  "affected_component": "unspecified",
  "attack_vector": "unspecified",
  "impact": "unspecified",
  "credit": "",
  "references": [
    "https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/commit/?id=3d995587c3ea335ad828b24592c89fdee013815f"
  ],
  "extended_references": [
    {
      "type": "commit",
      "value": "3d995587c3ea335ad828b24592c89fdee013815f",
      "note": "fixed"
    }
  ],
  "reporter": "joshbressers",
  "reporter_id": 1692786,
  "notes": "",
  "description": "dmaengine: mediatek: free the proper desc in desc_free handler\n\nThis is an automated ID intended to aid in discovery of potential security vulnerabilities. The actual impact and attack plausibility have not yet been proven.\nThis ID is fixed in Linux Kernel version v5.4.129 by commit 3d995587c3ea335ad828b24592c89fdee013815f. For more details please see the references link."
}
--- UVI JSON ---

This issue has been assigned UVI-2021-1001117


Add support for stylelint 6.3.x

Add support for new stylelint rules.

How about updating this straight to 6.5.X?


[feat] Add support for UPC language and launchers

testing functionality of UPC and UPC++ code requires reframe to know how to compile and run UPC code. This PR adds those features

Can I test this patch?

Codecov Report

Merging #1333 into master will increase coverage by 0.01%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master    #1333      +/-   ##
==========================================
+ Coverage   91.73%   91.74%   +0.01%
==========================================
  Files          83       83
  Lines       12486    12526      +40
==========================================
+ Hits        11454    11492      +38
- Misses       1032     1034       +2

Impacted Files
Coverage Δ

reframe/core/buildsystems.py
96.75% <100.00%> (ø)

reframe/core/launchers/mpi.py
98.92% <100.00%> (+0.29%)
:arrow_up:

unittests/test_launchers.py
94.93% <100.00%> (+0.73%)
:arrow_up:

reframe/core/pipeline.py
92.84% <0.00%> (-0.38%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e32463d...3710190. Read the comment docs.

@sleak-lbl We will also need an entry about these launchers in documentation here.

@sleak-lbl I think something got wrong with your updating this PR. It seems that you merged with your own modified master and pushed here.

I forced push to this PR and fixed the commits. It seems that you have rebased locally over master and then you pushed here doing essentially a merge.

@jenkins-cscs test this please

oops, I was trying to rebase to the eth-cscs master, must have used the wrong one .. thanks for fixing


USHIFT-732: forbid IP addresses as hostname

Which issue(s) this PR addresses:

Closes USHIFT-732

/retest
/lgtm

/lgtm

/lgtm


Fix iproute2 invocations including variables.

Description of changes
When using iproute2's ip binary, you can omit the dev parameter, e.g. ip link set up eth0 instead of ip link set up dev eth0.
This breaks if for some reason your device is named e.g. he, hel, … because it is interpreted as ip link set up help.
I just encountered this bug using networking.bridges trying to create an interface named he.
I used a grep on nixpkgs to try to find iproute2 invocations using variables without the dev keyword, and found a few, and fixed them by providing the dev keyword.
I merely fixed what I found, but the use of abbreviated commands makes it a bit hard to be sure everything has been found (e.g. ip l set … up instead of ip link set … up).

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Seems reasonable to me :)

is this related to error: getting status of '/nix/store/fijy0dlyk5b06ay7nxg88lr7bp13hpjb-iproute2-6.5.0/etc': No such file or directory? here's full stack trace https://gist.github.com/quinn-dougherty/bcd19ac1fbd3a17047f6410f829b3350 and here's the flake.lock https://github.com/quinn-dougherty/declare/blob/da8927c53b83d6bdbf7203f6d614e81ac35d6850/flake.lock#L819C5-L827C9 (nix flake update just a second ago tonight)


Add NameTextBox above MainTextBox

I made it so text in JL window matches exactly with the text in the game window, so I can put it on top of game text and read with my mouse.
This is how it looks like right now:

It's a bit jank right now. And of course it doesn't see when text in game is drawn bigger or smaller than usual.
I added new preferences in Preferences->Main Window, on the very bottom, "Show Button 1", "Show Button 2", "Show Button 3". Third button is "H" button, and it "Hides" both most of the window and text. Popup still works though.
There is also Preferences->NameTextBox now, this is where you can enable NameTextBox.
BUGS:
*) Names don't get preserved in history.
*) Preferences->NameTextBox->Use NameTextBox keeps getting unchecked every time settings are opened.
*) Context menu doesn't work if you click on NameTextBox instead of MainTextBox.
*) Popup doesn't disappear if you move mouse from MainTextBox to NameTextBox. Move mouse down when you done reading.

Can you describe what you are trying to achieve here in detail?
If you want to separate game text from the character name with a new line, you can do that with regex, see https://github.com/rampaa/JL/blob/master/Docs/Regex Replacement.md4
If you want JL main window to have dynamic height but want it to have a fixed bottom position, that will also be possible in the next version of JL, see https://github.com/rampaa/JL/commit/7168db40ca3e5967cbc21228a758bba136772e66.
In general, discussing what you want before creating a PR might be a good idea.

I noticed that I am required to have two different text areas right now, that both contain mostly same text, and tried to make it so I only have one.

Enable Preferences->Main Window->Text only visible on unhover
Enable Preferences->Main Window->Change opacity on unhover
Change Preferences->Main Window->Opacity on unhover to 0.2
Enable Preferences->Main Window->Hide all buttons when mouse is not over the title bar

This ought to be the most pragmatic solution to your problem. I.e., making JL's main window completely invisible unless you hover over it with your mouse. This way you won't have to suffer seeing two text boxes with the same text.

I'm not sure if just regex will be good enough for the game I'm playing,

I think you could use regex to omit the name and the initial「 character, and just place the main window accordingly. Though if the game you are playing changes the offset when it's a narration, I guess this wouldn't work. Either way, this solution is way too specific to this game and I don't want to incorporate any game-specific hacks like this to just make text alignment better. I don't even have a way of allowing users to change the kerning, so it's a given that JL will not be able to align with the game text unless the stars align. I suggest enabling the abovementioned preferences and being done with it.


Video setup tutorial

Already recorded, but need to find a way to fit into the app

Posted in Facebook Page


refactored documentation

fixed wrong explanation (#6454)
fixed wrong explanation Its first argument is assumed to be the minibatch dimension. -> Its first axis is assumed to be the minibatch dimension.
moved explanation of broadcasting to note directive.

Good improvement. Jenkins, test this please.

Jenkins CI test (for commit 7186bc4748078ca99667f54380a4992501dcc315, target branch master) failed with status FAILURE.
(For contributors, please wait until the reviewer confirms the details of the error.)

Jenkins CI test (for commit 7186bc4748078ca99667f54380a4992501dcc315, target branch master) failed with status FAILURE.
(For contributors, please wait until the reviewer confirms the details of the error.)


Adds Azure DevOps task extension for NLU.DevOps commands

Adds extension to install dotnet-nlu and run the train, test, and clean commands in single, independent tasks.

Add unit tests!

/azp run

/azp run

/azp run


Put Prometheus install first before Collect Metrics.

As the Collect Metrics topics depend on Prometheus install, so
we need to have the Prometheus install topic first.

Jenkins job istio.github.io/presubmit passed

That’s the reason I put Prometheus install as an explicit step in collect metrics. It does not make sense for an end user to see how to query metrics before actually collecting them.

Yes, fair enough, will close this one. thanks @rshriram


NS_ERROR_FAILURE when trying to open a PDF file

Link to PDF file (or attach file here):
pdfjs_issue.pdf
Configuration:

Web browser and its version: Firefox 52.0.2 (32-bit), Chrome  57.0.2987.133
Operating system and its version: Windows 10 Pro 64-bit Version 1067 (OS Build 14393.953)
PDF.js version: 1.8.177
Is an extension: No

Steps to reproduce the problem:

Try to open the attached pdf file using the viewer demo "https://mozilla.github.io/pdf.js/web/viewer.html"
It will not open, on FireFox you will get error in console "NS_ERROR_FAILURE"
Also i tried to open it using plain PDFJS api's and get the same error.

What is the expected behavior? (add screenshot)
The file to open correctly, (or at least an error returned to the error callback)
What went wrong? (add screenshot)
The file will not open and the error callback will not be triggered.
Link to a viewer (if hosted on a site other than mozilla.github.io/pdf.js or as Firefox/Chrome extension):
https://mozilla.github.io/pdf.js/web/viewer.html

Closing as duplicate of issue #6741.

i have opened the file with illustrator and removed the png image then added it again then saved.
i tried the new file and it is working (pdfjs_issue_comp.pdf), so i don't think the issue is related to huge images in pdf.

[...] so I don't think the issue is related to huge images in pdf.

Unfortunately this conclusion is incorrect, since in the broken PDF file the image is two orders of magnitude larger than the image in the working PDF file.
Please compare the Width/Height of the images in the two PDF files, using the screen-shot below, and you'll see the difference:

I am sorry, you are right.
it would be great if pdfjs return error for such files in order to handle fallback.


CAMEL-11892 - breadcrumbId class cast failure if other than SAAJ used…

… as WebServiceMessage impl

Closed #2028 via https://github.com/apache/camel/commit/ece63d7c9292fc16eb469f3713b905045ab33149


Unable to cancel

Downloading works fine but when passing the downloadId returned by PRDownloader.download and attempting to cancel the download request using
PRDownloader.cancel(downloadId);
i get the following
java.lang.NullPointerException: Attempt to invoke virtual method 'boolean java.lang.Object.equals(java.lang.Object)' on a null object reference
at com.downloader.internal.DownloadRequestQueue.cancel(DownloadRequestQueue.java:100)
at com.downloader.PRDownloader.cancel(PRDownloader.java:109)
works with tags but not with request ids

Can you share some code? I couldn't get canceling via tag working, I can't use downloadId because I issue a notification on progress bar that will have a button and I can't put a variable there


Android release bundle fails at :app:mergeReleaseAssets

Expected Behaviour
Android release bundle is successful
Actual Behaviour
Build fails at step :app:mergeReleaseAssets - this worked a month ago, and none of the app dependencies have changed.
Reproduce Scenario (including but not limited to)
Steps to Reproduce
Platform and Version
    "react-native": "0.64.1",
    "@adobe/react-native-acpanalytics": "^1.1.6",
    "@adobe/react-native-acpcore": "^1.2.5",
    "@adobe/react-native-acpuserprofile": "^1.1.0"

Sample Code that illustrates the problem
Logs taken while reproducing problem
FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':app:mergeReleaseAssets'.
> Could not resolve all files for configuration ':app:releaseRuntimeClasspath'.
   > Could not find :unspecified:.
     Required by:
         project :app > com.adobe.marketing.mobile:analytics:1.2.7

Apologies for the lack of reproducible code, I'm not really sure what would be valid to include...

Hi @gingerbenw, there was an issue present in the android analytics 1.2.7 release which was resolved in the android analytics 1.2.8 release. There have been issues with fetching the latest 1.2.8 release from maven though. Can you try updating your maven repository and android analytics version as described in https://experienceleaguecommunities.adobe.com/t5/adobe-experience-platform-sdks/how-to-i-update-sdk-to-android-analytics-1-2-8/m-p/417203/highlight/true#M242? Hopefully this resolves your issue.

Hi @rymorale, thanks for the quick response, that appears to have done the trick, thankyou!
For clarity: I added mavenCentral() to the repositories list at the bottom of android/build.gradle

Thanks for the update. Closed this issue as it has been resolved.


[Bug]: Unable to upgrade to tcp, received 404

Is there an existing issue for the same bug?

[X] I have checked the troubleshooting document at https://opendevin.github.io/OpenDevin/modules/usage/troubleshooting
[X] I have checked the existing issues.

Describe the bug
Unable to upgrade to tcp, received 404
Current Version
I use 0.5.0

Installation and Configuration
export WORKSPACE_BASE=$(pwd)/workspace;

 docker run \
    --pull=always \
    -e SANDBOX_USER_ID=$(id -u) \
    -e WORKSPACE_MOUNT_PATH=$WORKSPACE_BASE \
    -v $WORKSPACE_BASE:/opt/workspace_base \
    -v /var/run/docker.sock:/var/run/docker.sock \
    -p 3000:3000 \
    --add-host host.docker.internal=host-gateway \
    ghcr.io/opendevin/opendevin:0.5
0.5: Pulling from opendevin/opendevin

Model and Agent
No response
Reproduction Steps
Pull the lastest commits from the repo.
Set the workspace.
Run the Docker command abovce.
Logs, Errors, Screenshots, and Additional Context
Digest: sha256:7f17489e68873cdfe06b90d7cab902bf58fcd246a8f298c7b751ac191a3e8bc3
Status: Downloaded newer image for ghcr.io/opendevin/opendevin:0.5
unable to upgrade to tcp, received 404
pierruno@Pierruno:/mnt/c/Users/pierr/OpenDevin$

@PierrunoYT this seems like an issue with your docker daemon, not OpenDevin. You might want to try a restart


Training code

Would you mind sharing the SNAC training code? :)

You can refer to our reproduction at https://github.com/hertz-pj/SNAC-Vocos


Get dataset of solar zenith angle

@jklenzing Do you have code that can calclulate solar zenith angle?

https://geospacepy-lite.readthedocs.io/en/stable/sun.html
I think geospacepy.sun.solar_zenith_angle will work.  Need to test this out.


feat(analytics-sku): remove feature flag mentions [MA-3136]

Summary

Resources

Creating a package docs

@adorack updated.

Skipped a test in MetricsProvider.cy.ts that can probably be removed (?)
Skipped a test in DashboardRenderer.cy.ts which runs fine on its own, but fails when run in sequence:

it.only

vs run as part of full suite:


Upgrade trumbowyg to 2.27.3, support ActiveAdmin 3.2.x

Thanks for your PR @romanbsd
I prefer to have separate PRs for the different kind of changes.
In anycase, I'll need to take care of the CI first - which is outdated at the moment.

You PR is appreciated but I had to create a new PR to upgrade the supported ActiveAdmin versions in order to fix some outdated configurations (mainly regarding the CI and the test suite).
While for the Trumbowyg update to 2.27.3 I'll need to make some extra check because I saw that the editor changed quite a bit.

No worries. Just ping me here if you find some issues with 2.27.3.


Add Basque (eu) translation

Hi,
it would be great if you could include it in your next release.
Best regards

Thanks!
I'll release it in a few minutes.

Great! Thanks!


Update MD file on new branch 2017-11-25_15-31-37

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

split/updateTestRef1.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


WordPress function get_avatar_url() returns the default WP user avatar and not the auth0 avatar

Describe the problem
Native WordPress functions that get the user avatar, such as get_avatar_url() don't return the auth0 avatar.
What was the expected behavior?
get_avatar_url() should return the auth0 avatar.
Reproduction
Call <img src="<?php echo get_avatar_url(); ?> > in any WP template file.
Install WP Auth0.
Create new user.
Log in with e.g Azure AD.
Auth0 avatars can be seen on the "Users" admin page of the WordPress dashboard, but get_avatar_url() still shows the default WP user avatar.
Environment

Version of this library used: Latest
Which framework are you using, if applicable: _s WordPress theme
Other modules/plugins/libraries that might be involved: -
Any other relevant information you think would be useful: -

Hi @Simon-ProjectPartners 👋 Have you enabled the Auth0 configuration option to override avatars?

Hi @evansims 👋
Thanks for getting back to me. Yes, I did.
Ohh I see, will try my luck with get_avatar(). Thanks!


Emphasize what image is supported

Before:
- `v1.12.0-debian-azureblob-1.1,v1.12-debian-azureblob-1` [docker-image/v1.12/debian-azureblob/Dockerfile](docker-image/v1.12/debian-azureblob/Dockerfile)

After:
- `Azureblob` [Dockerfile](docker-image/v1.12/debian-azureblob/Dockerfile)
  - `docker pull fluent/fluentd-kubernetes-daemonset:v1.12.0-debian-azureblob-1.1`
  - `docker pull fluent/fluentd-kubernetes-daemonset:v1.12-debian-azureblob-1`

Thus, it makes easy to pull image (copy&past)

@kenhys Could you rebase off master? It seems that this notation change is useful for us.

I've rebased && make README.md again.


adds typescript types and command to generate them

Related Issue
Unable to correctly type the module when used in a typescript project.
Proposed Changes

Adds generated typescript types using declaration files.
Adds a command to generate said types accordingly.

Additional Info
-

Thank you for your contribution.
Could you please fix those places where the request method is being called with params argument it should be renamed to parameters

Hi Viktor,
I renamed params to parameters in all the places where they are used.


Fix createStringForKey segmentation fault on Mac OS for non-Latin languages

Segmantation Fault occurs if it is non-latin input source on MacOS.
I fixed this issue by changing from
TISCopyCurrentASCIICapableKeyboardInputSource

to
TISCopyCurrentKeyboardLayoutInputSource

in createStringForKey function.
Tested with 2-set Korean, 3-set Korean  and Simple Telex
Refer to this link
https://discussions.apple.com/thread/250732490#251392420022

This project appears to be unmaintained, see https://github.com/octalmage/robotjs/pull/622


How can I tune the parameter to modify my own imu data?

I used cartographer to build my map using 3d lidar data and imu data.
Because of some reasons, my trajectory keep climbing while the programme run, but the real environment has little difference in Z direction. And I think my imu is not that reliable, how can I change the parameter to make the trajectory on the same level plane?
Here is the constraint_list shown in my rviz:

And here is my configuration file:
configuration.zip
One way I think may work is tuning the rotation_weight in ceres_scan_matcher, but I am not sure.

From the Cartographer ROS issue template:

It would help us tremendously if you provide the following so that we can easily
reproduce your issue:

A link to a Git repository containing a branch of cartographer_ros
containing all the configuration, launch, and URDF files required to
reproduce your issue.
A link to a bag file we can use to reproduce your issue.

That said, if the trajectory keeps climbing, the gravity estimation is probably not working well.

Most likely cause is bad calibration of the relative orientation between IMU and LIDAR in the URDF. #361 is trying to help in this situation. Assuming the URDF is good enough to allow for loop closures to be detected, you can move along some path and the trajectory will climb due to the error in calibration. Now you turn by 180 degrees and move forward again back to where you started. Assuming loop closures are detected, the optimization problem can now compute a correction of the IMU orientation.

You can of course also try to tune the Ceres scan matcher and imu_gravity_time_constant, but unless your submaps look distorted, I think this is less likely to be an issue. You might want to have a look at acceleration_weight and rotation_weight in the optimization_problem which are the weights given to IMU data in the pose graph optimization.

Thanks for your reply.
You remind me of my configuration of my urdf, actually I can not get the real orientation of my imu and my lidar, so I just use the estimation of my own. Now I m trying to tune the parameter to make the map run well.
If I have further problem, I will upload my bagfile, because the bagfile is too big...
Thanks again.

And here is one more question for the task I'm working on : Can cartographer work well in an outdoor and complex environment especially using 3D Lidar as the main sensor?
Please let me know if there exists a way to modify the algorithm to make it work in a more complicate environment. I tried some outdoor data I got and I can hardly get a satisfied result.
Thanks very much~ @wohe  @SirVer

Cartographer is known to work very well outdoors. Complex environments are much more favorable than simple repetitive ones. I suspect your performance issues are related to sensor configuration (e.g. URDF) and tuning.
If you need assistance tuning, please follow the instructions in the issue template (mentioned by @wohe above) and we will try to help you as soon as time allows.

I m glad to hear u say so! And I m not sure if I can upload my bagfile because it is too big (5G even after compressed), the bag lasts for about 20 minutes and the first half looks ok, but after a cross the trajectory begin to drift and the programme seems to stop and lasts for hours without optimization.
Here is my configuration, and I just run the demo_test.launch file.
cartographer_ros.zip
Because my bagfile can provide /tf and /tf_static, so I delete the ros_state_publisher node.

And here is the problem, I just show the constraints lists because the trajectory can be hardly seen.
By the way, do u know how to upload a huge bagfile ?
Thanks very much! @damonkohler

You can host your bag file anyway you like (e.g. Google Drive or Dropbox). Sharing your GitHub fork with the configurations and launch files checked also makes it much easier for us to investigate your issue.

I finally upload my bagfile through google drive! Thanks very much! But there are some errors in my github, so I first give the link of my bagfile : https://drive.google.com/open?id=0B-HHtJ5SoiGgX1lmT2Q3bHlfYm8
And my configuration file has uploaded as .zip above, maybe I need a little time to fix my rep.
Thanks very much.

Sorry for loss of command!
I just run the 'demo_test.launch' file for my project! And other files are my test file!

Looking at your bag, I noticed two things:

It crashed because your IMU is not aligned with your tracking frame. Did you disable that check? If so, that's at least part of your problem. Change the tracking frame to be your IMU. You can continue publishing map <- base_link if you like. That's a separate concern.
Once I fixed that issue, it appears that your IMU to LIDAR alignment is off. The car (I guess it's a car?) is always climbing a bit. You should improve quality by calibrating the alignment between the IMU and the LIDAR.

Yes, because when I ran the bagfile, cartographer warned that the disitance between the imu and Lidar will make the result imprecise. So I just change the threshold to make the programme run.
if (sensor_to_tracking != nullptr) {
CHECK(sensor_to_tracking->translation().norm() < 1)
<< "The IMU frame must be colocated with the tracking frame. "
"Transforming linear acceleration into the tracking frame will "
"otherwise be imprecise.";
trajectory_builder_->AddImuData(
sensor_id, time,
sensor_to_tracking->rotation() * ToEigen(msg->linear_acceleration),
sensor_to_tracking->rotation() * ToEigen(msg->angular_velocity));
}
I changed the threshold to 1 in the sensor_bridge.cc . Sorry for forgetting to metion that issue.
And once I finished my bagfile, I wait for the final optimization for several hours but I can not get the result. Do you know why? And can you show your result of my data? Thanks a lot~
One question is that the IMU and Lidar need to be so closed? I check the threshold to be 1e-5, which I think is not easy to gurantee.
Thanks for your suggestion and I will try to calib my IMU and LIDAR to get a better result.
Further question may be asked because I m trying to use and learn this amazing SLAM algorithm!

Hi all,
I am trying to calibrate the IMU, and am able to have cartographer output the "IMU correction" message to give me the quaternion value. However, I am having trouble figuring out how to use this number in my urdf to correct my IMU. Specifically, I am not even sure if the quaternion pertains to the tf from IMU to lidar or from lidar to IMU. Perhaps more description on what the quaternion value means in respect to IMU would do.
Thanks in advance,
Dennis

Have a look at this line to see how IMU data is  transformed from the IMU to the tracking frame:
https://github.com/googlecartographer/cartographer_ros/blob/c0e713c404d3087cec3dbe07e35bd162ce802dc0/cartographer_ros/cartographer_ros/sensor_bridge.cc#L130
The IMU orientation quaternion would be a single additional multiplication from the left (i.e. `correction * sensor_to_tracking->rotation() * imu data).
You can check that you edited your URDF correctly if sensor_to_tracking_edited_urdf->rotation() == correction * sensor_to_tracking_original_urdf->rotation().

@ojura Thanks! I got the IMU to be calibrated and checked with this. However, now Cartographer will still "correct" my correct IMU during mapping. I've set POSE_GRAPH.optimize_every_n_nodes = 0 and Cartographer still performs optimization and correct my IMU. Please see this video for how cartographer is "correcting" the IMU.

Yeah, I got that as well. Seems like Cartographer's corrention quaternion doesn't  fully converge (i.e. re-running complete SLAM again with the corrections from previous iterations) - Cartographer always outputs a quaternion which is a rotation of about half a degree for me.

Thanks @ojura, if there's anything I can help you with the investigation, please let me know. I will be more than happy to help. Thanks!

Good to hear! What is the magnitude of the new correction after you apply the previously outputted one in the urdf?

@ojura, yeah! I got the IMU correction to be under the magnitude of 1 degree. And I did this by collecting a rosbag with a very small loop, and controlling the global matcher to only optimize at the location where the loop closes. After 2 or 3 times of obtaining and applying the IMU correction this way, the IMU correction was cut to under 1 degree.

@ludennis Thank you for looking into this!  I have been trying to figure out how to basically do exactly the same thing (reduce the IMU correction to zero).  However, I cannot seem to figure out what to apply that quaternion to.  How did you apply that quaternion in your urdf?  Is it the base_link to imu, imu to tracking_frame or something else?  This never really got resolved.
Thanks so much!

@Sanderi44,
Here's a snippet of my .urdf file:

<parent link="base_link"/>
<child link="tracking_imu"/>
<origin rpy="0.0189490484320089 -0.05259479494750925 0.07871776509703358" xyz="0 0 0"/>

<parent link="tracking_imu"/>
<child link="base_imu"/>
<origin rpy="0 0 0" xyz="0 0 0"/>

<parent link="base_link"/>
<child link="velodyne"/>
<origin rpy="-0.05 0.20 0.0" xyz="-0.02 0.05 1.20"/>

Here are the steps I took:

Recorded a bag file that has a small loop-closure with topics /velodyne_points and /data/imu,
Measured the distance between lidar (velodyne) and imu, and recorded the xyz difference in the .urdf file (If you, like me, have added a base_link, then you would need to find out the distance between base_link and imu and then base_link and velodyne,
Set POSE_GRAPH.optimization_problem.log_solver_summary = true in my .lua file,
Ran [offline_mapping_node_name].launch | grep IMU,
Adjust POSE_GRAPH.optimize_every_n_nodes so that IMU correction only happen once at the loop-closure,
Recorded the quaternion of IMU correction,
Used tf.transformations in python's interactive mode (python then import tf.transformations) to convert quaternion of IMU correction to RPY (roll, pitch, yaw),
Recorded the RPY in the .urdf file,
Ran [offline_mapping_node_name].launch | grep IMU, again,
Recorded the quaternion of IMU correction,
Applied new quaternion to the previous one with tf.transformations.quaternion_multiply([first_quaternion], [second_quaternion])
Used tf.transformations to convert quaternion to rpy
Updated the RPY in the .urdf file
Repeated steps 9)-13) until the IMU correction angel is less than 1 degree.

I personally don't think this is the best way of calibrating the imu (my colleague told me what I was doing was lidar-imu fusion. Was it?), but these were the steps I took. Didn't have to worry about these afterwards. Hope this helps. Let me know if you need anything!
Dennis

Thank you @ludennis! This is a great tutorial! Just to be clear, the new rpy values are applied to the base_link to tracking_imu joint right?

@Sanderi44 please carefully read my message from above, https://github.com/googlecartographer/cartographer/issues/440#issuecomment-417559625.
When Cartographer receives an IMU measurement, it takes the IMU sensor frame ID from the IMU message (probably imu_link for you) and obtains a transform from the IMU sensor frame to the tracking frame, which can be any frame in your tf tree (usually base_link), as long as it is colocated with your IMU frame (so no translation, but it can have an arbitrary rotation). The IMU measurements are transformed to the tracking frame in the line I highlighted in the message above.
There isn't a universal answer to your question. It depends how your tf tree looks like. For @ludennis' example, yes, it could be applied to the base_link->tracking_imu transform. Or, to tracking_imu->base_imu. You can check if you got it right by comparing transforms like I described above.

This gives me an idea. Maybe it would be useful to have an additional option in Cartographer ROS to specify that additional correction quaternion for pre-multiplying the IMU data without having to modify transforms. This would enable users to just directly copy and use the correction quaternion suggested in the solver's summary.

@Sanderi44, check out https://github.com/googlecartographer/cartographer_ros/pull/1025 (https://github.com/larics/cartographer_ros/tree/imu-correction). It should enable using the correction quaternion verbatim, without having to fiddle with the TF tree.

@ojura Thank you for the advice and for adding that commit.  Very helpful!  I will try out this solution and let you know how it goes.

@Sanderi44 have you had any luck with using the IMU correction quaternion?

@ojura Thanks for checking in.  I applied that commit to my code and did the following:

set the correction quaternion to (1,0,0,0) in the yaml
played back a dataset in which I travel in a loop, setting the pose graph to update at the end of the loop.  During this playback, the point cloud is not aligned with the ground plane until the pose graph is updated.
set the correction quaternion to the resulting IMU correction value.
played back again and the new IMU correction was still very big (> 40 deg, sometimes greater than 100 deg).

Trying it with different update rates results in the same thing.  However, the orientation of the point cloud when viewing in rviz is aligned correctly with the ground plane and the 2d projected map that it creates looks very good (i.e. walls are thin, no warping, ground plane looks aligned to horizontal map).  It seems kind of strange that it would continue to output a large IMU correction
Not sure if it is related, but the vertical accuracy of the resulting trajectory is much noisier than the horizontal accuracy.  The first image shows the horizontal trajectory versus the true trajectory.  The second shows the same time thing with the Z axis included.

40 degrees?! Ouch, something is very much off. IIRC we have observed convergence to around half a degree or less in this thread.

I agree, something is very wrong.  Also, I have some a small update to that result.  In my previous post, I had more than one submap for every pose graph update.  This time, I tried doing only one submap per pose graph update.  I was able to get the result down to 0.5 degrees, playing it back again with the new quaternion, and the same settings.  However, when I play back another dataset, with the same setup, in the same place, I once again get large IMU correction results.  If it helps, I can post my setup, rosbag validate, etc.

Feel free to post your bags and setup. I can’t promise to have a look at it in soonish, but someone else might be able to.

@ojura after much fretting, I was able to figure out what was going on.  There are two IMU's on my assembly, and I had the wrong one plugged in.  That's why it was not matching up.  Now I am able to get very low values for the IMU correction.  I am, however, still getting the same error in the vertical axis.  Do you have any hints as to how to improve that?

@Sanderi44
Even having calibrated my imu, cartographer will still need to correct my z-axis (slowly drifting up or down). I haven't found a solution to correct it. Cartographer corrects the imu, but I would still see a straight road being slightly slanted after running.
Dennis

I am trying to calibrate the IMU, and am able to have cartographer output the "IMU correction" message to give me the quaternion value. However, I am having trouble figuring out how to use this number in my urdf to correct my IMU. Specifically, I am not even sure if the quaternion pertains to the tf from IMU to lidar or from lidar to IMU, or IMU to base_link. Perhaps more description on what the quaternion value means in respect to IMU would do.

Hi, Dennis
I have the same trouble. Is it right that the quaternion only pertains to the tf from IMU to base_link? I don't think the operation could calibrate lidar and I don't know how to  calibrate lidar. Can you give me help?
Thanks in advance.


Update scala3-library to 3.5.1-RC1

About this PR
📦 Updates org.scala-lang:scala3-library from 3.5.0-RC4 to 3.5.1-RC1
📜 GitHub Release Notes - Version Diff
Usage
✅ Please merge!
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

⚙ Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scala-lang", artifactId = "scala3-library" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "30 days" },
  dependency = { groupId = "org.scala-lang", artifactId = "scala3-library" }
}]

labels: library-update, early-semver-pre-release, semver-spec-pre-release, version-scheme:semver-spec, commit-count:1

Superseded by #51.


emit on combine latest

I'm not certain how I forgot to PR this

closes #22

Codecov Report

Merging #32 into master will increase coverage by 0.05%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master      #32      +/-   ##
==========================================
+ Coverage   98.39%   98.44%   +0.05%
==========================================
  Files           5        5
  Lines         622      642      +20
==========================================
+ Hits          612      632      +20
  Misses         10       10

Impacted Files
Coverage Δ

streams/core.py
98.91% <100%> (+0.01%)
:arrow_up:

streams/tests/test_core.py
100% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update baf8f12...c4b66ce. Read the comment docs.

Thanks @CJ-Wright !


Make chartPadding work inside the axisX & axisY objects, not only globally

I've tried the following since the labels to the left of my chart are overflowing the SVG area.
axisX: {
    showLabel: true,
    showGrid: true,
    chartPadding: 20
}

...but didn't get the padding I expected. It's just a feature request... :stuck_out_tongue:
Cheers for this great framework!
Wallace

As a side-note, what I'd really like is to define padding independently, so these global values would be more convenient:
{
    chartPadding: 20, // for global padding
    chartPadding: '20px 15px 10px 5px',
    chartPaddingTop: 20,
    chartPaddingRight: 15,
    chartPaddingBottom: 10,
    chartPaddingLeft: 5
}

It would be more CSS-ish...

Hi Wallace
You are lucky and this is already supported  :-) Check http://gionkunz.github.io/chartist-js/api-documentation.html#chartistline-declaration-defaultoptions
  // Padding of the chart drawing area to the container element and labels as a number or padding object {top: 5, right: 5, bottom: 5, left: 5}
  chartPadding: {
    top: 15,
    right: 15,
    bottom: 5,
    left: 10
  }

Cheers for this Gion, liking it more and more! :sparkles:


DataSource.SetupGeneric can't actually create a new data source?

The description for this method is "Creates a new Generic Data Source." However it doesn't seem that is possible. It appears I have to use an already existing data source, pass the id of that data source to this method, then I can update the data source name, dimensions and events. If I omit the data source id, pass a null value or pass an id of a data source that doesn't exist I get a 400 error.
Is there anyway I can actually use this method to create a new data source?

The DataSources.SetupGeneric API is not available anymore according to both developer quick start guide  and the API docs


do-while loop to for loop

for example
before: do A,B,C...;while(D);
after: for(;A,B,C,...,D;);

I signed it!

I think maybe you clicked the wrong branch? This is just changing maven files.

@da0ka
This pull request is incorrect, since it's trying to merge one of our release branches into the main branch.
Please submit a new pull request.


Tames cant get tablet drops from forgotten four if your minion has /use 'd then

Title

this is fixed with https://github.com/oldschoolgg/oldschoolbot/pull/5684


remove binary index file.  It isn't used

Awesome
On Tue, Sep 22, 2015 at 11:48 AM, Ken Sipe<EMAIL_ADDRESS>wrote:

Merged #4 https://github.com/mesosphere/multiverse/pull/4.
—
Reply to this email directly or view it on GitHub
https://github.com/mesosphere/multiverse/pull/4#event-416009877.


fix(search): Add a placeholder to Search TextInput #403

Summary

Add placeholder prop to Search component
Related Issues or PRs

closes #403
How To Test
Added test to Search.test.tsx

Warnings

:warning:
This PR does not include changes to storybook, even though it affects component code.

  Generated by :no_entry_sign: dangerJS against 3db20ce85d19419d3ad8f1ef2e5c776e6552f5b4


.solhintignore not processed by plugin

Hi @juanfranblanco ,
It seems the solidity extension reads .solhint.json but it doesnt read .solhintignore ?
Could you add support for that? Would be sweet!

Hey @juanfranblanco! Was hoping for the same thing and stumbled upon this open issue. Any chance support for .solhintignore might happen?
Hope you're doing well :)


after getting the lmdb dataset, where should I put them to ?

now, I got data.mdb and lock.mdb files, but could you @bgshih tell me where should I put these two files?

look at config.lua:
...
trainSetPath     = '../data/synth90k_train_lmdb/data.mdb',
valSetPath = '../data/synth90k_val_lmdb/data.mdb',
...


MPS MisconfigurationException: Device should be MPS, got cpu instead

🐛 Bug

M1 series mac with Trainer flags accelerator and devices set to auto raises MisconfigurationException: Device should be MPS, got cpu instead.
To Reproduce
please see core.trainer.py of associated project.

model is set to BoringModel at ln 48, and the datamodule has been removed from trainer.fit at ln 104. additional trainer flags are set in core.trainer.yaml

Expected behavior

accelerator set to auto on M1 series Mac defaults to correct device.
Environment

CUDA:

GPU:
available:         False
version:           None

Packages:

lightning:         2022.8.2
lightning_app:     0.5.4
numpy:             1.23.1
pyTorch_debug:     False
pyTorch_version:   1.12.1
pytorch-lightning: 1.7.0
tqdm:              4.64.0

System:

OS:                Darwin
architecture:

64bit

processor:         arm
python:            3.9.13
version:           Darwin Kernel Version 21.6.0: Sat Jun 18 17:07:22 PDT 2022; root:xnu-8020.140.41~1/RELEASE_ARM64_T6000

Additional context

traceback:
Global seed set to 42
GPU available: True (mps), used: True
TPU available: False, using: 0 TPU cores
IPU available: False, using: 0 IPUs
HPU available: False, using: 0 HPUs
`Trainer(limit_train_batches=1.0)` was configured so 100% of the batches per epoch will be used..
Error executing job with overrides: []
Traceback (most recent call last):
  File "/Users/justin/Developer/lightning/lightning-pod/lightning_pod/core/trainer.py", line 103, in main
    trainer.fit(model=model, datamodule=datamodule)
  File "/Users/justin/Developer/lightning/lightning-pod/.venv/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 700, in fit
    self._call_and_handle_interrupt(
  File "/Users/justin/Developer/lightning/lightning-pod/.venv/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 654, in _call_and_handle_interrupt
    return trainer_fn(*args, **kwargs)
  File "/Users/justin/Developer/lightning/lightning-pod/.venv/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 741, in _fit_impl
    results = self._run(model, ckpt_path=self.ckpt_path)
  File "/Users/justin/Developer/lightning/lightning-pod/.venv/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1101, in _run
    self.strategy.setup_environment()
  File "/Users/justin/Developer/lightning/lightning-pod/.venv/lib/python3.9/site-packages/pytorch_lightning/strategies/strategy.py", line 130, in setup_environment
    self.accelerator.setup_environment(self.root_device)
  File "/Users/justin/Developer/lightning/lightning-pod/.venv/lib/python3.9/site-packages/pytorch_lightning/accelerators/mps.py", line 41, in setup_environment
    raise MisconfigurationException(f"Device should be MPS, got {root_device} instead.")
pytorch_lightning.utilities.exceptions.MisconfigurationException: Device should be MPS, got cpu instead.

cc @akihironitta @justusschock

the fix to this is that strategy must be None.
maybe there should be a MisconfigurationException that follows https://github.com/Lightning-AI/lightning/blob/619c2ff05827872973b2eed18d06651f7cd8bd4e/src/pytorch_lightning/trainer/trainer.py#L1797

@JustinGoheen I couldn't reproduce it with a simple boring model:
https://github.com/akihironitta/gist/blob/da3a7cd62b2219eb7af53129ad1d6b62acd90c72/pl_boring_model/main.py
I haven't looked into the detail yet, but would it be possible for you to provide a minimal script to reproduce the behaviour?

all code is at https://github.com/JustinGoheen/lightning-pod/tree/bug/accelerator-mps/lightning_pod/core
the issue was that I had accelerator and devices set to auto, and strategy set to single_device; single_device is not compatible with MPS and instead, strategy needs to be set to None.


Bech32 cleanup

Why do we need the custom types?

Why do we need the custom types?

Because the types from @types are wrong in many aspects
It allows us to pass binary data as Uint8Array directly instead of creating a copy to Buffer

Is it worth submitting a PR to the DefinitelyTyped project?

Is it worth submitting a PR to the DefinitelyTyped project?

I'm sumitting it to the project directly: https://github.com/bitcoinjs/bech32/pull/29#issuecomment-516733500


ASC Support for Windows Server 2008

Windows Server 2008 is listed as a supported server operating system for ASC to monitor.  The text of this page says that the Windows Server OS listed are supported platforms on which the log analytics agent can run.  However, when I check with the log analytics documentation (https://docs.microsoft.com/en-us/azure/azure-monitor/platform/log-analytics-agent#supported-windows-operating-systems) I do not see Windows Server 2008 listed as a supported platform for the Log Analytics agent.  So, which page is correct, this page, or the Log Analytics Agent support page above?
Finally, assuming that Win2008 is supported for both Log Analytics Agent and ASC, do we support both X64 and X86 versions or  only one of them?
Does this support include both X64 and X86 versions?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 525c1c48-3355-bc91-b8d0-6104c1f5f098
Version Independent ID: 0d1c6361-aeac-b0c9-016d-38d21f483396
Content: Platforms supported by Azure Security Center
Content Source: articles/security-center/security-center-os-coverage.md
Service: security-center
GitHub Login: @memildin
Microsoft Alias: memildin

@julesman101 Thanks for the feedback. We are investigating into the issue and will update you shortly.

@memildin  Could this be verified ?

@neeleshray-msft I'm investigating the multiple questions you asked and will respond on this thread when I have answers. Thanks!

The docs for the Azure Log Analytics agent do list Windows Server 2008 as a supported version. They also state that support is for X64:
https://docs.microsoft.com/azure/azure-monitor/platform/log-analytics-agent#supported-windows-operating-systems
I'm going to close this issue, but please let us know if you still have any questions and feel free to reopen this query.
#please-close


[spirv-tools] Update to v2021.1

Updates spirv-tools to v2021.1 and disables /MP4 (which was causing the compiler to bail on my high-corecount machine).
I've submitted the /MP4 removal patch to upstream.

/azp run

LGTM now, thanks for your update.


Clarify orig_elements documentation

The current docs do not specify that you don't dump the elements as JSON objects into the JSON file.
It would be clearer, if you gave an example of the serialization behavior.
Thanks in advance!

i met the same issue with you.
Currently the orig_elements output as BASE64 not as JSON format. don't know how to de-serialize to JSON or TEXT.

I had figure it out.
from unstructured.staging.base import elements_from_base64_gzipped_json

base64_elements_str = res_elements[4]["metadata"]["orig_elements"]
eles = elements_from_base64_gzipped_json(base64_elements_str)

Found in this PR

@kaleyroy you could also try this solution from an earclier converstation:
https://github.com/Unstructured-IO/unstructured/discussions/2887#discussioncomment-9225399
As far as I can understand data pipelines, I don't see too much reason dumping the objects into JSON files. I would much rather recommend processing the data while everything is loaded into memory and only dumping the final output into a JSON.
Note that you can modify elements and chunks, so you don't even have to create a separate structure for your new data. You can extend or modify the text option in your current chunks / elements.

Good call, we'll clarify this in the documention.
In the meantime, if you want to "rehydrate" elements in JSON form into in-memory objects, all you need to do is:
from unstructured.staging.base import elements_from_json

elements: list[Element] = elements_from_json(path_to_json_file)

The list[Element] you get will be just like the one originally produced by partitioning, or chunking, or whatever state it was in when you saved it.
This includes the .metadata.orig_elements value of each chunk being expanded into in-memory elements. The orig_elements are only compressed to Base64 when serialized, which is when Element.to_dict() is called on an element.


Crash on Copy / Paste with "envgen~" Object

When trying to copy/paste (Osc~) and (else/envgen~ 50 1 50 0.5 200 0 -suspoint 2 -exp -0.25 -0.5 -1 -0.5), both connected to an (*~) object, pure data crashes to desktop.

can you provide me with a test patch? zip it and upload it here on github

can you provide me with a test patch? zip it and upload it here on github

I cannot reproduce this error on my machine, so I suspect this error is not really happening and I'm closing this. You have to provide me with a patch that I can see the error happening and give more details on your system so we can reopen this.

Running
MacOS 10.12.6
Pd 0.51.1
else 1.0 beta 31
envgen~_error_testpatch.pd.zip

Works for me... damn...
MacOS 10.14.6 (although I doubt it matters if it's an older one like 10.12)
Pd 0.51-2 (not the 32 bit version)
else 1.0 beta 31 (compatible with the above Pd architecture, downloaded directly via Pd).
That's what you're using, right?
I'm afraid I can't help you if so... cause it's just too weird. Is it only happening with envgen~?

what if you create a new envgen~ without duplicating, what happens?

we can also try bringing this to the Pd list or something, maybe others can help figuring what could be wrong

i don't get the crash when i'm not using the start up flags for  (envgen~), so i guess it's a problem with that
so just
(envgen~ 50 1 50 0.5 200 0)
instead of (envgen~ 50 1 50 0.5 200 0 -suspoint 2 -exp -0.25 -0.5 -1 -0.5)
can be duplicated

ok, that gives me something to work with I guess. I could look and see if I can make some changes (if any) about the flags. Though it's still quite weird to me...

well, I have nothing looking at the code, so far...
what happens if you just create a new [envgen~] object with flags?
btw, you do have the 64 bit (regular) version, right? It just bothers me that I can't replicate this... so...

I am closing this as I think this has been fixed in the last update, please try @EdLud and if you try and still find the issue, please reopen!!!


drats forgot the env file

Was about to write on the other PR - I don't think 2018's rdkit releases supported > py 3.7, so I'd probably just move that one out of the matrix and put it as a single runner (i.e. py3.7 + 2018.03.4)?

Also I'd skip out on py3.10, rdkit doesn't support it yet (annoyingly it's blocking MDA's full move to py3.10).

No more issues with missing files but things like this:
https://github.com/OpenFreeEnergy/Lomap/runs/5015302658?check_suite_focus=true#step:8:653
AttributeError: 'QueryAtom' object has no attribute 'SetQuery'
Is odd since it should have that attribute
https://www.rdkit.org/docs/source/rdkit.Chem.rdchem.html?highlight=queryatom#rdkit.Chem.rdchem.QueryAtom

Ok I had a bit of a deeper dive here the problem seems to be that SetQuery didn't get added until late 2018: https://github.com/rdkit/rdkit/pull/2088 so I assume after the 2018 release was completed.
However that code path wasn't added until 2019 on lomap (https://github.com/OpenFreeEnergy/Lomap/commit/878efeefcd32b8b8e257a3a802fd245fac6f95bb)
So we're kinda doing a chicken and the egg type of thing.
There's two options here -

merge as-is and then start moving towards rdkit 2021 (things will break but c'est la vie)
we revert some of the cresset changes to lomap, get to point where it passes CI, and then bump up the rdkit version.

How have you been approaching this until now @richardjgowers ?

I'd vote to merge as-is, then create a new PR that adds rdkit 2021 to the testing matrix to catch things broken by api changes.
I do think we should mark these tests as okay to fail, or skip them, so that we can be sure we don't break things in future PRs, since right now its a pain to go through and see what is failing.
What should we do about the other test failures? I think they were mostly issues with score differences, which I am not sure where those are coming from.

Yeah I'd be happy with merge as-is too. I'll let @richardjgowers make the call though.

What should we do about the other test failures? I think they were mostly issues with score differences, which I am not sure where those are coming from.

I suspect those are also caused by erm... recent contributions to lomap that might not have respected the rdkit pins. Maybe the best thing to do is start picking at each test individually until everything passes?

@richardjgowers well this is wild but it is all passing now :upside_down_face:


[9.99.x-prod] Fix PR checks failures

The productized profile is still needed as there are still some leftovers of it in upstream code that was not removed yet

How to replicate CI configuration locally?

Build Chain tool does "simple" maven build(s), the builds are just Maven commands, but because the repositories relates and depends on each other and any change in API or class method could affect several of those repositories there is a need to use build-chain tool to handle cross repository builds and be sure that we always use latest version of the code for each repository.
build-chain tool is a build tool which can be used on command line locally or in Github Actions workflow(s), in case you need to change multiple repositories and send multiple dependent pull requests related with a change you can easily reproduce the same build by executing it on Github hosted environment or locally in your development environment. See local execution details to get more information about it.

How to retest this PR or trigger a specific build:

for pull request checks
Please add comment: Jenkins retest this

for a specific pull request check
Please add comment: Jenkins (re)run [kogito-runtimes|kogito-apps|kogito-examples] tests

for quarkus branch checks
Run checks against Quarkus current used branch
Please add comment: Jenkins run quarkus-branch

for a quarkus branch specific check
Run checks against Quarkus current used branch
Please add comment: Jenkins (re)run [kogito-runtimes|kogito-apps|kogito-examples] quarkus-branch

for quarkus main checks
Run checks against Quarkus main branch
Please add comment: Jenkins run quarkus-main

for a specific quarkus main check
Run checks against Quarkus main branch
Please add comment: Jenkins (re)run [kogito-runtimes|kogito-apps|kogito-examples] quarkus-main

for quarkus lts checks
Run checks against Quarkus lts branch
Please add comment: Jenkins run quarkus-lts

for native checks
Run native checks
Please add comment: Jenkins run native

for a specific native check
Run native checks
Please add comment: Jenkins (re)run [kogito-runtimes|kogito-apps|kogito-examples] native

How to backport a pull request to a different branch?

In order to automatically create a backporting pull request please add one or more labels having the following format backport-<branch-name>, where <branch-name> is the name of the branch where the pull request must be backported to (e.g., backport-7.67.x to backport the original PR to the 7.67.x branch).

NOTE: backporting is an action aiming to move a change (usually a commit) from a branch (usually the main one) to another one, which is generally referring to a still maintained release branch. Keeping it simple: it is about to move a specific change or a set of them from one branch to another.

Once the original pull request is successfully merged, the automated action will create one backporting pull request per each label (with the previous format) that has been added.
If something goes wrong, the author will be notified and at this point a manual backporting is needed.

NOTE: this automated backporting is triggered whenever a pull request on main branch is labeled or closed, but both conditions must be satisfied to get the new PR created.

Green! :)

Can't merge :(


Global navigation search box in v3

In v2, there was a simple method of creating a gllobal navigation search box by overriding js. Is there a similar equivalent in v2?

Thanks a lot for asking, the example for v2 actually is still completely valid:
http://django-autocomplete-light.readthedocs.io/en/v2/navigation.html
However, autocomplete.js has moved from django-autocomplete-light to jquery-autocomplete-light repository:
https://github.com/yourlabs/jquery-autocomplete-light
More exactly here:
https://github.com/yourlabs/jquery-autocomplete-light/blob/master/src/autocomplete.js
Please, can you propose a patch to the documentation where you would have expected to find this information ?

Thank you very much for the response! So navigation autocomplete does not use select2 like most of the new v3 tutorials?
And I would've expected to find the updated navigation autocomplete tutorial at
http://django-autocomplete-light.readthedocs.io/en/3.1.3/install.html
as this follows the updated format for all the other v3 tutorials.
I also have some security concerns regarding navigation autocomplete but I assume that would be better sorted out through email?
Thanks again.

I'm a bit affraid there's nothing I'll be able to do for you but yeah go ahead and send an email to the security mailing list.


RuntimeError: Could not load an opus lib. Tried....

I'm having the same problem and found your thread, then i just search for it else where on here got this: https://github.com/Just-Some-Bots/MusicBot/search?utf8=✓&q=RuntimeError&type=
Don't know if that will get any ball rolling, but i'm going to see if it works for me.

ok so run that /usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)" then hit return and it will ask for a password. GL


[OPENSTACK-2483]Fix confusing logs to avoid misunderstanding.

@<reviewer_id>
What issues does this address?
Fixes #
WIP #
...
What's this change do?
Where should the reviewer start?
Any background context?

Do you have an JIRA id?

Added

The JIRA id need to be saved in commit message.

JIRA id need to be saved in commit message

Added.


internal_ci: rename grpc_xds_k8s to psm-security as part of tech-debt cleanup and name clarity (backport 1.37.x) (#28034)

@srini100 I need this one merged by an authorized user


Add Views

Following tasks were completed:

Use preprocessed HTML files with embedded Ruby code.
Use layouts and templates for shared content.

@TayyabKM Kindly hold on for a moment!

@TayyabKM Kindly hold on for a moment!

@rloterh Yes ofcourse, Please just take a look as I am facing none of these errors on my end and all the links are working fine and I can access all the pages and everything is displaying correctly on my end. Please

@TayyabKM Kindly check my comments above regarding the same. Thanks
Cheers! 😃


Python Script support for MacOS

Hi,
is it planned to support MacOS in script?
If you need someone to test, i'am here :-)

regards
Markus

Hi Markus,
Could you check this link and make sure you have the geckodriver installed?
Once you have that, you can change the code of the python script and use the same lines as for the windows platform. The code is in the do_captcha function at the beginning.
It might already work, but it was never tested.

Thank you for your response...
It works 💯

Thanks for your support