Deletion of Source Files

Twice now i've noticed that if CPR stops responding (no updates in the UI or log file over 30 minutes) and is force quit, the source content can be lost.  Meaning actually deleted from the source/principal share.
Source is on-prem jamf pro 10.28.0 with SMB share on Windows Server 2012 R2. Destination is Jamf Cloud Distribution Point

Any chance you can provide the logs from when this happened?  I'll start digging in the mean time.


Remove unreleased folder

Codecov Report

Merging #3065 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #3065   +/-   ##
=======================================
  Coverage   57.43%   57.43%
=======================================
  Files        7781     7781
  Lines      158515   158515
=======================================
  Hits        91036    91036
  Misses      67479    67479

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 667ff3f...655fa05. Read the comment docs.


video in the readme section is broken

Describe the bug
A clear and concise description of what the bug is.
When I get to a particular part of the video it starts again from beginning
To Reproduce
Steps to reproduce the behavior:

Go to '1.34' at the video
press 'play'
See error

Expected behavior
A video to play to the end
Desktop (please complete the following information):

browser chrome

Additional context
Add any other context about the problem here.

@ukpagrace We use a GitHub video player. Try to reload your browser.


add code repository property for software product

DOAP seems to be a very good fit, for this property and for many others. It is used for example by the Python Package Index.
Integration of DOAP in general is requested in #22.
Related to #21.

###  http://hitontology.eu/ontology/repository
:repository rdf:type owl:ObjectProperty ;
                    rdfs:domain :SoftwareProduct ;
                    skos:closeMatch doap:repository;
                    rdfs:range rdfs:Resource;
                    rdfs:label "repository"@en .


Loosens ActiveSupport to 3

This is a fix for #289 and a second attempt (original pull request at #290)
The spec_helper now loads the needed hash extensions for ActiveSupport < 4. In ActiveSupport >=4, there's no change other than the ActiveSupport version info being loaded, which has no effect test functioning.

Coverage increased (+0.5%) to 95.91% when pulling 820bbbf141fc7869023dcd903baa09b05b5c425e on ericschultz:loosen_activesupport_to_3 into 1bfa7f34d6e7a3069590caf276556b0ca626fc25 on ruby-grape:master.

Coverage increased (+0.5%) to 95.91% when pulling 820bbbf141fc7869023dcd903baa09b05b5c425e on ericschultz:loosen_activesupport_to_3 into 1bfa7f34d6e7a3069590caf276556b0ca626fc25 on ruby-grape:master.

Coverage increased (+0.5%) to 95.91% when pulling 820bbbf141fc7869023dcd903baa09b05b5c425e on ericschultz:loosen_activesupport_to_3 into 1bfa7f34d6e7a3069590caf276556b0ca626fc25 on ruby-grape:master.

Coverage increased (+0.5%) to 95.91% when pulling 820bbbf141fc7869023dcd903baa09b05b5c425e on ericschultz:loosen_activesupport_to_3 into 1bfa7f34d6e7a3069590caf276556b0ca626fc25 on ruby-grape:master.

thanks @ericschultz …
will rebase and mörge it, after this one https://github.com/ruby-grape/grape-entity/pull/301, ok


Predicting Movie Reviews with BERT on TF Hub with tensorflow 2.0

BERT_MODEL_HUB = "https://tfhub.dev/google/bert_uncased_L-12_H-768_A-12/1"
bert_module = hub.Module(BERT_MODEL_HUB)

when I run the codes in tensorflow 2.0, it raise error:
Exporting/importing meta graphs is not supported when eager execution is enabled. No graph exists when eager execution is enabled.

May be there is no pretrain bert model in tensorflow 2.0, and I wonder when will support in tensorflow 2.0

As the error message suggests, static graphs can not be imported in Eager mode. Because Eager mode is disabled in TensorFlow 2.0 by default you might want to disable it before exporting the model (I tested this with TF 2.0 and latest tensorflow_hub):
import tensorflow as tf
import tensorflow_hub as hub

tf.compat.v1.disable_eager_execution()

BERT_MODEL_HUB = "https://tfhub.dev/google/bert_uncased_L-12_H-768_A-12/1"
bert_module = hub.Module(BERT_MODEL_HUB)

@kirillbobyrev thanks for answering, that means there's no dynamic graph mode bert is available, following your method is just turn tf 2,0 to static graph again.

@kirillbobyrev @RyanHuangNLP  - Building on what both of you said, it would be interesting to hear what the level of effort would be in order to make the conversion so that eager execution does not have to be disabled. Would this require a complete retraining of the BERT model or could this be done without retraining?

@ralphbrooks I suspect you may achieve what you need using pb export:

estimator._export_to_tpu = False
estimator.export_savedmodel()

@ralphbrooks - not sure if it helps, but I have recently coded a TF 2.0 Keras version of BERT (check kpe/bert-for-tf2, which can use the original google pre-trained weights, and calculate numerically identical activations to the activations calculated in this repo, so it should be safe to use it without finetuning/retraining. You could use it in both eager and non-eager mode (with TF 2.0 or TF 1.14+).

@kpe - nice work. Have you done any performance benchmarking. You can disable eager execution in r2.0:

import tensorflow as tf
from tensorflow.python.framework.ops import disable_eager_execution
disable_eager_execution()
tf.executing_eagerly()
False

Presumably one can run the BERT static models in r2.0 sans the eager execution, with the expectation there will need to be some porting of the code to r2.0. And then one can benchmark your keras clone against the static model. That would be very interesting information.


Not being able to record video with multi- azure kinect camera

I have tried External synchronization with two cameras using one single host PC as well two different Host pc's.
two cameras using one single host PC:
Not being able to start recording for sub, If i'm changing the external sync for one device to master, automatically subordinate camera device is also being set to master.

Document Details
-Look for the attachment
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: e58a1f3e-c828-1567-0a87-c1dd02b8f61b
Version Independent ID: 8bd1acf3-f151-0a91-7994-c06882595adb
Content: Use Azure Kinect recorder with external synchronized units
Content Source: articles/kinect-dk/record-external-synchronized-units.md
Product: kinect-dk
GitHub Login: @joylital
Microsoft Alias: joylital

@JayaSaiSontineni Thank you very much for bringing this to our attention. We are investigating and will update you when we have greater clarity of the issue. In the meantime, I am assigning this to the service area lead to be investigated.

@JayaSaiSontineni Thank you for you question. From the error above it looks like the reason recording is not starting is the camera already in use. Please make sure that all of the tools that are using the device or devices are closed (like a k4aviewer for example).

@JayaSaiSontineni was the previous comment helpful? Were you able to resolve the issue?

@JayaSaiSontineni were you able to resolve the issue? Any updates?

Hi Alberto,
Yes I was able to figure out the issue in a different method.
Thanks for checking.
Regards,
JayaSai
Get Outlook for iOShttps://aka.ms/o0ukef

From: Alberto Vega<EMAIL_ADDRESS>Sent: Tuesday, August 6, 2019 11:24:34 PM
To: MicrosoftDocs/azure-docs<EMAIL_ADDRESS>Cc: Jayasai Sontineni<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [MicrosoftDocs/azure-docs] Not being able to record video with multi- azure kinect camera (#36231)
@JayaSaiSontinenihttps://github.com/JayaSaiSontineni were you able to resolve the issue? Any updates?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/MicrosoftDocs/azure-docs/issues/36231?email_source=notifications&email_token=AJSQUGM2AVYSXBVH2H33EG3QDI57FA5CNFSM4IIIS452YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD3XCPRA#issuecomment-518924228, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AJSQUGINE6EP4ERCNAQGXZTQDI57FANCNFSM4IIIS45Q.

We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.


Docs for testing

Add documentation for testing E3SM Diags. Resolves #386.

@forsyth2 I like the idea of versioning the expected image directories. We could have a directory with name expected_images_latest. If there is update to the directory, the updated one will be renamed as latest, while time stamp the old version. Somehow a relevant point, for each release, it would be nice if we can set a designated directory to save the viewer from a complete run, so changes from version to version can be nicely captured.

@chengzhuzhang It would be cleaner to put the older versions in their own directory rather than the latest ones.
I can do that, but the issue I had with using the suffix _latest is we'd have to remember what date that was updated. ls -l showing the month/day might be sufficient since we'd expect to change the expected images more than once per year (e.g., with at least each release).

@forsyth2 Yeah, I think ls -l should be sufficient to show the dates for _latest.  We can autogenerate the timestamp and attach to directory name, so that it don't need to be changed each time

@chengzhuzhang @tomvothecoder I created a second commit to address your suggestions. Let me know if those changes (and the suggested workflow) look good.
These changes are in tandem with #391 which edits master instead of gh-pages. Please review those changes too.
For that pull request, running ./tests/test.sh passes. Running python -m unittest complete_run.py fails however. Two Taylor diagrams differ from expected -- see https://web.lcrc.anl.gov/public/e3sm/diagnostic_output/ac.forsyth2/image_check_failures_2021_02_23/. It looks like global_ceres_ebaf_toa got v4.1 added on top of v4.0. They're haven't been any new commits added on master since we last ran this test however. Is it possible that adding v4.1 to /lcrc/group/e3sm/public_html/diagnostics/observations/Atm/climatology/ caused this change? ls -l shows it being added on 2020-02-14 -- over a year ago.

@forsyth2 I did rsync last night to update the observation directory. Most likely this action cased the updated Taylor Diagram. We can use the new directory as a new baseline for images in this case.

@chengzhuzhang @tomvothecoder This is ready for code review. There are also minor changes to master in #391 (./tests/test.sh and python -m unittest tests/complete_run.py pass). Please review that in tandem with this. If the workflow looks good, I'll merge these pull requests.


⚠ Topfarmacia has degraded performance

In 4a081d3, Topfarmacia (https://www.topfarmacia.it) experienced degraded performance:

HTTP code: 200
Response time: 8462 ms

Resolved: Topfarmacia performance has improved in 2787848.


Don't emit @main into SIL

Cherry-picking https://github.com/apple/swift/pull/40601
We emit all the necessary entry point bits directly into SIL. Specifically, Entrypoint.$main.
When re-injesting SIL files, @main handling would re-trigger, attempting to add another Entrypoint.$main resulting in the following error message: error: invalid redeclaration of synthesized static method '$main()'.
We don't need to keep the attribute after we've generated the main function, so drop it.
https://bugs.swift.org/browse/SR-14957
rdar://80971052

@swift-ci please test


Lots of PHP errors with Customizer + local server

Greetings! Thank you for making Customizer; I find it's vital for Kanboard, and it seems to work well, despite lots of PHP errors showing repeatedly in the Customizer settings page.
I get the following repeatedly:
Notice: Trying to access array offset on value of type null in E:\ZNxPMp-Server\htdocs\kanboard\plugins\Customizer\Controller\CustomizerFileController.php on line 93

Call Stack
--
1 | 0.0008 | 373360 | {main}( ) | ...\index.php:0
2 | 2.5016 | 1651528 | Kanboard\Core\Controller\Runner->execute( ) | ...\index.php:9
3 | 2.5050 | 1788840 | Kanboard\Core\Controller\Runner->executeController( ) | ...\Runner.php:31
4 | 2.5072 | 1794776 | Kanboard\Plugin\Customizer\Controller\CustomizerFileController->show( ) | ...\Runner.php:77

and
Warning: Cannot modify header information - headers already sent by (output started at E:\ZNxPMp-Server\htdocs\kanboard\plugins\Customizer\Controller\CustomizerFileController.php:94) in E:\ZNxPMp-Server\htdocs\kanboard\app\Core\Http\Response.php on line 222
--
1 | 0.0008 | 373360 | {main}( ) | ...\index.php:0
2 | 2.5016 | 1651528 | Kanboard\Core\Controller\Runner->execute( ) | ...\index.php:9
3 | 2.5050 | 1788840 | Kanboard\Core\Controller\Runner->executeController( ) | ...\Runner.php:31
4 | 2.5072 | 1794776 | Kanboard\Plugin\Customizer\Controller\CustomizerFileController->show( ) | ...\Runner.php:77
5 | 2.5404 | 1965768 | Kanboard\Core\Http\Response->html( ) | ...\CustomizerFileController.php:101
6 | 2.5404 | 1965768 | Kanboard\Core\Http\Response->send( ) | ...\Response.php:272
7 | 2.5404 | 1965896 | header ( )

I'm running Kanboard on localhost with ZNxPMp Server. Any way I could stop those errors from appearing?

what version of kanboard are you running?  I haven't tested Customizer since version 1.2.13, and don't even have my server running anymore. I can spin up the latest KB version in docker and test, but If I don't get the errors, I'm not going to have a clue.

Although, just looking at your error. I am wondering....all your issues are from a null on the logo path. Did you upload a logo? Is it showing? Is it a bad file maybe?

Also, Tested in vs 1.2.15 and everything works as expected, no errors, running:
Application version: v1.2.15
PHP version: 7.3.19
PHP SAPI: fpm-fcgi
HTTP Client: cURL
OS version: Linux 4.14.122-rancher
Database driver: sqlite
Database version: 3.32.1
Browser: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/85.0.4183.83 Safari/537.36
Following your error though, this is whats happening.

Customizer thinks you have uploaded an image
It goes to grab the image
null is returned
it gets mad, spits out error
more mad ensues when making html header thing, cause, well image is null, spits out an other error

every error is referencing a null image

Confirmed. it's PHP 7.4.1

Trying to use values of type null, bool, int, float or resource as an array (such as $null["key"]) will now generate a notice.

https://www.php.net/manual/en/migration74.incompatible.php#migration74.incompatible.core.non-array-access
Previous versions didn't give a crap, and gave no "Notice".
If kanboards docker image is updated to use 7.4.1, then I will add a fix.

[slaps forehead] Knew I'd seen something about PHP versions while researching the error; wishing I had mentioned it!
To be honest, I'm a beginner myself. Just going nuts recently about local servers and stuff like that; found Kanboard, and it looked like a good idea for family task/startup company management.
I'm testing Kanboard with Laragon at the moment, and it's working a lot nicer - there's even an easy GUI way I can set PHP versions! It still throws an error with PHP 7.4.1 Notice: Trying to access array offset on value of type null in E:\ZNxPMp-Server\laragon\www\plugins\Customizer\Controller\CustomizerFileController.php on line 94 but at least Laragon's polite and doesn't spam errors all over the page.

Yes, correct, local server on my PC. Just for testing, as I'm trying to find a usable project planning/Kanban application for Windows (and none seem to exist (;_;) ). It's accessible via LAN from any other machine, but I haven't had any luck making Kanboard perform well on it (PHP server thrashes the HDD at 45% usage constantly while it's open), making pages/saving/etc. take long seconds to save (e.g. remote websites served from the internet are being faster than a local site served from my PC lol).

In my experience, thats the nature of virtual machines. If you have an old pc laying around, id recommend just wiping it, throw a minimalist on on it, and serve from that.

Will do, maybe once I get my RPi homeserver running :D
I believe Laragon (and the stuff running through it) isn't virtualised (unlike Docker, which is virtualised), though I could be wrong.

There is a big difference between the two. One is highly efficient.

Confirmed. it's PHP 7.4.1

Trying to use values of type null, bool, int, float or resource as an array (such as $null["key"]) will now generate a notice.

https://www.php.net/manual/en/migration74.incompatible.php#migration74.incompatible.core.non-array-access
Previous versions didn't give a crap, and gave no "Notice".
If (when) kanboards docker image is updated to use 7.4.1, then I will add a fix.

Not all of us run kanboard in a docker container. 😉
Quickfix for CustomizerFileController.php:
    public function show()
    {
        $logo         = $this->customizerFileModel->getByType(1);
        $flavicon     = $this->customizerFileModel->getByType(2) ?? ['id' => null, 'name' => null];
        $loginlogo    = $this->customizerFileModel->getByType(3) ?? ['id' => null, 'name' => null];
        $logopath     = $logo['path'] ?? null;
        $flaviconpath = $flavicon['path'] ?? null;
        $this->response->html(
            $this->helper->layout->config(
                'customizer:file/show',
                [
                    'logo'         => $logo,
                    'title'        => t('Settings') . ' > ' . t('Customizer'),
                    'flavicon'     => $flavicon,
                    'logopath'     => $logopath,
                    'flaviconpath' => $flaviconpath,
                    'loginlogo'    => $loginlogo,
                ]
            )
        );
    }

True, but I do.
Make a PR, and I'd be happy to merge.


[Suggestion] Logic Workbench Schematic Item

Some sort of way to save a logic schematic into item form would be quite useful, allowing the saving of schematics to free up a workbench for further use as well as the movement of schematics between logic workbenches.

Oh, something that came up in the IE discord: it'd be very useful to be able to have blueprint files that exist outside the game itself, so they could be loaded externally and be shared between players.
That's a much bigger scope than this issue though; should I make a new one for this?

I've implemented the schematic items in the commit above. Allowing schematics to be uploaded/exported is primarily a gameplay issue, I currently don't see an "immersive" way to do that. The technical side should be pretty easy, mostly just figuring out how to upload to pastebin or similar in code.


Fix link to French translation

@vincentchan Looks like http://www.oneskyapp.com/fr/docs/bootstrap/getting-started/ is fine but the homepage http://www.oneskyapp.com/fr/docs/bootstrap/ is broken. Could you please look into fixing that?


revisit whether we need bi-directional streaming for reduce

ResourceExhausted desc = trying to send message larger than max (19144763 vs. 4194304)
This is because today we demultiplex at client side because we create single gRPC stream from numaflow.
ERROR 2023-01-25 15:16:08 {"level":"error","ts":1674639968.7128754,"logger":"numaflow.ReduceUDF-processor","caller":"readloop/ordered.go:129","msg":"Process failed","vertex":"osam-metrics-sliding-aggregation","partitionID":"1674639300000-1674639900000","error":"gRPC client.ReduceFn failed, failed to execute stream.CloseAndRecv(): rpc error: code = ResourceExhausted desc = trying to send message larger than max (19144763 vs. 4194304)","stacktrace":"github.com/numaproj/numaflow/pkg/reduce/readloop.(*orderedForwarder).reduceOp\n\t/Users/adulam/intuit-work/analytics/numaflow/pkg/reduce/readloop/ordered.go:129"}

My understanding is the 4MB size limit is on each received message, not the whole, am I wrong?

I see, you are talking about the client side received message.

I see, you are talking about the client side received message.

yes, it is the gRPC client (numaflow) that is getting result from the UDF (gRPC Server)


Use java.math.BigDecimal in JsonBigDecimal

I don't think there's any good reason for JsonBigDecimal to use the scala.math.BigDecimal wrapper rather than java.math.BigDecimal, and it's likely to play a more central role soon, so I'm switching to the unwrapped version.
This change is not public facing, although if someone were constructing a bunch of Json values using fromBigDecimal and then immediately decoding them back into scala.math.BigDecimal, they might see a tiny  performance hit. Most (less unusual) use cases are likely to benefit, though.

Codecov Report

Merging #668 into master will increase coverage by 0.14%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master     #668      +/-   ##
==========================================
+ Coverage   84.27%   84.42%   +0.14%
==========================================
  Files          70       70
  Lines        2131     2131
  Branches      153      138      -15
==========================================
+ Hits         1796     1799       +3
+ Misses        335      332       -3

Impacted Files
Coverage Δ

...re/shared/src/main/scala/io/circe/JsonNumber.scala
97.02% <100%> (+0.99%)
:arrow_up:

...les/core/shared/src/main/scala/io/circe/Json.scala
78.84% <100%> (ø)
:arrow_up:

.../main/scala/io/circe/optics/JsonNumberOptics.scala
100% <100%> (ø)
:arrow_up:

...re/shared/src/main/scala/io/circe/KeyDecoder.scala
43.24% <0%> (-2.71%)
:arrow_down:

.../core/shared/src/main/scala/io/circe/Decoder.scala
90.64% <0%> (+0.35%)
:arrow_up:

...rc/main/scala/io/circe/shapes/SizedInstances.scala
92.85% <0%> (+14.28%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 84362a0...9c96909. Read the comment docs.


Introducing basic system test for Bigtable.

Hmm, I don't get the Travis failure:  we should be skipping system-tests for PRs, shouldn't we?

The Travis failure is my fault. I had to re-run the job before I remembered how things work. system_tests/bigtable.py will get imported by attempt_system_tests so the client set-up should happen at run-time not at import-time. D'oh!

@tseaver PTAL

LGTM.

Arrrg! I committed a Review changes (will be squashed). commit message by mistake.

Nobody is perfect.

Lulz


[BUG] Deleting one message more than has been read

Describe the bug
When a message is read using ServiceBusReceiverClient and there are more messages in the queue than specified by maxMessages parameter of receiveMessages method, next message is removed from the queue when close method of ServiceBusReceiverClient is invoked.
Code Snippet
try(ServiceBusReceiverClient receiver = new ServiceBusClientBuilder()
        .connectionString(CONNECTION_STRING)
        .sessionReceiver()
        .receiveMode(ServiceBusReceiveMode.RECEIVE_AND_DELETE)
        .queueName(QUEUE_NAME)
        .prefetchCount(0)
        .buildClient()
        .acceptSession(SESSION_ID)
) {
    IterableStream<ServiceBusReceivedMessage> receivedMessages = receiver.receiveMessages(1, MAX_WAIT_TIME_DURATION);
    return receivedMessages.stream().findFirst().orElse(null);
}

Expected behavior
The number of messages deleted from the queue is equal to the value of parameter maxMessages of receiveMessages method.
Setup (please complete the following information):

OS: Windows
IDE:
Library/Libraries: com.azure:azure-messaging-servicebus:17.13.2
Java version: 17
App Server/Environment:
Frameworks: Spring Boot

@conniey could you please follow up on @Ruby-77's github issue?

Thanks for reporting this. We know there are prefetch issues in the Service Bus client library that we are currently fixing (#33688).  For now, a workaround would be to use ServiceBusReceiveMode.PEEK_LOCK and explicitly complete messages (ie. disable auto-complete)

@conniey Is this prefetch problem affecting also receiver in PEEK_LOCK mode? Is there created lock on next message when there is invoked close on receiver? And if yes, can this cause memory leaks?

Yes, the receiver is affected in PEEK_LOCK mode.  The difference is that lock tokens expire after a period of time, so the next receiver can refetch it.  There aren't any memory leaks associated with this.


Handle an empty GIT repository for versioning

In the case where a pyscaffold project is moved into a new, yet empty GIT repository, git describe fails with exit code 128 due to not having any revision, i.e. there is also no HEAD. Only in this case handle the error and do the same actions as if an invalid tag (format) was given.

Coverage remained the same at 94.35% when pulling 66e8684732606ce4fe115c3720d1f60e57135e73 on fix-version-on-empty-repo into c109d167ecd9b25e5b52a000855035e91cd4e881 on master.

If exit code 128 is used to exactly state this then wouldn't it be more robust to check the exit state instead of string comparison with the output?

No, exit code 128 seems to be the general code for "something went wrong".
Also I just realised that that string comparison only works if your system language is English. To fix that, we could just possibly run this command with @LANG=C@ to force the English output but then if the error is not the above mentioned, it may not be in the user's native language. (Although we could probably assume that PyScaffold user have a sufficient understanding of English).

Would it not be an idea to use proper git bindings, such as GitPython throughout pyscaffold, instead of subprocess and output parsing (which is bound to break sooner or later)?

But that would introduce a dependency on GitPython in the setup.py or we would need to bundle it...both cases seem not so pleasant.

@kopf I don´t think GitPython is a proper git binding as it seems to also just call the git binary and parse its output. Also, there is not much development either. PyScaffold was using GitPython up until version 0.1.2 and then I dropped it for these reasons.

Ah, sorry, I'm unfamiliar with the python/git landscape (perhaps pygit2 would be more appropriate?) and simply wanted to make the point that perhaps using proper bindings would be a better way to go.

@kopf thanks for pointing this out but I think this feature would lead to further restrictions to the user of PyScaffold.
But back to the original topic!
@xhochy Couldn't we just check if there were any tags defined beforehand with a call to git show-ref --tags. I think a little function like do_git_tags_exist() which calls git show-ref --tags and returns True if there are returned lines and False if not, could help. What do you think?

@FlorianWilhelm sounds like a good alternative

@xhochy Do you want to change this PR into it? Then I'll merge it. Don't forget to add yourself to the AUTHORS.txt file as well.

will do

If git show-ref --tags also just returns zero lines if not in a git repository we could use git rev-parse --git-dir to make sure we are in a git repository.

I did some more research and found out that `git show-refs --tags``has different exit codes which we can use to distinguish the different situations thus we do not need to fallback to counting the number of ouput error lines.

Coverage remained the same at 94.41% when pulling 9cd2c73e31528fdff1d5f2459c4423c7e6daf84d on fix-version-on-empty-repo into 3ae9f0211f08585495c78c4fc2dc83a550015556 on master.

@xhochy Thanks a lot!


Issue mover not requesting third-party access in GitHub

Issue mover not requesting third-party access to organization on 1 of 4 organizations.

Issue still relative..

Resolved by temporarily Removing restrictions.

k


P-Extension PR

Hello Neel,
I’m the Andes engineer working on the “P” extension support for RISCV-CTG and RISCV-ISAC. We are ready to submit our initial pull request for the modification.
AS P-extension divides a register into 8/16-bit subfields for packed SIMD operations, the dataset and coverpoints become more complicated. Our first pull request will contain modifications for three instructions from the P extension only: ADD8, ADD16, and SCLIP8.  We would like to seek your review first before proceed into the rest of the instructions. Please kindly review our pull request and give us guidance on how to proceed next.
Reference for P-extension, ADD8, ADD16 on pages 83-84, and  SCLIP8 on page 263.
https://github.com/riscv/riscv-p-spec
Hsueh-Liang

Hi,
Based on our last discussion, I modify the dataset generating functions and coverpoints to be sub-element based instead of whole-register based.
The majority of functions are collected into a separate dsp_function.py. The second largest modification is to the coverage statistic function because a bunch of new val_vars are introduced.
Please let us know how you think of these changes, particularly my changes to the common functions.
Hsueh-Liang

Thanks for the update, will review. One suggestion: when adding python functions (here or in isac) kindly add sphinx-docstring-format comments so that the sphinx documents for the project can be easily built.

The latest commit uses a general approach to handle xlen based field names derivation for the VAL dictionary. This looks cleaner and the format of the nodes in the template.yaml remains consistent as opposed to a different instance type based on the extension of the instruction. I have made the changes for only add8. We can discuss further in case you feel this isn't a feasible way forward.

@s12121296 It would be great if you could pick up hints from @pawks commit and complete the remaining pieces. If you aren't sure we can have a quick call to discuss the same.
I am glad that the runtime for test-generation hasn't significantly exploded, so looks like we are on track to continue this.
Once we are done incorporating changes suggested by @pawks and my docstring suggestions, we can do one review and give a go ahead..

Thanks for @pawks 's sugguestion. We'll pick up from here and complete the remaining pieces.


Always get "multiple instances" error message

As the title says, every time I run scr, I get the error message even when no other scr process is running. I'm not sure how to fix it as I don't know what ${0##*/} refers to.

well, I think I get what that variable is doing now, and with a little debugging, I'm finding that it's always null or 0 with the -c flag. I have no idea why it would be the case.

Currently on my phone so can't help much, I'll look into the issue tomorrow.

I don't know what ${0##*/} refers to.

$0 is the script's path,
For example /usr/local/bin/scr
(${0} is the same as $0)
The ##*/ deletes everything before the last slash,
So the example should be shortened to scr

And I'll probably change the way I do process checking, I don't remember
being too proud of it (but yet again I barely remember what I did)

Alright.
@Barbarossa93 Above the error checking line (166), can you put
pgrep -x "${0##*/}"; exit

Just so I can see the output of pgrep - it should only give one number.
Also, to be clear, you're on the latest commit?

For some reason on my setup, I only see one number.
I checked out phisch's giph and tried pgrep -f "bash.+${0##*/}" instead of pgrep -x "${0##*/}" and now I see two of the same number. Seems like an issue with process naming?

Perhaps.
How are you running scr?

I'm seeing the error crop up within a terminal.
I assume that scr is in $PATH?

Oh sorry, yes, I'm simply running as scr -c -e with it in my $PATH

Honestly I have no idea what the issue could be, but I'll keep thinking.
@Barbarossa93 one quick thing though, can you try installing dash, then changing the /bin/sh symlink to use it (sudo ln -sf /bin/sh dash), then try that line i told you to add again?

So instead of changing the symlink, I just changed the shebang line to point to dash (I hope that's fine, let me know if you still want me to try with the symlink). It now works as expected. I thought bash was fully POSIX compliant, I guess it might not be?

I thought bash was fully POSIX compliant, I guess it might not be?
It's far from it.  I don't generally remember the times it breaks, but
a common example is echo needing -e in bash for the default POSIX
behavior.

Dash isn't fully POSIX either, but it is POSIX-compliant.
For example, dash supports [[ stuff ]], which was added in bash.
Anyway, now I know the issue lies with bash so I know where to look.

Alright, looks like bash gives subshells $() another PID.
 > scr # bash
script's pid
28730
no subshell
28730
subshell
28730
28736
 > scr # dash
script's pid
28797
no subshell
28797
subshell
28797
 >

Alright, looks like bash gives $(subshells) another PID with the same process name as the script.

... but only when using an empty trap
Changing trap '' INT to trap ':' INT seems to work.  (: is a nop, similar to true)
god, that's an interesting bug.

Wow, that is a bizarre bug! Looks like it works now, so thanks for figuring that out! I would never have guessed.

Honestly, thanks for reporting.  This was rather interesting.


KAFKA-12508: Disable KIP-557

A major issue has been raised that this implementation of
emit-on-change is vulnerable to a number of data-loss bugs
in the presence of recovery with dirty state under at-least-once
semantics. This should be fixed in the future when we implement
a way to avoid or clean up the dirty state under at-least-once,
at which point it will be safe to re-introduce KIP-557 and
complete it.
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

Hey @ableegoldman @cadonna, can you spare a quick review here?
All I did was revert the KTableSourceProcessor to its state before the KIP-557 implementation. I just ignored the unit test, and reverted the FK Join test (it had become possible to simplify it after KIP-557).

Thanks, @ableegoldman !
As far as I know this was the only operator we updated to KIP-557.
This is the only commit I find referencing the KIP: https://github.com/apache/kafka/commit/f54cece73e6116566979bcf6a865d803b7c18974

Ah ok, I saw the KIP had included "any aggregation or repartition operation" in addition to the source KTable but I guess this just hasn't been implemented yet. Looks like Richard never got around to making sub-tasks for the other operators so I filed tickets and linked them all in the KIP so it's easier to understand what is/isn't in which versions.
Thanks for doing this PR!

Woah, thanks for that, @ableegoldman !

I looked into the Java 8 timeout. It should not be related, as it's caused by the KafkaAdminClientTest hanging.
I submitted https://github.com/apache/kafka/pull/10404 to fix that test.

Nice test debugging 😄
Just to confirm, you're going to backport this to 2.7 & 2.6 right?

Thanks, @ableegoldman !
Yes, I plan to do it right now.


Only show message about packages that need update when updating

Hi! Currently when I run pipx upgrade-all I get the following output:
jupyter-core is already at latest version 4.4.0 (location: /home/pedro/.local/pipx/venvs/jupyter-core)
ipython is already at latest version 7.1.1 (location: /home/pedro/.local/pipx/venvs/ipython)
ranger-fm is already at latest version 1.9.2 (location: /home/pedro/.local/pipx/venvs/ranger-fm)
pgcli is already at latest version 2.0.1 (location: /home/pedro/.local/pipx/venvs/pgcli)
raiseorlaunch is already at latest version 2.1.0 (location: /home/pedro/.local/pipx/venvs/raiseorlaunch)
vim-vint is already at latest version 0.3.19 (location: /home/pedro/.local/pipx/venvs/vim-vint)
pipx is already at latest version 0.9.3 (location: /home/pedro/.local/pipx/venvs/pipx)
beautysh is already at latest version 3.11 (location: /home/pedro/.local/pipx/venvs/beautysh)
black is already at latest version 18.9b0 (location: /home/pedro/.local/pipx/venvs/black)
mypy is already at latest version 0.641 (location: /home/pedro/.local/pipx/venvs/mypy)
flake8 is already at latest version 3.6.0 (location: /home/pedro/.local/pipx/venvs/flake8)
yamllint is already at latest version 1.13.0 (location: /home/pedro/.local/pipx/venvs/yamllint)
sqlparse is already at latest version 0.2.4 (location: /home/pedro/.local/pipx/venvs/sqlparse)
mycli is already at latest version 1.19.0 (location: /home/pedro/.local/pipx/venvs/mycli)
neovim-remote is already at latest version 2.1.1 (location: /home/pedro/.local/pipx/venvs/neovim-remote)
trash-cli is already at latest version <IP_ADDRESS> (location: /home/pedro/.local/pipx/venvs/trash-cli)

Instead of printing a line for every installed package can we only print lines for packages that were actually updated or if no packages needs and update then simply print something like All packages up to date, nothing to do? Thanks!

Sounds good! I can make this change.

This has been added in <IP_ADDRESS>.
>> pipx upgrade-all
Versions did not change after running 'pip upgrade' for each package 😴

Thanks!


Is gem5-aladdin okay in simulating systolic arrays?

I hope that systolic array is not a strange name nowadays. I see a lot of custom accelerators (like TPU) use systolic array as very crucial part in their design. Therefore, I wonder is Gem5-Aladdin eligible to build such a systolic array-based accelerator? And then fetching data from surrounding buffer to feed into this accelerator as a specific dataflow?
Of course, my final target is interaction analysis between this accelerator and surrounding component, not internal NoC issues...

There's two parts of your question: can Aladdin be used to model a systolic array, and can gem5-aladdin be used to model a systolic array accelerator?
To the first part: In theory it's possible to simulate a systolic array with Aladdin, but it is challenging to represent that sort of parallelism in C, and ultimately that is the primary limitation. I've seen ways to do this in C-based HLS solutions but it's not at all natural or intuitive. It's also likely for Aladdin to have some issues inferring the appropriate data dependencies since we haven't tested such code on it before.
To the second part: gem5-aladdin contributes more than just connecting Aladdin with gem5; it also implements a fairly general interface between a CPU and a coarse-grained accelerator. So if you had a separate transaction-level systolic array accelerator model, it would be really easy to plug that into gem5-Aladdin and invoke it almost exactly as you would with an Aladdin based model. We have some ongoing work in this particular area, so stay tuned...

Thanks for @xyzsam answering previous question! I am a beginner in hardware simulation and the only one aim at accelerator design in our research group. Our advisor hopes my design could be finished under software simulating condition, thus I believe gem5 and gem5-aladdin should be a good tool in that.
However, now I am a little questioning whether gem5 derived tools eligible in inner functionality design of acceleator since I have seen a lot of gem5 works mainly focus on interaction issues between accelerator. I assume before talking about performance, we should put an accelerator with detailed internal structure there, is this eligible only in software condition? Or there are other software tools could complete this task together with gem5 or -aladdin?
It's my great appreciate for any explanation on that since it would be tough for me in choosing a unsuitable simulator, even though we only have software-level condition in designing specific accelerator (like using for matmul, machine learning or graph analytics).

gem5-aladdin is a good candidate for rapid, high level design exploration of the overall accelerator architecture as well as system interactions - it's not only for system co-design. If you don't have any idea what the accelerator microarchitecture might look like, it's a great way to get started. Once you figure out the major parameters of your accelerator, and you want to explore even lower-level optimization and design, you probably want to move on to RTL.


Multi threaded hashing?

Could you maybe add multi threaded hashing of dumped discs? The hashing takes very long time on bluray discs.

Most hash functions can't be parallelised. They required the information of the previous block for the next block.
What you are asking for is therefore impossible.
It would be possible to implement for CRC32 but not for MD5 or SHA1.
Thus nothing would be won.

Hash image while dumping (#108)


Incorrect JS syntax on pointer operations.

Extract issue from #771 here. Next source, when compiled on Roslyn in Release mode (with optimizations) produce syntax-incorrect JS:
    internal static unsafe int CompareOrdinal(byte* a, int byteLen, string b)
    {
        int r = 0;
        int i = 0;
        // Compare the min length # of characters, then return length diffs.
        int numChars = byteLen >> 1;
        if (numChars > b.Length)
            numChars = b.Length;
        while (i < numChars && r == 0)
        {
            // Must compare character by character, not byte by byte.
            char aCh = (char)(*a++ | (*a++ << 8));
            r = aCh - b[i++];
        }
        if (r != 0) return r;
        return byteLen - b.Length * 2;
    }

Translation of *a++ produce a++.get().

Really much simpler will be enough (on release):
    internal static unsafe int CompareOrdinal(byte* a)
    {
        return (*a++);
    }

Ohhh, it's Roslyn! I should figure out how to make unit tests run against roslyn.

Roslyn and only in Release mode :)
On Fri, Jul 31, 2015 at 10:32 PM, Katelyn Gadd<EMAIL_ADDRESS>wrote:

Ohhh, it's Roslyn! I should figure out how to make unit tests run against
roslyn.
—
Reply to this email directly or view it on GitHub
https://github.com/sq/JSIL/issues/774#issuecomment-126867336.

For now, can you compile that reduced one by itself into a .dll? We can add it as a binary test.

Oh, there is no pointer logic in Translate_UnaryOp at all :). Looks like simplified example reproduce issue both in Release and Debug.

Some of the other failures in the vs2015 move also have suggested a bunch of invariants to apply, like that the lhs of an assignment or the target of a unary expression must be an lvalue. I normally maintain that but these are cases where it doesn't happen - mechanically enforcing it would make it easier to debug this stuff and prevent it.
(ReplaceChild probably needs to go away in general, since it's untyped. I should think about that.)


Replace HttpUrlConnectionMessageSender with HttpComponentsMessageSend…

…er because connection pooling is supported in HttpComponentsMessageSender

https://jenkins.fdp.osgp.cloud/view/SMHE-cucumber/job/gxf-smhe-cucumber-build/39/


Trouble creating Popover initialised via Javascript or Data API

I'm having trouble creating and showing a Popover created via Javascript
I'm able to initialise the Popover but not able to access the public methods.

var element = document.getElementById('popup');

var pop = new Popover(element, {
  title: 'title',
  placement: 'top',
  content: 'the content',
  animation: 'slideNfade',
  delay: 100,
  dismissible: true
});

//element.Popover.show(); //element.Popover is undefined
pop.show();  //pop.show is not a function

I also tried using the data API using the example from the docs, with no luck.
Here's a codepen showing my progress:
https://codepen.io/anon/pen/VNagOG

var element = document.getElementById('my-button');

Thanks @thednp
Should anyone else be having trouble in the future, I think that the element must have at least the data-content Data API attribute added to it for this to work, as programmatically adding a Popover to an element without one won't work.

https://codepen.io/anon/pen/eoZamY shows it working.
However the 'content' option does not override the data-content of the element.

I'm gonna rework components init so that JS initialization has priority over setting option values.

The Popover component indeed didn't take any reading of options.title and options.content; I also found some inconsistencies with ScrollSpy, but they all gonna get fixed with the next commit, so stay tuned.

good stuff and thanks for a good library!


Bugs in the conda environment

I have setup the environment based on these commands:
conda create -n mbo -c conda-forge rdkit
pip install design-bench==2.0.20
However, when I use the api I encounter a strange problem.
The import design_bench got an error:
ValueError: Can't find a vocabulary file at path '/root/miniconda3/envs/mbo/lib/python3.10/site-packages/design_bench_data/smiles_vocab.txt'. To load the vocabulary from a Google pretrained model use tokenizer = BertTokenizer.from_pretrained(PRETRAINED_MODEL_NAME)

Hi,
This is an issue which has been resolved in a new branch (albeit pending approval), switch to branch chris/fixes-v2 and see if that helps.


Manual architecture migration

Checklist

[ ] Used a personal fork of the feedstock to propose changes
[ ] Bumped the build number (if the version is unchanged)
[ ] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[ ] Ensured the license file is being packaged.

Attempting to address https://github.com/oracle/python-oracledb/issues/21#issuecomment-1399220017

@conda-forge-admin, please rerender


Extraneous newlines in telnet server response

Thanks for writing and releasing this crate. I'm using it to collect diagnostic data from my router and seem to be getting extra newlines in the response from the telnet server.
When I telnet to my router using PuTTY and issue xdslctl info I get:
xdslctl: ADSL driver and PHY status
Status: Showtime
Last Retrain Reason:    1
Last initialization procedure status:   0
Max:    Upstream rate = 12578 Kbps, Downstream rate = 60380 Kbps
Bearer: 0, Upstream rate = 12835 Kbps, Downstream rate = 59803 Kbps
Bearer: 1, Upstream rate = 0 Kbps, Downstream rate = 0 Kbps

but when I use mini-telnet and let response = telnet.execute("xdslctl info").await? and then println!("{}", response), I get:
xdslctl: ADSL driver and PHY status

Status: Showtime

Last Retrain Reason:    1

Last initialization procedure status:   0

Max:    Upstream rate = 12578 Kbps, Downstream rate = 60276 Kbps

Bearer: 0, Upstream rate = 12835 Kbps, Downstream rate = 59803 Kbps

Bearer: 1, Upstream rate = 0 Kbps, Downstream rate = 0 Kbps

Could it be https://github.com/kolapapa/mini-telnet/blob/250f39d6bbae9ab2dc0cbe3b89639a9574ac0697/src/lib.rs#L255 that's introducing the extra newlines?

It looks like this problem. I have fixed it in version 0.1.8. Thank you again for your feedback~


Add support for xid in the bootstrap tool

Also add a gauge metric for xids in the cluster manager.

Codecov Report

Merging #1033 into master will increase coverage by 0.01%.
The diff coverage is 95.83%.

@@             Coverage Diff              @@
##             master    #1033      +/-   ##
============================================
+ Coverage      68.3%   68.31%   +0.01%
- Complexity     4744     4745       +1
============================================
  Files           378      378
  Lines         30047    30060      +13
  Branches       3831     3832       +1
============================================
+ Hits          20523    20536      +13
+ Misses         8490     8483       -7
- Partials       1034     1041       +7

Impacted Files
Coverage Δ
Complexity Δ

...ain/java/com.github.ambry.clustermap/DataNode.java
84.8% <100%> (+0.37%)
44 <1> (+1)
:arrow_up:

...b.ambry.clustermap/HelixClusterManagerMetrics.java
100% <100%> (ø)
10 <1> (+1)
:arrow_up:

...m.github.ambry.clustermap/HelixClusterManager.java
93.35% <100%> (+0.06%)
30 <0> (ø)
:arrow_down:

...ub.ambry.clustermap/HelixBootstrapUpgradeUtil.java
76.04% <100%> (+0.17%)
52 <0> (ø)
:arrow_down:

...a/com.github.ambry.clustermap/ClusterMapUtils.java
92.85% <100%> (-0.08%)
23 <1> (-1)

...ava/com.github.ambry.clustermap/AmbryDatanode.java
77.77% <66.66%> (-1.07%)
0 <0> (ø)

...java/com.github.ambry.store/CompactionManager.java
86.75% <0%> (-2.65%)
19% <0%> (ø)

.../src/main/java/com.github.ambry.store/Journal.java
90.76% <0%> (-1.54%)
24% <0%> (-1%)

...in/java/com.github.ambry.store/BlobStoreStats.java
69.97% <0%> (-1.3%)
101% <0%> (-1%)

...b.ambry.network/BlockingChannelConnectionPool.java
62.6% <0%> (-0.87%)
7% <0%> (-1%)

... and 3 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f3fe628...c29a75e. Read the comment docs.

I didn't see any relevant test in HelixBootstrapUpgradeTooTest, is it feasible to have a test?

HelixBootstrapTool does a validation at the end, and now it also validates if the xid in the json files is the same as the xid obtained when the instance configs are queried.
The tool's test is limited to this functionality since it does not concern itself with the logic around how xids are handled. For the logic we have tests elsewhere (which we added in the previous PR).
I will make a small change though in TestUtils so that it sets a valid non-null xid when datanodes are created, so that the tool's validation exercises the non-null case.

@jsjtzyy addressed your comments.

@jsjtzyy Addressed comments, also made the change we discussed yesterday to ignore xids for changes to self; added a test.

@jsjtzyy @cgtz made the change to getXid() to return long instead of String; rebased and fixed merged conflicts.


id_token : iat the same as exp

Hi,
Scenario:  oidc - frontend, saml - backend;
client receives always id_token where value of iat is the same as exp
sample decoded payload:
{   "sub": "e02c372f1a5f8df03265b68f7cdc2e22115eee7f39eb95938480e0c756f14b9f8732ca693f00471d19b80f67a8124b9a1dc587502143ec02daff3b943544a768",   "iat":<PHONE_NUMBER>.2663593,   "aud": [     "7FTl3vGXxRpC"   ],   "exp":<PHONE_NUMBER>.2663598,   "at_hash": "LgBpOuidp-mVyGMwXTzM6A",   "iss": "https://op-test.heanet.ie" }
In logs I always get that 'code' has already been used, whis is not true.
Sample exceptions  I get:
Traceback (most recent call last):   File "/opt/satosa/lib/python3.5/site-packages/satosa/frontends/openid_connect.py", line 322, in token_endpoint     response = self.provider.handle_token_request(urlencode(context.request), headers)   File "/opt/satosa/lib/python3.5/site-packages/pyop/provider.py", line 313, in handle_token_request     return self._do_code_exchange(token_request, extra_id_token_claims)   File "/opt/satosa/lib/python3.5/site-packages/pyop/provider.py", line 353, in _do_code_exchange     access_token = self.authz_state.exchange_code_for_token(token_request['code'])   File "/opt/satosa/lib/python3.5/site-packages/pyop/authz_state.py", line 159, in exchange_code_for_token     raise InvalidAuthorizationCode('{} has already been used'.format(authorization_code)) pyop.exceptions.InvalidAuthorizationCode: a0556ec7d2974e6fbd1879de4000c540 has already been used [2017-05-23 09:07:26] [DEBUG]: [urn:uuid:70e586d6-05e6-4bb6-a5b9-eb4685ee630f] Saving state as cookie, secure: True, max-age: 1200, path: /

sorry, issue actually is not in satosa code


Cannot Remove Container After 404

Shown below:

Thanks for the issue, what steps did you take to reproduce?
Just deleting a downloading container doesn't seem to reproduce this, but I think I've seen this another time in the wild.

Also seeing this with urelx/centos6-epel

Merging with #1030


HdmiCecSink json and md files updated as per code

Documentation enhancement for HdmiCecSink plugin
Jira ticket link: https://ccp.sys.comcast.net/browse/RDK-34974

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Way to pass JWT to underlying services

Hello!
I am using that project to make a dynamic mesh where services can register themselves. That idea worked until I faced the need to pass JWT provided by client to underlying services. Is there any context or other way to tell services who exactly makes the request?
Currently, I have to rebuild schema, and it is definetely counter-optimal solution:
Main file:
app.use(
        graphqlUploadExpress({ maxFileSize: 10000000, maxFiles: 10 }),
        graphqlHTTP(async (req) => {
            const token = `${req.headers['authorization']}`;
            let resultSchema = ttl.get(token);

            if (!resultSchema) {
                const services = await getServicesWithEndpoints();
                const { schema } = await rebuildSchema(services, {
                    token
                });

                ttl.push(token, schema, null, TTL);

                resultSchema = schema;
            } else {
                console.log("Schema found in cache for token:", token);
            }

            return {
                schema: resultSchema,
                graphiql: false
            };
        })
    );

Rebuild schema method:
const rebuildSchema = async (endpoints, options) => {
    const config = {
        merger: 'federation',
        sources: endpoints.map((endpoint) => ({
            name: endpoint.key,
            handler: {
                graphql: {
                    endpoint: endpoint.endpoint,
                    enableSubscriptions: false,
                    operationHeaders: {
                        Authorization: options.token
                    }
                }
            }
        })),
        additionalTypeDefs: getMeshTypes(endpoints.length > 0),
        additionalResolvers: ['./src/mesh/additional_resolvers.js']
    };
    const subConfig = {
        sources: endpoints
            .filter((endpoint) => !!endpoint.subEndpoint)
            .map((endpoint) => ({
                name: endpoint.key,
                handler: {
                    graphql: {
                        endpoint: endpoint.subEndpoint,
                        enableSubscriptions: true,
                        operationHeaders: {
                            Authorization: options.token
                        }
                    }
                }
            })),
        // additionalTypeDefs: getMeshTypes(endpoints.length > 0),
        additionalTypeDefs: getMeshTypes(false),
        additionalResolvers: ['./src/mesh/additional_resolvers.js']
    };

    if (endpoints.length === 0) {
        delete config.merger;
    }

    const meshConfig = await processConfig(config);
    const meshSubConfig = await processConfig(subConfig);

    try {
        const { schema, contextBuilder } = await getMesh(meshConfig);
        currentSchema = schema;
        currentContextBuilder = contextBuilder;
    } catch (e) {
        console.log('Schema error:', e, JSON.stringify(e));
    }

    try {
        const {
            schema: subSchema,
            contextBuilder: subContextBuilder
        } = await getMesh(meshSubConfig);
        currentSubSchema = subSchema;
        currentSubContextBuilder = subContextBuilder;
    } catch (e) {
        console.log('SUB ERR:', e, JSON.stringify(e));
    }

    return {
        schema: currentSchema,
        contextBuilder: currentContextBuilder
    };
};

Any ideas how to make it better?

You can pass values from context as headers like below;
operationHeaders:
  Authorization: Bearer {context.jwtToken}

@ardatan I have a mix of Runtime package functions and copypasted/edited CLI functions, and my Mesh allows services to register themselves, so I don't have any config there. I would try your approach but I don't completely understand where do I pass context in my case

GraphQL Mesh generates a GraphQLSchema object that can be passed to any kind of GraphQL Server.
const { schema } = getMesh(...);
app.use(graphQLHTTP(req => {
  return {
    context: {
      jwtToken: req.headers.authorization.replace('Bearer ', '') // <<< HERE
    }
  }
})

or you can directly use GraphQL Mesh CLI to serve your GraphQL API so in this case context will be upcoming HTTP request.

Thanks! I have successfully used context builder to pass JWT and Jaeger token to my underlying services.


BthPS3.sys DRIVER_POWER_STATE_FAILURE restoring from hibernate - Windows 10/11

BthPS3 version v2.0.144
Windows 11 version 22000.100
Had a DRIVER_POWER_STATE_FAILURE after restoring from Hibernate
WinDBG log as follows:
Microsoft (R) Windows Debugger Version 10.0.21349.1004 AMD64
Copyright (c) Microsoft Corporation. All rights reserved.

Loading Dump File [C:\Windows\Minidump\072521-27953-01.dmp]
Mini Kernel Dump File: Only registers and stack trace are available

************* Path validation summary **************
Response                         Time (ms)     Location
Deferred                                       srv*C:\Symbols*https://msdl.microsoft.com/download/symbols
Symbol search path is: srv*C:\Symbols*https://msdl.microsoft.com/download/symbols
Executable search path is:
Windows 10 Kernel Version 22000 MP (8 procs) Free x64
Product: WinNt, suite: TerminalServer SingleUserTS
Edition build lab: 22000.1.amd64fre.co_release.210604-1628
Machine Name:
Kernel base = 0xfffff806`7da00000 PsLoadedModuleList = 0xfffff806`7e629600
Debug session time: Sat Jul 24 21:13:06.253 2021 (UTC - 4:00)
System Uptime: 0 days 2:58:38.079
Loading Kernel Symbols
...............................................................
................................................................
................................................................
................................................................
.................
Loading User Symbols
Loading unloaded module list
........................
For analysis of this file, run !analyze -v
nt!KeBugCheckEx:
fffff806`7de129b0 48894c2408      mov     qword ptr [rsp+8],rcx ss:0018:ffffb70f`58a8f6a0=000000000000009f
7: kd> !analyze -v
*******************************************************************************
*                                                                             *
*                        Bugcheck Analysis                                    *
*                                                                             *
*******************************************************************************

DRIVER_POWER_STATE_FAILURE (9f)
A driver has failed to complete a power IRP within a specific time.
Arguments:
Arg1:<PHONE_NUMBER>000003, A device object has been blocking an IRP for too long a time
Arg2: ffffb88a95fe5a70, Physical Device Object of the stack
Arg3: ffffb70f58a8f6d0, nt!TRIAGE_9F_POWER on Win7 and higher, otherwise the Functional Device Object of the stack
Arg4: ffffb88abb075010, The blocked IRP

Debugging Details:
------------------

*** WARNING: Unable to verify timestamp for BthPS3.sys

KEY_VALUES_STRING: 1

    Key  : Analysis.CPU.mSec
    Value: 3999

    Key  : Analysis.DebugAnalysisManager
    Value: Create

    Key  : Analysis.Elapsed.mSec
    Value: 14693

    Key  : Analysis.Init.CPU.mSec
    Value: 983

    Key  : Analysis.Init.Elapsed.mSec
    Value: 603378

    Key  : Analysis.Memory.CommitPeak.Mb
    Value: 90

    Key  : WER.OS.Branch
    Value: co_release

    Key  : WER.OS.Timestamp
    Value: 2021-06-04T16:28:00Z

    Key  : WER.OS.Version
    Value: 10.0.22000.1

TAG_NOT_DEFINED_202b:  *** Unknown TAG in analysis list 202b

BUGCHECK_CODE:  9f

BUGCHECK_P1: 3

BUGCHECK_P2: ffffb88a95fe5a70

BUGCHECK_P3: ffffb70f58a8f6d0

BUGCHECK_P4: ffffb88abb075010

DRVPOWERSTATE_SUBCODE:  3

DRIVER_OBJECT: ffffb88a80632e10

IMAGE_NAME:  BthPS3.sys

MODULE_NAME: BthPS3

FAULTING_MODULE: fffff8069a6f0000 BthPS3

BLACKBOXBSD: 1 (!blackboxbsd)

BLACKBOXNTFS: 1 (!blackboxntfs)

BLACKBOXPNP: 1 (!blackboxpnp)

BLACKBOXWINLOGON: 1

CUSTOMER_CRASH_COUNT:  1

PROCESS_NAME:  System

STACK_TEXT:
ffffb70f`58a8f698 fffff806`7dfc2ca7     : 00000000`0000009f 00000000`00000003 ffffb88a`95fe5a70 ffffb70f`58a8f6d0 : nt!KeBugCheckEx
ffffb70f`58a8f6a0 fffff806`7dfc2bc1     : ffffb88a`89eac208 00000000`00000080 ffffb70f`58a8f9f8 ffffb70f`58a8f9f0 : nt!PopIrpWatchdogBugcheck+0xdf
ffffb70f`58a8f710 fffff806`7dc12824     : 00000000`00000000 ffffb88a`00000001 ffffb70f`00000000 ffffb88a`00000002 : nt!PopIrpWatchdog+0x31
ffffb70f`58a8f760 fffff806`7dc10e14     : 00000000`00000000 00000000`00000000 00000000`00000000 fffff806`7aa52648 : nt!KiProcessExpiredTimerList+0x204
ffffb70f`58a8f890 fffff806`7de168fe     : 00000000`00000000 ffff8101`9fdd6180 ffff8101`9fde2240 ffffb88a`86bbd080 : nt!KiRetireDpcList+0x714
ffffb70f`58a8fb40 00000000`00000000     : ffffb70f`58a90000 ffffb70f`58a89000 00000000`00000000 00000000`00000000 : nt!KiIdleLoop+0x9e

STACK_COMMAND:  .thread ; .cxr ; kb

FAILURE_BUCKET_ID:  0x9F_3_IMAGE_BthPS3.sys

OS_VERSION:  10.0.22000.1

BUILDLAB_STR:  co_release

OSPLATFORM_TYPE:  x64

OSNAME:  Windows 10

FAILURE_ID_HASH:  {328a30da-bacc-a428-20ed-22a427c03a3c}

Followup:     MachineOwner
---------

Aw sh... It's back 😭

Just had this too

Just had this too

yup same lol hopefully they can fix it.

Just had this too

yup same lol hopefully they can fix it. i think it happens when you leave controller plugged in then turn on pc to desktop then wait maybe around 5-20 mins then it happened. not really sure if it happens consistent, ill test it later.

Yes, it's a known issue. As a workaround make sure to disconnect your controllers before you send the machine to sleep.
The behaviour is pretty consistent to reproduce, connect controller, send PC to sleep, wake it up, almost exactly 10 minutes later (Windows Kernel Watchdog Timer) the BSOD happens.
I haven't had the time to look into it yet so simply watch this issue's progress and I don't need anymore "happens to me too" comments for the time being, thank you 😛

Yes, it's a known issue. As a workaround make sure to disconnect your controllers before you send the machine to sleep.
The behaviour is pretty consistent to reproduce, connect controller, send PC to sleep, wake it up, almost exactly 10 minutes later (Windows Kernel Watchdog Timer) the BSOD happens.
I haven't had the time to look into it yet so simply watch this issue's progress and I don't need anymore "happens to me too" comments for the time being, thank you 😛

Still happens while controller is disconnected hope this helps you to find those lines. Sorry if im bothering you.

Maybe I'm just getting lazy; I had two of these crashes this week.

Yes, it's a known issue. As a workaround make sure to disconnect your controllers before you send the machine to sleep.
The behaviour is pretty consistent to reproduce, connect controller, send PC to sleep, wake it up, almost exactly 10 minutes later (Windows Kernel Watchdog Timer) the BSOD happens.
I haven't had the time to look into it yet so simply watch this issue's progress and I don't need anymore "happens to me too" comments for the time being, thank you 😛

Still happens while controller is disconnected hope this helps you to find those lines. Sorry if im bothering you.

Maybe I'm just getting lazy; I had two of these crashes this week.

  So yes it appears to be due to having the controller connected to Bluetooth when the system goes to sleep.

I. Know. 🙂

Yes, I will confirm on 21H1/2 as well. Usually happens about :30-1 minute after resuming from sleep. Subscribed.

I'll double this
Выпуск	Windows 10 Education
Os Build 19043.1348
Windows Feature Experience Pack 120.2212.3920.0
Same bsod
Will upload memory dump later

I am aware 🙂

Found the issue. Will need a bit of rework to address it fully but we're getting there 😌

Work to tackle this has started on the branch nefarius/issue/DRIVER_POWER_STATE_FAILURE-fix
The plan is to remove chunks of legacy verbose sections with DMF, especially the child device creation and lifetime handling. The underlying issue is, that currently upon power down for sleep/hibernation the controller gets disconnected, but it also destroys the WDFDEVICE of the PDO, which then is not available after wake-up and the request sent to it is orphaned and triggers the crash when the kernel watchdog runs and finds it.
The plan is to rewrite the child handling code with modern substitutes and change the behaviour on power down to keep the device and resume it when the user wakes up the machine and connects the controller again.
This sounds simple on paper but will require a fair bit of work and testing, but it's the way to go, so stay tuned 😉

How is this fix coming along? Just ran in to this problem on win11 as well.

How is this fix coming along? Just ran in to this problem on win11 as well.

I was buried in company work last couple weeks so not much progress, as can be seen by the commits messages.

Ah, understandable sorry to bother you. Hadn't read the thread. I wish I could help, but unfortunately I am not very familiar with developing for windows.

Oof, looking at the code again with a few months break is an experience... Like "who wrote this... oh, right, it was me..."

Sorry for making a Duplicate was tired while looking into this but I just realised this morning that it was caused by Fastboot (still technically hibernate issue) as I turned my pc off with the controller also off then booting it back up later in the day

Aye, it's on the Roadmap. For 2022. I hope. 😬 So much to do lately it's crazy.

still waiting for the fix, my laptop bsod a couple of times:) i thought my windows/other devices on my laptop making the bsod happen.

Can you guys that add nothing to the issue stop spamming/whining? Its annoying when you‘re subscribed here.

It's the social media generation. Gotta post something even if it adds nothing whatsoever.

For me its crashing my pc even if no controllers are connected

                                                                        *

                   Bugcheck Analysis                                    *

                                                                        *

DRIVER_POWER_STATE_FAILURE (9f)
A driver has failed to complete a power IRP within a specific time.
Arguments:
Arg1:<PHONE_NUMBER>000003, A device object has been blocking an IRP for too long a time
Arg2: ffffcd0990d7ade0, Physical Device Object of the stack
Arg3: fffff80058091850, nt!TRIAGE_9F_POWER on Win7 and higher, otherwise the Functional Device Object of the stack
Arg4: ffffcd0990b93010, The blocked IRP
Debugging Details:
*** WARNING: Unable to verify timestamp for BthPS3.sys
KEY_VALUES_STRING: 1
Key  : Analysis.CPU.mSec
Value: 6703

Key  : Analysis.DebugAnalysisManager
Value: Create

Key  : Analysis.Elapsed.mSec
Value: 42890

Key  : Analysis.Init.CPU.mSec
Value: 812

Key  : Analysis.Init.Elapsed.mSec
Value: 147156

Key  : Analysis.Memory.CommitPeak.Mb
Value: 89

FILE_IN_CAB:<PHONE_NUMBER>0-01.dmp
DUMP_FILE_ATTRIBUTES: 0x8
Kernel Generated Triage Dump
BUGCHECK_CODE:  9f
BUGCHECK_P1: 3
BUGCHECK_P2: ffffcd0990d7ade0
BUGCHECK_P3: fffff80058091850
BUGCHECK_P4: ffffcd0990b93010
DRVPOWERSTATE_SUBCODE:  3
DRIVER_OBJECT: ffffcd099018d800
IMAGE_NAME:  BthPS3.sys
MODULE_NAME: BthPS3
FAULTING_MODULE: fffff80065bb0000 BthPS3
BLACKBOXBSD: 1 (!blackboxbsd)
BLACKBOXNTFS: 1 (!blackboxntfs)
BLACKBOXPNP: 1 (!blackboxpnp)
BLACKBOXWINLOGON: 1
CUSTOMER_CRASH_COUNT:  1
PROCESS_NAME:  System

Seriously, people, what do you expect posting the same thing over and over again? That I magically get more time to work on the fix? If anything, now it will take longer 😒

I am ocassionally getting a STATUS_DEVICE_POWER_FAILURE error in device manager for the Nefarius Bluetooth PS Enumerator device. No *SOD, though, just the device and thus the PS3 controller (over BT, USB is fine) doesn't work until restart. I didn't hibernate/sleep, just turned bluetooth on/off a few times. DsHidMini claims everything is fine, even though it's not. Restart fixes this. Windows 11, Intel BT v<IP_ADDRESS>

And locked until further notice.

Found and reported a bug in DMF that currently keeps this on hold, hopefully MS' guys soon have an update, then a huge chunk of legacy code is ready to be replaced with Dmf_Pdo 🎉

Alright, the DMF bug was squashed, replacement code works a treat, now fixing and testing the power-related issues.

The issue is resolved 🥳 a few more things are left to do, then a new release will be published.

Here we go, have fun testing!


🐛 [Bug] torchvision.ops.roi_align is throwing an internal assert failed

Bug Description
torchvision.ops.roi_align is throwing an internal assert failure when compiling a model using it with torch_tensorrt.compile.
To Reproduce
Repro script: trt_bug3.py
brett@br-workhorse:~/repos/Autosensor/NN/tmp$ python3 trt_bug3.py
torch.Size([20, 3, 6, 9])
torch.Size([20, 3, 6, 9])
WARNING: [Torch-TensorRT] - Cannot infer input type from calcuations in graph for input x.1. Assuming it is Float32. If not, specify input type explicity
WARNING: [Torch-TensorRT] - Input type for doing shape analysis could not be determined, defaulting to F32
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT] - Truncating graph input type from at::kLong to at::kInt
WARNING: [Torch-TensorRT TorchScript Conversion Context] - TensorRT was linked against cuBLAS/cuBLAS LT 11.8.0 but loaded cuBLAS/cuBLAS LT 111.0.1
WARNING: [Torch-TensorRT] - There may be undefined behavior using dynamic shape and aten::size
WARNING: [Torch-TensorRT TorchScript Conversion Context] - TensorRT was linked against cuBLAS/cuBLAS LT 11.8.0 but loaded cuBLAS/cuBLAS LT 111.0.1
WARNING: [Torch-TensorRT] - There may be undefined behavior using dynamic shape and aten::size
WARNING: [Torch-TensorRT TorchScript Conversion Context] - TensorRT was linked against cuBLAS/cuBLAS LT 11.8.0 but loaded cuBLAS/cuBLAS LT 111.0.1
WARNING: [Torch-TensorRT TorchScript Conversion Context] - Unused Input: input_1
WARNING: [Torch-TensorRT TorchScript Conversion Context] - [RemoveDeadLayers] Input Tensor input_1 is unused or used only at compile-time, but is not being removed.
WARNING: [Torch-TensorRT TorchScript Conversion Context] - TensorRT was linked against cuBLAS/cuBLAS LT 11.8.0 but loaded cuBLAS/cuBLAS LT 111.0.1
WARNING: [Torch-TensorRT] - There may be undefined behavior using dynamic shape and aten::size
WARNING: [Torch-TensorRT TorchScript Conversion Context] - Unused Input: input_3
WARNING: [Torch-TensorRT TorchScript Conversion Context] - [RemoveDeadLayers] Input Tensor input_3 is unused or used only at compile-time, but is not being removed.
WARNING: [Torch-TensorRT TorchScript Conversion Context] - TensorRT was linked against cuBLAS/cuBLAS LT 11.8.0 but loaded cuBLAS/cuBLAS LT 111.0.1
WARNING: [Torch-TensorRT TorchScript Conversion Context] - TensorRT was linked against cuBLAS/cuBLAS LT 11.8.0 but loaded cuBLAS/cuBLAS LT 111.0.1
WARNING: [Torch-TensorRT] - There may be undefined behavior using dynamic shape and aten::size
WARNING: [Torch-TensorRT TorchScript Conversion Context] - TensorRT was linked against cuBLAS/cuBLAS LT 11.8.0 but loaded cuBLAS/cuBLAS LT 111.0.1
WARNING: [Torch-TensorRT] - There may be undefined behavior using dynamic shape and aten::size
WARNING: [Torch-TensorRT TorchScript Conversion Context] - TensorRT was linked against cuBLAS/cuBLAS LT 11.8.0 but loaded cuBLAS/cuBLAS LT 111.0.1
WARNING: [Torch-TensorRT TorchScript Conversion Context] - Unused Input: input_1
WARNING: [Torch-TensorRT TorchScript Conversion Context] - [RemoveDeadLayers] Input Tensor input_1 is unused or used only at compile-time, but is not being removed.
WARNING: [Torch-TensorRT TorchScript Conversion Context] - TensorRT was linked against cuBLAS/cuBLAS LT 11.8.0 but loaded cuBLAS/cuBLAS LT 111.0.1
WARNING: [Torch-TensorRT] - There may be undefined behavior using dynamic shape and aten::size
WARNING: [Torch-TensorRT TorchScript Conversion Context] - Unused Input: input_3
WARNING: [Torch-TensorRT TorchScript Conversion Context] - [RemoveDeadLayers] Input Tensor input_3 is unused or used only at compile-time, but is not being removed.
WARNING: [Torch-TensorRT TorchScript Conversion Context] - TensorRT was linked against cuBLAS/cuBLAS LT 11.8.0 but loaded cuBLAS/cuBLAS LT 111.0.1
Traceback (most recent call last):
  File "/home/brett/repos/Autosensor/NN/tmp/trt_bug3.py", line 79, in <module>
    trt_m = torch_tensorrt.compile(scr_m, inputs=[torch_tensorrt.Input((2, 3, 10, 10)), ], truncate_long_and_double=True)
  File "/home/brett/.local/lib/python3.10/site-packages/torch_tensorrt/_compile.py", line 115, in compile
    return torch_tensorrt.ts.compile(ts_mod, inputs=inputs, enabled_precisions=enabled_precisions, **kwargs)
  File "/home/brett/.local/lib/python3.10/site-packages/torch_tensorrt/ts/_compiler.py", line 113, in compile
    compiled_cpp_mod = _C.compile_graph(module._c, _parse_compile_spec(spec))
RuntimeError: The following operation failed in the TorchScript interpreter.
Traceback of TorchScript (most recent call last):
  File "/home/brett/.local/lib/python3.10/site-packages/torchvision/ops/_utils.py", line 30, in forward
def check_roi_boxes_shape(boxes: Union[Tensor, List[Tensor]]):
    if isinstance(boxes, (list, tuple)):
        for _tensor in boxes:
        ~~~~~~~~~~~~~~~~~~~~~
            assert (
            ~~~~~~~~
                _tensor.size(1) == 4
                ~~~~~~~~~~~~~~~~~~~~
            ), "The shape of the tensor in the boxes list is not correct as List[Tensor[L, 4]]"
            ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ <--- HERE
    elif isinstance(boxes, torch.Tensor):
        assert boxes.size(1) == 5, "The boxes tensor shape is not correct as Tensor[K, 5]"
RuntimeError: isList()INTERNAL ASSERT FAILED at "/home/brett/github/pytorch/aten/src/ATen/core/ivalue_inl.h":1884, please report a bug to PyTorch. Expected GenericList but got Tensor

Expected behavior
Expected graph compilation to succeed.
Environment
brett@br-workhorse:~/repos/Autosensor/NN/tmp$ python3 -c "from torch.utils.collect_env import main; main()"
Collecting environment information...
PyTorch version: 1.11.0a0+gitbc2c6ed
Is debug build: False
CUDA used to build PyTorch: 11.7
ROCM used to build PyTorch: N/A

OS: Ubuntu 22.04 LTS (x86_64)
GCC version: (Ubuntu 11.2.0-19ubuntu1) 11.2.0
Clang version: Could not collect
CMake version: version 3.22.1
Libc version: glibc-2.35

Python version: 3.10.4 (main, Apr  2 2022, 09:04:19) [GCC 11.2.0] (64-bit runtime)
Python platform: Linux-5.15.0-37-generic-x86_64-with-glibc2.35
Is CUDA available: True
CUDA runtime version: 11.7.64
GPU models and configuration: GPU 0: NVIDIA GeForce GTX 1080 Ti
Nvidia driver version: 515.48.07
cuDNN version: Probably one of the following:
/usr/lib/x86_64-linux-gnu/libcudnn.so.7.6.5
/usr/lib/x86_64-linux-gnu/libcudnn.so.8.3.2
/usr/lib/x86_64-linux-gnu/libcudnn_adv_infer.so.8.3.2
/usr/lib/x86_64-linux-gnu/libcudnn_adv_train.so.8.3.2
/usr/lib/x86_64-linux-gnu/libcudnn_cnn_infer.so.8.3.2
/usr/lib/x86_64-linux-gnu/libcudnn_cnn_train.so.8.3.2
/usr/lib/x86_64-linux-gnu/libcudnn_ops_infer.so.8.3.2
/usr/lib/x86_64-linux-gnu/libcudnn_ops_train.so.8.3.2
HIP runtime version: N/A
MIOpen runtime version: N/A

Versions of relevant libraries:
[pip3] mypy-extensions==0.4.3
[pip3] numpy==1.21.6
[pip3] numpy-quaternion==2022.4.1
[pip3] pytorch-ranger==0.1.1
[pip3] torch==1.11.0
[pip3] torch-optimizer==0.1.0
[pip3] torch-tensorrt==1.2.0a0+22d91f5e
[pip3] torchmetrics==0.7.3
[pip3] torchsummary==1.5.1
[pip3] torchvision==0.12.0
[conda] Could not collect

TensorRT is built from 91a92ca4 with PR #1067 merged in
brett@br-workhorse:~/github/TensorRT$ git log --oneline --graph
* 22d91f5e (HEAD -> master) fix: fix the bug that tag Constant node as fallback node
*   ccb826e7 Merge remote-tracking branch 'origin' into refactor_segmentation
|\
| * 91a92ca4 (origin/master, origin/HEAD) docs: [Automated] Regenerating documenation for dcf3386
| *   dcf3386e Merge pull request #1057 from pytorch/anuragd/reduce_nox_sessions

As a temporary work-around while this and other issues are getting fixed, is it possible to tell torch_tensorrt.compile to ignore certain sections of the model? E.g., to compile the backbone of the network, but leave the rest as scripted or traced?

I see that the torch_executed_modules is intended for this, but I haven't been able to get it to work. How does one specify these modules?
E.g., in this simple script trt_bug4.py everything always gets compiled despite all the variants I'm passing to torch_executed_modules.


fix: issue with documentation

:tada: This PR is included in version 0.11.0-beta.23 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Whe UDF fails we don't print any details

And that's pretty much it.
It's weird that sometimes I can actually see some messages, but not in this case.

Can we do the basic research? If it fails see if we print stack trace, if fails to start for some reason also, etc.

Okay, the difference might be parallel flag. Let's check if in parallel mode we are getting actual results.

Is there any output before the traceback?

yes, but it's primarily the same - stack trace to save() function or something (kinda dc internal stack trace, no details)


[All] (Overview) Fix placement of image on overview page

My understanding is that moving this will improve SEO

Docs Build status updates of commit 3eb41f0:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

_dependentPackages/CommonPlugins/tools/JoinTOC.ps1
:x:Error

Details

.openpublishing.publish.config.json
:x:Error

Details

:x:Error

Details

_dependentPackages/CommonPlugins/tools/JoinTOC.ps1

Line 82: [Error] Error happened when executing plug-in script _dependentPackages/CommonPlugins/tools/JoinTOC.ps1 at step docset_prebuild. Please check your .openpublishing.publish.config.json?on the configuration of the plug-ins or ask for help?in Docs Support teams channel. Exit code: -1073741502
Line 217: [Error] Error happened when executing plug-in script _dependentPackages/CommonPlugins/tools/JoinTOC.ps1 at step docset_prebuild. Please check your .openpublishing.publish.config.json?on the configuration of the plug-ins or ask for help?in Docs Support teams channel. Please also include the build report and the following error code for our team to troubleshoot: 1

.openpublishing.publish.config.json

Line 80: [Error] Failed to execute customized script at step docset_prebuild in docset office-js-docs-pr. Please check your .openpublishing.publish.config.json?on the configuration of the plug-ins for docset office-js-docs-pr step docset_prebuild or ask for help?in Docs Support teams channel. Please also include the build report and the following error code for our team to troubleshoot: 1

Line 138: [Error] W:\sb1r-s\.optemp\packages\opbuild.scripts.1.84.4\tools\opbuild\docset.prebuild.ps1 failed to execute

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Docs Build status updates of commit 3eb41f0:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/overview/office-add-ins.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


matrix-synapse: 1.84.1 -> 1.85.0

Description of changes
https://github.com/matrix-org/synapse/releases/tag/v1.85.0
Signed-off-by: Sumner Evans<EMAIL_ADDRESS>
Things done
Running on my server and it is working fine

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[x] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 236288 run on x86_64-linux 1

2 packages blacklisted:

nixos-install-tools
tests.nixos-functions.nixos-test

8 packages built:

matrix-synapse
matrix-synapse-plugins.matrix-synapse-ldap3
matrix-synapse-plugins.matrix-synapse-ldap3.dist
matrix-synapse-plugins.matrix-synapse-mjolnir-antispam
matrix-synapse-plugins.matrix-synapse-mjolnir-antispam.dist
matrix-synapse-plugins.matrix-synapse-shared-secret-auth
matrix-synapse-plugins.matrix-synapse-shared-secret-auth.dist
matrix-synapse.dist

@ofborg build matrix-synapse

build fails in ofborg on aarch64-linux, but I can not reproduce this on my local aarch64-linux machine.

Everything seems to be working as expected on my homeserver!

@ofborg build matrix-synapse


contact name and organization remain empty at fgdc format

when importing https://water.usgs.gov/GIS/metadata/usgswrd/XML/gagesII_Sept2011.xml as fgdc I noticed the name and organization property remain empty on the result object in owslib. although https://github.com/geopython/OWSLib/blob/6a333c30a365a5702d8c9e93882f1589d84c6f48/owslib/fgdc.py#L252-L256 looks fine, not sure what's happening there.

mmm, this works fine if i run from console
print(vars(Metadata(etree.parse('fgdc-sample.xml'))))


Doesn't handle dsa keys

script is hard coded to look for ssh-rsa at the beginning of the keyfile.  ssh-dss is also valid and should be supported.
See here:
https://github.com/chadkouse.keys

Using ssh-keygen to check keys integrity now, tested with your keys and it went fine.
Commit 3ceec28daca4c601fa167e2f52866de92bcd4b16


Latex newline broken

In GitLab by @lakhoune on Feb 13, 2021, 20:53

Location: card
Description: When latex is enabled new lines are not put in a new line
Steps to reproduce: Load a card that has latex enabled and that has a paragraph with a new line (outside of mathmode)

In GitLab by @lakhoune on Feb 13, 2021, 20:54
To fix this we probably need to replace the newline character with \newline from latex

In GitLab by @erdzan on Feb 20, 2021, 23:02
mentioned in commit a3112cd02148e60aec4d8003d8f4e2f2d2133785


Fix default host urls used by compute

The default host url values for compute were incorrect and causing UnknownHostException errors.

Closing this PR without merging.  The modified URLs need to point to internal aliases to avoid accidentally referencing services on the external network.


Initial java controller cli hello world test

Problems:
Need to create initial java controller e2e test
This PR adds the java controller hello world test program.
Test:
./scripts/run_in_build_env.sh                   "./scripts/build/build_examples.py --no-log-timestamps --target android-x86-chip-tool build"
java -cp ./out/android-x86-chip-tool/lib/src/controller/tests/java/ControllerCLI.jar chip.devicecontroller.HelloWorld

close it, would go with https://github.com/project-chip/connectedhomeip/pull/23048


Unified sentry-sdk integration does not have support to add stack trace in python logger using 'stack': True in extra dict.

Migration from raven to unified sentry sdk, affected extended functionalities to python logging provided by raven. _extra_from_record - excludes keywords 'stack' and 'data'. Is there a known workaround?

Set exc_info=True, it's used for both callstack and exception stack now.
On Sat, Apr 13, 2019, 10:11 Gagan<EMAIL_ADDRESS>wrote:

Migration from raven to unified sentry sdk, affected extended
functionalities to python logging provided by raven. _extra_from_record -
excludes keywords 'stack' and 'data'. Is there a known workaround?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/getsentry/sentry-python/issues/336, or mute the
thread
https://github.com/notifications/unsubscribe-auth/AAGMPRI6YZ25H6YC2BI6MNDPQGITBANCNFSM4HFXVORA
.

About 'data' key in extra. It is also used for breadcrumbs, is that the reason we can't use it in python logging?

Good point, this seems like a bug. Likely a copy paste error from raven.
Would certainly appreciate a PR!
On Sat, Apr 13, 2019, 10:16 Gagan<EMAIL_ADDRESS>wrote:

About 'data' key in extra. It is also used for breadcrumbs, is that the
reason we can't use it in python logging?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/getsentry/sentry-python/issues/336#issuecomment-482788026,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAGMPRKGE6ULYIZI6CUGSLTPQGJENANCNFSM4HFXVORA
.

Here https://github.com/getsentry/sentry-python/pull/337


NIFI-2610 added initial support for categorizing tests

Due to Travis failure, I am pulling this PR and will @Ignore the failing tests instead. I'll also raise a separate JIRA to address Travis issue in the future.


Linux driver stalls if a signal is received

Required Info

Camera Model
D400

Firmware Version
Unknown

Operating System & Version
Ubuntu 16

Kernel Version (Linux Only)
Unknown

Platform
Custom

SDK Version
Latest 2.x from GitHub

Issue Description
When a process using the RealSense API receives a signal, the driver stalls.  This is because EINTR from a select call in backend-v4l2.cpp is not handled by attempting a retry.  The attached patch fixes this issue in the testing I did.  I'm hoping someone can take a look if this indeed looks like a bug, and whether there are any problems with the proposed fix.
select_check_eintr.patch.txt

[Realsense Customer Engineering Team Comment]
@richardroberts, please file the PR to request engineer review. Thank you.

I created PR based on the patch, @richardroberts, thank you for bringing this up.
Could you please provide some extra context regarding how to reproduce the issue?
We are exercising the V4L2 backend in our QA lab regularly for long periods of time, but never came across such problem.

Thank you for the followup.  The issue arose on an embedded Intel Pentium platform, using Ubuntu Linux with realtime patches.  A guess about why it occurred, is that we have some threads with very high priority running, and several sensors and I/O connected, so this may mean frequent interrupts cause the read to sometimes return early so that the kernel can deal with some I/O (very much a guess here).
The issue never occurred for me when testing on the desktop, but only occurred on the embedded platform, where it did occur repeatably.  On the embedded platform we could usually stream from the camera for anywhere between a few seconds to a minute before this hang occurred.
I think a commercially-available computer most likely to reproduce this issue would be an "Up Board".  If necessary, I might be able to work with you so that you're able to reproduce the issue, for this, contact me over email.

Great. I tested the patch a bit on my machine. We have couple of Up-Boards in the lab, but don't run regular and prolong validation on them. We'll try to run a longer cycle on it to make sure the problem does not come back.

[Realsense Customer Engineering Team Comment]
@richardroberts
The code has been merged into development branch, if your problem is fixed, can you help to close the issue? Thank you.

Ok, if I understand correctly, you would like me to close the issue, so I'm doing that.  Thanks!


Add ruby 2.7 to mac binary packages

Add ruby 2.7 to mac binary packages

Build failed with:
cd -
mkdir -p /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0
cd /Users/kbuilder/.rake-compiler/sources
tar xf ruby-2.7.0.tar.bz2
cd -
cp /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/Makefile.in /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/Makefile.in.bak
rake aborted!
Errno::ENOENT: No such file or directory @ rb_sysopen - /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/Makefile.in
/Volumes/BuildData/tmpfs/src/github/grpc/tmpfile.zIlTDEOA:98:in `block in <top (required)>'
/Users/kbuilder/.rvm/gems/ruby-2.5.0@global/gems/rake-12.3.0/exe/rake:27:in `<top (required)>'
/Users/kbuilder/.rvm/gems/ruby-2.5.0/bin/ruby_executable_hooks:24:in `eval'
/Users/kbuilder/.rvm/gems/ruby-2.5.0/bin/ruby_executable_hooks:24:in `<main>'
Tasks: TOP => cross-ruby => install => /Users/kbuilder/.rake-compiler/ruby/x86_64-darwin11/ruby-2.7.0/bin/ruby.exe => /Users/kbuilder/.rake-compiler/builds/x86_64-darwin11/ruby-2.7.0/ruby.exe => /Users/kbuilder/.rake-compiler/builds/x86_64-darwin11/ruby-2.7.0/Makefile => /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/Makefile.in => /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/Makefile.in.bak
(See full trace by running task with --trace)

... ruby 2.7 no longer has a Makefile.in (https://github.com/ruby/ruby/tree/ruby_2_7)

error now:
Apple LLVM version 9.0.0 (clang-9<IP_ADDRESS>)
Target: x86_64-apple-darwin17.7.0
Thread model: posix
InstalledDir: /Applications/Xcode_9.2.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin
/Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/revision.h unchanged
generating enc.mk
making srcs under enc
making enc
make[1]: make[1]: warning: -jN forced in submake: disabling jobserver mode.warning: -jN forced in submake: disabling jobserver mode.

make[1]: Nothing to be done for `enc'.
make[1]: Nothing to be done for `srcs'.
generating transdb.h
transdb.h unchanged
generating makefiles ext/configure-ext.mk
making trans
make[1]: warning: -jN forced in submake: disabling jobserver mode.
make[1]: Nothing to be done for `/Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/enc/trans'.
making encs
make[1]: warning: -jN forced in submake: disabling jobserver mode.
ext/configure-ext.mk unchanged
make[1]: Nothing to be done for `encs'.
make[1]: warning: -jN forced in submake: disabling jobserver mode.
make[1]: Nothing to be done for `all'.
make[1]: warning: -jN forced in submake: disabling jobserver mode.
make[1]: Nothing to be done for `note'.
/Users/kbuilder/.rvm/rubies/ruby-2.5.0/bin/ruby --disable=gems -I/Users/kbuilder/.rake-compiler/builds/x86_64-darwin11/ruby-2.7.0 -rx86_64-darwin11-fake  -I`cd /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib; pwd` --disable-gems -r./x86_64-darwin11-fake /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/tool/rbinstall.rb --make="make -j8" --dest-dir="" --extout=".ext" --mflags="- --jobserver-fds=4,5 -j" --make-flags=" --jobserver-fds=4,5 -j" --data-mode=0644 --prog-mode=0755 --installed-list .installed.list --mantype="doc" --exclude=doc
/Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/delegate.rb:78:in `<class:Delegator>': undefined method `ruby2_keywords' for Delegator:Class (NoMethodError)
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/delegate.rb:39:in `<top (required)>'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/rubygems/core_ext/kernel_require.rb:72:in `require'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/rubygems/core_ext/kernel_require.rb:72:in `require'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/tempfile.rb:8:in `<top (required)>'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/rubygems/core_ext/kernel_require.rb:72:in `require'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/rubygems/core_ext/kernel_require.rb:72:in `require'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/rubygems/ext/ext_conf_builder.rb:9:in `<top (required)>'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/rubygems/core_ext/kernel_require.rb:72:in `require'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/rubygems/core_ext/kernel_require.rb:72:in `require'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/rubygems/ext.rb:16:in `<top (required)>'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/rubygems/core_ext/kernel_require.rb:72:in `require'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/rubygems/core_ext/kernel_require.rb:72:in `require'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/rubygems/installer.rb:12:in `<top (required)>'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/rubygems/core_ext/kernel_require.rb:72:in `require'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/lib/rubygems/core_ext/kernel_require.rb:72:in `require'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/tool/rbinstall.rb:708:in `<module:RbInstall>'
	from /Users/kbuilder/.rake-compiler/sources/ruby-2.7.0/tool/rbinstall.rb:644:in `<main>'
make: *** [do-install-nodoc] Error 1
rake aborted!
Command failed with status (2): [make -j8 install...]
/Volumes/BuildData/tmpfs/src/github/grpc/tmpfile.BrISQcBP:172:in `block (2 levels) in <top (required)>'
/Volumes/BuildData/tmpfs/src/github/grpc/tmpfile.BrISQcBP:171:in `block in <top (required)>'
/Users/kbuilder/.rvm/gems/ruby-2.5.0@global/gems/rake-12.3.0/exe/rake:27:in `<top (required)>'
/Users/kbuilder/.rvm/gems/ruby-2.5.0/bin/ruby_executable_hooks:24:in `eval'
/Users/kbuilder/.rvm/gems/ruby-2.5.0/bin/ruby_executable_hooks:24:in `<main>'
Tasks: TOP => cross-ruby => install => /Users/kbuilder/.rake-compiler/ruby/x86_64-darwin11/ruby-2.7.0/bin/ruby.exe
(See full trace by running task with --trace)

[ID: 4025321] Build finished after 924 secs, exit value: 1

basic tests node macos: https://github.com/grpc/grpc/issues/20624
bazel c/C++ dbg macos: https://github.com/grpc/grpc/issues/21895
interop alts was issue mentioned in https://github.com/grpc/grpc-java/pull/6780
build_docker_java: https://github.com/grpc/grpc/issues/18892


[Question]: Configure context text for as_query_engine

Question Validation

[X] I have searched both the documentation and discord for an answer.

Question
It seems that the context text includes the page_label and the file_name when I use a VectorStoreIndex as as_query_engine. What would be the appropriate way to remove this and only include the contents of the text?

@debraj135 you can set the metadata keys to be used in LLM or Embedding calls
document.excluded_llm_metadata_keys = ["page_label", "file_name"]
document.excluded_embed_metadata_keys = ["page_label", "file_name"]

The same functionality exists for nodes as well
Source:
https://docs.llamaindex.ai/en/stable/module_guides/loading/documents_and_nodes/usage_documents.html#advanced-metadata-customization


Training -> Something went wrong

Trying to train a model but i get this error after the start
File "/content/diffusers/examples/dreambooth/train_dreambooth.py", line 852, in <module>     main()   File "/content/diffusers/examples/dreambooth/train_dreambooth.py", line 726, in main     accelerator.clip_grad_norm_(params_to_clip, args.max_grad_norm)   File "/usr/local/lib/python3.8/dist-packages/accelerate/accelerator.py", line 920, in clip_grad_norm_     self.unscale_gradients()   File "/usr/local/lib/python3.8/dist-packages/accelerate/accelerator.py", line 904, in unscale_gradients     self.scaler.unscale_(opt)   File "/usr/local/lib/python3.8/dist-packages/torch/cuda/amp/grad_scaler.py", line 282, in unscale_     optimizer_state["found_inf_per_device"] = self._unscale_grads_(optimizer, inv_scale, found_inf, False)   File "/usr/local/lib/python3.8/dist-packages/torch/cuda/amp/grad_scaler.py", line 210, in _unscale_grads_     raise ValueError("Attempting to unscale FP16 gradients.") ValueError: Attempting to unscale FP16 gradients.   0% 0/1500 [00:02<?, ?it/s] Traceback (most recent call last):   File "/usr/local/bin/accelerate", line 8, in <module>     sys.exit(main())   File "/usr/local/lib/python3.8/dist-packages/accelerate/commands/accelerate_cli.py", line 43, in main     args.func(args)   File "/usr/local/lib/python3.8/dist-packages/accelerate/commands/launch.py", line 837, in launch_command     simple_launcher(args)   File "/usr/local/lib/python3.8/dist-packages/accelerate/commands/launch.py", line 354, in simple_launcher     raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd) subprocess.CalledProcessError: Command '['/usr/bin/python3', '/content/diffusers/examples/dreambooth/train_dreambooth.py', '--stop_text_encoder_training=250', '--image_captions_filename', '--train_only_unet', '--save_starting_step=500', '--save_n_steps=0', '--Session_dir=/content/gdrive/MyDrive/Fast-Dreambooth/Sessions/klausreal', '--pretrained_model_name_or_path=/content/stable-diffusion-custom', '--instance_data_dir=/content/gdrive/MyDrive/Fast-Dreambooth/Sessions/klausreal/instance_images', '--output_dir=/content/models/klausreal', '--captions_dir=/content/gdrive/MyDrive/Fast-Dreambooth/Sessions/klausreal/captions', '--instance_prompt=', '--seed=873045', '--resolution=768', '--mixed_precision=fp16', '--train_batch_size=1', '--gradient_accumulation_steps=1', '--gradient_checkpointing', '--use_8bit_adam', '--learning_rate=2e-06', '--lr_scheduler=polynomial', '--lr_warmup_steps=0', '--max_train_steps=1500']' returned non-zero exit status 1. Something went wrong

The model you're using is in FP16, did you use a huggingface path to the custom model ? if so, try using the ckpt link to allow it to convert to fp32 before training.

Is there a place to check this off or does it happen automatically?

if you're not sure if the model is fp16 or not, just use the ckpt instead of the huggingface path to the diffusers model