Web App Migration hangs at 10% in portal. White page on web server app migration tool

Investigative information
Please provide the following:

UTC Timestamp:
Migration Tool App version :
OS Version:

Repro steps
Provide the steps required to reproduce the problem:

Expected behavior
Provide a description of the expected behavior.

Actual behavior
Provide a description of the actual behavior observed.

Known workarounds
Provide a description of any known workarounds.

Attached image shows where the tool is at right before it goes white.

Hello @lsgordon78
This looks a like an issue that was fixed in the most recent (Preview) version. Could you try using the latest 1.0.8 version and let us know if that does not resolve this issue for you?
As an alternative you have the option to complete the migration for this site manually - this is outlined a bit in comments in https://github.com/Azure/App-Service-Migration-Assistant/issues/31, but to summarize:

the site has been created and your content was zipped and should be in a location similar to this one (with your username/sitename and different numbers at the end): C:\Users[username]\AppData\Local\Temp[siteName]_1234567890123.zip", locate it (or you can create the zip using command noted in that linked issue)
Go to the "scm" for the site you created during the migration: YourSiteName.scm.azurewebsites.net
Click on "Debug Console" and choose either the CMD or PowerShell option to get to the file content view
You should see 2 folders listed: "LogFiles" and "Site". Drag the .zip file over the folders list in the browser and a blue square should appear with the text "Drag here to unload and unzip" - release the .zip there. Once that unzips your site content should then be placed (and you can check it here by clicking Site folder, then wwwroot to see site contents. You should also now be able to browse your site at YourSiteName.azurewebsites.net.

Thanks for the feedback, I’ll try this out and reply with my results as soon as I can.
From: krolson<EMAIL_ADDRESS>Sent: Friday, November 20, 2020 12:05 PM
To: Azure/App-Service-Migration-Assistant<EMAIL_ADDRESS>Cc: Gordon, Sam<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [Azure/App-Service-Migration-Assistant] Web App Migration hangs at 10% in portal. White page on web server app migration tool (#44)
[External: Use caution with links & attachments]
Hello @lsgordon78https://urldefense.us/v2/url?u=https-3A__github.com_lsgordon78&d=DwMCaQ&c=kBZcWdBOH-UDm7cX7sUnio9i4Dr7DDged-ltBm3Bq7Y&r=iCZDESt3rsvynJq60K4fZBrxlWjNale3Mc9UxP4aCg8&m=G98AGNma6A99xQ3FX92QcIWXMxw5AfkDN4ZorYlwQGI&s=6VoQG07Cs4rj-GT7EDOW_IS-JdNrK4JXWpf4mLe7tXc&e=
This looks a like an issue that was fixed in the most recent (Preview) version. Could you try using the latest 1.0.8 version and let us know if that does not resolve this issue for you?
As an alternative you have the option to complete the migration for this site manually - this is outlined a bit in comments in #31https://urldefense.us/v2/url?u=https-3A__github.com_Azure_App-2DService-2DMigration-2DAssistant_issues_31&d=DwMCaQ&c=kBZcWdBOH-UDm7cX7sUnio9i4Dr7DDged-ltBm3Bq7Y&r=iCZDESt3rsvynJq60K4fZBrxlWjNale3Mc9UxP4aCg8&m=G98AGNma6A99xQ3FX92QcIWXMxw5AfkDN4ZorYlwQGI&s=aZEIDVp9SdbbMKlwHRMavJ86r_8YaOBZIVb4iybeVVA&e=, but to summarize:

the site has been created and your content was zipped and should be in a location similar to this one (with your username/sitename and different numbers at the end): C:\Users[username]\AppData\Local\Temp[siteName]_1234567890123.zip", locate it (or you can create the zip using command noted in that linked issue)
Go to the "scm" for the site you created during the migration: YourSiteName.scm.azurewebsites.net
Click on "Debug Console" and choose either the CMD or PowerShell option to get to the file content view
You should see 2 folders listed: "LogFiles" and "Site". Drag the .zip file over the folders list in the browser and a blue square should appear with the text "Drag here to unload and unzip" - release the .zip there. Once that unzips your site content should then be placed (and you can check it here by clicking Site folder, then wwwroot to see site contents. You should also now be able to browse your site at YourSiteName.azurewebsites.net.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://urldefense.us/v2/url?u=https-3A__github.com_Azure_App-2DService-2DMigration-2DAssistant_issues_44-23issuecomment-2D731324399&d=DwMCaQ&c=kBZcWdBOH-UDm7cX7sUnio9i4Dr7DDged-ltBm3Bq7Y&r=iCZDESt3rsvynJq60K4fZBrxlWjNale3Mc9UxP4aCg8&m=G98AGNma6A99xQ3FX92QcIWXMxw5AfkDN4ZorYlwQGI&s=S6rTP2dIYST0BC_w4n9rGR8dnzeDopKlFNn9SdMDE8s&e=, or unsubscribehttps://urldefense.us/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AR2QWZEFOQAKILJQ7G2R3C3SQ2VT3ANCNFSM4T42TFHA&d=DwMCaQ&c=kBZcWdBOH-UDm7cX7sUnio9i4Dr7DDged-ltBm3Bq7Y&r=iCZDESt3rsvynJq60K4fZBrxlWjNale3Mc9UxP4aCg8&m=G98AGNma6A99xQ3FX92QcIWXMxw5AfkDN4ZorYlwQGI&s=4Y2ogntdR5lAtExw3zWkh8-weKl-oy8azpqjEq2RFcg&e=.

I updated to 1.0.8 and kicked off the migration. After about 30 mins I have this error

Hi @lsgordon78, I'm sorry this happened to you!
Based on your description it looks like the Creating site resources operation was taking an unusually long time (over 30 minutes rather than a more typical under 10). I believe the token the tool uses to talk to Azure is usually granted for 1 hour, so if it is more than 1 hour from when you go through the login to when publishing site content step starts, then calls to do things like check the deployment status will start failing. I suspect if you try again it might succeed - as that kind of very long amount of time in "Creating site resources" seems really abnormal and thus may have been a one-off (definitely let me know if this is happening to you repeatedly!) - I'd expect the content publish step to be the one that takes a long time (and that step only needs the token right at the beginning to get your publishing credentials, so a long time should be okay there). Note that if you click back to Choose a Site step in the left menu you can re-select your site and click through to refresh the token and not have to re-enter your Azure Option selections.
Was this by chance creating a new app service plan on an ASE (dedicated App Service Environment)? That is a case that can take 30-60 minutes as it provisions new machines to the ASE environment - in that case if you were to retry after the new server farm was created (click back to first step to refresh login and get back to Azure Options page with most of your selections remembered) - you should be able to pick a new site name and complete the migration with the new serverfarm.

At Step 4 I don’t have the option to unload and unzip. Please see image.  Is there another option?
<EMAIL_ADDRESS>From: krolson<EMAIL_ADDRESS>Sent: Friday, November 20, 2020 12:05 PM
To: Azure/App-Service-Migration-Assistant<EMAIL_ADDRESS>Cc: Gordon, Sam<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [Azure/App-Service-Migration-Assistant] Web App Migration hangs at 10% in portal. White page on web server app migration tool (#44)
[External: Use caution with links & attachments]
Hello @lsgordon78https://urldefense.us/v2/url?u=https-3A__github.com_lsgordon78&d=DwMCaQ&c=kBZcWdBOH-UDm7cX7sUnio9i4Dr7DDged-ltBm3Bq7Y&r=iCZDESt3rsvynJq60K4fZBrxlWjNale3Mc9UxP4aCg8&m=G98AGNma6A99xQ3FX92QcIWXMxw5AfkDN4ZorYlwQGI&s=6VoQG07Cs4rj-GT7EDOW_IS-JdNrK4JXWpf4mLe7tXc&e=
This looks a like an issue that was fixed in the most recent (Preview) version. Could you try using the latest 1.0.8 version and let us know if that does not resolve this issue for you?
As an alternative you have the option to complete the migration for this site manually - this is outlined a bit in comments in #31https://urldefense.us/v2/url?u=https-3A__github.com_Azure_App-2DService-2DMigration-2DAssistant_issues_31&d=DwMCaQ&c=kBZcWdBOH-UDm7cX7sUnio9i4Dr7DDged-ltBm3Bq7Y&r=iCZDESt3rsvynJq60K4fZBrxlWjNale3Mc9UxP4aCg8&m=G98AGNma6A99xQ3FX92QcIWXMxw5AfkDN4ZorYlwQGI&s=aZEIDVp9SdbbMKlwHRMavJ86r_8YaOBZIVb4iybeVVA&e=, but to summarize:

the site has been created and your content was zipped and should be in a location similar to this one (with your username/sitename and different numbers at the end): C:\Users[username]\AppData\Local\Temp[siteName]_1234567890123.zip", locate it (or you can create the zip using command noted in that linked issue)
Go to the "scm" for the site you created during the migration: YourSiteName.scm.azurewebsites.net
Click on "Debug Console" and choose either the CMD or PowerShell option to get to the file content view
You should see 2 folders listed: "LogFiles" and "Site". Drag the .zip file over the folders list in the browser and a blue square should appear with the text "Drag here to unload and unzip" - release the .zip there. Once that unzips your site content should then be placed (and you can check it here by clicking Site folder, then wwwroot to see site contents. You should also now be able to browse your site at YourSiteName.azurewebsites.net.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://urldefense.us/v2/url?u=https-3A__github.com_Azure_App-2DService-2DMigration-2DAssistant_issues_44-23issuecomment-2D731324399&d=DwMCaQ&c=kBZcWdBOH-UDm7cX7sUnio9i4Dr7DDged-ltBm3Bq7Y&r=iCZDESt3rsvynJq60K4fZBrxlWjNale3Mc9UxP4aCg8&m=G98AGNma6A99xQ3FX92QcIWXMxw5AfkDN4ZorYlwQGI&s=S6rTP2dIYST0BC_w4n9rGR8dnzeDopKlFNn9SdMDE8s&e=, or unsubscribehttps://urldefense.us/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AR2QWZEFOQAKILJQ7G2R3C3SQ2VT3ANCNFSM4T42TFHA&d=DwMCaQ&c=kBZcWdBOH-UDm7cX7sUnio9i4Dr7DDged-ltBm3Bq7Y&r=iCZDESt3rsvynJq60K4fZBrxlWjNale3Mc9UxP4aCg8&m=G98AGNma6A99xQ3FX92QcIWXMxw5AfkDN4ZorYlwQGI&s=4Y2ogntdR5lAtExw3zWkh8-weKl-oy8azpqjEq2RFcg&e=.

Correction update!
I was able to drag the zip file and noticed the advertised message but the file doesn’t appear to unzip or proceed to the next step.  See image
<EMAIL_ADDRESS>From: krolson<EMAIL_ADDRESS>Sent: Friday, November 20, 2020 12:05 PM
To: Azure/App-Service-Migration-Assistant<EMAIL_ADDRESS>Cc: Gordon, Sam<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [Azure/App-Service-Migration-Assistant] Web App Migration hangs at 10% in portal. White page on web server app migration tool (#44)
[External: Use caution with links & attachments]
Hello @lsgordon78https://urldefense.us/v2/url?u=https-3A__github.com_lsgordon78&d=DwMCaQ&c=kBZcWdBOH-UDm7cX7sUnio9i4Dr7DDged-ltBm3Bq7Y&r=iCZDESt3rsvynJq60K4fZBrxlWjNale3Mc9UxP4aCg8&m=G98AGNma6A99xQ3FX92QcIWXMxw5AfkDN4ZorYlwQGI&s=6VoQG07Cs4rj-GT7EDOW_IS-JdNrK4JXWpf4mLe7tXc&e=
This looks a like an issue that was fixed in the most recent (Preview) version. Could you try using the latest 1.0.8 version and let us know if that does not resolve this issue for you?
As an alternative you have the option to complete the migration for this site manually - this is outlined a bit in comments in #31https://urldefense.us/v2/url?u=https-3A__github.com_Azure_App-2DService-2DMigration-2DAssistant_issues_31&d=DwMCaQ&c=kBZcWdBOH-UDm7cX7sUnio9i4Dr7DDged-ltBm3Bq7Y&r=iCZDESt3rsvynJq60K4fZBrxlWjNale3Mc9UxP4aCg8&m=G98AGNma6A99xQ3FX92QcIWXMxw5AfkDN4ZorYlwQGI&s=aZEIDVp9SdbbMKlwHRMavJ86r_8YaOBZIVb4iybeVVA&e=, but to summarize:

the site has been created and your content was zipped and should be in a location similar to this one (with your username/sitename and different numbers at the end): C:\Users[username]\AppData\Local\Temp[siteName]_1234567890123.zip", locate it (or you can create the zip using command noted in that linked issue)
Go to the "scm" for the site you created during the migration: YourSiteName.scm.azurewebsites.net
Click on "Debug Console" and choose either the CMD or PowerShell option to get to the file content view
You should see 2 folders listed: "LogFiles" and "Site". Drag the .zip file over the folders list in the browser and a blue square should appear with the text "Drag here to unload and unzip" - release the .zip there. Once that unzips your site content should then be placed (and you can check it here by clicking Site folder, then wwwroot to see site contents. You should also now be able to browse your site at YourSiteName.azurewebsites.net.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://urldefense.us/v2/url?u=https-3A__github.com_Azure_App-2DService-2DMigration-2DAssistant_issues_44-23issuecomment-2D731324399&d=DwMCaQ&c=kBZcWdBOH-UDm7cX7sUnio9i4Dr7DDged-ltBm3Bq7Y&r=iCZDESt3rsvynJq60K4fZBrxlWjNale3Mc9UxP4aCg8&m=G98AGNma6A99xQ3FX92QcIWXMxw5AfkDN4ZorYlwQGI&s=S6rTP2dIYST0BC_w4n9rGR8dnzeDopKlFNn9SdMDE8s&e=, or unsubscribehttps://urldefense.us/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AR2QWZEFOQAKILJQ7G2R3C3SQ2VT3ANCNFSM4T42TFHA&d=DwMCaQ&c=kBZcWdBOH-UDm7cX7sUnio9i4Dr7DDged-ltBm3Bq7Y&r=iCZDESt3rsvynJq60K4fZBrxlWjNale3Mc9UxP4aCg8&m=G98AGNma6A99xQ3FX92QcIWXMxw5AfkDN4ZorYlwQGI&s=4Y2ogntdR5lAtExw3zWkh8-weKl-oy8azpqjEq2RFcg&e=.

Hi @lsgordon78 ,
I am afraid I am not able to view the images you've sent. :^(
I wonder if it may be that (especially with larger .zips) it takes some time for them to unzip and there is just a small visual indicator, a little moving tool icon in the upper right, so:
Right before dropping .zip:

Right after but before unzipping complete:

That little icon should appear after you release the zip and have some movement to it, and may even show a percentage complete indicator, but until it is 100% you may not see the actual folders and files appear in the directory view, and it could take a few minutes for the unzipping and file placement to complete.

Thank you very much for the assistance through this migration.  This has been my first attempt at using this tool. I have successfully imported and unzipped the file. The website is working perfectly !    I have several more over the course of this year and in to 2021.  My latest concern would be the automated method of the migration and looking into why that isn’t working.  At least we have a manual process working.  Thanks again! Happy to have this community git hub to get me through it.
From: krolson<EMAIL_ADDRESS>Sent: Thursday, December 3, 2020 2:04 PM
To: Azure/App-Service-Migration-Assistant<EMAIL_ADDRESS>Cc: Gordon, Sam<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [Azure/App-Service-Migration-Assistant] Web App Migration hangs at 10% in portal. White page on web server app migration tool (#44)
[External: Use caution with links & attachments]
Hi @lsgordon78https://urldefense.us/v3/__https:/github.com/lsgordon78__;!!JRQnnSFuzw7wjAKq6ti6!jwCbNVWGCLf3qpNM66R-Jcotjl0MMKdY9PndmATRnMxZJO9LYTNXIzLx80kBmYY$ ,
I am afraid I am not able to view the images you've sent. :^(
I wonder if it may be that (especially with larger .zips) it takes some time for them to unzip and there is just a small visual indicator, a little moving tool icon in the upper right, so:
Right before dropping .zip:
[image]https://urldefense.us/v3/__https:/user-images.githubusercontent.com/4675080/101081805-6a81f880-355f-11eb-8548-c8b8119540f9.png__;!!JRQnnSFuzw7wjAKq6ti6!jwCbNVWGCLf3qpNM66R-Jcotjl0MMKdY9PndmATRnMxZJO9LYTNXIzLxT1N4zZM$
Right after but before unzipping complete:
[image]https://urldefense.us/v3/__https:/user-images.githubusercontent.com/4675080/101081287-b84a3100-355e-11eb-8fe6-c4d1ba20da24.png__;!!JRQnnSFuzw7wjAKq6ti6!jwCbNVWGCLf3qpNM66R-Jcotjl0MMKdY9PndmATRnMxZJO9LYTNXIzLxSYjkwwE$
That little icon should appear after you release the zip and have some movement to it, and may even show a percentage complete indicator, but until it is 100% you may not see the actual folders and files appear in the directory view, and it could take a few minutes for the unzipping and file placement to complete.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://urldefense.us/v3/__https:/github.com/Azure/App-Service-Migration-Assistant/issues/44*issuecomment-738275849__;Iw!!JRQnnSFuzw7wjAKq6ti6!jwCbNVWGCLf3qpNM66R-Jcotjl0MMKdY9PndmATRnMxZJO9LYTNXIzLx7weT3oo$, or unsubscribehttps://urldefense.us/v3/__https:/github.com/notifications/unsubscribe-auth/AR2QWZGP6RJLKKFNOYIDOZ3SS7VJRANCNFSM4T42TFHA__;!!JRQnnSFuzw7wjAKq6ti6!jwCbNVWGCLf3qpNM66R-Jcotjl0MMKdY9PndmATRnMxZJO9LYTNXIzLxL-oTc7U$.

Closing this issue due to lack of activity in last 90 days. Please open a new issue if you are experiencing a similar issue.


multiprocessing connection error when training

Hi, I encountered an error that I don’t understand while trying to reproduce your work.
It doesn’t seem related to the algorithm or mechanism but rather to low-level coding, specifically multiprocessing, as shown in the attached image.

To debug, I limited num_env_steps, and the error occurred when the training code ended. During training, there were no errors, and the code ran well.
Does anyone have a solution for this type of error?

It doesn't affect training or testing. Adding envs.close() at the end of the training loop will solve the error.


Details on V2 architecture

Hey @dome272,
Amazing work on the V2.
Looking at the code, I see that stage C is not diffusing in the latent space of EffNet, since it's shape is Bx16x24x24 and not 16*12x12 as stated in the paper. I however see that stage B uncond shape is still 16x12x12, so I'm a bit confuse with what is happening there.
Also if i understand well, Stage B is not Paella like anymore?
Will there be a V2 of the paper as well with all the changes?
Thanks!

Based on the video, it sounds like Wuerstchen V2 started training with 512x512 images (12x12 latents) and then fine tuned on 1024x1024 images (24x24 latents) to get the final checkpoint.

This approach is similar to how SD team did their initial training on 256x256 images (32x32 latents), then finetuned on 512x512 images (64x64 latents), and (for SDXL) did further fine-tuning on 1024x1024-area images to get the final checkpoint.


[remote] opening folder dialog in broken remote window hangs

run out of sources
add at https://github.com/microsoft/vscode/blob/3ed654b8e8d0310e0fcdd4a08ef12d873c73816a/extensions/vscode-test-resolver/src/extension.ts#L353

	actions.push({
		title: 'Open Folder',
		execute: () => {
			vscode.commands.executeCommand('vscode.openFolder');
		}
	});

run and in the OSS Dev window set "testresolver.startupError": true
open a TestResolver window
in the modal dialog pick Open Folder
No dialog shows, resolver progress is spinning, nothing happens

Not sure that ever worked. Not everything is working when still in a resolver.
The open folder dialog depends on remoteAgentService.getEnvironment which depends on the resolver to be completed.
I suggest to close the issue unless there is a demand for this to work. The issue from which this came out of (https://github.com/microsoft/vscode-remote-release/issues/5811) doesn't.
Speak up if you disagree @bpasero @alexdima

Is this specific to the test resolver then? Or could this happen for others that are used too?

It would happen with all resolvers. But there are only few resolvers out there, written all by us and the API is still proposed.


setting up for remote dev is difficult

I tried to use my remote dev environment after several months idle. The docs still have the same instructions for remote development, but recent changes presume that remote dev is done using a pre-configured droplet provided by the Zulip team.
I can start the processes, and get to the dev login page. But if I click on a user to login, my host's ip address is replaced with localhost. (Registering using the non-dev flow had similar problems with the confirmation link.)
dev_settings.py has a special case for user zulipdev, but changing that to my user was not sufficient. I had to replace the entire block that sets EXTERNAL_HOST and/or REALM_HOSTS with hardcoded values:
EXTERNAL_HOST = "<IP_ADDRESS>:9991"
REALM_HOSTS = {
    'zulip': '<IP_ADDRESS>:9991'
}

Related: build-release-tarball will not run because of the modified file.
I also tried following the Vagrant directions, but Zulip would not start even with changing dev_settings.py.
See also: https://github.com/zulip/zulip/issues/5061

Hi @feorlen, welcome back!  Can you point specifically to the docs you looked at?  I think we probably need to add something to the docs to recommend setting the EXTERNAL_HOST environment variable (which overrides the need to hand-edit those in dev_settings.py).  We'll probably want to suggest putting it in .bashrc or something if you're not using the droplets.  We might also need something to set REALM_HOSTS roughly how you describe as an else statement to if EXTERNAL_HOST is None: in dev_settings.py, e.g. this:
diff --git a/zproject/dev_settings.py b/zproject/dev_settings.py
index bf2d0f8..f0f0860 100644
--- a/zproject/dev_settings.py
+++ b/zproject/dev_settings.py
@@ -26,6 +26,10 @@ if EXTERNAL_HOST is None:
         REALM_HOSTS = {
             'zulip': 'localhost:9991'
         }
+else:
+    REALM_HOSTS = {
+        'zulip': EXTERNAL_HOST,
+    }
 ALLOWED_HOSTS = ['*']

 # Uncomment extra backends if you want to test with them.  Note that

Can you try that and see if it works for you?

Hi @timabbott it's nice to see everyone!
The docs I used start here, Installing remotely, which links to both the direct and Vagrant instructions. I used the basic direct Ubuntu install. (By that I mean when I first set this up way back when.)
With EXTERNAL_HOST='x.x.x.x:9991'
clicking on one of the devlogin users gives me this:
http://zulip.x.x.x.x:9991/accounts/login/local/
which is the same behavior as when I hardcoded it in dev_settings.py. For this, it doesn't matter whether I use run-dev.py --interface='' or give it my ip address explicitly.
Your code with the additional else: in dev_settings.py does allow me to login as a dev user.
The odd thing there is that it works only if I use --interface='' but not with --interface=x.x.x.x. In that case it seems like I'm logging in, but the UI doesn't fully load.

Hmm, I'm not sure why specifying a specific IP address in --interface doesn't work; it's not something I've used before.  Might be worth comparing the run-dev.py logs.


Write Playwright tests for Pension Subcategory Module

These tests are doing nothing it will pass even without a database and  API backend 😞


Build and publish Cadence release binaries

Apparently, Uber sometimes updates release branches after they've been published.  We currently have a situation where our forked release branch which used to build, no longer builds.
The solution is to create a neonKUBE/cadence GitHub project and periodically publish the release binaries to the repo, perhaps becoming the official source of these binaries.

We do use release branches for patching. Which branch are you having trouble with and what are the build errors?

@dmetzgar: Hi Dustin!  Sorry for the delay getting back to you.  You're the first outside person to post to this repo since I made it public.
Here's the deal: We currently have a docker image that combines cadence and cassandra and also proactively applies the cassandra schema updates, we're using this for integration and unit testing right now (it's nice because it takes only about 10 seconds to start).
We're currently building Cadence Server within our Dockerfile and we'd like to maintain image for all Cadence releases going forward and we need to be able to rebuild these images at any time (for various reasons).
The problem is that you folks seem to be removing older GitHub release branches shortly after you release the next version, which means we won't be able to rebuild older releases after you've deleted the branches.
I figured I could solve this by forking your repo, watching for new releases and pulling them, and not deleting older release branches.  This worked for a while, but this failed last week when we tried top rebuild this image for your 0.5.7 release from my fork (the 0.5.7 release no longer exists in your official repo).  For what it's worth, we're seeing this compiler error:
go build -i -o cadence-server cmd/server/cadence.go cmd/server/server.go
# command-line-arguments
cmd/server/server.go:128:46: too many arguments in call to cluster.NewMetadata
        have ("github.com/nforgeio/cadence/vendor/github.com/uber/cadence/common/log".Logger, "github.com/nforgeio/cadence/vendor/github.com/uber/cadence/common/metrics".Client, dynamicconfig.BoolPropertyFn, int64, string, string, map[string]int64, map[string]config.Address, dynamicconfig.StringPropertyFn, string, dynamicconfig.BoolPropertyFn)
        want ("github.com/nforgeio/cadence/vendor/github.com/uber/cadence/common/log".Logger, "github.com/nforgeio/cadence/vendor/github.com/uber/cadence/common/metrics".Client, dynamicconfig.BoolPropertyFn, int64, string, string, map[string]config.ClusterInformation, dynamicconfig.StringPropertyFn, string, dynamicconfig.BoolPropertyFn)

What I'd really love is avoid having to compile Cadence Server at all and be able to simply download pre-built binaries from someplace where all release versions will be archived.  That would make it easy to build custom docker images.
I was figuring that I could just build these binaries myself and and release them on GitHub, but it would be super nice if you Uber folks did this.  We really only care about the Linux binaries right now, but I was going to do OS/X and Windows for completeness.

Ah, just saw this reply. Our process is generally to put a tag on master for the release and create a branch for any patches. After a few versions we clean up the old branches. The tags should still be there though. I created an issue to document our release process.

Cool thanks.

@dmetzgar: We've been stupid!  We'll just use the GitHub tags as you suggest.
I've been mostly using the Visual Studio integrated GitHub UX and didn't realize that tags and branches were essentially the same thing.


Where is vue router created?

I want to implement vue-router-prefetch and add some navigation guards. But i don't know how to do it since router is auto generated and i don't know where it is.
Note: vue-router-prefetch has to be used after creating router.

Any solution?


Update: KDE.kmymoney version 5.1

[X] Have you signed the Contributor License Agreement?
[X] Have you checked that there aren't other open pull requests for the same manifest update/change?

[ ] Have you tested your manifest locally with winget install --manifest <path>?
[X] Does your manifest conform to the 1.1 schema?

Microsoft Reviewers: Open in CodeFlow

For some reason the latest RRS post i had was expired so i had to get it manually and forgot it did that 🤦♂


[Snyk] Upgrade html-snapshots from 3.13.0 to 3.14.0

Snyk has created this PR to upgrade html-snapshots from 3.13.0 to 3.14.0.
:information_source: Keep your dependencies up-to-date. This makes it easier to fix existing vulnerabilities and to more quickly identify and fix newly disclosed vulnerabilities when they affect your project.

The recommended version is 2 versions ahead of your current version.

The recommended version was released on 7 days ago.

Release notes

Package name: html-snapshots

3.14.0 -<EMAIL_ADDRESS>

3.13.1 -<EMAIL_ADDRESS>

3.13.0 -<EMAIL_ADDRESS>

    from html-snapshots GitHub release notes

[!IMPORTANT]

Check the changes in this PR to ensure they won't cause issues with your project.
This PR was automatically created by Snyk using the credentials of a real user.

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open upgrade PRs.
For more information:

🧐 View latest project report
📜 Customise PR templates
🛠 Adjust upgrade PR settings
🔕 Ignore this dependency or unsubscribe from future upgrade PRs

coverage: 99.245%. remained the same
when pulling 44f98d53ea089c1bd0bf1eb200514f2782f9e632 on snyk-upgrade-0540cea47a20374a6175840dbc20c3e1
into d695abf6c3ed849e8f071061fa2485bc953df0e3 on master.


Query relevant data from Firebase realtimedatabase, link the data together using autoIDs and structure data for use. SWIFT 4

I'm a relatively new developer to the Firebase/Swift communities and am facing a challenge slightly out of my current capacity. I’m looking to create a chat app similar to slack and my database looks as follows...
USERS
• **User ID**
  *Meta*
    Name - “”
    Email - “”

  *Groups*
    groupID - true
    groupID - true

GROUPS
• **Group ID**
  *Meta*
    Name - “”
    ImageURL - “”

  *Channels*
    channellD - true
    channellD - true

CHANNELS
• **Channel ID**
  *Meta*
    Title - “”

  *Messages*
    messageID - true
    messageID - true

MESSAGES
• **Message ID**
  *Meta*
    Message Body - “”
    userID - true
    channelID - true

The current issue I’m facing is how to query the relevant data and how to link the data together.
I would like to display a collection view, populated with group images. Once a group is selected, display the relevant channels for this group in a table view below, then the relevant messages for the channel selected inside a new VC.

Would I have to create an array of groupIDs for each user, then loop through those IDs to get groups data (and so on)?

Would i have to query the current userID inside the groups node and add all relevant groups data to a 'Groups' array (and so on - or would this too long with large sets of data?)?

Or is there a more efficient way to do this?

I’m also finding it hard to understand how the data would be structured inside my code once I have retrieved it from the database (unless i were to use number 2), so i can display it in the relevant views. I could not imagine a standard Dictionary would be suitable for this?
E.g. How would I know which channels belonged to which groups, and which messages to which channels? This may be a simple solution, but right now i cant seem to find an answer.
With the following question in mind
https://stackoverflow.com/questions/38537028/firebase-ios-swift-retrieve-child-data-corresponding-to-a-chat-conversation-id?rq=1
I'd like to say thanks in advance and hope you guys can help!

You'd have to do a lot of querying, but your queries themselves won't be downloading large amounts of data until you start loading messages. Here's what I'd recommend:

From user login, use the user's uid as the unique identifier for their user node in RTDB. This way you can fetch the user node directly without querying a collection of users.
Enumerate the user's groups array and fetch all of those groups from the groups root.
Similarly, enumerate the channels for a selected group, and then load all the messages belonging to that channel in chronological order.

To answer your questions directly:

Would I have to create an array of groupIDs for each user, then loop through those IDs to get groups data (and so on)?

Yes. FUIIndexArray is a sample implementation of what you're describing, though it's in objc.

Would i have to query the current userID inside the groups node and add all relevant groups data to a 'Groups' array (and so on - or would this too long with large sets of data?)?

Yes, though if you're concerned with data size you can always just load the first N and then allow the user to load more later.

Or is there a more efficient way to do this?

There's some optimizations you can make around how frequently groups/channels will be created and destroyed as well as how many groups a user will likely belong to at one time, but otherwise there isn't really a more efficient way to do this.

I’m also finding it hard to understand how the data would be structured inside my code once I have retrieved it from the database (unless i were to use number 2), so i can display it in the relevant views. I could not imagine a standard Dictionary would be suitable for this?

A standard dictionary is not suitable since you have to load each corresponding key's value asynchronously.

How would I know which channels belonged to which groups, and which messages to which channels?

The easiest way would be to add a groupID field to your channel object and a channelID field to your message objects, since each message can only belong to one channel and each channel can only belong to one group.


Add firewall dependency for gitea/nexus

Add dependency on firewall module to gitea and nexus modules to fix #1297

@stuartleeks perhaps it would be nice to add the dependency for Gitea too?

@stuartleeks perhaps it would be nice to add the dependency for Gitea too?

how do you mean @tamirkamara ?

@stuartleeks perhaps it would be nice to add the dependency for Gitea too?

@tamirkamara  - do you mean something other than this?

https://github.com/microsoft/AzureTRE/blob/caab6bd33aa4c52acc7844f318cfc694647ffe25/templates/core/terraform/main.tf#L133

Closing and re-opening to test whether the build issue is transient or not


added tox coverage report to terminal

solutin proposed to issue #51

Codecov Report

Merging #52 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #52   +/-   ##
=======================================
  Coverage   72.12%   72.12%
=======================================
  Files          11       11
  Lines         330      330
=======================================
  Hits          238      238
  Misses         92       92

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bce6c86...fe92302. Read the comment docs.

Thank you for taking this @aqreed :+1:


DocumentSymbol.detail?: support MarkupContent

Fixes #1130.

LSP v3.15 was already finalized. Any new changes would need to be done to specification-3-16.md.

Fixed.

It feels a bit odd because for hover and completion docs the client can advertise a list of supported formats (currently: plaintext and/or markdown). Should this diff follow that principle?

Actually, that is a good idea :); I'll fix this soon.

On second thought, shouldn't we perhaps have a shared list for the various supported formats? Why would a client be able to render Markdown for auto-completion, but not for signatureHelp or this field?

A client may decide to only allow plaintext for the detail field for performance reasons :)

@nbfalcon thanks for the PR. Just want to point out that besides a spec update we need a proof of concept implementation as well. This doesn't need to be done in VS Code. It can be any editor that supports LSP. See https://github.com/microsoft/language-server-protocol/blob/master/contributing.md
Are you willing to work on this as well?

I wanted to do that for Emacs lsp-mode anyway. The necessary refactoring is already done.

Great. Can you post a screen shot here on how this will look?

Ant update on an implementation?

Closing due to inactivity.


[release-v1.77] Automated cherry pick of #8532: Add more versioned tool binaries for (go build) gardener tools to gardenertools image

/kind enhancement
/area dev-productivity
Cherry pick of #8532 on release-v1.77.
#8532: Add more versioned tool binaries for (go build) gardener tools to gardenertools image
Release Notes:
NONE

/lgtm
/approve


Build basic Standard Library to allow basic tests to pass

var_dump, etc

Here is an uncompleted list what the compiler needs for compiling itself (expect the difficult php language itself)
array_shift
count
end
max
exec
explode
implode
file_get_contents
stream_get_contents
filemtime
real_path
str_replace
strtolower
substr
trim
unlink

Some are only used in the cli tools but i think this is whats needed. While im looking though a lot of code this is mostly whats used in a a lot of basic classes.

A few other functions are likely needed. It depends one the language standard tests need as well. But this seems like an amazing start :)


MDCATH

This pull request introduces the MDCATH class, which extends torch_geometric.data.Dataset to facilitate the processing and handling of the mdCATH dataset, available on Hugging Face.
Key Features:

The MDCATH class processes the mdcath_source.h5 file, efficiently filtering domains and trajectories based on the specified filter arguments.
Users can customize the filtering criteria by passing specific arguments to the class, allowing for targeted data selection

Looks great Antonio. Is it ready to merge?

Looks great. Great work Antonio!


include overall-scan

I know we have been discussing this before, but annotating on the new documents has shown that OCR often leaves out several sections or lines. This makes it necessary to have an overview of the full page. We can display the page on ZEFYS in most cases, but it costs extra time and is not possible with the pages that are not online yet. Therefore, would it be possible to link the full scan (e.g. on the upper display of the filename in neath)?

Now, there is a little full page link below the image snippet.

@labusch Great, this is a very helpful shortcut! Thx


pytorch3d install error

Hi @krrish94
Thank you for being so supportive.
I run the python scripts/generate_gsa_results.py successfully. I am running the following command  python slam/cfslam_pipeline_batch.py but facing an error.
Please let me know how I can fix it.
(conceptgraph) user@user:~/Pictures/Gaurav/Robotics/concept-graphs/conceptgraph$ python slam/cfslam_pipeline_batch.py \

dataset_root=/home/user/Pictures/Gaurav/Robotics/concept-graphs/Datasets/Replica \
dataset_config=/home/user/Pictures/Gaurav/Robotics/concept-graphs/conceptgraph/dataset/dataconfigs/replica/replica.yaml \
stride=5 \
scene_id=room0 \
spatial_sim_type=overlap \
mask_conf_threshold=0.95 \
match_method=sim_sum \
sim_threshold=1.2 \
dbscan_eps=0.1 \
gsa_variant=none \
class_agnostic=True \
skip_bg=True \
max_bbox_area_ratio=0.5 \
save_suffix=overlap_maskconf0.95_simsum1.2_dbscan.1_merge20_masksub \
merge_interval=20 \
merge_visual_sim_thresh=0.8 \
merge_text_sim_thresh=0.8

[2023-10-10 20:37:38,504] [INFO] [real_accelerator.py:110:get_accelerator] Setting ds_accelerator to cuda (auto detect)
Setting image height and width to 680 x 1200
Loaded class colors from  /home/user/Pictures/Gaurav/Robotics/concept-graphs/Datasets/Replica/room0/gsa_classes_none_colors.json
0%|                                                                                | 0/400 [00:00<?, ?it/s]/home/user/anaconda3/envs/conceptgraph/lib/python3.10/site-packages/imageio/plugins/pillow.py:297: UserWarning: Loading 16-bit (uint16) PNG as int32 due to limitations in pillow's PNG decoder. This will be fixed in a future version of pillow which will make this warning dissapear.
warnings.warn(
0%|▍                                                                                | 1/400 [00:01<10:10,  1.53s/it]
Error executing job with overrides: ['dataset_root=/home/user/Pictures/Gaurav/Robotics/concept-graphs/Datasets/Replica', 'dataset_config=/home/user/Pictures/Gaurav/Robotics/concept-graphs/conceptgraph/dataset/dataconfigs/replica/replica.yaml', 'stride=5', 'scene_id=room0', 'spatial_sim_type=overlap', 'mask_conf_threshold=0.95', 'match_method=sim_sum', 'sim_threshold=1.2', 'dbscan_eps=0.1', 'gsa_variant=none', 'class_agnostic=True', 'skip_bg=True', 'max_bbox_area_ratio=0.5', 'save_suffix=overlap_maskconf0.95_simsum1.2_dbscan.1_merge20_masksub', 'merge_interval=20', 'merge_visual_sim_thresh=0.8', 'merge_text_sim_thresh=0.8']
Traceback (most recent call last):
File "/home/user/Pictures/Gaurav/Robotics/concept-graphs/conceptgraph/slam/cfslam_pipeline_batch.py", line 270, in main
spatial_sim = compute_spatial_similarities(cfg, fg_detection_list, objects)
File "/home/user/Pictures/Gaurav/Robotics/concept-graphs/conceptgraph/slam/mapping.py", line 39, in compute_spatial_similarities
spatial_sim = compute_overlap_matrix_2set(cfg, objects, detection_list)
File "/home/user/Pictures/Gaurav/Robotics/concept-graphs/conceptgraph/slam/utils.py", line 293, in compute_overlap_matrix_2set
iou = compute_3d_iou_accuracte_batch(bbox_map, bbox_new) # (m, n)
File "/home/user/Pictures/Gaurav/Robotics/concept-graphs/conceptgraph/utils/ious.py", line 165, in compute_3d_iou_accuracte_batch
import pytorch3d.ops as ops
File "/home/user/anaconda3/envs/conceptgraph/lib/python3.10/site-packages/pytorch3d/ops/init.py", line 7, in
from .ball_query import ball_query
File "/home/user/anaconda3/envs/conceptgraph/lib/python3.10/site-packages/pytorch3d/ops/ball_query.py", line 10, in
from pytorch3d import _C
ImportError: /home/user/anaconda3/envs/conceptgraph/lib/python3.10/site-packages/pytorch3d/_C.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c106detail14torchCheckFailEPKcS2_jRKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE
Set the environment variable HYDRA_FULL_ERROR=1 for a complete stack trace.

This looks like a pytorch3d install error. Can you try running just the import pytorch3d statement inside an interpreter to see if that works?
(As the error message above indicates, you're running into this error when import pytorch3d.ops as ops is executed)

Updated the issue title to reflect the pytorch3d install issue.

Hi @krrish94
Yes, you are right.
I had installed pytorch3d wrongly.
For installing pytorch3d with CUDA support from Anaconda Cloud, on Linux only, there is a different command. Which is given below.
$conda install pytorch3d -c pytorch3d
I followed it and now it working well.
Thank you very much for your support.


Connex

Dev Home version
0.301.198.0
Windows build number
10.0.23521.1000
Other software
OS Build Version: 10.0.23521.1000.amd64fre.ni_prerelease.230804-1452
.NET Version: .NET 6.0.18
Steps to reproduce the bug
Streaming Live TV
Expected result
To run smooth and performing well while streaming live TV
Actual result
Suddenly PC become extremely slow
Included System Information
Physical Memory: 3.83GB (0.92GB free)
Processor Architecture: x64
Included Extensions Information
Extensions:
Microsoft.Windows.DevHome_0.301.198.0_x64__8wekyb3d8bbwe
Microsoft.Windows.DevHomeGitHubExtension_0.300.198.0_x64__8wekyb3d8bbwe

This does not sound like an issue with Dev Home and should be reported elsewhere. You may want to use Feedback Hub instead.


Resource created by helm rollback doesn't have meta.helm.sh annotations.

Output of helm version: 3.3.4
Output of kubectl version: v1.19.9
Cloud Provider/Platform (AKS, GKE, Minikube etc.): AWS EKS
Resource created by helm rollback doesn't have meta.helm.sh annotations.
It seems setMetadataVisitor is executed by upgrade and install but not by rollback. Because of that resource created by rollback is not annotated and can't be "adopted" by helm if needed.

Good catch. Thanks for finding this. Do you have a patch available to test?

I see @cndoit18 have already prepared PR. Thanks 🙇 . I hope it's going to be approved and merged 🤞

/remove-stale

/remove-stale

Hitting same problem in CI/CD (which does --dry-run before actual upgrade --install ).
Leaving and error here so the issue can be found easier.
Error: rendered manifests contain a resource that already exists. Unable to continue with install: Ingress "ingress-name" in namespace "namespace-name" exists and cannot be imported into the current release: invalid ownership metadata; annotation validation error: missing key "meta.helm.sh/release-name": must be set to "ingress-name"; annotation validation error: missing key "meta.helm.sh/release-namespace": must be set to "namespace-name"


unnecessary function calls in Scenario Cards

The getCompartmentValue and getCompartmentRate functions are called on every render (even on mouseover/hover).
This could be optimized, as they only need to be called / the render changed when actual input/changes occur.
Maybe a useEffect or useMemo can help alleviate the call frequency.

Maybe this is fixed in #287?


Add a type-writing effect

Add a type-writing effect in the home page for the name of the website.

i will send a pull request related to this once check it


Add instructions for fica sphinx extension in docs

Currently, the docs do not specify that you need to add fica.sphinx to extensions in conf.py. Add this.

Added in e4402c4


Ru localization updated

@vgrichina can you please help review these RU translations when you have a chance?


Parallel running of nanoid might get stuck

Hey,
When I run nanoid with more than ~20 rows on my GCP Postgres instance (8 vCPUs) it might get stuck in the while loop. This problem was solved by indicating this function is PARALLEL UNSAFE.
I opened a PR solving this issue 😄
thanks,
Omri

Hi Omri,
Firstly, thank you for taking the time to open an issue and submitting a pull request simultaneously.
I appreciate the details you gave me about the behaviour on GCP's Postgres instance. Addressing such concerns is crucial for the project's robustness, and I'm glad you identified a workaround with the PARALLEL UNSAFE indication.
While marking the function as PARALLEL UNSAFE is a valid workaround, I am also concerned about its limitations. There should be a solution that allows parallel execution, and I will analyse this further to seek an optimal algorithm.
I'll review the PR shortly. Again, thank you for being proactive and for your valuable input.
Cheers, Nikola

Hi @omris94,
Would you mind telling me which parameters you used to execute the nanoid() function? Have you defined any custom size or alphabet?
I prepared a test SQL to reproduce the bug, but locally, for me, it works, unfortunately.
This is the test I wrote:
DO
$$
    DECLARE
        counter         int;
        numLoops int := 1000;
    BEGIN
        -- Default parameters
        FOR counter IN 1..numLoops
            LOOP
                RAISE NOTICE '%', nanoid();
            END LOOP;

        -- Size 12, default alphabet
        FOR counter IN 1..numLoops
            LOOP
                RAISE NOTICE '%', nanoid(12);
            END LOOP;

        -- Size 25, default alphabet
        FOR counter IN 1..numLoops
            LOOP
                RAISE NOTICE '%', nanoid(25);
            END LOOP;

        -- Default size (21), custom alphabet (only lowercase)
        FOR counter IN 1..numLoops
            LOOP
                RAISE NOTICE '%', nanoid(21, 'abcdefghijklmnopqrstuvwxyz');
            END LOOP;

        -- Size 15, custom alphabet (only numbers)
        FOR counter IN 1..numLoops
            LOOP
                RAISE NOTICE '%', nanoid(15, '0123456789');
            END LOOP;

        -- Size 17, custom alphabet (uppercase + numbers)
        FOR counter IN 1..numLoops
            LOOP
                RAISE NOTICE '%', nanoid(17, 'ABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789');
            END LOOP;
    END
$$;

Would you execute my test SQL without and once with your fix on your GCP Postgres instance and report your results on this issue?
Thanks in advance!
Cheers, Nikola

Hey @nik-sta,
I used nanoid like this: nanoid(10, '23456789abcdefghijklmnopqrstuvwxyz'). I recreated the function without the UNSAFE indication, but for some reason, the method I used yesterday doesn't reproduce the issue and neither does your test 😞
Furthermore, I read that UNSAFE is the default for functions, so I'm not sure what happened yesterday or why the function got stuck...
thanks,
Omri

Thanks @omris94, for your help.
The underlying gen_random_bytes function from the pgcrypto extension relies on the operating system for generating random values. In some contexts, especially when there's a high demand for random values, this could lead to performance issues or even blocking:

Continuous heavy usage of random generation can be resource-intensive.
Specific sources of randomness in the OS, like /dev/random, can block if they believe there isn't enough entropy, potentially causing stalls.
Available entropy might differ from traditional physical systems in cloud or virtualised environments.

Given this understanding and after a thorough analysis of the function's behaviour, I've decided to mark the base code of the function as PARALLEL SAFE. No concrete reasons indicate it should be inherently unsafe for parallel execution. However, the PARALLEL UNSAFE designation can be cautious in specific contexts to ensure serial execution, especially if the issue isn't consistently reproducible.
Thanks for bringing this to my attention, and I hope this provides a clear path forward!
I will close this issue now. Feel free to re-open it anytime if you have new ideas or findings.
Cheers, Nikola

Thanks @nik-sta! That Sounds great.
I just want to clarify that the symptoms didn't seem like a deadlock or anything block-related. I've noticed peak CPU utilization for way more time than it would make sense (CPU usage graph attached). The original insert statement that got stuck contained less than 10k rows. After 30 minutes of waiting for the query to finish (and high CPU usage), I manually stopped the query. Because of the CPU usage, I thought that for some reason we got stuck in the while loop for one of the rows.
After I recreated the function with the unsafe  indication (now I know it was probably meaningless) it worked like a charm and it took less than one second.

Hi @omris94, after our discussion, we improved the nanoid() function. While testing, we used your custom size and alphabet definition. We discovered your combination could be enhanced with a better additional bytes factor (1.85 instead of the default 1.6). We added this possibility to the nanoid() function. It's now the third parameter to pass by. Check out the new release and the new README file for more insights. I also added a release documentation and a migration guide if you plan to use the more recent version. Have a nice weekend! Cheers, Nikola

https://github.com/viascom/nanoid-postgres/releases/tag/2.0.0


Inable to take offer from UI with code from current master

On current taker_master I keep running into this problem:
2022-08-17 14:56:02
{"timestamp":"2022-08-17T14:56:02.118255716Z","level":"ERROR","fields":{"error":"500 Internal Server Error - Order request failed - Offer to take could not be found in current maker offers, you might have an outdated offer"},"target":"taker::routes","span":{"cfd_order_request":"Json(CfdOrderRequest { order_id: OrderId(260a7251-a720-44fb-9bc1-e075a0c81cb2), quantity: Usd(100), leverage: Leverage(2) })","name":"POST /cfd/order"}}

2022-08-17 14:56:02
{"timestamp":"2022-08-17T14:56:02.117942241Z","level":"ERROR","fields":{"error":"Offer to take could not be found in current maker offers, you might have an outdated offer"},"target":"daemon","span":{"leverage":"Leverage(2)","offer_id":"OrderId(260a7251-a720-44fb-9bc1-e075a0c81cb2)","quantity":"Usd(100)","name":"place_order"}}

I was able to reproduce this locally but not deterministically. When I started a taker from master locally I was at first able to open a position, but then ran into the same problem after letting taker run for some time:
2022-08-17 15:14:50 ERROR POST /cfd/order{cfd_order_request=Json(CfdOrderRequest { order_id: OrderId(1aba039f-01c5-457c-9c64-63692b21326c), quantity: Usd(100), leverage: Leverage(2) })}:place_order{offer_id=OrderId(1aba039f-01c5-457c-9c64-63692b21326c) quantity=Usd(100) leverage=Leverage(2)}: daemon: error=Offer to take could not be found in current maker offers, you might have an outdated offer
2022-08-17 15:14:50 ERROR POST /cfd/order{cfd_order_request=Json(CfdOrderRequest { order_id: OrderId(1aba039f-01c5-457c-9c64-63692b21326c), quantity: Usd(100), leverage: Leverage(2) })}: taker::routes: error=500 Internal Server Error - Order request failed - Offer to take could not be found in current maker offers, you might have an outdated offer
2022-08-17 15:14:50 DEBUG http: Handled request method=POST path=/api/cfd/order status=500 Internal Server Error

A restart of the taker_master did however not resolve the problem in the taker_master UI.

On current master this happens when the maker just sent out an ETH/USD offer and are trying to take a BTC/USD offer in the taker-UI.
This is likely a problem of consuming ETH/USD as BTC/USD. As long as the maker only sends out BTC/USD offers there is no problem.
Given that this code is still seeing heavy changes with currently pending PRs I am closing this for now.


(WIP) Get rid of 2to3

On EuroPython we sprinted on making Cython single-source compatible between py2/py3, because waiting for the 2to3 run each time a change needs to be tested takes an annoying amount of time.
The shrinking list of 2to3 fixers that are still needed is in 2to3-fixers.txt.

I hope you don't mind if I don't merge this specific pull request. I also continued our work from yesterday in parallel (sorry for the duplicate work) and while at it, modernised a couple of places, e.g. the demos. I'm currently finishing up the 'unicode' adaptations and will then push the branch back into master.
Thanks for your work, it's really helpful.

OK! I'll leave it in your hands then. Glad I could help!

Very nice work. For the record, I'd be happy with using to 3to2 instead of 2to3 if need be.


Any plans of a React Native equivalent?

Awesome library! Any plans of having a React Native version of the same?

probably not. There is a ton of DOM specific code here, that would be difficult or impossible to port to RN, also we don't do any RN development at the moment so there isn't much of a need.

@sanketsahusoft
Hi, I am creating react-native-big-calendar, inspired by this library.
https://github.com/llotheo/react-native-big-calendar
The functionality has not been equivalent to react-big-calendar yet, but basic features such as rendering cell components, weekly schedules, and listing events are implemented. And it runs on Web/Android/iOS.
Please take a loot! Thanks.


Failed to upgrade with --genome GRCh37

Version info

bcbio version (bcbio_nextgen.py --version): 1.2.9a
OS name and version (lsb_release -ds): Ubuntu 16.04.7 LTS

To Reproduce
Exact bcbio command you have used:
sudo /home/iblc3/Tools/bcbio/tools/bin/bcbio_nextgen.py upgrade -u development --genomes GRCh37

Your yaml configuration file:

Log files (could be found in work/log)
Please attach (10MB max):  bcbio-nextgen-commands.log, and bcbio-nextgen-debug.log.
Error message:
File ‘GRCh37-rnaseq-2015-12-01.tar.xz’ not modified on server. Omitting download.

xz: GRCh37-rnaseq-2015-12-01.tar.xz: Compressed data is corrupt
tar: Unexpected EOF in archive
tar: Unexpected EOF in archive
tar: Error is not recoverable: exiting now
Traceback (most recent call last):
  File "/home/iblc3/Tools/bcbio/tools/bin/bcbio_nextgen.py", line 228, in <module>
    install.upgrade_bcbio(kwargs["args"])
  File "/home/iblc3/Tools/bcbio/anaconda/lib/python3.7/site-packages/bcbio/install.py", line 107, in upgrade_bcbio
    upgrade_bcbio_data(args, REMOTES)
  File "/home/iblc3/Tools/bcbio/anaconda/lib/python3.7/site-packages/bcbio/install.py", line 359, in upgrade_bcbio_data
    args.cores, ["ggd", "s3", "raw"])
  File "/home/iblc3/MD/02_MDv3_pipeline/sample/work/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/genomes.py", line 354, in install_data_local
    _prep_genomes(env, genomes, genome_indexes, ready_approaches, data_filedir)
  File "/home/iblc3/MD/02_MDv3_pipeline/sample/work/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/genomes.py", line 480, in _prep_genomes
    retrieve_fn(env, manager, gid, idx)
  File "/home/iblc3/MD/02_MDv3_pipeline/sample/work/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/genomes.py", line 875, in _install_with_ggd
    ggd.install_recipe(os.getcwd(), env.system_install, recipe_file, gid)
  File "/home/iblc3/MD/02_MDv3_pipeline/sample/work/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/ggd.py", line 30, in install_recipe
    recipe["recipe"]["full"]["recipe_type"], system_install)
  File "/home/iblc3/MD/02_MDv3_pipeline/sample/work/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/ggd.py", line 62, in _run_recipe
    subprocess.check_output(["bash", run_file])
  File "/home/iblc3/Tools/bcbio/anaconda/lib/python3.7/subprocess.py", line 411, in check_output
    **kwargs).stdout
  File "/home/iblc3/Tools/bcbio/anaconda/lib/python3.7/subprocess.py", line 512, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['bash', '/home/iblc3/Tools/bcbio/genomes/Hsapiens/GRCh37/txtmp/ggd-run.sh']' returned non-zero exit status 2.

Hi @zetamui !
Thanks for reporting and sorry about the issue!
It is this recipe that failing: https://github.com/chapmanb/cloudbiolinux/blob/master/ggd-recipes/GRCh37/transcripts.yaml
Could you please check these two commands in your environment?
wget https://s3.amazonaws.com/biodata/annotation/GRCh37-rnaseq-2015-12-01.tar.xz
xz -dc *-rnaseq-*.tar.xz | tar --no-same-owner -xpf -

It works in the two environments I have access to.
The xz is from bcbio (please make sure you are not using another xz).
$ which xz
[bcbio]/anaconda/bin/xz

You may also check the file size:
2021-12-07 15:39:25 (6.74 MB/s) - ‘GRCh37-rnaseq-2015-12-01.tar.xz’ saved [2245386164/2245386164]
Sergey

Hi @zetamui !
Thanks for reporting and sorry about the issue! It is this recipe that failing: https://github.com/chapmanb/cloudbiolinux/blob/master/ggd-recipes/GRCh37/transcripts.yaml
Could you please check these two commands in your environment?
wget https://s3.amazonaws.com/biodata/annotation/GRCh37-rnaseq-2015-12-01.tar.xz
xz -dc *-rnaseq-*.tar.xz | tar --no-same-owner -xpf -

It works in the two environments I have access to.
The xz is from bcbio (please make sure you are not using another xz).
$ which xz
[bcbio]/anaconda/bin/xz

You may also check the file size: 2021-12-07 15:39:25 (6.74 MB/s) - ‘GRCh37-rnaseq-2015-12-01.tar.xz’ saved [2245386164/2245386164]
Sergey

I have checked these two commands, both works and the output to which xz is:
iblc3@Johnny-6:~/MD/02_MDv3_pipeline/sample/work$ which xz
/home/iblc3/Tools/bcbio/tools/bin/xz

Filesize is 2021-12-08 09:28:43 (2.72 MB/s) - ‘GRCh37-rnaseq-2015-12-01.tar.xz’ saved [2245386164/2245386164]

thanks for checking! It looks like everything works as expected.
It might be a random connection error when downloading from s3, I also got it once.
I made wget a little tougher with --random-wait --retry-connrefused
Please try again! If it is still not working, you may just extract all these files to
[bcbio]/genomes/Hsapiens/GRCh37/rnaseq and make sure you have references in your
[bcbio]/genomes/Hsapiens/GRCh37/seq/GRCh37-resources.yaml :
rnaseq:
  transcripts: ../rnaseq/ref-transcripts.gtf
  transcripts_mask: ../rnaseq/ref-transcripts-mask.gtf
  transcriptome_index:
    tophat: ../rnaseq/tophat/GRCh37_transcriptome.ver
  dexseq: ../rnaseq/ref-transcripts.dexseq.gff3
  refflat: ../rnaseq/ref-transcripts.refFlat
  rRNA_fa: ../rnaseq/rRNA.fa

rnaseq:
  transcripts: ../rnaseq/ref-transcripts.gtf
  transcripts_mask: ../rnaseq/ref-transcripts-mask.gtf
  transcriptome_index:
    tophat: ../rnaseq/tophat/GRCh37_transcriptome.ver
  dexseq: ../rnaseq/ref-transcripts.dexseq.gff3
  refflat: ../rnaseq/ref-transcripts.refFlat
  rRNA_fa: ../rnaseq/rRNA.fa

I have tried but still the same error. Then, I tried your suggestions downloading and extracting the GRCh37 rnaseq file and put in the folder as you have suggested. However, since the GRCh37 didn't go through the installation, it is still not usable and I got this error:
``
ValueError: Did not find genome build GRCh37 in bcbio installation: /home/iblc3/Tools/bcbio/galaxy/tool-data/sam_fa_indices.loc

Have you tried to repeat the genome install after unpacking the rnaseq files?

Have you tried to repeat the genome install after unpacking the rnaseq files? What about hg38 genome? Could you please try to install it?

I have tried, upgrade --genomes GRCh37 continues to have error:
File ‘GRCh37-rnaseq-2015-12-01.tar.xz’ not modified on server. Omitting download.

xz: GRCh37-rnaseq-2015-12-01.tar.xz: Compressed data is corrupt
tar: Unexpected EOF in archive
tar: Unexpected EOF in archive
tar: Error is not recoverable: exiting now
Traceback (most recent call last):
  File "/home/iblc3/Tools/bcbio/tools/bin/bcbio_nextgen.py", line 228, in <module>
    install.upgrade_bcbio(kwargs["args"])
  File "/home/iblc3/Tools/bcbio/anaconda/lib/python3.7/site-packages/bcbio/install.py", line 107, in upgrade_bcbio
    upgrade_bcbio_data(args, REMOTES)
  File "/home/iblc3/Tools/bcbio/anaconda/lib/python3.7/site-packages/bcbio/install.py", line 359, in upgrade_bcbio_data
    args.cores, ["ggd", "s3", "raw"])
  File "/home/iblc3/MD/02_MDv3_pipeline/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/genomes.py", line 354, in install_data_local
    _prep_genomes(env, genomes, genome_indexes, ready_approaches, data_filedir)
  File "/home/iblc3/MD/02_MDv3_pipeline/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/genomes.py", line 480, in _prep_genomes
    retrieve_fn(env, manager, gid, idx)
  File "/home/iblc3/MD/02_MDv3_pipeline/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/genomes.py", line 875, in _install_with_ggd
    ggd.install_recipe(os.getcwd(), env.system_install, recipe_file, gid)
  File "/home/iblc3/MD/02_MDv3_pipeline/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/ggd.py", line 30, in install_recipe
    recipe["recipe"]["full"]["recipe_type"], system_install)
  File "/home/iblc3/MD/02_MDv3_pipeline/tmpbcbio-install/cloudbiolinux/cloudbio/biodata/ggd.py", line 62, in _run_recipe
    subprocess.check_output(["bash", run_file])
  File "/home/iblc3/Tools/bcbio/anaconda/lib/python3.7/subprocess.py", line 411, in check_output
    **kwargs).stdout
  File "/home/iblc3/Tools/bcbio/anaconda/lib/python3.7/subprocess.py", line 512, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['bash', '/home/iblc3/Tools/bcbio/genomes/Hsapiens/GRCh37/txtmp/ggd-run.sh']' returned non-zero exit status 2.

But upgrade --genomes hg38 successfully installed.

thanks for checking!
This is unfortunate that GRCh37 is not working: the recipes are very similar:
https://github.com/chapmanb/cloudbiolinux/blob/master/ggd-recipes/GRCh37/transcripts.yaml
https://github.com/chapmanb/cloudbiolinux/blob/master/ggd-recipes/hg38/transcripts.yaml
And GRCh37 works on the other system.
I could only think that the incomplete file was downloaded on your system and cached, so you may try to reach out to network admins asking to drop it from the cache or give you an instruction on how to bypass the proxy.
On the bcbio side I can suggest installing your genome as a custom one:
https://bcbio-nextgen.readthedocs.io/en/latest/contents/configuration.html#adding-custom-genomes


Create 0000_cargo_standard_directories.md

Initial draft of the RFC

I think the most important contribution to this date is this comment by @brson here: https://github.com/rust-lang/cargo/pull/5183#issuecomment-381449546.
If you take things step-by-step, I believe that the very first art of the RFC should suggest some cargo dirs sub-command, which introduces the notion that there might be different directories in the future, such that people can mentally (and code-wise) prepare for it.

Is there any chance of including a section on the target directory currently present in workspaces / package directories after working with cargo build, cargo test or similar? In particular considering moving this directory and the files within it (with some unique name, perhaps derived from the path to the projects files) to the user local cache directory currently known to cargo (whatever that might end up being).
As others have mention (https://github.com/rust-lang/cargo/issues/1734#issuecomment-372071041, https://github.com/rust-lang/cargo/issues/1734#issuecomment-721183423), keeping a directory of mostly temporary generated files alongside the source files at arbitrary locations in the users filesystem can also be a source of pain.
My personal use-case for this is using BTRFS snapshots to make efficient and fast backups of my home directory. While this method is very efficient it does not allow for arbitrary filtering rules to exclude directories such as target in a cargo workspace due to the technical details of filesystem snapshotting.
A solution to this is marking special fixed paths as separate from the main home filesystem (making it another subvolume in BTRFS's case). This however is only possible if most if not all temporary files (that are uninteresting / hindering for backups) are stored under a common ancestor path (e.g. ~/.cache).
While my use-case deals with BTRFS in particular, I've noticed other backup approaches often have similar issues due to limited filtering options (e.g. rsync can use .gitignore where available, but this fails for workspaces with git versioned crates, but itself no git versioning or .gitignore), and the inability to rule out target as a name for directories that should be backed up in general (somebody might want to use that name for other reasons).
This issue is not special to Rust and cargo, but rather to all build systems that store generated files alongside source files (or even worse interspersed with source files). I feel like Rust could have another benefit over other programming language ecosystems by getting this right.
A possible counter point worth mentioning would be the wide-reaching use of git versioning in the Rust ecosystem paired with git repository servers, making local backups somewhat unnecessary or perhaps better accomplished otherwise.
In my case I could probably store versioned code projects in a separate subvolume only for such projects that will not be included in backups.
If you feel that his might be out of scope for this RFC, do tell (and possibly mark this off-topic OSLT). I can also imagine this fitting in a standalone follow up RFC after this one. I however feel that this is an important point that might be worth bundling together with this proposal.
It might be worth pulling in opinions from people involved with https://github.com/rust-lang/cargo/issues/6100.

For this specifically, target can be a symlink off into some ignored place. I've been doing this for years (and contributing fixes to projects that don't ignore it when it is a symlink. Anyone using cargo init after Jan 2018 has this patch to support it, but some are still around. And other gitignore templates don't have the change yet.


Feature Request - control client by clientId  for admistrator fucntion

the best way maybe  to make some dynamic  acl rule to control user to access the topic.
but it maybe consume huge resources to achieve this goal.
I think maybe can add some interfere to control client  to access some topic for system adminstrator。
feature description：
1、kick some client by clientid
2、unsubscribe some topic of the client by clientid
by cli command or web console is all ok，but should have acl rule to control this privilege。
I can use this interfere in java/python/c etc.  to do this  admin function。

3， subscribe some topic of the client by clientid
With 2 and 3, I can use emqttd as a pure push server.  Make my clients full passive, clients only need connect to emqttd and receive messages. Application server know what topic need to be subscribe and unsubscribe for a specified clientID at runtime.
Also this can save clients network traffic, clients no need subscription and unsubscription, all controlled by internal server.

4, publish message to one username's all session, emqttd will use topic '$Q/client/ClientId'.
If the username has no session bind, then abandon this message and do nothing.
This can big improve thrid party server performance,  no need query, just push to those active user(48h expire). The client know how long it offline, it will sync information with application server by its own way(like HTTP request) when expired.

subscribe topic by clientid
1  add code in emqttd/rel/files/emqttd_ctl
Check the first argument for instructions
case "$1" in
subscribe)
if [ $# -ne 4 ]; then
echo "Usage: $SCRIPT subscribe   "
exit 1
fi
    RES=`$NODETOOL ping`
    if [ "$RES" != "pong" ]; then
        echo "Node is not running!"
        exit 1
    fi
    shift

    $NODETOOL rpc emqttd_ctl subscribe $@
    ;;

in emqttd/apps/emqttd/src/emqttd_ctl.erl
-export([subscribe/1,
status/1,
..
%%------------------------------------------------------------------------------
%% @doc subscribe topic by clientid
%% @end
%%------------------------------------------------------------------------------
subscribe([ClientId, Topics, Qos]) ->
Client = emqttd_cm:lookup(bin(ClientId)),
#mqtt_client{clientid = _, client_pid =ClientPid} = Client,
%?PRINT("subscribe ~p ~p ~p ~p ~n", [ClientId, Topics, Qos, ClientPid]),
subscribe_iml([ClientPid, Topics, Qos]).

subscribe_iml([undefined, _, _])->
ignore;
subscribe_iml([ClientPid, Topics, Qos])->
[ClientPid ! {subscribe, list_to_binary([Topics]), Qos}].
test result
right clientid
root@10-9-26-83:/data/emqttd/rel/emqttd/bin# ./emqttd_ctl subscribe lsxtest dsfsf  0
19:15:06.851 [info] Client lsxtest subscribe [{<<"dsfsf">>,"0"}]. Granted QoS: ["0"]
wrong cliendid
root@10-9-26-83:/data/emqttd/rel/emqttd/bin# ./emqttd_ctl subscribe lsxtest1 dsfsf  0
RPC to<EMAIL_ADDRESS>failed: {'EXIT',
{{badmatch,undefined},
[{emqttd_ctl,subscribe,1,
[{file,"src/emqttd_ctl.erl"},{line,59}]},
{rpc,'-handle_call_call/6-fun-0-',5,
[{file,"rpc.erl"},{line,205}]}]}}
root@10-9-26-83:/data/emqttd/rel/emqttd/bin#

@erylee I believe that what I am requesting in #252 is roughly the same as @roytan883 is requesting in here.


Support JSON stringify replacer argument.

Adds support for the replacer argument of JSON.stringify, in the same
way that request already supports the revivier argument for JSON.parse.

Updated to remove extra semicolon.

@mikeal Anything I can do to move this one forward?  It seems like a simple change and complements the existing use of the reviver when parsing JSON, but I haven't heard a yeah, a nay or a please-change-this from anyone.

So, I'm +1 on adding this for now but it should be named something else, like "jsonStringify".

Thanks @mikeal.
Just to explain my reasoning, I went with jsonReplacer as, like the existing jsonReviver argument, it reflects the name of the argument parsed to the underlying JSON.stringify call (as reviver reflects the argument to JSON.parse) and I thought that those names would be more obvious to users because of that.
That said, if you're sure that something like jsonStringifier instead I'll make that change and repush.

Possibly something like jsonParseReviver and jsonStringifyReplacer would be more descriptive for both of them.

Test failures appear unrelated...

@elyobo don't squash commits before the final review, now I can't see what your first commit looked like.
jsonReplacer is fine, that's how we add those options so far. Ideally we should be using an object for these settings like this

Apologies on the squashing, I can probably reconstruct it out of the reflog if you'd like to see it how it was.  The only change in the last one was to correct the JSON.string() to JSON.stringify() in the readme.  Before that the change was to update the docs in the readme, which I'd missed before that.  Before that was a change to switch to jsonStringifier along the lines of mikeal's suggestion which I pushed accidentally, then reverted and squashed.  No functional changes have been made at any time.

Ok :+1: do you want this change published soon? It's probably a good time for new release anyway.

Thanks for the merge, whenever suits you to release is fine by me.
On Sat, 26 Mar 2016 18:50 simo<EMAIL_ADDRESS>wrote:

Ok [image: :+1:] do you want this change published soon? It's probably a
good time for new release anyway.
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/request/request/pull/2009#issuecomment-201726293


"Error processing 'configurationDone' request. Unknown Error: 0x89720010" in 1.22.0-insider

This issue was reported by @nesshoever in https://github.com/OmniSharp/omnisharp-vscode/issues/143
VS Code version:
Version 1.22.0-insider
Commit 31c30b99345e65fffdc33066726d0962dfbecfa3
Date 2018-03-21T06:14:55.070Z
Shell 1.7.12
Renderer 58.0.3029.110
Node 7.9.0
Architecture x64
Repro steps:

Install insiders build
Open a C# folder
Attempt to debug

Result:
C# debug adapter fails with "Error processing 'configurationDone' request. Unknown Error: 0x89720010"
This error indicates that the handshake request is failing or providing the wrong data.

@bpasero did we update the handshake library for the new electron? Do we have some checkbox so we do not forget to do this onward?
@gregg-miskelly thanks for reporthing this.

@isidorn we always build that handshake library as part of the build unless that changed @joaomoreno ?

@isidorn fyi I verified that the handshake module can be required in insiders, so this must be something else.

@gregg-miskelly we did not change the handshake module, aren't you guys the authors of that module?

We provided the initial implementation, but we don't own it.

@gregg-miskelly can you please check if everything works fine if you remove the handshake in your extension? Also you could provide more data on what is worng on your extension side.
Please note that the following 4 days are off in Zurich so I will have no time to look into this.

This could be due to the new build machines. @isidorn Make sure this works for you in Windows.

Fyi I verified that the vsda module can be required on all platforms.

Here is the result that VS Code sends -
{"type":"response","seq":3,"command":"handshake","request_seq":2,"success":true,"body":{"signature":""}}

Maybe then it is not about building the module and requiring it but there is actually more...

@gregg-miskelly I cannot reproduce the empty string, what value are you passing into the sign function that would return an empty string?

@bpasero are you using Linux? I don't see the issue on OSX. I will check what the input is.

Here was the input: "fut8qEkPJtmF0lntCUnlGDjD1mnsIvnBjycgqcZ4Z4E=".

FYI I'm seeing this also, on Linux:
Distributor ID: Ubuntu
Description:    Ubuntu 17.10
Release:        17.10
Codename:       artful
Latest Insiders / C# extension.

@gregg-miskelly thanks I can reproduce on Linux only too.

@gregg-miskelly can you please try with todays insider build from here.
@joaomoreno looks like you changed back to our old Linux build machine. That seems to have fixed the issue, I am getting a hash back now again from todays insider build. Leaving the issue up to you.

@bpasero I'll close this for now. But whoever owns that signing code should be aware that stuff will break as soon as we update to 16.04. Which we don't intend on doing anyway.

I'm still getting this error.
Version 1.22.0-insider
Commit 952b2a641da89a6c7bc28387474bc8afd47f0d2f
Date 2018-03-29T15:50:12.706Z
Shell 1.7.12
Renderer 58.0.3029.110
Node 7.9.0
Architecture x64
Fedora 27
Try with both the 1.14.0 OmniSharp C# extension as well as 1.15.0-beta4 OmniSharp C# extension.

@joaomoreno I can reproduce, are you sure we have the exact same build environment as before?

Im also getting this error, can not debug at all.
Error processing 'configurationDone' request. Unknown Error: 0x89720010
Version 1.22.0-insider
Commit 6c22e21cdcd6811770ddcc0d8ac3174aaad03678
Date 2018-03-30T14:36:39.526Z
Shell 1.7.12
Renderer 58.0.3029.110
Node 7.9.0
Architecture x64
Ubuntu 17.10 64

@XewTurquish1 thanks!

I'm getting this error with 1.23.1 when trying to debug a fresh 'dotnet new webapi' project.
Version 1.23.1
Commit d0182c3417d225529c6d5ad24b7572815d0de9ac
Date 2018-05-04T19:23:45Z
Shell 1.7.12
Renderer 58.0.3029.110
Node 7.9.0
Architecture x64
Linux: Solus
dotnet: 2.1.300-rc1-008673


Speed up npm bundle builds

[x] Use include option to point to app sources (reduces by 33%)
[x] Try extracting vendor modules into own bundle
[x] Have app, terminal-app, and common bundles

Niccee, I get ~40s -> ~30s :+1:
Turning sourceMaps off[0] gets another 5s, so down to about ~25s. Do they get used? I haven't had to debug anything in a prod env yet :).
diff --git a/client/webpack.production.config.js b/client/webpack.production.config.js
index 89744be..8072589 100644
--- a/client/webpack.production.config.js
+++ b/client/webpack.production.config.js
@@ -74,6 +74,7 @@ module.exports = {
     new webpack.DefinePlugin(GLOBALS),
     new webpack.optimize.CommonsChunkPlugin('vendors', 'vendors.js'),
     new webpack.optimize.UglifyJsPlugin({
+      sourceMap: false,
       compress: {
         warnings: false
       }

Everything seems to still be working in dev/prod local/container.
LGTM

The sourceMap: false option in uglify gives me this error
ERROR in vendors.js from UglifyJs
TypeError: Cannot read property 'sections' of null
    at new SourceMapConsumer (/Users/david/weave/src/github.com/weaveworks/scope/client/node_modules/webpack-core/node_modules/source-map/lib/source-map/source-map-consumer.js:24:21)
    at /Users/david/weave/src/github.com/weaveworks/scope/client/node_modules/webpack/lib/optimize/UglifyJsPlugin.js:62:23

Turns out, it tried to uglify twice if -p was given. Now included sourceMaps: false.


Add TT-NN operation to re-pad tensor with new values

Is your feature request related to a problem? Please describe.
Many ops assume the right padding.
We want to establish a standard where ops assume padding to be junk.
Describe the solution you'd like
We want to make it easier for ops to re-pad tensors with valid data
Describe alternatives you've considered
none
Additional context
Ideally the next step we should allow to pass an additional arg which would specify the pad info (like whether tensor is padded with -inf, inf, 0 or unknown).

@ayerofieiev-tt could you put a priority on this?


handle ACR request failure exceptions

This fixes #5333.

This is harder to cause with template specs because the URI is tied to the cloud profile. With custom, we could still have the issue, but I decided to skip fixing that one for now.


[Bug] AsyncSubscribe not found

Search before asking

[X] I had searched in the issues and found no similar issues.

Environment
Linux
EventMesh version
1.4.0
What happened
When invoking $JAVA $JAVA_OPT -classpath ${DEMO_PATH}/conf:${DEMO_PATH}/apps/*:${DEMO_PATH}/libs/* $DEMO_MAIN with DEMO_PATH=org.apache.eventmesh.tcp.demo.sub.eventmeshmessage.AsyncSubscribe, I get the following error:
Error: Could not find or load main class org.apache.eventmesh.tcp.demo.sub.eventmeshmessage.AsyncSubscribe
How to reproduce

Download code and extract as eventmesh-1.4.0 folder
go to eventmesh-1.4.0/eventmesh-examples folder and execute ../gradlew build
gradle successfully builds
move results to a demo-app folder to keep things ordered (conf with server.env etc, apps with classes, and libs with jars, slf4j-api and sl4j-simple). If skipping that phase, then the scripts do not work........
Launch subscriber script and it fails, but the publisher will work....

Debug logs
No response
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

I just follow your steps, but didn't get your ERROR, please take a look

Hi, thank you for your response.
I cannot get your results. I will explain better all the steps I do:
$ docker run -it --rm openjdk:8 /bin/bash

# cd /opt
# EVENTMESH_VERSION=1.4.0
# wget https://github.com/apache/incubator-eventmesh/archive/refs/tags/v${EVENTMESH_VERSION}.tar.gz -O - | tar -xz
# mv incubator-eventmesh-${EVENTMESH_VERSION} eventmesh-${EVENTMESH_VERSION}
# cd eventmesh-${EVENTMESH_VERSION}/eventmesh-example
# sh /opt/eventmesh-${EVENTMESH_VERSION}/gradlew build

At the end of the process, if I go to eventmesh-examples/bin and launch tcp_sub.sh or
the publisher, it doesn't work.
# cd bin
# ls
http_pub.sh  http_sub.sh  tcp_pub.sh  tcp_pub_broadcast.sh  tcp_sub.sh  tcp_sub_broadcast.sh
# bash tcp_sub.sh
tcp_sub.sh: line 27: warning: setlocale: LC_CTYPE: cannot change locale (en_US.UTF-8): No such file or directory
tcp_sub.sh: line 28: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
tcp_sub_demo use java location= /usr/local/openjdk-8/bin/java
DEMO_HOME : /data/em-example/dist/eventmesh-examples, DEMO_LOG_HOME : /data/em-example/dist/eventmesh-examples/logs
cat: /data/em-example/dist/eventmesh-examples/conf/server.env: No such file or directory

I tried to create a similar launch script in this way:
# cd /opt/eventmesh-${EVENTMESH_VERSION}/eventmesh-examples
# mkdir -p demo-app/conf
# mkdir -p demo-app/apps
# mkdir -p demo-app/libs
# mv build/resources/main/* demo-app/conf
# mv build/libs/* demo-app/libs
# mv build/classes demo-app/apps
# # Add missing library slf4j
# SLF4J_VERSION=1.7.9
# wget -P demo-app/libs https://repo1.maven.org/maven2/org/slf4j/slf4j-api/${SLF4J_VERSION}/slf4j-api-${SLF4J_VERSION}.jar
# wget -P demo-app/libs https://repo1.maven.org/maven2/org/slf4j/slf4j-simple/${SLF4J_VERSION}/slf4j-simple-${SLF4J_VERSION}.jar
# cd demo-app
# pwd
/opt/eventmesh-1.4.0/eventmesh-examples/demo-app
# ls
apps  conf  libs

Now I add in demo-app the following scripts (inspired by the ones in the project):
tcp_pub.sh
#!/bin/bash

# This script will launch the demo app as TCP publisher.

# The configuration of different servers may be inconsistent,
# adding these configurations can avoid the problem of garbled characters
# export LANG=en_US.UTF-8
# export LC_CTYPE=en_US.UTF-8
# export LC_ALL=en_US.UTF-8

DEMO_PATH=${1:-$(dirname $0)}

DEMO_LOG_PATH=${DEMO_PATH}/logs
DEMO_LOG=${DEMO_LOG_PATH}/demo_tcp_pub.log

# create logs folder, if already exist does not show err msg
mkdir -p "${DEMO_LOG_PATH}" 2> /dev/null

JAVA="$(which java)"

# Java configuration options
JAVA_OPT=`cat ${DEMO_PATH}/conf/server.env | grep APP_START_JVM_OPTION::: | awk -F ':::' {'print $2'}`
JAVA_OPT="${JAVA_OPT} -XX:+UseG1GC -XX:G1HeapRegionSize=16m -XX:G1ReservePercent=25 -XX:InitiatingHeapOccupancyPercent=30 -XX:SoftRefLRUPolicyMSPerMB=0 -XX:SurvivorRatio=8 -XX:MaxGCPauseMillis=50"
JAVA_OPT="${JAVA_OPT} -verbose:gc -Xloggc:${DEMO_PATH}/logs/demo_tcp_pub_gc_%p.log -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime -XX:+PrintAdaptiveSizePolicy"
JAVA_OPT="${JAVA_OPT} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=${DEMO_PATH}/logs -XX:ErrorFile=${DEMO_PATH}/logs/hs_err_%p.log"
JAVA_OPT="${JAVA_OPT} -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=5 -XX:GCLogFileSize=30m"
JAVA_OPT="${JAVA_OPT} -XX:-OmitStackTraceInFastThrow"
JAVA_OPT="${JAVA_OPT} -XX:+AlwaysPreTouch"
JAVA_OPT="${JAVA_OPT} -XX:MaxDirectMemorySize=8G"
JAVA_OPT="${JAVA_OPT} -XX:-UseLargePages -XX:-UseBiasedLocking"
JAVA_OPT="${JAVA_OPT} -Dio.netty.leakDetectionLevel=advanced"
JAVA_OPT="${JAVA_OPT} -Dio.netty.allocator.type=pooled"
JAVA_OPT="${JAVA_OPT} -Djava.security.egd=file:/dev/./urandom"
JAVA_OPT="${JAVA_OPT} -Dlog4j.configurationFile=${DEMO_PATH}/conf/log4j2.xml"
#JAVA_OPT="${JAVA_OPT} -Deventmesh.log.home=${DEMO_LOG_PATH}"
JAVA_OPT="${JAVA_OPT} -DconfPath=${DEMO_PATH}/conf"
JAVA_OPT="${JAVA_OPT} -Dlog4j2.AsyncQueueFullPolicy=Discard"
JAVA_OPT="${JAVA_OPT} -Drocketmq.client.logUseSlf4j=true"

DEMO_MAIN=org.apache.eventmesh.tcp.demo.pub.eventmeshmessage.AsyncPublish

# Debug and log
echo "====== tcp publisher demo ======" | tee -a "$DEMO_LOG"
echo "INFO: Starting at $(date)" | tee -a "$DEMO_LOG"
echo "INFO: DEMO_PATH: ${DEMO_PATH}" | tee -a "$DEMO_LOG"
echo "INFO: DEMO_LOG_PATH : ${DEMO_LOG_PATH}" | tee -a "$DEMO_LOG"
echo "INFO: JAVA: $JAVA" | tee -a "$DEMO_LOG"
echo "INFO: DEMO MAIN: $DEMO_MAIN" | tee -a "$DEMO_LOG"

$JAVA $JAVA_OPT -classpath ${DEMO_PATH}/conf:${DEMO_PATH}/apps/*:${DEMO_PATH}/libs/* $DEMO_MAIN | tee -a "$DEMO_LOG"

tcp_sub.sh
#!/bin/bash

# This script will launch the demo app as TCP publisher.

# The configuration of different servers may be inconsistent,
# adding these configurations can avoid the problem of garbled characters
# export LANG=en_US.UTF-8
# export LC_CTYPE=en_US.UTF-8
# export LC_ALL=en_US.UTF-8

DEMO_PATH=${1:-$(dirname $0)}

DEMO_LOG_PATH=${DEMO_PATH}/logs
DEMO_LOG=${DEMO_LOG_PATH}/demo_tcp_sub.log

# create logs folder, if already exist does not show err msg
mkdir -p "${DEMO_LOG_PATH}" 2> /dev/null

JAVA="$(which java)"

# Java configuration options
JAVA_OPT=`cat ${DEMO_PATH}/conf/server.env | grep APP_START_JVM_OPTION::: | awk -F ':::' {'print $2'}`
JAVA_OPT="${JAVA_OPT} -XX:+UseG1GC -XX:G1HeapRegionSize=16m -XX:G1ReservePercent=25 -XX:InitiatingHeapOccupancyPercent=30 -XX:SoftRefLRUPolicyMSPerMB=0 -XX:SurvivorRatio=8 -XX:MaxGCPauseMillis=50"
JAVA_OPT="${JAVA_OPT} -verbose:gc -Xloggc:${DEMO_PATH}/logs/demo_tcp_sub_gc_%p.log -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime -XX:+PrintAdaptiveSizePolicy"
JAVA_OPT="${JAVA_OPT} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=${DEMO_PATH}/logs -XX:ErrorFile=${DEMO_PATH}/logs/hs_err_%p.log"
JAVA_OPT="${JAVA_OPT} -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=5 -XX:GCLogFileSize=30m"
JAVA_OPT="${JAVA_OPT} -XX:-OmitStackTraceInFastThrow"
JAVA_OPT="${JAVA_OPT} -XX:+AlwaysPreTouch"
JAVA_OPT="${JAVA_OPT} -XX:MaxDirectMemorySize=8G"
JAVA_OPT="${JAVA_OPT} -XX:-UseLargePages -XX:-UseBiasedLocking"
JAVA_OPT="${JAVA_OPT} -Dio.netty.leakDetectionLevel=advanced"
JAVA_OPT="${JAVA_OPT} -Dio.netty.allocator.type=pooled"
JAVA_OPT="${JAVA_OPT} -Djava.security.egd=file:/dev/./urandom"
JAVA_OPT="${JAVA_OPT} -Dlog4j.configurationFile=${DEMO_PATH}/conf/log4j2.xml"
#JAVA_OPT="${JAVA_OPT} -Deventmesh.log.home=${DEMO_LOG_PATH}"
JAVA_OPT="${JAVA_OPT} -DconfPath=${DEMO_PATH}/conf"
JAVA_OPT="${JAVA_OPT} -Dlog4j2.AsyncQueueFullPolicy=Discard"
JAVA_OPT="${JAVA_OPT} -Drocketmq.client.logUseSlf4j=true"

DEMO_MAIN=org.apache.eventmesh.tcp.demo.sub.eventmeshmessage.AsyncSubscribe

# Debug and log
echo "====== tcp subscriber demo ======" | tee -a "$DEMO_LOG"
echo "INFO: Starting at $(date)" | tee -a "$DEMO_LOG"
echo "INFO: DEMO_PATH: ${DEMO_PATH}" | tee -a "$DEMO_LOG"
echo "INFO: DEMO_LOG_PATH : ${DEMO_LOG_PATH}" | tee -a "$DEMO_LOG"
echo "INFO: JAVA: $JAVA" | tee -a "$DEMO_LOG"
echo "INFO: DEMO MAIN: $DEMO_MAIN" | tee -a "$DEMO_LOG"

$JAVA $JAVA_OPT -classpath ${DEMO_PATH}/conf:${DEMO_PATH}/apps/*:${DEMO_PATH}/libs/* $DEMO_MAIN | tee -a "$DEMO_LOG"

Now, if I launch them, tcp_pub works, while the subscriber says that org.apache.eventmesh.tcp.demo.sub.eventmeshmessage.AsyncSubscribe cannot be found.

The sh files has been changed, you can use these files under the master branch https://github.com/apache/incubator-eventmesh/tree/master/eventmesh-examples/bin

Thank you for your replies.

The sh files has been changed, you can use these files under the master branch https://github.com/apache/incubator-eventmesh/tree/master/eventmesh-examples/bin

Or you can build the tar files using the source code, by execute gradlew clean jar dist && gradlew installPlugin and gradlew tar -x test then you can got the tar.gz file.

Ok I did what you suggested and I used the updated files in master.
I noticed that they seem to start, but they are not because of the same error. In the following I inserted just the subscriber script:
[root@9c6dc5a83917 bin]# ls
start.sh  stop.sh  tcp_eventmeshmessage_sub.sh  watchdog.sh

[root@9c6dc5a83917 bin]# pwd
/opt/incubator-eventmesh/dist/bin

[root@9c6dc5a83917 bin]# bash tcp_eventmeshmessage_sub.sh
tcp_sub_demo use java location= /usr/local/jdk/bin/java
DEMO_HOME : /opt/incubator-eventmesh/dist, DEMO_LOG_HOME : /opt/incubator-eventmesh/dist/logs
Error: Could not find or load main class org.apache.eventmesh.tcp.demo.sub.eventmeshmessage.AsyncSubscribe

I'm on docker and I tried both with openjdk-8 and oracle jdk-8.
It seems to me that gradle does not build correctly the examples (it is successful, but the shell scripts do not start).
I could probably be wrong. In that case, can you provide the steps to make the demo work? Running examples is not well documented.

OK，sorry I forgot that , we didn't  package the example module into the tar.gz file for docker image. you can find this in the build.gradle file at root project . It doesn't contains the example module.

Ok, but I need to test the eventmesh deployment I made on a Kubernetes cluster. Working locally is not what I need.

After some testing, I found that gradle builds everything successfully, but the tcp AsyncSubscribe and AsyncSubscribeBroadcast main methods cannot be found when invoking them.
I'm not a Java developer and I have no experience with gradle and after some research it seems everything ok to me in build.gradle.
This does not happen with the Publisher.. could it be related to implements ReceiveMsgHook<EventMeshMessage>?
I tried also to rewrite the subscriber demo from the ground up. I've noticed that even in that case the subscriber is not working (no main class can be found)... At this point I think it could be related to the eventmesh-common or eventmesh-sdk subprojects..

Ok I found that the classpath seems not to be correct. I will investigate more.

Seems to work with the following procedure:

`sh gradlew clean jar dist && sh gradlew installPlugin ``
mv eventmesh-examples/build/classes/java/main/org dist
Add to the classpath :.


Change the shebang lines from "#!/usr/bin/env python" to "#!/usr/bin/env python3"

Describe the Task
Change the shebang lines from "#!/usr/bin/env python" to "#!/usr/bin/env python3"
Best practice indicates that we should change python shebangs to python3 when Python 3.x is supported.
Time Estimate
1 day
Sub-Issues
Consider breaking the task down into sub-issues.

[x] Add a checkbox for each sub-issue here.

Relevant Deadlines
METplus-3.1
Funding Source
?
Define the Metadata
Assignee

[x] Select engineer(s) or no engineer required
[x] Select scientist(s) or no scientist required

Labels

[x] Select component(s)
[x] Select priority
[x] Select requestor(s)

Projects and Milestone

[x] Review projects and select relevant Repository and Organization ones
[x] Select milestone

Define Related Issue(s)
Consider the impact to the other METplus components.

[x] METplus, MET, METdb, METviewer, METexpress, METcalcpy, METplotpy

Task Checklist
See the METplus Workflow for details.

[x] Complete the issue definition above.
[x] Fork this repository or create a branch of develop.
Branch name:  feature_503_python3_shebang
[x] Complete the task and verify your changes.
[x] Add/update unit tests.
[x] Add/update documentation.
[x] Push local changes to GitHub.
[X] Submit a pull request to merge into develop.
Pull request: Feature 503 python3 shebang #508
[ ] Iterate until the reviewer(s) accept and merge your changes.
[ ] Delete your fork or branch.
[ ] Close this issue.

From email thread: You can still obtain the same functionality as calling a wrapper directly by adding an explicit override of the PROCESS_LIST.
For example, if you have a use case that calls GridStat and StatAnalysis in the PROCESS_LIST, let's call it GridStat_StatAnalysis_together.conf. If you wanted to just call GridStat, previously you could call
grid_stat_wrapper.py -c GridStat_StatAnalysis_together.conf
You can get the same behavior by running:
master_metplus.py -c GridStat_StatAnalysis_together.conf -c config.PROCESS_LIST=GridStat
so we aren't losing that functionality, just losing the ability to directly call the script.
A few reasons others why I think we should make this change:
The rearrange of the wrapper and util files to allow METplus to be made into a package causes problems with the imports when trying to run the wrapper file directly. It complains that you are trying to import something that is above the top directory (where the wrappers live). If we really need to support calling the wrapper directly the old way, we would have to change all of the imports to not be relative imports and contain "from metplus.wrappers" or "from metplus.util" before each import.

It makes sense to have users only be able to call py files in the ush directory, which is now only master_metplus.py and validate_config.py.

I don't think anyone called the wrappers directly before.


fix: change the preview default mode from development to production

Description
fix #4007

What is the purpose of this pull request?

[X] Bug fix
[ ] New Feature
[ ] Documentation update
[ ] Other

Before submitting the PR, please make sure you do the following

[X] Read the Contributing Guidelines.
[X] Read the Pull Request Guidelines and follow the Commit Convention.
[X] Check that there isn't already a PR that solves the problem the same way to avoid creating a duplicate.
[X] Provide a description in this PR that addresses what the PR is solving, or reference the issue that it solves (e.g. fixes #123).
[ ] Ideally, include relevant tests that fail without this PR but pass with it.

You are right, mode is really useless in Preview，I have fixed it to production.

@patak-js @iheyunfei
Thank you, I have modified it, help review.


NPM lock issue.

Hit the same issue as described here: https://github.com/flynn/flynn/issues/537
Seems like the builder docker image needs to have its npm upgraded?

We're on v64. buildpack-nodejs has cut a v70, so we're a few releases behind. Could you try the following for me and see if it works for you?
deis config:set BUILDPACK_URL=https://github.com/heroku/heroku-buildpack-nodejs

That will make your build fetch from master instead of using the buildpack bundled with the builder.

@joshmackey the npm in v0.10.35 is 1.4.28. Just add:
"engines": {
  "npm": "2.x"
}

to the package.json and the node.js buildpack will use that version.

Its too late to test any of these. I restarted the builder which removed the lock file.
@bacongobbler I use https://github.com/appstack/heroku-buildpack-nodejs-gulp for a buildpack.
@aledbf I imagine that this would work. I'll update it and we'll see if it ever happens again.
Thanks for the quick response.


⚠ Jenkins Plugins Artifactory has degraded performance

In aea557c, Jenkins Plugins Artifactory (https://get.jenkins.io/plugins/artifactory/) experienced degraded performance:

HTTP code: 200
Response time: 1250 ms

Resolved: Jenkins Plugins Artifactory performance has improved in c476dbc after 45 minutes.


Turkish language support

Turkish language support

We already have Turkish support :)

Closing PR due to the fact that we already have support for the Turkish language in Harpy and in Siren.


Sample projects

Projects:

Simple Razor project - (review/update/cleanup existing project - TestSite)
Simple Blazor project - example
IdentityServer4 project

If someone wants to grab this one, you are welcome.
Please create separate PR for each project.

If i can ever figure out IS 4 ill post it ive been trying to get a hosted Blazor WASM app to work but the server wants AddApiAuthorization and i havent cracked the code yet.

If i can ever figure out IS 4 ill post it ive been trying to get a hosted Blazor WASM app to work but the server wants AddApiAuthorization and i havent cracked the code yet.

I am still trying to find out how AddApiAuthorization  works with the latest Blazor webassembly app template using mongodb


[Impeller] Link 99th and worst frame time benchmarks on the document containing important Impeller benchmarks.

Some important benchmarks the team tracks are documented here. However, this is currently missing the 99th and worst frame time benchmarks. These are important as they capture the jank due to shader compilation. References to these benchmarks must be added to the page.

cc @gaaclarke

I followed the link and several of the bencharmks due include 99% and worst frame time. If there are specific ones that should be added, just make the change?