set plot style

Hi,
I would like to change the default matplotlib style for scatter plots in order to match other plots from DHI, as now fmskill looks too different.
This is how it looks now

And just by changing some line colors and sizes of markers and locations, I get this, which aligns with other tools (eg MOOD plots)

Still not 100% identical but quite almost there at least (both plots are different data by the way)

I had a spaguetti of branches so I had to make a new one with this just change :)

I am a bit hesitant about making the m_tools/MOOD style of plotting the default in FMskill. I think it would be better to have a global parameter:
fmskill.plot_style = "MOOD"

or similar to control the look and feel of the plots.

@ecomodeller : I fixed the location based on fig size, now it should stay in place

@jsmariegaard : Fully agree with your suggestion. However, can we get help with setting this up? :-) Or do you have a good example to adopt from?

I guess I was wondering: Is there a quick way into this now :-)
How about we simply add .scatter(style = None) for now? Just as we have skill_table, plot_backend and maybe others. Then we can in a new PR think about which and how to replace args by global customization?
Maybe it would be even desirable to also have these customization arguments in each method, where the global customization only sets the default (maybe you want a one-off plot look different without changing the global settings)?

I support Hendrik's idea

I found a way to implement this with
fmskill.plot.plot_style = 'MOOD'
would that be ok @jsmariegaard ?

@jsmariegaard  I implemented a plot_style as wanted, so by default you get

and if you add fmskill.plot_style = 'MOOD'  somewhere, you change the global style

and if the previous (default) style is preferred, the user can either restart the kernel or

Good stuff @daniel-caichac-DHI ! Can we not set skill_table = True as default for plot_style = 'MOOD'?

@Hendrik1987  I think we can, I just did not think about it , let me fix it

there it is:
if style=mood and skill_table not explicitly False, then by default skill_table=True

Looks great. I am pasting in a random sample from MOOD for comparison.

Is the aim to get the plot with  plot_style = 'MOOD' to be identical to the plot you get on MOOD?
The main difference is in the title, where the MOOD version has a lot information, are you going to include that as well, and some less important (the title says scatter plot, not sure how useful that is)?
There are some other minor differences, like x axis labels in 45 degrees and non-linear labels on the colorbar (not sure why you would want that though🙄)

@ecomodeller , I don't think it needs to be 100%. But yes, it would be ultimately be the goal to have similar info in the title. But I think we need to first fix the attrs container from which the title can be constructed. For now the user can use the title argument.

FYI, I am working on a general concept for global settings in FMskill. Will make it a PR either today or tomorrow. We can then merge that first, before finishing this PR.

Following @Hendrik1987  comments, inded it does not need to be 100% equivalent (we would need to calculate the Peak Ratio for that as well), and as of now we can with the *kwargs control the xlabel, ylabel and title. We can even have some improvements over the MOOD plot (as in, maybe less decimals for the location, or give the location in UTM if we wanted to).
But what we don't want is to have two plots that look completely different, because then we basically cannot use fmSkill for production in combination with MOOD plots, and that's one of the goals.

FYI, I am working on a general concept for global settings in FMskill. Will make it a PR either today or tomorrow. We can then merge that first, before finishing this PR.

@jsmariegaard  are we ok to merge this PR now???

I finally, got around to work on the global options, they are coming along in #158 - we will merge the global options first, before finishing this PR.

@daniel-caichac-DHI #158 have now been merged - have a look at https://github.com/DHI/fmskill/blob/main/tests/test_settings.py and https://github.com/DHI/fmskill/blob/main/fmskill/plot.py on how to use. We still need to define a function fmskill.set_style() or similar to invoke a number of functions at the same time. But at least we now have a way to handle options in fmskill :)

By the way, it may be simpler to start a new branch following the new way of specifying settings rather than solve all the merge conflicts in this one...

sure, the amount of conflicts will make it easier to make a new branch.
Question is: how should I implement the mood style now?
I am thinking something like the following:

default now is register_option("plot.scatter.quantiles.label", "Q-Q", validator=settings.is_str)
maybe I could add something like
if fmskill.options.style='MOOD':
options.plot.scatter.quantiles.label="Q-Q Line 1:1 fit"
@jsmariegaard what do you think?  I already have all the values and colors/sizes of the MOOD style from this branch that I can close, question is how to implement now to get a smooth approval.

I tried to add some examples of how to register options at the top of https://github.com/DHI/fmskill/blob/main/fmskill/plot.py (and used correspondingly inside the scatter method). That you'll need to do first for all the options you wish to change.
Then we can make a new function in the settings module. Let's call it set_plot_style() for now. This method takes a name as an argument (e.g. MOOD) and contains a dict of the changes that need to be made compared to the default settings. At the bottom of this function, you can apply the options all at once by providing the dict as an argument to fmskill.set_option().
Does it make sense?

I am trying to understand, but if I want to have say point size=5 when using MOOD style, I assume this should be inside the set_plot_style  as you in a dictionary , but I don't understand what should be inside this dictionary and how we would call it later.

From the user perspective, only this will be needed:
import fmskill
fmskill.set_plot_style("MOOD")
# do normal stuff, all plots will now have MOOD-style

As a developer, contributing a new style, you will have to check that all the things you want to change are already registered as an option. If they are, you can just go ahead and create a dictionary with those options.
In settings.py you can add this:
def set_plot_style(name:str) -> None:
    d = {}
    if name == "MOOD":
        d["plot.scatter.quantiles.markersize"] = 2.0
        d["plot.scatter.oneone_line.label"] = "1:1 (45degrees)"
        # add more here
    else:
        raise ValueError(f"Plot style '{name}' not found (MOOD)")
    set_option(d)


Add previous & next buttons to docs pages

Describe the problem you're trying to solve
The docs pages are getting a bit long partly because it's not necessarily obvious to the reader where they would go to next.
Describe the solution you'd like
There are a number of docs sites that use:

Previous & Next page buttons at the bottom of each docs page - this helps users know where to continue their journey
Page hierarchies in the left nav - for example Dagger's API page begins collapsed but when you click on it you see a bunch of sub-pages. This would be helpful for some of our sections where details could be progressively exposed.

(1) seems more useful and important right now. (2) is interesting but may not be needed yet - dropped it in here more to see if there was any thoughts/discussion on it right now.

Wont fix as this is already part of Vitepress default's settings


Feature request: be able to suppress problems

I hope VSCode could allow user to suppress problem highlights in code view, and in the down-left corner of the status bar. Sometimes the error highlights are false-positive, or in some cases, an "error" is intended for some reasons (e.g. a spell-checker falsely flags some acronyms).
I searched in the issue list but have found no one has raised it.. it's similar to #30038 but not the same.

This should be supported by the extensions generating diagnostics to not to have false positives and options to exclude.


Any chance of a typescript compatible version

I'm in a project with a Typescript codebase and would love to import your project but can't because of the lack of typescript support.

Hi @quadrofolio ,
Thank you for liking this library.
I'm planning to upgrade this library with Typescript actually, but it will takes me maybe few weeks or months.
I'll let you know when it publish!

That is great news Wilson. I'll be looking out for it.
Thanks for your reply
Op za 22 apr 2023 om 05:13 schreef Wilson Wu @.***>:

Hi @quadrofolio https://github.com/quadrofolio ,
Thank you for liking this library.
I'm planning to upgrade this library with Typescript actually, but it will
takes me maybe few weeks or months.
I'll let you know when it publish!
—
Reply to this email directly, view it on GitHub
https://github.com/cotton123236/zoomist/issues/16#issuecomment-1518488435,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AADM5UA7NCMKPJDBGDJOZTTXCNEGFANCNFSM6AAAAAAXD4WCHM
.
You are receiving this because you were mentioned.Message ID:
@.***>

--
Joost Klaver
Lead Frontend Developer
+31 6 41236326 <+31641236326> +31 (0)23 727 1077 <+310237271077>

[image: -] https://endeavour.nl [image: -]
https://www.linkedin.com/company/endeavour-agency [image: -]
https://www.instagram.com/endeavouragency [image: -]
https://www.facebook.com/EndeavourAgency.NL
HQ LAB KOEPEL
Gonnetstraat 32 Jansweg 39 Koepelplein 1
2011 KC Haarlem 2011 KM Haarlem 2031 WL Haarlem

[image: -]
[image: -] ISO 9001 / ISO 27001

Hey can i contribute tooooo ???

Hi @quadrofolio @ekshoonya ,
Sorry for the wait! I rebuild Zoomist with TypeScript and already published on NPM just few days ago.
You can checkout branch next. I'll set it to default version after I build the documentation.
If you have any question or suggestion for Zoomist version 2, please let me know! Thanks!!

Hi WIlson,
That is great news. I will definitely check it out.
Thanks for reaching out!
Regards,
Joost
Op ma 2 okt 2023 om 04:21 schreef Wilson Wu @.***>:

Hi @quadrofolio https://github.com/quadrofolio @ekshoonya
https://github.com/ekshoonya ,
Sorry for the wait! I rebuild Zoomist with TypeScript and already
published on NPM just few days ago.
You can checkout branch next
https://github.com/cotton123236/zoomist/tree/next. I'll set it to
default version after I build the documentation.
If you have any question or suggestion for Zoomist version 2, please let
me know! Thanks!!
—
Reply to this email directly, view it on GitHub
https://github.com/cotton123236/zoomist/issues/16#issuecomment-1742317518,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AADM5UGTCRG3C6YDACFT633X5IQJ3ANCNFSM6AAAAAAXD4WCHM
.
You are receiving this because you were mentioned.Message ID:
@.***>

--
Joost Klaver
Lead Frontend Developer
+31 (0)23 727 1077 <+310237271077>
[image: -] http://endeavour.nl
.nl
https://endeavour.nl?utm_source=signaturesatori&utm_medium=email&utm_campaign=Signature GIF Banner (Endeavour videos)
[image: linkedin icon]
https://www.linkedin.com/company/endeavour-agency [image:
instagram icon] https://www.instagram.com/endeavouragency [image:
facebook icon] https://www.facebook.com/EndeavourAgency.NL
HQ LAB KOEPEL
Gonnetstraat 32 Jansweg 39 Koepelplein 1E
2011 KA Haarlem 2011 KM Haarlem 2031 WL Haarlem
[image: -]
https://endeavour.nl?utm_source=signaturesatori&utm_medium=email&utm_campaign=Signature GIF Banner (Endeavour videos)
[image:
-] ISO 9001 /
ISO 27001
[image: Endeavour Video's]
https://endeavour.nl/videos/?utm_source=signaturesatori&utm_medium=email&utm_campaign=video-banner


feat: bulk check api

Enhance check API to accommodate multiple resource permission checks
To avoid breaking changes single resource permission check is also allowed. (Existing fields are deprecated)

Old API contract

POST /admin/v1beta1/check
X-Auth-Email: user-email

Request body
{
   "objectId": "abcd",
   "objectNamespace": "abcd-ns",
   "permission": "edit"
}

Response body
{
    "status": false
}

Modified API contract

POST /admin/v1beta1/check
X-Auth-Email: user-email

Request body
{
  "objectId": "", <deprecated>
  "objectNamespace": "", <deprecated>
  "permission": "" <deprecated>
  "resourcePermissions": [
    {
      "objectId": "abcd",
      "objectNamespace": "abcd-ns",
      "permission": "edit"
    },
    {
      "objectId": "abcd-1",
      "objectNamespace": "abcd-ns-1",
      "permission": "view"
    }
  ]
}

Response body
{
  "status": ""<deprecated>,
  "resourcePermissions": [
    {
      "objectId": "abcd",
      "objectNamespace": "abcd-ns",
      "permission": "edit",
      "allowed": true
    },
    {
      "objectId": "abcd-1",
      "objectNamespace": "abcd-ns-1",
      "permission": "view",
      "allowed": false
    }
  ]
}

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

44 of 60 (73.33%)  changed or added relevant lines in 2 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.2%) to 57.658%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

internal/api/v1beta1/permission_check.go
44
47
93.62%

internal/api/v1beta1/v1beta1.go
0
13
0.0%

Totals

Change from base Build<PHONE_NUMBER>:
0.2%

Covered Lines:
4702

Relevant Lines:
8155

💛  - Coveralls

Can you also include the change in API in description?

Can you also include the change in API in the description?

@AkarshSatija  Updated the description with the changes in API.


Reprint and share plugin.

Can I reprint Pl3xMap to MCBBS(A Minecraft forum in China, which can also release original or reprinted plugin)? I believe that server owners from China will like your plugin. Also, I will mark you as the author, link to your Github and never profit from them. I hope you can agree to my request.
Best regard <3

Pl3xMap is open source and released under the very permissive MIT license. https://github.com/pl3xgaming/Pl3xMap/blob/master/LICENSE

Pl3xMap is open source and released under the very permissive MIT license. https://github.com/pl3xgaming/Pl3xMap/blob/master/LICENSE

A rule of MCBBS is that no matter whether the plugin is open source or what the open source agreement is, the author's explicit consent is required.

I see. I'm unfamiliar with MCBBS or how it operates. Seeing as the license already permits what you are asking, I doubt you'll get any objections from Billy.


AzureResourceManagerTemplateDeployment fails on multiline strings

Required Information
Type: Bug
Enter Task Name: AzureResourceManagerTemplateDeployment@3
Environment

Server - Azure Pipelines
Agent - Hosted

Issue Description
Consider following very minimal ARM template poc.json:
{
    "$schema": "https://schema.management.azure.com/schemas/2019-08-01/subscriptionDeploymentTemplate.json#",
    "contentVersion": "<IP_ADDRESS>",
    "parameters": {
        "parameter1": {
            "type": "string",
            "defaultValue": "abc",
            "metadata": {
                "description": "very long
                and multiline
                description"
            }
        }
    },
    "functions": [],
    "variables": {},
    "resources": [],
    "outputs": {}
}

and Azure Pipeline to run it:
trigger: none

pool:
  vmImage: 'ubuntu-latest'

steps:
- task: AzureResourceManagerTemplateDeployment@3
  inputs:
    deploymentScope: Subscription
    azureResourceManagerConnection: 'my service connection 1'
    subscriptionId: 40f2d467-c27b-4ded-a7bc-82dc0b95cbb2
    templateLocation: Linked artifact
    csmFile: poc.json
    location: eastus

Pipeline fails with the following error message
##[error]Check out the troubleshooting guide to see if your issue is addressed: https://docs.microsoft.com/en-us/azure/devops/pipelines/tasks/deploy/azure-resource-group-deployment?view=azure-devops#troubleshooting
##[error]Error: Ensure the Template file ( '/home/vsts/work/1/s/poc.json' ) is valid. Task failed while parsing with following error: Unexpected token
in JSON at position 321
Running the template manually from PowerShell like this works without any problems New-AzSubscriptionDeployment -Location 'eastus' -TemplateFile .\poc.json
As soon as the parameter description in the ARM template is changed from multiline string to single line like so
        "parameter1": {
            "type": "string",
            "defaultValue": "abc",
            "metadata": {
                "description": "single line description"
            }
        }

the pipeline task works as expected

Multiline strings like the one in your example are not valid in JSON, a JSON parser/editor will highlight the error. Multilple lines need to be separated by \n.  You will not face issues with a valid JSON template file.
The task does JSON parsing to determining that the template is a valid JSON, the error you see is before the deployment takes place. It appears that az cli and az powershell might not make this check, so the deployment succeeds.

Please see the https://docs.microsoft.com/en-us/azure/azure-resource-manager/templates/template-syntax#multi-line-strings
Multiline strings are supported in ARM template json

The error you see is thrown during validations done by the task before the deployment is don, not during deployment.

Exactly. During, or to be more precise, right before the deployment the json is validated once again by the Azure Deployment engine (Resource Manager?). So why validate it twice: by the task and by Azure itself? Isn't Azure knows better what is valid and what is not?

@SDedik could you please attach debug logs for the failure

Sure thing, please see full logs attached below

Debug Logs
##[debug]Evaluating condition for step: 'AzureResourceManagerTemplateDeployment'
##[debug]Evaluating: SucceededNode()
##[debug]Evaluating SucceededNode:
##[debug]=> True
##[debug]Result: True
##[section]Starting: AzureResourceManagerTemplateDeployment
==============================================================================
Task         : ARM template deployment
Description  : Deploy an Azure Resource Manager (ARM) template to all the deployment scopes
Version      : 3.184.1
Author       : Microsoft Corporation
Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/deploy/azure-resource-group-deployment
==============================================================================
##[debug]Using node path: /home/vsts/agents/2.183.1/externals/node10/bin/node
##[debug]agent.TempDirectory=/home/vsts/work/_temp
##[debug]loading inputs and endpoints
##[debug]loading INPUT_DEPLOYMENTSCOPE
##[debug]loading INPUT_CONNECTEDSERVICENAME
##[debug]loading INPUT_SUBSCRIPTIONNAME
##[debug]loading INPUT_ACTION
##[debug]loading INPUT_LOCATION
##[debug]loading INPUT_TEMPLATELOCATION
##[debug]loading INPUT_CSMFILE
##[debug]loading INPUT_CSMPARAMETERSFILE
##[debug]loading INPUT_DEPLOYMENTMODE
##[debug]loading INPUT_ADDSPNTOENVIRONMENT
##[debug]loading ENDPOINT_AUTH_5e561276-7456-4ec2-8a13-e5394c4179a3
##[debug]loading ENDPOINT_AUTH_SCHEME_5e561276-7456-4ec2-8a13-e5394c4179a3
##[debug]loading ENDPOINT_AUTH_PARAMETER_5e561276-7456-4ec2-8a13-e5394c4179a3_TENANTID
##[debug]loading ENDPOINT_AUTH_PARAMETER_5e561276-7456-4ec2-8a13-e5394c4179a3_SERVICEPRINCIPALID
##[debug]loading ENDPOINT_AUTH_PARAMETER_5e561276-7456-4ec2-8a13-e5394c4179a3_AUTHENTICATIONTYPE
##[debug]loading ENDPOINT_AUTH_PARAMETER_5e561276-7456-4ec2-8a13-e5394c4179a3_SERVICEPRINCIPALKEY
##[debug]loading ENDPOINT_AUTH_SYSTEMVSSCONNECTION
##[debug]loading ENDPOINT_AUTH_SCHEME_SYSTEMVSSCONNECTION
##[debug]loading ENDPOINT_AUTH_PARAMETER_SYSTEMVSSCONNECTION_ACCESSTOKEN
##[debug]loading SECRET_SYSTEM_ACCESSTOKEN
##[debug]loaded 20
##[debug]Agent.ProxyUrl=undefined
##[debug]Agent.CAInfo=undefined
##[debug]Agent.ClientCert=undefined
##[debug]Agent.SkipCertValidation=undefined
##[debug]agent.proxyurl=undefined
##[debug]VSTS_ARM_REST_IGNORE_SSL_ERRORS=undefined
##[debug]AZURE_HTTP_USER_AGENT=VSTS_501c23d7-fd7d-4eaf-aaff-846cc96306bf_build_4_0
##[debug]check path : /home/vsts/work/_tasks/AzureResourceManagerTemplateDeployment_94a74903-f93f-4075-884f-dc11f34058b4/3.184.1/node_modules/azure-pipelines-tasks-azure-arm-rest-v2/module.json
##[debug]adding resource file: /home/vsts/work/_tasks/AzureResourceManagerTemplateDeployment_94a74903-f93f-4075-884f-dc11f34058b4/3.184.1/node_modules/azure-pipelines-tasks-azure-arm-rest-v2/module.json
##[debug]system.culture=en-US
##[debug]Agent.TempDirectory=/home/vsts/work/_temp
##[debug]Resource file has already set to: /home/vsts/work/_tasks/AzureResourceManagerTemplateDeployment_94a74903-f93f-4075-884f-dc11f34058b4/3.184.1/node_modules/azure-pipelines-tasks-azure-arm-rest-v2/module.json
##[debug]agent.proxyurl=undefined
##[debug]VSTS_ARM_REST_IGNORE_SSL_ERRORS=undefined
##[debug]AZURE_HTTP_USER_AGENT=VSTS_501c23d7-fd7d-4eaf-aaff-846cc96306bf_build_4_0
##[debug]Resource file has already set to: /home/vsts/work/_tasks/AzureResourceManagerTemplateDeployment_94a74903-f93f-4075-884f-dc11f34058b4/3.184.1/node_modules/azure-pipelines-tasks-azure-arm-rest-v2/module.json
##[debug]Resource file has already set to: /home/vsts/work/_tasks/AzureResourceManagerTemplateDeployment_94a74903-f93f-4075-884f-dc11f34058b4/3.184.1/node_modules/azure-pipelines-tasks-azure-arm-rest-v2/module.json
##[debug]Resource file has already set to: /home/vsts/work/_tasks/AzureResourceManagerTemplateDeployment_94a74903-f93f-4075-884f-dc11f34058b4/3.184.1/node_modules/azure-pipelines-tasks-azure-arm-rest-v2/module.json
##[debug]Resource file has already set to: /home/vsts/work/_tasks/AzureResourceManagerTemplateDeployment_94a74903-f93f-4075-884f-dc11f34058b4/3.184.1/node_modules/azure-pipelines-tasks-azure-arm-rest-v2/module.json
##[debug]Resource file has already set to: /home/vsts/work/_tasks/AzureResourceManagerTemplateDeployment_94a74903-f93f-4075-884f-dc11f34058b4/3.184.1/node_modules/azure-pipelines-tasks-azure-arm-rest-v2/module.json
##[debug]Resource file has already set to: /home/vsts/work/_tasks/AzureResourceManagerTemplateDeployment_94a74903-f93f-4075-884f-dc11f34058b4/3.184.1/node_modules/azure-pipelines-tasks-azure-arm-rest-v2/module.json
##[debug]Setting resource path to /home/vsts/work/_tasks/AzureResourceManagerTemplateDeployment_94a74903-f93f-4075-884f-dc11f34058b4/3.184.1/task.json
##[debug]check path : /home/vsts/work/_tasks/AzureResourceManagerTemplateDeployment_94a74903-f93f-4075-884f-dc11f34058b4/3.184.1/task.json
##[debug]adding resource file: /home/vsts/work/_tasks/AzureResourceManagerTemplateDeployment_94a74903-f93f-4075-884f-dc11f34058b4/3.184.1/task.json
##[debug]system.culture=en-US
##[debug]Resource file has already set to: /home/vsts/work/_tasks/AzureResourceManagerTemplateDeployment_94a74903-f93f-4075-884f-dc11f34058b4/3.184.1/node_modules/azure-pipelines-tasks-azure-arm-rest-v2/module.json
##[debug]deploymentScope=Subscription
##[debug]ConnectedServiceName=5e561276-7456-4ec2-8a13-e5394c4179a3
##[debug]Processed: ##vso[telemetry.publish area=TaskEndpointId;feature=AzureResourceManagerTemplateDeployment]{"endpointId":"5e561276-7456-4ec2-8a13-e5394c4179a3"}
(node:1534) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead.
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data armManagementPortalUrl = https://portal.azure.com/
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data ScopeLevel = Subscription
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth param scope = undefined
ARM Service Connection deployment scope - Subscription
##[debug]subscriptionName=40f2d467-c27b-4ded-a7bc-82dc0b95cbb2
##[debug]resourceGroupName=undefined
##[debug]action=Create Or Update Resource Group
##[debug]location=eastus
##[debug]deploymentMode=Incremental
##[debug]templateLocation=Linked artifact
##[debug]csmFile=/home/vsts/work/1/s/poc.json
##[debug]csmParametersFile=/home/vsts/work/1/s
##[debug]overrideParameters=undefined
##[debug]outputVariable=undefined
##[debug]deploymentName=undefined
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth scheme = ServicePrincipal
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data subscriptionid = 40f2d467-c27b-4ded-a7bc-82dc0b95cbb2
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data subscriptionname = Visual Studio Professional Subscription
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth param serviceprincipalid = ***
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data environmentAuthorityUrl = https://login.windows.net/
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth param tenantid = ***
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3=https://management.azure.com/
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data environment = AzureCloud
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth scheme = ServicePrincipal
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data msiclientId = undefined
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data activeDirectoryServiceEndpointResourceId = https://management.core.windows.net/
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data AzureKeyVaultServiceEndpointResourceId = https://vault.azure.net
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data AzureKeyVaultDnsSuffix = vault.azure.net
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data ScopeLevel = Subscription
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth param authenticationType = ***
##[debug]credentials spn endpoint
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth param serviceprincipalkey = ***
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data EnableAdfsAuthentication = false
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth param apitoken = undefined
##[debug]{"subscriptionID":"40f2d467-c27b-4ded-a7bc-82dc0b95cbb2","subscriptionName":"Visual Studio Professional Subscription","servicePrincipalClientID":"***","environmentAuthorityUrl":"https://login.windows.net/","tenantID":"***","url":"https://management.azure.com/","environment":"AzureCloud","scheme":"ServicePrincipal","activeDirectoryResourceID":"https://management.azure.com/","azureKeyVaultServiceEndpointResourceId":"https://vault.azure.net","azureKeyVaultDnsSuffix":"vault.azure.net","scopeLevel":"Subscription","authenticationType":"***","servicePrincipalKey":***,"isADFSEnabled":false,"applicationTokenCredentials":{"clientId":"***","domain":"***","baseUrl":"https://management.azure.com/","authorityUrl":"https://login.windows.net/","activeDirectoryResourceId":"https://management.azure.com/","isAzureStackEnvironment":false,"authType":"***","secret":***,"isADFSEnabled":false}}
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth scheme = ServicePrincipal
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth scheme = ServicePrincipal
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data subscriptionid = 40f2d467-c27b-4ded-a7bc-82dc0b95cbb2
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data subscriptionname = Visual Studio Professional Subscription
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth param serviceprincipalid = ***
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data environmentAuthorityUrl = https://login.windows.net/
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth param tenantid = ***
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3=https://management.azure.com/
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data environment = AzureCloud
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth scheme = ServicePrincipal
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data msiclientId = undefined
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data activeDirectoryServiceEndpointResourceId = https://management.core.windows.net/
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data AzureKeyVaultServiceEndpointResourceId = https://vault.azure.net
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data AzureKeyVaultDnsSuffix = vault.azure.net
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data ScopeLevel = Subscription
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data graphUrl = https://graph.windows.net/
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth param authenticationType = ***
##[debug]credentials spn endpoint
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth param serviceprincipalkey = ***
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 data EnableAdfsAuthentication = false
##[debug]5e561276-7456-4ec2-8a13-e5394c4179a3 auth param apitoken = undefined
##[debug]{"subscriptionID":"40f2d467-c27b-4ded-a7bc-82dc0b95cbb2","subscriptionName":"Visual Studio Professional Subscription","servicePrincipalClientID":"***","environmentAuthorityUrl":"https://login.windows.net/","tenantID":"***","url":"https://management.azure.com/","environment":"AzureCloud","scheme":"ServicePrincipal","activeDirectoryResourceID":"https://graph.windows.net/","azureKeyVaultServiceEndpointResourceId":"https://vault.azure.net","azureKeyVaultDnsSuffix":"vault.azure.net","scopeLevel":"Subscription","authenticationType":"***","servicePrincipalKey":***,"isADFSEnabled":false,"applicationTokenCredentials":{"clientId":"***","domain":"***","baseUrl":"https://management.azure.com/","authorityUrl":"https://login.windows.net/","activeDirectoryResourceId":"https://graph.windows.net/","isAzureStackEnvironment":false,"authType":"***","secret":***,"isADFSEnabled":false}}
##[debug]deploymentOutputs=undefined
##[debug]addSpnToEnvironment=false
##[debug]Processed: ##vso[telemetry.publish area=TaskDeploymentMethod;feature=AzureResourceManagerTemplateDeployment]{"deploymentScope":"Subscription","deploymentMode":"Incremental"}
Creating deployment parameters.
##[debug]System.DefaultWorkingDirectory=/home/vsts/work/1/s
##[debug]defaultRoot: '/home/vsts/work/1/s'
##[debug]findOptions.allowBrokenSymbolicLinks: 'false'
##[debug]findOptions.followSpecifiedSymbolicLink: 'true'
##[debug]findOptions.followSymbolicLinks: 'true'
##[debug]matchOptions.debug: 'false'
##[debug]matchOptions.nobrace: 'true'
##[debug]matchOptions.noglobstar: 'false'
##[debug]matchOptions.dot: 'true'
##[debug]matchOptions.noext: 'false'
##[debug]matchOptions.nocase: 'false'
##[debug]matchOptions.nonull: 'false'
##[debug]matchOptions.matchBase: 'false'
##[debug]matchOptions.nocomment: 'false'
##[debug]matchOptions.nonegate: 'false'
##[debug]matchOptions.flipNegate: 'false'
##[debug]pattern: '/home/vsts/work/1/s/poc.json'
##[debug]findPath: '/home/vsts/work/1/s/poc.json'
##[debug]statOnly: 'true'
##[debug]found 1 paths
##[debug]applying include pattern
##[debug]1 matches
##[debug]1 final results
##[debug]Loading CSM Template File.. /home/vsts/work/1/s/poc.json
##[debug]Detecting file encoding using BOM
##[debug]Unable to detect File encoding using BOM
##[debug]Detecting file encoding without BOM
The detected encoding for file '/home/vsts/work/1/s/poc.json' is 'utf-8'
##[error]Check out the troubleshooting guide to see if your issue is addressed: https://docs.microsoft.com/en-us/azure/devops/pipelines/tasks/deploy/azure-resource-group-deployment?view=azure-devops#troubleshooting
##[debug]Processed: ##vso[task.issue type=error;]Check out the troubleshooting guide to see if your issue is addressed: https://docs.microsoft.com/en-us/azure/devops/pipelines/tasks/deploy/azure-resource-group-deployment?view=azure-devops#troubleshooting
##[debug]task result: Failed
##[error]Error: Ensure the Template file ( '/home/vsts/work/1/s/poc.json' ) is valid. Task failed while parsing with following error: Unexpected token

##[debug]Processed: ##vso[task.issue type=error;]Error: Ensure the Template file ( '/home/vsts/work/1/s/poc.json' ) is valid. Task failed while parsing with following error: Unexpected token %0A in JSON at position 321
##[debug]Processed: ##vso[task.complete result=Failed;]Error: Ensure the Template file ( '/home/vsts/work/1/s/poc.json' ) is valid. Task failed while parsing with following error: Unexpected token %0A in JSON at position 321
##[section]Finishing: AzureResourceManagerTemplateDeployment

Same with comments. It fails if there are comments in document which are not allowed in JSON but allowed in JSONC

Hi @SDedik and @artisticcheese yes, you are right. This is the limitation of task as for parsing and validation csm file we are using javascript JSON.parse which expects valid JSON. The multiline string and comments is supported in the latest version of ARM templates as mentioned in this doc that you must use the --handle-extended-json-format switch in Azure CLI version above 2.3.0

@anuragc617, the root cause of the failure is well understood, as we as possible workarounds like switching to AzureCLI task or AzurePowerShell task. However...
Think of it this way. I have an ARM template file which can be fed to the Azure Resource Manager via the Azure Portal, Azure API, Azure PowerShell and Azure CLI and it works as intended with all of the above. But, when I try to use the AzureResourceManagerTemplateDeployment task, the task fails.
Do you acknowledge that this is a valid use-case and with such the behavior of the AzureResourceManagerTemplateDeployment task is a bug?
What is the correct way of addressing this bug is a next question, but the fact that it needs to be addressed is of no doubt.

In addition to that please at least provide better explanation for failures. It tooks me hours to figure out what the issue is since error message so non-descriptive

@SDedik yes, we acknowledge that this is a bug in AzureResourceManagerTemplateDeployment task. We have started internal discussion on how to address this bug.
Sorry, my bad, yes it is t should be Azure CLI version 2.3.0 and below
@artisticcheese we will look at it as well if we can provide better message while error in template parsing

The linked documentation is really bad and does not describe that multiline JSON support is done on the client-side as a template preprocessing step.
That is the reason why deploying templates with multiline strings or comments works with Az CLI or with Powershell. The documentation should clearly state that other deployment methods will FAIL:

Deployments directly calling API will fail
Deployments in the portal will fail

Every ADO task doing ARM deployment should document that multiline and JSON comments are unsupported if they are unsupported. Also, the main documentation site MUST clearly state that multiline and JSON comments are selected client-only features. The current wording is really misleading.

@jikuja You are saying that powershell cmdlet before submitting deployment to Azure backplane transpiles multi-line string into single line string?

Might be. Not sure what is the state of the current code but clients usually requires special code to handle JSON comments and/or multiline strings if they are parsing template file instead of passing contents of a file as a string to API.
Requires more testing by end-users for end-users to understand the current situation OR serious documentation updates.

Multiline strings are not supported if you are deploying through Azure portal, a DevOps pipeline, or the REST API
https://learn.microsoft.com/en-us/azure/azure-resource-manager/templates/syntax#multi-line-strings


Nans in NWP

Describe the bug
There are Nans in the NWP data
To Reproduce
Open mnt/storage_ssd_4tb/data/ocf/solar_pv_nowcasting/nowcasting_dataset_pipeline/prepared_ML_training_data/v14/train/nwp/000000.nc and have a look
Expected behavior
no nans

As discussed this morning, I'll look into this issue today...

In v14/train/nwp/000000.nc all the NaNs are in channels_index=5.  So, a very quick hack fix would be to ignore channels_index=5.  I'll do a more thorough check now, and change the nowcasting_dataset code...

That bad data looks like it's coming from the hcct channel (Height of convective cloud top) which, by design, has NaNs where there are no clouds, I think.  BUT, this suggests another bug:  The YAML config doesn't request the hcct channel!

Hmm... as far as I can tell, the code is correctly loading the list of NWP channels requested by the YAML config.  And so hcct shouldn't be in the batches... I'll keep digging!...
The PR for this fix is #492

next step:  Log where the NaNs are.

aha!  The problem is in the intermediate Zarr:  Sometimes the channel labelled "si10" (10 meter wind speed) has data from the hcct channel in it!

Yeah, it did take me awhile!  But, in retrospect, I really should have started with the intermediate Zarr!

OK, the new intermediate Zarr is finished (although it only covers 2020 and 2021) and I'm recreating the NWP batches from batch 0.  It's doing about 2 NWP batches per second.  So far, there have been no log messages about NaNs :slightly_smiling_face:


Crash on start up on steamdeck

been playing the through the re-console modpack but adding this issue here because it seems to be an issue with Legacy4J specifically. Uploaded the crash report to my browser and opened it and it is reporting that Legacy4J is incompatible with mod menu causing a crash immediately on start up.
https://mclo.gs/0ij8m8A

update disabled mod menu and restarted and still resulted in a crash so im not sure whats happening

Did you update from 0.3.6 to 0.4.0 or 0.4.1 via Prism Launcher?

yes

Remove Loqui, Load My Resources, Keep That Music, and Very Many Players

giving me a different crash now "code 255"

do you have a log file?

If you have Prism Launcher, select your instance and click Edit, go to Other Logs and click Upload. Paste the link here.

Are you using Java 21?

yes im using java 21 collecting the crash log now

heres the crash log
https://mclo.gs/7l4XgWb

is that log from the code 255 crash? if so, it seems like load my resources is still enabled and is causing a crash for some reason

yup it was load my resources. didnt realize it was still enabled. crash has been fixed 'preciate the help mate


"x0b" instead of "\vault" showing in path?

Please select the area your bug applies to. (Multiple selections are Possible)

[ ] Onboard. Initial vault setup and import/export pods
[ ] Create. Note creation, lookup, snippets and templates
[ ] Retrieve. Backlinks, references, graph view
[ ] Structure. Refactoring, multi-vault and schemas
[ ] Publish. Sharing your repo with the world
[X] Misc (Choose this if your not sure)

Describe the bug
When tying to access the Dendron filepath as part of a Python script, the /vault part renders as /x0bault.
To Reproduce
Steps to reproduce the behavior:

From VS Code, create a Python program that accesses a file from a Dendron vault

import os

my_file = "E:\dataDocuments\ktree\vault\projects.test.md"

with open(my_file, "r") as file_object:
    data = file_object.read()
    print(data)

Error: OSError: [Errno 22] Invalid argument: 'E:\\dataDocuments\\ktree\x0bault\\projects.test.md'

Expected behavior
Python script would retrieve the file beneath the /vault directory. (The script works when stepping above the /vault directory.)
Screenshots

Desktop (please complete the following information)

OS: Window 10
Browser: Chrome
Version: v0.67.1

Additional context
Add any other context about the problem here.
Dendron Log file
Please attach the output of > Dev:Dendron: Open Logs here

Hm. This is not a Dendron issue. By escaping the \'s I was able to get the script to work.
my_file = "E:\\dataDocuments\\ktree\\vault\\projects.books.md"
Interesting that the first 2 \ and the last 1 \ were initially fine!


Upgrade plugin to 2.4 and refactor zip dependencies

Description
Upgrades plugin to 2.4. Fixes a couple compile time dependencies with ml-commons.
Refactors dependencies on zips for ml-commons and k-NN. Currently, both ml-commons and k-NN post zips to maven. We already depend on k-NN for the jar. We can refactor dependencies to rely only on these artifacts and not have to download separately.
Check List

[X] Commits are signed as per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Seems that CI is checking out wrong commit: "HEAD is now at 272d803 Integrate model inference to build query (#20)" from https://github.com/opensearch-project/neural-search/actions/runs/3284862131/jobs/5411313863

How we are using zip file with models from resources folder (src/test/resources/model/all-MiniLM-L6-v2.zip)?

This is a minimal model used for integration tests. Ideally, it would be smaller and/or located somewhere we could download it from, but for now we need to check it in.


typescript 4.3.3 types problem

you site example have problem with types

You're likely missing a dependency in your package.json. The example project will throw this error when the dependencies aren't installed.

@vanstinator oh, problem in my tsconfig.json with include other local folders with d.ts files
Excuse for troubling, thanks for the tip :)


Make GEOMETRY type recognizable by DBeaver

It would be nice if GEOMETRY type was recognized by DBeaver which has a spatial viewer.
Right now creating geometry by using e.g. ST_Point results in having a geometry column but there is no option to display it on a map like it would be with a Postgis database.

Hi! Thanks for reporting this issue. This seems to be a DBeaver issue? Although I don't expect them to be able to read our internal geometry format (nor do I think that would be a good idea). I don't use DBeaver personally, but perhaps if you transform the GEOMETRY to WKB or WKT DBeaver can pick it up and display it properly?

I assume there is some standard Geometry type defined by SQL/MM or Simple Features spec and DBeaver knows how to recognize that.
I tried with WKB_BLOB but it's not recognized. Interestingly it's represented as WKT not WKB but column type is marked as WKB_BLOB.

Seems like this is implemented on a case-by-case basis, at least there's special handler code for PostgGIS
I'd definitely like to investigate how hard it would be to add something similar for DuckDB, my only concern is that DBeaver should not have to depend on the internal binary format of DuckDB geometries (as thats still evolving), but maybe its possible for DBeaver to intercept and convert the result-set to WKB/WKT before display.

Interesting, for reference this is the switch statement which leads to the class that conditionally builds the geometry.
In DuckDBs case it seems that some types get mapped to struct and some to blob: https://github.com/dbeaver/dbeaver/blob/devel/plugins/org.jkiss.dbeaver.ext.duckdb/src/org/jkiss/dbeaver/ext/duckdb/model/DuckDataTypeCache.java#L67C11-L67C11


Random UUID API

I need API that returns radom uuid eg : ce78a9bc-1e6f-461d-8647-29862e4a6d7c

I'd love to help with this, please assign me.

I have fixed this @iphadey , merge and add the hacktoberfest-accepted label.


"Invalid resource type undefined" error appears for creation new VM from template with tags

http://cs-ui-ci.z1.netpoint-dc.com:8080/bwsw/master/instances/create
develop
Steps:

Login and press create new VM
For installation source select template with tags
Fill all mandatories and press Create

Expected result: VM created with copied tags from template
Actual result: "Invalid resource type undefined" error appears for copying tags

It is partially fixed in #646, but it is needed to be tested, and fixed, if the error will occur on tag actions with Taggable entities.


Moving billing (4) resources to v1beta1 version

Moving 4 resources to v1beta1 version

[ ] google_billing_account_iam_binding
[ ] google_billing_account_iam_member
[ ] google_billing_account_iam_policy
[ ] google_billing_budget

The iam resource returns an error:
Error when reading or editing Resource "billingAccount \"015CE2-E29302-2811C2\"" with IAM Policy: Error retrieving IAM policy for billing account "015CE2-E29302-2811C2": googleapi: Error 403: The caller does not have permission, forbidden:


chore(deps): upgrade dev dependencies

Upgrades project dependencies. See details in workflow run.

Automatically created by projen via the "upgrade-dev-dependencies-1.x" workflow

⚪ Backport skipped
The pull request was not backported as there were no branches to backport to. If this is a mistake, please apply the desired version labels or run the backport tool manually.
Manual backport
To create the backport manually run:
backport --pr 2247

Questions ?
Please refer to the Backport tool documentation


Added options variable for htmlhint

Currently htmlhint has a bug which prevents htmlhint from using .htmlhintrc file
But it works if I add it as a param to command:
let g:ale_html_htmlhint_options = '--config ~/.htmlhintrc --format=unix stdin'

If you don't mind i'll try to prepare another PR to make it work similar to jshint


Enable annotation processing warning showing everytime project is opened

Short description
Lombok requires annotation processing to be enabled everytime project is opened.
Expected behavior
After annotation processing is enabled, don't request it again.
Version information

IDEA Version: 2020.2.2 (also happened with 2020.2.1)

JDK Version: corretto-1.8.0_252, project language level 8

OS Type & Version: Mac

Lombok Plugin Version: 0.31-2020.2

Lombok Dependency Version: 1.18.12

Steps to reproduce
Intellij setup to NOT enable annotation processing by default for new projects.

Import build.gradle and Open as project;

Annotation processing is not enabled at this point.

Wait for project to finish indexing/importing
See event log warning about needing annotation processing enabled
Click enable
Open preferences to see that annotation processing is enabled
Close project
Open project again
See event log warning about needing annotation processing enabled
Without clicking enable open preferences, see that annotation processing is still enabled.

Sample project
https://github.com/mplushnikov/lombok-intellij-plugin

[x] Sample project provided
[x] I am able to reproduce this error on the sample project by following the steps described above

Additional information
Interestingly when I setup IntelliJ to enable annotation processing by default for new projects I did not get the warning on initial project import. I disabled annotation processing, closed, and opened the project without deleting anything and the issue showed up.
Preferences show that annotation processing is indeed enabled in the project, but event log still shows warning.

I do see that in the Lombok plugin settings there is a checkbox for "Enable annotation processing warning", but would not expect this to force it to always show.

Hi!
I faced exactly same issue. And even submitted this bug.
However, in my case it looks like Lombok really doesn't work: for example, for the class annotated with @Value - when I use generated constructor / getter / etc in the code - Idea doesn't highlight any errors (it "sees" them), while project build (compilation) fails in these places ("cannot find symbol", etc).
Note: project is gradle-based, with Quarkus plugin - maybe Lombok + Quarkus magic intersects...

I've hit the same issue and I've fixed it by switching back to Java SDK8 (had my project configured to use Java SDK11).  Not sure if this helps

Hi
I have the same issue too. I'm waiting for it to be fixed soon. just red warning message is annoying me slightly.
my project is gradle-based also.

I'm seeing this too. My project is sbt-based, so I guess we can rule out Gradle. The plugin is working fine for me, but I get the "enable annotation processing" message every time I open the project.


Move Participant models from the experiments app to the participants app

There are three ways one can approach moving models to a new app. I opted for the django way where one create the migrations, but use the SeparateDatabaseAndState operation to update django's state by running the original migrations only on the state. The DB operations to delete the tables from the experiments app and create them in the participants app should be overwritten to rather just rename the table.
Initial testing showed that nothing breaks, but this doesn't mean it's working as expected. I still have to ensure I know exactly what happens to the indexes and unique constraints that would have been removed. My code just leaves them alone, which I suspect is wrong. Maybe we should rename them as well. For now, I'm parking this change until we decide to tackle it.

@snopoke for your review. Happy to create a ticket and link these changes for future implementation

Closing to minimize PR clutter. I created an issue to tackle this and linked this PR to it


Add LV version to readme file

Please add the LabVIEW version code is maintained in to the readme file.

Commit: edb3b5d - Add LV version code into README.md and CONTRIBUTING.md


IncidentDensity GP Tool/TestCase crashes Pro 2.1/arcpy

The IncidentDensity GP Tool crashes Pro 2.1 (Tested on 2.1.9865).
Using the Template in Pro 2.1:
Steps to Reproduce (for bugs)

On Pro 2.1 (Tested on 2.1.9865).
Download the Incident Analysis Template (http://solutions.arcgis.com/defense/help/incident-analysis/)
Extract zip and copy to Pro IncidentAnalysis.aptx to Documents\ArcGIS\ProjectTemplates
Create a new project from the IncidentAnalysis template
Run the Incident Density Tool/Model in Incident Analysis Tools.tbx (screenshot below)
Pro CRASH on step: Creating output raster layer:

Your Environment

Current Dev branch
Pro 2.1 Beta 1 (2.1.9865)
Windows 10
Using the unit test driver:
Unit test case: IncidentDensityTestCase crashes Pro 2.1/arcpy. Output:
....IncidentDensityTestCase.setUp
UnitTestUtilities - checkArcPy
ArcPy works
UnitTestUtilities - createScratch
UnitTestUtilities - checkExists
Scratch already exists
UnitTestUtilities - checkFilePaths
Valid Path: C:\Users\----\Documents\GitHub\solutions-geoprocessing-toolbox\utils\test\test_data\incident_analysis
UnitTestUtilities - checkGeoObjects
Valid Object: test_incident_analysis_tools.gdb
Valid Object: test_incident_analysis_results.gdb
Valid Object: Incident Analysis Tools_pro.tbx
Valid Object: Incidents
Valid Object: Districts
.....IncidentDensityTestCase.test_incident_density
Running tool (Incident Density)

************************** Initial Data Assessment ***************************
Making sure there are enough incidents for analysis....
    - There are 5532 valid input features.

Looking for locational outliers....
    - There were 49 outlier locations; these will not be used to compute the snap distance.

Checking to see if the Environment Settings include a raster analysis mask....
    - Raster analysis mask not set; constructing convex hull....

**************************** Incident Aggregation ****************************
Snapping nearby incidents together to create weighted points....
    - Aggregating features less than 43.2996 Meters from each other.

Evaluating incident counts and the number of weighted point features....
    - The aggregation process resulted in 1470 weighted points.
    - Incident Count Properties:
        Min:        1.0000
        Max:       50.0000
        Mean:       3.7633
        Std. Dev.:  4.3050
***************************** Scale of Analysis ******************************
Looking for an optimal scale of analysis by assessing the intensity of clustering at increasing distances....
    - The optimal fixed distance band is based on peak clustering found at 570.2298 Meters

***************************** Hot Spot Analysis ******************************
Finding statistically significant clusters of high and low incident counts....
    - There are 58 output features statistically significant based on an FDR correction for multiple testing and spatial dependence.

    - 4.4% of features had less than 8 neighbors based on the distance band of 570.2298 Meters
*********************************** Output ***********************************
Creating output feature class: C:\Users\----\Documents\GitHub\solutions-geoprocessing-toolbox\utils\test\test_data\incident_analysis\test_incident_analysis_results.gdb\outputDensity
    - Red output features represent hot spots where high incident counts cluster.
    - Blue output features represent cold spots where low incident counts cluster.

Creating output raster layer: C:\Users\----\Documents\GitHub\solutions-geoprocessing-toolbox\utils\test\test_data\incident_analysis\scratch.gdb\IncidentDensitySurface_Output
    - Using optimal fixed distance band (570.2298 Meters) for the kernel density search radius.
    - The surface will be clipped to a convex hull of the input points.

{CRASH - test runner stops}
Steps to Reproduce (for bugs)

On Pro 2.1
Run Units Test Driver (TestKickstartPro.bat)
Note Crash (screen shot below) at test case: IncidentDensityTestCase.test_incident_density

Context

Your Environment

Current Dev branch
Pro 2.1 Beta 1 (2.1.9865)
Windows 10

This issue also occurs running the project template in Pro 2.1 - updated the original issue comment with these repro steps.
@mfunk @topowright @lfunkhouser @nfeuerstein - can you pass this issue onto the Pro team?

I have not had a  chance to look at this. If someone else has a chance please do  take a look.

No longer seems to be an issue as of 2.1.10195


Manage app groups tutorial links to Spring Release article in error

Hyperlink should point to
https://docs.microsoft.com/en-us/azure/virtual-desktop/virtual-desktop-fall-2019/manage-app-groups-2019

@gamcmaho : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@Heidilohr Could you review this pull request? Note that it's a request for an update embedded in the article, not a direct update to the article. Therefore, #hold-off

@gamcmaho I've created and merged a pull request that addresses the incorrect links. Thank you for bringing this to my attention.

@ktoliver I've merged a pull request addressing this link and a few related links that also pointed to the wrong folder.

Thanks, all. We'll close this pull request.


Closing PowerToys after check update

Microsoft PowerToys version
0.64.1
Installation method
PowerToys auto-update
Running as admin
Yes
Area(s) with issue?
Settings
Steps to reproduce
check new update (no update found)
Close windows with windows x and PowerTpys exit.
No error message but powertoys is not present on try area
I need restart it from start menu
✔ Expected Behavior
No exit after close settings windows after check if there an update
❌ Actual Behavior
No response
Other Software
No response

I've been able to repro this. Got a crash from PowerToys.exe After checking for updates and closing Settings.

The fix for this issue has been released in 0.65. Please update PowerToys to the latest version:
https://github.com/microsoft/PowerToys/releases


Add function to remove all lights

If you use the same instance of ROT.Lighting with different sets of lights or just want to switch to another set of light, there's no function to clear all lights. This pull request solves that by wrapping for this._lights = {}; in a function which provides a more intuitive  interface to clear all lights.

Sounds like a useful addition. Thanks!


problem SQLSTATE 42S02

Hi @nahid
follow your steps to install, After type php artisan migrate command it's give this issue
all the commands like php artisan not work, give this screen , any idea?
the .env the file has been modified as indicated in the guide.
Thank you for your help !

Thank you for using this project.
Please go to app/Providers and open PartialServiceProvider.php file. Now comment those line from boot() method
    $this->sidebarCategory();
    $this->adminHeader();

and save it.
Now run php artisan migrate and it will work. After complete migration please uncomment those line from app/Providers/PartisalServiceProvider.php
Thank you :)

root@homestead:~/Code/Fanshub-blog# php artisan
[Illuminate\Database\QueryException]
SQLSTATE[42S02]: Base table or view not found: 1146 Table 'myblog.alien_tagged' doesn't exist (SQL: select alien_tags.id, count(
tag_id) as total_tags, alien_tags.tag_name from alien_tagged inner join alien_tags on alien_tagged.tag_id = alien_tags
.id group by alien_tagged.tag_id limit 20)
[PDOException]
SQLSTATE[42S02]: Base table or view not found: 1146 Table 'myblog.alien_tagged' doesn't exist

Oh its a misstake. Please follow these steps its will be fixed.

Goto app/Providers/PartialsServiceProvider.php
Comments those line

$this->sidebarCategory();
$this->adminHeader();

and save it.

run composer install or composer update
then run php artisan migrate
and now uncomment those line which you commented first.

I think it will work fine and solve your problem also.
Thank you


Map view for tables does not display

From a profile, click "Show data", then select "Map" tab. Map view does not display correctly. "Table" and "Distribution" display correctly.
Example:
https://beta.nepalmap.org/data/map/?table=POPULATION&primary_geo_id=local-4003&geo_ids=local|district-28

Should look something like this:
https://nepalmap.org/data/map/?table=DISABILITY_SEX&primary_geo_id=district-04&geo_ids=district|country-NP

@pratimakandel - would be interested in looking at this?

hi @hbvj99 - thank you for interest in contributing to open source products. Would you be interested in submitting a pull request for this issue?

@ravinepal thank you for mentioning. I'm working on a fix will notify you soon.

@ravinepal thank you for mentioning. I'm working on a fix and will notify you soon.

Please let me know if you have any questions while getting your dev environment set up.

One thing that may be useful is to run the app and

monitor the web browser console
take a look at the debug level SQL log statements that are put out in the terminal

There is a JavaScript error when this view is accessed, and it should provide insight into what is going wrong. This will almost certainly be very useful.
You might compare the debug level SQL log statements for the federal version of the app with the statements from running the pre-federal version of the app to see if there is something different.
Here are some screenshots of a Chrome console showing JS errors.

I was looking into this, had a few issues

Installation of the repo was difficult for me, some version mismatch involving Django, Wazimap and django-cors-header, had to install different versions to get the app up and running
Had to add auth module after upgrading to Django 2
The SQL that is run when the URL is hit, has these in it
SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."geo_code" = '28' AND "wazimap_geography"."geo_level" = 'district') ORDER BY "wazimap_geography"."version" DESC LIMIT 1; args=(u'28', u'district') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'district' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '28'); args=(u'district', u'2016', u'28') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'local' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '4001'); args=(u'local', u'2016', u'4001') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'local' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '4002'); args=(u'local', u'2016', u'4002') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'local' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '4003'); args=(u'local', u'2016', u'4003') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'local' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '4004'); args=(u'local', u'2016', u'4004') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'local' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '4005'); args=(u'local', u'2016', u'4005') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'local' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '4006'); args=(u'local', u'2016', u'4006') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'local' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '4007'); args=(u'local', u'2016', u'4007') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'local' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '4008'); args=(u'local', u'2016', u'4008') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'local' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '4009'); args=(u'local', u'2016', u'4009') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'local' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '4010'); args=(u'local', u'2016', u'4010') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'local' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '4011'); args=(u'local', u'2016', u'4011') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'local' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '4012'); args=(u'local', u'2016', u'4012') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'local' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '4013'); args=(u'local', u'2016', u'4013') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'local' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '4014'); args=(u'local', u'2016', u'4014') SELECT "wazimap_geography"."id", "wazimap_geography"."geo_level", "wazimap_geography"."geo_code", "wazimap_geography"."version", "wazimap_geography"."name", "wazimap_geography"."long_name", "wazimap_geography"."square_kms", "wazimap_geography"."parent_level", "wazimap_geography"."parent_code" FROM "wazimap_geography" WHERE ("wazimap_geography"."parent_level" = 'local' AND "wazimap_geography"."version" = '2016' AND "wazimap_geography"."parent_code" = '4015'); args=(u'local', u'2016', u'4015')

The first 2 queries generate good data, the others don't, does this look right? @clifton-mcintosh

I do not know what upgrading Django will do. It may or may not be compatible with wazimap 0.8.2. I would suggest creating a separate issue for that so that any changes that need to be made for possible Django upgrades be separated out from the issue reported here.
#30 covers upgrading the wazimap framework to 1.0. Even then, I am not sure about Django 2.0. Please note that Wazimap S

@hbvj99
You reached out to me by email to ask about this ticket a couple of weeks ago. Did my updated comments help provide any guidance on this?

@cliftonmcintosh It seems like there is a data mismatch between topojson, geojson. Also, when I replaced district topojson from nepalmap_app, the map seems to be working fine, but the geolocation is not correct.

@hbvj99
When the app goes into that view, it tries to find the matching area in the topojson files by using the "geoid" fields in the topojson files. It expects the "geoid" fields to be the "geo_level" plus the "geo_code", like "level-code". For example, if it is trying to find the geographic data about Achham, it will look in the "district.topojson" file for "geoid":"district-01". If you look at the district.topojson file, you will see that the geoid fields in that file do not match what Wazimap needs. For example, Achham's "geoid" in that file is "dis-01". So the map view fails. The "geoid" fields in all our topojson files need to conform to the requirements of Wazimap. They need to be of the form "geo_level-geo_code".

I'm actually editing the topojson and geojson files to make that change from dis-01 to district-01 and loc-1001 to local-1001.
I found that was the only change from old nepalmap v/s the federal one in terms of geo codes

for my local installation, I had to upgrade both wazimap and django to get it running, but I will make sure not to push those changes so that it does not break anything.

It sounds like we have two people working on the issue, @crackjack and @hbvj99

in that case, I'll stop working on it. I have changed the geojson and topojson files, but looks like we also need to edit those entries in the database to match them.
I was thinking to change the SQL files next, but I'll wait until further notice. I am available to help if needed @hbvj99

I don't believe we need to change the SQL
On Mon, Mar 11, 2019, 8:09 AM Nitesh Rijal<EMAIL_ADDRESS>wrote:

in that case, I'll stop working on it. I have changed the geojson and
topojson files, but looks like we also need to edit those entries in the
database to match them.
I was thinking to change the SQL files next, but I'll wait until further
notice. I am available to help if needed @hbvj99
https://github.com/hbvj99
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/Code4Nepal/nepalmap_federal/issues/49#issuecomment-471531451,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ADpbbDeR2v9SzLtN5TNKxsVQ6PucfhfFks5vVlV_gaJpZM4aLWVB
.

the sql file has geo_codes as just integers, is that fine? I thought since we said the geo_codes should be changed in the topojson and geojson, we need to change it in the sql too.
I think I should start reading about it in the wazimap documentation instead of asking you all these questions. @cliftonmcintosh
any updates on this @hbvj99? lets sync up if you want to collaborate on this.

@crackjack
Even though they don't have quotes around them in the SQL file, they are read in as strings. You can see the table definition here:
https://github.com/Code4Nepal/nepalmap_federal/blob/dev/sql/geography.sql#L34-L44
Note the definition of geo_code: geo_code character varying(10) NOT NULL.

@cliftonmcintosh @crackjack I'm not sure how to tackle this issue, do we have to update geo files? I found wazimap_za https://github.com/OpenUpSA/wazimap-za don't use geo files a static content. Could we apply the same approach on solving this issue?

I have updated the geojson and topojson files with the geo_id being local-, district- etc, I can push it tonight if you want me to.

@cliftonmcintosh I tried to install the dependencies from our project, as well as from the wazimap_za repo's requirement, but I cannot get past the dependency issue
wazimap 2.0.0 has requirement Django<1.12.0,>=1.11.15, but you'll have django 1.9.2 which is incompatible.
django-cors-headers 2.5.2 has requirement Django>=1.11, but you'll have django 1.9.2 which is incompatible.

The requirements.txt for this project specify wazimap 0.8.2.
https://github.com/Code4Nepal/nepalmap_federal/blob/dev/requirements.txt
The printout from your message says wazimap 2.0.0. I'm not sure how that got there. Can you set up virtualenv or some other environment manager and run pip install requirements.txt so that it uses the correct version of wazimap? When I run pip show wazimap, it tells me I'm on 0.8.2. That's what is running on the servers, too.
We have an issue to upgrade to wazimap 1.0.0. https://github.com/Code4Nepal/nepalmap_federal/issues/30

I'm sorry about not explaining it fully. Let me put it this way:

using the requirements from our project, it gets 0.8.2 for wazimap, no doubt. but I get an error on middlewares for django-cors-headers because it requires django version above 1.10
using the requirements from wazimap_za repo, it fails to compile GDAL, and I get wazimap 1.0.0.

I have used virtualenv, I do that for every project. If you can pip freeze your environment and send it over that would be very helpful. Also, I am using Pytyon 2.7, using Python 3 has a lot of other issues, which I believe is not what we want .
I had a successful combination of django, django-cors-headers and wazimap upgraded, that caused an error with JavaScript, and hence I was not able to get the map loading.

I say we setup a time of about max 1 hour to go over this, it will help me catch up and may be fix the issue ultimately.

@crackjack
Here is the outcome of pip freeze: nepalmap_federal.txt
And here is my python version:
$ python --version
Python 2.7.15rc1

What OS are you running? I can spin up a VM with that OS and try to build the project fresh to see if I encounter the problems you have encountered.
I doubt I have any advice that is better conveyed verbally, but fee free to contact me directly via email if you would like to set something up.

see you have different versions of Django, Gdal, etc

I'll get this running with your requirement, I hope it will work. I use Arch Linux, so it doesn't have a version, may be using it through docker is a better idea.

@crackjack
I did not try with Arch, but I was able to do an install in Linux Mint. The one package import I had to adjust was django-cors-headers, setting it to 2.4.2 in the requirements.txt. pip install loaded django-cors-headers 2.5.2 by default and it failed on a deprecated dependency. Once I adjusted requirements.txt for that, I was fine.

@cliftonmcintosh you were right about the dependencies. I re-did everything, installed from requirements.txt file but with version django-cors-headers==2.4.1 because 2.4.2 was not found.
I am able to load the map now, I have attached a screenshot here.
I am going to push it and create a pull request for you to review, I have also changed the requirements.txt file with the change.

PR: https://github.com/Code4Nepal/nepalmap_federal/pull/60

Fixed with #60
Thank you, @crackjack

@crackjack
Your changes are now deployed to https://beta.nepalmap.org
Thank you for the fix.


Blocking writes during connectivity loss prevent resumption of stream

What version of gRPC and what language are you using?
1.15.0 - C++
What operating system (Linux, Windows,...) and version?
Linux Ubuntu 14.04
What runtime / compiler are you using (e.g. python version or version of gcc)
clang 3.8
What did you do?
We are using the grpc C++ client in an environment with spotty network connectivity.  What we have noticed is that stream writes that occur during a time of connection loss seem to block the reconnection logic from re-establishing the channel.
For example, our flow is like this:

CreateCustomChannel using SSL certs
Get stub for API (i.e. auto api = FooAPI::NewStub(channel))
Issue the call to get the stream (i.e. auto stream = api->SendFoo)
Stream the writes:

for (req : requests) {
    stream->Write(req);
}

If the connectivity drops during the loop that is writing to the stream, the Write call will block instead of failing fast.  When connectivity comes back, the grpc channel will attempt it's reconnection logic.
What did you expect to see?
I would expect the reconnection logic to retry the blocked write and continue writing.
What did you see instead?
The channel reconnects, but writes to this stream remain blocked.  This then causes our grpc channel to go to IDLE status and no rpcs to flow through.
Sometimes the write will unblock and RPCs start flowing again.  This causes the channel to move to CONNECTING.  However, if our SSL certs have expired at this point, we get an SSL alert certificate expired error.  It would be nice to provide a callback to re-retrieve certs, which was the impetus for this issue I filed (https://github.com/grpc/grpc/issues/18257).
However, the fact that the write continues to block even after the channel re-establishes is what is my main concern is for this issue.
One thing we have tried is to wrap the Write in an async call and then wait on it.  If the call blocks for longer than some time period, we issue TryCancel.  However, this is not guaranteed to cancel the call and in most cases does not appear to:
auto f = std::async(std::launch::async, [this, &req, ok]() {
   *ok = stream->Write(req);
});
auto timeout = f.wait_for(5000ms) != std::future_status::ready;
if (timeout) {
   foo_context->TryCancel();
}

What is the preferred/recommended approach for dropped connectivity during long-running streams?  Ideally I would expect a way to either deterministically cancel the blocked call or allow it to block and then retry when the stream comes back up, but neither seem to be possible.

@smaye81 Can you reproduce with 1.19?

CC @vjpai @yashykt

I can try.  Was there any change in reconnection logic between 1.15 and 1.19?


Cloudinary

Need to setup Cloudinary for images. Also would be good to use their transcribe video service from Google and save that into the videos table when new videos are added.

I moved this to https://github.com/drewroberts/media


What is the part number for JTAG

Hi,
What is the part number for the USB to JTAG adapter used here ?
Thanks
Kind regards
Kiran Kanchi

I've been successful using a CPLD-based Altera USB-Blaster compatible JTAG programmer.

Do you have any further info about this? I have an Altera USB-Blaster clone that came with a simple MAX2 breakout board. Using openocd results in a tdo check error when I try to program the hello world example here.
The command I'm using is
openocd -f /usr/local/share/openocd/scripts/interface/altera-usb-blaster.cfg -f prog_openocd.cfg
The wiring I'm using is
(v7.0 board)
board - name - USB Blaster pin
J27 - TCK - 1
J31 - TMS - 5
J32 - TDI - 9
J30 - TDO - 3
J33 - 3.3v - 4 (VccTRGT)
J34 - GND - 2


New Feature - Buttom to run code in the Browser.

I would like to see a direct button in Atom to run the code in browser.
Like a "Compile" butom rsrs
If the feature already exists, sorry for this issue.

There are many packages that add this functionality - you may want to try out the script or build packages.


remove the launch template mixed variable from examples

PR o'clock
Description
Removing the worker_groups_launch_template_mixed variable from examples.
Checklist

[ ] terraform fmt and terraform validate both work from the root and examples/* directories
[ ] CI tests are passing
[ ] I've added my change to CHANGELOG.md and highlighted any breaking changes
[ ] README.md has been updated after any changes to variables and outputs. See https://github.com/terraform-aws-modules/terraform-aws-eks/#doc-generation

Resolves https://github.com/terraform-aws-modules/terraform-aws-eks/issues/546


:lady_beetle: Migration Plan (UI) - "Disk Transfer" isn't updated the progress during copy disks step.

While the migration plan is running, the "Disk Transfer" progress field isn't updating during the "DiskTransferV2v - Copy disks" step. It is updated at the end.

@ahadas hi, the value that don't get updated is from the plan yaml, pipline status disk transfer step when doing vsphere, is this a known issue ?

no, it's not a known issue
if that value is missing in the plan CR then we'll take care of it on the backend of course

@duduvaa hi,
the UI take the value from
the Plan CR
status -> migration -> vms [*] -> pipeline [ DiskTransferV2v ] -> tasks -> progress
can you check if this value get updated in the plan CR for this vm ?
if it's updating it's a UI thing
if it's not we move the bug to the backend
Ref:
https://github.com/yaacov/forklift-console-plugin/blob/main/packages/forklift-console-plugin/src/modules/Plans/views/details/tabs/VirtualMachines/Migration/MigrationVirtualMachinesRow.tsx#L49

@yaacov @duduvaa I'm checking this now

@ahadas hi, closing on the UI side, because it's a backend issue


time: Multiple packages in the directory: time, main

What version of Go are you using (go version)?

$ go version
go version go1.18beta1 windows/amd64

Does this issue reproduce with the latest release?

yes

What operating system and processor architecture are you using (go env)?
go env Output
$ go env
set GO111MODULE=on
set GOARCH=amd64
set GOBIN=
set GOCACHE=C:\Users\lenovo\AppData\Local\go-build
set GOENV=C:\Users\lenovo\AppData\Roaming\go\env
set GOEXE=.exe
set GOEXPERIMENT=
set GOFLAGS=
set GOHOSTARCH=amd64
set GOHOSTOS=windows
set GOINSECURE=
set GOMODCACHE=E:\goProject\pkg\mod
set GONOPROXY=
set GONOSUMDB=
set GOOS=windows
set GOPATH=E:\goProject
set GOPRIVATE=
set GOPROXY=https://goproxy.cn,https://goproxy.io,direct
set GOROOT=E:\Go
set GOSUMDB=sum.golang.org
set GOTMPDIR=
set GOTOOLDIR=E:\Go\pkg\tool\windows_amd64
set GOVCS=
set GOVERSION=go1.18beta1
set GCCGO=gccgo
set GOAMD64=v1
set AR=ar
set CC=gcc
set CXX=g++
set CGO_ENABLED=1
set GOMOD=NUL
set GOWORK=
set CGO_CFLAGS=-g -O2
set CGO_CPPFLAGS=
set CGO_CXXFLAGS=-g -O2
set CGO_FFLAGS=-g -O2
set CGO_LDFLAGS=-g -O2
set PKG_CONFIG=pkg-config
set GOGCCFLAGS=-m64 -mthreads -fmessage-length=0 -fdebug-prefix-map=C:\Users\lenovo\AppData\Local\Temp\go-build1614885817=/tmp/go-build -gno-record-gcc-switches

What did you do?
I plan to use the time package, but I got this error on goland：
Multiple packages in the directory: time, main

This seems to be caused by genzabbrs.go. Although it will not be compiled, it seems not good to have multiple packages in the same directory, so is it possible to move this type of file to another directory?

What did you expect to see?

A cleaner time directory

What did you see instead?

There are multiple different packages in the same directory

The file is guarded by the build tag //go:build ignore.
How are you using the package/building your program?

This is normal and intended.  There are other examples of this in the standard library, such as crypto/md5 and encoding/gob.

Yes, it won’t have any problems when compiling, I just think it’s a better idea to keep the directory clean. That’s okay, thanks for your reply

Yes, it won’t have any problems when compiling, I just think it’s a better idea to keep the directory clean. That’s okay, thanks for your reply

I have the same problem, can you tell me how to fix?


API Endpoint: Fetch Submission History

We can get a specific submission for a user and recent submissions for all users, but we do not have an endpoint for fetching all submissions for a specific user.
Maybe add a parameter to filter by assignment.

Trying this one!

Complete in 83fc1f781fda18aec7d245d23dc5ffab12e8ed04.


Fix service lookup referenced in issue: #109

Description
This PR fixes #109

[x] Yes, I signed my commits.
Signed-off-by: Utkarsh Srivastava<EMAIL_ADDRESS>

@utkarsh-pro This would override those namespace specified inside the manifest I believe?

@utkarsh-pro This would override those namespace specified inside the manifest I believe?

Yes, @kumarabd basically initially we were not using the namespace provided by the user while creating the resource. This change will ensure that the resource is created in the namespace provided by the user. It does so by changing/overriding the namespace read from the YAML file to the one provided by the user.

@utkarsh-pro This would override those namespace specified inside the manifest I believe?

Yes, @kumarabd basically initially we were not using the namespace provided by the user while creating the resource. This change will ensure that the resource is created in the namespace provided by the user. It does so by changing/overriding the namespace read from the YAML file to the one provided by the user.

@utkarsh-pro  Thanks for this. A caution, while we tried to do that earlier, we ended up missing some cases where it wasn't making use of user provided namespace for certain resource types and things went for a toss. Did you happen to verify this from your setup? Some sort of dry run?

@kumarabd here are the things that I tested after making these changes:

Deployed linkerd
Deployed istio
Deployed all of the sample applications of both of the service meshes

Please let me know if I should test some other things too. I'll test those things and will get back to you.

@kumarabd here are the things that I tested after making these changes:

Deployed linkerd
Deployed istio
Deployed all of the sample applications of both of the service meshes

Please let me know if I should test some other things too. I'll test those things and will get back to you.

LGTM!


ArchiveBox incompatible with Django versions below v3: Invalid template library specified error

Describe the bug
Followed the install instructions on debian, and once I tried to run the server it works, but gives me a Django related template error when I try to hit the :8000 url:
"Invalid template library specified"
No module named 'django.contrib.admin.templatetags.base'
Steps to reproduce

Followed apt install steps for Debian
created empty folder
ran archivebox setup in it
created user and super user following tutorial
checked that all with fine with --version : no error reported
launched server: archivebox server myip:8000
Tried the myip:8000 in the browser and this is where I see the django error via SSH

ArchiveBox version

Cpython Linux Linux-4.19.0-16-amd64-x86_64-with-debian-10.9 x86_64
IN_DOCKER=False DEBUG=False IS_TTY=True TZ=UTC SEARCH_BACKEND_ENGINE=ripgrep

[i] Dependency versions:
 √  ARCHIVEBOX_BINARY     v0.6.2          valid     /usr/bin/archivebox
 √  PYTHON_BINARY         v3.7.3          valid     /usr/bin/python3.7
 √  DJANGO_BINARY         v2.0.10         valid     /usr/local/lib/python3.7/dist-packages/django/bin/django-admin.py
 √  CURL_BINARY           v7.64.0         valid     /usr/bin/curl
 √  WGET_BINARY           v1.20.1         valid     /usr/bin/wget
 √  NODE_BINARY           v13.14.0        valid     /usr/bin/node
 √  SINGLEFILE_BINARY     v0.3.17         valid     ./node_modules/single-file/cli/single-file
 √  READABILITY_BINARY    v0.0.2          valid     ./node_modules/readability-extractor/readability-extractor
 √  MERCURY_BINARY        v1.0.0          valid<EMAIL_ADDRESS>
 √  GIT_BINARY            v2.20.1         valid     /usr/bin/git
 √  YOUTUBEDL_BINARY      v2019.01.17     valid     /usr/bin/youtube-dl
 -  CHROME_BINARY         -               disabled
 √  RIPGREP_BINARY        v0.10.0         valid     /usr/bin/rg

[i] Source-code locations:
 √  PACKAGE_DIR           23 files        valid     /usr/lib/python3/dist-packages/archivebox
 √  TEMPLATES_DIR         3 files         valid     /usr/lib/python3/dist-packages/archivebox/templates
 -  CUSTOM_TEMPLATES_DIR  -               disabled

[i] Secrets locations:
 -  CHROME_USER_DATA_DIR  -               disabled
 -  COOKIES_FILE          -               disabled

[i] Data locations:
 √  OUTPUT_DIR            6 files         valid     /home/<myuser>/archivebox
 √  SOURCES_DIR           0 files         valid     ./sources
 √  LOGS_DIR              1 files         valid     ./logs
 √  ARCHIVE_DIR           0 files         valid     ./archive
 √  CONFIG_FILE           81.0 Bytes      valid     ./ArchiveBox.conf
 √  SQL_INDEX             204.0 KB        valid     ./index.sqlite3

just verifying that you ran 'init'...

do you need init ? From the install it seems that it was only needed when using existing folders with prior data?

I just ran init and it did some additional checks without changing anything - then the error remains.

You django version is waaaay too old. I don't know where you installed it from, but you need at least Django version 3, if not 3.1.
pip3 install django==3.1.8.

good catch. i missed that
Larry G. Wapnitsky
E<EMAIL_ADDRESS>Web: Larry.Wapnitsky.com http://larry.wapnitsky.com/Twitter:
@LGWapnitsky
On Tue, Apr 20, 2021 at 5:07 PM Nick Sweeting @.***>
wrote:

You django version is waaaay too old. I don't know where you installed it
from, but you need at least Django version 3, if not 3.1.
pip3 install django==3.1.8.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/ArchiveBox/ArchiveBox/issues/717#issuecomment-823601044,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAE6CFGYLWYXDX2PWSDQQR3TJXUI3ANCNFSM43HAP64A
.

OK, after upgrading to Django 3.1.8 the problem is gone away - thanks!