[SPARK-31833][SQL][test-hive1.2] Set HiveThriftServer2 with actual port while configured 0

What changes were proposed in this pull request?
When I was developing some stuff based on the DeveloperAPI  org.apache.spark.sql.hive.thriftserver.HiveThriftServer2#startWithContext, I need to use thrift port randomly to avoid race on ports. But the org.apache.hive.service.cli.thrift.ThriftCLIService#getPortNumber do not respond to me with the actual bound port but always 0.
And the server log is not right too, after starting the server, it's hard to form to the right JDBC connection string.
INFO ThriftCLIService: Starting ThriftBinaryCLIService on port 0 with 5...500 worker threads

Indeed, the 53742 is the right port
lsof -nP -p `cat ./pid/spark-kentyao-org.apache.spark.sql.hive.thriftserver.HiveThriftServer2-1.pid` | grep LISTEN
java    18990 kentyao  288u    IPv6 0x22858e3e60d6a0a7      0t0                 TCP <IP_ADDRESS>:53723 (LISTEN)
java    18990 kentyao  290u    IPv6 0x22858e3e60d68827      0t0                 TCP *:4040 (LISTEN)
java    18990 kentyao  366u    IPv6 0x22858e3e60d66987      0t0                 TCP <IP_ADDRESS>:53724 (LISTEN)
java    18990 kentyao  438u    IPv6 0x22858e3e60d65d47      0t0                 TCP *:53742 (LISTEN)

In the PR, when the port is configured 0, the portNum will be set to the real used port during the start process.
Also use 0 in thrift related tests to avoid potential flakiness.
Why are the changes needed?
1 fix API bug
2 reduce test flakiness
Does this PR introduce any user-facing change?

yes, org.apache.hive.service.cli.thrift.ThriftCLIService#getPortNumber will always give you the actual port when it is configured 0.
How was this patch tested?

modified unit tests

Test build #123166 has started for PR 28651 at commit ea1f9dc.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/27796/
Test PASSed.

cc @cloud-fan @maropu @wangyum @dongjoon-hyun thanks very much.

Test build #123166 has finished for PR 28651 at commit ea1f9dc.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/123166/
Test PASSed.

retest this please

retest this please

Test build #123171 has started for PR 28651 at commit ea1f9dc.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/27804/
Test FAILed.

retest this please

Test build #123176 has started for PR 28651 at commit ea1f9dc.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/27805/
Test PASSed.

cc @juliuszsompolski

Test build #123171 has finished for PR 28651 at commit ea1f9dc.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/123171/
Test PASSed.

Test build #123176 has finished for PR 28651 at commit ea1f9dc.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/123176/
Test PASSed.

Test build #123179 has started for PR 28651 at commit c58250d.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/27807/
Test PASSed.

Test build #123179 has finished for PR 28651 at commit c58250d.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/123179/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/27880/
Test PASSed.

Test build #123258 has started for PR 28651 at commit 099d261.

Test build #123258 has finished for PR 28651 at commit 099d261.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/123258/
Test PASSed.

thanks, merging to master/3.0!


Is it possible to be used with query?

https://i.imgur.com/j4rAIxF.png

Currently not yet, but let me look into it.

Just a question. Queries typically retrieve multiple results. How would you use them on a Kanban board?

Just a question. Queries typically retrieve multiple results. How would you use them on a Kanban board?

An example would be:
- {{renderer(:kanban_dpjdipddbc)}}
	- data
	    - TODOs
		- {{query((todo todo) )}}

Lists all TODO blocks across the entire database as separate cards under the TODO Column.

Delivered in v2.6.0.


DL-192: year needs updating in NOTICE

The year was 2016. but we are going to release at 2017. so updating the files to 2017.

does this need to be a template eventually?
ie does every new release need to use the current year?

I think this has to be updated on every new release to use current year. I will check if there is any plugin can be used for automating this.

If you find a way to automate, then great, but otherwise, just add a bullet to the release management page to remind the release manager to update if necessary.

@fpj yeah. will first add a bullet to release guide for now.


Integrate 2021+ FERC-714 XBRL data

Overview
Thus far we have only integrated the 2006-2020 FERC-714 data, which was published as CSV dumps from VisualFoxPro DBF database files.  Since 2021 this data has been transitioned to XBRL, but we haven't integrated it yet.  To have the most up to date hourly demand and 10-year load forecast data available, we should get the FERC-714.
Logistics

We are already archiving the post-2020 FERC-714 XBRL data and converting it to SQLite for convenient extraction.
We would need to adapt / repurpose our existing XBRL extraction infrastructure to getting the FERC-714 data.
Structurally the tables we're pulling from FERC-714 are simple, and only have a few columns each.
Currently in PUDL we have out_ferc714__hourly_planning_area_demand.
#3519 and #3670 will bring in the 10-year load forecast table.

What do you know about it so far?

There's probably a bunch of new timezone / timestamp issues to clean up in the newer years of data for consistency with the old data in the hourly demand table.
The newer years of data have even more freeform utility IDs -- there's the FERC-714 ID (which is different from the FERC-1 IDs) and then a choose-your-own-adventure ID, many of which are from EIA, but not all.  So there will be some manual mapping, but there's only ~100 planning areas so this is tractable even if it's all manual.

@zaneselvans Was this issue addressed by #3809, and should it be closed? If not, it probably wants to be updated.

Yeah I think this is good to close now! 🎉


Activating Azure - offer walkthrough for Visual Studio Dev Essentials too

Module 1 Lesson 1 Activating your Azure Pass and Using the Azure Portal Lab
this HOL only describes the process of activating an Azure Pass (which are only valid for 30 days).
Since we introduced Visual Studio Dev Essentials (https://www.visualstudio.com/dev-essentials/) which comes with $25 of free Azure for one year, it would be useful to describe the process of activating an Azure subscription through this offering.

Since we are primarily using these workshops with students we didn't want to focus on Azure offers that require a credit card.  So it was a conscious decision to leave off descriptions of Dev Essentials and the Azure Free Trial in the instructions.  If you feel strongly about it feel free to disagree and explain your perspective.

Hi Susan,
Thanks for your answer. My reasoning is based on the following points:

Azure Passes are only valid for 30 days, and most (all?) of the course modules would take longer to schedule and teach on a real academic setup.
You can only use one Azure Pass for your Microsoft account (as explained here in the FAQ). A new pass would require you to create a new Microsoft account. You'd also be losing access to your previously created resources, which might be useful to refer to later in your module, or to refresh your knowledge.
By contrast, the VS Dev Essentials package has some Azure credit (currently $25 a month) which is valid for an entire year. It is true that requiring a CC can be a limiting factor for students, which is why I would propose to add it as an alternative to the Azure Pass.
The Microsoft Imagine (formerly DreamSpark) would be a good choice in terms of length and not requiring a CC, but the number of available Azure services is too limited right now.

Where are you planning to use the workshop content?

@neaorin and @susanibach - I agree with your reasoning for not including the Dev Essentials credit, but I think now that we have the Azure for Students credits available, it would be great to highlight that instead.
Let me know if either of you disagree!


Melissa - completed Pixart assignment

Comfort: 5/5
Completeness: 6/5?
I finished the 6 initial commits + the bonus (except for one remaining bug in the color switcher that currently prevents the right colors from displaying in the color switcher if two clicks in the color switcher boxes happen subsequently)

:+1: :star2: EXCELLENT pseudo code!!


Fix flake8 issues for Python 3

Resolve the open Travis CI issues.

Thanks for taking care of that!


Test data/filename for specific mime type(s)

A nice feature would be to test if some data or a filename is a certain mimetype or mimetypes. This way it will be performant as it will only be carrying out a check for the requested mime types and not for each mimetype.

That's not really how the shared-mime-type database works.
For data blobs, the lookup operation stops at the first match; you still need to perform a tree traversal because the each magic entry can have multiple rules.
For globs—i.e. filenames—we can have multiple matching extensions, and they all have to be reported.
Do you have an example of what kind of convenience API are you looking for?

Thanks, that makes sense about traversing the tree.
I'd seen a function for checking if data matched a mime type in the tree magic crate which I had been originally using however it only supports a handful of mine types.
https://docs.rs/tree_magic/0.2.3/tree_magic/fn.match_u8.html

In the end, I didn't write any convenience API for this.
Using GuessBuilder::guess() to guess a MIME type, and then using Mime::from_str() to check if it's a specific MIME type is already pretty simple; if somebody wishes to implement additional convenience API, feel free to open a pull request.


[Bug]: Error when pickling simulation

PyBaMM Version
23.4.1
Python Version
3.9.16
Describe the bug
When trying to pickle a simulation with experiment I get an error related to a SwigPy object that can't be pickled. I suspect it is a problem with Casadi, but haven't been able to trace the origin of such object.
Steps to Reproduce
Run
import pybamm
model = pybamm.lithium_ion.SPMe()

experiment = pybamm.Experiment(
    [
        (
            "Discharge at 1C until 2.5 V",
            "Charge at C/3 until 4.2 V",
            "Hold at 4.2 V until C/20",
        )
    ]
)

sim = pybamm.Simulation(
    model,
    experiment=experiment,
)
sim.solve()
sim.save("test.pkl")

If instead you replace the last few lines by
sim = pybamm.Simulation(
    model,
)
sim.solve([0, 3600])
sim.save("test.pkl")

it works fine.
Relevant log output
Traceback (most recent call last):
  File "/home/brosaplanella/support-pybamm/mwe_swigpy.py", line 19, in <module>
    sim.save("test.pkl")
  File "/home/brosaplanella/support-pybamm/env/lib/python3.9/site-packages/pybamm/simulation.py", line 1096, in save
    pickle.dump(self, f, pickle.HIGHEST_PROTOCOL)
TypeError: cannot pickle 'SwigPyObject' object

Pickling simulations is a pain and simulations are super cheap to set up. Do we want to continue allowing this, or suggest that people set up configuration files instead?

This also kind of relates to #2787

I think that some optimisers pickle (or do something similar to pickling) when running in parallel. It was not where this issues came up, but had similar issues in the past with pybamm-param. I think for that it would be enough to be able to access an unsolved version.

Ok, I found the issue. It is with op_conds_to_build_solvers which keeps a copy of the solver which is not processed for pickling. It should be an easy fix, we only need to process the solvers in op_conds_to_build_solvers similarly as we do in
https://github.com/pybamm-team/PyBaMM/blob/a1e64c7715723b67928a9423e714689d9ee06e83/pybamm/simulation.py#L1090
Note that this issue appears only after merging #2960


Inconsistent type checking when using the spread operator

TypeScript Version:  3.9.2, 3.8.3

Search Terms:
spread operator loose typing
Code
class MyPayload {
  foo: string;
}

class MyClass {
  constructor(payload: MyPayload) {}
}

const someProps = {
  a: 'hello',
  b: 'super',
};

const a = new MyClass({ ...someProps, foo: 'bar' }); // Compiles fine

const b = new MyClass({ a: 'hello', ...someProps, foo: 'bar' }); // Compiles fine

const c = new MyClass({ ...someProps, a: 'hello', foo: 'bar' }); // Compile error

const d = new MyClass({ a: 'hello', foo: 'bar' }); // Compile error

Error message:
 error TS2345: Argument of type '{ a: string; foo: string; }' is not assignable to parameter of type 'MyPayload'.
  Object literal may only specify known properties, and 'a' does not exist in type 'MyPayload'.

Expected behavior:
All 4 last statements should either result in an compile error or none of them.
Actual behavior:
Two gives errors, the other two do not.
Discussion
I tried to find in older issues and discussions something that could explain this behaviour but I could not find it. Intuitively I picture the spread operator in the examples above as a shorthand instead of specifying all the object properties one by one, but surprisingly tsc does not threat it like that. If this really is working as design please provide some explanation for the layman.
Thanks!.

Likely duplicate of #32495.
I get an error in your b line also, where you say it "compiles fine"; see Playground.

@jcalz yes you are right that in latest version you get an error in b (not in 3.8.x though). However it is a different error, it is complaining that property "a" will be overwritten by the spreaded object.

I don't really want to go in to 100.0% of the reasoning behind excess property checking and how spreads are treated. These four lines are different and it's insufficient to say that spreads should behave exactly like writing their individual operands, because spreading is not the same as writing the individual operands (e.g. the possibility of aliasing, the behavior of duplicate keys, etc). If you want to make an argument for any individual line to behave different I can speak to that, but behaving differently in the presence of different code is par for the course.

@RyanCavanaugh I think it is pretty confusing that this line compiles without any error:
const a = new MyClass({ ...someProps, foo: 'bar' }); // Compiles fine

I would love if you could point out to some explanation on why that is the case.

@manast-apsis the provided object literal is a subtype of MyPayload because it has a foo property of type string, therefore the call is valid

But it includes properties that are not part of MyPayload, why would this one give a compiler error then?
const d = new MyClass({ a: 'hello', foo: 'bar' }); // Compile error


After running take-over playbook, swith-to-containers fails in [get current ceph fsid]

In TripleO we're trying to run two infrastructure playbooks sequentially

take-over-existing-cluster.yml (which completes successfully)
switch-from-non-containerized-to-containerized-ceph-daemons.yml

The second fails in [get current ceph fsid] with:
fatal: [<IP_ADDRESS>]: FAILED! => {"failed": true, "msg": "'mon_host' is undefined"}
Output from execution attached
switch_failure.txt

I think this happens because with a single monitor the when condition in [select a running monitor] is never met; it prevents migration of clusters with a single monitor. Is this the intended behavior?

I think we still want to make some changes, working on it in PR #1779

More fixes coming with https://github.com/ceph/ceph-ansible/pull/1788

Closed due to inactivity, feel free to re-open if needed. Thanks!


PoC: Add an internal-to-OpenShift listener

JIRA: https://issues.redhat.com/browse/MGDSTRM-9651
This listener would be accessible through the -kafka-brokers service, rather than through the ELB/Ingress controller setup.
The TLS cert is provided by the cluster CA, and client apps can be given access to that CA by following the docs here:
https://docs.openshift.com/container-platform/4.11/security/certificates/service-serving-certificate.html
One oddity is that the controller that creates the cert in response to the annotation on the Service will try to add an additional annotation also, but Strimzi removes that. I don't know if that causes any problems.

Closing this as it's not intended to be reviewed or merged (at least not for now).


ViewStartProvider needs unit tests for Unix-style paths

Need to figure out what the pattern is for running things per OS environment.

This was an issue when we previously manipulated the ApplicationBasePath to construct potential paths for _ViewStarts. This is no longer the case (we rely on app-relative paths) so we no longer require specialized tests.


Proxy server in system settings

Hi Gentlemen ,
First big thank you for all the work done , i really like this library :
i am looking for the proxy server object ? below SystemSettings i can't find the object related or options ?

Thanks in advance

Hi fixed like this but doesn't cover all parameters for other people that will used the call :
class SystemSettings(VersionedPanObject):
params.append(VersionedParamPath(
'proxy_server', path='secure-proxy-server'))
params.append(VersionedParamPath(
'proxy_port', path='secure-proxy-port'))


Misleading error when incorrect arguments provided to aks get-credentials

Describe the bug
A clear and concise description of what the bug is.
To Reproduce
Run
az aks get-credentials -g "" -n ""

Expected behavior
An error message stating that resource group and cluster name values provided are either invalid or not found.
Actual behavior
The api-version '2018-03-31' is invalid. The supported versions are '2018-09-01,2018-08-01,2018-07-01,2018-06-01,2018-05-01,2018-02-01,2018-01-01,2017-12-01,2017-08-01,2017-06-01,2017-05-10,2017-05-01,2017-03-01,2016-09-01,2016-07-01,2016-06-01,2016-02-01,2015-11-01,2015-01-01,2014-04-01-preview,2014-04-01,2014-01-01,2013-03-01,2014-02-26,2014-04'.

This error lead me on a wild goose chase for configuration issues, rather than to re-examine my script that was passing uninitialized variables.
Environment summary
apt on Ubuntu / 2.0.51 / 18.04 / bash

Looks like a swagger issue, similar to #7256.

I made a similar swagger fix to ACR in Azure/azure-rest-api-specs#4979.

Fixed


Unescape string in SendingTask before sending it to server

SendingTask.java line 58
conn.sendMessage(rawArgs.substring(11, rawArgs.length() - 2));

rawArgs contains JSON.stringifyed string, which escapes some symbols (specifically double quotes)
You should unescape them before sending it to server.
Something like
JSONArray json = new JSONArray(rawArgs);
String str = (String)json.get(0);
conn.sendMessage(str.substring(9, str.length()));

Sorry for my late response, and thank you for pointing out the bug. I've just fixed it and published as ver.0.11.1.


Update whats-new.md

@ravastra : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@ravastra - Contributors who work in the Product Manager role should work in the private repository for advanced quality validations and staging (you also can sign off directly in the private repo). To edit an article in the private repo from within the documentation, after you select Edit on an article page,  add “-pr” to the URL. Would you make the updates in the private repo? We'll close this PR. Thanks!


Add more host names to block ads/popups from netu.tv videoplayer

https://github.com/StevenBlack/hosts/pull/2330

Thanks Andrei @BaxAndrei!
Merging.


TreeError [FileExplorer] Tree element not found: [object Object]

Error: TreeError [FileExplorer] Tree element not found: [object Object]
at l.getCompressedNode (https:/<REDACTED: user-file-path>:133:35258)
at l.isCollapsed (https:/<REDACTED: user-file-path>:133:34714)
at p.isCollapsed (https:/<REDACTED: user-file-path>:133:37716)
at v.isCollapsed (https:/<REDACTED: user-file-path>:545:669)
at re.H (https:/<REDACTED: user-file-path>:545:19435)
at re.E (https:/<REDACTED: user-file-path>:545:18722)
at async re.D (https:/<REDACTED: user-file-path>:545:18298)

Go to Errors Site

Duplicate of https://github.com/microsoft/vscode/issues/172789


Problem with Content Security Policy: require-trusted-types-for 'script'

Hello, I have a problem in a project where the CSP require-trusted-types-for 'script' is enabled. If I understand it right because Iconify uses innerHTML, it throughs following error in Chrome:
This document requires 'TrustedHTML' assignment.

Do you know how to solve this problem besides removing the policy?

Description of that policy is very vague and uses example when assigning code with script, so I have no idea what's going on there.
As I understand, that policy affects only code that contains scripts, so it should not be triggered by icons because they are very strictly validated to make sure they do not contain scripts and other nasty stuff.

What icon component are you using and how are you using it (bundling or linking to external script)?

I think I found a fix. Can you please check if it works for you by installing @iconify/react@next?

New versions of React component, web component and SVG framework have been published with workaround for policy.
That policy is absolutely useless though. It should not be relied upon for any kind of security because it doesn't provide any. Whoever is using it is either misunderstanding it (most likely) or just saw word "security" (then its plain incompetence) and added it without understanding how it works. This explains this is first time I'm hearing it even though this policy existed for about 4 years, as most website developers are usually competent enough to read spec and understand that this policy is junk.
Why is it useless? Policy works by requiring content to be sanitised. However, it does not define how content is sanitised, does not provide any functions for doing it. It is up to a library to sanitise content. That means library can just return original string without doing any actual sanitisation. How is that considered "security"??? Absolutely useless policy.

Awesome! I'm sorry for not getting back to you sooner! It works great now! Thank you very much! 🙏 😊


Add myself as uploader for the dashboard-view plugin

Description
Plugin: dashboard-view plugin, current maintainers: @mambu @petehayes
Request for adoption is here: https://groups.google.com/forum/#!topic/jenkinsci-dev/YbRuslAAHAU (not accepted yet)
Submitter checklist for changing permissions
Always

[x] Add link to plugin/component Git repository in description above

When adding new uploaders (this includes newly created permissions files)

[x] Make sure to @mention an existing maintainer to confirm the permissions request, if applicable
[x] Use the Jenkins community (LDAP) account name in the YAML file, not the GitHub account name
[x] All newly added users have logged in to Artifactory at least once

Looks like @olivergondza was recently active here, so would like to hear from him.


schedule: remove text shadow on h4

Signed-off-by: Mathieu Tortuyaux<EMAIL_ADDRESS>
Before:

After:

@pabluk if you could just regen css from this change?

@pabluk if you could just regen css from this change?

Yes, of course :+1:

I've also updated the submodule version on https://github.com/sre-summercamp/sre-summercamp.github.io/commit/253375d11cedd5c1d676a8fd4e8e1aced5b08d4d

Thanks a lot!


How to run the gguf model

Tried running the provided gguf files with llama.cpp and got
llama_model_load: error loading model: create_tensor: tensor 'blk.0.attn_q.weight' has wrong shape; expected  3072,  3072, got  3072,  4096,     1,     1
llama_load_model_from_file: failed to load model
llama_init_from_gpt_params: error: failed to load model '/mnt/llama/gguf/Apollo-7B-q8_0.gguf'
main: error: unable to load model

Tried some other things as well (including converting the safetensors myself which resulted in the same problem)
It's probably something obvious that I'm forgetting here

Hello, sorry for the delayed reply. I am not familiar with GGUF. I will debug it this weekend and try to solve it .

You can try https://huggingface.co/mradermacher/Apollo-7B-GGUF first

At least the first one worked, didn't try the second one


Flickering windows.

There is this odd flickering of windows that happens at random. So far it has happened to me twice within the span of the past 30 minutes and always when I click send on an email I just composed in "Mail"
I wish that I could attach a video to give you an idea of what I'm talking about.

This doesn't sound exactly like #129, but possibly related?

Possibly. I installed chunkwm using brew and its version 0.2.12

The windows tend to flicker when I am closing them.

Probably same as in kwm. Disable window_region_locked

@koekeishiya Yes.. I figured that it might be the issue.

Maybe it'd be possible to mitigate this issue by buffering window resizes if we try to resize a win more then a threshold in an arbitrary amount of time...

@choco I believe that the standard window animations of Mac OS are probably the issue. As mentioned in issue #129 , I notice the window start bouncing when compose and send a letter in the Mail app. The animation for sending a letter is the window basically flying upwards and closing. So with  the window_region_locked in the on position, we basically have an issue where the window is trying to fly off and the lock wants it kept in place.
Perhaps switching off the window animations is needed. Or a way to unlock the windows for the animations to do their thing and switching it back on.


fixe the wrong word 'builderh' to 'builder' in chatclient.adoc file

There is a wrong word 'builderh' in chatclient.adoc file, it should be 'builder'.

Thank you @shihaoxiong . It seems though that this type has been fixed already by some other PR.
Nothing to fix


[FLINK-18241] Use correct user class loader in OptimizerPlaneEnvironment & StreamPlanEnvironment

What is the purpose of the change
Use the user classloader when creating StreamPlanEnvironment and OptimizerPlanEnvironment
Verifying this change
Added test in PackagedProgramUtilsTest
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (yes / no) - test dependency
The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no)
The serializers: (yes / no / don't know)
The runtime per-record code paths (performance sensitive): (yes / no / don't know)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn/Mesos, ZooKeeper: (yes / no / don't know)
The S3 file system connector: (yes / no / don't know)

Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

Closed with c2e2c6e


extra780 it returns false positive because of quote when running container in Windows

Because this check is using --query 'DomainStatus.CognitoOptions.Enabled'
instead of --query "DomainStatus.CognitoOptions.Enabled", th aws cli  2.2.12 it does not return the value (True / False) but the text
DomainStatus.CognitoOptions.Enabled

Hi,
The issue appears only on Windows aws cli.
Thanks.

ok thanks for clarifying, that is not planned to fix at this point, could you use cli v2 or the existing docker image or provided dockerfile? that would fix the problem. https://github.com/toniblyx/prowler/blob/master/util/Dockerfile

Apparently when the container is running in Windows the response of command
$ aws es describe-elasticsearch-domain --domain-name test1  --region eu-west-1 --query "DomainStatus.CognitoOptions.Enabled" --output text

is empty instead of true or false. Can you confirm @ilutiu ?

Sorry for the misunderstanding. The container is linux (amazon/aws-cli) and I've also tested on windows (not a container).
On both cases I've obtained a false positive and on windows  I've seen that the response of the cli is the text
DomainStatus.CognitoOptions.Enabled instead of bool

Hi @ilutiu, could you please fulfil the issue template here, we need more information to address this issue.
Please, include as much debug information as you can, using bash -x, because with the information you provide we are not  being able to reproduce your issue.
Thank you!

Hi @ilutiu, we are closing this issue because we need more information to reproduce it.
Please, feel free to reopen it if you can provide more information or if you are experiencing the same issue.
Thank you!


data-package schema has resources as required

Strictly the spec does not require a resources entry (it is a SHOULD) so we should not have this as required in the schema.
@ldodds wdyt?

Closed by https://github.com/dataprotocols/dataprotocols/commit/8c81898f3cc635c85f5531199b9544889228e87e


Allow serializing as multiline strings

Would it be possible to somehow mark certain fields to be serialized as multiline strings rather than with \n?

Looks like to_string_pretty does this for all strings, which is actually enough for my needs


Getting errors while adding as dev-dependancy

jsHint installed globally with no errors
jshint -version gives output 2.13.5
While adding jshint in project as dev dependancy, gives the following errors -
Used command - npm install --save-dev jshint
Output -

><EMAIL_ADDRESS>install /Users/**/node_modules/fsevents
> node install

node-pre-gyp ERR! Tried to download(403): https://fsevents-binaries.s3-us-west-2.amazonaws.com/v1.1.2/fse-v1.1.2-node-v72-darwin-x64.tar.gz
node-pre-gyp ERR! Pre-built binaries not found for<EMAIL_ADDRESS>and<EMAIL_ADDRESS>(node-v72 ABI) (falling back to source compile with node-gyp)
node-pre-gyp ERR! Tried to download(undefined): https://fsevents-binaries.s3-us-west-2.amazonaws.com/v1.1.2/fse-v1.1.2-node-v72-darwin-x64.tar.gz
node-pre-gyp ERR! Pre-built binaries not found for<EMAIL_ADDRESS>and<EMAIL_ADDRESS>(node-v72 ABI) (falling back to source compile with node-gyp)
Traceback (most recent call last):
Traceback (most recent call last):
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/gyp_main.py", line 50, in <module>
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/gyp_main.py", line 50, in <module>
    sys.exit(gyp.script_main())
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 554, in script_main
    sys.exit(gyp.script_main())
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 554, in script_main
    return main(sys.argv[1:])
    return main(sys.argv[1:])
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 547, in main
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 547, in main
    return gyp_main(args)
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 532, in gyp_main
    return gyp_main(args)
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/__init__.py", line 532, in gyp_main
    generator.GenerateOutput(flat_list, targets, data, params)
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/generator/make.py", line 2214, in GenerateOutput
    generator.GenerateOutput(flat_list, targets, data, params)
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/generator/make.py", line 2214, in GenerateOutput
    writer.Write(qualified_target, base_path, output_file, spec, configs,
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/generator/make.py", line 802, in Write
    writer.Write(qualified_target, base_path, output_file, spec, configs,
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/generator/make.py", line 802, in Write
    self.WriteCopies(spec['copies'], extra_outputs, part_of_all)
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/generator/make.py", line 1145, in WriteCopies
    self.WriteCopies(spec['copies'], extra_outputs, part_of_all)
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/generator/make.py", line 1145, in WriteCopies
    env = self.GetSortedXcodeEnv()
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/generator/make.py", line 1882, in GetSortedXcodeEnv
    env = self.GetSortedXcodeEnv()
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/generator/make.py", line 1882, in GetSortedXcodeEnv
    return gyp.xcode_emulation.GetSortedXcodeEnv(
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/xcode_emulation.py", line 1615, in GetSortedXcodeEnv
    return gyp.xcode_emulation.GetSortedXcodeEnv(
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/xcode_emulation.py", line 1615, in GetSortedXcodeEnv
    env = _GetXcodeEnv(xcode_settings, built_products_dir, srcroot, configuration,
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/xcode_emulation.py", line 1527, in _GetXcodeEnv
    env = _GetXcodeEnv(xcode_settings, built_products_dir, srcroot, configuration,
  File "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/gyp/pylib/gyp/xcode_emulation.py", line 1527, in _GetXcodeEnv
    if XcodeVersion() >= '0500' and not env.get('SDKROOT'):
TypeError: '>=' not supported between instances of 'tuple' and 'str'
    if XcodeVersion() >= '0500' and not env.get('SDKROOT'):
TypeError: '>=' not supported between instances of 'tuple' and 'str'
gypgyp ERR! configure error
 gypERR!  configure error
ERR! stack Error: `gyp` failed with exit code: 1
gyp ERR! stack     at ChildProcess.onCpExit (/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/lib/configure.js:351:16)
gyp ERR! stack     at ChildProcess.emit (events.js:311:20)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:275:12)
gyp ERR! stack Error: `gyp` failed with exit code: 1
gyp ERR! gyp stackERR!     at ChildProcess.onCpExit (/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/lib/configure.js:351:16)
 gypSystem  Darwin 21.5.0
ERR! gypstack      at ChildProcess.emit (events.js:311:20)
ERR! gypcommand  "/Users/amangautam/.nvm/versions/node/v12.16.1/bin/node" "/Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "configure" "--fallback-to-build" "--module=/Users/**/node_modules/fsevents/lib/binding/Release/node-v72-darwin-x64/fse.node" "--module_name=fse" "--module_path=/Users/**/node_modules/fsevents/lib/binding/Release/node-v72-darwin-x64"
ERR! stackgyp     at Process.ChildProcess._handle.onexit (internal/child_process.js:275:12)
 ERR! cwd /Users/**/node_modules/fsevents
gyp ERR! node -v v12.16.1
gyp ERR! node-gyp -v v5.0.5
gyp ERR! not ok
gyp ERR!  System Darwin 21.5.0
node-pre-gyp ERR! command "/Users/amangautam/.nvm/versions/node/v12.16.1/bin/node" "/Users/**/node_modules/fsevents/node_modules/.bin/node-pre-gyp" "install" "--fallback-to-build"
node-pre-gyp ERR! cwd /Users/**/node_modules/fsevents
node-pre-gyp ERR! node -v v12.16.1
node-pre-gyp ERR! node-pre-gyp -v v0.6.36
node-pre-gyp ERR! not ok
Failed to execute '/Users/amangautam/.nvm/versions/node/v12.16.1/bin/node /Users/amangautam/.nvm/versions/node/v12.16.1/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js configure --fallback-to-build --module=/Users/**/node_modules/fsevents/lib/binding/Release/node-v72-darwin-x64/fse.node --module_name=fse --module_path=/Users/**/node_modules/fsevents/lib/binding/Release/node-v72-darwin-x64' (1)
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS><6.0.0 but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of typescript@>= 3.x but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of webpack@>= 4 but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>|| ^7.0.0 but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS><5.0.0 but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>- 4.x but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>|| ^3 || ^4 but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>|| ^4.0.0 but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>|| ^5.0.0 but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>|| ^2.0.0 || ^3.0.0 but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>< 6.0.0 but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>|| ^5.0.0 but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of typescript@>= 4.3.x but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>|| ^5.0.0 but none is installed. You must install peer dependencies yourself.
npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>|| >= 3.2.0-dev || >= 3.3.0-dev || >= 3.4.0-dev || >= 3.5.0-dev || >= 3.6.0-dev || >= 3.6.0-beta || >= 3.7.0-dev || >= 3.7.0-beta but none is installed. You must install peer dependencies yourself.
npm WARN optional SKIPPING OPTIONAL DEPENDENCY<EMAIL_ADDRESS>(node_modules/fsevents):
npm WARN optional SKIPPING OPTIONAL DEPENDENCY<EMAIL_ADDRESS>install: `node install`
npm WARN optional SKIPPING OPTIONAL DEPENDENCY: Exit status 1

+<EMAIL_ADDRESS>updated 1 package and audited 3958 packages in 17.855s

232 packages are looking for funding
  run `npm fund` for details

found 252 vulnerabilities (19 low, 95 moderate, 110 high, 28 critical)
  run `npm audit fix` to fix them, or `npm audit` for details``

I am using first time jshint in the project so I am confused whether this is valid errors, pls help
Thanks in advance !!

Thanks for taking the time to file a report. Fortunately, there's no problems here!
What that log shows is that the fsevents npm package is failing to install on your system. I know that sounds bad--it sure looks bad. The saving grace comes near the very end:

npm WARN optional SKIPPING OPTIONAL DEPENDENCY<EMAIL_ADDRESS>(node_modules/fsevents):
npm WARN optional SKIPPING OPTIONAL DEPENDENCY<EMAIL_ADDRESS>install: `node install`
npm WARN optional SKIPPING OPTIONAL DEPENDENCY: Exit status 1

This means that the failure is tolerable because fsevents is an optional dependency. In other words, you can make do without it.
That's also why the final statements in the log sound so positive--they say that the jshint package was updated, and they don't mention any error at all.
Another useful signal from the npm utility (or any well-behaved command-line utility, really) is the exit status code. This is a convention followed by many, many apps in macOS and GNU/Linux (to name a few), so there are much better places to learn about it then here on the JSHint issue tracker. But in short, when any process ends, it reports a number to the operating system which describes whether it was successful or not. Well-behaved programs report the number 0 to indicate that "everything was okay," and any other number indicates a problem. You can see the exit status of the most recent process by printing a special environment variable named "?".
Here's an example from my terminal:
$ node -e 'console.log("This process will exit successfully.")'
This process will exit successfully.
$ echo $?
0
$ node -e 'throw new Error("This program throws an exception, so the process will exit with a non-zero status code.")'
[eval]:1
throw new Error("This program throws an exception, so the process will exit with a non-zero status code.")
^

Error: This program throws an exception, so the process will exit with a non-zero status code.
    at [eval]:1:7
    at Script.runInThisContext (node:vm:129:12)
    at Object.runInThisContext (node:vm:305:38)
    at node:internal/process/execution:75:19
    at [eval]-wrapper:6:22
    at evalScript (node:internal/process/execution:74:60)
    at node:internal/main/eval_string:27:3
$ echo $?
1

This is all to say: if you aren't sure whether npm failed to install something, you can try typing echo $? to see whether it exited successfully.
Hope that helps!


Add blobstore interface to bootstrap params and implement filestore

Having a blobstore as a resource is a useful primitive in many contexts. It is being added here to be used in db scan. Having a local file system implementation allows testing this locally.

In order to have a blobstore for scanner.

There are unit tests and I verified locally that blobstore client works.

The interface might have been defined badly so that when external developers implement there own version of blobstore it might need to be changed later.

Coverage increased (+0.1%) to 68.804% when pulling 64dbd6621fd705317c4291e1c25541f7444c7e00 on andrewjdawson2016:blobstore into 6d1a17aee46c72429b2fad3849d3a1da49582fcf on uber:master.


undefined symbol: dgeqrf_ on Ubuntu14.04

I have tried installing dlib on my Ubuntu 14.04 machine in two ways:

Using pip install dlib
Cloning and running python3 setup.py install

In both case it installs fine. But in both cases when I import it get this error:
import dlib
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: /home/paperspace/anaconda3/lib/python3.6/site-packages/dlib-19.9.99-py3.6-linux-x86_64.egg/dlib.cpython-36m-x86_64-linux-gnu.so: undefined symbol: dgeqrf_

Here is the installation message when running python3 setup.py install:
paperspace@***:~/projects/dlib$ python3 setup.py install
running install
running bdist_egg
running egg_info
writing dlib.egg-info/PKG-INFO
writing dependency_links to dlib.egg-info/dependency_links.txt
writing top-level names to dlib.egg-info/top_level.txt
package init file 'dlib/__init__.py' not found (or not a regular file)
reading manifest file 'dlib.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file 'dlib.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
running build_ext
Invoking CMake setup: 'cmake /home/paperspace/projects/dlib/tools/python -DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/paperspace/projects/dlib/build/lib.linux-x86_64-3.6 -DPYTHON_EXECUTABLE=/home/paperspace/anaconda3/bin/python3 -DCMAKE_BUILD_TYPE=Release'
-- pybind11 v2.2.2
-- Enabling SSE4 instructions
-- Searching for BLAS and LAPACK
-- Searching for BLAS and LAPACK
-- checking for module 'cblas'
--   package 'cblas' not found
-- checking for module 'lapack'
--   package 'lapack' not found
-- Found OpenBLAS library
-- Using OpenBLAS's built in LAPACK
-- Looking for cuDNN install...
-- Found cuDNN: /usr/lib/x86_64-linux-gnu/libcudnn.so
-- Enabling CUDA support for dlib.  DLIB WILL USE CUDA
-- C++11 activated.
-- Found Python with installed numpy package
-- Numpy include path '/home/paperspace/anaconda3/lib/python3.6/site-packages/numpy/core/include'
-- Configuring done
-- Generating done
-- Build files have been written to: /home/paperspace/projects/dlib/build/temp.linux-x86_64-3.6
Invoking CMake build: 'cmake --build . --config Release -- -j8'
Linking CXX static library libdlib.a
[ 74%] Built target dlib
Linking CXX shared module /home/paperspace/projects/dlib/build/lib.linux-x86_64-3.6/dlib.cpython-36m-x86_64-linux-gnu.so
[100%] Built target dlib_python
creating build/bdist.linux-x86_64/egg
copying build/lib.linux-x86_64-3.6/dlib.cpython-36m-x86_64-linux-gnu.so -> build/bdist.linux-x86_64/egg
creating stub loader for dlib.cpython-36m-x86_64-linux-gnu.so
byte-compiling build/bdist.linux-x86_64/egg/dlib.py to dlib.cpython-36.pyc
creating build/bdist.linux-x86_64/egg/EGG-INFO
copying dlib.egg-info/PKG-INFO -> build/bdist.linux-x86_64/egg/EGG-INFO
copying dlib.egg-info/SOURCES.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying dlib.egg-info/dependency_links.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
copying dlib.egg-info/not-zip-safe -> build/bdist.linux-x86_64/egg/EGG-INFO
copying dlib.egg-info/top_level.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
writing build/bdist.linux-x86_64/egg/EGG-INFO/native_libs.txt
creating 'dist/dlib-19.9.99-py3.6-linux-x86_64.egg' and adding 'build/bdist.linux-x86_64/egg' to it
removing 'build/bdist.linux-x86_64/egg' (and everything under it)
Processing dlib-19.9.99-py3.6-linux-x86_64.egg
creating /home/paperspace/anaconda3/lib/python3.6/site-packages/dlib-19.9.99-py3.6-linux-x86_64.egg
Extracting dlib-19.9.99-py3.6-linux-x86_64.egg to /home/paperspace/anaconda3/lib/python3.6/site-packages
Adding dlib 19.9.99 to easy-install.pth file
Installed /home/paperspace/anaconda3/lib/python3.6/site-packages/dlib-19.9.99-py3.6-linux-x86_64.egg
Processing dependencies for dlib==19.9.99
Finished processing dependencies for dlib==19.9.99

Output of ldd dlib.cpython-36m-x86_64-linux-gnu.so:
paperspace@***:~/projects/dlib/dlib/cmake_utils/test_for_cuda$ ldd /home/paperspace/anaconda3/lib/python3.6/site-packages/dlib-19.9.99-py3.6-linux-x86_64.egg/dlib.cpython-36m-x86_64-linux-gnu.so
        linux-vdso.so.1 =>  (0x00007ffdc9dcc000)
        libcudart.so.8.0 => /usr/local/cuda/lib64/libcudart.so.8.0 (0x00007f8a38e63000)
        libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f8a38c20000)
        libX11.so.6 => /usr/lib/x86_64-linux-gnu/libX11.so.6 (0x00007f8a388eb000)
        libpng12.so.0 => /lib/x86_64-linux-gnu/libpng12.so.0 (0x00007f8a386c4000)
        libjpeg.so.8 => /usr/lib/x86_64-linux-gnu/libjpeg.so.8 (0x00007f8a3846f000)
        libcublas.so.8.0 => /usr/local/cuda/lib64/libcublas.so.8.0 (0x00007f8a3542a000)
        libcudnn.so.5 => /usr/lib/x86_64-linux-gnu/libcudnn.so.5 (0x00007f8a301ba000)
        libcurand.so.8.0 => /usr/local/cuda/lib64/libcurand.so.8.0 (0x00007f8a2c244000)
        libcusolver.so.8.0 => /usr/local/cuda/lib64/libcusolver.so.8.0 (0x00007f8a28cd6000)
        libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f8a289d1000)
        libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f8a286cb000)
        libgomp.so.1 => /usr/lib/x86_64-linux-gnu/libgomp.so.1 (0x00007f8a284bc000)
        libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f8a282a5000)
        libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f8a27edc000)
        /lib64/ld-linux-x86-64.so.2 (0x000055c8e99e8000)
        libgif.so.4 => /usr/lib/x86_64-linux-gnu/libgif.so.4 (0x00007f8a27cd3000)
        libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f8a27ace000)
        librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f8a278c6000)
        libxcb.so.1 => /usr/lib/x86_64-linux-gnu/libxcb.so.1 (0x00007f8a276a7000)
        libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007f8a2748d000)
        libXau.so.6 => /usr/lib/x86_64-linux-gnu/libXau.so.6 (0x00007f8a27289000)
        libXdmcp.so.6 => /usr/lib/x86_64-linux-gnu/libXdmcp.so.6 (0x00007f8a27082000)

Something is wrong with the copy of OpenBLAS it's finding since it's
missing symbols.  Use --no DLIB_USE_BLAS and --clean to recompile without
using BLAS.  Or install a non-broken BLAS.

I build and installed OpenBlas from source but that didn't help.
I also did python3 setup.py install --clean  --no DLIB_USE_BLAS, but that didn't help either.

Post the build output from that command.

paperspace@***:~/projects/dlib$ python3 setup.py install --clean  --no DLIB_USE_BLAS
running install
running bdist_egg
running egg_info
writing dlib.egg-info/PKG-INFO
writing dependency_links to dlib.egg-info/dependency_links.txt
writing top-level names to dlib.egg-info/top_level.txt
package init file 'dlib/__init__.py' not found (or not a regular file)
reading manifest file 'dlib.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file 'dlib.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
running build_ext
Removing old directory /home/paperspace/projects/dlib/build/temp.linux-x86_64-3.6
Invoking CMake setup: 'cmake /home/paperspace/projects/dlib/tools/python -DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/paperspace/projects/dlib/build/lib.linux-x86_64-3.6 -DPYTHON_EXECUTABLE=/home/paperspace/anaconda3/bin/python3 -DDLIB_USE_BLAS=no -DCMAKE_BUILD_TYPE=Release'
-- The C compiler identification is GNU 4.8.4
-- The CXX compiler identification is GNU 4.8.4
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Found PythonInterp: /home/paperspace/anaconda3/bin/python3 (found version "3.6.4")
-- Found PythonLibs: /home/paperspace/anaconda3/lib/libpython3.6m.so
-- Performing Test HAS_CPP14_FLAG
-- Performing Test HAS_CPP14_FLAG - Failed
-- Performing Test HAS_CPP11_FLAG
-- Performing Test HAS_CPP11_FLAG - Success
-- pybind11 v2.2.2
-- Enabling SSE4 instructions
-- Looking for include file pthread.h
-- Looking for include file pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- Looking for XOpenDisplay in /usr/lib/x86_64-linux-gnu/libX11.so;/usr/lib/x86_64-linux-gnu/libXext.so
-- Looking for XOpenDisplay in /usr/lib/x86_64-linux-gnu/libX11.so;/usr/lib/x86_64-linux-gnu/libXext.so - found
-- Looking for gethostbyname
-- Looking for gethostbyname - found
-- Looking for connect
-- Looking for connect - found
-- Looking for remove
-- Looking for remove - found
-- Looking for shmat
-- Looking for shmat - found
-- Looking for IceConnectionNumber in ICE
-- Looking for IceConnectionNumber in ICE - found
-- Found X11: /usr/lib/x86_64-linux-gnu/libX11.so
-- Looking for png_create_read_struct
-- Looking for png_create_read_struct - found
-- Looking for jpeg_read_header
-- Looking for jpeg_read_header - found
-- Searching for BLAS and LAPACK
-- Searching for BLAS and LAPACK
-- Found PkgConfig: /usr/bin/pkg-config (found version "0.26")
-- checking for module 'cblas'
--   package 'cblas' not found
-- checking for module 'lapack'
--   package 'lapack' not found
-- Looking for sys/types.h
-- Looking for sys/types.h - found
-- Looking for stdint.h
-- Looking for stdint.h - found
-- Looking for stddef.h
-- Looking for stddef.h - found
-- Check size of void*
-- Check size of void* - done
-- Found OpenBLAS library
-- Looking for sgetrf_single
-- Looking for sgetrf_single - found
-- Using OpenBLAS's built in LAPACK
-- Looking for cblas_ddot
-- Looking for cblas_ddot - found
-- Looking for sgesv
-- Looking for sgesv - not found
-- Looking for sgesv_
-- Looking for sgesv_ - not found
-- Found CUDA: /usr/local/cuda (found suitable version "8.0", minimum required is "7.5")
-- Looking for cuDNN install...
-- Found cuDNN: /usr/lib/x86_64-linux-gnu/libcudnn.so
-- Building a CUDA test project to see if your compiler is compatible with CUDA...
-- Checking if you have the right version of cuDNN installed.
-- Try OpenMP C flag = [-fopenmp]
-- Performing Test OpenMP_FLAG_DETECTED
-- Performing Test OpenMP_FLAG_DETECTED - Success
-- Try OpenMP CXX flag = [-fopenmp]
-- Performing Test OpenMP_FLAG_DETECTED
-- Performing Test OpenMP_FLAG_DETECTED - Success
-- Found OpenMP: -fopenmp
-- Enabling CUDA support for dlib.  DLIB WILL USE CUDA
-- C++11 activated.

Will be missing something as a result of this?

Some things will just run slower, but all features are still available.

I wanna use dlib api on ubuntu16.04 with c/c++,how can I do it?

Thanks this worked for me as well. I am also using paperspace ubuntu 14.


vimPlugins.nvim-docs-view: init at 2023-10-19

Description of changes
Adds https://github.com/amrbashir/nvim-docs-view
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

I was able to get this tested on x86_64-darwin. It appears that the :DocsViewToggle command that comes with the plugin is broken, but :DocsViewUpdate showed the sidebar so I suppose the plugin is working.
Were you able to test this yourself and confirm it functioned the way you need it to function?

When I tested it :DocsViewUpdate showed an error if I ran it before :DocsViewToggle. Personally it works good enough for me and the code base looks simple enough to fix any issues


Feature Request: useVirtualScroll

It uses useIntersectionObserver to implement virtual scrolling effect for list of DOM Elements.

We're not planning on adding any other hooks right now.


Fixed date formatting

The default date formatting displays the month numerically where it should display the date.
According to the Go documentation for the time package, the reference time is defined as Mon Jan 2 15:04:05 -0700 MST 2006.

Thanks @nikovacevic!

@jrutheiser Sure thing! Love the theme :)

@nikovacevic Awesome, I'm glad you like it!


Note needed about Enabling Access-Control-Allow-Credentials from CLI

Since the az functionapp cors command allows adding/removing/showing origin URLs, I was expecting this same command to allow enabling Access-Control-Allow-Credentials as well.  I based this logic on the fact that these operations are shown on the same screen in the Azure Portal (numbers 2 and 3 in the screenshot):

Turns out while you can use az functionapp cors to modify the Origin URLs, you have to use a completely different command to programmatically enable the Access-Control-Allow-Credentials checkbox:
az resource update --name web --resource-group <resource group name> --namespace Microsoft.Web --resource-type config --parent sites/<function app name> --set properties.cors.supportCredentials=true
This is confusing.  Best case, I'd like to see a az functionapp cors --enable command added.  At the very least, a note should be added to the az functionapp cors documentation saying that az resource needs to be used to enable CORS, with the above command as an example.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 9a3961a2-da0c-5697-b52d-35c8e676537d
Version Independent ID: 3111fdd6-55ed-c1c8-7ac6-c4806a16945c
Content: az functionapp cors
Content Source: latest/docs-ref-autogen/functionapp/cors.yml
Service: functions
GitHub Login: @rloutlaw
Microsoft Alias: routlaw

functionapp

functionapp

@bertwagner thank you for this request. This is reasonable, we will have to review and prioritize this.

@bertwagner thank you for this request. This is reasonable, we will have to review and prioritize this.

Just to prevent other from wasting time. I am using:
funcappid=$(az functionapp create -n $app -g $grp -s $storage --consumption-plan-location $loc --runtime dotnet --functions-version 3 --app-insights $app --query id -o tsv)
az resource update --ids $funcappid/config/web --set properties.cors.supportCredentials="true"

Marking as resolved since this is now supported.


Fix on spaces Makefile

Fix for clarity in Makefile to remove extra spacings

/assign @jimangel

Thanks for the review @sftim

Thanks @EmilyM1
/approve


Remove list style for product lists on customer stories

Resolves styling for MWPW-119641
Test URLs:

Before: https://main--bacom--adobecom.hlx.page/jp/customer-success-stories/abematv-case-study?martech=off
After: https://bradjohn-stats-list-style--bacom--adobecom.hlx.page/jp/customer-success-stories/abematv-case-study?martech=off

@Brandon32  Updated with links. This is to address the list styles coming in after making an adjustment to how I import this particular section.
Before:

After:

Codecov Report

Merging #33 (261e7fa) into main (bd5c288) will decrease coverage by 5.80%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##              main      #33      +/-   ##
===========================================
- Coverage   100.00%   94.19%   -5.81%
===========================================
  Files            1        3       +2
  Lines           42      155     +113
===========================================
+ Hits            42      146     +104
- Misses           0        9       +9

Impacted Files
Coverage Δ

scripts/utils.js
93.18% <0.00%> (ø)

blocks/stats/stats.js
91.30% <0.00%> (ø)

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Cookies disclaimer

DESC

place a cookies disclaimer
github itself does not use cookies: https://github.community/t/cookies-if-i-use-github-pages-am-i-using-cookies/130249
might still be a problem because of third party software

TODOs

[x] implement

atm not of importance because no user information is being tracked / collected


Add Wireless adapter selection window

Due to the terribly obnoxious names Windows comes up with for wifi adapters, this needs to be added for windows support.

Done!


calls to push previous HistoryToken should call clearAction

App.pushHistoryToken

tests if given historyToken is equal to previous then pushes historyToken.clearAction

App.fireCurrentHistoryToken needs to set and clear previous around firing event listeners


authorityUri is unreachable

was able to get working with https://login.windows.net/common/oauth2/authorize/

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: bef3a0a2-7cc8-136e-eb8e-a80f4cade7d3
Version Independent ID: 20093c04-76cd-9266-e2f1-96c329da93c1
Content: Get an authentication access token - Power BI
Content Source: powerbi-docs/developer/walkthrough-push-data-get-token.md
Service: powerbi
Sub-service: powerbi-developer
GitHub Login: @markingmyname
Microsoft Alias: maghan

Hi, @ericoneal -- I've assigned your issue to the author. However, I think you'll be better off asking in the Power BI Community, https://community.powerbi.com/, or in Power BI Support, https://powerbi.microsoft.com/en-us/support/.
Good luck!

I didnt have a question, just noting that the uri in the sample code:  https://login.microsoftonline.net/common  was unreachable

Thanks for clarifying, @ericoneal! I've reopened it and assigned it to the author.

Try the following address instead: https://login.windows.net/common/

I get a 404 error when I visit that link, which is what prompted this thread.
I got it working here:  https://login.windows.net/common/oauth2/authorize/

@ericoneal,
Thank you for your feedback! We will investigate and review if we need to change/add the information suggested.

@ericoneal I am glad you got it working.
We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion, and we will reopen the issue.


Use a library for base64 encode

We can use this library https://www.npmjs.com/package/as-base64 and remove base64.ts file from our code

@Thykof It was a temporary work around. The TestNet 17 will remove the string in favor of a byte array.


Migrate away from MEF for loading DLLs in Windows PowerShell

PSScriptAnalyzer's .NET Framework builds depend on a lesser known technology called the Managed Extensibility Framework (namespaced to System.ComponentModel.Composition) to do a kind of lazy loading of assemblies for rules, presumably for custom rule sets.
This seems to be a kind of inversion of control framework, although we use it in a less typical way than a web server might:
https://github.com/PowerShell/PSScriptAnalyzer/blob/cfeb7d5f510763ba33a9a4ec73259d7d6ea86fdb/Engine/ScriptAnalyzer.cs#L930-L969
It also means that for rules to be discoverable they need to be decorated with attributes like here:
https://github.com/PowerShell/PSScriptAnalyzer/blob/cfeb7d5f510763ba33a9a4ec73259d7d6ea86fdb/Rules/AvoidGlobalFunctions.cs#L18-L20
All of that is fine, and it may be that PSScriptAnalyzer users are having success with it, but I'm not really sure if anyone is using it.
There are two problems:

We aren't using (and don't seem to need) MEF in PowerShell Core (it apparently has been ported, but it's not clear to what extent).
MEF loads assemblies differently to PowerShell

This problem raised itself in https://github.com/PowerShell/PSScriptAnalyzer/pull/1133, where a rule that depended on an external assembly, which in turn depended on a third assembly failed to load only in .NET Framework (and behaved differently across PowerShell versions).
The error looked like this:
System.Reflection.ReflectionTypeLoadException: Unable to load one or more of the requested types. Retrieve the LoaderExceptions property for more information.
   at System.Reflection.RuntimeModule.GetTypes(RuntimeModule module)
   at System.Reflection.Assembly.GetTypes()
   at System.ComponentModel.Composition.Hosting.AssemblyCatalog.get_InnerCatalog()
   at System.ComponentModel.Composition.Hosting.AssemblyCatalog.GetEnumerator()
   at System.Linq.Buffer`1..ctor(IEnumerable`1 source)
   at System.Linq.Enumerable.ToArray[TSource](IEnumerable`1 source)
   at Microsoft.Windows.PowerShell.ScriptAnalyzer.SafeDirectoryCatalog..ctor(String folderLocation, IOutputWriter outputWriter)
System.ComponentModel.Composition.CompositionException: The composition produced a single composition error. The root cause is provided below. Review the CompositionException.Errors property for more detailed information.
1) Could not load file or assembly 'Newtonsoft.Json, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=30ad4fe6b2a6aeed' or one of its dependencies. The located assembly's manifest definition does not match the assembly reference. (Exception from HRESULT: 0x80131040)
Resulting in: An exception occurred while trying to create an instance of type 'Microsoft.Windows.PowerShell.ScriptAnalyzer.BuiltinRules.UseCompatibleCommands'.
Resulting in: Cannot activate part 'Microsoft.Windows.PowerShell.ScriptAnalyzer.BuiltinRules.UseCompatibleCommands'.
Element: Microsoft.Windows.PowerShell.ScriptAnalyzer.BuiltinRules.UseCompatibleCommands -->  Microsoft.Windows.PowerShell.ScriptAnalyzer.BuiltinRules.UseCompatibleCommands -->  AssemblyCatalog (Assembly="Microsoft.Windows.PowerShell.ScriptAnalyzer.BuiltinRules, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=null")
Resulting in: Cannot get export 'Microsoft.Windows.PowerShell.ScriptAnalyzer.BuiltinRules.UseCompatibleCommands (ContractName="Microsoft.Windows.PowerShell.ScriptAnalyzer.Generic.IScriptRule")' from part 'Microsoft.Windows.PowerShell.ScriptAnalyzer.BuiltinRules.UseCompatibleCommands'.
Element: Microsoft.Windows.PowerShell.ScriptAnalyzer.BuiltinRules.UseCompatibleCommands (ContractName="Microsoft.Windows.PowerShell.ScriptAnalyzer.Generic.IScriptRule") -->  Microsoft.Windows.PowerShell.ScriptAnalyzer.BuiltinRules.UseCompatibleCommands -->  AssemblyCatalog (Assembly="Microsoft.Windows.PowerShell.ScriptAnalyzer.BuiltinRules, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=null")
Resulting in: Cannot set import 'Microsoft.Windows.PowerShell.ScriptAnalyzer.ScriptAnalyzer.ScriptRules (ContractName="Microsoft.Windows.PowerShell.ScriptAnalyzer.Generic.IScriptRule")' on part 'Microsoft.Windows.PowerShell.ScriptAnalyzer.ScriptAnalyzer'.
Element: Microsoft.Windows.PowerShell.ScriptAnalyzer.ScriptAnalyzer.ScriptRules (ContractName="Microsoft.Windows.PowerShell.ScriptAnalyzer.Generic.IScriptRule") -->  Microsoft.Windows.PowerShell.ScriptAnalyzer.ScriptAnalyzer
   at System.ComponentModel.Composition.CompositionResult.ThrowOnErrors(AtomicComposition atomicComposition)
   at System.ComponentModel.Composition.Hosting.ComposablePartExportProvider.Compose(CompositionBatch batch)
   at Microsoft.Windows.PowerShell.ScriptAnalyzer.ScriptAnalyzer.LoadRules(Dictionary`2 result, CommandInvocationIntrinsics invokeCommand, Boolean loadBuiltInRules)

At some point, the compatibility rule would depend on Microsoft.PowerShell.CrossCompatibility.dll, which in turn depended on Newtonsoft.Json.dll.
The first load would succeed, but the second would fail because it would only look for Newtonsoft.Json.dll in the directory of powershell.exe rather than in the same directory as Microsoft.Windows.PowerShell.ScriptAnalyzer.BuiltinRules.dll.
This was resolved by adding Add-Type $newtonsoftDllPath to ScriptAnalyzer.psm1.
This may not actually be due to MEF, but is worth investigating in any case. The DLL loading differences between Windows PS and PS Core are here:
https://github.com/PowerShell/PSScriptAnalyzer/blob/cfeb7d5f510763ba33a9a4ec73259d7d6ea86fdb/Engine/ScriptAnalyzer.cs#L930-L969

Thanks for providing those details. Very helpful, especially since I did not write the base of  PSSA and didn't know some of the details you described  :-)


UI not updating: BashV3 doesn't output until entire script is done

Environment

Server - Azure Pipelines
Agent - Private: macOS 10.13.6, agent 2.140.2

Issue Description
I am running the default cake bootstrapper: build.sh to build an app for Android and iOS.
I kick it off as follows:
- task: Bash@3
  displayName: 'Run CakeBuild'
  inputs:
    targetType: 'filePath'
    filePath: 'build.sh'

The task takes around 12 minutes to complete. However, in those 12 minutes I only get waiting for console output... so I can't see what is going on until the task is entirely done.

I have similar experience with other tasks. The auto refresh does not work properly. Have you tried to manually refresh the page? Sometimes it works for me...

The bash script sends data.  Likely something up with signal R / web UI updates.  Is this a solid repro for you?  Other tasks?  Build UI team should look

@bryanmacfarlane not super important to me. However, if I for instance have a iOS build that is not outputting anything on the screen for a while, then it will appear as if the task is not doing anything. The old lines from the output are not shown either if you come in and look at the log after it has been started, and such long running command in the script is running and not putting anything out for a while. In such cases you are staring at a blank screen.

I agree with @Cheesebaron : not the highest priority, but definitely something that could improve the user experience. Sometimes I have a browser tab open on a running pipeline and I do not realised it has finished unless I refresh the page.....

In the case of a visiting after a long running command has started the service recently changed to caching and showing the last 5 lines run to give context.  We’re also looking to improve.

@Cheesebaron we have made many improvements with the logs UI. If this is still an issue, please open a ticket on Azure DevOps Developer Community


Python remote debug support

Hello!
Are there any plans to introduce support for Python remote debugging in IDEs such as PyCharm and Visual Studio Code?

Hi, at the moment we are not working on any IDE plugins - but we welcome contributions :)

Hello @strobil, this sounds good to us, we will welcome your contribution. I think this feature should be disabled by default and enabled with a flag.

must have, develop with proper debugging capability is essential


Make program multithreaded and use less memory, add more cmd args

Use concurrent iterator for cycling through osm entries.
Use rolling buffer to drop data into file when X number of entries have been extracted.
Add a --out option for file out.

Thank you for your interest.
This crate is rather in maintenance mode, so I can’t really say when I’ll have time to spend on this issue, especially given that your need some tricky performance optimization.
The --out is more straightforward. Could you make a separate issue to track it. Do you mean the output format, or the output files (that would require --edges-file and --nodes-file or something in that direction)

For the parallelization, with your implementation in #37 we have an ~30% performance improvement. A nice start.
For the memory usage, this is more difficult: we need to parse all the data to count how many times the nodes are used. Unfortunately, the way OSM data in built, there is no situation where we can be sure that partial data is complete and could be dumped


Add custom methodology with variance field

This change is

Current dependencies on/for this PR:

main

PR #172   👈

This comment was auto-generated by Graphite.


Save to local storage

Save current canvas to local storage
Restore saved canvas when page load
Warning message when leave without save

Closes #17
Closes #18

Yes, that makes sense @vjeux

@vjeux  I'll work on this suggestions

How can we restore the state from local storage? I thought in the restore function return the state and then pass to App through props and set the state in the constructor, is it a good idea?

@paulomenezes I have added a comment, the restore function can be moved in the componentDidMount instead of constructor

Thanks so much for contributing, I just gave you access to the repo! Can't wait to see what cool stuff we're going to build together :)

I've just been using it for the past half hour and it's so awesome to have the current scene persist across reloads and while developing!

Is really nice!


Ligo on sidechain prototype 1 (single contract)

Proto 1: A single static contract that resends any money you send to it to me

[x] talk to ligo people about writing a function for compiling a string that doesn't require writing it to a file first
[ ] modify zinc interpreter to support ADTs

[x] products
[x] matching on sums
[ ] lists

[x] add operation for invoking contract
[x] implement get_contract_opt
[x] execute contract
[x] interpret contract's output (which will be to send money to me)
[ ] and then execute that too

We have Tunac compiler for this now.


Please Mongodb Connect!

Information

Version of Medoo:
Type of Database (MySQL, MSSQL, SQLite...):
System (Liunx\Windows\Mac):

Describe the Problem
A clear and concise description of what the problem is.
Detail Code
The detail code you are using causes the problem.
Expected output
A clear and concise description of what output you expected.

MongoDB is a key-value database, and Medoo is a PDO-based SQL database framework.
It's fundamentally different and impossible to support.
You can check out the list of MongoDB frameworks here: https://docs.mongodb.com/drivers/php-libraries/.


add japanese readme

Add Japanese readme file.
Add a hyperlink to japanese readme on readme file.

Hi @devinaconley san,
Would you please watch my #33 pull request?
This code pattern is very useful for Japanese developers.
So, I had translated the README.md file for them. :-)


LLL dependency

Couple things, the the LethalLevelLoader dependency is version 1.0.7 but only works with the latest update. Would it also be possible to have a downgraded version to 1.0.7 due to the LLL update and Lethal Expansion having compatibility issues. Other than that the mod is awesome, I love the look. Unfortunately I can't use this until LLL and LE stop being a dumpster fire

Can also confirm does not work on 1.0.7

Hi guys, I have the wrong LLL version in the manifest... Sorry about that :(
So I tested the mod with Lethal Expansion and it seems to work fine. How do I create the conflict so I can understand what is going on here? In the meantime, I will fix the manifest version to be the latest version of LLL.

It's to do with Custom Moons and them being managed from my knowledge, not dungeon's themselves. Batby away atm until 13th and LE looking for someone else to continue it's functionality.
LLL 1.0.8-1.1.4 fights with LE on handling CustomMoons, I don't think there's issue with vanilla moon/generation.
If you're not already, jump into the discord: https://discord.com/invite/XeyYqRdRGC
Love the interior btw <3

It will work if I use latest LLL and LE and load experimentation for example but modded moons from LE don't show on the terminal. If you swap for LE Core instead then moons will show but any custom dungeon spawn rates for vanilla(facility/mansion) stay default to the moons and modded dungeons don't spawn properly

Also this gets spammed in the console

 Also this gets spammed in the console

This doesn't always happen, just sometimes. I am investigating what it means.

 Also this gets spammed in the console

I'm trying to replicate this myself but haven't been able to. Tempted to put in LE back in to see if it does anything to it.

The latest might fix the console spam issue. Pretty sure it was this lingering Unity water component thingy that wasn't being used.

Closing as I have everything setup with the latest LLL and I think the issue is gone?


Hosted field error: INSTANTIATION_OPTION_REQUIRED

General information

SDK version: 3.77.0
Environment: Both local and production
Browser and OS Chrome 106.0.5249.103 (64-bit) on MacOS 11.6.1

Issue description
This issue is hard to reproduce since it barely happens, and works well in most cases. But sometimes, the Braintree hosted fields never load properly and prevent the user from inputting anything. The screenshot below show the error in the console.

This is the code to create hosted fields on our side.
import hostedFields from 'braintree-web/hosted-fields';

...

    hostedFields.create(
      {
        client: window.braintreeClientInstance,
        styles: {
          input: {
            'font-size': '16px',
            'font-family': typography.primaryFontFamily,
            color: '#ffffff',
          },
        },
        fields: {
          number: {
            selector: '#card-number',
            placeholder: 'Card Number',
            maxCardLength: 16,
            supportedCardBrands: {
              visa: true,
              mastercard: true,
              'american-express': true,
              discover: true,
              jcb: false,
            },
          },
          cvv: {
            selector: '#cvv',
            placeholder: 'CVV',
          },
          expirationDate: {
            selector: '#expiration-date',
            placeholder: 'MM/YY',
          },
        },
      },
      (err, clientInstance) => {
        if (err) {
          console.error(err);
          return;
        }
        setHostedFieldsInstance(clientInstance);
      }
    );

How is window.braintreeClientInstance being created? The error message is showing that the client is missing/not what was expected so something is causing it to not be ready for the rare times you see this issue, maybe some sort of race condition?
One suggestion is that you can switch to passing in authorization rather than client (docs here) which could circumvent any async problems

Closing this issue since we haven't heard back from OP.


Avoid panics

Do a full-scan of the repository to avoid explicit panics. Even though we usually use them in cases where critical invariants must hold, panicking is very aggressive for at least a graceful shutdown, even in non-recoverable errors.
Also, scan for dependencies (e.g: go-ipa) for the same.
We can do this getting closer to a stable implementation, and definitely before getting close to being fully integrated in geth since it can result in breaking some APIs returning errors instead of panicking.
cc @gballet

Yeah that's too many
~/s/go-verkle (master)> grep -r panic * | wc -l
29


docs: bit misspell AdvancedUsage conjunction Usage

Goals :soccer:

Improve readability.

Implementation Details :construction:

Handle potential minor misspell in AdvancedUsage.md
Remove conjunction see URLSessionTaskMetrics section in Usage.md
Testing Details :mag:
None.

Both of these are intentional and correct, but thanks anyway.


Pipeline correction and work item assignment correction

In this commit i have corrected Deployment groups pipeline corrections and work item assignment to the right team area for delivery plans templates

AB#3400 #3404


Add debounce to push

Avoid the duplicated push (first when the first change in the batch happen, one after the last change).
The side effect is that if a single change happens, it'll be delayed by 0.1 second.
If any other changes are picked in the 0.1s we'll keep delaying the push until 2 seconds have passed (both are configurable, we'll tune based on what we see while testing with various loads and changes).
The 2s is for safety, in case there is a continuous stream of changes - normally batches of changes (kubectl apply of multiple configs) finish faster.
Also addresses the verbose log @rshriram  mentioned on Slack.

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: costinm
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [costinm]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@costinm: PR needs rebase.

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: costinm
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

pilot/OWNERS [costinm]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: costinm
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

install/OWNERS [costinm]
pilot/OWNERS [costinm]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@costinm: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/e2e-bookInfoTests-v1alpha3.sh
526aa33dc3b876092db783888135f8f1644a4f20
link
/test e2e-bookInfo-envoyv2-v1alpha3

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@costinm: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/e2e-bookInfoTests-v1alpha3.sh
526aa33dc3b876092db783888135f8f1644a4f20
link
/test e2e-bookInfo-envoyv2-v1alpha3

prow/istio-pilot-e2e-envoyv2-v1alpha3.sh
c8a14e240799f492085f61ac90586233531c72c4
link
/test istio-pilot-e2e-envoyv2-v1alpha3

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.


[STYLED-COMPONENTS] - INTELLISENSE NOT WORKING

Does this issue occur when all extensions are disabled?: Yes/No

VS Code Version: March 2023 (version 1.77).
OS Version: Win 10 - Ver. 22H2.

Steps to Reproduce:

With the last VsCode version (1.77), the vscode-styled-components extension intellisense just stop working, ive been searching for a solution and i found out that this issue just happened before in some other versions and the solution was downgrade the VsCode version.

Here is the issue representation:

I just downgraded the VsCode to the previous version (1.76) and now all just works fine.

Image of intellisense working on VsCode 1.76:

Thanks for creating this issue! It looks like you may be using an old version of VS Code, the latest stable release is 1.77.0. Please try upgrading to the latest version and checking whether this issue remains.
Happy Coding!

Thanks for creating this issue! It looks like you may be using an old version of VS Code, the latest stable release is 1.77.0. Please try upgrading to the latest version and checking whether this issue remains.
Happy Coding!

Hi, this issue is only occurring in the latest release (1.77.0) of VsCode.
The error:

The version:

See https://github.com/microsoft/vscode/issues/178782#issuecomment-1492651359

This issue is caused by an extension, please file it with the repository (or contact) the extension has linked in its overview in VS Code or the marketplace for VS Code. See also our issue reporting guidelines. If you don't know which extension is causing the problem, you can run Help: Start extension bisect from the command palette (F1) to help identify the problem extension.
Happy Coding!


Catch uncommon or random errors for tier0 and tier1

Changes in API and analysis tests during last week made a shift in CI API E2E test suite stability. However some less frequent errors are still experienced for tier0.

## SOLVED: Hub API fails due to orphaned records in DB
Addressed with https://github.com/konveyor/tackle2-hub/pull/554/files

Analysis File system - Java IO
Tested with ~50x repeated local test execution. Testapp public analysis sometimes missing incident line 56 https://github.com/konveyor/go-konveyor-tests/blob/main/analysis/tc_tackle_testapp_public.go#L76-L80 at https://github.com/konveyor/tackle-testapp-public/blob/main/src/main/java/io/konveyor/demo/ordermanagement/config/PersistenceConfig.java#L56
RuleSet: "openshift",
Rule: "local-storage-00001",
File: "/addon/source/tackle-testapp-public/src/main/java/io/konveyor/demo/ordermanagement/config/PersistenceConfig.java",
Line: 56,

From 51 analysis test executions, got 35 PASS, 16 FAIL (always on missing incident line 56 ^, anything else).
Task pod logs are the same (except timestamps and order of Tags, but thats also different across PASS exections)
Debugging details at https://gist.github.com/aufi/1d073945b711de027c3ec423ee464390

Might be resolved by Pranav's PR replacing Testapp simple analysis test with the same app analysis with Maven repo dependencies.


Adapt the dns declaration to the usage of dns zones

Nice! Adding INGRESS_SERVICE_PORT_WEBSECURE to local.env.template.sh with some explanations and we're good to go

Already done.

Nice! Adding INGRESS_SERVICE_PORT_WEBSECURE to local.env.template.sh with some explanations and we're good to go

Nice! Adding INGRESS_SERVICE_PORT_WEBSECURE to local.env.template.sh with some explanations and we're good to go

Already done


Fix Translation PR

Somehow there is a apps.json instead of a language in there:
https://github.com/cstenglein/raspiblitz-web/pull/197/files#diff-2c5d7719e202a695876d100fc100c1c39cb4c733505243e9cacff8ab26797175

Thx :)


TryDuplicateBadTab and TryDuplicateBadPane unit tests are hanging when run locally

Environment
Windows build number: Version 10.0.18362.657
Windows Terminal version (if applicable): Commit 28d108bf32de4dce061d80a2bd160cd617c7e698
Steps to reproduce

Build the OpenConsole solution from a recent commit
Run the unit test with runut.cmd /name:*TabTests::TryDuplicate*

Expected behavior
The unit tests should execute successfully.
Actual behavior
The TestHostApp window opens up and the test then appears to be stuck. Closing the window manually doesn't help, but if you instead kill the TestHostApp process, it will at least continue with the rest of the tests.

That's not what you want to hear 😞. I wonder when this regressed - I'd bet it's the combo of #5051 with #5090, but I can't be sure ATM


[cpp] Update repo for 2.11.x support for clang-format PR

In preparation of PR'ing the clang-format plugin to Pants mainline

Turns out I didn't need to - PR going well over here: https://github.com/pantsbuild/pants/pull/15395


Ignores position and undecorated configuration

Hello, I know this package is fairly old but I've noticed that you are still active so I'll still raise this issue.
I do not know if it's SwayWM related or Galendae itself, but changing the position value in ~/.config/galendae/galendae.conf it ignores it and still spawns a window in the middle of the screen. And it does not matter if galendae is called from terminal, a launcher or by clicking in a status bar.
I do know that galendae does not ignore the configuration file itself as it changes the colors, fonts, etc.
# ~/.config/galendae/galendae.conf
undecorated=1
position=mouse
x_offset=0
y_offset=0

My system:
OS: Arch Linux x86_64
Kernel: 6.5.9-arch2-1
WM: sway

Could this be related to default swaywm window rules and I have to somehow force galendae's settings in window rules? Thank you

I think it 100% is an I apologize for raising this issue, resolved it easily with:
# ~/.config/sway/config
  for_window [app_id="galendae"] move position cursor
  for_window [app_id="galendae"] move down 30px


Error on websocket multi instance using redis-adapter

Hello,
I'm using the socket.io-redis-adapter with nestjs as explained here https://docs.nestjs.com/websockets/adapter to use multi instance of node
I have extended the NestGateway and using the
@WebSocketServer()
server: any;
to get the current server instance and added the method emitToNamespace to emit to the namespace as here
emitToNamespace(namespace: string, channel: string, data?: any) {
    this.server.server._nsps.get(namespace)?.emit(channel, data);
  }

The thing is it's working perfectly when there is only one server but when i'm using load balancer with multiple nest instance the message is not always received.
I have added a console.log inside the emitToNamespace to log the socket and look's like the server that receive the request only see the sockets from the current server as this function only return local server socket and not from the redis :
const socketsMap = this.server.server._nsps.get(namespace)?.sockets;

    if (!socketsMap) return;

    const socketIterator = socketsMap.values();

    for (let i = 0; i < socketsMap.size; i++) {
      const socket = socketIterator.next().value;

      console.log(`namespace ${namespace}/${channel} socket user`, socket.user);
    }

Has anyone know if i'm doing this good is the this.server is provived in a good way and is this going to emit properly and also get the global sockets ?
Thank you 😉

okay my bad I used the methods from socket.io api instance and now it's working
this.server.server.of(namespace);


"Current map" can lie to you

Description
Loaded in and the map was actually Pillar, not Bagel
This is probably caused by the map vote picking Bagel during the lobby which changes the "current map" even though Pillar was loaded in when the lobby actually started
The "current map" should probably really be "next map", and "current map" should use a different mechanism for figuring out what map is currently loaded

Additional context

Steps to reproduce:

Set server config map_rotation = false
Start server, join, and start round
Call a map vote
Start a second client and late-join the lobby
The current map will wrongly display as the next map from the vote

The also happens with game mode.  Repeat the steps with game mode vote and see the same results. The wrong/next game mode is also displayed on the Round End window. Not sure if we want to fix that as part of this or make a separate issue.
(I'm not sure if map voting is intended to work with map rotation, but the code looks like it ignores vote results with map rotation on. Should map voting be disabled if rotation is on?)


Specialzer

This is the PR for the specialisers: IPAM/VLAN
They use the condSDK and are executed in a controller as a local fn. This allows to reuse a lot of code and second to use the IPAM/VLAN fns as stubs in the test pipelines.

/retest

/lgtm


[DOC-3902] [PL-44174] Update key concepts

Update key concepts

Remove left nav from screenshots (future proof for new UI)
Revise text for conciseness

For reviewers, a preview is available:
Key concepts
What Type of PR is This?

[ ] Issue
[ ] Feature
[x] Maintenance/Chore

If tied to an Issue, list the Issue(s) here:

Issue(s)

House Keeping
Some items to keep track of. Screen shots of changes are optional but would help the maintainers review quicker.

[x] Tested Locally
[ ] Optional Screen Shoot.

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://65a8177390850a151a2b1a94--harness-developer.netlify.app

Brian, there are several diagrams (for most of the key concepts). Is that making it easy for someone who is trying to arguably get a quick overview?
Also, in my opinion, the order needs to be re-looked. For example, Projects is the most granular unit where users associate their resources to. If we define projects first, then orgs and then account, it might be easier for user to understand. Currently, projects mentioned in the description of orgs and account before the description of project.

Brian, there are several diagrams (for most of the key concepts). Is that making it easy for someone who is trying to arguably get a quick overview?
Also, in my opinion, the order needs to be re-looked. For example, Projects is the most granular unit where users associate their resources to. If we define projects first, then orgs and then account, it might be easier for user to understand. Currently, projects mentioned in the description of orgs and account before the description of project.

@harishkammanahalli Thank you for your review. Good points. I'll add a commit with your suggested changes.

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://65a8bc9233deb03e076b260a--harness-developer.netlify.app

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://65a8be30167fbf3c711a429d--harness-developer.netlify.app

@harishkammanahalli I made the changes and updated the preview in the Conversation tab.


Add mastercf_tail option

This option lets you append anything to the end of your master.cf. This
is particularly useful if you have some custom transports, or other
configurations that you need to make that aren't part of the module, and
don't make sense to add to the module because they are too site-specific.

#217 added the possibility to tune the content of master.cf. Closing this.