Windows: unable to install binary CLI module due to permissions error in CLI

Please answer the following questions before submitting your issue. Thanks!
What version of DC/OS + DC/OS CLI are you using (dcos --version)?
If DC/OS CLI version < 0.4.5, DC/OS version can be found at http://dcos_url/dcos-metada/dcos-version.json
C:\Users\nick\Downloads>dcos --version
dcoscli.version=0.4.10
dcos.version=1.8-dev
dcos.commit=87f744716be332be5347280508a4d197beeeedd6
dcos.bootstrap-id=20944ba7d8867a345b41ae50607a13b94b24f57f
What operating system and version are you using?
Windows 8.1
What did you do?
If possible please provide a recipe for reproducing.
install binary CLI module via 'dcos package install --cli kafka'
What did you expect to see?
binary CLI module installs successfully
What did you see instead?
C:\Users\nick\Downloads>dcos.exe
Command line utility for the Mesosphere Datacenter Operating
System (DC/OS). The Mesosphere DC/OS is a distributed operating
system built around Apache Mesos. This utility provides tools
for easy management of a DC/OS installation.

Available DC/OS commands:

        auth            Authenticate to DC/OS cluster
        config          Manage the DC/OS configuration file
        help            Display help information about DC/OS
        marathon        Deploy and manage applications to DC/OS
        node            Administer and manage DC/OS cluster nodes
        package         Install and manage DC/OS software packages
        service         Manage DC/OS services
        task            Manage DC/OS tasks

Get detailed command description with 'dcos <command> --help'.

C:\Users\nick\Downloads>dcos config set core.dcos_url https://gabriel-r-elasticl
-1kb545ofwxii2-442801080.us-west-2.elb.amazonaws.com/
[core.dcos_url]: set to 'https://gabriel-r-elasticl-1kb545ofwxii2-442801080.us-w
est-2.elb.amazonaws.com/'

C:\Users\nick\Downloads>dcos auth login
An SSL error occurred. To configure your SSL settings, please run: `dcos config
set core.ssl_verify <value>`
<value>: Whether to verify SSL certs for HTTPS or path to certs

C:\Users\nick\Downloads>dcos config set core.ssl_verify false
[core.ssl_verify]: set to 'false'

C:\Users\nick\Downloads>dcos auth login
gabriel-r-elasticl-1kb545ofwxii2-442801080.us-west-2.elb.amazonaws.com's usernam
e: bootstrapuser
<EMAIL_ADDRESS>.com's password:
Login successful!

C:\Users\nick\Downloads>dcos package install --cli kafka
Installing CLI subcommand for package [kafka] version [1.1.10-<IP_ADDRESS>]
Error installing 'kafka' package.
Run with `dcos --log-level=ERROR` to see the full output.

C:\Users\nick\Downloads>dcos package repo list
dev-universe: http://universe.marathon.mesos:8085/repo
Universe: https://universe.mesosphere.com/repo

C:\Users\nick\Downloads>dcos --log-level=DEBUG package install --cli kafka
MainThread: 2016-08-24 11:36:20,661 dcos\http.py:_request:87 - Sending HTTP ['ge
t'] to ['https://gabriel-r-elasticl-1kb545ofwxii2-442801080.us-west-2.elb.amazon
aws.com/capabilities']: {'Content-Type': 'application/vnd.dcos.capabilities+json
;charset=utf-8;version=v1', 'Accept': 'application/vnd.dcos.capabilities+json;ch
arset=utf-8;version=v1'}
MainThread: 2016-08-24 11:36:20,661 site-packages\requests\packages\urllib3\conn
ectionpool.py:_new_conn:758 - Starting new HTTPS connection (1): gabriel-r-elast
icl-1kb545ofwxii2-442801080.us-west-2.elb.amazonaws.com
MainThread: 2016-08-24 11:36:21,458 site-packages\requests\packages\urllib3\conn
ectionpool.py:_make_request:387 - "GET /capabilities HTTP/1.1" 401 None
MainThread: 2016-08-24 11:36:21,458 dcos\http.py:_request:117 - Received HTTP re
sponse [401]: {'Connection': 'keep-alive', 'Date': 'Wed, 24 Aug 2016 18:36:21 GM
T', 'Server': 'openresty/<IP_ADDRESS>', 'Content-Type': 'text/html; charset=UTF-8',
'Transfer-Encoding': 'chunked', 'WWW-Authenticate': 'acsjwt'}
MainThread: 2016-08-24 11:36:21,458 dcos\util.py:timer:529 - duration: dcos.http
._request: 0.80s
MainThread: 2016-08-24 11:36:21,458 dcos\http.py:_request:87 - Sending HTTP ['ge
t'] to ['https://gabriel-r-elasticl-1kb545ofwxii2-442801080.us-west-2.elb.amazon
aws.com/capabilities']: {'Content-Type': 'application/vnd.dcos.capabilities+json
;charset=utf-8;version=v1', 'Accept': 'application/vnd.dcos.capabilities+json;ch
arset=utf-8;version=v1'}
MainThread: 2016-08-24 11:36:21,474 site-packages\requests\packages\urllib3\conn
ectionpool.py:_new_conn:758 - Starting new HTTPS connection (1): gabriel-r-elast
icl-1kb545ofwxii2-442801080.us-west-2.elb.amazonaws.com
MainThread: 2016-08-24 11:36:21,599 site-packages\requests\packages\urllib3\conn
ectionpool.py:_make_request:387 - "GET /capabilities HTTP/1.1" 200 103
MainThread: 2016-08-24 11:36:21,599 dcos\http.py:_request:117 - Received HTTP re
sponse [200]: {'Server': 'openresty/<IP_ADDRESS>', 'Content-Length': '103', 'Content
-Type': 'application/vnd.dcos.capabilities+json;charset=utf-8;version=v1', 'Date
': 'Wed, 24 Aug 2016 18:36:22 GMT', 'Connection': 'keep-alive'}
MainThread: 2016-08-24 11:36:21,599 dcos\util.py:timer:529 - duration: dcos.http
._request: 0.14s
MainThread: 2016-08-24 11:36:21,615 dcos\http.py:_request:87 - Sending HTTP ['po
st'] to ['https://gabriel-r-elasticl-1kb545ofwxii2-442801080.us-west-2.elb.amazo
naws.com/package/describe']: {'Content-Type': 'application/vnd.dcos.package.desc
ribe-request+json;charset=utf-8;version=v1', 'Accept': 'application/vnd.dcos.pac
kage.describe-response+json;charset=utf-8;version=v2'}
MainThread: 2016-08-24 11:36:21,615 site-packages\requests\packages\urllib3\conn
ectionpool.py:_new_conn:758 - Starting new HTTPS connection (1): gabriel-r-elast
icl-1kb545ofwxii2-442801080.us-west-2.elb.amazonaws.com
MainThread: 2016-08-24 11:36:21,755 site-packages\requests\packages\urllib3\conn
ectionpool.py:_make_request:387 - "POST /package/describe HTTP/1.1" 401 None
MainThread: 2016-08-24 11:36:21,755 dcos\http.py:_request:117 - Received HTTP re
sponse [401]: {'Connection': 'keep-alive', 'Date': 'Wed, 24 Aug 2016 18:36:22 GM
T', 'Server': 'openresty/<IP_ADDRESS>', 'Content-Type': 'text/html; charset=UTF-8',
'Transfer-Encoding': 'chunked', 'WWW-Authenticate': 'acsjwt'}
MainThread: 2016-08-24 11:36:21,755 dcos\util.py:timer:529 - duration: dcos.http
._request: 0.14s
MainThread: 2016-08-24 11:36:21,755 dcos\http.py:_request:87 - Sending HTTP ['po
st'] to ['https://gabriel-r-elasticl-1kb545ofwxii2-442801080.us-west-2.elb.amazo
naws.com/package/describe']: {'Content-Type': 'application/vnd.dcos.package.desc
ribe-request+json;charset=utf-8;version=v1', 'Accept': 'application/vnd.dcos.pac
kage.describe-response+json;charset=utf-8;version=v2'}
MainThread: 2016-08-24 11:36:21,755 site-packages\requests\packages\urllib3\conn
ectionpool.py:_new_conn:758 - Starting new HTTPS connection (1): gabriel-r-elast
icl-1kb545ofwxii2-442801080.us-west-2.elb.amazonaws.com
MainThread: 2016-08-24 11:36:22,037 site-packages\requests\packages\urllib3\conn
ectionpool.py:_make_request:387 - "POST /package/describe HTTP/1.1" 200 39908
MainThread: 2016-08-24 11:36:22,068 dcos\http.py:_request:117 - Received HTTP re
sponse [200]: {'Server': 'openresty/<IP_ADDRESS>', 'Content-Length': '39908', 'Conte
nt-Type': 'application/vnd.dcos.package.describe-response+json;charset=utf-8;ver
sion=v2', 'Date': 'Wed, 24 Aug 2016 18:36:22 GMT', 'Connection': 'keep-alive'}
MainThread: 2016-08-24 11:36:22,068 dcos\util.py:timer:529 - duration: dcos.http
._request: 0.31s
Installing CLI subcommand for package [kafka] version [1.1.10-<IP_ADDRESS>]
MainThread: 2016-08-24 11:36:22,083 dcos\util.py:ensure_dir_exists:129 - Creatin
g directory: 'C:\\Users\\nick\\.dcos\\subcommands\\kafka'
MainThread: 2016-08-24 11:36:22,083 site-packages\requests\packages\urllib3\conn
ectionpool.py:_new_conn:758 - Starting new HTTPS connection (1): downloads.mesos
phere.com
MainThread: 2016-08-24 11:36:22,177 site-packages\requests\packages\urllib3\conn
ectionpool.py:_make_request:387 - "GET /kafka/assets/1.1.10-<IP_ADDRESS>/dcos-kafka.
exe HTTP/1.1"<PHONE_NUMBER>
MainThread: 2016-08-24 11:36:22,943 dcos\util.py:ensure_dir_exists:129 - Creatin
g directory: 'C:\\Users\\nick\\.dcos\\subcommands\\kafka\\env\\Scripts'
MainThread: 2016-08-24 11:36:23,021 dcos\subcommand.py:_install_with_binary:492
- [WinError 32] The process cannot access the file because it is being used by a
nother process: 'C:\\Users\\nick\\AppData\\Local\\Temp\\tmpepdgtcl_'
Traceback (most recent call last):
  File "shutil.py", line 523, in move
PermissionError: [WinError 32] The process cannot access the file because it is
being used by another process: 'C:\\Users\\nick\\AppData\\Local\\Temp\\tmpepdgtc
l_' -> 'C:\\Users\\nick\\.dcos\\subcommands\\kafka\\env\\Scripts\\dcos-kafka'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "dcos\subcommand.py", line 464, in _install_with_binary
  File "shutil.py", line 536, in move
PermissionError: [WinError 32] The process cannot access the file because it is
being used by another process: 'C:\\Users\\nick\\AppData\\Local\\Temp\\tmpepdgtc
l_'
Error installing 'kafka' package.
Run with `dcos --log-level=ERROR` to see the full output.

C:\Users\nick\Downloads>

This is possible due to Windows not letting you move a file that is open. Will verify and see if copying the file first fixes the issue.

fixed with #742


keep-a-changelog  does not mantain a changelog

;)

Personally I just use https://github.com/release-it/keep-a-changelog/releases for this.
Not using other tools for this myself, just the default git.changelog release-it option.

Totally understand the irony here, just don't have the time to maintain e.g. release-it plugins that well :)


Add information on checking for Delay Holds

I experienced an issue where I went through the steps to remove an In-Place Hold from a few mailboxes with a "full (100 GB in size) Recoverable Items folder, and was still not seeing a size decrease until I found this:
https://docs.microsoft.com/en-us/microsoft-365/compliance/identify-a-hold-on-an-exchange-online-mailbox?view=o365-worldwide#managing-mailboxes-on-delay-hold
Set-Mailbox  -RemoveDelayHoldApplied
Set-Mailbox  -RemoveDelayReleaseHoldApplied
Indeed, the commands are listed in Step 4 of this page but have no context to earlier checks.
Therefore, it may be beneficial to expand the checks in Step 1 to provide more useful output and clarify that the above commands are indeed needed with something like the following.
Get-Mailbox  | FL Hold
or
Get-Mailbox  | FL *HoldApplied
Thanks.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: aac0819e-2ed8-d57f-35f5-cfa5210210a9
Version Independent ID: 61bf03a8-091b-9a33-a7eb-a4a25e8452f3
Content: Delete items in the Recoverable Items folder of cloud mailbox's on hold - Microsoft 365 Compliance
Content Source: microsoft-365/compliance/delete-items-in-the-recoverable-items-folder-of-mailboxes-on-hold.md
Service: o365-seccomp
GitHub Login: @markjjo
Microsoft Alias: markjjo

@jmeddy Thanks for the feedback. To be clear, you're suggesting that steps/cmdlets to determine if delay hold is applied should be moved to Step 1 (Get- cmdlets). And Step 4 would be about removing those delay holds (Set- cmdlets). Is that correct?

@jmeddy Fixed. Added step about getting delayhold info in step 1 on gathering information and then focused step 4 on removing delay holds. Thanks again for feedback.


Long build time for Windows CI

I think adding the WindowCI as mandatory is a good move but at this time:

the build takes 2:20 hours to build (last one that passed)
we don't have a way to test it (IBM team has access to Mac/Linux x86 but not Windows). Would it be possible to make a virtual machine available to our team for us to develop when there are errors specific to Windows.

My personal preference would be to make the Windows CI mandatory once these two points are addressed.

@NathanielMcVicar @sstamenova please chime in here

While I understand the concern about latency here, I also feel that the purpose of the CI testing is to prevent broken code getting into the repo, so really all tests that we feel are useful should be mandatory.

While I understand the concern about latency here, I also feel that the purpose of the CI testing is to prevent broken code getting into the repo, so really all tests that we feel are useful should be mandatory.

It currently take 5x more time for the Window CI to complete as our other CIs.

The build runs on a free Microsoft hosted Windows VM pipeline. These are available to everyone, so shouldn't be a problem for IBM folks to access, but are very small (currently 2 Xeon E5-2673 vCPUs and 7 GB RAM), hence the long build times. More information is available here: https://docs.microsoft.com/en-us/azure/devops/pipelines/agents/hosted?view=azure-devops&tabs=yaml#faq. I think if we wanted faster Windows VMs to be part of the regular CI someone would have to provide them.

Considering that most PRs currently take on the order of days to get approved and committed, I think a 2-hour build is not much of a detriment to the process, while it will guarantee that there are no breaks that accidentally get checked in. I would like to see the Windows CI become required regardless of how long the builds take and then we can look at improving the build time.
I can spend some time next week to see what can be done about the build times, but again, I think the Windows CI should be required regardless.

Considering that most PRs currently take on the order of days to get approved and committed, I think a 2-hour build is not much of a detriment to the process,

Yes, I agree that a couple of hours does not seem to be a huge impediment

I can spend some time next week to see what can be done about the build times, but again, I think the Windows CI should be required regardless.

Does the Windows build cache the llvm part currently?

I can spend some time next week to see what can be done about the build times, but again, I think the Windows CI should be required regardless.

Does the Windows build cache the llvm part currently?

It does not, that's one of the improvements, but it would require a new pipeline to build just llvm because the free hosted agents are stateless.

I think this is a significant difference, the macOS and Windows GitHub CI builds don't and the macOS one also takes over an hour. The fast Jenkins CI builds use docker and have LLVM cached. I don't see any reason why the Windows build can't use a similar Docker Hub cache (in which case the stateless MS hosted Windows VMs wouldn't be an issue).

Considering that most PRs currently take on the order of days to get approved and committed, I think a 2-hour build is not much of a detriment to the process

Except that a PR is often built 5-10 times before its squashed, so lower times are clearly appreciated.
Also, smaller PR should be encouraged as they are easier to review, and this is building a disincentive to smaller PRs.

I don't see any reason why the Windows build can't use a similar Docker Hub cache

That would be great indeed. LLVM is very large, so it takes a large amount of time to build.

The build runs on a free Microsoft hosted Windows VM pipeline.

Could we ask you to add some instructions here on how to pull a docker image and run it on these free Windows VM? @gongsu832 has done very helpful work by having docker images stored for us to quickly test (without having to rebuild llvm, a big help, and even at time without rebuilding MLIR). Would be great to have similar instructions for Windows.
I am in favor to add Windows CI, as it shifts more work on our team, we should have the tools to perform this additional work.

I've never used a Windows container in Docker before, but I'm sure I can figure it out. :)

@sstamenova @NathanielMcVicar how is it going? We are really looking forward to the faster times.

@AlexandreEichenberger I apologize for my radio silence. I've been on leave, but I would like to take a look at this now, if the situation hasn't changed. Our current thought is to cache LLVM as an Azure DevOps pipeline artifact. I don't see any reason this won't work with the free builders in the documentation, but I haven't tried. We would then rebuild on any change to utils/clone-mlir.sh.

Would be great if you had a chance, and yes, its still taking significantly longer than the other builds.


Pinpoint-Docker installation failed while configuring Flink

What version of pinpoint are you using?
I am using docker version of pinpoint by cloning the repo
Describe your problem
Docker installation failed throwing error in  Flink configuration.
My docker version:
docker version
Client:
Version:      17.06.2-ee-6
API version:  1.30
Go version:   go1.8.3
Git commit:   e75fdb8
Built:        Mon Nov 27 22:44:50 2017
OS/Arch:      linux/amd64
Server:
Version:      17.06.2-ee-6
API version:  1.30 (minimum version 1.12)
Go version:   go1.8.3
Git commit:   e75fdb8
Built:        Mon Nov 27 22:43:44 2017
OS/Arch:      linux/amd64
Experimental: false
What have you done?
git clone https://github.com/naver/pinpoint-docker.git
Clone was successful.
i initiated docker-compose pull && docker-compose up -d
It prompted
"ERROR: Version in "./docker-compose.yml" is unsupported. You might be seeing this error because you're using the wrong Compose file version. Either specify a supported version (e.g "2.2" or "3.3") and place your service definitions under the services key, or omit the version key and place your service definitions at the root of the file to use version 1."
Commented out #version: "3.6" in docker-compose.yml
later we got
"ERROR: Invalid interpolation format for "jobmanager" option in service "services": "${FLINK_WEB_PORT:-8081}:8081""
Screenshots
Logs
Additional context

Hello, @sattishv
It looks like your docker version doesn't support your docker-compose version. Please try to install the docker which support docker-compose 3.6. To get more information on this, check out the documents in the official Docker homepage.
About followed format ERROR. I think it will be also taken care of when you install the supported version.

Hi team,
Thanks for the response. Will try with new version
Sattish.


Fix test_midway_ipp.ssh.slurm.config1.py test

I see the following error when running
python test_sites/test_midway/test_midway_ipp.ssh.slurm.config1.py
with the singleNode config:
Traceback (most recent call last):
  File "/Users/awoodard/software/anaconda3/envs/parsl_py36/lib/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
  File "/Users/awoodard/software/anaconda3/envs/parsl_py36/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/awoodard/ci/parsl/parsl/dataflow/flow_control.py", line 121, in _wake_up_timer
    self.make_callback(kind='timer')
  File "/Users/awoodard/ci/parsl/parsl/dataflow/flow_control.py", line 141, in make_callback
    self.callback(tasks=self._event_buffer, kind=kind)
  File "/Users/awoodard/ci/parsl/parsl/dataflow/strategy.py", line 162, in _strategy_simple
    status = exc.status()
  File "/Users/awoodard/ci/parsl/parsl/executors/ipp.py", line 253, in status
    status = self.execution_provider.status(self.engines)
  File "/Users/awoodard/ci/libsubmit/libsubmit/providers/cluster_provider.py", line 174, in status
    self._status()
  File "/Users/awoodard/ci/libsubmit/libsubmit/providers/slurm/slurm.py", line 141, in _status
    self.resources[job_id]['status'] = status
KeyError: '41784475_20'

Running
Spits out the following log:
INFO:parsl.dataflow.dflow:Task 18 launched on site Local_IPP_1
DEBUG:parsl.dataflow.dflow:Task 18 launched with AppFut:<AppFuture at 0x7f02d208f5c0 state=pending>
INFO:parsl.dataflow.dflow:Task 19 submitted for App python_app_2, waiting on tasks []
INFO:parsl.dataflow.dflow:Task 19 launched on site Local_IPP_2
DEBUG:parsl.dataflow.dflow:Task 19 launched with AppFut:<AppFuture at 0x7f02d208fda0 state=pending>
Waiting ....
Exception in thread Thread-3:
Traceback (most recent call last):
  File "/cephfs/users/dominic/.conda/lib/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
  File "/cephfs/users/dominic/.conda/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "/cephfs/users/dominic/.conda/lib/python3.6/site-packages/parsl/dataflow/flow_control.py", line 121, in _wake_up_timer
    self.make_callback(kind='timer')
  File "/cephfs/users/dominic/.conda/lib/python3.6/site-packages/parsl/dataflow/flow_control.py", line 141, in make_callback
    self.callback(tasks=self._event_buffer, kind=kind)
  File "/cephfs/users/dominic/.conda/lib/python3.6/site-packages/parsl/dataflow/strategy.py", line 162, in _strategy_simple
    status = exc.status()
  File "/cephfs/users/dominic/.conda/lib/python3.6/site-packages/parsl/executors/ipp.py", line 253, in status
    status = self.execution_provider.status(self.engines)
  File "/cephfs/users/dominic/.conda/lib/python3.6/site-packages/libsubmit/providers/cluster_provider.py", line 180, in status
    self._status()
  File "/cephfs/users/dominic/.conda/lib/python3.6/site-packages/libsubmit/providers/slurm/slurm.py", line 146, in _status
    self.resources[job_id]['status'] = status
KeyError: '16083'

INFO:parsl.dataflow.dflow:Task 1 completed
INFO:parsl.dataflow.dflow:Task 3 completed
INFO:parsl.dataflow.dflow:Task 5 completed
INFO:parsl.dataflow.dflow:Task 7 completed

While the queue at the time of execution is:
JOBID PARTITION     NAME     USER ST       TIME  NODES NODELIST(REASON)
16083  daenerys ICD_Enco   akumar  R 3-20:14:25      1 kg15-20
16264  daenerys dnaseq-a   thomas  R    2:05:47      1 kg15-21
16265  daenerys dnaseq-a   thomas  R    2:05:47      1 kg15-21

This only happens when the config has multiple defined sites, otherwise it's fine. It's only been tested on slurm, so it may or may not occur on other clusters. Notice the job ID that produces the key error does actually exist, but it's always the oldest job ID in the queue. Some of the engines do successfully execute jobs, but the script as a whole will never terminate.

The stategy module polls the status of all jobs periodically. Often this poll happens prior to the actual submission of jobs to the site. At this point when there are no jobs in the resources list, slurm returns counter-intuitive results when called with squeue --jobs .This returns all jobs instead of none, and that breaks the provider code with a KeyError.
I'm able to reproduce this issue. A fix is in testing.


Incorrect write operations into s3 storage

Describe the bug
There is a timeout in the drone.
In drone, the timeout occurs because the registry cannot replace/delete data in s3 when pushing a new image.
When debugging seaweedfs we found this:
14:45:48.998311 filer_delete_entry.go:79 deleting a folder /buckets/registry/docker/registry/v2/repositories/sandbox-dev-node/_uploads/909441e1-0daa-4b8c-9841-68bec38bf30d has children: hashstates ...
When we using the same setup but in linux fs itself - everything works perfectly.
No one errors found anywhere except seaweedfs.
System Setup
setup:
drone (2 runners)
docker-registry with image storage in s3 (seaweedfs)

OS version - Ubuntu 22.04 LTS
version 30GB 3.59 27b34f379 linux amd64
seaweedfs cluster runs under Nomad into docker

Commands to start each service:

    "master",
    "-mdir=/var/local/seaweedfs/master",
    "-peers=<IP_ADDRESS>:9333,<IP_ADDRESS>:9333,<IP_ADDRESS>:9333",
    "-ip=${meta.vlan}",
    "-ip.bind=<IP_ADDRESS>",
    "-volumeSizeLimitMB=1024",
    "-defaultReplication=010"

      "volume",
    "-mserver=<IP_ADDRESS>:9333,<IP_ADDRESS>:9333,<IP_ADDRESS>:9333",
    "-dataCenter=${node.datacenter}",
    "-rack=${node.unique.name}",
    "-ip.bind=<IP_ADDRESS>",
    "-dir=/var/local/seaweedfs/volume",
    "-ip=${meta.vlan}",
    "-port=${NOMAD_PORT_http}",
    "-port.grpc=${NOMAD_PORT_grpc}",
    "-idleTimeout=5",

      "filer",
    "-dataCenter=${node.datacenter}",
    "-master=<IP_ADDRESS>:9333,<IP_ADDRESS>:9333,<IP_ADDRESS>:9333",
    "-ip.bind=<IP_ADDRESS>",
    "-ip=${meta.vlan}",
    "-port=${NOMAD_PORT_filer}",
    "-s3",
    "-s3.port=${NOMAD_PORT_s3}"

if using filer, show the content of filer.toml

cat /local/filer.toml
[filer.options]
recursive_delete = true

[leveldb3]
enabled = true
dir = "/var/local/seaweedfs/filerldb3"

Expected behavior
docker-registry writes data correctly into s3 storage
Additional context
s3 setup:
{
  "identities":  [
    {
      "name":  "registry",
      "credentials":  [
        {
          "accessKey":  "secret123",
          "secretKey":  "secret12345"
        }
      ],
      "actions":  [
        "Read:registry",
        "Write:registry",
        "List:registry",
        "Tagging:registry",
        "Admin:registry"
      ],
      "account":  null
    },

docker-registry - latest version
seaweedfs - latest (ver 3.59)
drone - latest version

option
s3.allowEmptyFolder=false
does not resolve issue.
More verbose errors output:
I1129 11:09:02.082294 filer_delete_entry.go:79 deleting a folder /buckets/registry/docker/registry/v2/repositories/sandbox-dev-node/_uploads/2c53aa7f-dce7-45de-9b75-cccee4549466 has children: hashstates ...
I1129 11:09:02.082312 filer_delete_entry.go:41 delete directory /buckets/registry/docker/registry/v2/repositories/sandbox-dev-node/_uploads/2c53aa7f-dce7-45de-9b75-cccee4549466: fail to delete non-empty folder: /buckets/registry/docker/registry/v2/repositories/sandbox-dev-node/_uploads/2c53aa7f-dce7-45de-9b75-cccee4549466
I1129 11:09:02.083291 filer_delete_entry.go:79 deleting a folder /buckets/registry/docker/registry/v2/repositories/sandbox-dev-node/_uploads has children: 334adfdf-7021-4378-b382-fca94f46184d ...
I1129 11:09:02.083309 filer_delete_entry.go:41 delete directory /buckets/registry/docker/registry/v2/repositories/sandbox-dev-node/_uploads: fail to delete non-empty folder: /buckets/registry/docker/registry/v2/repositories/sandbox-dev-node/_uploads

Please try this:
s3.allowEmptyFolder=true

The issue was related to the incorrect behavior of the registry garbage collector, which was damaging some files during cleanup due to the use of the -m option (a flag --delete-untagged that removes unreferenced blobs).
Executing the following command was causing problems:

exec -it registry registry garbage-collect /etc/docker/registry/config.yml -m

There are several issues associated with -m option, and one relevant link is: GitHub Issue #3178.
The problem reported in this issue is that manifests stored in sub-repositories get deleted by garbage-collect with the -m flag, even though they are part of a fat manifest in the main repository.


Trigger for debug

[ ] Draft function that accepts trigger module parameters and generates the underlying registers
[ ] Draft functions that accept the trigger module data structs and maps these onto underlying register writes
[ ] Draft functions that accept the underlying register values and returns the trigger module data structs

https://sifive.atlassian.net/wiki/spaces/CIP/pages/331513894/SiFive+Debug+System

Possible Abstract Structure:
Record AbsStruct (A: Type) {
RegKind: Kind;
AbsKind: Kind;
fromAbs: AbsKind @# ty -> RegKind @# ty;
toAbs: RegKind @# ty -> AbsKind @# ty;
}

[ ] renamed numTriggers to lgNumTrigs

[ ] place aliases for StructPkt _ and StructRegPkt _ in FU.v


Do we need a --jsx flag set when --noEmit is on?

From https://twitter.com/drosenwasser/status/1022241336009715712
When using some sort of JSX syntax on a new project, we often get an error like
Cannot use JSX unless the '--jsx' flag is provided.

However, do we need this set in projects that have noEmit set? Given that some users will be interested in Babel
Pros

Marginally simpler setup for Babel users.

Cons

Makes it marginally harder to move off of Babel if desired.

The main issue for --jsx in general is module resolution. we use --jsx as a queue to look for .tsx and .jsx files. if we are ok with that, then we could just make it on all the time, and default to "React". the experience will be better this way for both JS and TS users.

The default is now preserve so this is moot


Use argument decomposition in log_histogram

seemed like a good use case for it

Codecov Report

Merging #3 into master will not change coverage.
The diff coverage is 0%.

@@         Coverage Diff         @@
##           master   #3   +/-   ##
===================================
  Coverage       0%   0%
===================================
  Files           7    7
  Lines          90   90
===================================
  Misses         90   90

Impacted Files
Coverage Δ

src/Loggers/LogHistograms.jl
0% <0%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 261356b...0f8f73f. Read the comment docs.

Makes sense. I did not know about that feature...
Thanks!


[Macros] Use macro expansion mangling for unique names in macros

Use the name mangling scheme we've devised for macro expansions to
back the implementation of the macro expansion context's
getUniqueName operation. This way, we guarantee that the names
provided by macro expansions don't conflict, as well as making them
demangleable so we can determine what introduced the names.

@swift-ci please smoke test

https://github.com/apple/swift-driver/pull/1281
@swift-ci please smoke test macOS

https://github.com/apple/swift-driver/pull/1281
@swift-ci please smoke test

@swift-ci please smoke test macOS


IEXQueryError: An error occurred while making the query (404): Not Found

Summary (include Python version): 3.7.7
Free account. None of the common usage examples work (https://addisonlynch.github.io/iexfinance/stable/usage.html#). I always get the following error:
IEXQueryError: An error occurred while making the query (404): Not Found
`>>> from datetime import datetime

from iexfinance.stocks import get_historical_data
start = datetime(2020, 7, 1)
end = datetime(2020, 7, 10)
key = ******using my public key here
df = get_historical_data('tsla',start,end,token=key)
`

Actual behavior

Confirmed on v0.5.0, on python v3.7.3

@cgates30 this was several months ago, but maybe this will help:
    _URLS = {
        "v1": "https://cloud.iexapis.com/v1/",
        "stable": "https://cloud.iexapis.com/stable/",
        "latest": "https://cloud.iexapis.com/latest/",
        "beta": "https://cloud.iexapis.com/beta/",
        "sandbox": "https://sandbox.iexapis.com/v1/",
        "iexcloud-beta": "https://cloud.iexapis.com/beta/",
        "iexcloud-v1": "https://cloud.iexapis.com/v1/",
        "iexcloud-sandbox": "https://sandbox.iexapis.com/v1/",
    }

According to the source code  here you can choose from these different API branches. I set my IEX_API_VERSION environment variable to point to stable, and it worked for my use-case (getting peer groups). Hope that helps.

    _VALID_API_VERSIONS = (
        "v1",
        "stable",
        "latest",
        "beta",
        "sandbox",
        "iexcloud-beta",
        "iexcloud-v1",
        "iexcloud-sandbox",
    )

to clarify for future visitors, youll want to set IEX_API_VERSION to one of those


Fix low-hanging HTML validation problems.

This fixes a bunch of small issues found by HTML validation with the validator.nu code. Most of them looked invisible but a handful had really been rendering wrong (e.g. “located in zulip_bots/bots//” in /api/running-bots).
You run a local copy of validator.nu with npm -g install validator-nu; java -jar ~/.local/lib/node_modules/vnu-jar/build/dist/vnu.jar. Perhaps we can eventually run it on a bunch of pages as part of linting?

@andersk Thanks for doing this!  I think we might want to split up the commits a bit, so that it's a bit easier to revert any changes that cause problems.  For any HTML change in the app that involves classes/data/ids, there's some danger that our jQuery code will break if we have brittle selectors (and we tend to have those in places).
I think having a single commit for each file might be overkill, but that might be the easiest way to split them.  It's also reasonable to break it up in terms of major areas.  For example, all the portico-related stuff.
Were you able to test things like the Drafts button?

Yeah, I tried to test everything—the Drafts button especially carefully, since it needed a tiny CSS tweak for pixel-accurate height parity with the other buttons.
I’ve split this into 11 commits by category. Let me know if I should split anything further.

Thanks!

@andersk I don't have time to review the direct changes this moment, but how fast is that tool?  We could potentially integrate it into tools/lint if it runs fast on a single file.

It might be good to have the commit messages have some explanation for why the changes are correct where it's not obvious (e.g. the "svg" commit I think falls into this category).
@showell feel free to merge pieces that look good to you from this.

Added the following explanation to the xmlns:svg commit:
xmlns:svg is an XML namespace declaration that would be valid in XHTML but not in HTML. Even in XHTML, it wouldn’t be necessary because we don’t write SVG tags prefixed like <svg:circle>, only unprefixed like <circle>.

My local validator-nu can validate about 20 pages per second, which is something like three times as fast as the Zulip dev server can serve them.

I just merged about half the commits, and did a push to update this PR to just have the remaining half.

I merged everything remaining but the type removal commit and "invalid attribute" commit.

For type removal, it appears it's required for HTML 4, but not HTML 5: https://stackoverflow.com/questions/4195427/is-the-type-attribute-necessary-for-script-tags
We should at least record that in the commit message.

Great, merged, thanks @andersk!
On whether to run this in our linter suite, check out how tools/lint --verbose works; if this tool is fast (or can run on just one template file), we could run it there; if it needs to interact with an actual website (rather than the templates), it might not be worth it to run in CI but we could hook it up the same way tools/test-api or tools/test-help-documentation works.

@timabbott Is this fully merged at this point?  (If so, I think you just forgot to close the PR.)

Oops, yes, closing.


MOB-1614 show enviornment on login page

@gwprice @BenjiLee
Just show environment on login page.   [in production , it won't show]

:+1: verify with screenshots.

I don't really know enough about Android to verify this. @aleffert would be a better choice for reviewer.

@aleffert   please see the attached image

Should we also show the version number in production?

@hanningni  We show this in the navigation drawer after user logs in. So, do we need to remove version name from there?

Looks good to me. Agree about factoring the string logic.

@hanningni

@BenjiLee
we haven't decided whether we should add feature to switch test environments at runtime or not.
also if we support this feature, should we turn it off on production or not.

@hanningni Should this be merged?

it is half done.  As we have some concern about the security for switching
different env.
I plan to discard this change.
On Wed, Apr 8, 2015 at 4:49 PM, Akiva Leffert<EMAIL_ADDRESS>wrote:

@hanningni https://github.com/hanningni Should this be merged?
—
Reply to this email directly or view it on GitHub
https://github.com/edx/edx-app-android/pull/158#issuecomment-91032993.

I don't think this change includes the different environment stuff? Just showing the current one?


Beam search is broken

Hi there!
I came across this library recently and looks exciting. I tried out a couple of examples and it works great. There are quite couple of libraries on GNN. But it seems to a comprehensive one thats focuses on NLP.
I also look a deeper with the NMT example and tried out translate with different beam size. But looks like beam search is completely buggy.
Beam search works for the top-1. But looks like when top_k > 1 does not work with beam_width > 1. Lets say the top-1 inference is “ABC”. Then top-5 candidate becomes:
Beam_width = 5, top_k = 5
“ABC”
“ABC” “XYX”
“ABC” “XYX” “BCD”
“ABC” “XYX” “BCD” “SUE”
.. so on and so forth

Beam-seach decoding should not work like this. It should keeps track of k states rather than just one. It should sort all candidate sequences in ascending order by their score and select the first k as the most likely candidate sequences. Here looks like it is just expanding on one candidate.

Thanks for your feedback. I think this is a bug and I will check it now.

@AlanSwift @hugochan @SaizhuoWang this is a serious limitation of the library. Would this be resolved for the library? Or is it a fundamental flaw in the library that beam-search would not be supported for the library.

@AlanSwift @hugochan @teddylfwu @SaizhuoWang  my feedback about the library:

I think the effort for the library is misdirected. For example, the library has severe bug like Beam search is broken. I think any Major bug should be prioritized as that completely limits the use of the library.

Even if I look into the current Roadmap, I see effort is seriously misguided. The only major feature I see is adding relational GNN support which is great. But what's the point of so many bookkeeping tasks like add a brand new configuration system based on OmegaConf. These are just busy work that does not do much for an average user of the library. I am pretty sure a lot of effort would then be directed just to modify/update existing examples and to use this new configuration system.

Unfortunately that does not do much for a typical user. No one really cares that you are using OmegaConf configuration library. What matters is adding actual useful feature into the library. And it is extremely important to ensure the features that are already into the library actually works and there is no bug. Lets say you added R-GCN and it is buggy. Then the priority should be to fix that bug instead of updating a configuration system.
If there is a major bug, there is no point of adding more and more features into the library. To summarize, for any software engineering tasks, there needs to be a balance between what is "actual feature" vs "doing chores" (like updating configuration system) which does not add much to the library.

Sorry for the late reply. I will handle this issue in this week. @ramsey-coding

I can't reproduce your bug.
This is the beam search results for NMT when K=3, beam=5:
Case 1:
ground truth:  and of course , we all share the same adap@@ tive im@@ per@@ a@@ tives .
top: 1's beam search: and of course , we all share the same adap@@ tation .
top: 2's beam search: and of course we all share the same adap@@ tation .
top: 3's beam search: and of course , we all share the same adap@@ t@@ ability .

Case 2:
ground truth:  we 're all born . we all bring our children into the world .
top: 1's beam search: we 're all born . we bring children to the world .
top: 2's beam search: we 're all born . we bring kids to the world .
top: 3's beam search: we 're all born . we get children to the world .

Case 3:
ground truth:  we have to deal with the in@@ ex@@ or@@ able separ@@ ation of death , so it shouldn 't surprise us that we all sing , we all dance , we all have art .
top: 1's beam search: we have to put ourselves with the un@@ stable separ@@ ation through death , and so we shouldn 't surprise us that we all sing , dance and art .
top: 2's beam search: we have to put ourselves with the un@@ stable separ@@ ation by death , and so we shouldn 't surprise us that we all sing , dance and art .
top: 3's beam search: we have to put ourselves with the un@@ stable separ@@ ation of death , and so we shouldn 't surprise us that we all sing , dance and art .

Case 4:
ground truth:  all of these peop@@ les teach us that there are other ways of being , other ways of thinking , other ways of ori@@ enting yourself in the earth .
top: 1's beam search: all of these people teach us that there are still other existence , other ways , other ways of con@@ gress on earth .
top: 2's beam search: all of these people teach us that there are still other existence , other ways , other ways of re@@ duc@@ ing on earth .
top: 3's beam search: all of these people teach us that there 's still other existence , other ways , other ways of re@@ duc@@ ing on earth .

Case 5:
ground truth:  to this day , they re@@ main rul@@ ed by a ritual pri@@ es@@ tho@@ od but the training for the pri@@ es@@ tho@@ od is rather extraordinary .
top: 1's beam search: until the next day , you 'll be treated by a ritual p@@ rie@@ stry . the education of p@@ rie@@ sts are very extraordinary .
top: 2's beam search: until the next day , you 'll be treated by a ritual p@@ rie@@ stry . the education of p@@ rie@@ sts is very extraordinary .
top: 3's beam search: until the next day , you 're going to be treated by a ritual p@@ rie@@ stry , the education of p@@ rie@@ sts is very extraordinary .

Case 6
ground truth:  his un@@ cle fl@@ ed with his hol@@ iness in the di@@ as@@ por@@ a that took the people to ne@@ p@@ al .
top: 1's beam search: his un@@ cle fle@@ w with their hol@@ iness in the di@@ as@@ por@@ a , people went to ne@@ p@@ al .
top: 2's beam search: his un@@ cle fle@@ w with their hol@@ iness in the di@@ as@@ por@@ a , and people went to ne@@ p@@ al .
top: 3's beam search: his un@@ cle fle@@ w with their hol@@ iness in the di@@ as@@ por@@ a , people to go to ne@@ p@@ al .

Case7
ground truth:  the can@@ adi@@ an government has not always been kind to the in@@ u@@ it people , and during the 195@@ 0s , to establi@@ sh our so@@ ver@@ eig@@ n@@ ty , we forced them into sett@@ le@@ ments .
top: 1's beam search: the can@@ adi@@ an government is not always very good with the in@@ u@@ it , and during the 50@@ th of our wealth , they were forced to pull in sett@@ le@@ ments .
top: 2's beam search: the can@@ adi@@ an government is not always very good with the in@@ u@@ it , and during the 50@@ th years of our wealth , they were forced to pull in sett@@ le@@ ments .
top: 3's beam search: the can@@ adi@@ an government is not always very good with the in@@ u@@ it , and during the 50@@ th of our wealth , they were forced to pull up in sett@@ le@@ ments .

The beam search's results for topk>1 seem ok. And actually, the beam search can obtain about 1.0 gain for BLEU4 metric.

The prefix is always the same in all the cases. Why is that?
Let's take the "ground truth:  to this day , they re@@ main rul@@ ed by a ritual pri@@ es@@ tho@@ od but the training for the pri@@ es@@ tho@@ od is rather extraordinary .
"
The predictions all starting with "until the next day".  This output suggest during prediction it is not keeping track of k states and rather than just one is used. It should not just expand on one candidate and should sort all candidate sequences in ascending order by their score and select the first k as the most likely candidate sequences.
top: 1's beam search: until the next day , you 'll be treated by a ritual p@@ rie@@ stry . the education of p@@ rie@@ sts are very extraordinary .
top: 2's beam search: until the next day , you 'll be treated by a ritual p@@ rie@@ stry . the education of p@@ rie@@ sts is very extraordinary .
top: 3's beam search: until the next day , you 're going to be treated by a ritual p@@ rie@@ stry , the education of p@@ rie@@ sts is very extraordinary .

The predictions look suspicious, isn't it?

Can you explain it?

There is no guarantee about the results' prefix.
This is an example:
1: A B C D
2: A B E F
3: C D E F
If the final score 1 > 2 >3，the 3 is dropped and 1 and 2 are reserved with the same prefix A B. The prefix is not guaranteed to be the same, This is just a natural result.
I suggest you dig into the beam search algorithm.


Update wmi-troubleshooting.md

From:
"The computer really doesn't exist The Windows Firewall is blocking the connection"
To:
"The computer really doesn't exist or the Windows Firewall is blocking the connection"

@hungtsetse : Thanks for your contribution! The author(s) have been notified to review your proposed change.


Dependabot is excluding (ignoring) the packages it's supposed to keep updated

Basic info:
Package ecosystem
pip
Package manager version
N/A
Language version
Python 3
Manifest location and content prior to update
N/A
Updated dependency
N/A
Native package manager behavior
N/A
Images of the diff or a link to the PR, issue or logs
https://github.com/andreagrandi/andreagrandi.it/pull/137/files
Previous behavior in Dependabot Preview:
Previously Dependabot was able to detect these upgrades are needed
Current behavior in GitHub-native Dependabot:
Now Dependabot is putting ipython, pelican and markdown in the ignore: section of .github/dependabot.yml and this (I suppose) will make them ignored by dependabot.

Hi @andreagrandi
The ignore file that was generated as part of the migration includes these packages along with specific version. This means only those specific releases will be ignored for purposes of your scheduled updates.
As part of the migration, we look at Dependabot Preview PRs that were closed rather than merged, e.g. https://github.com/andreagrandi/andreagrandi.it/pull/133
When a Dependabot PR is closed without merging, Dependabot will not re-attempt to create a PR to update to that version as it has either been rejected by the user or superseded.
As part of the migration, we place any versions in closed Dependabot Preview PRs in the generated updated config so GitHub-native Dependabot doesn't try to recreate anything that you have either rejected or has been recently superseded.
This should not affect any updates to ipython, pelican and markdown in future.

Thank you so much for your explanation Barry. I will go on and merge my PR then. I suppose once those packages will be upgraded, I will eventually be able to simplify the ignore: section and remove them from there, right?

That's right, yeah - once you have at least one new upgrade PR for them merged they can be removed entirely 👍🏻


Allow wands to have 0 xp regen and external xp control.

Realized there was already a getMana() method in Wand...


Added set_if_unset method for spark configuration

This allows us to safely avoid overwriting some settings.

:shipit:


F-secure malware protection going bonkers over Synctrayzor upgrade v.1.18.5

F-secures DeepGuard which is running on my system, blocks Syncthing v.1.18.5 (it attempted an automatic update yesterday). Is this a false positive or is Syncthing compromised?

Malware bytes has blocked Syncthing from accessing an IP that resolves to Russia on my computer: <IP_ADDRESS>

This is the SyncTrayzor issue tracker, and you're talking about Syncthing. Try https://forum.syncthing.net


Reduce Test Runtime in CICD

Describe the bug
CICD is failing and running out of free minutes due to long and unnecessary testing.
To Reproduce
Steps to reproduce the behavior:
Run tests in CICD
Expected behavior
A quick and sufficient completion of test cases.

Partially dealt with by: https://github.com/functime-org/functime/pull/175

Ciao! Now all tests pass (we skip the benchmarking ones). I still would like to shrink CI duration with #212, but that's another topic of discussion. Closing this. And thanks for taking care of it!


Give Chaosbot more github access

Chaosbot should be able to post it's own opinions into PR threads and down and upvote suggestiosn based on some chaotic algorithm.

I think random votes will kill it sooner or later, but that is up to the community to accept such a PR. Some more or less intelligent algorithm would be interesting.
In the end it could delete itself from github.

There's only one way to find out: merge.

What about starting with random bofh quote on rejected PR's?

maybe this could be done with some chatbot ai?
https://github.com/jasonhutchens/megahal
https://github.com/fossasia/susi_server

Just so that we're clear, Chaos can and does post comments on PRs, so access isn't the issue. You just need to submit (and get approved) a PR containing the changes you'd like to see.

i think chaosbot might be having a stroke


Closehandler not working in iOS when closeOnSelect is false

Using Select2 v4 on a testing site with the settings multiple: true and closeOnSelect: false. In testing, I've noticed that I can get the dropdown to close when clicking / tapping outside the dropdown area on all browsers except iOS. I've tested iOS 8 on an actual device, and iOS 6-7 via Browserstack. Desktop browsers Chrome, Safari, and FF seems to work, as does Android down to 4.
The only way I can get the dropdown to close on iOS is to click inside the input area - which I'm guessing is triggering a focus event?
I have a jsfiddle that replicates the issue - http://jsfiddle.net/m0wo6zp7/, which I've tested in Browserstack. I had a more stripped-down version of the jsfiddle to start with, where the click/tap-to-close functionality does not seem to be working across any browsers - http://jsfiddle.net/8g27t277/. The difference between the two is the number of additional div elements, so I'm wondering if this is related to how the container is targeted.
Also, if I comment out the following line in select2.full.js on my site, the click/tap-to-close functionality is removed on browsers where it previously worked:
self._attachCloseHandler(container);

I am experiencing this issue as well.


Allow parallel builds

I think this would just require running make -jN instead of make. It doesn't look like there's a way to specify a custom make command.

Could you try MAKE="make -j8" rake ...?

Ah, that works, thanks for the tip.

Ah, that works, thanks for the tip.

No problem. :-)

It should be documented somewhere.

It should be documented somewhere.

Could you send a pull request?


Suppress entity display in detail view based on annotation

Provide an annotation mechanism (or augment an existing one) so that table entities can hidden in the detail view.  In particular, suppress FK traversals for such tables, such that for any given table that is to be hidden/excluded, automatic queries for that data are not performed when a key relation to that table is encountered in another table.

Fixed in 8081be9c72.


i installed it as extension but it it not unlocking the premium courses

@hmm-star
Hello, this was for the old website, that's why I made it public...
I made a new one that currently works, but it's a private repo, and it's for educational purposes onl

can you [please share the repo with me ? i really need it

can you [please share the repo with me ? i really need it

Honestly, I don't have any intentions in sharing it right now, but you can reach me on whatsapp if you need help with anything specific

okay no problem if you can't share it
thank you for your time


(packaging) Test if mirroring config for task helpers fixes ship job

Got a different error (looks like it is from puppet-blacksmith which means we are getting that dep without explicitly requiring it in the gemfile). https://jenkins-master-prod-1.delivery.puppetlabs.net/job/forge-module_puppetlabs-manualadminjob_init-tag_generic-push-forge/130/console I think that might have to do with permissions pushing to the forge though? I remember there is a problem with first time push using these pipelines.

Template that calls the modules-build-step.sh script https://github.com/puppetlabs/ci-job-configs/blob/30edb2a0bbccc397a09fd1ed534f4c53e39d75e4/resources/job-templates/modules.yaml#L1346-L1367
It is erroring at https://github.com/voxpupuli/puppet-blacksmith/blob/775f582e500468d8896dfc9e22e96379a12d240e/lib/puppet_blacksmith/forge.rb#L43

For the ruby task helper we get the message:
15:54:44 Uploading to Puppet Forge puppetlabs/ruby_task_helper

where it looks malformed in the vault module:
11:45:29 Uploading to Puppet Forge Puppet, Inc./vault


Gabage when send to local plantuml web

I've run local plantuml server as described in official documentation.
I use java -jar plantuml.jar -picoweb command.
In plugin settings I set the server URL: http://localhost:8080.
I added to the note the following code:
```plantuml
@startuml
id1 -> id2
@enduml

After switching to read mode I've got the following....

Console:

Browser shows the correct image:

Found the problem, the PicoWeb server does not support image maps(for making links clickable) and instead returns an image, which will be converted to this weird text.
Will be fixed in the next update.

Rolling back to 1.1.2 will temporarily fix the issue.


Serveral improvements to move_to_map_pokemon

Parsing snipable and walkable Pokemon separately, and add two new attributes to pokemons: snipable, walkable
Making the bot keep walking to pokemon after sniping, but only when snipe_high_prio_only is set
When walking toward a pokemon, bot will not moving backward to spin pokestops (every pokestops in path must closer to the target comparing with current trainer position), which will eliminate potential infinite loop between close pokestops

@martixingwei Thank you for your work. Unfortunatelly, I'm pulling a request soon which will delete this old snipping system for a new one fully refactored. Although this can still be used if my request doesn't get approved, which I doubt. Anyways, for now please fix the 'map_path' attribute, which was deprecated in previous commits.

@YvesHenri Can you fix the get_nearest_fort_on_the_way function so that I can avoid making another PR? Also, I don't know the reason, but my sniping stopped working suddenly. All encounter status became 3 or 6 after sniping. (wild Pokemon are normal)

@martixingwei We're currently trying to restore the repo to it's lastest version. Untill then, I can't pull my request, but you can do pull yours. What's "stopped working" for you, btw?

@YvesHenri The sniping. My bot cannot encounter the sniped pokemon correctly. The encounter dictionary would be empty with status 3 or 6. But the encounters while bot walking are fine.

@YvesHenri The log looks like:
2016-09-14 11:15:56] [MainThread] [MoveToMapPokemon] [INFO] Encountered Pokemon: Dratini [2016-09-14 11:15:59] [MainThread] [MoveToMapPokemon] [INFO] Teleporting back to previous location (35.6753617949,<PHONE_NUMBER>34)... (My debug output here) {'ENCOUNTER': {'status': 3}}
where the correct encounter would be:
{'ENCOUNTER': {'status': 1, 'wild_pokemon': {'last_modified_timestamp_ms':<PHONE_NUMBER>563L, 'longitude':<PHONE_NUMBER>4614456, 'pokemon_data': {'move_1': 241, 'move_2': 95, 'pokemon_id': 111, 'height_m': 0.990321159362793, 'stamina_max': 116, 'weight_kg':<PHONE_NUMBER>2939453, 'individual_defense': 10, 'cp_multiplier': 0.667934000492096, 'stamina': 116, 'individual_stamina': 14, 'individual_attack': 11, 'cp': 799}, 'latitude': 35.67628807546485, 'spawn_point_id': u'60188bf3c01', 'encounter_id':<PHONE_NUMBER>7189509885L, 'time_till_hidden_ms': 817569}, 'capture_probability': {'capture_probability': [0.299430787563324, 0.4136234521865845, 0.509202778339386], 'pokeball_type': [1, 2, 3]}}}

@martixingwei You mean it teleports back but instead of catching the target (if exists) it just moves around? If that it, you can fix by changing the line that looks something like this:
                ```

if not pokemon['encounter_id'] or not pokemon['spawnpoint_id']:
pokemon['encounter_id'] = nearby_pokemon['encounter_id']
pokemon['spawn_point_id'] = nearby_pokemon['spawnpoint_id']

To this:

                    if not pokemon['encounter_id'] or not pokemon['spawn_point_id']:
                        pokemon['encounter_id'] = nearby_pokemon['encounter_id']
                        pokemon['spawn_point_id'] = nearby_pokemon['spawn_point_id'] # <----

Whereas 'spawn_point_id' is the correct attribute name that can't be None or '' by the time it encounters with it. There were some issues related to this, but again the repo was deleted and I couldnt pull a request for this. Fix it yourself for now. The new snipper is ready to go. :)


cannot import NLTKWordTokenizer

Should I install a specific version of NLTK?
when I run :
`import texthero as hero
import pandas as pd
df = pd.read_csv(
"dataset/bbcsport.csv"
)
df['pca'] = (
df['text']
.pipe(hero.clean)
.pipe(hero.tfidf)
.pipe(hero.pca)
)
hero.scatterplot(df, 'pca', color='topic', title="PCA BBC Sport news")`
I got this output:
[nltk_data] Downloading package stopwords to
[nltk_data]     /home/aistudio/nltk_data...
[nltk_data]   Unzipping corpora/stopwords.zip.
⚠ Skipping model package dependencies and setting --no-deps. You
don't seem to have the spaCy package itself installed (maybe because you've
built from source?), so installing the model dependencies would cause spaCy to
be downloaded, which probably isn't what you want. If the model package has
other dependencies, you'll have to install them manually.
✔ Download and installation successful
You can now load the model via spacy.load('en_core_web_sm')
---------------------------------------------------------------------------ImportError                               Traceback (most recent call last) in
----> 1 import texthero as hero
2 import pandas as pd
3
4 df = pd.read_csv(
5    "dataset/bbcsport.csv"
/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/texthero/init.py in
10 from .representation import *
11
---> 12 from . import visualization
13 from .visualization import *
14
/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/texthero/visualization.py in
7
8 from wordcloud import WordCloud
----> 9 from nltk import NLTKWordTokenizer
10
11 from texthero import preprocessing
ImportError: cannot import name 'NLTKWordTokenizer' from 'nltk' (/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/nltk/init.py)

Hey Wei, thank you for opening an issue!
By updating NLTK you should automatically solve the problem:
pip install -U nltk

I will fix this in the upcoming version. Please let us know if that worked.
Regards,

Sorry,it does not work.i had updated to NLTK-3.5
expect  for upcoming version

Ok. Will fix this shortly, already in a couple of hours, I guess.
Another question. If you fire up python3 and run
from nltk import NLTKWordTokenizer

Does it work?
I tried on my PC with NLTK 3.5 and it worked fine.

Version 1.0.9 has been released. This should have solved the issue. May you please check and let me know?
Thank you in advance!

Version 1.0.9 has been released. This should have solved the issue. May you please check and let me know?
Thank you in advance!

Many thanks, I will try it right now~~

Sorry,it does not work.i had updated to NLTK-3.5
expect for upcoming version

it worked! Thank you all!


Write unit tests for customizer

https://github.com/konveyor/move2kube/tree/master/internal/customizer

@pabloloyola After #100


DateTimeToStringValueConverter Not Available in Symfony2 Package

The value converter, Ddeboer\DataImport\ValueConverter\DateTimeValueConverter does not come with the Symfony2 composer download. Is there a reason for this? I am using Symfony 2.7.11 with bundle version ~0.1

Ah, that was introduced in an as of yet untagged version of the library. I’ll try to tag a new version shortly.

Sure do it :+1:

Released 0.19.0! Please note that a lot has changed since the last tag (most notably, Steps), so update with care.


Convert Tags to Labels

This supersedes pull request https://github.com/bosh-prometheus/firehose_exporter/pull/56 from another contributor.   PR 56 did not handle delta counters and contained broken tests.   I was not able to get a response from original contributor of PR 56 so this is a new PR that contains original changes plus above fixes.

Thanks @kkellner!


Sync prometheus operator dashboard and rules

Signed-off-by: Matteo Gazzetta<EMAIL_ADDRESS>
What this PR does / why we need it:
Which issue this PR fixes
(optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close that issue when PR gets merged)

fixes #

Special notes for your reviewer:
Checklist
[Place an '[x]' (no spaces) in all applicable fields. Please remove unrelated fields.]

[x] DCO signed
[x] Chart Version bumped
[x] Variables are documented in the README.md

/ok-to-test

/lgtm

@ElfoLiNk Could you please bump the chart version?

Done

Thanks!
/lgtm


Provide access to mempool information

Request
As a wallet developer, I would like access to the mempool so that I can more efficiently manage transactions.
Criteria:

A wallet doesn't have to wait until a block is mined to see inbound transactions because mempool information can be used, instead
A wallet can confirm that a transaction that it broadcast is present in the mempool
A wallet can confirm that a transaction that it broadcast is absent in the mempool

I have some concerns about how this will affect the wallet<->lightwalletd protocol's privacy properties. Unless lightwalletd is sending the entire mempool (high bandwidth?), the wallet will have to reveal which transactions it's interested in, or we'll have to use a private information retrieval scheme. It's okay to give up some privacy to lightwalletd for the MVP, but we should make sure that whatever mempool API we expose to wallets doesn't back us into a corner with privacy problems we can't get out of.
Is there a proposed way that this would work?
If the solution is to send a compact representation of the entire mempool, there's an opportunity for a DoS attack, since the mempool can contain up to 20,000 transactions (compared to blocks, which can contain about 725 Sapling transactions per block). An attacker could in theory make all 20,000 transactions in the mempool change frequently by having them all expire and resubmitting new ones.

I made a comment in #169, will mention and elaborate on it here too. To address the DoS concern, maybe the wallet should request a bloom filter of the mempool. That reply message is of limited and small size, and the wallet would be able to very efficiently determine that a given txid that it cares about is in the mempool (with high probability). It has perfect privacy properties since the lightwalletd is returning (a representation of) the entire mempool. It's true that a bloom filter can contain false-positives, meaning that a wallet may think a transaction is in the mempool when it isn't, but I believe that error (if the probability is small) is acceptable; the opposite error (wallet thinking a tx isn't in the mempool when it is) isn't possible, and that's good, because I'm assuming the wallet wants to know if a tx is in the mempool so that it can confirm to the user that it's a valid transaction (not necessarily valid against double-spends, of course, but at least first-level valid). Or that an expected incoming payment is indeed in the mempool.
Yes, it's possible that Alice tells Bob that she paid him (and gives him the txid), and he checks the mempool and it appears to him that she did, when she actually did not, but that's probably a rare situation, and besides, Bob should wait for at least one confirmation anyway. But the opposite case, where Alice tells Bob she paid him, and he says, "No you didn't!" (calling Alice a liar) -- that's not possible with this bloom filter approach.


Add pubspec line to each Flutter plugin README

Each Flutter plugin README should include a section that demonstrates how it should be added to a pubspec file for easy reference.  For example, notice how the README for this Android library shows how to include it in the build.gradle file:
https://github.com/square/picasso
This is useful for people who go straight to GitHub instead of dart pub.

CC @amirh @mklim @bparrishMines

We have this for a number of plugins (we need to audit to see if it's all of them), but they get stale. We should also ensure that the breaking version (major for 1.0+, minor for <1.0) matched what's in the pubspec.


graphql-shield + Apollo Federation

Question about GraphQL Shield
I've setup graphql-shield with a federated graph.
After the permission rule isAuthenticated returns an error, the resolver of the account service is hit but the data returned for the me query is null.
The expected behavior would be that the account service resolver is not hit and the error the permission rule is throwing is returned.
Does graphql-shield support federated graphs? Am I missing something in the implementation?
Server
const { ApolloServer } = require("apollo-server");
const { ApolloGateway } = require("@apollo/gateway");
const { applyMiddleware } = require("graphql-middleware");
const { formatError } = require("apollo-errors");
const { permissions } = require("./middlewares");

const gateway = new ApolloGateway({
  serviceList: [
    { name: "account-service", url: "http://localhost:4001/graphql" }
  ]
});

(async () => {
  const gw = await gateway.load();
  const { schema } = applyMiddleware(gw.schema, permissions);
  const { executor } = gw;
  const server = new ApolloServer({
    schema,
    executor,
    formatError
  });
  server.listen().then(({ url }) => {
    console.log(`🚀 Server ready at ${url}`);
  });
})();

Permissions
const { shield } = require("graphql-shield");
const Rules = require("./rules");

const permissions = shield(
  {
    Query: {
      me: Rules.isAuthenticated
    }
  },
  {
    allowExternalErrors: true,
    debug: true
  }
);

Rule
const { rule } = require("graphql-shield");
const Errors = require("../../../misc/errors");

const isAuthenticated = rule()(async (parent, args, context) => {
  return new Errors.NotAuthorizedError();
});

[x] I have checked other questions and found none that matches mine.

I've implemented authentication on the subservice level

@harri121 I am happy to hear that! Do you mind sharing your approach? I believe it could be of great benefit to other people trying out the same thing. I am sorry I couldn't get back to you any sooner.

@maticzav Sure
Approach
1⃣The gateway service fetches the user from the request auth token.
2⃣The user is then passed to the sub services via the request header.
3⃣Get the user from the request header in the sub service
4⃣Use the user in your permission rules
Gateway service
const { ApolloServer } = require("apollo-server");
const { ApolloGateway, RemoteGraphQLDataSource } = require("@apollo/gateway");

const gateway = new ApolloGateway({
  serviceList: [
    { name: "account-service", url: "http://localhost:4001/graphql" }
  ],
  buildService({ name, url }) {
    return new RemoteGraphQLDataSource({
      url,
      willSendRequest({ request, context }) {
        if (context.user) {
          // 2⃣pass the user to the sub service
          request.http.headers.set("user", context.user);
        }
      }
    });
  }
});

(async () => {
  const { schema, executor } = await gateway.load();
  const server = new ApolloServer({
    schema,
    executor,
    context: ({req}) => {
       //1⃣ get user from auth token
       return {
          user
       }
    }
  });
  server.listen().then(({ url }) => {
    console.log(`🚀 Server ready at ${url}`);
  });
})();

Sub service
const fs = require("fs");
const express = require("express");
const { ApolloServer, gql } = require("apollo-server-express");
const { buildFederatedSchema } = require("@apollo/federation");
const { applyMiddleware } = require("graphql-middleware");
const { permissions } = require("./middlewares");
const { resolvers } = require("./resolvers");

const typeDefs = gql`
  ${fs.readFileSync(__dirname.concat("/schema.graphql"), "utf8")}
`;

const schema = buildFederatedSchema([
  {
    typeDefs,
    resolvers
  }
]);

const schemaMiddleware = applyMiddleware(schema, permissions);
const server = new ApolloServer({
  schema: schemaMiddleware,
  context: ({ req }) => {
    // 3⃣get the user
    if (!req.headers["user"]) {
      return {};
    }
    const user = req.headers["user"];
    return {
      user
    };
  }
});

const app = express();
server.applyMiddleware({ app, path: "/graphql" });
app.listen({ port: 4001 }, () => console.log("Account service ready!"));

Thanks! Truly appreciated. 🙂

user

can you tell us more details about your first step ( get the user from token in gateway service)
did you add the repository process code in gateway service to load user from DB?
what i was thinking is there would be a sub-service like 'account' which will handle user's business.
this's post give me some inspirations
another confusion is if there is another sub-service like 'book', and there is a mutation is load 'myBooks', how to make the auth information be shared in both 'account' and 'book' resolvers, so that no need to load user data twice. use graphql-shield in each service and load user in each service looks silly. i think there must have a central auth service handle those staffs

@minzojian  I'm using RabbitMQ to request the user from the account service. I don't know if that's the ideal way but it works for my use case. Since I pass the user object to the sub services there is no need to query the user again in the permission rules of your sub services.

here is what i did so far,used some hack moves...
gateway service
    const gateway = new ApolloGateway({
      serviceList: [
//there are 2 sub-services, i use the first service as the auth service, handle user login staffs
        { name: "accounts", url: "http://localhost:4001/graphql" },
        { name: "schools", url: "http://localhost:4002/graphql" },
      ],
      buildService({ name, url }) {
        return new RemoteGraphQLDataSource({
          url,
          willSendRequest({ request, context }) {
            //sub-service can read the share context with gateway here
            if(context.user)
            {
              //i record the user model into header as a json string
              //cause so far i can not find another way to translate the data out expect via http headers
              request.http.headers.set('user',JSON.stringify(context.user));
            }
          },
        });
      },
    });

    (async () => {
      const { schema, executor } = await gateway.load();

      const server = new ApolloServer({ schema, executor,
        subscriptions: false,

        context: async ({req,res}) => {
          // get the user token from the headers
         const token = req.headers.authorization || '';

          // try to retrieve a user with the token
          //const userId = getUserId(token);
          if(token && req.body.operationName==null)
          {
          var a_login_request=`mutation {
            login(username:\"my_username\",password:\"my_password\")
              {
                status,
                user{username,id,name}
              }
          }`;

          try{
            let authReq={query:a_login_request,variables:req.body.variables}
            let result:any=await (gateway['serviceMap']['accounts']).process({request:authReq,context:{}})
            //direct call the process function over the account service
            //to invoke a login request and get the user data back
            return {user:result.data.login.user}
          }catch(error){
            console.error(error);
          }
        }
        return {};
        },
      });
    ...

account service resolver codes
...
{
    Query: {
      me(_,__,{user}) {
        return user;
      }
    },
    Mutation:{
      login(_,{username,password},context){
       //compared and return with specific values, just for testing
        if(username=='my_username' && password=='my_password')
          return {status:200,user:{username:'my_username',id:1,name:'hello'}}
        else
          return {status:500}
      },
    }
}...

school service
import { ApolloServer, gql } from "apollo-server";
import { buildFederatedSchema } from "@apollo/federation";

const typeDefs = gql`
  extend type Query
  {
    mySchool:School
  }
   extend type User @key(fields: "id") {
    id: ID! @external
    school:School
  }

  type School @key(fields: "schoolId") {
    schoolId: ID!
    schoolname: String
  }
`;
const getSchoolByUserId = (userId) => {
  var schoolInfo = students_2_schools.find(item => item.studentId === userId);
  if (schoolInfo) {
    return schools.find(school => school.schoolId === schoolInfo.schoolId);
  }
  return null;
}
const resolvers = {
  Query: {
    mySchool(_, __, { user }) {
      if(user)
        return getSchoolByUserId(user.id);
      return null;
    }
  },
  User: {
    school(user) {
      return getSchoolByUserId(user.id);
    }
  },
  School: {
    __resolveReference(object) {
      return schools.find(school => school.schoolId === object.id);
    }
  }
};

const server = new ApolloServer({
  schema: buildFederatedSchema([
    {
      typeDefs,
      resolvers
    }
  ]),

  //override context function to load the user data(json string) from request header,and decode it
  context: async ({ req, res }) => {
    const user = req.headers.user && JSON.parse(req.headers.user);
    if (user) {
      return { user }
    }
    return {};
  }
});
server.listen({ port: 4002 }).then(({ url }) => {
  console.log(`🚀 Server ready at ${url}`);
});

//////static data for testing/////////
const students_2_schools = [
  { studentId: "1", schoolId: "123" }
]

const schools = [
  {
    schoolId: "123",
    schoolname: "Cambridge"
  }
];

as you can see, i use the context function in schools service, also the same code appeared in account service,cause both services need read the possibility user data which set by the gateway service.
those are my current progress
this is my first day coding with graphql maybe will found some smart ways

@minzojian I'm using RabbitMQ to request the user from the account service. I don't know if that's the ideal way but it works for my use case. Since I pass the user object to the sub services there is no need to query the user again in the permission rules of your sub services.

 request.http.headers.set("user", context.user);

it looks can't set an object into header items, so i did json encode, later in sub-service context function,decoded it back to user object

@minzojian  @harri121 Would sending the user as a Http header would allow a malicious user to send a request to the sublevel service with the user in the headers to pretend to be that user?

@donedgardo I guess it would. My sublevel services can only be accessed from within my k8s cluster, that's why this solution is working for me. You can also set the Authorization header instead of the user directly and check for it in each sublevel service.

@donedgardo I guess it would. My sublevel services can only be accessed from within my k8s cluster, that's why this solution is working for me. You can also set the Authorization header instead of the user directly and check for it in each sublevel service.

@donedgardo Please please please don't do this. This is essentially the equivalent of relying on network security. Yes, the K8s network boundary is a lot easier to lock down, but if you're building a distributed system don't just take authentication as granted. Forward the auth header, or at least some sort of signed message


now when you hover over the icons in wallet page, will show text

Currently if you hover over the send button and edit contact button it doesn't show any text, but the export account does. This fixes it so the word send and edit contact will show over the hovers of the icons.

good catch! +5


ci: report workflow stats

Now only related changes in PR

not needed, just rebasing in previous one worked well.


feat: update replication and retention rules

What type of PR is this?
/kind feature
What this PR does / why we need it:

Adds a new 24 hours retention policy
Reduces non-current versions expiration for 3d and 7d policies
Adds a replication rule for all objects stored in the /archive

/priority important-longterm
/assign

/lgtm

/approve


add bedboss tests

I have changed a lot of things in bedboss, and new testing approach is needed.

Fixed in 0.3.0


Delete downtime once end_time has passed

https://www.agileplannerapp.com/boards/173808/cards/9233
we're using Sidekiq's perform_at to minimise the gap between downtime's end_time and the time that it gets deleted. this will ensure all information showed in Publisher related to downtimes is realtime. the other option is to use cron which will have to be run very frequently to achieve the same level of realtime. given there aren't many downtime objects running cron that frequently is not worth it.

@alext: fair points, addressed.


Split AnalysisContext concept for package configs and analysis options files

When the Dart Analysis Server is given a context root, it divides up the child directories into different AnalysisContexts, based on the presence of two different files:

a package config file, found at .dart_tool/package_config.yaml
an analysis options file, found at analysis_options.yaml

Any directory with one of these files defines a new AnalysisContext. In the presence of a package config file, we need to resolve into new element models, because a library at package:a/b.dart can resolve to two different files on disk. But not so for analysis options files. So any AnalysisContext created because of the presence of an analysis options results in a separate element model, with elements that are purely duplicate, identical to the ones in every other AnalysisContext which uses the same package config file.
We can separate the two concepts. I believe the following paradigm should work:

Every Dart library is associated with a package config. Typically it is explicit, defined by a .dart_tool/package_config.yaml file. A Dart library without any .dart_tool/package_config.yaml file in any of it's ancestor directories is associated with an implicit package config file, with a Dart Language Version of "2.12" (I think?) and an empty package map.
A package config maps to an AnalysisContext, which stores less than it used to; just package-config-y things.
Every Dart library is also associated with an analysis option set. It may be explicit, defined by a package_config.yaml file. If there is no package_config.yaml file in any of it's ancestor directories, it is associated with an implicit, "default" analysis options file. This might basically be today's AnalysisOptionsImpl class.

A note for priority: duplication of the element model across AnalysisContexts is likely a high cause of high DAS memory usage, but this may or may not reduce the duplication significantly for a typical user. We don't really have analytics to tell us.
CC @scheglov

One hang-up is that language experiments can be enabled in an analysis options file 😦  . I think this is an example of how an analysis options file can actually result in a distinct element model. Not a deal breaker, because this is an extremely little-used feature, I think mostly by the Dart team itself during feature development.
I propose we continue to split, but we read analysis options files when deciding if it amounts to a new AnalysisContext: if an analysis options file contains enabled experiments, it does; otherwise, it does not.

Also, we split a new ContextRoot for each Workspace.
A "workspace" here can be a PubWorkspace, with pubspec.yaml as a marker file.


setup docker & its instructions

Since Sparked will be distributed to different setup with different operating systems, we need a docker option that allows a smooth way to run a production version of this.

@OlivierJM Can you tell me more about the realm thing?

@OlivierJM I'm having trouble finding the Relam app I'd. Where can I get that?

Yeah sure I can help. But the thing is I don't know how to setup the realm app. I don't have the key so I can't run it in local.

@OlivierJM/sparked-next @.***> Please share the
.env file with him.
On Fri, 4 Oct 2024 at 11:08, Harsh Vardhan Pandey @.***>
wrote:

Yeah sure I can help. But the thing is I don't know how to setup the realm
app. I don't have the key so I can't run it in local.
—
Reply to this email directly, view it on GitHub
https://github.com/SparkEdUAB/sparked-next/issues/166#issuecomment-2393229792,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABCPXPP33G2HTX5L4FKTMOTZZZLH5AVCNFSM6AAAAABIUKOCJOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOJTGIZDSNZZGI
.
You are receiving this because you were mentioned.Message ID:
@.***>

--
[image: imuks.org]
Brian Mukuka
[image: https://]about.me/brianmuks
http://about.me/brianmuks

?


Asserion error on running python setup.py install

Hi,
I am getting this error on running python setup.py install
running install
Traceback (most recent call last):
  File "setup.py", line 49, in <module>
    graphical data."""
  File "/usr/local/lib/python3.7/site-packages/setuptools/__init__.py", line 129, in setup
    return distutils.core.setup(**attrs)
  File "/usr/local/lib/python3.7/distutils/core.py", line 148, in setup
    dist.run_commands()
  File "/usr/local/lib/python3.7/distutils/dist.py", line 966, in run_commands
    self.run_command(cmd)
  File "/usr/local/lib/python3.7/distutils/dist.py", line 985, in run_command
    cmd_obj.run()
  File "setup.py", line 22, in run
    assert len(lib_file) == 1 and len(install_dirs) >= 1
AssertionError

I found the solution. The setup.py had a correction to be made. The variable install_dirs has been initialized as install_dir.

I tried that but im still getting the same error, any ideas?

you can just copy the .so file to your python lib path, or you can add
install_dirs = [install_dir]
to initialize install_dirs as a list.

you can just copy the .so file to your python lib path, or you can add
install_dirs = [install_dir]
to initialize install_dirs as a list.

I was also struggling with this. @LeemeetElaine is completly right. Changing the code to this worked:
        install_dir = get_python_lib()
        install_dirs = [install_dir]

        lib_file = glob.glob(__library_file__)
        assert len(lib_file) == 1 and len(install_dirs) >= 1

        print('copying {} -> {}'.format(lib_file[0], install_dirs[0]))
        shutil.copy(lib_file[0], install_dir)

Then running:
sudo python3.6 setup.py install

I add install_dirs = [install_dir] but it still put the same error "AssertionError", I have struggled with pangolin in python for a day, tired.

@KunB-Fighting solution worked for me
just after install_dirs definition after install_dir
    def run(self):
        install_dir = get_python_lib()
        install_dirs = [install_dir]

running python setup.py install will copy the so file to my conda environment and then I used the demo application from the readme
note: I installed stevenlovegrove main pangolin before. I had a problem while building due to something missing dependency of eigen library but it was actually missing a dependecy for eigen3-devel in my system and it was not listed in the cmake

same error !!

@fsan @solbach

not sure what you need @harshitsinghcode, but you should probably look into the main branch and/or then try to contact the authors.
If the problem persists there, then you can collaborate with a patch to fix the problem

I mentioned you because u also had the same error!

I had this error because the build failed. I think it was trying to link the wrong python.
cmake .. -DPython_EXECUTABLE=which python3 -DBUILD_PANGOLIN_FFMPEG=OFF
Worked for me on python 3.10


Include README and all-file list in reviewer view

Closes https://github.com/datadryad/dryad-product-roadmap/issues/3631

@ahamelers what about point 4. Download option (same as dataset landing page); users can either select individual files for download or ALL files for download 5) Incorporate tabular data preview option (?)

what about point 4. Download option (same as dataset landing page); users can either select individual files for download or ALL files for download 5) Incorporate tabular data preview option (?)

@alinvetian these are done, the dataset display is now the same for the landing page and the reviewer (share) page, including the file download options available and any previews.


implement an ack tunnel mode

hello i just found out about gost tunnel when i was looking for any quic protocol tunnel , i din't expect to find any and thought i would have to write it from scratch , was pleasantly surprised  to find this software
i was wondering how hard it is to implement an ack tunnel as described by - Arne Vidstrom,
http://ntsecurity.nu/papers/acktunneling/
i haven't thought about the impact this will have on the tcp protocol if all the flag bits for every frame are all set as "ack" , also i have never written anything in golang , i would appreciate any pointers if you have on how best to implement it ,(maybe even as a hack )
the ack tunnel is interesting as most packet filters allow any tcp packet with the ack bit set right throught, as they assume that for the ack bit to be set the previous syn packet was approved and hence the packet was an earlier allowed packet , this can be exploited to make a covert tunnel on such networks
let me know what you think
thank you

It may require us to manually send RAW TCP bytes over IP layer or hack the Go net library (that is not a good idea). I think this will be very troublesome.

hello
i din't see your reply , do you think there will be sufficent interest in implementing this on gost as a covert tunnel as most packet filter have no way of detecting this

I think it should be an independent well-tested library, so it can be incorporated into gost quickly, but I have no time to do this, PR is welcomed.


Website not working

Describe the bug
The website just gives this netlify error

Reproduction
No response
System / Nuxt Info
No response

Thanks, should be fixed :)


Created a file for Swapping of two numbers using bit manipulation and…

… updated README.md

Have you read the Contributing Guidelines on Pull Requests?
Yes
Fixes #4426
Description
Added a file for Swapping of two numbers using bit manipulation, Reason being We all know that bit manipulation operators are faster than '+','-' and can lay heavy effects in which we have to repeat that task. Example: Usage in Bubble sort.
Checklist

[x] I've read the contribution guidelines.
[x] I've checked the issue list before deciding what to submit.
[x] I've edited the README.md and link to my code.

Related Issues or Pull Requests
(Write your answer here.)

@ankitaggarwal23  Sorry Sir I didn't know that, I have updated the comment and has added the issue number it is fxing , Could you please review it now. Thanks.


feat: Replace CustomTask with CallAwsService in GlueTransform stage

Feature or Bugfix

Refactoring

Detail

Replace CustomTask with CallAwsService in GlueTransform stage

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@LeonLuttenberger looks good, needs API.md added I believe.


Allow adding and removing tilesets to existing maps

Operation is aborted if tileset is contained within a TerrainType.
Removes references to tileset from TileGroups and the current map by setting indices to 0.

** This functionality will eventually need to be expanded for dealing with TerrainTypes.

I resolved the merge conflicts within GitHub and it only added a single commit in the process, which is good. I found GitHub's merge conflict resolution system intuitive. The only downside is that I cannot compile and check on the results before pushing the merge to the public.
I will try to resolve through TortoiseGit for the next Merge Conflict and see how it goes again.

I'm considering never merging this branch into master. A system that gracefully handles replacing tilesets needs to take into account the contents of TerrainRange, which may look a lot different than this solution.
I would like to leave this branch in place in case it is helpful to someone in the future.


I'm having a problem trying to install the Vue Cli : permission denied node-sass

Version
3.1.1
Node and OS info
linux mint 19 64 bit / node 11 / npm 6.4.1
Steps to reproduce
I'm having a problem trying to install the Vue Cli :

Unable to save binary /opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/node-sass/vendor/linux-x64-67 : { Error: EACCES: permission denied, mkdir '/opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/node-sass/vendor'
    at Object.mkdirSync (fs.js:768:3)
    at sync (/opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/mkdirp/index.js:71:13)
    at Function.sync (/opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/mkdirp/index.js:77:24)
    at checkAndDownloadBinary (/opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/node-sass/scripts/install.js:114:11)
    at Object.<anonymous> (/opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/node-sass/scripts/install.js:157:1)
    at Module._compile (internal/modules/cjs/loader.js:707:30)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:718:10)
    at Module.load (internal/modules/cjs/loader.js:605:32)
    at tryModuleLoad (internal/modules/cjs/loader.js:544:12)
    at Function.Module._load (internal/modules/cjs/loader.js:536:3)
  errno: -13,
  syscall: 'mkdir',
  code: 'EACCES',
  path:
   '/opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/node-sass/vendor' }

><EMAIL_ADDRESS>postinstall /opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/node-sass
> node scripts/build.js

Building: /usr/local/bin/node /opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/node-gyp/bin/node-gyp.js rebuild --verbose --libsass_ext= --libsass_cflags= --libsass_ldflags= --libsass_library=
gyp info it worked if it ends with ok
gyp verb cli [ '/usr/local/bin/node',
gyp verb cli   '/opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/node-gyp/bin/node-gyp.js',
gyp verb cli   'rebuild',
gyp verb cli   '--verbose',
gyp verb cli   '--libsass_ext=',
gyp verb cli   '--libsass_cflags=',
gyp verb cli   '--libsass_ldflags=',
gyp verb cli   '--libsass_library=' ]
gyp info using<EMAIL_ADDRESS>gyp info using<EMAIL_ADDRESS>| linux | x64
gyp verb command rebuild []
gyp verb command clean []
gyp verb clean removing "build" directory
gyp verb command configure []
gyp verb check python checking for Python executable "python2" in the PATH
gyp verb `which` succeeded python2 /usr/bin/python2
gyp verb check python version `/usr/bin/python2 -c "import sys; print "2.7.15
gyp verb check python version .%s.%s" % sys.version_info[:3];"` returned: %j
gyp verb get node dir no --target version specified, falling back to host node version: 11.0.0
gyp verb command install [ '11.0.0' ]
gyp verb install input version string "11.0.0"
gyp verb install installing version: 11.0.0
gyp verb install --ensure was passed, so won't reinstall if already installed
gyp WARN EACCES user "root" does not have permission to access the dev dir "/root/.node-gyp/11.0.0"
gyp WARN EACCES attempting to reinstall using temporary dev dir "/opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/node-sass/.node-gyp"
gyp verb tmpdir == cwd automatically will remove dev files after to save disk space
gyp verb command install [ '--node_gyp_internal_noretry', '11.0.0' ]
gyp verb install input version string "11.0.0"
gyp verb install installing version: 11.0.0
gyp verb install --ensure was passed, so won't reinstall if already installed
gyp verb install version not already installed, continuing with install 11.0.0
gyp verb ensuring nodedir is created /opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/node-sass/.node-gyp/11.0.0
gyp WARN install got an error, rolling back install
gyp verb command remove [ '11.0.0' ]
gyp verb remove using node-gyp dir: /opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/node-sass/.node-gyp
gyp verb remove removing target version: 11.0.0
gyp verb remove removing development files for version: 11.0.0
gyp WARN install got an error, rolling back install
gyp verb command remove [ '11.0.0' ]
gyp verb remove using node-gyp dir: /opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/node-sass/.node-gyp
gyp verb remove removing target version: 11.0.0
gyp verb remove removing development files for version: 11.0.0
gyp ERR! configure error
gyp ERR! stack Error: EACCES: permission denied, mkdir '/opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/node-sass/.node-gyp'
gyp ERR! System Linux 4.15.0-38-generic
gyp ERR! command "/usr/local/bin/node" "/opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/node-gyp/bin/node-gyp.js" "rebuild" "--verbose" "--libsass_ext=" "--libsass_cflags=" "--libsass_ldflags=" "--libsass_library="
gyp ERR! cwd /opt/lampp/htdocs/crud-ajax-simples-b3/exemplo/node_modules/node-sass
gyp ERR! node -v v11.0.0
gyp ERR! node-gyp -v v3.8.0
gyp ERR! not ok
Build failed with error code: 1
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR<EMAIL_ADDRESS>postinstall: `node scripts/build.js`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>postinstall script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR!
I Tried:
chmod -R 777 ...
or
https://docs.npmjs.com/getting-started/fixing-npm-permissions
What is expected?
install vue cli
What is actually happening?
permission denied node-sass

Well, while I'm sorry that you're having trouble with this. even if you tried all of those proposed solutions, it's still a permissions problem with npm, not a problem with vue-cli. So I don't see how we can solve this problem in this repository.
You can ask for help on our forum at https://forum.vuejs.org or stack overflow.

same problem


Support StableReferenceRelationship

What
Support the query of https://github.com/OpenAssetIO/OpenAssetIO-MediaCreation/blob/5bbac622eb13f97a134a5886212fc286ffaed288/traits.yml#L310
Why
Allows us to demonstrate the replacement to finalizedEntityReference

WIP https://github.com/foundrytom/OpenAssetIO-Manager-BAL/tree/work/83-stableRef


Require Stream Analytics Query Tester role at subscription scope

To use this Process-data feature, Stream Analytics Query Tester role (https://www.azadvertizer.net/azrolesadvertizer/1ec5b3c1-b17e-4e25-8312-2acb3c3c5abf.html) is required at given subscription scope, which allows user to perform query testing without creating a stream analytics job first. Otherwise it throws unauthorized error.
Example:
The client<EMAIL_ADDRESS>with object id '' does not have authorization to perform action 'Microsoft.StreamAnalytics/locations/sampleInput/action' over scope '/subscriptions/' or the scope is invalid. If access was recently granted, please refresh your credentials

@Amitchauhangit : Thanks for your contribution! The author(s) have been notified to review your proposed change.

#label:"aq-pr-triaged"

@Amitchauhangit - Thanks for bringing this to our notice. I am working with another content developer to have the following article updated with a section for this role: https://docs.microsoft.com/en-us/azure/role-based-access-control/built-in-roles. Once that's done, I will request you to update the link in your change to point to the section in the above article. I am also trying to confirm with the Stream Analytics product team on whether the user needs to be added to the role at the subscription level. Thanks.

@Amitchauhangit - I have confirmed with the product team that what you observed and documented is correct.
"User must be a member of the Stream Analytics Query Tester role at the Azure subscription level. This role allows user to perform query testing without creating a stream analytics job first."
Could you please update the statement and remove the link to the external site? I will merge this PR and then add the link to the section that the other content dev will be adding to the central RBAC article. Thanks.

@Amitchauhangit - Here's the link to the role in our documentation now:
https://docs.microsoft.com/en-us/azure/role-based-access-control/built-in-roles#stream-analytics-query-tester
Could you please update the statement and upload the changes?
"User must be a member of the Stream Analytics Query Tester role at the Azure subscription level. This role allows user to perform query testing without creating a stream analytics job first."

@Amitchauhangit : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Thanks @spelluru for the updated link.

[!IMPORTANT]
If you aren't a member of owner or contributor roles at the Azure subscription level, you must be a member of the Stream Analytics Query Tester role at the Azure subscription level to successfully complete steps in this section. This role allows you to perform testing queries without creating a stream analytics job first. For instructions on assigning a role to a user, see Assign AD roles to users.

#please-close


README.md updates for Mac Installs

added Mac OS X specific installation instructions to the top-level README.md file.

Can one of the admins verify this patch?

"ok to test" to accept this pull request for testing
"test this please" for a one time test run
"add to whitelist" to add the author to the whitelist

Can one of the admins verify this patch?

"ok to test" to accept this pull request for testing
"test this please" for a one time test run
"add to whitelist" to add the author to the whitelist


Host API publicly

Hi @keenanjohnson, I'd like to host this API so our data is publicly queryable, which will let us query it from the dashboard! It looks like we're using platform.sh for the dashboard, so (as long as it doesn't cost us any more money) can we add this project there too? You'll need to copy over the environment variables from .env into the .platform.app.yaml file... you might also want to store INFLUXDB_AUTH_TOKEN privately if platform.sh supports that.

Hey @brianstrauch ! Thanks for reaching out!
I can check with the platform folks to see! I didn't realize this was in a state where it was deployable quite yet.
Thanks for reaching back out!


openunison  auditing / events publisher

Hello,
Is there a way for me to set an endpoint where all token creation request are being pushed/
Can I have something like {date: today- at -this hour-minute , user: mihai, action: create token}
Thank you

hmm, if you want to log every token that would generate a LARGE amount of traffic.  Since we generate short lived tokens those tokens are generate often.
Also, there's no standard for such a webhook so I'm a bit wary of putting that in place.  Also worried about potential performance vs security implications.
What if we gave you the option to generate a log event whenever a token is created?

Thanks Marc,
What if we gave you the option to generate a log event whenever a token is created?
-> This is what i was looking for (my Sec team)