Linux: Use Vulkan/CUDA interop in NVENC encoder

Confirmed working here with a 3090 on Ubuntu 22.04, X11, Pico 4.

This is with quality preset P2, with P1 you can probably go near 2ms encode latency now. When we started this, it was around 25ms. Big improvement.
Huge thanks again @nowrep !

Tested and merging.


Call flushSync if too much data buffered

If the output can't keep up calling async flush will just make things bad and register a lot of drain handlers in ´callFlushCallbackOnDrain´.
If we get to this point we should somehow force some throttling either through some kind of write/flush sync or a spin loop.

I'm doing something like this atm:
stream = pino.destination({ sync: false, minLength: 4096 })
let flushing = 0
setInterval(() => {
  if (flushing > 8) {
    logger.flushSync()
  } else {
    flushing++
    logger.flush(() => {
      flushing--
    })
  }
}, flushInterval).unref()

This was partially implemented with retryEAGAIN(err, writeBufferLen, remainingBufferLen)  which allows to skip a buffer if the target resource is busy and no more can be written to it... which you might not be hitting yet.
Did you implement that workaround becaude you experienced some OOM crash?

Did you implement that workaround becaude you experienced some OOM crash?

Correct.

I think we might need some more guidance in the docs around async mode and this. Not quite sure what that would be though.

Would it make sense to have a "maxLength" in addition to "minLength" which indicates an automatic flush?

I would not do an automatic flush because it might cause writing data out of order, it's unlikely but there is a race condition.
If you are not logging on Docker, raise minLength to a few megabytes, and see how it performs.
In your case, I would operate it sync with an even higher minLegth.


Bump Dependencies #2409882610

Bumps dependencies for product-is. Link : https://github.com/wso2/product-is/actions/runs/2409882610

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.jenkins-is-staging seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


Public Suffix List as a package

Issue summary
Are there plans to release Public Suffix List as a Composer package?

Hi @szepeviktor sorry but I fail to understand your question. The list does not need any package as it is maintained and made publicly available by Mozilla. Or you are thinking of something else 🤔

When I use php-domain-parser I need to set up a mechanism to update the list.
We could release the list as a Composer package with weekly updates.

Previous versions of the package use to offer a cache mechanism. It was removed because the cache was never in sync with the Mozilla list or with the application settings. If you implement the new caching system as explain in the doc you should tbe fine.
Also there's a companion package for Laravel which can be set for doing jist that.

I am talking about making the cache mechanism unnecessary by releasing the list as a package.

That's a bad idea because it gives a false sense a accuracy

as an example see how the laravel package manage what you are asking:
https://distortedfusion.com/docs/kevindierkx/laravel-domain-parser/getting-started#configuration
to me that's how you should do it. Because you get the full control over the cache and when and how to update it. And since the integration is done on the. application level on daily usage you can completely forget about the cache and the copy.

Okay. So you are against publishing the list as a package.


update(build): update to falcoctl 0.6.0

What type of PR is this?

Uncomment one (or more) /kind <> lines:

/kind cleanup

Any specific area of the project related to this PR?

Uncomment one (or more) /area <> lines:

/area build

What this PR does / why we need it:
Update to the latest released version
Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: LucaGuerra
Once this PR has been reviewed and has the lgtm label, please assign leogr for approval. For more information see the Kubernetes Code Review Process.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: leogr, LucaGuerra
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [leogr]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

LGTM label has been added.  Git tree hash: ef09214d4e38846ea7354540174042e0e8dd0325


Add call to getPageContext in prefetch

Hey @brillout, this is a draft PR for fetch page context along with fetching static files (#246). I'm looking for feedback on how to incorporate the config for such behavior.

Hi @archit-p, I'm glad you're taking a stab at this 👍.
As you can imagine I'm quite busy with the V1 Design: even though pageContext prefetching can have a big impact it isn't my top priority right now.
I'm more than open to review a PR, but I'll only do so for a full-fledged attempt at this.
If you want, we can close this, or mark it as a draft PR.
Also, in case your company is up for it: https://github.com/sponsors/brillout. Feature requests of sponsors have much higher priority.

I understand @brillout.
I can give this a full-fledged attempt, just thought it’ll be better to check if I’m in the right direction. I’m closing this PR while I work on it.
I’m using this project for a personal project. Thanks for your continued work on making it better!

@archit-p 👍 Looking forward to it 👀.


Fix 164

Resolve #164
Ensure that missing modifier is always defaulted even if the a address is missing.
Added some funky new regression/integration test code!

Was slightly disappointed at the lack of actual funk in the test code :(


404 upon npm install, v4.14.1/linux-arm64-83_binding.node

Getting Cannot download "https://github.com/sass/node-sass/releases/download/v4.14.1/linux-arm64-83_binding.node": HTTP error 404 Not Found - upon npm i node-sass on a Raspberry Pi 4 running Ubuntu Server 20 latest (openbox). Is this pointing to a non existing release?

ARM is not supported by node-sass. You can try not install node-sass --force to compile the binary locally but you'll need the C++ build chain. I suggest try dart sass.

Weird thing is the other day I installed it on Raspian OS which worked fine? It now failed on Ubuntu Server though. How come?


[Bug]: 2 nodes serving hanging

Your current environment

The output of `python collect_env.py`
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A

OS: Ubuntu 20.04.6 LTS (x86_64)
GCC version: (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0
Clang version: Could not collect
CMake version: Could not collect
Libc version: glibc-2.31

Python version: 3.10.14 (main, Apr  6 2024, 18:45:05) [GCC 9.4.0] (64-bit runtime)
Python platform: Linux-5.4.119-19.0009.28-x86_64-with-glibc2.31
Is CUDA available: True
CUDA runtime version: Could not collect
CUDA_MODULE_LOADING set to: LAZY
GPU models and configuration:
GPU 0: NVIDIA H800
GPU 1: NVIDIA H800
GPU 2: NVIDIA H800
GPU 3: NVIDIA H800
GPU 4: NVIDIA H800
GPU 5: NVIDIA H800
GPU 6: NVIDIA H800
GPU 7: NVIDIA H800

Nvidia driver version: 535.54.03
cuDNN version: Could not collect
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

CPU:
Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Byte Order:                      Little Endian
Address sizes:                   46 bits physical, 48 bits virtual
CPU(s):                          200
On-line CPU(s) list:             0-199
Thread(s) per core:              2
Core(s) per socket:              50
Socket(s):                       2
NUMA node(s):                    2
Vendor ID:                       GenuineIntel
CPU family:                      6
Model:                           143
Model name:                      Intel(R) Xeon(R) Platinum 8480+
Stepping:                        6
CPU MHz:                         2000.000
BogoMIPS:                        4000.00
Hypervisor vendor:               KVM
Virtualization type:             full
L1d cache:                       4.7 MiB
L1i cache:                       3.1 MiB
L2 cache:                        200 MiB
L3 cache:                        210 MiB
NUMA node0 CPU(s):               0-99
NUMA node1 CPU(s):               100-199
Vulnerability Itlb multihit:     Not affected
Vulnerability L1tf:              Not affected
Vulnerability Mds:               Not affected
Vulnerability Meltdown:          Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp
Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:        Mitigation; Enhanced IBRS, IBPB conditional, RSB filling
Vulnerability Srbds:             Not affected
Vulnerability Tsx async abort:   Not affected
Flags:                           fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid tsc_known_freq pni pclmulqdq monitor ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch cpuid_fault invpcid_single ssbd ibrs ibpb ibrs_enhanced fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap avx512ifma clflushopt clwb avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves avx512_bf16 wbnoinvd arat avx512vbmi umip avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq movdiri movdir64b fsrm arch_capabilities

Versions of relevant libraries:
[pip3] flashinfer==0.1.6+cu121torch2.4
[pip3] numpy==1.26.4
[pip3] nvidia-cublas-cu12==<IP_ADDRESS>
[pip3] nvidia-cuda-cupti-cu12==12.1.105
[pip3] nvidia-cuda-nvrtc-cu12==12.1.105
[pip3] nvidia-cuda-runtime-cu12==12.1.105
[pip3] nvidia-cudnn-cu12==<IP_ADDRESS>
[pip3] nvidia-cufft-cu12==<IP_ADDRESS>
[pip3] nvidia-curand-cu12==<IP_ADDRESS>
[pip3] nvidia-cusolver-cu12==<IP_ADDRESS>
[pip3] nvidia-cusparse-cu12==<IP_ADDRESS>
[pip3] nvidia-ml-py==12.560.30
[pip3] nvidia-nccl-cu12==2.20.5
[pip3] nvidia-nvjitlink-cu12==12.6.68
[pip3] nvidia-nvtx-cu12==12.1.105
[pip3] pyzmq==26.2.0
[pip3] torch==2.4.0
[pip3] torchvision==0.19.0
[pip3] transformers==4.44.2
[pip3] triton==3.0.0
[conda] Could not collect
ROCM Version: Could not collect
Neuron SDK Version: N/A
vLLM Version: 0.6.0@COMMIT_HASH_PLACEHOLDER
vLLM Build Flags:
CUDA Archs: Not Set; ROCm: Disabled; Neuron: Disabled
GPU Topology:
GPU0	GPU1	GPU2	GPU3	GPU4	GPU5	GPU6	GPU7	NIC0	NIC1	NIC2	NIC3	NIC4	NIC5	NIC6	NIC7	CPU Affinity	NUMA Affinity	GPU NUMA ID
GPU0	 X 	NV8	NV8	NV8	NV8	NV8	NV8	NV8	PIX	NODE	NODE	NODE	SYS	SYS	SYS	SYS	0-99	0		N/A
GPU1	NV8	 X 	NV8	NV8	NV8	NV8	NV8	NV8	NODE	PIX	NODE	NODE	SYS	SYS	SYS	SYS	0-99	0		N/A
GPU2	NV8	NV8	 X 	NV8	NV8	NV8	NV8	NV8	NODE	NODE	PIX	NODE	SYS	SYS	SYS	SYS	0-99	0		N/A
GPU3	NV8	NV8	NV8	 X 	NV8	NV8	NV8	NV8	NODE	NODE	NODE	PIX	SYS	SYS	SYS	SYS	0-99	0		N/A
GPU4	NV8	NV8	NV8	NV8	 X 	NV8	NV8	NV8	SYS	SYS	SYS	SYS	PIX	NODE	NODE	NODE	100-199	1		N/A
GPU5	NV8	NV8	NV8	NV8	NV8	 X 	NV8	NV8	SYS	SYS	SYS	SYS	NODE	PIX	NODE	NODE	100-199	1		N/A
GPU6	NV8	NV8	NV8	NV8	NV8	NV8	 X 	NV8	SYS	SYS	SYS	SYS	NODE	NODE	PIX	NODE	100-199	1		N/A
GPU7	NV8	NV8	NV8	NV8	NV8	NV8	NV8	 X 	SYS	SYS	SYS	SYS	NODE	NODE	NODE	PIX	100-199	1		N/A
NIC0	PIX	NODE	NODE	NODE	SYS	SYS	SYS	SYS	 X 	NODE	NODE	NODE	SYS	SYS	SYS	SYS
NIC1	NODE	PIX	NODE	NODE	SYS	SYS	SYS	SYS	NODE	 X 	NODE	NODE	SYS	SYS	SYS	SYS
NIC2	NODE	NODE	PIX	NODE	SYS	SYS	SYS	SYS	NODE	NODE	 X 	NODE	SYS	SYS	SYS	SYS
NIC3	NODE	NODE	NODE	PIX	SYS	SYS	SYS	SYS	NODE	NODE	NODE	 X 	SYS	SYS	SYS	SYS
NIC4	SYS	SYS	SYS	SYS	PIX	NODE	NODE	NODE	SYS	SYS	SYS	SYS	 X 	NODE	NODE	NODE
NIC5	SYS	SYS	SYS	SYS	NODE	PIX	NODE	NODE	SYS	SYS	SYS	SYS	NODE	 X 	NODE	NODE
NIC6	SYS	SYS	SYS	SYS	NODE	NODE	PIX	NODE	SYS	SYS	SYS	SYS	NODE	NODE	 X 	NODE
NIC7	SYS	SYS	SYS	SYS	NODE	NODE	NODE	PIX	SYS	SYS	SYS	SYS	NODE	NODE	NODE	 X

Legend:

  X    = Self
  SYS  = Connection traversing PCIe as well as the SMP interconnect between NUMA nodes (e.g., QPI/UPI)
  NODE = Connection traversing PCIe as well as the interconnect between PCIe Host Bridges within a NUMA node
  PHB  = Connection traversing PCIe as well as a PCIe Host Bridge (typically the CPU)
  PXB  = Connection traversing multiple PCIe bridges (without traversing the PCIe Host Bridge)
  PIX  = Connection traversing at most a single PCIe bridge
  NV#  = Connection traversing a bonded set of # NVLinks

NIC Legend:

  NIC0: mlx5_bond_0
  NIC1: mlx5_bond_1
  NIC2: mlx5_bond_2
  NIC3: mlx5_bond_3
  NIC4: mlx5_bond_4
  NIC5: mlx5_bond_5
  NIC6: mlx5_bond_6
  NIC7: mlx5_bond_7

Model Input Dumps
No response
🐛 Describe the bug
running command:
export NCCL_DEBUG=INFO
export CUDA_LAUNCH_BLOCKING=1
export VLLM_TRACE_FUNCTION=1
python3 api_server.py
--model my_model
-tp 8
-pp 2
--enforce-eager
--max-num-seqs=32
--dtype=bfloat16
--worker-use-ray
--gpu-memory-utilization 0.8
logs are hanging here:
INFO 09-12 23:40:47 utils.py:977] Found nccl from library libnccl.so.2
INFO 09-12 23:40:47 pynccl.py:63] vLLM is using nccl==2.20.5
VM-160-69-tencentos:561:561 [0] NCCL INFO Using non-device net plugin version 0
VM-160-69-tencentos:561:561 [0] NCCL INFO Using network IB
VM-160-69-tencentos:561:561 [0] NCCL INFO comm 0x1476dca0 rank 0 nranks 2 cudaDev 0 nvmlDev 0 busId 23000 commId 0xa015ae7e0a50005d - Init START
(RayWorkerWrapper pid=248, ip=<IP_ADDRESS>) INFO 09-12 23:40:47 utils.py:977] Found nccl from library libnccl.so.2
(RayWorkerWrapper pid=248, ip=<IP_ADDRESS>) INFO 09-12 23:40:47 pynccl.py:63] vLLM is using nccl==2.20.5
VM-160-69-tencentos:561:561 [0] NCCL INFO Setting affinity for GPU 0 to 0f,ffffffff,ffffffff,ffffffff
VM-160-69-tencentos:561:561 [0] NCCL INFO comm 0x1476dca0 rank 0 nRanks 2 nNodes 2 localRanks 1 localRank 0 MNNVL 0
VM-160-69-tencentos:561:561 [0] NCCL INFO Channel 00/02 :    0   1
VM-160-69-tencentos:561:561 [0] NCCL INFO Channel 01/02 :    0   1
VM-160-69-tencentos:561:561 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] -1/-1/-1->0->1
VM-160-69-tencentos:561:561 [0] NCCL INFO P2P Chunksize set to 131072
VM-160-69-tencentos:561:561 [0] NCCL INFO Channel 00/0 : 1[0] -> 0[0] [receive] via NET/IB/1/GDRDMA
VM-160-69-tencentos:561:561 [0] NCCL INFO Channel 01/0 : 1[0] -> 0[0] [receive] via NET/IB/1/GDRDMA
VM-160-69-tencentos:561:561 [0] NCCL INFO Channel 00/0 : 0[0] -> 1[0] [send] via NET/IB/1/GDRDMA
VM-160-69-tencentos:561:561 [0] NCCL INFO Channel 01/0 : 0[0] -> 1[0] [send] via NET/IB/1/GDRDMA
VM-160-69-tencentos:561:561 [0] NCCL INFO Connected all rings
VM-160-69-tencentos:561:561 [0] NCCL INFO Connected all trees
VM-160-69-tencentos:561:561 [0] NCCL INFO threadThresholds 8/8/64 | 16/8/64 | 512 | 512
VM-160-69-tencentos:561:561 [0] NCCL INFO 2 coll channels, 0 collnet channels, 0 nvls channels, 2 p2p channels, 2 p2p channels per peer
VM-160-69-tencentos:561:561 [0] NCCL INFO comm 0x1476dca0 rank 0 nranks 2 cudaDev 0 nvmlDev 0 busId 23000 commId 0xa015ae7e0a50005d - Init COMPLETE
VM-160-69-tencentos:561:13506 [0] transport/net_ib.cc:1698 NCCL WARN NET/IB : Got completion from peer <IP_ADDRESS><57552> with status=12 opcode=0 len=0 vendor err 129 (Recv) localGid fe80::a288:c2ff:fe16:5c9c remoteGidsfe80::a288:c2ff:fe16:4e4c
VM-160-69-tencentos:561:13506 [0] NCCL INFO transport/net.cc:1298 -> 6
VM-160-69-tencentos:561:13506 [0] NCCL INFO proxy.cc:694 -> 6
VM-160-69-tencentos:561:13506 [0] NCCL INFO proxy.cc:874 -> 6 [Progress Thread]
VM-160-69-tencentos:561:13506 [0] transport/net_ib.cc:1698 NCCL WARN NET/IB : Got completion from peer <IP_ADDRESS><57552> with status=5 opcode=0 len=0 vendor err 249 (Recv) localGid fe80::a288:c2ff:fe16:5c9c remoteGidsfe80::a288:c2ff:fe16:4e4c
VM-160-69-tencentos:561:13506 [0] NCCL INFO transport/net.cc:1298 -> 6
VM-160-69-tencentos:561:13506 [0] NCCL INFO proxy.cc:694 -> 6
VM-160-69-tencentos:561:13506 [0] NCCL INFO proxy.cc:874 -> 6 [Progress Thread]
VM-160-69-tencentos:561:13506 [0] transport/net_ib.cc:1698 NCCL WARN NET/IB : Got completion from peer <IP_ADDRESS><57552> with status=5 opcode=0 len=0 vendor err 244 (Recv) localGid fe80::a288:c2ff:fe16:5c9c remoteGidsfe80::a288:c2ff:fe16:4e4c
VM-160-69-tencentos:561:13506 [0] NCCL INFO transport/net.cc:1298 -> 6
VM-160-69-tencentos:561:13506 [0] NCCL INFO proxy.cc:694 -> 6
VM-160-69-tencentos:561:13506 [0] NCCL INFO proxy.cc:874 -> 6 [Progress Thread]
VM-160-69-tencentos:561:13506 [0] transport/net_ib.cc:1698 NCCL WARN NET/IB : Got completion from peer <IP_ADDRESS><57552> with status=5 opcode=0 len=0 vendor err 249 (Recv) localGid fe80::a288:c2ff:fe16:5c9c remoteGidsfe80::a288:c2ff:fe16:4e4c
VM-160-69-tencentos:561:13506 [0] NCCL INFO transport/net.cc:1298 -> 6
VM-160-69-tencentos:561:13506 [0] NCCL INFO proxy.cc:694 -> 6
VM-160-69-tencentos:561:13506 [0] NCCL INFO proxy.cc:874 -> 6 [Progress Thread]
Before submitting a new issue...

[X] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

did you try https://docs.vllm.ai/en/latest/getting_started/debugging.html ?

usually this means you need to set GLOO_SOCKET_IFNAME and NCCL_SOCKET_IFNAME . see https://docs.vllm.ai/en/latest/getting_started/debugging.html

that's strange then. what's your network config?

your network config is so complicated. i suggest you talk to your network admin, to make sure the test script can run normally first.

if you use --master_addr <IP_ADDRESS> --master_port 23456, I think you still need to add --node-rank ?

interesting. what's your full command?

your hardware / driver / nccl might be broken.

looking at the logs above:

VM-160-69-tencentos:561:13506 [0] transport/net_ib.cc:1698 NCCL WARN NET/IB : Got completion from peer <IP_ADDRESS><57552> with status=12 opcode=0 len=0 vendor err 129 (Recv) localGid fe80::a288:c2ff:fe16:5c9c remoteGidsfe80::a288:c2ff:fe16:4e4c

this means your IB config is wrong, and there are errors there. you need to contact your admin to fix it first.


urlNormalizer normalizations add removeTrailingHash

Need additional feature like removeTrailingQuestionMark and removeTrailingSlash named removeTrailingHash.
Removes trailing hash sign ("#").
http://www.example.com/display# → http://www.example.com/display
Without it, now crawler creates item for each of pages, creating dubles.

This feature is now present in the latest snapshot release.   Please confirm.
Keep in mind the GenericURLNormalizer lets you use regular expressions as well to modify URLs as you see fit.

ERROR - Could not apply normalization "removeTrailingHash".
java.lang.NoSuchMethodException: No such accessible method: removeTrailingHash() on object: com.norconex.commons.lang.url.URLNormalizer
	at org.apache.commons.lang3.reflect.MethodUtils.invokeExactMethod(MethodUtils.java:239)
	at org.apache.commons.lang3.reflect.MethodUtils.invokeExactMethod(MethodUtils.java:208)
	at com.norconex.collector.http.url.impl.GenericURLNormalizer.normalizeURL(GenericURLNormalizer.java:213)
	at com.norconex.collector.http.pipeline.queue.HttpQueuePipeline$URLNormalizerStage.executeStage(HttpQueuePipeline.java:125)
	at com.norconex.collector.http.pipeline.queue.AbstractQueueStage.execute(AbstractQueueStage.java:31)
	at com.norconex.collector.http.pipeline.queue.AbstractQueueStage.execute(AbstractQueueStage.java:24)
	at com.norconex.commons.lang.pipeline.Pipeline.execute(Pipeline.java:91)
	at com.norconex.collector.http.crawler.HttpCrawler.executeQueuePipeline(HttpCrawler.java:250)
	at com.norconex.collector.http.crawler.HttpCrawler.queueStartURLsRegular(HttpCrawler.java:151)
	at com.norconex.collector.http.crawler.HttpCrawler.queueStartURLs(HttpCrawler.java:137)
	at com.norconex.collector.http.crawler.HttpCrawler.prepareExecution(HttpCrawler.java:128)
	at com.norconex.collector.core.crawler.AbstractCrawler.doExecute(AbstractCrawler.java:216)
	at com.norconex.collector.core.crawler.AbstractCrawler.startExecution(AbstractCrawler.java:189)
	at com.norconex.jef4.job.AbstractResumableJob.execute(AbstractResumableJob.java:49)
	at com.norconex.jef4.suite.JobSuite.runJob(JobSuite.java:355)
	at com.norconex.jef4.suite.JobSuite.doExecute(JobSuite.java:296)
	at com.norconex.jef4.suite.JobSuite.execute(JobSuite.java:168)
	at com.norconex.collector.core.AbstractCollector.start(AbstractCollector.java:132)
	at com.norconex.collector.core.AbstractCollectorLauncher.launch(AbstractCollectorLauncher.java:95)
	at com.norconex.collector.http.HttpCollector.main(HttpCollector.java:75)

Are you using the new snapshot entirely?  Some dependencies were updated that contribute to this fix, so you can't update just the collector jar.

I have downloaded http collector snapshot zip. Which dependencies arr needed also?

What is this one? norconex-collector-http-2.7.0-20170328.185911-15.zip
Do you overwrite a previous installation or started fresh? Maybe you have duplicate jars (same name, but different version)?   The zip has an updated version of this file: norconex-commons-lang-1.13.0-SNAPSHOT.jar which you need (your error suggests you do not have the latest).

i see the propblem.
After unzipping collector, i also install latest snapshot of elastic commiter. And it overrides this norconex-commons-lang-1.13.0-20170328.184247-17.jar file to norconex-commons-lang-1.13.0-SNAPSHOT.jar version from (02.03.2017 23:48)

Did you use the committer install script?  If so, I will try to fix it to better handle these type of conflicts.  I am otherwise closing since the original request has been implemented.  Thanks for confirming.

Yes,  commiter install script.

FYI, the collectors and committer snapshot versions were updated so their versioning is no longer time stamped so it should eliminate this issue in the future.


[Docathon][Add API Legend No.52]为masked_fill API添加图例

为masked_fill API添加图例并修改masked_fill_cn.rst
中文文档链接：docs/api/paddle/masked_fill_cn.rst
@zoooo0820
@sunzhongkai588

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

CodeStyle有问题，请修复

  CodeStyle有问题，请修复

已修改

可以提交对应的英文文档 PR

已同步英文文档：https://github.com/PaddlePaddle/Paddle/pull/69215


Installing rescript-test prior to changing suffix in bsconfig.json

First of all, thank you so much for taking the time to create this library 🙏.

rescript-test/bin/retest.mjs uses the inferred suffix when loading its own Test module:

https://github.com/bloodyowl/rescript-test/blob/main/bin/retest.mjs#L42

yet the compiled output of that Test.res modle appears to depend on the suffix setting within the end-developers bsconfig.json file.
Therefore, if a developer installs rescript-test, finds out that it doesn't support the .bs.js suffixed files that actually contain ES6 import statements (which rescript currently outputs), and then attempts to fix that by changing suffix to .mjs within bsconfig.json, they will instead get this error:
Error [ERR_MODULE_NOT_FOUND]: Cannot find module '/Users/dominic.chambers/dev/proj/node_modules/rescript-test/src/Test.mjs' imported from /Users/dominic.chambers/dev/proj/node_modules/rescript-test/bin/retest.mjs
    at new NodeError (internal/errors.js:322:7)
    at finalizeResolution (internal/modules/esm/resolve.js:308:11)
    at moduleResolve (internal/modules/esm/resolve.js:731:10)
    at Loader.defaultResolve [as _resolve] (internal/modules/esm/resolve.js:842:11)
    at Loader.resolve (internal/modules/esm/loader.js:89:40)
    at Loader.getModuleJob (internal/modules/esm/loader.js:242:28)
    at Loader.import (internal/modules/esm/loader.js:177:28)
    at importModuleDynamically (internal/modules/esm/translators.js:114:35)
    at exports.importModuleDynamicallyCallback (internal/process/esm_loader.js:30:14)
    at file:///Users/dominic.chambers/dev/proj/node_modules/rescript-test/bin/retest.mjs:42:41 {
  code: 'ERR_MODULE_NOT_FOUND'
}

Likely unbeknownst to the developer, this can actually be mitigated by deleting node_modules\rescript-test, and running yarn or npm install again, at which point it will re-build the Test module using the now appropriate settings within bsconfig.json.

this is due to the fact rescript builds the dependencies/devDependencies once, and then rebuilds your project.
running the rescript -with-deps should fix the issue without having to delete from node_modules


feat: solve year 2022, day 21

https://adventofcode.com/2022/day/21

:tada: This issue has been resolved in version 1.21.0 :tada:
The release is available on:

v1.21.0
GitHub release

Your semantic-release bot :package::rocket:


我的线上外网不能访问，这部分一直超市[Bug]

Prerequisite

[X] I have searched Issues and Discussions but cannot get the expected help.
[X] The bug has not been fixed in the latest version.

Type
I'm evaluating with the officially supported tasks/models/datasets.
Environment
同官方
Reproduces the problem - code/configuration sample
模型：qwen7b-chat
数据：ceval
Reproduces the problem - command or script
['/opt/conda/envs/python3.8.13/bin/python', './run.py', 'configs/eval_qwen7b.py', '--work-dir', '/data/oss_bucket_0/llm/user/luxi/opencompass/eval', '--mode', 'all', '--max-num-workers', '1']
Reproduces the problem - error message
Downloading data files:   0%|          | 0/1 [00:00<?, ?it/s]
Downloading data files: 100%|██████████| 1/1 [00:00<00:00, 17697.49it/s]
Extracting data files:   0%|          | 0/1 [00:00<?, ?it/s]
Extracting data files: 100%|██████████| 1/1 [00:00<00:00, 2489.20it/s]
Generating train split: 0 examples [00:00, ? examples/s]
Generating train split: 443 examples [00:00, 97742.07 examples/s]
Downloading builder script:   0%|          | 0.00/5.42k [00:00<?, ?B/s]
Downloading builder script: 100%|██████████| 5.42k/5.42k [00:00<00:00, 8.37MB/s]
Traceback (most recent call last):
File "./run.py", line 378, in
main()
File "./run.py", line 227, in main
tasks = partitioner(cfg)
File "/checkpoint/binary/train_package/opencompass/opencompass/partitioners/base.py", line 48, in call
tasks = self.partition(models, datasets, work_dir, self.out_dir)
File "/checkpoint/binary/train_package/opencompass/opencompass/partitioners/size.py", line 67, in partition
datasets = sorted(datasets,
File "/checkpoint/binary/train_package/opencompass/opencompass/partitioners/size.py", line 68, in
key=lambda x: self.get_cost(x),
File "/checkpoint/binary/train_package/opencompass/opencompass/partitioners/size.py", line 188, in get_cost
dataset = build_dataset_from_cfg(dataset)
File "/checkpoint/binary/train_package/opencompass/opencompass/utils/build.py", line 13, in build_dataset_from_cfg
return LOAD_DATASET.build(dataset_cfg)
File "/root/.local/lib/python3.8/site-packages/mmengine/registry/registry.py", line 570, in build
return self.build_func(cfg, *args, **kwargs, registry=self)
File "/root/.local/lib/python3.8/site-packages/mmengine/registry/build_functions.py", line 121, in build_from_cfg
obj = obj_cls(**args)  # type: ignore
File "/checkpoint/binary/train_package/opencompass/opencompass/datasets/base.py", line 12, in init
self.dataset = self.load(**kwargs)
File "/checkpoint/binary/train_package/opencompass/opencompass/datasets/winograd.py", line 13, in load
dataset = load_dataset(**kwargs)
File "/root/.local/lib/python3.8/site-packages/datasets/load.py", line 2112, in load_dataset
builder_instance = load_dataset_builder(
File "/root/.local/lib/python3.8/site-packages/datasets/load.py", line 1798, in load_dataset_builder
dataset_module = dataset_module_factory(
File "/root/.local/lib/python3.8/site-packages/datasets/load.py", line 1495, in dataset_module_factory
raise e1 from None
File "/root/.local/lib/python3.8/site-packages/datasets/load.py", line 1464, in dataset_module_factory
return HubDatasetModuleFactoryWithScript(
File "/root/.local/lib/python3.8/site-packages/datasets/load.py", line 1183, in get_module
dataset_readme_path = self.download_dataset_readme_file()
File "/root/.local/lib/python3.8/site-packages/datasets/load.py", line 1172, in download_dataset_readme_file
return cached_path(
File "/root/.local/lib/python3.8/site-packages/datasets/utils/file_utils.py", line 182, in cached_path
output_path = get_from_cache(
File "/root/.local/lib/python3.8/site-packages/datasets/utils/file_utils.py", line 644, in get_from_cache
http_get(
File "/root/.local/lib/python3.8/site-packages/datasets/utils/file_utils.py", line 397, in http_get
response = _request_with_retry(
File "/root/.local/lib/python3.8/site-packages/datasets/utils/file_utils.py", line 332, in _request_with_retry
raise err
File "/root/.local/lib/python3.8/site-packages/datasets/utils/file_utils.py", line 328, in _request_with_retry
response = requests.request(method=method.upper(), url=url, timeout=timeout, **params)
File "/opt/conda/envs/python3.8.13/lib/python3.8/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
File "/opt/conda/envs/python3.8.13/lib/python3.8/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "/opt/conda/envs/python3.8.13/lib/python3.8/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "/opt/conda/envs/python3.8.13/lib/python3.8/site-packages/requests/adapters.py", line 501, in send
raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
2023-08-21 22:44:14,407 - MDL: INFO - HeartbeatClient: stopped.
Other information
我在线下可以访问外网的机器是可以运行的，但是在线上不能访问外网，就出现问题。
不太明白他在下载什么， 我把数据都导入到工作目录下了。

HuggingFace requires the Internet whenever it is launched. To switch to offline mode, try setting environment variables HF_DATASETS_OFFLINE=1 TRANSFORMERS_OFFLINE=1: https://huggingface.co/docs/transformers/installation#fetch-models-and-tokenizers-to-use-offline

ok


strong-mode implicit-casts demotes template classes to Object

Summary:
With implicit-casts: true, Klass<A> and KlassB extends Klass<B> are demoted to Object when used in the same elvis operator expression.  Discovered when using CircleAvatar in Flutter:
backgroundImage: profile.photoUrl == null
                      ? const AssetImage('images/anonymous.jpg')
                      : NetworkImage(profile.photoUrl),

Dart SDK Version (dart --version)
Whether you are using Windows, MacOSX, or Linux (if applicable)

$ dart --version
Dart SDK version: 2.10.0-7.3.beta (beta) (Wed Aug 26 09:46:50 2020 +0200) on "linux_x64"

Code sample:
import 'dart:math';

class Value<T> {
  final T x;
  const Value(this.x);
  String toString() => x.toString();
}

class StringValue extends Value<String> {
  StringValue(String x) : super(x);
}

void printValue(Value<dynamic> v) => print(v);

void main() {
  printValue(Random().nextBool() ? Value<int>(42) : Value<String>('test'));
  printValue(Random().nextBool() ? Value<int>(42) : StringValue('test'));
}

analysis_options.yaml:
analyzer:
  strong-mode:
    implicit-casts: false

Observed:
dartanalyzer:
$ dartanalyzer test.dart
Analyzing test.dart...
  error • The argument type 'Object' can't be assigned to the parameter type 'Value<dynamic>'. • test.dart:17:14 • argument_type_not_assignable
1 error found.

Expected: either analyzer complains about both lines (requiring a cast) or none (since they both can be demoted to Value<dynamic>).

This is working as intended, but it is a quirky corner of the language.
The point is that ?: relies on the computation of a least upper bound (LUB) of two types, and that computation has several tricky properties. First, it isn't a least upper bound, because that doesn't exist (we can have two classes C1 and C2, both implementing B1 as well as B2, and then the least upper bound cannot be a nominal type: B1 is not a subtype of B2 and vice versa). Second, the Dart 1 rule for computing LUBs is still being used in the special case where we are computing the least upper bound of two interface types that aren't generic instantiations of the same class (so we're using that old rule for Value<int> and StringValue), but for two instantiations of the same interface type we use recursion (so with Value<int> and Value<String> we get Value<LUB(int, String)> which is Value<Object>).
void test(bool b) {
  var x1 = b ? Value<int>(42) : Value<String>('test');
  var x2 = b ? Value<int>(42) : StringValue('test');
  int i1 = x1; // Can't assign a `Value<Object>` to an `int`.
  int i2 = x2; // Can't assign an `Object` to an `int`.
}

The reason why that old rule is still being used in the "otherwise" case is that it would be too much of a breaking change to do anything else, but we are aware of the fact that it may seem confusing and inconsistent in cases like this one.

Got it, thanks Erik for the explanation and reference to the doc.  I've nothing to add here; unless you'd prefer me to rephrase it as an FR, we can close this issue.
To close on the thread, I appended as ImageProvider<dynamic> to the AssetImage() in my use case (that would be equivalent to StringValue('test') as Value<dynamic> in the example code).  Indeed, that required ignore: avoid_as, but it's honest work.
Expanding to if ... else assigning to a pre-declared variable of true LUB class (ImageProvider<dynamic> / Value<dynamic>) works as well in my case.

Thanks, Artem! We have the need to think hard about least upper bound firmly on the agenda, so there is no need to create a feature request on that.


100% test coverage

Yes it is possible and https://coveralls.io/github/rochacbruno/dynaconf lists all files missing coverage.
Lets write more tests!!!

Missing validators and transformators tests


Start new debug sessions from within debugger

Hello. I currently do feature development on the PHP debugger https://github.com/xdebug/vscode-php-debug and have the following question/request.
The DBGP debug protocol that is used to debug languages like PHP, Python, AutoHotkey has a "connect back" concept where the DEBUGGER LISTENS and the DEBUGEE CONNECTS to it. In a typical PHP setup it could, and usually does mean, that for each page-load the PHP runtime makes a connection to the debugger.
The debugger should offer the user a separate debug session for each connection received.
What we are currently doing is that we present these individual debugee connections as threads in the currently running debug session.
Currently each debug session must be initiated form vscode side. Is there a way it could be achieved that when the extension receives a valid DBGP debug connection it somehow starts a new DebugSession and passes the connected socket over to that one?
Thank you.

@connor4312  this feature request seems to be related to what you are doing in js-debug.
I think we should add support for this in DAP. What do you think?

Interesting the DBGP protocol is 'push only' for session instantiation. I think this makes sense, right now js-debug needs to call startDebugging in VS Code and short circuit the configuration logic for child sessions. I wonder if any adapter needs launch configs for child sessions, since children can only be created programmatically.
js-debug has a separate bundle for VS that makes a custom DAP request to trigger a child session, and nvim-dap had trouble trying to set it up because of the need for special child-session logic. Adding a protocol-level feature would make js-debug more reusable.

Thanks for the hints. As far as I understand the behavior could be achieved by having two parts in the implementation:

The DAP implementation extending vscode-debugadapter.DebugSession. This part is defined under package.json contributes.debggers and is launched in a separate extension host.
The extension part (defined in package.json main and registered through activate()).

So when a "listen" (we'd probably abuse "attach") type of debug session would be started

vscode starts DAP implementation and we start a listen socket for dbgp
when a dbgp connection is received we store it globally and then we fire a custom even from DAP and catch it with help of onDidReceiveDebugSessionCustomEvent (similar to https://github.com/microsoft/vscode-node-debug/blob/034f91bb445e24f430da461a80be7493108d0b66/src/node/extension/autoAttach.ts#L50)
we build a special config passing socket information received through custom even and pass it back via vscode.debug.startDebugging (like https://github.com/microsoft/vscode-node-debug/blob/034f91bb445e24f430da461a80be7493108d0b66/src/node/extension/autoAttach.ts#L143)
back in DAP implementation we extract the socket information, get the globally stored socket and start normal debugging

This way we end up with two sessions. One responsible for listening, another for the active active connection.
This would be really nice and would mimic how I implement my first DBGP debug client.
There the action of "listen for dbgp/stop listening for dbgp" was separate from "stop/disconnect current active dbgp session".
My question is, will passing the parentSession like this vscode.debug.startDebugging(folder, config, parentSession); ensure the new DAP session will start in the same extension host and so can access the native socket?
Now, if there were a simpler option, even better :)
Thanks!

Your approach is very similar to what the JavaScript debugger does. As far as I know any given extension can be activated in at most one extension host, so that would work.

@zobo please note that vscode-debugadapter.DebugSession is an implementation detail of a JS/TS library for DAP. It is not a DAP concept. The same is true for VS Code extension API like vscode.debug.startDebugging(...).
We should try to come up with a proposal for a language-neutral DAP addition (and we probably should move the discussion to debug-adapter.protocol).

Hi @weinand. I understand, the question was specific to vscode and so I use the term DAP in this context, as you pointed out.
As far as I researched the "debug adapter protocol" setting up a child session seemed a bit out of scope and more depending on the IDE (DAP consumer) plumbing. However providing a concept for it in the protocol itself would be great. I will also open an issue there and we'll see if we come up with a solution.

Hello @connor4312.
I have tried to implement separate debug sessions as described and while in development context it worked ok. But not in production.
What I do is:

register an extension with activationEvents: onDebug
Start a debug session type "launch" where I open a listening socket on port 9003
When a connection is established, I save this connection into a static variable and send a custom event, containing an ID of that connection in the static map.
The extension part has a onDidReceiveDebugSessionCustomEvent and then proceeds to call vscode.debug.startDebugging(undefined, config, event.session) where config is the same config of the initial session, but with request set to attach and that connection ID passed with the config object
the adapter implementation receives an attachRequest with said connection ID. It looks up the static variable, gets the actual connection/socket object and continues to handle that as in a normal debug session.

As long as I am developing the debug adapter and it's running in one debuggable processes and vscode connects to it via debugServer: 4711 directive, all works fine. But when I let vscode start the adapter process it starts a new one for each startDebugging call.
Thus leading to the new adapter not being able to access the native socket object....
Is there any way to request vscode to reuse the adapter process?
Thanks!

Ok, I should have just RTFM: https://code.visualstudio.com/api/extension-guides/debugger-extension. Doc here explains how using DebugAdapterDescriptorFactory I can manipulate where and how the adaptor exists.

@zobo yes, the DebugAdapterDescriptorFactory will be your friend...

Let's merge this into https://github.com/microsoft/vscode/issues/116730. Adoption in VS Code can be tracked in https://github.com/microsoft/vscode/issues/160169.


Accents are not marshalled correctly

I found a bug in RouteResult.cpp (line 105) :
routeStep->Name = msclr::interop::marshal_asSystem::String^(name);
where the accents is not converted correctly.
For example : Got 'Rue Jacques DestrÃ©e' but expected 'Rue Jacques Destrée'. It seems OSRM lib is encoded with UTF-8.
I'm an experienced developer in C#, Java & Objective-C but I'm not familiar with C++/CLI so I cannot propose a fix.
Kind regards,
Daniel

Hi Daniel,
Just to help me out, do you still have the coordinate for the route and what region of pbf map you're using?

Hi Surya,
I'm using the region : https://download.geofabrik.de/europe/france-latest.osm.pbf but the sub-region
: https://download.geofabrik.de/europe/france/ile-de-france-latest.osm.pbf should work.
The route is :
http://<IP_ADDRESS>:5000/route/v1/driving/2.349566,48.829717;2.472986,48.629575?steps=true
Note also that the lane node in this route will be cause another bug :
const auto& laneList = intersection.values.at("lanes").getosrm::json::Array().values;
for (const auto &lane : laneList)
{
result->Lanes->Add(msclr::interop::marshal_asSystem::String^(lane.getosrm::json::String().value));
}
Please find attached the modified project I'm working on to fix the lane bug and to upgrade to libosrm 5.12.0 : https://www.dropbox.com/s/94jyc6a1dlmvvps/OSRM.NET.zip?dl=0

Added support for AnnotationsType
Added support for GeometriesType.GeoJSON

The modified project seems to work correctly with libosrm 5.12.0.
Kind regards,
Daniel

Hi Daniel, thanks for the heads up and I'll definitely will look into your solution. I made progress last night.  It is caused by the libosrm compiled with non unicode. We still want to leave libosrm as is so the solution will have to be a string conversion. I tested it last night and it worked nicely, but I know I have to apply it everywhere that deals with string.
On a different note, looking at the list that you're working on, I would be very grateful if you can contribute. We can separate the work by feature and by you forking the project and just issue pull request.  PM me if you're interested and we can work out the detail on how to best coordinate this.

Hi Surya,
Yes it would be nice to work together, how can I contact you directly so I can give my email to setup detail.
I already finish a full implementation of route in the modified project in Dropbox.
Indeed I feel comfortable to implement ProcessRouteLeg, ProcessManeuver ... as it is just to adapt the code as the syntax is already there.

Daniel, you can reach me at<EMAIL_ADDRESS>

Addressed with #36


hello world workflow fails on containerd runtime

Pre-requisites

[X] I have double-checked my configuration
[X] I can confirm the issues exists when I tested with :latest
[x] I'd like to contribute the fix myself (see contributing guide)

What happened/what you expected to happen?
Installing argo using:
sudo helm repo add argo https://argoproj.github.io/argo-helm
sudo helm repo update
sudo helm install argo argo/argo-workflows -n argo

And running sudo argo submit https://raw.githubusercontent.com/argoproj/argo-workflows/master/examples/hello-world.yaml --watch -n argo
I expect the hello world workflow to run.
Instead, the container wait for a docker-socket mount:
Warning  FailedMount  25s (x14 over 12m)  kubelet            MountVolume.SetUp failed for volume "docker-sock" : hostPath type check failed: /var/run/docker.sock is not a socket file
I saw some previous issues (https://github.com/argoproj/argo-workflows/issues/826) but executors seem deprecated, so I cannot use the fixes proposed.
Version
v3.4.3
Paste a small workflow that reproduces the issue. We must be able to run the workflow; don't enter a workflows that uses private images.
https://raw.githubusercontent.com/argoproj/argo-workflows/master/examples/hello-world.yaml

Logs from the workflow controller
time="2022-11-04T08:21:00.546Z" level=info msg="Processing workflow" namespace=default workflow=hello-world-hkwbh
time="2022-11-04T08:21:00.551Z" level=info msg="Updated phase  -> Running" namespace=default workflow=hello-world-hkwbh
time="2022-11-04T08:21:00.552Z" level=info msg="Pod node hello-world-hkwbh initialized Pending" namespace=default workflow=hello-world-hkwbh
time="2022-11-04T08:21:00.800Z" level=info msg="Created pod: hello-world-hkwbh (hello-world-hkwbh)" namespace=default workflow=hello-world-hkwbh
time="2022-11-04T08:21:00.800Z" level=info msg="TaskSet Reconciliation" namespace=default workflow=hello-world-hkwbh
time="2022-11-04T08:21:00.800Z" level=info msg=reconcileAgentPod namespace=default workflow=hello-world-hkwbh
time="2022-11-04T08:21:00.854Z" level=info msg="Workflow update successful" namespace=default phase=Running resourceVersion=8615568 workflow=hello-world-hkwbh
time="2022-11-04T08:21:10.802Z" level=info msg="Processing workflow" namespace=default workflow=hello-world-hkwbh
time="2022-11-04T08:21:10.802Z" level=info msg="Updating node hello-world-hkwbh message: ContainerCreating" namespace=default workflow=hello-world-hkwbh
time="2022-11-04T08:21:10.803Z" level=info msg="TaskSet Reconciliation" namespace=default workflow=hello-world-hkwbh
time="2022-11-04T08:21:10.803Z" level=info msg=reconcileAgentPod namespace=default workflow=hello-world-hkwbh
time="2022-11-04T08:21:10.820Z" level=info msg="Workflow update successful" namespace=default phase=Running resourceVersion=8615621 workflow=hello-world-hkwbh
time="2022-11-04T08:21:20.822Z" level=info msg="Processing workflow" namespace=default workflow=hello-world-hkwbh
time="2022-11-04T08:21:20.822Z" level=info msg="TaskSet Reconciliation" namespace=default workflow=hello-world-hkwbh
time="2022-11-04T08:21:20.822Z" level=info msg=reconcileAgentPod namespace=default workflow=hello-world-hkwbh
time="2022-11-04T08:41:20.823Z" level=info msg="Processing workflow" namespace=default workflow=hello-world-hkwbh
time="2022-11-04T08:41:20.824Z" level=info msg="TaskSet Reconciliation" namespace=default workflow=hello-world-hkwbh
time="2022-11-04T08:41:20.824Z" level=info msg=reconcileAgentPod namespace=default workflow=hello-world-hkwbh
time="2022-11-04T09:01:20.824Z" level=info msg="Processing workflow" namespace=default workflow=hello-world-hkwbh
time="2022-11-04T09:01:20.825Z" level=info msg="TaskSet Reconciliation" namespace=default workflow=hello-world-hkwbh
time="2022-11-04T09:01:20.825Z" level=info msg=reconcileAgentPod namespace=default workflow=hello-world-hkwbh
Logs from in your workflow's wait container
sudo kubectl logs -n argo -c wait -l workflows.argoproj.io/workflow=hello-world-hkwbh,workflow.argoproj.io/phase!=Succeeded
[16:12] Albrecht Weerts
cloudadm@kubeserver:~$ sudo kubectl logs -n argo -c wait -l workflows.argoproj.io/workflow=hello-world-66hq2,workflow.argoproj.io/phase!=Succeeded
Error from server (BadRequest): container "wait" in pod "hello-world-66hq2" is waiting to start: ContainerCreating

For anyone googling this, an old version was installed in the same namespace, causing argo cli to refer to an old deployment with docker as executor. Deleting the old deployment was enough to solve the issue, running with the emissary executor. To argo devs, sorry for the noise.


When HStack appears, there is no spring animation, which feels a bit abrupt.

https://movingparts.io/pow#move

import SwiftUI
import Pow

struct TestUI: View {
  @State var isAdded = false

  var body: some View {
    ZStack {
      Color.clear

      if isAdded {
        Image("zb_yezi")
          .resizable()
          .frame(width: 150, height: 200)
          .transition(
            .asymmetric(
                insertion: .movingParts.move(
                  angle: .degrees(-45)
                ),
                removal: .movingParts.move(
                  angle: .degrees(135)
                )
            ).combined(with: .opacity)
          )
      }
    }
    .contentShape(Rectangle())
    .onTapGesture {
      withAnimation {
        isAdded.toggle()
      }
    }
  }
}

https://github.com/EmergeTools/Pow/assets/61079864/15085772-909c-4509-80c0-6f90fcffc71d

It feels like a lot of the detailed effects showcased on the web don't translate to real device performance. Unfortunately, my SwiftUI skills are still quite weak.

Hey @zhu-hongwei, the effects showcased on the web are animations that were recorded on a real device so they should translate your iOS app. The code on the website is meant to demonstrate how the transitions work, but what the code you posted is missing is an animation to give it the springiness you're looking for.
If you want additional bounciness you'll want to add something like this to the ZStack, or you can substitute whatever animation you find suitable for your app's look and feel.
ZStack {
    // All the other code stays the same
}
.animation(.spring(response: 0.25, dampingFraction: 0.5), value: isAdded)

Hope that answers your question and gives you a good starting point for your app!


Spatially reproject data in data conversion script

Detailed Description
The EUMETSAT data is in geostationary projection.  We probably want it in transverse Mercator.
Related

See the way SatIp used to do it (in git history)
The notebook I wrote in 2019 to convert .nat files to NetCDF and re-project
Notebook which reprojects using pyresample
Notebook which reprojects using rasterio
pyresample can be told to use multiple CPU cores

SatFlow also did it here: https://github.com/openclimatefix/satflow/blob/ad5d6f6c419994835977cb75322f86b171d6a341/satflow/data/utils/utils.py#L48-L96


advise cluster-autoscaler-fips-1.26 CVE-2024-3177

Advise for cluster-autoscaler-fips-1.26. https://github.com/chainguard-dev/enterprise-packages/pull/3689

This PR should be in enterprise-advisories repo where there is an advisory file for this package.

Correct PR: https://github.com/chainguard-dev/enterprise-advisories/pull/4341


[hi] Localized docs/concepts/containers/container-lifecycle-hooks.md

Hi @aj11anuj, Can you address the review in the PR?

@aj11anuj  can you address review comments given?

/remove-lifecycle rotten

@aj11anuj gentle reminder

closing due to long time inactivity.

@aj11anuj  feel free to reopen if you have time to work on this.

/close


Aux factories are not properly updated after concatenation

🐛 Bug Report

In https://github.com/SciTools/iris/pull/5096, I missed to update the scalar coordinates of the new concatenated cube correctly. As a result, operations like indexing a cube fail with cryptic errors like
KeyError:<PHONE_NUMBER>61168

How To Reproduce
Steps to reproduce the behaviour:
import iris
import iris.util
from iris.cube import CubeList
from iris.coords import DimCoord

print(iris.__version__)
print("")

# Load sample data
path = iris.sample_data_path('hybrid_height.nc')
cube = iris.load(path)[0]
cube.remove_coord('time')

time_coord = DimCoord(10.0, units='days since 2000-01-01', standard_name='time')

cube_0 = iris.util.new_axis(cube)
cube_0.add_dim_coord(time_coord.copy(), 0)

cube_1 = iris.util.new_axis(cube)
cube_1.add_dim_coord(time_coord.copy(), 0)
cube_1.coord('time').points = [20.0]

cubes = CubeList([cube_0, cube_1])
concat_cube = cubes.concatenate_cube()
print(concat_cube[0, 0, 0])

Running this leads to the aforementioned KeyError.
Expected behaviour

No error.
Environment

OS & Version: Red Hat Enterprise Linux 8.6 (Ootpa)
Iris Version: 3.6.0

I will provide a fix for this shortly.

@SciTools/peloton: note this did not automatically close because the fix is in the v3.6.x patch branch. However we always do a 'merge back' of such branches post-release so we are comfortable closing this now.


Feature/lint prettier

With this all is formatted and a lint hook is run before commit

Thanks Angelo!

Thanks Angelo!

You are welcome ;)


Quick fix for tremor-script publish

Signed-off-by: PrimalPimmy<EMAIL_ADDRESS>Pull request
Description
Since publish crate action wasn't working for tremor-script, changed it to cargo publish method

Checklist

[x] The RFC, if required, has been submitted and approved
[x] Any user-facing impact of the changes is reflected in docs.tremor.rs
[x] The code is tested
[x] Use of unsafe code is reasoned about in a comment
[x] Update CHANGELOG.md appropriately, recording any changes, bug fixes, or other observable changes in behavior
[x] The performance impact of the change is measured (see below)

Performance

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.01%) to 85.693%

Totals

Change from base Build<PHONE_NUMBER>:
0.01%

Covered Lines:
40436

Relevant Lines:
47187

💛  - Coveralls


Cant specify fastjson when marshal

I trying to use fastjson instance of jackson, with camel-k 1.8.1, so I wrote this yaml
apiVersion: camel.apache.org/v1
kind: Integration
metadata:
  name: jackson-test
  namespace: camel
spec:
  dependencies:
  - mvn:mysql:mysql-connector-java:8.0.28
  - mvn:org.apache.commons:commons-dbcp2:2.8.0
  - mvn:com.fasterxml.jackson.datatype:jackson-datatype-jsr310:2.13.2
  flows:
  - from:
      steps:
      - to:
          uri: freemarker:sql.ftl?contentCache=false
      - to:
          uri: (hidden bean)
      - marshal:
        json:
           library: fastjson
      uri: rest:get:/

And I got this error in container
java.lang.IllegalArgumentException: Unexpected type: class org.apache.camel.model.dataformat.JsonDataFormat
I'm very confused. Why doesn't the "library" usage I found in the unit test of the source code work.
In addition, I think the yaml file of camel-k also puzzles me when I refer to the java example of camel. I don't know how to convert them accurately.

It should be:
      - marshal:
          json:
            library: Fastjson

your indentation seems to be wrong

It's a different way of writing routes through YAML, so there no automatic conversion, for the moment, from plain camel or Java DSL, to YAML.

Also Jackson is a thing, Fastjson is another thing.

Also Jackson is a thing, Fastjson is another thing.

Ow ow ow ow, I did make an indentation mistake. I was stupid! Thanks for your help!
The Jackson dependency is that I forgot to remove it when I was testing at the beginning, which is not a problem

Also Jackson is a thing, Fastjson is another thing.

Also Jackson is a thing, Fastjson is another thing.

There is another question that puzzles me. I can define a custom serializer module for Jackson in normal Java( just like moduleClassNames, JavaTimeModule  below), but if I use yaml file, do I have any way to use my class without deploy my jar to maven? Just define a class in yaml, and use it, Is this impossible?
      - marshal:
          json:
            moduleClassNames: "com.fasterxml.jackson.datatype.jsr310.JavaTimeModule"
            disableFeatures: "WRITE_DATES_AS_TIMESTAMPS"

The class I want like this
public class TimeSerializer extends SimpleModule {
    public TimeSerializer(){
        super(PackageVersion.VERSION);
        addSerializer(LocalDateTime.class, new LocalDateTimeSerializer());
    }
}

What I want to do is let Jackson serialize LocalDateTime into UNIX timestamp, and Jackson gave me an array, which shocked me, so I'm working with the serializer battle
I'm really confused about the yaml writing method of camel K. instead of seeking automatic conversion, I think the introduction of yaml in camel-k tutorial is too simple and lacks advanced usage
Sorry, my question is beyond the scope of this issues, but this problem really bothers me. If you know, please tell me possible or impossible or don't-know, so I won't try again. Thank you

My suggestion is to use jitpack while developing.


Feature/layouts i18n

Localisation of layouts default.vue and error.vue.
Extra feature gulp verifyI18nDefiniton to verify the strings definition, it's structure and allows local development without need for translation

Thank you!


Tor 0.3.4.x is supported until June switch to Tor 0.3.5.x (long-term support until 2022)

Hi, just wanted to remember ;)
Deeponion always run Tor <IP_ADDRESS>-alpha-dev. Current is <IP_ADDRESS>
Depponion could just bring out Tor updates more often and not just 1 time a year.

This is not the place for a discussion like this. Please use the forums.


7.0.0 Stable: Add backwards compatibility mode

We know our users will find it difficult to migrate big prototype to the new world over night.
To make this easier we want to re-introduce a backwards compatibility mode that allows users to run the old Elements code alongside the new code.
Pull request here:
#553

shipped with #570


Do not build mozilla cacerts bundle natively on Solaris/SPARC (too slow on our systems)

Because of the slowness issues with java on the SPARC Solaris 10 machine, the changes to run keytool multiple times during the build have pushed it over the 8 hour timeout.
As a mitigation, this PR will stop the builds from generating cacerts on Solaris/SPARC and instaead download and use the cacerts file from the Solaris/x64 build. This is not intended to be a permanent solution, but it will allow us to get the JDK8/HotSpot/Solaris-sparc builds running clean again with valid output on this platform.
~(NOTE: This WIP PR currently includes a change to exclude gradle as it helps speed up testing, but that will NOT be part of this PR - only the change to prepareWorkspace.sh)~ Now removed again

Looks like we may have a Solaris build failure in tonight's code, but after a few cycles I'm reasonably confident that this has worked around the problem and will allow the build to complete in less than the timeout period onc ethe code is working again.
(The exclude gradle PR mentioned in the description in addition to this would allow the build to get down to about 3h35)

The contents are always the same. And the format is currently the same, too (Sun/JKS).


fix!: compatibility with new cypress 10 configuration

related to #1 .

reimplement resolveTestFiles w/o integrationFolder and with new specPattern / excludeSpecPattern
update tests (replace integrationFolder with fixturesFolder for configuration resolving tests)
update README
bump 3.0.0

Hey @Anthony-Champagne-Wiztivi, thanks for your work in both this and badeball/cypress-cucumber-preprocessor/pull/734. This however isn't complete I'm afraid, as it does not take into account reading from the new cypress.config.{js,mjs,ts} and thus resolveTestFiles() will not behave correctly.
@lmiller1990 and @admah, is this something we can request that Cypress expose for us? Either a complete configuration resolvement or simply a method or a method for resolving test files given [cwd, argv, env].

Bear in mind that this plugin powers https://github.com/badeball/cypress-parallel and an (hopefully) upcoming vscode extenstion for Cypress + Cucumber which does not have the luxury of access to the config object as a regular Cypress plugin has.

I'll take time this morning to see if I can take care of it manually, so that we can have a temporary solution before a resolver is available from the core ? Is it OK with you ?

I'm also not entirely sure what you have in mind, but I'm afraid we might not be on the same wavelength as to how to implement support for v10.
It shouldn't come as a surprise, but I don't intend to remove support for < 10 during this. You should keep this is mind if you want to continue the work without my counsil. Otherwise you run the risk of disappointment, as I'm not going to merge something hastily.

This has been superseded by https://github.com/badeball/cypress-configuration/commit/d2ea63cf12c8d4546f00e17a50261733997d6b5c, where I ensured to retain backward compatibility.


Risk: investing too many or too few resources

#8 Issue by smattingly,
Investing too many resources in a project too early can lead to waste because

the resources are being invested in a project that turns out to be unfeasible, or
it is too early for the project to make valuable use of the resources.

The risk seems to about the same, I guess will really wait to see til after work resumes.

same for now.

reviewed

same for now

too few resources being used

reviewed


Translate Update for V1.3: Tutorials - Chaincode for developers

There are lots of differences between V1.3 Version and V1.2 translated version, need to update

there is a wrong translation in this chapter. the part title  is Terminal 2- Build&Start the chaincode. In the orignal sentence is :
Now run the chaincode:
CORE_PEER_ADDRESS=peer:7052 CORE_CHAINCODE_ID_NAME=mycc:0 ./sacc
but the Chinese translation is
CORE_PEER_ADDRESS=peer:7051 CORE_CHAINCODE_ID_NAME=mycc:0 ./sacc
And after I did the experiment, I found the translation is wrong.

hi @alexanderhawl , the port number in V1.2 and V1.3 are both 7052, whether you are referring the 1.2 or 1.3 version of documents? Thanks.

I donot know which version the document is. The site is https://hyperledgercn.github.io/hyperledgerDocs/chaincode_developers_zh/#2.  And  my fabric version is 1.3. Maybe I didnot find the right translation version.

From: Jiachuan Li<EMAIL_ADDRESS>Sent: Thursday, December 13, 2018 3:20 AM
To: hyperledger-labs/fabric-docs-cn
Cc: alex hawl; Mention
Subject: Re: [hyperledger-labs/fabric-docs-cn] Translate Update for V1.3: Tutorials - Chaincode for developers (#72)
hi @alexanderhawlhttps://github.com/alexanderhawl , the port number in V1.2 and V1.3 are both 7052, whether you are referring the 1.2 or 1.3 version of documents? Thanks.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/hyperledger-labs/fabric-docs-cn/issues/72#issuecomment-446828961, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AVVDbq27qen6EGK_VNqyV1wgz86xwZSXks5u4cdwgaJpZM4YnePQ.

@alexanderhawl , please check this one, and this is not translated yet for 1.3 version.
https://hyperledger-fabric-cn.readthedocs.io/zh/latest/chaincode4ade.html

The 1.3 verison is right.

From: Jiachuan Li<EMAIL_ADDRESS>Sent: Monday, December 17, 2018 12:52 PM
To: hyperledger-labs/fabric-docs-cn
Cc: alex hawl; Mention
Subject: Re: [hyperledger-labs/fabric-docs-cn] Translate Update for V1.3: Tutorials - Chaincode for developers (#72)
@alexanderhawlhttps://github.com/alexanderhawl , please check this one, and this is not translated yet for 1.3 version.
https://hyperledger-fabric-cn.readthedocs.io/zh/latest/chaincode4ade.html
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/hyperledger-labs/fabric-docs-cn/issues/72#issuecomment-447835558, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AVVDbkSIW5yRlqrG6_vMf8o0dywLKDZ8ks5u55ObgaJpZM4YnePQ.


[WIP] Imports layering

I think, it's easier to look at the code and discuss a proposal 🙂

Closing as it's too old now ...


No need for admin rights in installer.

There really is no need to ask for administrative right with the installer. I can just unzip and run the application portable.
Having an application asking for administrative rights when not needed is really limiting your application exposure. If I were you I would remove it.

@generic-user Thanks, I'll fix it.


feature request: want Del method return the deleted elements

hello, I find in Del method.
`
 // Del removes matching nodes.
func (x Expr) Del(data any) error {
    return x.set(data, delFlag, "delete", false)
}

`
could ojg provide a del method. which could return those elements who have been deleted, thanks.

That's a possibility. It would not be as performant and it would think returning both path and value would be best.
Alternatively a delete with a callback is another option.

I think the callback approach will be best. Not sure when I will have it done though.

thanks，I will also research how to achieve this.   if done. I will submit a pr.

The jp.Modify might be a good example of how to implement. Not exactly the same but similar. It also depends on whether the delete should replace items in a list with nil or remove from list.

I've started a branch names expr-walk. The plan is to implement func (x Expr) Walk(data any, cb func(path Expr, data, parent any)). That will walk the matching nodes and allow the cb function to modify and/or collect matching nodes. It should be easy to implement a delete that returns the deleted values along with the path the deleted value was found at with this new function.

I've started a branch names expr-walk. The plan is to implement func (x Expr) Walk(data any, cb func(path Expr, data, parent any)). That will walk the matching nodes and allow the cb function to modify and/or collect matching nodes. It should be easy to implement a delete that returns the deleted values along with the path the deleted value was found at with this new function.

thanks, that's awesome, I will have a look.

Only started the branch. Not even close to being ready for use. Just letting you know in case you wanted to keep an eye on it.

OK，get it!

The expr-walk branch is ready to be merged. I plan on merging and releasing tomorrow unless someone such as yourself has comments about it.


:bug: Fix images displaying wider than card

Fixes #25
Added example to "Google Developers Group" post to show issue.

@thunsaker awesome :+1: thanks for your contribution :smile:


int8 lower performance than fp16

System Info
CPU architecture: x86_64
Host RAM: 1TB
GPU: 8xH100 SXM
Container: Manually built container with TRT 9.3 Dockerfile.trt_llm_backend
TRT LLM v0.9 main branch (https://github.com/NVIDIA/TensorRT-LLM/commit/850b6fa1e710d25769f2b560d897d2bd424a645e)
Driver Version: 535.161.07
CUDA Version: 12.2
OS: Ubuntu 22.04
Who can help?
@byshiue
Information

[ ] The official example scripts
[X] My own modified scripts

Tasks

[ ] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
[X] My own task or dataset (give details below)

Reproduction
Build the same model in fp16 and int8 weight only quantization and enable_chunked_context=True
python3 convert_checkpoint.py \
  --model_dir ./llama-70b \
  --output_dir ./llama-70b_tp4 \
  --dtype float16 \
  --use_weight_only \
  --weight_only_precision int8 \
  --tp_size 4

trtllm-build \
  --checkpoint_dir ./llama-70b_tp4  \
  --output_dir engines/llama-70b-2 \
  --gemm_plugin float16 \
  --max_batch_size 192 \
  --max_input_len 2048 \
  --max_output_len 384 \
  --gpt_attention_plugin float16 \
  --paged_kv_cache enable \
  --remove_input_padding enable \
  --multi_block_mode disable \
  --max_num_tokens 393216 \
  --context_fmha enable \
  --use_paged_context_fmha enable \
  --enable_xqa enable \
  --workers 4 \
  --use_custom_all_reduce enable \
  --opt_num_tokens 192

Expected behavior
int8 performance should be better than fp16
actual behavior
int8 latency is 3x higher than fp16
additional notes
The issue may be related to enabling chunked context

Could you run nsight system profiler to help comparing? From your setting, I guess the program takes lots of time on context phase.
Since int8 weight only requires to dequantize the weights back to fp16 and use fp16 tensor core, it might be slower than pure fp16 when the batch size is large, especially when the bottleneck is on context phase.
However, 3x slower does not really make sense. So, we need more information to help analyzing.


'sndfile' port not cleanup when remove

Describe the bug
Sndfile port does not remove headers and libraries when removed.
Environment

OS: Windows 10 x64 21H1 19043.1081.
Compiler: Microsoft Visual Studio Enterprise 2019 Version 16.10.2

To Reproduce
Steps to reproduce the behavior:

vcpkg.exe install sndfile:x86-windows-static
vcpkg.exe remove sndfile:x86-windows-static
I can see the sndfile header and lib files in my file system.

Expected behavior
A clear and concise description of what you expected to happen.
Failure logs
-(please attached failure logs)
Additional context
Add any other context about the problem here.

This issue hasn’t been updated in 3 month, if it is still an issue, please reopen this issue.


get/create/update/delete CRDs in the Rancher UI

What kind of request is this (question/bug/enhancement/feature request):
Feature request
Steps to reproduce (least amount of steps as possible):
It would be nice to have an ability to get/create/update/delete CRDs in the Rancher UI. At least to make them visible.
Result:
Maybe there can be an configuration field, where the CRD can be configured, which shows up somewhere in the project UI part as an dynamic item.
Other details that may be helpful:
Environment information

Rancher version (rancher/rancher/rancher/server image tag or shown bottom left in the UI): v2.1.5
Installation option (single install/HA): N/A

Even a raw yaml Editor would be great, because kubectl edit does not work well in "kubectl" shell on cluster tab.
For example, I'm currently updating my rook-ceph cluster to image v14.2.4-20190917, I would have a yaml editor to make this change rather than download kubeconfig and start kubectl from my workstation.

In the new Cluster Explorer view with 2.5, all CRDs are visible and you can manage those CRs directly in the Rancher UI.


Database schema

[ ] Create a schema.sql file with tables that will be analogical to the structure of the classes that you created:

books table (add all properties and associations from the parent Item class as table columns)

labels table

[[# STATUS: APPROVED :green_circle: :clap:
Hello @shaaibu7          ,
Your project is complete!  There is nothing else to say other than... it's time to merge it :shipit:
Congratulations! 🎉  Keep up the good work 🥂
HIGHLIGHTS:

[x] Descriptive P.R 💯
[x] linters are passing

Now you can merge this branch and move on :1st_place_medal:
Happy Coding cheers 🥇 💯

Every comment with the [OPTIONAL] prefix is not crucial enough to stop the approval of this PR. However, I strongly recommend you to take them into account as they can make your code better.
Feel free to leave any questions or comments in the PR thread if something is not 100% clear.
Please, remember to tag me in your question so I can receive the notification.

As described in the Code reviews limits policy  you have a limited number of reviews per project (check the exact number in your Dashboard). If you think that the code review was not fair, you can request a second opinion using this form.]]


Security doc updates

Closes #3023 and #4052

This change is

http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/331390f1b407143c53c1df3c899a2c2769c0b6ae/

http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/44b3d5ec620d6f2032ac640c2337263748d1386b/

http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/e4652a4f1693a6ce52584caf18d80e173daad1d1/

http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/0796eb350680a821110d5c7cda55c134c20413af/

v19.1/authentication.md, line 7 at r2 (raw file):
Previously, sploiselle (Sean Loiselle) wrote…
I think the prevalence of the term SSL merits the change:
https://trends.google.com/trends/explore?geo=US&q=digital certificate,ssl

Wow, good point, Sean. Shouldn't we technically use TLS? Even that is way more prevelant than digital certificate. https://trends.google.com/trends/explore?geo=US&q=digital certificate,tls
Amruta, can you open an issue to look into this more and address?

v19.1/authentication.md, line 7 at r2 (raw file):
Previously, jseldess (Jesse Seldess) wrote…
Wow, good point, Sean. Shouldn't we technically use TLS? Even that is way more prevelant than digital certificate. https://trends.google.com/trends/explore?geo=US&q=digital certificate,tls
Amruta, can you open an issue to look into this more and address?

I think these are better comparison:
digital certificate vs ssl certificate: https://trends.google.com/trends/explore?geo=US&q=digital certificate,ssl certificate
digital certificate vs tls certificate: https://trends.google.com/trends/explore?geo=US&q=digital certificates,tls certificate

The certs we use are not SSL certificates; they are TLS certificates. I used the term digital certs because it's the term most associated with public key cryptography and independent of the changes in technology (SSL/TLS). In the PKI section, I am discussing digital certs in general and not SSL/TLS certs in particular.

@jseldess Yes, the PR addresses the issues listed. I had fixed major issues while revamping the security docs; this PR addresses the minor ones (didn't know about these issues back then).

@Amruta-Ranade TIL! I think it would be useful to do something to capture people who are looking for SSL certificates, or explain that all of these types of certificates are commonly referred to as the same thing, though they are in fact different.

Looked into this some more this and realized my confusion centers on the fact that you use these certificates with the Postgres feature ssl-mode. So, even though we've inherited an inaptly named feature, I think it's important to do our best to ensure that our documentation aligns with the mental model of our product. It's unintuitive to me, at least, that you use "digital certificates" or "TLS certificates" when the URI parameter is called "ssl-mode".


Wrong town and line-breaking issue

Hello everybody, I found some issues at your page. They are small and I don't want to flood the "Issues" section, so I put them into this one issue.

at the page https://studenten-bilden-schueler.de/standorte/hamburg the first line of the text says: „Der Standort Oldenburg befindet sich gerade in Gründung.“ It should rather say „Der Standort Hamburg befindet sich gerade in Gründung.“
In the school kids application form at https://studenten-bilden-schueler.de/anmeldung?type=Schüler&chapter=Hamburg there is at the screen size of my phone several time a wrong hypothenation of the word „Bestätigungsemail“ displayed. It is seen as „Bestätigungse-mail“, but should be „Bestätigungs-email“ instead. I think a shy hyphen should suffice to fix this minimal issue.

If you like, I could try to fix it on my own and submit a pull request containing the changes.
EDIT: I take my offering back 😅 the sourcecode looks completely different to that little HTML I know...

Thanks for letting us know! As you already seem to have noticed, our content isn't actually part of this repo but lives in Contentful. As a result, this is not something you can fix yourself but I went ahead and published fixes. Please let us know if you find further typos/bugs/errors! 👍


processing

What does this PR do?
Add Resource(s)
For resources
Processing
Description
Language to programm multimedia documente
Why is this valuable (or not)
programming...
How do we know it's really free?
GPL v2 https://fr.flossmanuals.net/processing/a-propos-de-ce-manuel/
For book lists, is it a book?
yes
Checklist:

[x] Not a duplicate
[ ] Included author(s) if appropriate
[x] Lists are in alphabetical order
[ ] Needed indications added (PDF, access notes, under construction)

Thanks for the addition!


Can a MQTT client check whether another client is connected/alive?

Hello Experts!
For a MQTT broker's client A, is it possible to verify whether another client B (a sensor device) is currently connected. Or - if not possible - can client A subscribe for a topic from client B and can A then distinguish whether the topic message from B (if delivered) is a last-will message or a regular "alive" message?
Thanks
Karlo

Hi,
you can build your own keep alive message system. Client A can publish something like "client-a/alive" every couple of seconds and another client can subscribe to it. But then client B requires some logic to determine whether client A is offline or online.
Another option is, as you already mentioned, the "will" message. You can specify the will message as something like "client-a/status" with payload "offline" and set the retain flag to true. Then every client will get that offline state after subscribing even if client-a is offline. After connecting client-a must set the retained message with topic "client-a" status to "online".
Best regards
Christian

Ok, I understand. Thanks!


ci: merge staging to master

This is an automatic PR generated by the pipeline CI/CD. This will be automatically fast-forward merged if successful.

Pipeline Attempt on<PHONE_NUMBER> for 429aeab678c04badf060d9a52010a015b496a7fc
https://gitlab.com/MatrixAI/open-source/js-mdns/-/pipelines/1031110618

Pipeline Attempt on<PHONE_NUMBER> for ea7a9fa770602a36500890e64fc4fb960b8f8ad5
https://gitlab.com/MatrixAI/open-source/js-mdns/-/pipelines/1031481043

Pipeline Succeeded on<PHONE_NUMBER> for ea7a9fa770602a36500890e64fc4fb960b8f8ad5
https://gitlab.com/MatrixAI/open-source/js-mdns/-/pipelines/1031481043

Pipeline Attempt on<PHONE_NUMBER> for b54ed8f0daa266d1ccb2d5dd43843f9bf3175aa8
https://gitlab.com/MatrixAI/open-source/js-mdns/-/pipelines/1031488413

Pipeline Succeeded on<PHONE_NUMBER> for b54ed8f0daa266d1ccb2d5dd43843f9bf3175aa8
https://gitlab.com/MatrixAI/open-source/js-mdns/-/pipelines/1031488413


Post-0.1, pre-releases should not be uploaded to the canonical RPM repository

Replaced by https://clusterhq.atlassian.net/browse/FLOC-506
Our tutorial Vagrantfile (and any users who are installing the Flocker RPMs manually) download RPMs from the canonical repository. We should therefore not upload pre-releases there, only stable releases.
Blocked on:

[ ] #662 A mechanism for building RPMs with pre-release version numbers

We are moving our development planning to JIRA. This issue is now being tracked at https://clusterhq.atlassian.net/browse/FLOC-506. You are welcome to file additional issues in GitHub if that's easier for you.


Support change idle time

for everyone

Is this ever going to be merged to the master branch? It's a great feature and one that I could use with much appreciation on a current project (SPA) where different steps have different idle timeout requirements.

@pdbq21 Will, you merge this or is there anything wrong with it?


Adding Location Map through Layout & Objects Tab

HI Steve,
I am not sure if I am using the MuraLocations plugin correctly or not but I was wondering should it be ok to include the MuraLocations plugin in a page through the Layout & Objects Tab?
When I do add the plugin this way, none of the MuraLocationsMap Options are being used, the default values are always used.
I added the plugin this way, went to the Layout & Objects Tab, selected "Plugins" from the Content Objects drop down menu, those selected "MuraLocations". Finally I selected "Locations Map" and clicked it across to the main content. The maps appears and has all the pins it should have but it always uses the default values in this case no matter what I change in the MuraLocationsMap Options.
I know I could use a line of code like this to override the default values:
[mura]$.muraLocations.dspLocationsMap(displayTravelMode=false, mapType='ROADMAP',displayDirections=false,mapHeight=200)[/mura]
but from a client point of view it would be far better for them to include the plugin from the  Layout & Objects Tab as they are familiar and comfortable using this.
Any advice would be appreciated.
Best Regards
Chris

@kriskrosinteractive, sorry for the delay in responding. However, it sounds like you're doing a couple of things together and the code is getting stepped on. You need to choose one option or the other, not both.
Option 1: Add Folder/MuraLocationsMap
If you add a content item of type MuraLocationsMap then you shouldn't go to the Layout & Objects tab at all. The map will just appear based on the settings provided.
Option 2: Display Object
Currently, the display object is not configurable from the User Interface, however I'll flag this ticket as a feature request and will keep it in mind when I have time.
Hope that makes sense,
Steve


feat(Form): add Standard Schema support

❓ Type of change

[ ] 📖 Documentation (updates to the documentation or readme)
[ ] 🐞 Bug fix (a non-breaking change that fixes an issue)
[ ] 👌 Enhancement (improving an existing functionality)
[x] ✨ New feature (a non-breaking change that adds functionality)
[x] 🧹 Chore (updates to the build process or auxiliary tools and libraries)
[ ] ⚠ Breaking change (fix or feature that would cause existing functionality to change)

📚 Description
An union of schema library authors (Zod, Valibot, ArkType, ...) collaborating on a standard interface for schema libraries called Standard Schema. This simplifies implementation and prevents vendor lock-in. So far Valibot v1 supports this spec and Zod will follow soon. This PR adds support for all schema libraries that follow this v1 of this spec in the future.

In the long run, the explicit implementation of Valibot and Zod specific code can be removed from Nuxt UI.

📝 Checklist

[ ] I have linked an issue or discussion.
[ ] I have updated the documentation accordingly.

@romhml Should we handle this in v3 as well?

@benjamincanac the PR already targets v3. We can look into integrating this into v2 and removing the explicit implementation from v3 whenever valibot and zod will release this.

Thanks @fabian-hiller! 😊

You you! 🚀


Build a Nightlife Coordination App: Demo app is not working

Affected page

https://www.freecodecamp.org/learn/coding-interview-prep/take-home-projects/build-a-nightlife-coordination-app
Your code

N/A

Expected behavior

When I click the demo app link (https://yoyo44.herokuapp.com/), the demo app should pop up.
Screenshots

System

Device: N/A
OS: N/A
Browser: N/A
Version: N/A

Additional context

On this page, it asks the user to create an app that is similar to https://yoyo44.herokuapp.com/. However, https://yoyo44.herokuapp.com/ is not working.

@moT01 let's transfer over the source code to the demo projects and get it hosted like the others.

Closing in favor of https://github.com/freeCodeCamp/freeCodeCamp/issues/48950 to hopefully give it some attention.


Add a Phar with dependencies

I think drift could benefit from a phar with dependencies, as that would remove all conflicts caused by the dependencies.

I definitely agree, and I've been thinking about this while on holiday. Shouldn't be too hard at all using Box. :+1: I'm happy to implement this when I'm back in about a week's time if no one else has. 👌🏻

Awesome! I think we should do like rector does and have another repository called drift-prefixed.
This way people can require the phar via composer


Azure Active Directory Redirect URL always routing htttp

I uploaded the azure environment with powershell and I configured all environment for the Azure AD but redirect_url always set http.

What type of deployment are you using? Docker or Code publish?

Docker

Closed as no longer valid issue. AAD Login is now using SPA mode with JWT.


Changing pfp length to avoid authentication error (& ORCID text)

Changed profile picture length of field to 2048 to avoid long Google URL links for profile pictures (ex. URL was 1042 characters in length).

Not possible to easily change type from FileType to text unfortunately.

Also changed ORCID to text-based field instead of character.

Sorry, you also need to run makemigrations to create the actual migration that accompanies these changes.


video-extensions.json returns empty object

In trying to use is-video in the browser I saw that require('video-extensions') was returning an empty object.
I changed the first line of video-extensions.json from
[
// ...
]

to
exports = module.exports = [
// ...
]

I'm sure this has something to do with the differences in Node.js' native commonJS implementation vs. how webpack performs it but I'm not sure exactly what.
This also affects the image-extensions module.

Open an issue on Webpack. This works fine on Node.js and with Browserify.


Support intrumentation for  LogNet grpc-client-spring-boot-starter

Currently gRPC  instrumentation is supported for Lognet grpc-spring-boot-starter, but not for a gRPC client that use Lognet grpc-client-spring-boot-starter,
In this case BraveGrpcAutoConfiguration is not loaded because class 'org.lognet.springboot.grpc.GRpcGlobalInterceptor' is not in classpath
I think will be fine that BraveGrpcAutoConfiguration take this into account, with a solution similar to  this other: https://github.com/yidongnan/grpc-spring-boot-starter/issues/194

We are not planning on adding any new features for Sleuth


[Bug]: the function delete_nodes() in file llama_index/core/indices/vector_store/base.py has a bug

Bug Description
def delete_nodes(
        self,
        node_ids: List[str],
        delete_from_docstore: bool = False,
        **delete_kwargs: Any,
    ) -> None:
        """
        Delete a list of nodes from the index.

        Args:
            node_ids (List[str]): A list of node_ids from the nodes to delete

        """
        # delete nodes from vector store
        self._vector_store.delete_nodes(node_ids, **delete_kwargs)

        # delete from docstore only if needed
        if (
            not self._vector_store.stores_text or self._store_nodes_override
        ) and delete_from_docstore:
            for node_id in node_ids:
                self._docstore.delete_document(node_id, raise_error=False)

bwteen the line "self._vector_store.delete_nodes(node_ids, **delete_kwargs)” , the  function delete_nodes is not  implemented
Version
0.10.63
Steps to Reproduce
when run the function delete_nodes, an error  has been occurred, raise NotImplementedError("delete_nodes not implemented")
Relevant Logs/Tracbacks
No response

@Gzj369 what vector store are you using? It's not implemented for every vector store (although PRs are welcome)
(Also not bug in this case)

@Gzj369 what vector store are you using? It's not implemented for every vector store (although PRs are welcome)
(Also not bug in this case)

@logan-markewich I use the faiss vector store, and I  have been searched a few about delete* function in some source code files, but found them not implemented yet, please help have a look

Yea, delete_nodes is not implemented for faiss. In fact, I don't think any delete method is?
https://github.com/run-llama/llama_index/blob/e0866ceee846b9c09f37bd4478b458b65f4c6e43/llama-index-integrations/vector_stores/llama-index-vector-stores-faiss/llama_index/vector_stores/faiss/base.py#L176
I'd suggest picking any other vector store, or figuring out a PR to update it

Yea, delete_nodes is not implemented for faiss. In fact, I don't think any delete method is?
https://github.com/run-llama/llama_index/blob/e0866ceee846b9c09f37bd4478b458b65f4c6e43/llama-index-integrations/vector_stores/llama-index-vector-stores-faiss/llama_index/vector_stores/faiss/base.py#L176
I'd suggest picking any other vector store, or figuring out a PR to update it

@logan-markewich ok, thanks a lot, I will search the internet for more solution.
By the way,  another question from here

I cannot understand the differences between the function  vector_store.add(nodes) and index.insert_nodes(nodes), which function should I use in what scenario?
As I use the faiss vector store, I have been tried to use the function of vector_store.add(nodes), found it cannot really work, until  change to use  the function of  index.insert_nodes(nodes), it can work,
please help have a look

index.insert_nodes handles inserting into the docstore and index store as well, which faiss needs, because it cannot store text
Other vector stores can store text, and don't need the docstore and index store, so inserting directly into the vector store works there

@logan-markewich Okay, thank you very much!
delete_nodes is not implemented for faiss, I have just  been implemented this function, and it has been tested pass. Please help have a look
def faiss_delete_vector(faiss_vector_store: FaissVectorStore, vector):
    # get Faiss Index object
    index = faiss_vector_store._faiss_index

    # get vector's indice
    distances, indices = index.search(vector, 1)
    logger.info(f"----------indices:{indices}")

    # delete vector
    if len(indices) > 0 and indices[0][0] >= 0:
        index.remove_ids(indices[0])
        faiss_vector_store._faiss_index = index
        return str(indices[0][0])
    else:
        logger.warning("Vector not found.")
        return None

def delete_nodes(
        faiss_vector_index: VectorStoreIndex,
        faiss_vector_store: FaissVectorStore,
        nodes: List[BaseNode],
        **add_kwargs: Any,
    ) -> None:
    """Delete nodes from vector store.

    NOTE: in the Faiss vector store, we do not store text in Faiss.

    """
    nodes = faiss_vector_index._get_node_with_embedding(nodes)
    for node in nodes:
        text_embedding = node.get_embedding()
        text_embedding_np = np.array(text_embedding, dtype="float32")[np.newaxis, :]
        text_id = faiss_delete_vector(faiss_vector_store, text_embedding_np)
        delete_id = ""
        try:
            if text_id:
                delete_id = text_id
            else:
                delete_id = node.node_id
            faiss_vector_index._index_struct.delete(delete_id)
        except:
            logger.warning(f"----------the text_id of value {delete_id} not exist!")
        faiss_vector_index._docstore.delete_document(node.node_id, raise_error=False)
    faiss_vector_index._storage_context.index_store.add_index_struct(faiss_vector_index._index_struct)


[Discussion] Improve state and event logging

For both state and event logs, at each time step, we log the reports to a log file that we open at the start of the simulation.
Each of these reports get written to the logs as a single json line like the below for a vehicle state event.
{"vehicle_id": "v13", "memberships": "", "vehicle_state": "ChargingStation", "balance":<PHONE_NUMBER>929938, "distance_traveled_km":<PHONE_NUMBER>8784205, "energy_ELECTRIC": 13.58399203772548, "link_link_id": "176107959-176080957", "link_geoid": "8f268cdacadc186", "sim_time": "1970-01-01T17:51:00", "report_type": "VEHICLE_STATE"}

Some downsides of this approach are:

performance hit writing to file at each time step
difficulty parsing the results afterwards since each entry into the log can have different entries for different report types
large file sizes for big simulations

This issue is intended as a discussion for ways to improve the reporting and then we can implement more issues for the ideas that come from it.

One idea is that we could at least write each report type to a dedicated file (rather than a single log file for all states and all events). In that way, we would eliminate the report_type information, and, we could write to file in different formats, like csv, since the report keys will always be the same for each report type.


Suggesting improvements via Lint.ai

See individual commit messages for details.  Of course, feel free to cherry-pick as needed, or if you identify a set of commit messages to include/exclude, we'll amend this new PR with only the set of changes you want to actually merge.

@MathiasDesch @qpleple


Visualization tools for ApplyForceTorque

🎉 New feature
Requires #2014
Summary

Adds visualization tools to the new ApplyForceTorque GUI plugin. This allows the user to see the force (represented by an arrow) and the torque (represented by a circle) displayed on the scene at their application point before applying them.
TODO:

[ ] Improve torque visualization
[ ] Implement rotation tool for the vectors (like in Classic)

Test it

Open any test world.
Load the Apply Force Torque plugin from the plugin dropdown.
Select a model or link and specify a force or torque to see its direction on the scene.

Checklist

[x] Signed all commits for DCO
[ ] Added tests
[ ] Added example and/or tutorial
[ ] Updated documentation (as needed)
[ ] Updated migration guide (as needed)
[ ] Consider updating Python bindings (if the library has them)
[x] codecheck passed (See contributing)
[x] All tests passed (See test coverage)
[ ] While waiting for a review on your PR, please help review another open pull request to support the maintainers

Note to maintainers: Remember to use Squash-Merge and edit the commit message to match the pull request summary while retaining Signed-off-by messages.

@Henrique-BO this is really cool. It would be nice if we could extract the rendering logic out to some common area so it can be shared by other plugins. #1898 seeks to do visualizations but on arbitrary objects. It would be nice to have a consistent vsiaul language between these two PRs. Perhaps if you were to create a new utility class called "Force Visuallization" and make the material configurable, we would be able to reuse this code in #1898.

Sounds awesome!

Changes addressed in b5cafc3.
The 3D scene interaction is working on my end, like this:
https://github.com/gazebosim/gz-sim/assets/49255495/425f466a-e4dd-4de4-aaed-b23a456e58c3
Is this not working for you?

Good point, I added a message to the GUI in 419b34f


Metro.utils.isObject(val);

Other types of detection functions.
Temporary unused
This is used, and I think it should be a return to false or true value, rather than returning an object, and the function will report errors when it is not an object.
hope function that wants to detect types
Everything ought to be such
The second parameter is open  ,return content.
var a = Metro.utils.isObject(data);
a  true or false
var b = Metro.utils.isObject(data,true);
b  content

The behavior of the function will not change


[docs/enhancement} - uber/ludwig - README.md

[docs/enhancement} - uber/ludwig - README.md

Thank yo ufor this, will review and then merge!


Using zip results in 3-4x slower code compared to indexing

This could be because it is used repeatedly in a small loop within a much bigger loop. Here is code to reproduce:
import numpy as np
import numba

def moments_central_nb(image, center=None, use_zip=True, order=3):
    mu = np.zeros((order + 1,) * image.ndim)
    if center is None:
        center = np.mean(np.column_stack(np.nonzero(image)), axis=0)
    if use_zip:
        _moments_central_nb_loop(image, center, mu)
    else:
        _moments_central_nb_loop_nozip(image, center, mu)
    return mu

@numba.njit
def _moments_central_nb_loop(image, center, mu):
    for coord, val in np.ndenumerate(image):
        if val > 0:
            for powers in np.ndindex(mu.shape):
                curval = val
                for c, ctr, p in zip(coord, center, powers):
                    dc = c - ctr
                    cr = 1
                    for pcount in range(p):
                        cr *= dc
                    curval *= cr
                mu[powers] += curval

@numba.njit
def _moments_central_nb_loop_nozip(image, center, mu):
    for coord, val in np.ndenumerate(image):
        if val > 0:
            for powers in np.ndindex(mu.shape):
                curval = val
                for i in range(image.ndim):
                    c, ctr, p = coord[i], center[i], powers[i]
                    dc = c - ctr
                    cr = 1
                    for pcount in range(p):
                        cr *= dc
                    curval *= cr
                mu[powers] += curval

Then time it with:
# get some data
from skimage import data
horse = data.horse().astype(float)

# compute the centroid
center = np.mean(np.column_stack(np.nonzero(horse)), axis=0)

# warm up the JIT
_ = moments_central_nb(horse, center=center, use_zip=True)
_ = moments_central_nb(horse, center=center, use_zip=False)

# time it
%timeit moments_central_nb(horse, center=center, use_zip=True)
%timeit moments_central_nb(horse, center=center, use_zip=False)

On my machine, use_zip=True takes 500ms, while use_zip=False takes 150ms. It's worth noting that the tuples being zipped have a length of just 2. This might be expected behavior compared to indexing. If so, feel free to close.

It's worth noting that the tuples being zipped have a length of just 2.

Not sure if it matters, but the horse image has shape (328, 400, 4), so these tuples have length 3, not 2.
In [10]: import numpy as np

In [11]: from skimage import data

In [12]: horse = data.horse().astype(float)

In [13]: center = np.mean(np.column_stack(np.nonzero(horse)), axis=0)

In [14]: print center
[<PHONE_NUMBER>8<PHONE_NUMBER>4    1.65896038]

@stuarteberg I think that you have an older version of skimage or some kind of plugin conflict:
In [1]: from skimage import data
In [2]: horse = data.horse()
In [3]: horse.shape
Out[3]: (328, 400)

Probably something to discuss on scikit-image issues rather than here. ;)

As of 0.51.2 this seems less bad but still  present.
471 µs ± 103 ns per loop (mean ± std. dev. of 7 runs, 1000 loops each)
532 µs ± 4.64 µs per loop (mean ± std. dev. of 7 runs, 1000 loops each)


fix: lower the block production wait cutoff time for timely proposal publish

3 second cutoff seems to be very tight as it could take 2+ seconds to publish and peers don't seem to be including the block if arrives later than 4 second into slot

:tada: This PR is included in v1.10.0 :tada:


WIP:  FCP 7 XML - Fix failure on empty name tags

Empty or missing name elements in FCP XML use empty string for names instead of failing trying to instantiate OTIO objects with None names.
Closes #673
Marked WIP because I'd really like to get a real-world test file to test this against.

Codecov Report

Merging #674 into master will decrease coverage by 0.02%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #674      +/-   ##
==========================================
- Coverage   81.69%   81.67%   -0.03%
==========================================
  Files          72       72
  Lines        2731     2728       -3
==========================================
- Hits         2231     2228       -3
  Misses        500      500

Flag
Coverage Δ

#py27
?

#py36
81.67% <ø> (ø)

#py37
?

Impacted Files
Coverage Δ

...ntimelineio/opentimelineio-bindings/otio_utils.cpp
87.05% <0.00%> (-0.16%)
:arrow_down:

...elineio/opentimelineio-bindings/otio_anyVector.cpp
100.00% <0.00%> (ø)

...eio/opentimelineio-bindings/otio_anyDictionary.cpp
100.00% <0.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9d010f2...4a9a243. Read the comment docs.

PR is no longer WIP, ready for review.