Job failing on CDH 5.8.2 - Executor Heartbeat timing out

I'm running the below command:
spark-submit --master yarn --deploy-mode client --queue cpu --num-executors 2 --executor-memory 4G --py-files TensorFlowOnSpark/examples/mnist/spark/mnist_dist.py --conf spark.dynamicAllocation.enabled=false --conf spark.yarn.maxAppAttempts=1 --conf spark.executor.heartbeatInterval=1200s --conf spark.executorEnv.LD_LIBRARY_PATH="/opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib:/usr/lib/jvm/java-7-oracle-cloudera/jre/lib/amd64/server" TensorFlowOnSpark/examples/mnist/spark/mnist_spark.py --images hdfs:///user/mayub/mnist/csv/train/images --labels hdfs:///user/mayub/mnist/csv/train/labels --mode train --model hdfs:///user/mayub//mnist/mnist_model2
After waiting for a while the job fails with the below error;
"Removing executor 2 with no recent heartbeats: 172657 ms exceeds timeout 120000 ms"
I have tried running this in couple of ways:
Option 1: Client mode
Variables -
$LIB_HDFS = /opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib/
$LIB_JVM= /usr/lib/jvm/java-7-oracle-cloudera/jre/lib/amd64/server
spark-submit --master yarn --deploy-mode client --queue cpu --num-executors 2 --executor-memory 4G --py-files TensorFlowOnSpark/examples/mnist/spark/mnist_dist.py --conf spark.dynamicAllocation.enabled=false --conf spark.yarn.maxAppAttempts=1 --conf spark.executor.heartbeatInterval=1200s --conf spark.executorEnv.LD_LIBRARY_PATH="/opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib:/usr/lib/jvm/java-7-oracle-cloudera/jre/lib/amd64/server" TensorFlowOnSpark/examples/mnist/spark/mnist_spark.py --images hdfs:///user/mayub/mnist/csv/train/images --labels hdfs:///user/mayub/mnist/csv/train/labels --mode train --model hdfs:///user/mayub//mnist/mnist_model2
Error log File: "Executor Heartbeat timing out"
spark_client_mode.txt
Option 2: cluster mode
Variables -
$LIB_HDFS = /opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib/
$LIB_JVM= /usr/lib/jvm/java-7-oracle-cloudera/jre/lib/amd64/server
Command:
spark-submit --master yarn --deploy-mode cluster --queue cpu --num-executors 1 --executor-memory 2G --py-files TensorFlowOnSpark/examples/mnist/spark/mnist_dist.py --conf spark.dynamicAllocation.enabled=false --conf spark.yarn.maxAppAttempts=1 --conf spark.executorEnv.LD_LIBRARY_PATH=$LIB_JVM:$LIB_HDFS TensorFlowOnSpark/examples/mnist/spark/mnist_spark.py --images hdfs:///user/mayub/mnist/csv/train/images --labels hdfs:///user/mayub/mnist/csv/train/labels --mode train --model hdfs:///user/mayub//mnist/mnist_model2
Error Log File: "Job just hangs and then fails after running for a while while"
spark_hanging_job.txt
Option 3: with additional Cloudera configs
Variables -
$LIB_HDFS = /opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib/
$LIB_JVM= /usr/lib/jvm/java-7-oracle-cloudera/jre/lib/amd64/server
Command:
spark-submit --master yarn --deploy-mode client --queue cpu --num-executors 2 --executor-memory 4G --py-files TensorFlowOnSpark/examples/mnist/spark/mnist_dist.py --conf spark.dynamicAllocation.enabled=false --conf spark.yarn.maxAppAttempts=1 --conf spark.executor.heartbeatInterval=1200s --conf spark.executorEnv.LD_LIBRARY_PATH="/opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib:/usr/lib/jvm/java-7-oracle-cloudera/jre/lib/amd64/server" TensorFlowOnSpark/examples/mnist/spark/mnist_spark.py --images hdfs:///user/mayub/mnist/csv/train/images --labels hdfs:///user/mayub/mnist/csv/train/labels --mode train --model hdfs:///user/mayub//mnist/mnist_model2
Error- same error as option 1.
Just to validate that if other spark-submit jobs are running fine. I ran a spark word count example and it ran fine.
Appreciate any help.

Found this in your spark_hanging_job.txt:
18/06/19 10:22:50 ERROR cluster.YarnClusterScheduler: Lost executor 2 on cluster-01.example.com: Container killed by YARN for exceeding memory limits. 2.6 GB of 2.5 GB physical memory used. Consider boosting spark.yarn.executor.memoryOverhead.

Looks like you may need to adjust your memory settings.

@leewyang  Thanks I have changed my memory settings ran the below command:
spark-submit --master yarn --deploy-mode client --queue cpu --num-executors 4 --executor-memory 8G --driver-memory 4G --py-files TensorFlowOnSpark/examples/mnist/spark/mnist_dist.py --conf spark.dynamicAllocation.enabled=false --conf spark.yarn.maxAppAttempts=1 --conf spark.yarn.executor.memoryOverhead=1600 --conf spark.yarn.driver.memoryOverhead=720 --conf spark.executor.heartbeatInterval=1200s --conf spark.executorEnv.LD_LIBRARY_PATH="/opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib:/usr/lib/jvm/java-7-oracle-cloudera/jre/lib/amd64/server" TensorFlowOnSpark/examples/mnist/spark/mnist_spark.py --images hdfs://nn:8020/user/mayub/mnist/csv/train/images --labels hdfs://nn:8020/user/mayub/mnist/csv/train/labels --mode train --model hdfs://nn:8020/user/mayub/mnist/mnist_model2
I also explicitly had to specify the namenode and port. But still no success. I think I'm running into this issues #Issues257
I'm attaching the log file from the yarn applicationId for your confirmation. Not sure if this is resolution I need to apply.
Uploading spark_log_application_1529599655665_0004.txt…

Thanks !

Your log file didn't come through.  Can you post?

Also, note that you ended up with 8 executors, even though you requested 4 with dynamicAllocation.enabled=false.  That would result in that symptom.

spark_log_application_1529599655665_0004.txt
Sorry here is the log file.
So how can I avoid this symptom of ending up with more than required executors ?

What versions do you have installed for:

spark
tensorflowonspark
tensorflow

Also, I'm assuming you've pip installed TF and TFoS on all of your grid nodes?
Can you grab the full yarn logs of a failed attempt via yarn logs -applicationId <your_appId> >yarn.log?

Also you can also try setting (just in case dynamic allocation is still enabled):
--conf spark.dynamicAllocation.maxExecutors=4
--conf spark.dynamicAllocation.minExecutors=4

Thanks @leewyang  Here are the required info:
Small cluster of 3 machines running CDH 5.8.2, I have Spark 1.6 installed on all machines. I have pip installed TF and TFoS as suggested in the documentation. Below are the verification snaphots
Here  is the yarn log file:
yarn_appid_1529599655665_0004_logfile.txt

Meanwhile, let me try running today with the conf's you specified.

@leewyang
Added configs:
--conf spark.dynamicAllocation.maxExecutors=4 --conf spark.dynamicAllocation.minExecutors=4
Query:
spark-submit --master yarn --deploy-mode client --queue cpu --num-executors 4 --executor-memory 8G --driver-memory 4G --py-files TensorFlowOnSpark/examples/mnist/spark/mnist_dist.py --conf spark.dynamicAllocation.enabled=false --conf spark.dynamicAllocation.maxExecutors=4 --conf spark.dynamicAllocation.minExecutors=4 --conf spark.yarn.maxAppAttempts=1 --conf spark.yarn.executor.memoryOverhead=1600 --conf spark.yarn.driver.memoryOverhead=720 --conf spark.executor.heartbeatInterval=1200s --conf spark.executorEnv.LD_LIBRARY_PATH="/opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib:/usr/lib/jvm/java-7-oracle-cloudera/jre/lib/amd64/server" TensorFlowOnSpark/examples/mnist/spark/mnist_spark.py --images hdfs://nn:8020/user/mayub/mnist/csv/train/images --labels hdfs://nn:8020/user/mayub/mnist/csv/train/labels --mode train --model hdfs://nn:8020/user/mayub/mnist/mnist_model2
Still getting the timeout error on executors.
Attached is the yarn log for the same:
yarn_log_after_adding_configs.txt

I see the following in your logs:
tensorflow model path: hdfs://nn:8020/user/mayub/mnist/mnist_model2
18/06/25 12:53:02 INFO python.PythonRunner: Times: total = 2266, boot = -1098, init = 1154, finish = 2210
18/06/25 12:53:02 INFO python.PythonRunner: Times: total = 123, boot = 3, init = 36, finish = 84
hdfsBuilderConnect(forceNewInstance=0, nn=nn:8020, port=0, kerbTicketCachePath=(NULL), userName=(NULL)) error:
java.lang.IllegalArgumentException: java.net.UnknownHostException: nn
        at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:406)
        at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:310)
        at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:176)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:727)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:670)
        at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2696)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:94)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2733)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2715)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:382)
        at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:171)
        at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:168)
Caused by: java.net.UnknownHostException: nn

Sorry here is the correct query I ran:
spark-submit --master yarn --deploy-mode client --queue cpu --num-executors 4 --executor-memory 8G --driver-memory 4G --py-files TensorFlowOnSpark/examples/mnist/spark/mnist_dist.py --conf spark.dynamicAllocation.enabled=false --conf spark.dynamicAllocation.maxExecutors=4 --conf spark.dynamicAllocation.minExecutors=4 --conf spark.yarn.maxAppAttempts=1 --conf spark.yarn.executor.memoryOverhead=1600 --conf spark.yarn.driver.memoryOverhead=720 --conf spark.executor.heartbeatInterval=1200s --conf spark.executorEnv.LD_LIBRARY_PATH="/opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib:/usr/lib/jvm/java-7-oracle-cloudera/jre/lib/amd64/server" TensorFlowOnSpark/examples/mnist/spark/mnist_spark.py --images hdfs://<IP_ADDRESS>:8020/user/mayub/mnist/csv/train/images --labels hdfs://<IP_ADDRESS>:8020/user/mayub/mnist/csv/train/labels --mode train --model hdfs://<IP_ADDRESS>:8020/user/mayub/mnist/mnist_model2
Getting this error;
"AttributeError: 'NoneType' object has no attribute 'get'"
here is the yarn log for the same:
spark_submit_after_adding_configs_10.txt

@mohammedayub44 that log shows the following: PermissionDeniedError: hdfs://<IP_ADDRESS>:8020/user/mayub/mnist/mnist_model2; Permission denied
Note: the 'NoneType' error is typically a symptom of an upstream error, not a root cause.  To help identify the root cause, you can try adding --conf spark.task.maxFailures=1 to your spark-submit command line.
And, FWIW, I used the following to find this error: egrep -i "error|exception|exceed" spark_submit_after_adding_configs_10.txt.  Note that you can usually ignore most of the repeated errors (since they're usually logged by Spark is shutting down due to errors), and just look for anything "unique".

@leewyang  Thank you for finding the root cause. Spark-submit was cleverly deceiving me with all other errors. I command ran successfully after the permission changes.
I also found that owner of this process is "yarn"  (attached pic below) when it's writing the trained model folder into HDFS (but not the predictions folder) so I had to change the permissions of my HDFS folder to allow write access to 'yarn' user.
How can i change this behavior to run/write as my username, instead of changing permissions etc. ?

Just to summarize the issue and resolution for future reference.
I removed the following configurations from query as  --num-executors 4 implicitly sets dynamic allocation to false.
--conf spark.dynamicAllocation.enabled=false
--conf spark.dynamicAllocation.maxExecutors=4
--conf spark.dynamicAllocation.minExecutors=4
Also, removed absolute NN pathnamee from train, test, model and output HDFS directories as relative path names resolve successfully.
I had to tune the following parameters according to the setting in my Cloudera cluster (please don't blindly use the ones from the example)
--executor-memory 8G
--driver-memory 4G
--conf spark.yarn.executor.memoryOverhead=1600
--conf spark.yarn.driver.memoryOverhead=720
Add permissions to model output folder.
$hdfs dfs -chmod 777 /user/mayub/mnist/mnist_model
Here is the final query that worked in both 'client' and 'cluster' mode.
Training:
spark-submit --master yarn --deploy-mode cluster --queue cpu --num-executors 4 --executor-memory 8G --driver-memory 4G --py-files TensorFlowOnSpark/examples/mnist/spark/mnist_dist.py --conf spark.yarn.maxAppAttempts=1 --conf spark.yarn.executor.memoryOverhead=1600 --conf spark.yarn.driver.memoryOverhead=720 --conf spark.executorEnv.LD_LIBRARY_PATH="/opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib:/usr/lib/jvm/java-7-oracle-cloudera/jre/lib/amd64/server" TensorFlowOnSpark/examples/mnist/spark/mnist_spark.py --images /user/mayub/mnist/csv/test/images --labels /user/mayub/mnist/csv/test/labels --mode train --model /user/mayub/mnist/mnist_model
Inference
 spark-submit --master yarn --deploy-mode cluster --queue cpu --num-executors 4 --executor-memory 8G --driver-memory 4G --py-files TensorFlowOnSpark/examples/mnist/spark/mnist_dist.py --conf spark.yarn.executor.memoryOverhead=1600 --conf spark.yarn.driver.memoryOverhead=720 --conf spark.executorEnv.LD_LIBRARY_PATH="/opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib:/usr/lib/jvm/java-7-oracle-cloudera/jre/lib/amd64/server" TensorFlowOnSpark/examples/mnist/spark/mnist_spark.py --images /user/mayub/mnist/csv/test/images --labels /user/mayub/mnist/csv/test/labels --mode inference --model /user/mayub/mnist/mnist_model --output /user/mayub/mnist/predictions
@leewyang  Thanks for your help. I'll go ahead and close this, but would like your thoughts on my earlier comment on 'yarn' user.

@mohammedayub44 glad you got it working!  As for the 'yarn' user thing, it's something that only a few folks have seen (see #210), and it's hard for me to debug, since I don't see this in my environment.  Hoping someone in the community can get to the bottom of it...

$hdfs dfs -chmod 777 /user/mayub/mnist/mnist_model

That did the trick. Thanks.


Kotlin JS

Hey,
any chance to get Kotlin JS support? Would be nice in combination with jetbrains compose web.
Thanks for considering!

Hi @Burtan. We are looking into JS support, but there are quite a few technical challenges associated with it, like building the core database for WebAssembly and making sure the threading model will still work. So we don't really have any sort of timeline for it yet.

I'm curious if this is more feasible now with the Kotlin/WASM target. Would it be as simple as adding the following target to build.gradle.kts files?
wasm {
  browser
}

@cmelchior what do you mean by not working? As in there is something within Realm that needs to be updated or that the Kotlin/WASM target is in alpha and has some bug that affects Realm? If it's the former, I might be interested in contributing to get this working as I have decided to invest pretty heavily in Realm for my side project 😁

The core of realm is not written in kotlin. This project just contains the bindings.

@gxhenderson There are two limitations:

WASM is a lot more restricted than "normal" native code since it is running inside the browser sandbox. That has large implications on which APIs we have available in C++ and required us to modify parts of https://github.com/realm/realm-core. We have started this work, but there is still more to do. You can see the initial PR here: https://github.com/realm/realm-core/pull/6263

With Realm Core compiling against WASM, it should, in theory, be possible to enable the JS target, but there is a fair amount of expect/actual implementations in Realm Kotlin that only support Native, JVM and Android, those would have to be extended with JS support. After that we might run into architectural issues. The current codebase is heavily designed as multi-threaded and I suspect some of these designs would have to be re-worked for JS support.

While we appreciate the offer to help, I'm not sure the current state of this project is suitable for external collaboration, but I'll let you know when that changes.

Thanks for this extra context and all the work the team is putting into supporting this! Excited to see how this goes.

im using realm for andoird/iOS and desktop but not web. I'm trying to run web without realm but I keep on receiving errors because realm doesn't work with     js(IR) {
browser()
} but im not using realm for web. also I can't remove     js(IR) {
browser()
} because web needs it

val jsMain by getting {
dependsOn(commonMain)
dependencies {
implementation(compose.html.core)
implementation("io.realm.kotlin:library-base:$realmVersion") {
exclude(group = "io.realm.kotlin", module = "library-base")
}
implementation("io.realm.kotlin:library-sync:$realmVersion") {
exclude(group = "io.realm.kotlin", module = "library-sync")
}
}
} this won't work


rewrite improving-the-documentation.adoc

I think this is a more realistic guide to how to work on the documentation than what it replaces.  It also is an experiment about a simpler way to get a website PR/preview build.

[ERROR] Unresolved xrefs:
[ERROR]   manual:ROOT:improving-the-documentation.adoc (/Users/davsclaus/workspace/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 207: xref:eips:enterprise-integration-patterns.adoc[]
[ERROR]   manual:ROOT:improving-the-documentation.adoc (/Users/davsclaus/workspace/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 212: xref:next@components:eips:enterprise-integration-patterns.adoc[]
[ERROR]   manual:ROOT:improving-the-documentation.adoc (/Users/davsclaus/workspace/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 227: xref:user-manual::improving-the-documentation.adoc[]
[ERROR]   manual:ROOT:improving-the-documentation.adoc (/Users/davsclaus/workspace/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 260: xref:{camel-version}@camel:eips:enterprise-integration-patterns.adoc[]

I think we need to separate this into two pages / sections. One for a beginner that just want to help fixing a typo, adding a paragraph to an existing page, etc. vs Camel comitters that maintain several sub projects and needs to better understand how these are linked together, and how it works with antora etc.
The docs may be too overwhelming for the beginner that just want an easy way to contribute - eg browse the docs, click the "edit this page" in the bottom, edit/preview on github, and click submit as PR. That we absolutely need to tell so we can have new users easily contribute.

[ERROR] Unresolved xrefs:
[ERROR]   manual:ROOT:improving-the-documentation.adoc (/home/oscerd/workspace/apache-camel/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 207: xref:eips:enterprise-integration-patterns.adoc[]
[ERROR]   manual:ROOT:improving-the-documentation.adoc (/home/oscerd/workspace/apache-camel/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 212: xref:next@components:eips:enterprise-integration-patterns.adoc[]
[ERROR]   manual:ROOT:improving-the-documentation.adoc (/home/oscerd/workspace/apache-camel/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 227: xref:user-manual::improving-the-documentation.adoc[]
[ERROR]   manual:ROOT:improving-the-documentation.adoc (/home/oscerd/workspace/apache-camel/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 260: xref:{camel-version}@camel:eips:enterprise-integration-patterns.adoc[]

This needs to be fixed before 3.14.0, otherwise the build will fail

What exactly are you doing to get these errors? They are all in example blocks so the xrefs should not be evaluated, and for me they are not.
The first two xrefs are correct, they are illustrating xrefs from a different component, but the last two happen to have errors.  Still, something is different between my setup and yours, a local website build against the remote repos works fine for me.

On Dec 1, 2021, at 2:01 AM, Andrea Cosentino @.***> wrote:
[ERROR] Unresolved xrefs:
[ERROR] manual:ROOT:improving-the-documentation.adoc (/home/oscerd/workspace/apache-camel/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 207: xref:eips:enterprise-integration-patterns.adoc[]
[ERROR] manual:ROOT:improving-the-documentation.adoc (/home/oscerd/workspace/apache-camel/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 212: @.:eips:enterprise-integration-patterns.adoc[]
[ERROR] manual:ROOT:improving-the-documentation.adoc (/home/oscerd/workspace/apache-camel/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 227: xref:user-manual::improving-the-documentation.adoc[]
[ERROR] manual:ROOT:improving-the-documentation.adoc (/home/oscerd/workspace/apache-camel/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 260: @. https://github.com/Camel:eips:enterprise-integration-patterns.adoc[]
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub https://github.com/apache/camel/pull/6485#issuecomment-983477439, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAELDXSFP4DUFVAZNK234BTUOXW6PANCNFSM5I4TDTDA.

There are already two pages explaining how to work on the website.
Currently the faq page manual/faq/how-do-i-edit-the-website.html explains in perhaps appropriate detail how to use the “edit this page” button.  I added some notes on when not to try to use it.  It used to have a really incomplete description of how to do a local build: I removed that and pointed to the other page,
manual/improving-the-documentation.html which now has a note mentioning when using the “edit this page” is appropriate, and more complete instructions on more complex edits.
I did’t want to change things too much :-)
Without the constraints of history, what I’d like is to have all the instructions on the manual/improving-the-documentation.html page in  top-level sections, and a little bit of explanation with two links but no instructions on the faq page.  Shall I make that change and we can discuss the result?

On Nov 30, 2021, at 10:11 PM, Claus Ibsen @.***> wrote:
I think we need to separate this into two pages / sections. One for a beginner that just want to help fixing a typo, adding a paragraph to an existing page, etc. vs Camel comitters that maintain several sub projects and needs to better understand how these are linked together, and how it works with antora etc.
The docs may be too overwhelming for the beginner that just want an easy way to contribute - eg browse the docs, click the "edit this page" in the bottom, edit/preview on github, and click submit as PR. That we absolutely need to tell so we can have new users easily contribute.
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub https://github.com/apache/camel/pull/6485#issuecomment-983321551, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAELDXWZZYRIW56CXQLD3WDUOW37NANCNFSM5I4TDTDA.

What exactly are you doing to get these errors? They are all in example blocks so the xrefs should not be evaluated, and for me they are not. The first two xrefs are correct, they are illustrating xrefs from a different component, but the last two happen to have errors. Still, something is different between my setup and yours, a local website build against the remote repos works fine for me.
On Dec 1, 2021, at 2:01 AM, Andrea Cosentino @.> wrote: [ERROR] Unresolved xrefs: [ERROR] manual:ROOT:improving-the-documentation.adoc (/home/oscerd/workspace/apache-camel/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 207: xref:eips:enterprise-integration-patterns.adoc[] [ERROR] manual:ROOT:improving-the-documentation.adoc (/home/oscerd/workspace/apache-camel/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 212: @.:eips:enterprise-integration-patterns.adoc[] [ERROR] manual:ROOT:improving-the-documentation.adoc (/home/oscerd/workspace/apache-camel/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 227: xref:user-manual::improving-the-documentation.adoc[] [ERROR] manual:ROOT:improving-the-documentation.adoc (/home/oscerd/workspace/apache-camel/camel/docs/user-manual/modules/ROOT/pages/improving-the-documentation.adoc) at line 260: @.*** <https://github.com/Camel>:eips:enterprise-integration-patterns.adoc[] — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub <#6485 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAELDXSFP4DUFVAZNK234BTUOXW6PANCNFSM5I4TDTDA.
Plus... I triggered the jenkins build, which completed without errors: https://ci-builds.apache.org/job/Camel/job/Camel.website/job/main/575/

We are compiling camel. Look at the docs module. Maybe you should build camel when changing this stuff.

https://github.com/apache/camel/blob/main/docs/pom.xml#L102

https://github.com/apache/camel/blob/main/tooling/maven/camel-package-maven-plugin/src/main/java/org/apache/camel/maven/packaging/XRefCheckMojo.java
If this is not updated/not aligned, then we can simply skip the execution and remove it. If not, we need to fix the errors.

This is Guillaume's attempt to imitate Antora? I'm afraid this is proof that it doesn't work and needs to be removed.   I can make a PR tomorrow.

No it should not be removed, it catches a number of xref errors when we work on the project.
Instead just update the adoc file you modified and remove links etc - its not an important doc for end users

There have been a few doc changes more or less recently that moved or removed pages and broke the website build. Were they relying on this xref checker for validation? If so I think that's an additional argument for removing the xref checker.

It could be, but it's important to check the build. If you don't want to build locally at least take a look at Jenkins. I'll remove that mojo btw

So do we want to maintain the xref checker? It's true that it will show the errors, but i don't think the build should fail

I don’t think the xref checker is a good idea. It catches some xref problems within the user manual and components components but has false positives due to incomplete understanding of AsciiDoc and completely misses problems with links into these components. I think if you change the docs you need to build the website to find out if you broke anything.
Sent from my iPhone

On Dec 1, 2021, at 10:29 PM, Andrea Cosentino @.***> wrote:

So do we want to maintain the xref checker? It's true that it will show the errors, but i don't think the build should fail
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub, or unsubscribe.

I know I have to build the website, my question was related to the mojo. If the mojo is completely out of the game, we should remove it. If you modify something on Camel, you NEED to check the camel build not the website build. Website is important, a Camel green build is important too, so please, next time, check the Camel build.

If you really want to keep the xref checker I can probably insert some invisible stuff into the problematic xrefs so they aren’t recognized by the checker.
Sent from my iPhone

On Dec 1, 2021, at 10:29 PM, Andrea Cosentino @.***> wrote:

So do we want to maintain the xref checker? It's true that it will show the errors, but i don't think the build should fail
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub, or unsubscribe.

If it's giving false positives, I don't see the value of having it. We are changing stuff around the Antora content and nobody cared about this Mojo. Maybe we need to put more attention on this stuff. There's not only Antora and the website in this ecosystem.

I think I did check the PR builds for this commit, and they had failed for an unrelated check style problem. The ones I can find now certainly did. Since I’d checked the complete website build I figured it was ok.
Sent from my iPhone

On Dec 1, 2021, at 10:23 PM, Claus Ibsen @.***> wrote:

No it should not be removed, it catches a number of xref errors when we work on the project.
Instead just update the adoc file you modified and remove links etc - its not an important doc for end users
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub, or unsubscribe.

Yes, but the camel build is failing.

For example having this in docs in the core camel project, such as in bean-eip.adoc
xref:does-not-exists.adoc[XXX] bla blah
Then the validator catches this
[INFO] --- camel-package-maven-plugin:3.14.0-SNAPSHOT:xref-check (xref-check) @ docs ---
[ERROR] Unresolved xrefs:
[ERROR]   components:eips:bean-eip.adoc (/Users/davsclaus/workspace/camel/core/camel-core-engine/src/main/docs/modules/eips/pages/bean-eip.adoc) at line 14: xref:does-not-exists.adoc[XXX]
I am going to comment out / change that adoc file so the validator works and the CI builds works again - we need this for building SNAPSHOTS and to release 3.14.x
Those 4 xref failures are not useable anyway as linking to EIPs, user manual etc can easily find without a link, and this doc page is not for normal Camel users.

Okay did a "clever hack" and use XREF in upper case for that "code output". I do not know if there is some escape char you can use, so you can try to escape xref so its \x\r\e\f or something but still displayed as xref in lower case

See https://github.com/apache/camel/pull/6497 for better ugly hack.


On IE 11 and Edge SyntaxError: Expected identifier, string or number

number  -2146827274
SyntaxError: Invalid character  at ./node_modules/react-flow-renderer/dist/ReactFlow.esm.js .  I'm using 1.3.2 version. Thank you for your help in advance. :)

Hey @SvetoslavSlavov,
for now IE11 is not supported. You might be able to get it run if you configure babel to transpile to es5 with Promises polyfilled.


[h264e] Enable QPOffset by default

In CQP mode and GopRefDist 1 case
PRefType is set to MFX_P_REF_PYRAMID by default.
EnableQPOffset is on by default, QPOffset is added in CQP mode.

@DenWolf , @dmitrybrazhkin , @aleonenk , please review

@pgribov , please ping reviewers

@stasefremov , @dvrogozh , @ogolikov
ping

@DenWolf , @aleonenk Please review


[BROWSER] Opera support

Describe the browser and provide any links if available
Browser name: Opera
Opera is based on Chromium, so it should be easy to add support for it given you find the history location. The history_SQL, history_file, etc. can be set to be the same as Chrome/Chromium. Look at the implementation of Edge for ideas (#24)
List the platforms supported by the browser to be added
Platforms:

[ ] Windows
[ ] Linux
[ ] Mac OS

Hey, I'd like to work on this issue

Yes! Go ahead. Any idea on what platforms you want to add support for? This helps us in assigning the remaining ones to anybody else. Also, If you need any help, Contact us here or on our slack channel.

Yes! Go ahead. Any idea on what platforms you want to add support for? This helps us in assigning the remaining ones to anybody else. Also, If you need any help, Contact us here or on our slack channel.

Linux and windows, though there seems to be a problem with path, if opera is installed with snap store directly in linux

Samyak, the maintainer will assign it to you shortly.

Linux and windows, though there seems to be a problem with path, if opera is installed with snap store directly in linux

Is the path different when installed through snap?

Linux and windows, though there seems to be a problem with path, if opera is installed with snap store directly in linux

Is the path different when installed through snap?

In Ubuntu, yes, installing Opera through the store puts the folder in snaps folder, not sure if that's the case for only Opera or other Browsers too

In Ubuntu, yes, installing Opera through the store puts the folder in snaps folder, not sure if that's the case for only Opera or other Browsers too

That's a tricky case. Is the snaps folder under the user's home directory or somewhere else?

In Ubuntu, yes, installing Opera through the store puts the folder in snaps folder, not sure if that's the case for only Opera or other Browsers too

That's a tricky case. Is the snaps folder under the user's home directory or somewhere else?

Yes, its /home/user/snaps

Mac OS support is yet to be added, re-opening this if anyone wants to work on it.

@Samyak2 Remove the assignee so that it appears to a unassigned issue.


openrc-0.40.2 supervise-deamon healthcheck_timer file descriptor leak, plus infinite supervise-deamon --stop kill 0 loop

The supervise-daemon leaks one '/run/openrc/exclusive/${RC_SVCNAME} (deleted)' file descriptor for each healthcheck_timer period.
After the file descriptors are exhausted, an attempt to stop the service triggers an infinite kill 0 loop in the start-stop-daemon ${RC_SVCNAME} --stop call with retry="SIGTERM/2/SIGTERM/3/SIGKILL/5":
# strace -p 7955
strace: Process 7955 attached
nanosleep({tv_sec=0, tv_nsec=1}, NULL)  = 0
kill(22293, SIG_0)                      = 0
nanosleep({tv_sec=0, tv_nsec=1}, NULL)  = 0
kill(22293, SIG_0)                      = 0

Meanwhile, the start-stop-daemon instance with exhausted file descriptors is in a blocking wait call:
# strace -p 22293
strace: Process 22293 attached
wait4(-1,

The infinite loop you are seeing in the second instance is because it is waiting for the first one to go down. The first one is stuck in the wait call due to exhausting the file descriptors. I am running a long-running test on master with the patch above applied to make sure that the file descriptors do not leak any longer. If they do not, this should also fix the shutdown. I will verify and update in the morning.


Remove CNAME from list of Image Domains

Removed CNAME of website from the list of authorised image domains.

LGTM


[MXNET-337] Change Model url to S3

Description
Change the links for the models to S3
@nswamy @anirudh2290
Same as this PR: https://github.com/apache/incubator-mxnet/pull/10617
Checklist
Essentials
Please feel free to remove inapplicable items for your PR.

[ ] The PR title starts with [MXNET-$JIRA_ID], where $JIRA_ID refers to the relevant JIRA issue created (except PRs with tiny changes)
[ ] Changes are complete (i.e. I finished coding on this PR)
[ ] All changes have test coverage:
Unit tests are added for small changes to verify correctness (e.g. adding a new operator)
Nightly tests are added for complicated/long-running ones (e.g. changing distributed kvstore)
Build tests will be added for build configuration changes (e.g. adding a new build option with NCCL)
[ ] Code is well-documented:
For user-facing API changes, API doc string has been updated.
For new C++ functions in header files, their functionalities and arguments are documented.
For new examples, README.md is added to explain the what the example does, the source of the dataset, expected performance on test set and reference to the original paper if applicable
Check the API doc at http://mxnet-ci-doc.s3-accelerate.dualstack.amazonaws.com/PR-$PR_ID/$BUILD_ID/index.html
[ ] To the my best knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change

Changes

[ ] Feature1, tests, (and when applicable, API doc)
[ ] Feature2, tests, (and when applicable, API doc)

Comments

If this change is a backward incompatible change, why must this change be made.
Interesting edge cases to note here

@nsamy can this be merged ?


Code problems in inference_mp4_2x.py

line #77 and line #79 should be deleted. Cuz mid0 and mid2 are not defined

Done. Thanks.


bug in apical diametrizer

@adrien-berchet , the last section of apical trunk should not be major, or the next sections will be asymetrical ;) Hard to catch this one!

Indeed, good catch :)

@adrien-berchet , your if broke the coverage...

I don't want to add a test, and I don't know how to handle this codecov dude :P


PowerManager SystemSuspendStatusChanged unusable

Describe the bug
This minimal example, which involves registering for an event and checking which kind was triggered, doesn't work:
    PowerManager::SystemSuspendStatusChanged([](auto const&, auto const&) {
        const auto status = PowerManager::SystemSuspendStatus();
        });

This generates: API only callable after a SystemSuspendStatusChanged callback.
The following code only makes the status known during the event, but RaiseEvent() is a coroutine that runs the callback in a background thread, making m_systemSuspendStatus be SystemSuspendStatus::Uninitialized by the time the callback is called.
https://github.com/microsoft/WindowsAppSDK/blob/5d49c0dc48243fa86c257019ece44c1f3d09b6af/dev/PowerNotifications/PowerNotifications.h#L618-L638
Steps to reproduce the bug

Create a packaged blank UWP C++ app, add the code above to App::OnLaunched.
Run app.
Sleep and wake pc.
Exception is thrown.

Expected behavior
PowerManager::SystemSuspendStatus() callable.
Screenshots
No response
NuGet package version
1.1.3
Packaging type
Packaged (MSIX)
Windows version
Windows 10 version 21H2 (19044, November 2021 Update)
IDE
Visual Studio 2022
Additional context
No response

Does this reproduce in a Win32 packaged or unpackaged application?
@brialmsft or @kanismohammed can you check?

Still seeing this issue in a packaged WinAppSDK 1.2 application.  I didn't try an unpackaged variant.

The PowerManager code appears to be broken. From the code, I wouldn't expect the event to ever fire or for getting the property value to ever work. Logged (internal bug) for this issue.
A possible workaround currently would be for an app to directly use PowerRegisterSuspendResumeNotification function (powerbase.h) - Win32 apps | Microsoft Learn to listen for changes. That is easier for a C++ app than a C# app.

If it helps, back when I reported the issue in 2022 the event was indeed firing correctly for me. The issue was with the supporting call SystemSuspendStatus(), which would be essential to use this API, is unusable due to it always failing.
The description has a possible reason why I think this is broken, which is that the code thinks RaiseEvent() is synchronous, due to the comment left there // Resetting the value after the callback , when in fact it isn't.

Closing as fixed by #4496.

This is fixed in 1.6.240701003-experimental2.


Screenshot links appear to be broken

Yeah, maybe I shouldn't use Tumblr for uploading images any more. Fixed.


Postgres, failed to upsert memo relation, internal=pq: column "version" does not exist. memos v0.18.1, postgres 15

Describe the bug
Memos v0.18.1, PostgreSQL 15
Failed to create memo with references (OR update memo with referneces), got error
{
  "error": "code=500, message=Failed to upsert memo relation, internal=pq: column \"version\" does not exist",
  "message": "Failed to upsert memo relation"
}

Steps to reproduce

Setup memos (0.18) with postgres (v15 is tested), my docker-compose.yml is attached, see Screenshots or additional context
Sign in and go to home page
Type some words in the text box.
Click on the  to add references, in the pop up window, input another memo's id (the memo exists)
Click on the , linked memo's detail appears below the input box, that's good.
Close the popup window, and click the save button to create the new memo with reference. You may want to open the browser console to catch the network request.
In my test, it partially failed. Memo is created, but reference not added. Got a toast message "Failed to upsert memo relation".

The version of Memos you're using
v0.18.1
Screenshots or additional context
docker-compose.yml
version: "3.0"
services:
  memos:
    image: ghcr.io/usememos/memos:latest
    container_name: memos
    env_file:
      - .env
    environment:
      - MEMOS_DRIVER=postgres
      - MEMOS_DSN=postgresql://${POSTGRES_USER}:${POSTGRES_PASSWORD}@db:5432/${POSTGRES_DB}?sslmode=disable
    volumes:
      - ./memos/:/var/opt/memos
    ports:
      - 5230:5230
    depends_on:
      - db
  db:
    container_name: memos_postgres
    image: postgres:15
    env_file:
      - .env
    environment:
      POSTGRES_PASSWORD: ${POSTGRES_PASSWORD}
      POSTGRES_USER: ${POSTGRES_USER}
      POSTGRES_DB: ${POSTGRES_DB}
    volumes:
      - memos-pgdata:/var/lib/postgresql/data
    restart: always

volumes:
  memos-pgdata:

.env
POSTGRES_DB=memos
POSTGRES_USER=memos
POSTGRES_PASSWORD=yourpassword

network request
curl
curl 'https://XXXXXX/api/v1/memo' -X POST -H 'User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:121.0) Gecko/20100101 Firefox/121.0' -H 'Accept: application/json, text/plain, */*' -H 'Accept-Language: zh-CN,en-US;q=0.7,en;q=0.3' -H 'Accept-Encoding: gzip, deflate, br' -H 'Content-Type: application/json' -H 'Referer: https://XXXXXX' -H 'Origin: https://XXXXXX' -H 'Sec-Fetch-Dest: empty' -H 'Sec-Fetch-Mode: cors' -H 'Sec-Fetch-Site: same-origin' -H 'Connection: keep-alive' -H 'Cookie: memos.access-token=XXXXXX' -H 'Pragma: no-cache' -H 'Cache-Control: no-cache' -H 'TE: trailers' --data-raw '{"content":"test reference #test ","visibility":"PRIVATE","resourceIdList":[],"relationList":[{"memoId":-1,"relatedMemoId":168,"type":"REFERENCE"}]}'

request body
{
    "content": "test reference #test ",
    "visibility": "PRIVATE",
    "resourceIdList": [],
    "relationList": [
        {
            "memoId": -1,
            "relatedMemoId": 160,
            "type": "REFERENCE"
        }
    ]
}

response
{
  "error": "code=500, message=Failed to upsert memo relation, internal=pq: column \"version\" does not exist",
  "message": "Failed to upsert memo relation"
}

FYI, sqlite works without any errors, postgres is strict i guess.

I am also able to recreate this error in a v0.18.1 Memos instance with the latest build (using PostgreSQL 15). When marking or linking a memo, the memo is created but the reference is missing. The same error is thrown in the logs:
{error: code=500, message=Failed to upsert memo relation, internal=pq: column "version" does not exist, latency: 11.198403ms, method: POST, status: 500, uri: /api/v1/memo}

Same error when adding comments

When creating a new memo that links to another memo, the memo is posted without the link. When looking at the console, there is a client error thrown. This is for v0.18.1 (latest commit)
MemoResourceListView-8u0rjhx_.js:5 ClientError: /memos.api.v2.MemoService/SetMemoRelations INTERNAL: failed to upsert memo relation
    at makeCall (index-trH83BUM.js:300:6112)
    at async at (index-trH83BUM.js:300:11471)
    at async Object.setMemoRelations (index-trH83BUM.js:300:11982)
    at async ye (MemoResourceListView-8u0rjhx_.js:5:5305)
ye @ MemoResourceListView-8u0rjhx_.js:5
await in ye (async)
sr @ Button-9itNe7Gw.js:4
Nb @ index-trH83BUM.js:74
Tb @ index-trH83BUM.js:74
Ub @ index-trH83BUM.js:74
nf @ index-trH83BUM.js:74
se$1 @ index-trH83BUM.js:74
(anonymous) @ index-trH83BUM.js:74
Rk @ index-trH83BUM.js:77
Jb @ index-trH83BUM.js:74
hd @ index-trH83BUM.js:74
fd @ index-trH83BUM.js:74
ed @ index-trH83BUM.js:74
MemoResourceListView-8u0rjhx_.js:5 Uncaught (in promise) TypeError: Cannot read properties of undefined (reading 'data')
    at ye (MemoResourceListView-8u0rjhx_.js:5:5510)

Fixed with https://github.com/usememos/memos


Readme edits and let’s get started with GitHub!

Some contemporary content for the non-contentious contenders.

No content and no comment.


update sofaboot version to 3.1.1-SNAPSHOT

Motivation:
Explain the context, and why you're making that change.
To make others understand what is the problem you're trying to solve.
Modification:
Describe the idea and modifications you've done.
Result:
Fixes #.
If there is no issue then describe the changes introduced by this PR.

closed, 其他分之已经升级到了3.1.1了


A how to...

Have added this to create a "back to" page 1
$(document).ready(function(){
  $("button.home").click(function() {
    $('section').horizon('scrollTo', '0');
  });
});

And in last html section page added
<button class="home" type="button">PAGE 1</button>
This works, however on this back to scroll, page one shows both L/R arrows, the L arrow on click scrolls back to 2nd last section, and R arrow not active, ie they are still bound to the last section page
My question, is how to have page 1 showing only the R arrow that is bound to scroll to next section page [ie page 2]
Also, I am trying to implement a lazy load for each page which is loaded using .onload, however I am using a binding click via 'horizon-next' which means all section pages load all images

$(".pg2").click(function() {
    $("#loadpage2").load("page2.html");
});
$(".pg3").click(function() {
	$("#loadpage3").load("page3.html");
});

What I am wanting is only that section page in view to load images
fyi I am using a plugin from [http://jquery.eisbehr.de/lazy/]
Any assistance will be greatly appreciated
thank you, Col

If it is scrolling back to the second to last screen, then 'i' is not being set to zero. Try your line without quotes around zero. $('section').horizon('scrollTo', 0);

..thank you that worked, scrolling from last page back to first,  however the R arrow on first page [after this scroll back] is not triggering scroll to page 2, thoughts?...
console only shows:
Scroll right
where I see from previous console log, should be
Scroll right
Scroll to: 1

i is not being set. That's a bug. Ill look at it right now.

Sorry for the delay. Version 1.0.3 has a fix for your issue. Thanks for raising it.


docs: add benchmark results for yi-coder 9b

I ran the unquantised model via https://glhf.chat/ that serves HuggingFace models via vLLM (hence the --openai-api-base parameter in the command), and then I ran the Q4_0 quantised model via Ollama (as of this PR, Ollama hasn't published the Q8_0 quant, and I didn't feel like manually setting up the quant).

Thanks!


Can’t take screenshots with slurp

Running labwc on Arch Linux, when I try the -s $(slurp) option I can drag the cursor to select an XxY area but then I get:
error: unrecognized argument (XxY)

My bad, I forgot to put quotes in the command, now it's working


refactor(transformer): methods only take &TraverseCtx where possible

Methods which only need an immutable ref &TraverseCtx take that, instead of unnecessary &mut TraverseCtx.

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#6812  👈
#6811
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @overlookmotel and the rest of your teammates on  Graphite

Minor change, so merging without review.

Merge activity

Oct 23, 7:31 AM EDT: The merge label '0-merge' was detected. This PR will be added to the Graphite merge queue once it meets the requirements.


Remove gulp-util.

Coverage remained the same at 95.652% when pulling 7d15b0ba08a80b1881f5ea382349468cf5994faf on remove-gulp-util into 375a13f18d911f629329e5e993771ca890f84636 on master.


Discretization of 2D (bounded) x 2D (unbounded)

Hello everyone,
I'm working on a numerical scheme applicable to domains of the shape $\Omega \times R^2$. My current plan is to discretize the unbounded part using Hermite polynomials as part of the offline processing and then to solve the resulting $N^2$ equations in 2D. Since this is essentially different to what I've been doing with MFEM so far, it would be great if someone could point me in the right direction or provide me with some hints.

What would be the best way to handle such a large number of equations?
Is there a smarter way to discretize the unbounded dimension in MFEM than offline precalculation?
Are there code examples regarding such problems e.g. the Fokker-Plank equation?

Best wishes,
Jonas

Hi @JonasBeddrich,
I am not aware of any other such applications but your plan sounds reasonable to me.
Maybe other MFEM users have experience with similar problems and can chime in?
Tzanio

Hi @tzanio,
One application would be the Fokker Plank equation. Let  $\Omega \subset \mathbb{R}^d$, $\psi:[0,T] \times \Omega \times \mathbb{R}^d \rightarrow \mathbb{R}, \psi = \psi(t,\mathbf{x}, \mathbf{R})$. Then the equation reads as:
$$\partial_t \psi + \mathbf{u} \cdot \nabla_x \psi -\epsilon \Delta_x \psi = -\nabla_R \cdot (\nabla_x \mathbf{u} \cdot \mathbf{R} \psi + \xi \mathbf{R} \psi) + \chi \Delta_R \psi$$
Here, solving for $\psi$ with $d=2$, I end up with a 4D equation.
Best wishes, Jonas

Unfortunately there hasn't been activity on this for several months, so I will close it, but please feel free to reopen if you have additional information.


Error TS2790: The operand of a 'delete' operator must be optional with latest deno-postgres (v0.4.3)

I am having such errors with  latest versions of<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>error: TS2790 [ERROR]: The operand of a 'delete' operator must be optional.
    delete this.conn;
           ~~~~~~~~~
    at https://deno.land/x/postgres@v0.4.3/connection.ts:612:12

TS2790 [ERROR]: The operand of a 'delete' operator must be optional.
    delete this.bufReader;
           ~~~~~~~~~~~~~~
    at https://deno.land/x/postgres@v0.4.3/connection.ts:613:12

TS2790 [ERROR]: The operand of a 'delete' operator must be optional.
    delete this.bufWriter;
           ~~~~~~~~~~~~~~
    at https://deno.land/x/postgres@v0.4.3/connection.ts:614:12

TS2790 [ERROR]: The operand of a 'delete' operator must be optional.
    delete this.packetWriter;
           ~~~~~~~~~~~~~~~~~
    at https://deno.land/x/postgres@v0.4.3/connection.ts:615:12

Found 4 errors.

try this
deno upgrade --version 1.3.0

and
deno run --reload deps.ts

thanks, it worked, I downgraded typescript, deno-postgres, denon and forgot to downgrade deno, what a coincidence

Note: 0.4.3 of this repos is the most recent release which can be downloaded from Deno's Third Party Modules
0.4.3 has this issue, 0.4.4 does not
<EMAIL_ADDRESS>


Json import not possible anymore in v1.1.5

The recent dependency update seems to have caused a regression when importing json files.
Listening on http://localhost:8000/
X [ERROR] The file "static/world.json" was loaded with the "js" loader

    islands/Globe.tsx:4:33:
      4 │ import { default as world } from "../static/world.json" assert { type: "json" };
        ╵                                  ~~~~~~~~~~~~~~~~~~~~~~

  This import assertion requires the loader to be "json" instead:

    islands/Globe.tsx:4:65:
      4 │ import { default as world } from "../static/world.json" assert { type: "json" };
        ╵                                                                  ~~~~~~~~~~~~

  You need to either reconfigure esbuild to ensure that the loader for this file is "json" or you
  need to remove this import assertion.

An error occurred during route handling or page rendering. Error: Build failed with 1 error:
islands/Globe.tsx:4:33: ERROR: The file "static/world.json" was loaded with the "js" loader
    at failureErrorWithLog (https://deno.land/x/esbuild@v0.17.11/mod.js:1612:15)
    at https://deno.land/x/esbuild@v0.17.11/mod.js:1024:25
    at runOnEndCallbacks (https://deno.land/x/esbuild@v0.17.11/mod.js:1447:45)
    at buildResponseToResult (https://deno.land/x/esbuild@v0.17.11/mod.js:1022:7)
    at https://deno.land/x/esbuild@v0.17.11/mod.js:1051:16
    at responseCallbacks.<computed> (https://deno.land/x/esbuild@v0.17.11/mod.js:673:9)
    at handleIncomingPacket (https://deno.land/x/esbuild@v0.17.11/mod.js:728:9)
    at readFromStdout (https://deno.land/x/esbuild@v0.17.11/mod.js:649:7)
    at https://deno.land/x/esbuild@v0.17.11/mod.js:1898:11

Using fresh v1.1.4 instead of v1.1.5 works as expected.

I have the same problem.
Is it caused by the updated esbuild to v0.17.11?

probably related to: https://github.com/lucacasonato/esbuild_deno_loader/issues/46

https://github.com/lucacasonato/esbuild_deno_loader/issues/46 is fixed. Will be part of Fresh 1.2.0 next week.

We just released Fresh v1.2.0. With that json imports work again 👍


add terms to glossary

[x] Headcount Ratio
[x] Poverty Gap Ratio
[x] Poverty Severity Ratio
[x] Rainfall Variability
[ ] explanation of "age of reference"

@jspeis what about age of reference?

we can simply alter the term "age of reference" to make it more straighforward e.g.

Wasted: Below minus two standard deviations from median weight for height of the given population.


Fix typo & delete unnecessary spaces

typo: github -> GitHub
delete unnecessary spaces: As Markdown syntax, there was a large amount of half-width spaces that did not affect the display, so I deleted it

@changeworld : Thanks for your contribution! The author, @dimazaid, has been notified to review your proposed change.

Verified editorial fix and layout in GitHub.


Enhance JIT provisioning feature

Description
This issue is to track the following JIT provisioning improvements and the migration impact.

[x] Config to enable JIT provisioning enhanced feature
[x] Unique identifier for the JIT provisioned user
[x] Disable editing synced attributes of the JIT provisioned users
[x] Introduce userSourceId claim to capture the JIT provisioined source
[ ] Option to disable attribute syncing for JIT provisioned users

This issue is being closed due to extended inactivity. Please feel free to reopen it if further attention is needed. Thank you for helping us keep the issue list relevant and focused!


RemotePaths: Add some special cases for item.Fullname

Some special cases were missing when calculation item.Fullname

Thanks!


Proper handling for WSL upgrade 2

Picking up where #39 left off.

@sirredbeard please rebase this all into a single commit and make sure it's properly signed-off.


Added ed25519 to x25519 conversion methods

To address the change requests for PR #362
Since the original author of the pull request hadn't responded. I've made the changes here.

Checks seem to have failed due to network errors when cargo was fetching stuff. Not sure if I'm able to rerun them.

Checks seem to have failed due to network errors when cargo was fetching stuff. Not sure if I'm able to rerun them.

Not sure if I'm able to rerun them.

You could amend your last commit (without any changes) and force-push the result to trigger the CI again.

Not sure if I'm able to rerun them.

You could amend your last commit (without any changes) and force-push the result to trigger the CI again.

Checks seem fine now :)

Checks seem fine now :)

bors: r+

bors: r+

@sekhat btw, did you see https://github.com/sodiumoxide/sodiumoxide/pull/456 ?

@sekhat btw, did you see https://github.com/sodiumoxide/sodiumoxide/pull/456 ?


Update EDMs due to @Core.Links

EDMs will change with the upcoming cds-compiler version. Please adapt tests and snapshots accordingly when starting to use this version.
fyi @oklemenz2 / @johannes-vogel

Thanks for heads-up. Will update it with next version...


Non-ASCII characters in DNS makes trustymail crash

This is probably a mix of domains not following standards and handling of errors in trustymail.
I see in testing that trustymail crashes completely when finding non-ASCII characters in DNS.
See example with testing the domain aigecala.no:
python -m trustymail.cli --smtp-timeout=15 --debug aigecala.no
[aigecala.no]
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/local/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/home/trustymail/trustymail/cli.py", line 140, in <module>
    main()
  File "/home/trustymail/trustymail/cli.py", line 93, in main
    scan_types))
  File "/home/trustymail/trustymail/trustymail.py", line 295, in scan
    spf_scan(domain)
  File "/home/trustymail/trustymail/trustymail.py", line 175, in spf_scan
    record_text = record_to_str(record)
  File "/home/trustymail/trustymail/trustymail.py", line 306, in record_to_str
    record = record.decode('utf-8')
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe1 in position 1: invalid continuation byte

This domain does not have a MX record, but trustymail seems to still look for a SPF record and then finds this:
aigecala.no.		86400	IN	TXT	"S\225mi die?ala\168 \225ige?\225la"
It seems to be some kind of text in the Sami language set as a TXT record.
When trying to scan many domains from a source csv-file trustymail could maybe log these as errors and not stop the entire scan?

Thanks for the issue, @byeskille!  I should be able to catch the exception, log it, and keep going.  I'll make the change once pull request 25 gets merged.

@byeskille, what version of trustymail are you using?  The offending exception does not appear to be thrown any longer since we switched from using py3dns to dnspython in #25.  At least I'm not seeing it with the code currently in master.
Are you able to test with the code currently in master and let me know if you're still seeing an issue?  Or do you need a new version pushed to PyPI so that you can install via pip?

@jsf9k I have been cloning this repo and running pip install -r requirements.txt
So after updating from the repo and doing the install once again it is working!
The mentioned domain above no longer fails hard, and I have tested a couple more I earlier experienced crashes for with no problems.
I have now started a scan of a larger domain list csv with varying data quality, and can report back my experiences later.

That's great, @byeskille!  I look forward to hearing how your testing goes.  I'll leave the issue open for now.

@byeskille, just checking in to see how your testing went.

Sorry for the late update. I can report that my two large scans with a total exceeding 10.000 domains went through without crashing. So thanks!

Excellent! :+1:


DateTime timezone is missing a :

The time string in the gateway is omitting a : in the time zone.
"time":"2020-04-20T11:15:57+0800"
SQL Server can't convert this format into a datetime unless there is a : in the timezone like this:
"time":"2020-04-20T11:15:57+08:00"

@andreevdenis is this something that requires actions?

@laurijamsa @ojousima we asked about it in slack, because fixing it can break someones logic

No-one has protested in Slack, I think we could take this on ToDo list?

I got around it with adding the missing ":" to the string before inserting it into the database. I guess once that is updated, I need to remove that.

QA passed build 1.4.1


Error code 1-2435-8325 with hiyaCFW Helper!!!

I have a 128 gb sd card and I am trying to install hiya cfw with the helper. I use a dsi and hiya keeps on showing the same error message, 1-2435-8325. I reinstalled hiya cfw helper, reinstalled twilight menu, but no luck. Can somebody help me?

This is a NAND related error. Please check if you can access unlaunch. If you can, it's better to run TWiLightMenu from there directly, please follow this guide for that as HiyaCFW is no longer needed by it.


[Coverity CID: 182777] Error handling issues in /samples/net/sockets/dumb_http_server/src/socket_dumb_http.c

Static code scan issues seen in File: /samples/net/sockets/dumb_http_server/src/socket_dumb_http.c
Category: Error handling issues
Function: main
Component: Samples
CID: 182777
Please fix or provide comments to square it off in coverity in the link: https://scan9.coverity.com/reports.htm#v32951/p12996

*** CID 182777:  Error handling issues  (CHECKED_RETURN)
/samples/net/sockets/dumb_http_server/src/socket_dumb_http.c: 49 in main()
43
44     	serv = socket(AF_INET, SOCK_STREAM, IPPROTO_TCP);
45
46     	bind_addr.sin_family = AF_INET;
47     	bind_addr.sin_addr.s_addr = htonl(INADDR_ANY);
48     	bind_addr.sin_port = htons(8080);

CID 182777:  Error handling issues  (CHECKED_RETURN)
Calling "bind(serv, (struct sockaddr *)&bind_addr, 8U)" without

checking return value. This library function may fail and return an
error code. [Note: The source code implementation of the function
has been overridden by a builtin model.]
49     	bind(serv, (struct sockaddr *)&bind_addr, sizeof(bind_addr));
50
51     	listen(serv, 5);
52
53     	while (1) {
54     		struct sockaddr_in client_addr;

Addressed by https://github.com/zephyrproject-rtos/zephyr/pull/7526


Bug: Old dependencies and build fails

Describe the bug and the steps to reproduce it
A fresh install of @coinbase/onchainkit with this sample frame fails do to missing libraries when building
Perhaps they should be added as dependencies?
page.tsx
import { FrameMetadata } from "@coinbase/onchainkit";

export default function Home() {
return (
  <FrameMetadata
    buttons={[
      {
        label: "Tell me the story",
      },
      {
        action: "link",
        label: "Link to Google",
        target: "https://www.google.com",
      },
      {
        action: "post_redirect",
        label: "Redirect to cute pictures",
      },
    ]}
    image="https://zizzamia.xyz/park-1.png"
    input={{
      text: "Tell me a boat story",
    }}
    post_url="https://zizzamia.xyz/api/frame"
  />
);
}

npm ERR! Missing<EMAIL_ADDRESS>from lock file
npm ERR! Missing<EMAIL_ADDRESS>from lock file
npm ERR! Missing<EMAIL_ADDRESS>from lock file
npm ERR! Missing<EMAIL_ADDRESS>from lock file
npm ERR! Missing<EMAIL_ADDRESS>from lock file
npm ERR! Missing<EMAIL_ADDRESS>from lock file
npm ERR! Missing<EMAIL_ADDRESS>from lock file
npm ERR! Missing<EMAIL_ADDRESS>from lock file
npm ERR! Missing<EMAIL_ADDRESS>from lock file
npm ERR! Missing<EMAIL_ADDRESS>from lock file

https://github.com/coinbase/onchainkit/releases/tag/v0.5.2 fix this.
Thank you @FedererKK


cannot share with (only) whatsapp anymore [iOS]

I use the official share flutter plugin (https://pub.dev/packages/share) and want to share photos with following implementation
await Share.shareFiles(['${(await randomImage.assetEntity.originFile)!.path}'], text: 'MyText');
I know that it worked but it does not anymore.
I've tried .heic / .jpg / .png but whatsapp won't show the files. When sharing via Mail then it's working, it's just Whatsapp that does not
I have the latest flutter (2.2.0), the latest photo_manager / share plugin
Can anyone confirm my issue? Is maybe anything wrong with my implementation?

I guess that this has nothing to do with photo_manager but with the share plugin

closed because has nothing to do with this plugin here, sorry


luci-app-adblock query form: Fix enter key submitting form but not showing any results

Right now you can hit the enter key while the input field is focused, and it submits the form, but no result is displayed. Even though a POST request is made, it doesn't seem to actually be querying the domain.
It might be nice to fix that too, so it would work for users that have JavaScript disabled. But I am not sure how to make that work, so if someone can provide help with that, that would be great.
Thanks!

Thanks for your contribution!
Please remove the CONTRIBUTING.md change from this PR, its unrelated to adblock and should go in a separate PR.
Thanks!

Done. I cherry-picked that commit to this PR: https://github.com/openwrt/luci/pull/3708

Thanks!

cherry-picked to 19.07 as well.

@dibdot Just wanted to note that it may be desirable to fix the form submission as well? I just didn't know how to do that. Thanks.

I don't really care, cause I've already migrated forthcoming adblock 4.0 to client side JS ...;-)


Making Flagsmith available for macOS projects

There were a few UIKit imports which don't affect the framework so I just removed them to be able to use it in macOS app.

Awesome thanks!


bug: Dropdown overlapped by table header

What version of daisyUI are you using?
4.12.10
Which browsers are you seeing the problem on?
No response
Reproduction URL

Describe your issue

        "Date"

                Col 1

                                      Some dropdown content

Example:

I have also reproduced this problem, where table headings are on top of a nav dropdown. The navbar and dropdown are outside the table element.

The dropdown is being covered by the table. i tried z-index but not working

when a dropdown is inside a div with transform, it will behave like this.
https://play.tailwindcss.com/NJPASKLtKE

I have this error when i add dropdown inside a table.
https://play.tailwindcss.com/jaw5gLJBnA

@leouie28 overflow-x-auto class is causing that.
This will be fixed in the upcoming daisyUI 5 release by using the new HTML popover API for dropdowns.


Typo: addEventListenter

https://github.com/github/textarea-autosize/blob/b07dd1fe1f03655c3e235307d91a2a582e70a209/src/index.js#L85
Okay, one of my play tool just not work and I found this typo... This issue will be fixed by #30

It looks 0.3.1 has fixed this issue.


⚠ ClamAV has degraded performance

In eeb198a, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 555 ms

Resolved: ClamAV performance has improved in e1581b9.


Add button to go back up at the end of the work section

Might be handy to add a button at the end of the work section, so that one doesn't need to scroll back up all the way to view the other work.

@lucaslampe Hey this is a great idea. You are welcome to open a pull request that adds that functionality. I'm closing this for now.


Uploader with no files uploaded

I'm currently implementing an uploader feature and need to handle the scenario where there is an error message displayed when no files are uploaded. I'm using the rx.upload_files(upload_id=id) and rx.selected_files(id) functions, but I'm unsure how to detect when no files have been uploaded. It seems that these functions don't execute when no files are uploaded. Could you please advise on how I can check for this condition and create an error message accordingly?

Currently this is expected behavior given this code: https://github.com/reflex-dev/reflex/blob/ee1ff7f93fa5bfbeb48f296970977c9174fe7136/reflex/.templates/web/utils/state.js#L382-L385
The client side upload handler just returns if no files are selected for upload.
I suppose this code could be changed to still submit the request, but return an empty file list.

please assign

@masenf tried this and repro'd ; after clicking the upload btn , what comes through to state.js (uploadFiles ) is undefined . i logged at the call-site of* uploadFile*s and it seems
event.payload.files
is undefined when the user sends an "empty upload" . so it throws a parse error in the eventhandler func in uploadFiles. i think a simple log(in addition to
return false
to notify the user to handle this , will suffice but unless some other reason to insist on sending an empty array to the backend?


[vulkan] Extract GUI utility functions out in samples (NFC)

These utility functions can be shared for other GUI applications.

@ScottTodd, I've extracted the utility functions out as we discussed last time. Let me know whether this is something you expected. :)

Tested on Windows the vulkan_inference_gui app still works. Linux is failing on main due to some other issues that can be fixed separately.


podnetwork: Disable connection tracking of VXLAN UDP packets

This patch disables connection tracking of VXLAN UDP packets to prevent the conntrack table from filing up.
The Linux connection tracking system (conntrack) always tracks UDP packets as connections by default. This is OK for usual UDP communications, but does not work with VXLAN UDP packets, since a destination port of each VXLAN UDP packet is fixed (4789) in both directions, and a source port of each packet is randomly selected. This UDP packet flow does not creates a connection flow, and every UDP packet of a VXLAN tunnel is recognized as a first packet of a new UDP  sream.
If conntrack table fills up, it may affect other network connections that needs NAT. This patch will alleviate such problems.
Fixes #2015
We can confirm necessary iptable rules are added in a worker node as follows.
# iptables -t raw -S
-P PREROUTING ACCEPT
-P OUTPUT ACCEPT
-N peerpod-OUTPUT
-N peerpod-PREROUTING
-A PREROUTING -j peerpod-PREROUTING
-A OUTPUT -j peerpod-OUTPUT
-A peerpod-OUTPUT -d <IP_ADDRESS>/32 -p udp -m comment --comment "peerpod [vni:555001]" -m udp --dport 4789 -j NOTRACK
-A peerpod-PREROUTING -s <IP_ADDRESS>/32 -p udp -m comment --comment "peerpod [vni:555001]" -m udp --dport 4789 -j NOTRACK

We can confirm that no conntrack entries are created for VXLAN as follows.
# conntrack -L | grep "udp" | grep "UNREPLIED" | grep "dport=4789"
conntrack v1.4.6 (conntrack-tools): 171 flow entries have been shown.

Few e2e tests related to kbs and policy are failing. Not sure if it's related.

@bpradipt they are possibly related to this PR. Let me rerun the test with debug logging enabled.

@bpradipt I reran the e2e tests, and they all passed this time.
https://github.com/confidential-containers/cloud-api-adaptor/actions/runs/10703496594/job/29709337377?pr=2023#step:12:4663

Oh, I forgot to add iptables rules in the pod VM. The current patch only adds iptables rules in the worker node only.
I'll update the patch to add iptabels rules in the peer pod VM as well.

@bpradipt I updated the patch, and all tests passed.


Catalog App - wordpress fails to upgrade in 1.15 when upgrading Rancher from 2.2.9 to 2.3.2-rc2

What kind of request is this (question/bug/enhancement/feature request):
Bug
Steps to reproduce (least amount of steps as possible):

run Rancher v2.2.9 single install
add a cluster with k8s v1.15.5-rancher1-1
deploy app WordPress template v2.1.12
upgrade Rancher to v2.3.2-rc2
switch catalog library's branch to k8s-1.16
see the new template version v7.3.8
upgrade the WordPress app to v7.3.8

Result:

failed to upgrade

Other details that may be helpful:

I can install the WordPress version v7.3.8 in the same project with no problems

Another observation:

run Rancher v2.2.9 single install
add a cluster with k8s v1.15.5-rancher1-1
deploy app WordPress template v2.1.12
upgrade Rancher to v2.3.2-rc2
switch catalog library's branch to k8s-1.16
see the new template version v7.3.8
upgrade the cluster to k8s v1.16.2-rancher1-1
upgrade the WordPress app to v7.3.8

Results:

failed to upgrade the app

Other details that may be helpful:

I can install the WordPress version v7.3.8 in the same project with no problems


fix: add arm64 support

Is there a supporting issue/discussion for this? The reason I ask is I want to know if we need to also support this downstream.

Yes. We should
https://9to5mac.com/2021/01/06/m1-macs-market-share/


ng2-ckeditor not found

I've followed every step but angular doesn't seem to be able to find ckeditor when the app is served... Did I miss something?
GET http://localhost:4200/ng2-ckeditor 404 (Not Found)

Do you use systemjs ?

I've copied the lines from the sample to system-config. Same not found error only the path now is different:
http://localhost:4200/vendor/ng2-ckeditor/lib/CKEditor.js

I've copied the lines from the sample to system-config. Same not found error only the path now is different:
http://localhost:4200/vendor/ng2-ckeditor/lib/CKEditor.js

Which sample ? there are 3 samples in readme...
Can you share your all config file ?

The cli one.
"use strict";
// SystemJS configuration file, see links for more information
// https://github.com/systemjs/systemjs
// https://github.com/systemjs/systemjs/blob/master/docs/config-api.md
/***********************************************************************************************
 * User Configuration.
 **********************************************************************************************/
/** Map relative paths to URLs. */
var map = {
    'ng2-ckeditor': 'vendor/ng2-ckeditor/lib/CKEditor.js'
};
/** User packages configuration. */
var packages = {
    'ng2-ckeditor': {
        format: 'cjs'
    }
};
////////////////////////////////////////////////////////////////////////////////////////////////
/***********************************************************************************************
 * Everything underneath this line is managed by the CLI.
 **********************************************************************************************/
var barrels = [
    // Angular specific barrels.
    '@angular/core',
    '@angular/common',
    '@angular/compiler',
    '@angular/forms',
    '@angular/http',
    '@angular/router',
    '@angular/platform-browser',
    '@angular/platform-browser-dynamic',
    // Thirdparty barrels.
    'rxjs',
    // App specific barrels.
    'app',
    'app/shared',
    'app/noticias'
];
var cliSystemConfigPackages = {};
barrels.forEach(function (barrelName) {
    cliSystemConfigPackages[barrelName] = { main: 'index' };
});
// Apply the CLI SystemJS configuration.
System.config({
    map: {
        '@angular': 'vendor/@angular',
        'rxjs': 'vendor/rxjs',
        'main': 'main.js'
    },
    packages: cliSystemConfigPackages
});
// Apply the user's configuration.
System.config({ map: map, packages: packages });
//# sourceMappingURL=system-config.js.map

Did you update your angular-cli-build.js ?
https://github.com/chymz/ng2-cli-ckeditor-sample/blob/master/angular-cli-build.js

Yup...

Do you have dist/vendor/ng2-ckeditor/lib/CKEditor.js in your project ?

I copied the dir from the sample and it worked. Thought all the dist stuff was autogenerated but maybe the problem was that I wasn't restarting the ng serve.
Anyway, I found that I need to use formControlName in order for this to work, so I guess I'll have to refactor how I handle all my forms. I was using [(ngModel)] for every textarea and that worked fine until now.
Thanks!


YETUS-942. yetus-dl for specific versions is broken

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
28m  6s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ master Compile Tests _

_ Patch Compile Tests _

+1 :green_heart:
shellcheck
0m  1s
There were no new shellcheck issues.

+1 :green_heart:
shelldocs
0m  0s
There were no new shelldocs issues.

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

_ Other Tests _

+1 :green_heart:
asflicense
0m 10s
The patch does not generate ASF License warnings.

28m 32s

Subsystem
Report/Notes

Docker
Client=19.03.6 Server=19.03.6 base: https://builds.apache.org/job/yetus-github-multibranch/job/PR-92/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/yetus/pull/92

Optional Tests
dupname asflicense shellcheck shelldocs

uname
Linux 19e17814ae20 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
precommit/src/main/shell/personality/yetus.sh

git revision
master / 46cb589

Max. process+thread count
46 (vs. ulimit of 2000)

modules
C: . U: .

Console output
https://builds.apache.org/job/yetus-github-multibranch/job/PR-92/1/console

versions
git=2.7.4 maven=3.3.9 shellcheck=0.7.0

Powered by
Apache Yetus 0.12.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

Thanks @busbey !


Request: Reparent node, maintaining transform

I would like to request a method added to CanvasItem object:
CanvasItem.reparent( new_parent, keep_world_transform=false )
The method would un-parent node from its current parent, and add itself as child to new_parent. If keep_world_transform is true, it would maintain its transform relative to scene root ( so get_global_transform() before the call and after would return the same transform ). After this call, with keep_world_transform true, the node would not appear to move, but switch parent.
Additionally, this method would NOT call _exit_tree or _enter_tree methods unless new_parent is not part of display tree.
I suspect it could be a pretty easy thing to add to engine itself, and kind of a pain to do in GD Script.
As an example, I'm using similar functionality to transplant player character from "room" to "room". Each "room" is dynamically loaded / discarded, and has own transform.

Related to issue #2284, which is about an option for the editor.

@neikeq ~ I guess that solving that other issue would require making this function.
@kirilledelman ~ I guess it would be hard to not call _{exit,enter}_tree. Maybe you want to add a was_called_before boolean to your scripts? :smile:

@bojidar-bg the other issue is already solved, but it's just an editor option :P

@neikeq ~ whoops, did't notice it is closed... And about editor options... :wink:

If it's a pain to prevent _enter_tree and _exit_tree let's omit it, but reparent( keep_transform ) could still be quite useful, even though it's possible to do it yourself via GDscript.

Why close? This is still not done, and a nice function to do it wouldn't harm

Well I thought about it, and realized that without _exit_tree and _enter_tree it's trivial to do yourself. All you have to do is save get_world_transform, unparent, reparent, and set_world_transform. It's 4 statements. Not really something I wish to add to a looooong list of requested features.

I feel there is still a need for this function. In my game I want to have multiple rooms that are dynamically loaded and ran at runtime and the player can transition through them in an 'open world' (no loading screens) manner. While using the following code if functional, there is a noticeable flicker as the player being moved is first placed locally and then the position is fixed globally.
func set_room( node):
var parent = self.get_parent()
var transformation = get_global_transform()
parent.remove_child(self)
node.add_child(self)
self.set_owner(node)
set_global_transform(transformation)
Unfortunately due to the graphics requirements for the game, the player must be moved between room nodes in order for the ZY sorting to work.


fix: prevent You attempted to update _tracking on Tag issue on Ember-data 4.5+

I realised we had an issue on, that I reproduce pretty easily in my app with Ember-data 4.6.
The RecordState is registered when we create a new Model.
For a classic native model, the RecordState will be build after all the initial value of the attributes have been set.
But with fragments it's the opposite, the RecordState is build first then the attributes are set which result in a duplicate update of the state
This produce the exact same error that you can find on this issue: https://github.com/adopted-ember-addons/ember-data-model-fragments/issues/427
My fix is based on the RecordDataDefault, I saw they are using notifyPropertyChange to notify an attribute has change instead of what we are doing which is using notifyStateChange to say the state of the record has changed

The PR is not ready yet, I'll check why the CI is not apssing

Okey it should be good now

Looks like the change is for 4.5+, but you mentioned 4.6, was that a typo?

Looks like the change is for 4.5+, but you mentioned 4.6, was that a typo?

Yes correct sorry. Because I thought at first it was just 4.6 but you are right it happens also for 4.5.0

Does this solve #427

Does this solve #427

I don't think so as it's related to Ember 3.28. But I actually had the issue on 3.28 but before<EMAIL_ADDRESS>So this issue might already be fixed anyway

Version released


Bump express-bunyan-logger

The latest version of express-bunyan-logger includes the option to obfuscate specific fields based on patterns.
This is really useful if you want to hide the body.password field which is currently logged by for failed signin attempts. Often users type their email in incorrectly but their password correctly so their valid password will be left hanging around in log files.
Will update docs with example of obfuscating as well.

I'm surprised that this is an issue, remember we had dealt with it at some point. But that was probably the pre-bunyan logger. Waiting for the travis build to complete and will review/merge. Thanks!

Coverage remained the same at 79.743% when pulling e609d43ccf9dbc045ea6f77715940fb92bd6961e on hedleysmith:express-bunyan-logger-update into a21dd1ff17d4893bb97eb7beb455888afb10eea0 on anvilresearch:master.

Yeah, could be worth including a conservative 'default' config somewhere so if people just 'turn on' logging it hides things like body.password for all requests. I'm not if/where the password field from successful login attempts are being blocked from being logged but if this is happening somewhere could be added alongside there. Or perhaps there could be default options just straight in boot/logger.js

@hedleysmith, sorry for the delay in responding to this. Been busy collaborating w/MIT CSAIL on some next gen oidc code and have unintentionally neglected this repo.
I will gladly accept a PR that defauls logging to hide the password if anyone has time.
cc: @tomkersten

Hello,
I just created this PR :  #354 !
Regards,
Camille


Fix usage of version dropdown to work on mobile

This fixes a minor bug that was preventing the version dropdown from showing on mobile + uncollapsed navbar. It adds two little JavaScript hooks to the bootstrap show/hide events that add a class to the bd-header container, and trigger whether it should be scrollable with an overflow-y
closes https://github.com/pydata/pydata-sphinx-theme/issues/782

LGTM!


Namespace qualifiers in element(foo:bar) and /fooo:bar are not checked for validity

Given:
xquery version "3.0";
let $foo as element(foo:bar) := <foo:bar/>
return /foo:bar

The foo: namespace in <foo:bar/> is flagged as not being resolved, whereas element(foo:bar) and /foo:bar are not. All cases should report the error.

The same happens for calling scoped functions, e.g.:
foo:bar("foo")

It is not shown on the namespace as the function will already be highlighted with error of not being able to resolve.
The remaining lack of highlighting is a new feature.


AzureBlobStorageContainerLoader doesn't load the container

Hi.
I try to run the following code
connection_string = "DefaultEndpointsProtocol=https;AccountName=<myaccount>;AccountKey=<mykey>"
container="<mycontainer>"
loader = AzureBlobStorageContainerLoader(
    conn_str=connection_string,
    container=container
)
documents = loader.load()

but the code documents = loader.load() takes like several minutes, and still not response any value.
The container has several html files and it has 1.5MB volume, which I think is not so heavy data.
I try above code several times, and I once got the following error.
      0 [main] python 868 C:\<path to python exe>\Python310\python.exe: *** fatal error - Internal error: TP_NUM_C_BUFS too small: 50
   1139 [main] python 868 cygwin_exception::open_stackdumpfile: Dumping stack trace to python.exe.stackdump

My python environment is following

OS Windows 10
Python version is 3.10
use virtualenv
running my script in mingw console (it's git bash, actually)

Has any Ideas to solve this situation?
(And, THANK YOU for the great framework)

I run the script in debug mode, and find out that dump error occurs in azure_blob_storage_container.py script.
I inserted breakpoint() as following
azure_blob_storage_container.py

        blob_list = container.list_blobs(name_starts_with=self.prefix)
        breakpoint()
        for blob in blob_list:
            print("in the list")
            loader = AzureBlobStorageFileLoader(
                self.conn_str, self.container, blob.name  # type: ignore
            )
            print("done loader init")
            docs.extend(loader.load())
        return docs

and got following console output.
> c:\<path to project root\.venv\lib\site-packages\langchain\document_loaders\azure_blob_storage_container.py(37)load()
-> for blob in blob_list:
(Pdb) c
in the list
done loader init
      0 [main] python 1207 C:\Users\hiromasa.kei\AppData\Local\Programs\Python\Python310\python.exe: *** fatal error - Internal error: TP_NUM_C_BUFS too small: 50
   1703 [main] python 1207 cygwin_exception::open_stackdumpfile: Dumping stack trace to python.exe.stackdump
(.venv)

Hope this infomation helps.

Sorry for bothering you, it sees like that the probrem is not in langchain, but in the mingw I use.
I run the same script from Windows bash, and had no error and process finished.
I'm closing this issue.


improve error handling for resources loaded form Custom TemplateResourceLoader

this patch works for me.

sorry for the fix fix commits- I didn't know how to add a testcase for this.

@WolfgangFahl Merge conflict here.


Expose mobile{Keyboard,Default}ViewIcon props from PickerToolbar

This PR closes #1693.

@Philipp91 Thanks for the pull request. Unfortunately, we can't accept it here. On-going work was moved to v5 in the main repository: https://next.material-ui.com/components/date-picker/.
I have transferred the linked issue to https://github.com/mui-org/material-ui/issues/23604.


Add Send method

Add implementation of proto Send  method.
Add implementation of AstartePublisher.
Add error(transparent) on some errors to forward the source and Display methods straight through to an underlying error without adding additional error.
Remove PartiEq derive because not all errors implements it.
Use matches! to compare the AstarteMessageHubError enum values.

Closes #13 .

Also, I forgot during the previous review.
For the functions publish_astarte_individual(), publish_astarte_object(), and send() adding a docstring would make them easier to understand.


Suggestion: Consider changing /MD to /MT for Windows MSVC compilation

I've had a user complain to me that the library wasn't working on actively crashing the game.
After a lot of back and forth, we figured out that it was because the proper MSVC libraries weren't installed.
Godot isn't able to check this, nor is it able to install the proper VC++ redistributables.
The VCRUNTIME140-dependency as seen in DependenciesGUI:

What is the proper solution for this issue?

Is there a way to automatically detect & install the redistributables?
Another possible solution is to change the compilation flag /MD to /MT (and /MDd and /MTd respectively) as described here:
https://docs.microsoft.com/en-us/cpp/build/reference/md-mt-ld-use-run-time-library?view=msvc-160

How are you guys handling this issue?

After some discussion there seem to be 2 common solutions:

Compile the libraries using the /MT-flag, like for example is the default for Godot (Godot doesn't have any external VCRUNTIME.DLL dependencies)
Add a VCRUNTIME.DLL myself to the folder. For example, Blender uses this method.

Both have potential disadvantages/advantages as described here:
https://stackoverflow.com/questions/757418/should-i-compile-with-md-or-mt

For consistency, I think it's better to take the same option as Godot.


Interpolation escaping forbids mrkdwn formatted links

I'm currently working on a project where most of the strings for the messages we send are stored on a CMS. One of the things we wanted to do is to allow the content writter to be able to insert links within the messages; we thought that using slacks'  markdwn would be the way to go, but when trying to interpolate a CMS text with a link on it, the < and > symbols get escaped into their respective html entities, which causes the final message to not be what's expected.
For example:
const textWithLink = '<https://example.com|Click here> to read more about the topic!';
const message = (

    {textWithLink}

);

will output something like:
{
  ...
  text: {
    type: 'mrkdwn',
    text: '>https://example.com|Click here< to read more about the topic!',
    verbatim: true,
  }
}

which will cause the text to be rendered as-is instead of the intended result of having the "Click here" text pointing to the link.
Looking through the code, this seems to be part of the escapeEntity logic of the mrkdwn module and I couldn't find any way to skip that.
Is this behaviour intentional? Is there any way to mark my string as safe so it doesn't get escaped?
In any case, big congratz in the library; my team and I have been using it and we're really enjoying it!

First, thanks for enjoying our lib! 😄 And yes, escaping into lt; and gt; is intentional behavior since #45.
Slack mrkdwn has provided a way to escape the link syntax safely, so jsx-slack will escape the text contents into supported HTML entities automatically. This behavior is safe by default as same as the case of using < and > in React JSX contents. You always have to use  tag for rendering links in JSX.
JSX has no way to know whether the string is defined in the interpolation or not, so I suppose disabling this encode in only interpolation is difficult.
If you want to use raw mrkdwn, jsx-slack v2 has an easy way to skip this mrkdwn conversion: Define custom component to return JSON inherited from <Mrkdwn>, with assigning raw mrkdwn.
const RawMrkdwn = (props) => {
  // Generate mrkdwn text composition object (skip unnecessary HTML parsing by assigning children to null)
  const mrkdwn = <Mrkdwn {...props} children={null} />;

  // Define the passed raw mrkdwn as text
  mrkdwn.text = props.children;

  return mrkdwn;
};

const textWithLink = '<https://example.com|Click here> to read more about the topic!';
const message = (

    <RawMrkdwn>{textWithLink}</RawMrkdwn>

);

{
  "type": "section",
  "text": {
    "type": "mrkdwn",
    "text": "<https://example.com|Click here> to read more about the topic!"
  }
}

Alright, it's a shame that it doesn't work out of the box, but it's understandable given the issues it introduces.
We'll be using the workaround you mentioned, thanks a lot!

@asermax Now I made an idea of <Mrkdwn raw> based on this: #161. We might work on the out-of-the-box support.


removing Mixer since it has has been shut down by Microsoft

Thank you for taking the time to work on a Pull Request for this project!
To ensure your PR is dealt with swiftly please check the following:

[x ] Your submissions are formatted according to the guidelines in the contributing guide
[x ] Your additions are ordered alphabetically
[x ] Your submission has a useful description
[x ] The description does not end with punctuation
[x ] Each table column should be padded with one space on either side
[x ] You have searched the repository for any relevant issues or pull requests
[x ] Any category you are creating has the minimum requirement of 3 items
[x ] All changes have been squashed into a single commit

Mixer has been removed by another PR (that removed dead links) that's recently been merged in


NumberFormatException for input string ""

I tried to download the Stock Firmware for my Device today, SM-G900F and Region BTU. Checking for Updates worked without problem, but clicking "Download" led to an Error. Stack Trace:
java.lang.NumberFormatException: For input string: ""
        at java.base/java.lang.NumberFormatException.forInputString(Unknown Source)
        at java.base/java.lang.Long.parseLong(Unknown Source)
        at java.base/java.lang.Long.parseLong(Unknown Source)
        at tk.zwander.common.tools.Request.getBinaryFile(Request.kt:179)
        at tk.zwander.common.tools.Request$getBinaryFile$1.invokeSuspend(Request.kt)
        at kotlin.coroutines.jvm.internal.BaseContinuationImpl.resumeWith(ContinuationImpl.kt:33)
        at kotlinx.coroutines.DispatchedTask.run(DispatchedTask.kt:106)
        at java.desktop/java.awt.event.InvocationEvent.dispatch(Unknown Source)
        at java.desktop/java.awt.EventQueue.dispatchEventImpl(Unknown Source)
        at java.desktop/java.awt.EventQueue$4.run(Unknown Source)
        at java.desktop/java.awt.EventQueue$4.run(Unknown Source)
        at java.base/java.security.AccessController.doPrivileged(Unknown Source)
        at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
        at java.desktop/java.awt.EventQueue.dispatchEvent(Unknown Source)
        at java.desktop/java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
        at java.desktop/java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
        at java.desktop/java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
        at java.desktop/java.awt.EventDispatchThread.pumpEvents(Unknown Source)
        at java.desktop/java.awt.EventDispatchThread.pumpEvents(Unknown Source)
        at java.desktop/java.awt.EventDispatchThread.run(Unknown Source)

I Itried it on Windows 10 if that's important.
Edit: Tried to download the Firmware with samloader, similar issue there. Maybe there is something messed up at Samsung's side?

Looking at the response generated by Samsung, there's no file size reported, no file path reported, and a whole bunch of other missing information. The DBT CSC seems to have a proper file, but the current version will crash if you try to check with it. I'm working on fixing that.


Getting started, getting stuck

Trying out this library with a toy example:
using CommandLine;
using System;

namespace Test_CommandArgs
{
    class Options
    {
        [Option('a', "optiona", Required = true, HelpText = "Option A")]
        string a {get; set;}
    }

    class Program
    {
        static void Main(string[] args)
        {
            var results = CommandLine.Parser.Default.ParseArguments<Options>(new string[] {});
            Console.WriteLine(results.Tag);
            Console.WriteLine(results.);
        }
    }
}

For the last line, I was hoping that VS would show me an attribute that I'd expect to hold a reference to the options object, but I can't see it:

What am I doing wrong?  How do I get that reference?

The WithParsed method takes an Action<Options> delegate that contains the parsed value.
results.WithParsed(opt =>
{
    Console.WriteLine(opt.a);
}

Hmmm.  Pity it doesn't expose the parsed value directly, say in a ParserResult.Value property.  This means an awkward (to me) workaround like:
  class Program
   {
       static void Main(string[] args)
       {
           var results = CommandLine.Parser.Default.ParseArguments<Options>(args);
           results.WithParsed(o => RealMain(o));
           results.WithNotParsed(e =>
               {
                   foreach(var i in e) Console.WriteLine("Error: " + i);
                   throw new ArgumentException("Invalid Argument(s).");
               });
       }
       static void RealMain(Options o)
       {
           // Now we really start.
       }
   }
}

Also, both approaches are at odds with the example code which looks very nice https://archive.codeplex.com/?p=commandline

I see, I need a type cast.  got it

Agree with this issue, it used to be nice to use and with most recent changes the QuickStart example is wrong. Needs to be more obvious how to get at the parsed values passed in. It's kind of the point of the whole utility. For parsing the arguments.

I'm going to weigh in on the very original description, where the OP couldn't get results.a.  This was because the Options type had declared string a:
    class Options
    {
        [Option('a', "optiona", Required = true, HelpText = "Option A")]
        string a {get; set;}
    }

You need a "public" access modifier on that property to get access to that property outside of the Options type.
Also, when you're looking at archive.codeplex.com for the Quick Start, you're looking at something that is years old.  The Quick Start example works with v2+ of the library, which is what is current.

And like @nemec said, you can use the parsed results within the WithParsed method... the fully parsed arguments are passed into gbritton1's example function "RealMain".
Nothing stopping you from wrapping all the RealMain code with a try/catch or whatever your design specifications need, with the additional benefit of a fully typed and parsed command line parsed and provided for you as an instance of the Options type.

If the quickstart example could be improved for a user that isnt familiar with the library, a pull request would be welcome and thanks in order.


Update parameters/tolerances based on precision

Update parameters/tolerances based on precision

[ ] I have read and checked the items on the review checklist.

@sriharshakandala I left a few additional comments on the other (merged PR). Could you incorporate them here and try out how it affects results?

@sriharshakandala I left a few additional comments on the other (merged PR). Could you incorporate them here and try out how it affects results?

Sure!

Replaced by https://github.com/CliMA/RRTMGP.jl/pull/421


[PKO-15] Do not attempt to overwrite full object on teardown of uncontrolled/external object

Summary

Resolves: PKO-15
Change Type

Check List Before Merging

[ ] This PR passes all pre-commit hook validations.
[ ] This PR is fully tested and regression tests are included.
[ ] Relevant documentation has been updated.

Additional Information

Closing this in favor of #1382


Cleanup Verovio examples

Does the following:

Update the Schema to 5.0.0-dev
Make formatting consistent
Add @n to all layer elements
Change rend@fonfname="VerovioText" to rend@fontfam="smufl" (Fixes #1146)

PS rend@fontfam will have to be changed to<EMAIL_ADDRESS>once #1142 is implemented in Verovio

@bwbohl Can you please double check: ant generate-images runs fine for me with this PR. However, when I run ant build-guidelines-html with this PR, java output throws:
ERROR: Unable to parse the following XML snippet, which is apparently not well-formed: (And then listing all the mei example files with html-escaped angled brackets (< instead of <)

@kepper Do we need to add smufl as font-face in source/assets/css/print/fonts.css ?