TCPDump not working when Istio set with global proxy privileged as true

Is this the right place to submit this?

[X] This is not a security vulnerability or a crashing bug
[X] This is not a question about how to use Istio

Bug Description
Istio was upgraded from 1.14 to 1.16.5 with global.proxy.privileged to true. In the istio operator the proxy shows as privileged true where I can't generate tcp dump in the istio-ingressgateway.
istio-proxy@istio-ingressgateway-544dbb94c5-5k6kl:/$ tcpdump -s 0 -vvv -w /capture.cap
tcpdump: eth0: You don't have permission to capture on that device
(socket: Operation not permitted)
Istio Operator:
 proxy:
    autoInject: enabled
    clusterDomain: cluster.local
    componentLogLevel: misc:error
    enableCoreDump: false
    excludeIPRanges: ''
    excludeInboundPorts: ''
    excludeOutboundPorts: ''
    image: proxyv2
    includeIPRanges: '*'
    logLevel: warning
    privileged: true
    readinessFailureThreshold: 30
    readinessInitialDelaySeconds: 1
    readinessPeriodSeconds: 2
    resources:
      limits:
        cpu: 2000m
        memory: 1024Mi
      requests:
        cpu: 100m
        memory: 128Mi
    statusPort: 15020
    tracer: zipkin

Istio-ingressgateway:
       failureThreshold: 30
      terminationMessagePath: /dev/termination-log
      terminationMessagePolicy: File
      imagePullPolicy: IfNotPresent
      securityContext:
        capabilities:
          drop:
            - ALL
        privileged: false
        readOnlyRootFilesystem: true
        allowPrivilegeEscalation: false

Version
$ istioctl version
client version: 1.17.3
control plane version: 1.16.5
data plane version: 1.14.0 (10 proxies), 1.16.5 (6 proxies)

$ kubectl version --short
Flag --short has been deprecated, and will be removed in the future. The --short output will become the default.
Client Version: v1.25.0
Kustomize Version: v4.5.7
Server Version: v1.24.9

Additional Information
No response
Affected product area

[ ] Ambient
[ ] Docs
[ ] Installation
[X] Networking
[ ] Performance and Scalability
[X] Extensions and Telemetry
[ ] Security
[ ] Test and Release
[X] User Experience
[ ] Developer Infrastructure
[ ] Upgrade
[ ] Multi Cluster
[ ] Virtual Machine
[ ] Control Plane Revisions

You can refer to this issue
https://github.com/istio/istio/issues/30982

.

...and to store your pcap to a file you must set sidecar.istio.io/enableCoreDump: "true" to make the istio-proxy container file system writtable.

What is the full install settings and methods? There are quite a few ingrss install methods

@howardjohn, I used istioctl to install the mesh. I found an alternative where after install with privileged as true and manually changed the privileged value under security context in ingress gateway deployment.yaml. It finally worked and I could do packet capture. Thanks everyone for quick support.


Xp improvements

XP works really bad right now.
(What was implemented - I need to redo the changes due to merge conflicts) clicking the xp bar shows a +1 button and a book icon. Clicking +1 gives 1 xp. Clicking the book brings a dialog similar to the last, which lets you end the session, level up, or override xp.
XP is no longer limited to the amount necessary for the next level. RAW you must take the Level Up move to do that.
The level up tab in the menu lets you choose a stat to increase, but won't let you go above 18 which is RAW the maximum value for a stat.
Manually changing stats no longer limits them to 20, in case you want to do something else for some reason.

Honestly I really like the changes to the End of Session dialog.
The level up section looks really nice. I think it should be really simple to also add some "Select New Move" button and not have to only tell the user they should go do so from somewhere else.
I would however note that the chip effect doesn't look great in all themes, might want to consider a different color combination here, especially for the unselected ones:

And then, I think there is too much spacing between collapsed items. Anything collapsed should be closer to the next:

Note the boundaries (estimated) around each clickable area, there is too much negative space between them. They should have 4 or 8 logical pixels apart max. It's much more noticeable here:

As for the chips above the XP bar, I'm not really sure this is the right approach.
There are a few points I am concerned about:

I'm not sure interactions that have time limits are very accessible. Especially on small controls like these. There is not enough time to understand what each action would mean, or it might be inaccessible to some users for failing to hit the target fast, which might be frustrating.
The parchment with quill icon doesn't really belong here. It has an association with the journal section, which might arguably be related to EXP, but right now they are not connected in the UI in any way. I'm not sure which icon should go there, as there is no icon with an inherent "end of session" feel to it IMO, but probably a more general option would be a "details" icon which is usually an ellipsis (3 dots), or the cog icon that usually goes in settings
There is no opportunity to understand what each button does. While +1 is pretty self explanatory, the quill icon isn't, and there is no tooltip (or enough time to read one).
The chips don't really fit well on top of the bars. They are too tall, and off center; and the inner padding is too great. But I don't really see any padding working here because the different in heights makes it seem imbalanced.

I really think the access to the XP dialog and +1 could be improved here. If we prefer not to put the +1 on the screen at all times on the home view, I at least prefer to have a design that is intuitive and balanced.
I have a few ideas for how to maybe modify the UI for accessing the buttons. Since it will already take 2 clicks to get to the EOS dialog anyway, we are not adding any more clicks than we already did, so I see no point in having it timed by an arbitrary amount. It should either be there or not, whether it's behind a click at all, is up to the selected solution

Add some "overlay" colored container around the buttons and the bar, so it hides them entirely, and shows the controls on top. We should add some X or "Back" icon to dismiss it back to "bar" mode.
Add a popover that opens below the bar for this.
Have it "flip" to another state via some animation, where the bar is replaced with relevant actions.
Another option would be to find a good place for the +1 permanently on screen, so that the new action doesn't change the existing behavior for existing users. It will be easy to spot something new on the home view, and +1 is perfectly self-explanatory so there would be no need to fuss over what to put there, and it is small. It could be placed:

on the right of the bar
below the bar, next to the armor chip
somewhere else?

Would love to hear your thoughts on these points and possible solutions.
I'm sorry for the wall of text, the UX of the app is very important to me and I want to make sure I don't add more frustration points for user, while keeping the overall visual language consistent. Hope you understand :)
Either way I really appreciate all the contributions, they do a lot for improving the app for everyone.

Responses:
I thought about it and keeping the +1 permanently on screen at the right of the xp bar and then clicking the rest of it to level up is probably the best UX. I will implement that.
The point about spacing makes sense, I will change.
Is there any way to easily select an advanced move, advice about how to implement that? Or could we do that in a followup?
The point about some text being dark on dark in some themes and thus unreadable seems like something that needs to be fixed in those themes, and not this code. It seems I am unable to test what changing a theme looks like since that feature requires the server. I would also like if you resolved that yourself later.
I also noticed that alignment doesn't seem to be selectable at the end of session. Should I add it there?
I also have no idea how to create a class with a custom alignment at all.

Is there any way to easily select an advanced move, advice about how to implement that? Or could we do that in a followup?

You can take a look at what happens when you click "Add Moves" from the actions view, or how it works in the create character dialog, it should be pretty much the same - you open the library page with the correct type and filters (for class/move cat), and the save callback saves the change (or puts it pending on the UI for confirmation)

The point about some text being dark on dark in some themes and thus unreadable seems like something that needs to be fixed in those themes, and not this code. It seems I am unable to test what changing a theme looks like since that feature requires the server. I would also like if you resolved that yourself later.

No problem, I will handle the theming better there

Works great!
I might play a bit with the designs, maybe add some spacing between the bar and button, and I'll play with different button/chip types here. Otherwise I really like this direction.
I'll also fix the chip theming problems.
Was there anything else missing before I can merge this PR?

If you look very closely, you'll see that the HP text is slightly higher than the XP text due to the bounding box of the +1 button. I was going to take a look at trying to fix this, I don't think it really matters, but you might want to look at it.

Awesome. I am working on #33 so I think I will wait with this, when the refactor is done I'll handle any conflicts, and merge. Then I'll do some updates to make sure it's ready for release

Refactors & updated the design a bit, closing this in favor of #34


Minor wording changes for clarity

@AErmie : Thanks for your contribution! The author, @axayjo, has been notified to review your proposed change.

@AErmie thanks for the contribution!
#sign-off

@cynthn: I'm sorry - only the author of this article, @axayjo, can sign off on your changes. But we do have an exception process - if you are on the Microsoft content or product team for this product area, you can ask the PR review team to review and merge it by sending mail to the techdocprs alias.


play animation before note hit

What is your question?
Is there a way to make an animation play before playing another using a note? Or in other words, it's a sword prep animation that plays before the note gets over the note bar.

source or lua
(i will always ask this if i don't know what to do)

source or lua (i will always ask this if i don't know what to do)

you there?

Oh I forgot...
No I don't know sorry.
Try asking in mayo's discussion repo?

Oh I forgot...
No I don't know sorry.
Try asking in mayo's discussion repo?

ok, thank you anyways


[jvm-packages]SparkWithDataFrame: java.lang.IllegalArgumentException: requirement failed: Column features must be of type org.apache.spark.ml.linalg.VectorUDT@3bfc3ba7 but was actually ArrayType(FloatType,true).

Hi
xgboost 0.7
unmodified SparkWithDataFrame.scala
spark-submit --class ml.dmlc.xgboost4j.scala.example.spark.SparkWithDataFrame --master local[4] --driver-memory 20g xgboost4j-example-0.7-jar-with-dependencies.jar 5 5 agaricus.txt.train agaricus.txt.test model
throws error
Exception in thread "main" java.lang.IllegalArgumentException: requirement failed: Column features must be of type org.apache.spark.ml.linalg.VectorUDT@3bfc3ba7 but was actually ArrayType(FloatType,true).
at scala.Predef$.require(Predef.scala:224)
at org.apache.spark.ml.util.SchemaUtils$.checkColumnType(SchemaUtils.scala:42)
at org.apache.spark.ml.PredictorParams$class.validateAndTransformSchema(Predictor.scala:51)
at org.apache.spark.ml.Predictor.validateAndTransformSchema(Predictor.scala:71)
at org.apache.spark.ml.Predictor.transformSchema(Predictor.scala:116)
at org.apache.spark.ml.PipelineStage.transformSchema(Pipeline.scala:70)
at org.apache.spark.ml.Predictor.fit(Predictor.scala:89)
at ml.dmlc.xgboost4j.scala.spark.XGBoost$.trainWithDataFrame(XGBoost.scala:151)
at ml.dmlc.xgboost4j.scala.example.spark.SparkWithDataFrame$.main(SparkWithDataFrame.scala:60)
at ml.dmlc.xgboost4j.scala.example.spark.SparkWithDataFrame.main(SparkWithDataFrame.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:729)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:124)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Same error on cluster
full stack:
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
16/10/19 15:59:58 INFO SparkContext: Running Spark version 2.0.0
16/10/19 15:59:58 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
16/10/19 15:59:59 INFO SecurityManager: Changing view acls to: mindaugz
16/10/19 15:59:59 INFO SecurityManager: Changing modify acls to: mindaugz
16/10/19 15:59:59 INFO SecurityManager: Changing view acls groups to:
16/10/19 15:59:59 INFO SecurityManager: Changing modify acls groups to:
16/10/19 15:59:59 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(mindaugz); groups with view permissions: Set(); users  with modify permissions: Set(mindaugz); groups with modify permissions: Set()
16/10/19 15:59:59 INFO Utils: Successfully started service 'sparkDriver' on port 33685.
16/10/19 15:59:59 INFO SparkEnv: Registering MapOutputTracker
16/10/19 15:59:59 INFO SparkEnv: Registering BlockManagerMaster
16/10/19 15:59:59 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-671ff1b7-3f7b-4b02-b998-9eb8e1626b38
16/10/19 15:59:59 INFO MemoryStore: MemoryStore started with capacity 10.5 GB
16/10/19 15:59:59 INFO SparkEnv: Registering OutputCommitCoordinator
16/10/19 16:00:00 WARN Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041.
16/10/19 16:00:00 INFO Utils: Successfully started service 'SparkUI' on port 4041.
16/10/19 16:00:00 INFO SparkUI: Bound SparkUI to <IP_ADDRESS>, and started at http://<IP_ADDRESS>:4041
16/10/19 16:00:00 INFO SparkContext: Added JAR file:/nfs/science/globalscience/mindis/delete/xgboost/jvm-packages/xgboost4j-example/target/xgboost4j-example-0.7-jar-with-dependencies.jar at spark://<IP_ADDRESS>:33685/jars/xgboost4j-example-0.7-jar-with-dependencies.jar with timestamp<PHONE_NUMBER>381
16/10/19 16:00:00 INFO Executor: Starting executor ID driver on host localhost
16/10/19 16:00:00 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 40546.
16/10/19 16:00:00 INFO NettyBlockTransferService: Server created on <IP_ADDRESS>:40546
16/10/19 16:00:00 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, <IP_ADDRESS>, 40546)
16/10/19 16:00:00 INFO BlockManagerMasterEndpoint: Registering block manager <IP_ADDRESS>:40546 with 10.5 GB RAM, BlockManagerId(driver, <IP_ADDRESS>, 40546)
16/10/19 16:00:00 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, <IP_ADDRESS>, 40546)
16/10/19 16:00:01 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 107.7 KB, free 10.5 GB)
16/10/19 16:00:01 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 10.2 KB, free 10.5 GB)
16/10/19 16:00:01 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on <IP_ADDRESS>:40546 (size: 10.2 KB, free: 10.5 GB)
16/10/19 16:00:01 INFO SparkContext: Created broadcast 0 from textFile at MLUtils.scala:99
16/10/19 16:00:02 INFO FileInputFormat: Total input paths to process : 1
16/10/19 16:00:02 INFO SparkContext: Starting job: reduce at MLUtils.scala:92
16/10/19 16:00:02 INFO DAGScheduler: Got job 0 (reduce at MLUtils.scala:92) with 2 output partitions
16/10/19 16:00:02 INFO DAGScheduler: Final stage: ResultStage 0 (reduce at MLUtils.scala:92)
16/10/19 16:00:02 INFO DAGScheduler: Parents of final stage: List()
16/10/19 16:00:02 INFO DAGScheduler: Missing parents: List()
16/10/19 16:00:02 INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[5] at map at MLUtils.scala:90), which has no missing parents
16/10/19 16:00:02 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 3.9 KB, free 10.5 GB)
16/10/19 16:00:02 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.2 KB, free 10.5 GB)
16/10/19 16:00:02 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on <IP_ADDRESS>:40546 (size: 2.2 KB, free: 10.5 GB)
16/10/19 16:00:02 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012
16/10/19 16:00:02 INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 0 (MapPartitionsRDD[5] at map at MLUtils.scala:90)
16/10/19 16:00:02 INFO TaskSchedulerImpl: Adding task set 0.0 with 2 tasks
16/10/19 16:00:02 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5487 bytes)
16/10/19 16:00:02 INFO TaskSetManager: Starting task 1.0 in stage 0.0 (TID 1, localhost, partition 1, PROCESS_LOCAL, 5487 bytes)
16/10/19 16:00:02 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
16/10/19 16:00:02 INFO Executor: Running task 1.0 in stage 0.0 (TID 1)
16/10/19 16:00:02 INFO Executor: Fetching spark://<IP_ADDRESS>:33685/jars/xgboost4j-example-0.7-jar-with-dependencies.jar with timestamp<PHONE_NUMBER>381
16/10/19 16:00:02 INFO TransportClientFactory: Successfully created connection to /<IP_ADDRESS>:33685 after 40 ms (0 ms spent in bootstraps)
16/10/19 16:00:02 INFO Utils: Fetching spark://<IP_ADDRESS>:33685/jars/xgboost4j-example-0.7-jar-with-dependencies.jar to /tmp/spark-00f12da8-d8db-4e1e-90c7-ff5d68e521c9/userFiles-adb0ce66-9896-4b31-9ed8-08328bd47949/fetchFileTemp593037925043306245.tmp
16/10/19 16:00:03 INFO Executor: Adding file:/tmp/spark-00f12da8-d8db-4e1e-90c7-ff5d68e521c9/userFiles-adb0ce66-9896-4b31-9ed8-08328bd47949/xgboost4j-example-0.7-jar-with-dependencies.jar to class loader
16/10/19 16:00:03 INFO HadoopRDD: Input split: file:/nfs/science/globalscience/mindis/data/agaricus.txt.test:91805+91806
16/10/19 16:00:03 INFO HadoopRDD: Input split: file:/nfs/science/globalscience/mindis/data/agaricus.txt.test:0+91805
16/10/19 16:00:03 INFO deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id
16/10/19 16:00:03 INFO deprecation: mapred.tip.id is deprecated. Instead, use mapreduce.task.id
16/10/19 16:00:03 INFO deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id
16/10/19 16:00:03 INFO deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id
16/10/19 16:00:03 INFO deprecation: mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap
16/10/19 16:00:03 INFO deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
16/10/19 16:00:03 INFO deprecation: mapred.job.id is deprecated. Instead, use mapreduce.job.id
16/10/19 16:00:03 INFO MemoryStore: Block rdd_4_1 stored as values in memory (estimated size 271.9 KB, free 10.5 GB)
16/10/19 16:00:03 INFO BlockManagerInfo: Added rdd_4_1 in memory on <IP_ADDRESS>:40546 (size: 271.9 KB, free: 10.5 GB)
16/10/19 16:00:03 INFO MemoryStore: Block rdd_4_0 stored as values in memory (estimated size 271.9 KB, free 10.5 GB)
16/10/19 16:00:03 INFO BlockManagerInfo: Added rdd_4_0 in memory on <IP_ADDRESS>:40546 (size: 271.9 KB, free: 10.5 GB)
16/10/19 16:00:03 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1562 bytes result sent to driver
16/10/19 16:00:03 INFO Executor: Finished task 1.0 in stage 0.0 (TID 1). 1562 bytes result sent to driver
16/10/19 16:00:03 INFO TaskSetManager: Finished task 1.0 in stage 0.0 (TID 1) in 1240 ms on localhost (1/2)
16/10/19 16:00:03 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 1307 ms on localhost (2/2)
16/10/19 16:00:03 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool
16/10/19 16:00:03 INFO DAGScheduler: ResultStage 0 (reduce at MLUtils.scala:92) finished in 1.322 s
16/10/19 16:00:03 INFO DAGScheduler: Job 0 finished: reduce at MLUtils.scala:92, took 1.704135 s
16/10/19 16:00:05 INFO SharedState: Warehouse path is 'file:/nfs/science/globalscience/mindis/delete/xgboost/jvm-packages/spark-warehouse'.
16/10/19 16:00:06 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 127.1 KB, free 10.5 GB)
16/10/19 16:00:06 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 14.3 KB, free 10.5 GB)
16/10/19 16:00:06 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on <IP_ADDRESS>:40546 (size: 14.3 KB, free: 10.5 GB)
16/10/19 16:00:06 INFO SparkContext: Created broadcast 2 from textFile at MLUtils.scala:99
16/10/19 16:00:06 INFO FileInputFormat: Total input paths to process : 1
16/10/19 16:00:06 INFO SparkContext: Starting job: reduce at MLUtils.scala:92
16/10/19 16:00:06 INFO DAGScheduler: Got job 1 (reduce at MLUtils.scala:92) with 2 output partitions
16/10/19 16:00:06 INFO DAGScheduler: Final stage: ResultStage 1 (reduce at MLUtils.scala:92)
16/10/19 16:00:06 INFO DAGScheduler: Parents of final stage: List()
16/10/19 16:00:06 INFO DAGScheduler: Missing parents: List()
16/10/19 16:00:06 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[14] at map at MLUtils.scala:90), which has no missing parents
16/10/19 16:00:06 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 3.9 KB, free 10.5 GB)
16/10/19 16:00:06 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.1 KB, free 10.5 GB)
16/10/19 16:00:06 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on <IP_ADDRESS>:40546 (size: 2.1 KB, free: 10.5 GB)
16/10/19 16:00:06 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012
16/10/19 16:00:06 INFO DAGScheduler: Submitting 2 missing tasks from ResultStage 1 (MapPartitionsRDD[14] at map at MLUtils.scala:90)
16/10/19 16:00:06 INFO TaskSchedulerImpl: Adding task set 1.0 with 2 tasks
16/10/19 16:00:06 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 2, localhost, partition 0, PROCESS_LOCAL, 5488 bytes)
16/10/19 16:00:06 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 3, localhost, partition 1, PROCESS_LOCAL, 5488 bytes)
16/10/19 16:00:06 INFO Executor: Running task 0.0 in stage 1.0 (TID 2)
16/10/19 16:00:06 INFO Executor: Running task 1.0 in stage 1.0 (TID 3)
16/10/19 16:00:06 INFO HadoopRDD: Input split: file:/nfs/science/globalscience/mindis/data/agaricus.txt.test:0+91805
16/10/19 16:00:06 INFO HadoopRDD: Input split: file:/nfs/science/globalscience/mindis/data/agaricus.txt.test:91805+91806
16/10/19 16:00:06 INFO MemoryStore: Block rdd_13_0 stored as values in memory (estimated size 271.9 KB, free 10.5 GB)
16/10/19 16:00:06 INFO BlockManagerInfo: Added rdd_13_0 in memory on <IP_ADDRESS>:40546 (size: 271.9 KB, free: 10.5 GB)
16/10/19 16:00:06 INFO MemoryStore: Block rdd_13_1 stored as values in memory (estimated size 271.9 KB, free 10.5 GB)
16/10/19 16:00:06 INFO BlockManagerInfo: Added rdd_13_1 in memory on <IP_ADDRESS>:40546 (size: 271.9 KB, free: 10.5 GB)
16/10/19 16:00:06 INFO Executor: Finished task 0.0 in stage 1.0 (TID 2). 1562 bytes result sent to driver
16/10/19 16:00:06 INFO Executor: Finished task 1.0 in stage 1.0 (TID 3). 1562 bytes result sent to driver
16/10/19 16:00:06 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 2) in 120 ms on localhost (1/2)
16/10/19 16:00:06 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 3) in 120 ms on localhost (2/2)
16/10/19 16:00:06 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool
16/10/19 16:00:06 INFO DAGScheduler: ResultStage 1 (reduce at MLUtils.scala:92) finished in 0.126 s
16/10/19 16:00:06 INFO DAGScheduler: Job 1 finished: reduce at MLUtils.scala:92, took 0.150533 s
16/10/19 16:00:06 INFO SparkContext: Starting job: zipWithIndex at SparkWithDataFrame.scala:50
16/10/19 16:00:06 INFO DAGScheduler: Got job 2 (zipWithIndex at SparkWithDataFrame.scala:50) with 1 output partitions
16/10/19 16:00:06 INFO DAGScheduler: Final stage: ResultStage 2 (zipWithIndex at SparkWithDataFrame.scala:50)
16/10/19 16:00:06 INFO DAGScheduler: Parents of final stage: List()
16/10/19 16:00:06 INFO DAGScheduler: Missing parents: List()
16/10/19 16:00:06 INFO DAGScheduler: Submitting ResultStage 2 (MapPartitionsRDD[15] at map at MLUtils.scala:84), which has no missing parents
16/10/19 16:00:06 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 3.8 KB, free 10.5 GB)
16/10/19 16:00:06 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.1 KB, free 10.5 GB)
16/10/19 16:00:06 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on <IP_ADDRESS>:40546 (size: 2.1 KB, free: 10.5 GB)
16/10/19 16:00:06 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012
16/10/19 16:00:06 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 2 (MapPartitionsRDD[15] at map at MLUtils.scala:84)
16/10/19 16:00:06 INFO TaskSchedulerImpl: Adding task set 2.0 with 1 tasks
16/10/19 16:00:06 INFO TaskSetManager: Starting task 0.0 in stage 2.0 (TID 4, localhost, partition 0, PROCESS_LOCAL, 5494 bytes)
16/10/19 16:00:06 INFO Executor: Running task 0.0 in stage 2.0 (TID 4)
16/10/19 16:00:06 INFO BlockManager: Found block rdd_13_0 locally
16/10/19 16:00:06 INFO Executor: Finished task 0.0 in stage 2.0 (TID 4). 875 bytes result sent to driver
16/10/19 16:00:06 INFO TaskSetManager: Finished task 0.0 in stage 2.0 (TID 4) in 37 ms on localhost (1/1)
16/10/19 16:00:06 INFO TaskSchedulerImpl: Removed TaskSet 2.0, whose tasks have all completed, from pool
16/10/19 16:00:06 INFO DAGScheduler: ResultStage 2 (zipWithIndex at SparkWithDataFrame.scala:50) finished in 0.037 s
16/10/19 16:00:06 INFO DAGScheduler: Job 2 finished: zipWithIndex at SparkWithDataFrame.scala:50, took 0.069588 s
Exception in thread "main" java.lang.IllegalArgumentException: requirement failed: Column features must be of type org.apache.spark.ml.linalg.VectorUDT@3bfc3ba7 but was actually ArrayType(FloatType,true).
at scala.Predef$.require(Predef.scala:224)
at org.apache.spark.ml.util.SchemaUtils$.checkColumnType(SchemaUtils.scala:42)
at org.apache.spark.ml.PredictorParams$class.validateAndTransformSchema(Predictor.scala:51)
at org.apache.spark.ml.Predictor.validateAndTransformSchema(Predictor.scala:71)
at org.apache.spark.ml.Predictor.transformSchema(Predictor.scala:116)
at org.apache.spark.ml.PipelineStage.transformSchema(Pipeline.scala:70)
at org.apache.spark.ml.Predictor.fit(Predictor.scala:89)
at ml.dmlc.xgboost4j.scala.spark.XGBoost$.trainWithDataFrame(XGBoost.scala:151)
at ml.dmlc.xgboost4j.scala.example.spark.SparkWithDataFrame$.main(SparkWithDataFrame.scala:60)
at ml.dmlc.xgboost4j.scala.example.spark.SparkWithDataFrame.main(SparkWithDataFrame.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:729)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:124)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
16/10/19 16:00:06 INFO SparkContext: Invoking stop() from shutdown hook
16/10/19 16:00:06 INFO SparkUI: Stopped Spark web UI at http://<IP_ADDRESS>:4041
16/10/19 16:00:06 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
16/10/19 16:00:06 INFO MemoryStore: MemoryStore cleared
16/10/19 16:00:06 INFO BlockManager: BlockManager stopped
16/10/19 16:00:06 INFO BlockManagerMaster: BlockManagerMaster stopped
16/10/19 16:00:06 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
16/10/19 16:00:06 INFO SparkContext: Successfully stopped SparkContext
16/10/19 16:00:06 INFO ShutdownHookManager: Shutdown hook called
16/10/19 16:00:06 INFO ShutdownHookManager: Deleting directory /tmp/spark-00f12da8-d8db-4e1e-90c7-ff5d68e521c9

it has clearly stated in the error information, you have to make the type of your feature column as Vector. you can generate it manually or with Vector Assembler


New SteamChatRoomClient Event for friend message acknowledgement

Problem description
I'm trying to detect when a friend chat message has been acknowledge by the logged in user (not the friend). The message acknowledgement is happening in a different session, meaning that my program should be informed when my desktop client reads a friend message.
Possible solution
An event that is fired when the logged in user has read a message with a callback containing:

steamid_friend - The SteamID object for the friend
unread_message_count - How many unread messages are contained in this session

Current workaround
I tried polling getActiveFriendMessageSessions or getFriendMessageHistory at a set interval to detect when unread_message_count changes. This however is unnecessarily resource intensive and is limited by the polling rate.
I hope this is technically possible.

I have found a way to do this by altering ./components/chatroom.js. All I had to do was to add an Event of type FriendMessagesClient.NotifyAckMessageEcho#1 under the //Handlers section
SteamUserBase.prototype._handlerManager.add('FriendMessagesClient.NotifyAckMessageEcho#1', function (body) {
  body = preProcessObject(body);

  /*
  console.log("Body:\n" + body);
  */

  this.chat.emit("NotifyAckMessageEcho", body);
});


Create a iPad UI from Mockups

The mockups for the UI has been designed by @Shubham0812. It is available at this link. Create the UI in code. You can use a combination of Storyboard and Programmatical UI, Although keep in mind that there are already custom classes for various UI elements prefer to use it over creating your own.

Hey, @Shubham0812 do you want to work on this next?

Cool yeah, I can take it up. :)

Cool.

Hey, @Shubham0812 any updates on the issue?

Hey, @pushpinderpalsingh yeah I'll work on it this weekend, had been preoccupied.

Cool, no issues!

hey @Shubham0812, do you think you can create a pr for this issue before the end of this week? We are planning to redesign the complete UI by mid-December. And it would be in the best interest if we can deploy this asap.


Tooltips don't show for traits in-game sometimes

Heyo!
Fantastic mod, really adds to the flavor of playing an anthro creature.
I'm having trouble with the traits not showing their description in-game. I've tried unsubbing, resubbing, restarting the game in various combinations without much luck.
Edit: Sike, apparently.
I loaded up the game to grab a screenshot and they were working. Only thing I did differently is that I loaded up a save file I'd already started and went to make a new character.
Either that gets the descriptions to register properly, or you gotta really spam a restart of the game multiple times. But they do show up. Will post again if I have further trouble.
Last edited by Kaiser; Nov 3 @ 9:34pm — [See post history](javascript:Forum_ShowForumAudits( '3817417431886225385', '3942398662636308875' );)
#28
MommaBee has Project Zomboid Nov 18 @ 9:27am
Im also having the issue as Kaiser above, im thinking it could be a mod description or another mod possibly over writing the descriptions? but im not entirely sure

I can reproduce this in single player after selecting sandbox mode. I'll take a look at how i trigger this.

pretty sure i fixed this. closing.


add performed tests runner

add the missing pieces to get performed tests running

changed the csv file names to use English names
moved a few pieces to a new db_common.py file
added a 'total tests' column for the cantons providing only this number and the positivity rate

I just had a phone call with @andreasamsler to discuss this PR
Notes:

positivity_rate is missing from the CSV
if possible we should not to calculations on our own, but rather provide the data by the cantons (so either have positive_tests and negative_tests OR have total_tests and positivity_rate).  Depending on what numbers the cantons provide.
The field url should be renamed to source to be consistent with the other CSVs

Other than that, this is good to go!

I just had a phone call with @andreasamsler to discuss this PR
Notes:
* positivity_rate is missing from the CSV

* if possible we should not to calculations on our own, but rather provide the data by the cantons (so either have `positive_tests` and `negative_tests` OR have `total_tests` and `positivity_rate`).  Depending on what numbers the cantons provide.

* The field `url` should be renamed to `source` to be consistent with the other CSVs

Other than that, this is good to go!

Alright, we're getting closer then!
Thanks for spotting the missing positivity_rate, should be added. Also renamed the url to source.
I've updated all scrapers to avoid any calculations, but add what is available from the source.

Thanks a lot @maekke !


Add prompts to get the NutriScore for uncomplete products

Add prompts to get the NutriScore and Nova groups for uncomplete products

Add a prompt for the category that turns into the category edit field 'Add a category to compute the Nutri-Score'
Add a prompt for the Nutrition table that turns into the nutrition tab 'Add the nutrition values to compute the Nutri-Score'

Explanation (by steps to reproduce)?

Some products don't have nutrition facts (there is an option to indicate that in the Edit mode, and there's a specific value in the JSON when that's the case)
As a result:
Nutrition tab (if no nutrition facts are indicated) :
Add the nutrition values to compute the Nutri-Score
This product doesn't have nutrition facts


iph

Type: Performance Issue
admin
VS Code version: Code 1.84.0 (d037ac076cee195194f93ce6fe2bdfe2969cc82d, 2023-11-01T11:29:04.398Z)
OS version: Windows_NT x64 10.0.22621
Modes:

Hi @ElAdrian05-git
Thanks for reaching VS Marketplace, please share error message or screenshot to investigate better.
Regards,
VS Marketplace Team

Hi @ElAdrian05-git  We are closing this issue as we have not received the required information.
If the issue still persists, please feel free to reopen or create a new issue.
Thanks,
VS Marketplace Team


v2 - NSCocoaErrorDomain

If I start iCloud syncing while baselines are still downloaded, I am getting errors like this:
NSCocoaErrorDomain Code=260
"The file “274_2E87EBA0-DAB6-475E-A1F4-73FD2900476C-497-000001DC4556E81A_AA2A44A1_2of3.cdeevent” couldn’t be opened because there is no such file."
….
NSUnderlyingError=0x7fab9a846fb0 "The operation couldn’t be completed. No such file or directory“
Shouldn’t this be an Ensembles error (CDEErrorDomain) like:
CDEErrorCodeDiscontinuousRevisions
CDEErrorCodeMissingDependencies
CDEErrorCodeFileCoordinatorTimedOut

I think experience the same, it does not seem to break anything though.


Timeouts when using usr-tcp232-410s, but not when using USB

Issue related to
Sunsynk Home Assistant Add-On
Describe the issue/bug
I had the addon running 100% using a USB RS485 adapter (this one) via mbusd.
I decided to switch to a usr-tcp232-410s as it will be better for my cabling setup. After setting it up as per the settings for the HF5142B, and setting the READ_SENSORS_BATCH_SIZE to 8, it works well and seemingly without issue.
However, I can see on the activity lights on the USR that it's reading fine every second or so for about 20 seconds, then the activity stops, the following error is posted in the log, then a few seconds later the activity starts again and so on.
Looking at the data on the HA dashboard, one won't notice this unless you're looking for the sensor data being updated. During the period of timeout during the error below there are obviously no updates to the sensor data in MQTT.
But otherwise this connection link is working fine.
I've tried turning flow control on and off. Tried various other settings on the USR.
Tried decreasing and increasing the READ_SENSORS_BATCH_SIZE.
I'm using using umodbus. Tried pymodbus and it doesn't work at all really.
Expected behavior
I expect it to keep updating without timing out every 30 seconds or so.
Your environment

Home Assistant version: 2023.5.3
Addon version: 2023.05.05-0.3.4
Inverter make: Sunsynk
Inverter Model: Sunsynk-5k-SG01LP1
Inverter Firmware: M <IP_ADDRESS> / S  <IP_ADDRESS> / C E.4.2.C

Logs
[s6-init] making user provided files available at /var/run/s6/etc...exited 0.
[s6-init] ensuring user provided files have correct perms...exited 0.
[fix-attrs.d] applying ownership & permissions fixes...
[fix-attrs.d] done.
[cont-init.d] executing container initialization scripts...
[cont-init.d] done.
[services.d] starting services
[services.d] done.
2023-05-17 14:31:24,228 INFO    options Loading HASS OS configuration
2023-05-17 14:31:24,253 INFO    Using Single phase sensor definitions.
2023-05-17 14:31:24,256 INFO    Connecting to tcp://<IP_ADDRESS>:26
2023-05-17 14:31:24,263 INFO    Reading startup sensors rated_power, serial
2023-05-17 14:31:24,384 INFO    ############################################################
2023-05-17 14:31:24,384 INFO                Inverter serial number '2301069881'
2023-05-17 14:31:24,386 INFO    ############################################################
2023-05-17 14:31:24,397 INFO    MQTT: Connecting to sunsynkmqtt@core-mosquitto:1883
2023-05-17 14:31:24,430 INFO    MQTT: Connection successful
2023-05-17 14:32:02,466 ERROR   Read Error: <class 'Exception'>: (1,175,1) readexactly call timeout on '<IP_ADDRESS>:26'
2023-05-17 14:32:18,833 ERROR   Read Error: <class 'Exception'>: (1,190,1) readexactly call timeout on '<IP_ADDRESS>:26'
2023-05-17 14:32:42,954 ERROR   Read Error: <class 'Exception'>: (1,166,2) readexactly call timeout on '<IP_ADDRESS>:26'
2023-05-17 14:32:52,991 ERROR   Read Error: <class 'Exception'>: (1,79,1) readexactly call timeout on '<IP_ADDRESS>:26'
2023-05-17 14:33:34,335 ERROR   Read Error: <class 'Exception'>: (1,175,1) readexactly call timeout on '<IP_ADDRESS>:26'
2023-05-17 14:34:02,417 ERROR   Read Error: <class 'Exception'>: (1,79,1) readexactly call timeout on '<IP_ADDRESS>:26'
2023-05-17 14:34:22,581 ERROR   Read Error: <class 'Exception'>: (1,169,1) readexactly call timeout on '<IP_ADDRESS>:26'
2023-05-17 14:34:33,718 ERROR   Read Error: <class 'Exception'>: (1,169,1) readexactly call timeout on '<IP_ADDRESS>:26'
2023-05-17 14:34:52,151 ERROR   Read Error: <class 'Exception'>: (1,193,1) readexactly call timeout on '<IP_ADDRESS>:26'
2023-05-17 14:35:31,623 ERROR   Read Error: <class 'Exception'>: (1,193,1) readexactly call timeout on '<IP_ADDRESS>:26'

What does the USR logs show? It seems like it stops responding to the TCP requests for a while...

btw, I've been using pymodbus toward mbusd for a couple of weeks now and seems just as stable as umodbus

I've checked the USR web options, doesn't look like I can access a log. Not sure if there's an option on the config software for one.
I can't redirect the connection via mbusd can I? Am I mistaken that mbusd can't point to the TCP server on the USR?

These smaller web gateways do not seem to be very reliable. The wave one was unable to issue writes (their support confirmed this)
you could try routing it via mbusd, but it will likely require a custom config file. If the upstream server disappears I’m not sure it will help.
might help to contact the USR support team as well

I'm running the Pace BMS addon for my Hubble AM-2's via the rs232 interface on the same USR, running without issue.
I've also got a single rs232 USR interfacing my Russound multiroom audio controller with no issue. But I guess the data transfer on both of those is less demanding.
I'll see if I can ask the Pusr folks about logs. thanks!

For interest, here's the log when I switch to pymodbus:
'''
[s6-init] making user provided files available at /var/run/s6/etc...exited 0.
[s6-init] ensuring user provided files have correct perms...exited 0.
[fix-attrs.d] applying ownership & permissions fixes...
[fix-attrs.d] done.
[cont-init.d] executing container initialization scripts...
[cont-init.d] done.
[services.d] starting services
[services.d] done.
2023-05-18 08:07:49,063 INFO    options Loading HASS OS configuration
2023-05-18 08:07:49,182 INFO    Using Single phase sensor definitions.
2023-05-18 08:07:49,185 INFO    Connecting to tcp://<IP_ADDRESS>:26
2023-05-18 08:07:49,186 INFO    PyModbus 3.2.2 TCP: <IP_ADDRESS>:26
2023-05-18 08:07:49,189 INFO    Protocol made connection.
2023-05-18 08:07:49,190 INFO    Connected to <IP_ADDRESS>:26.
2023-05-18 08:07:49,190 INFO    Reading startup sensors rated_power, serial
2023-05-18 08:07:49,308 INFO    ############################################################
2023-05-18 08:07:49,308 INFO                Inverter serial number '2301069881'
2023-05-18 08:07:49,309 INFO    ############################################################
2023-05-18 08:07:49,323 INFO    MQTT: Connecting to sunsynkmqtt@core-mosquitto:1883
2023-05-18 08:07:49,362 INFO    MQTT: Connection successful
2023-05-18 08:07:54,361 INFO    Protocol lost connection.
2023-05-18 08:07:54,362 INFO    Protocol lost connection.
2023-05-18 08:07:54,362 WARNING Ignoring launch of delayed reconnection, another is in progress
2023-05-18 08:07:54,363 ERROR   timeout reading register 166 (2)
2023-05-18 08:07:54,368 INFO    Protocol made connection.
2023-05-18 08:07:54,369 INFO    Connected to <IP_ADDRESS>:26.
2023-05-18 08:07:54,466 INFO    Protocol made connection.
2023-05-18 08:07:54,467 ERROR   Factory protocol connect callback called while connected.
2023-05-18 08:07:54,468 INFO    Connected to <IP_ADDRESS>:26.
2023-05-18 08:07:57,423 INFO    Protocol lost connection.
2023-05-18 08:07:57,424 INFO    Protocol lost connection.
2023-05-18 08:07:57,424 WARNING Ignoring launch of delayed reconnection, another is in progress
2023-05-18 08:07:57,425 ERROR   timeout reading register 166 (2)
2023-05-18 08:07:57,428 INFO    Protocol made connection.
2023-05-18 08:07:57,429 INFO    Connected to <IP_ADDRESS>:26.
2023-05-18 08:07:57,528 INFO    Protocol made connection.
2023-05-18 08:07:57,528 ERROR   Factory protocol connect callback called while connected.
2023-05-18 08:07:57,529 INFO    Connected to <IP_ADDRESS>:26.
2023-05-18 08:08:00,487 INFO    Protocol lost connection.
'''

So pymodbus is a bit more verbose, but you can see the connection to the USR seems to disappear for some reason - you also saw this with umodbus

Yes, although with pymodbus it doesn't populate any data at all.
With umodbus it works fine for a minute, then times out, reconnects, and repeats.

Have a look at #96 - is your unit similar?

It is the same unit. I've asked if they're experiencing the same timeouts in their log and isn't aware of it. Like I was before looking at the logs.

I've asked if they're experiencing the same timeouts in their log and isn't aware of it.

Hopefully they can help out, as I don't have access to any of this to help any further. Have you tried swapping units (you mentioned you had a couple of them?)
Btw, it seems you can read the AM2 data vie RS485 as well... Maybe using both RS232&RS485 is a bit much for the USR?
Maybe also contact the USR guys for help?

Thanks for your help though, I appreciate it. I'll wait to hear from the other guys.
I only have another rs232 one, not 485.
I've tried unplugging the AM-2 from the 232 port, no change. But the pace BMS addon only reads the BMS data every 30 seconds, and it's very quick, so I don't think it's particularly resource intensive.
I've also logged a support ticket with Pusr. I'll let you know if I learn anything more.

I've been using USR-TCP232-304 and it has been rock solid for me.
How is yours configured?

I've been using USR-TCP232-304 and it has been rock solid for me, 410s seems to be very similar so i would expect similar levels of reliability.
How is yours configured?

Interesting. So no Read Errors in the log at all?
  Try doing the same (change your work mode to just be a tcp server)

Thanks for the tip. I've configured as you say, and it first seemed to be erroring less. But I think it's actually much the same.
I think I might try change my network topology to see if that has any effect (there's currently two switches in the chain).
"
[s6-init] making user provided files available at /var/run/s6/etc...exited 0.
[s6-init] ensuring user provided files have correct perms...exited 0.
[fix-attrs.d] applying ownership & permissions fixes...
[fix-attrs.d] done.
[cont-init.d] executing container initialization scripts...
[cont-init.d] done.
[services.d] starting services
[services.d] done.
2023-06-03 09:56:19,223 INFO    options Loading HASS OS configuration
2023-06-03 09:56:19,247 INFO    Using Single phase sensor definitions.
2023-06-03 09:56:19,251 INFO    Connecting to serial-tcp://<IP_ADDRESS>:26
2023-06-03 09:56:19,271 INFO    Reading startup sensors rated_power, serial
2023-06-03 09:56:19,392 INFO    ############################################################
2023-06-03 09:56:19,393 INFO                Inverter serial number '2301069881'
2023-06-03 09:56:19,393 INFO    ############################################################
2023-06-03 09:56:19,405 INFO    MQTT: Connecting to sunsynkmqtt@core-mosquitto:1883
2023-06-03 09:56:19,440 INFO    MQTT: Connection successful
2023-06-03 09:56:58,439 ERROR   Read Error: <class 'Exception'>: (1,172,1) read call timeout on '<IP_ADDRESS>:26'
2023-06-03 09:57:12,472 ERROR   Read Error: <class 'Exception'>: (1,79,1) read call timeout on '<IP_ADDRESS>:26'
2023-06-03 09:57:22,679 ERROR   Read Error: <class 'Exception'>: (1,172,1) read call timeout on '<IP_ADDRESS>:26'
2023-06-03 09:58:12,147 ERROR   Read Error: <class 'Exception'>: (1,190,1) read call timeout on '<IP_ADDRESS>:26'
2023-06-03 09:59:01,583 ERROR   Read Error: <class 'Exception'>: (1,190,1) read call timeout on '<IP_ADDRESS>:26'
2023-06-03 09:59:46,916 ERROR   Read Error: <class 'Exception'>: (1,172,1) unpack requires a buffer of 1 bytes
2023-06-03 09:59:47,718 ERROR   Read Error: <class 'Exception'>: (1,79,1) 0
2023-06-03 09:59:58,731 ERROR   Read Error: <class 'Exception'>: (1,166,2) read call timeout on '<IP_ADDRESS>:26'
2023-06-03 10:01:00,991 ERROR   Read Error: <class 'Exception'>: (1,166,2) read call timeout on '<IP_ADDRESS>:26'
2023-06-03 10:01:20,366 ERROR   Read Error: <class 'Exception'>: (1,190,1) read call timeout on '<IP_ADDRESS>:26'
2023-06-03 10:01:30,671 ERROR   Read Error: <class 'Exception'>: (1,186,2) read call timeout on '<IP_ADDRESS>:26'"

Similar to Zit501, I have essentially the same problem without resolution. I however, have done a lot of experimentation with three different interfaces. I have a 3 phase 8K SunSynk inverter.
Interface 1: Direct serial cable from Synsynk Inverter to RS485-USB adapter direct into laptop. Used Windows based software QModmaster to interrogate the inverter. This worked flawlessly, returned correct data without issue and was completely repeatable. Due to cable considerations, I can not use this method to integrate with home assistant.
Interface 2: Serial cable from inverter to a Serial to TCP unit that handles modbus conversions "pusr usr-w610" This unit integrates into my home network over tcp. Using QModmaster software to interrogate the interface, I have partial success. On some interrogations get data coming back, on other interrogations I get timeout errors.

Similar to Zit501, I have essentially the same problem without resolution. I however, have done a lot of experimentation with three different interfaces. I have a 3 phase 8K SunSynk inverter.
Interface 1: Direct serial cable from Synsynk Inverter to RS485-USB adapter direct into laptop. Used Windows based software QModmaster to interrogate the inverter. This worked flawlessly, returned correct data without issue and was completely repeatable. Due to cable considerations, I can not use this method to integrate with home assistant.
Interface 2: Serial cable from inverter to a Serial to TCP unit that handles modbus conversions "pusr usr-w610" This unit integrates into my home network over tcp. Using QModmaster software to interrogate the interface, I have partial success. On some interrogations get data coming back, on other interrogations I get timeout errors. See Below.

When using the Kellerza Integration for home assistant, using either umodbus or pymodbus both fail with timeout errors. The software connects to the USR-W610 unit, from this point forward it is all down hill with timeout errors. See error output below using the umodbus interface. I get no data from this interfacing due to constant timeout errors.
Error Log (umodbus interface) s6-rc: info: service s6rc-oneshot-runner: starting s6-rc: info: service s6rc-oneshot-runner successfully started s6-rc: info: service fix-attrs: starting s6-rc: info: service fix-attrs successfully started s6-rc: info: service legacy-cont-init: starting s6-rc: info: service legacy-cont-init successfully started s6-rc: info: service legacy-services: starting services-up: info: copying legacy longrun sunsynk (no readiness notification) s6-rc: info: service legacy-services successfully started 03:51:21 INFO Loading configuration: /data/options.json 03:51:21 INFO sunsynk library version: 0.6.4 03:51:22 INFO Schedules: +-----------+-----+------+--------+-----------+----------+------------+ | Key | src | Read | Report | Change by | Change % | Change any | +-----------+-----+------+--------+-----------+----------+------------+ | date_time | | 60 | 60 | | | True | | rw | | 5 | 300 | | | True | | w | * | 5 | 60 | 80 | | | | kwh | | 300 | 300 | | | | | any_unit | | 15 | 300 | | | | | no_unit | | 15 | 300 | | | True | +-----------+-----+------+--------+-----------+----------+------------+ 03:51:22 INFO Using three phase sensor definitions. 03:51:22 ERROR Unknown sensor specified: aux_power 03:51:22 ERROR Unknown sensor specified: essential_power 03:51:22 ERROR Unknown sensor specified: grid_connected 03:51:22 ERROR Unknown sensor specified: inverter_current 03:51:22 ERROR Unknown sensor specified: load_frequency 03:51:22 ERROR Unknown sensor specified: non_essential_power 03:51:22 INFO Added hidden sensors as other sensors depend on it: Rated power, Serial 03:51:22 INFO Connecting to tcp://<IP_ADDRESS>:502 03:51:22 INFO Reading startup sensors Prog4 Time, Prog3 Time, Serial, Rated power, Prog5 Time, Prog2 Time, Prog6 Time, Battery Low Capacity, Prog1 Time 03:52:13 ERROR ConnectionTimeoutError reading 1 registers from 5: readexactly call timeout on '<IP_ADDRESS>:502'; error reading 1 registers from 7: unpack requires a buffer of 3 bytes; ConnectionTimeoutError reading 1 registers from 20: readexactly call timeout on '<IP_ADDRESS>:502'; ConnectionTimeoutError reading 1 registers from 117: readexactly call timeout on '<IP_ADDRESS>:502'; ConnectionTimeoutError reading 1 registers from 148: readexactly call timeout on '<IP_ADDRESS>:502'; KeyError reading 1 registers from 150: 175; KeyError reading 1 registers from 151: 0; ConnectionTimeoutError reading 1 registers from 152: readexactly call timeout on '<IP_ADDRESS>:502' 03:53:04 ERROR KeyError reading 1 registers from 3: 196; KeyError reading 1 registers from 4: 50; ConnectionTimeoutError reading 1 registers from 5: readexactly call timeout on '<IP_ADDRESS>:502'; error reading 1 registers from 7: unpack requires a buffer of 3 bytes; ConnectionTimeoutError reading 1 registers from 20: readexactly call timeout on '<IP_ADDRESS>:502'; ConnectionTimeoutError reading 1 registers from 117: readexactly call timeout on '<IP_ADDRESS>:502'; ConnectionTimeoutError reading 1 registers from 149: readexactly call timeout on '<IP_ADDRESS>:502'; error reading 1 registers from 151: unpack requires a buffer of 3 bytes; ConnectionTimeoutError reading 1 registers from 152: readexactly call timeout on '<IP_ADDRESS>:502'
Error Log (pymodbus interface)
s6-rc: info: service s6rc-oneshot-runner: starting s6-rc: info: service s6rc-oneshot-runner successfully started s6-rc: info: service fix-attrs: starting s6-rc: info: service fix-attrs successfully started s6-rc: info: service legacy-cont-init: starting s6-rc: info: service legacy-cont-init successfully started s6-rc: info: service legacy-services: starting services-up: info: copying legacy longrun sunsynk (no readiness notification) s6-rc: info: service legacy-services successfully started 05:01:00 INFO Loading configuration: /data/options.json 05:01:00 INFO sunsynk library version: 0.6.4 05:01:00 INFO Schedules: +-----------+-----+------+--------+-----------+----------+------------+ | Key | src | Read | Report | Change by | Change % | Change any | +-----------+-----+------+--------+-----------+----------+------------+ | date_time | | 60 | 60 | | | True | | rw | | 5 | 300 | | | True | | w | * | 5 | 60 | 80 | | | | kwh | | 300 | 300 | | | | | any_unit | | 15 | 300 | | | | | no_unit | | 15 | 300 | | | True | +-----------+-----+------+--------+-----------+----------+------------+ 05:01:00 INFO Using three phase sensor definitions. 05:01:00 ERROR Unknown sensor specified: aux_power 05:01:00 ERROR Unknown sensor specified: essential_power 05:01:00 ERROR Unknown sensor specified: grid_connected 05:01:00 ERROR Unknown sensor specified: inverter_current 05:01:00 ERROR Unknown sensor specified: load_frequency 05:01:00 ERROR Unknown sensor specified: non_essential_power 05:01:00 INFO Added hidden sensors as other sensors depend on it: Rated power, Serial 05:01:00 INFO Connecting to tcp://<IP_ADDRESS>:502 05:01:00 INFO PyModbus 3.4.1 tcp: <IP_ADDRESS>:502 05:01:00 INFO Reading startup sensors Serial, Prog5 Time, Prog6 Time, Battery Low Capacity, Prog2 Time, Prog3 Time, Rated power, Prog1 Time, Prog4 Time 05:01:10 ERROR Unable to decode response Modbus Error: Unknown response 10 05:01:10 ERROR Fatal error: protocol.data_received() call failed. protocol: <pymodbus.client.tcp.AsyncModbusTcpClient object at 0x7ff85ba19410> transport: <_SelectorSocketTransport fd=8 read=polling write=<idle, bufsize=0>> Traceback (most recent call last): File "/usr/local/lib/python3.11/asyncio/selector_events.py", line 1009, in _read_ready__data_received self._protocol.data_received(data) File "/usr/local/lib/python3.11/site-packages/pymodbus/transport/transport.py", line 289, in data_received self.datagram_received(data, None) File "/usr/local/lib/python3.11/site-packages/pymodbus/transport/transport.py", line 303, in datagram_received cut = self.callback_data(self.recv_buffer, addr=addr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/pymodbus/client/base.py", line 219, in callback_data self.framer.processIncomingPacket(data, self._handle_response, slave=0) File "/usr/local/lib/python3.11/site-packages/pymodbus/framer/base.py", line 137, in processIncomingPacket self.frameProcessIncomingPacket(single, callback, slave, **kwargs) File "/usr/local/lib/python3.11/site-packages/pymodbus/framer/socket_framer.py", line 147, in frameProcessIncomingPacket self._process(callback, tid) File "/usr/local/lib/python3.11/site-packages/pymodbus/framer/socket_framer.py", line 154, in _process raise ModbusIOException("Unable to decode request") pymodbus.exceptions.ModbusIOException: Modbus Error: [Input/Output] Unable to decode request 05:01:10 ERROR Unable to decode response Modbus Error: Unknown response 10 05:01:10 ERROR Fatal error: protocol.data_received() call failed. protocol: <pymodbus.client.tcp.AsyncModbusTcpClient object at 0x7ff85ba19410> transport: <_SelectorSocketTransport fd=9 read=polling write=<idle, bufsize=0>> Traceback (most recent call last): File "/usr/local/lib/python3.11/asyncio/selector_events.py", line 1009, in _read_ready__data_received self._protocol.data_received(data) File "/usr/local/lib/python3.11/site-packages/pymodbus/transport/transport.py", line 289, in data_received self.datagram_received(data, None) File "/usr/local/lib/python3.11/site-packages/pymodbus/transport/transport.py", line 303, in datagram_received cut = self.callback_data(self.recv_buffer, addr=addr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/pymodbus/client/base.py", line 219, in callback_data self.framer.processIncomingPacket(data, self._handle_response, slave=0) File "/usr/local/lib/python3.11/site-packages/pymodbus/framer/base.py", line 137, in processIncomingPacket self.frameProcessIncomingPacket(single, callback, slave, **kwargs) File "/usr/local/lib/python3.11/site-packages/pymodbus/framer/socket_framer.py", line 147, in frameProcessIncomingPacket self._process(callback, tid) File "/usr/local/lib/python3.11/site-packages/pymodbus/framer/socket_framer.py", line 154, in _process raise ModbusIOException("Unable to decode request") pymodbus.exceptions.ModbusIOException: Modbus Error: [Input/Output] Unable to decode request 05:01:10 ERROR ConnectionException reading 1 registers from 152: Modbus Error: [Connection] Connection lost during request Prog5 Time 05:01:10 ERROR General exception: unpack requires a buffer of 4 bytes 05:01:10 ERROR Fatal error: protocol.data_received() call failed. protocol: <pymodbus.client.tcp.AsyncModbusTcpClient object at 0x7ff85ba19410> transport: <_SelectorSocketTransport fd=8 read=polling write=<idle, bufsize=0>> Traceback (most recent call last): File "/usr/local/lib/python3.11/asyncio/selector_events.py", line 1009, in _read_ready__data_received self._protocol.data_received(data) File "/usr/local/lib/python3.11/site-packages/pymodbus/transport/transport.py", line 289, in data_received self.datagram_received(data, None) File "/usr/local/lib/python3.11/site-packages/pymodbus/transport/transport.py", line 303, in datagram_received cut = self.callback_data(self.recv_buffer, addr=addr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/pymodbus/client/base.py", line 219, in callback_data self.framer.processIncomingPacket(data, self._handle_response, slave=0) File "/usr/local/lib/python3.11/site-packages/pymodbus/framer/base.py", line 137, in processIncomingPacket self.frameProcessIncomingPacket(single, callback, slave, **kwargs) File "/usr/local/lib/python3.11/site-packages/pymodbus/framer/socket_framer.py", line 147, in frameProcessIncomingPacket self._process(callback, tid) File "/usr/local/lib/python3.11/site-packages/pymodbus/framer/socket_framer.py", line 154, in _process raise ModbusIOException("Unable to decode request") pymodbus.exceptions.ModbusIOException: Modbus Error: [Input/Output] Unable to decode request 05:01:10 ERROR ConnectionException reading 1 registers from 152: Modbus Error: [Connection] Connection lost during request Prog5 Time 05:01:13 ERROR Timeout Prog6 Time 05:01:16 ERROR Timeout Battery Low Capacity 05:01:20 ERROR Timeout Prog2 Time 05:01:23 ERROR Timeout Prog3 Time 05:01:26 ERROR Timeout Rated power 05:01:26 ERROR General exception: index out of range 05:01:26 ERROR Fatal error: protocol.data_received() call failed. protocol: <pymodbus.client.tcp.AsyncModbusTcpClient object at 0x7ff85ba19410> transport: <_SelectorSocketTransport fd=8 read=polling write=<idle, bufsize=0>> Traceback (most recent call last): File "/usr/local/lib/python3.11/asyncio/selector_events.py", line 1009, in _read_ready__data_received self._protocol.data_received(data) File "/usr/local/lib/python3.11/site-packages/pymodbus/transport/transport.py", line 289, in data_received self.datagram_received(data, None) File "/usr/local/lib/python3.11/site-packages/pymodbus/transport/transport.py", line 303, in datagram_received cut = self.callback_data(self.recv_buffer, addr=addr) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/pymodbus/client/base.py", line 219, in callback_data self.framer.processIncomingPacket(data, self._handle_response, slave=0) File "/usr/local/lib/python3.11/site-packages/pymodbus/framer/base.py", line 137, in processIncomingPacket self.frameProcessIncomingPacket(single, callback, slave, **kwargs) File "/usr/local/lib/python3.11/site-packages/pymodbus/framer/socket_framer.py", line 147, in frameProcessIncomingPacket self._process(callback, tid) File "/usr/local/lib/python3.11/site-packages/pymodbus/framer/socket_framer.py", line 154, in _process raise ModbusIOException("Unable to decode request") pymodbus.exceptions.ModbusIOException: Modbus Error: [Input/Output] Unable to decode request 05:01:26 ERROR ConnectionException reading 1 registers from 148: Modbus Error: [Connection] Connection lost during request Prog1 Time 05:01:29 ERROR Timeout Prog1 Time 05:01:33 ERROR Timeout Prog1 Time 05:01:33 CRITICAL Could not read sensors: ['Prog1 Time'] 05:01:33 INFO ############################################################ 05:01:33 INFO No response on the Modbus interface tcp://<IP_ADDRESS>:502, see https://kellerza.github.io/sunsynk/guide/fault-finding 05:01:33 INFO ############################################################ 05:01:33 CRITICAL This Add-On will terminate in 30 seconds, use the Supervisor Watchdog to restart automatically.
Interface 3: Serial cable from inverter to a Serial to TCP unit that handles modbus conversions "High Flying HF5111A" This is essentially the same unit as mentioned in the installation notes per the Kellerza Integration. This unit integrates into my home network over tcp. Using QModmaster software to interrogate the interface, I had total failure, with no ability to extract any data from the inverter. Given this situation, running the Kellerza Integration was just a complete waste of time.
Point of interest: I am using the same serial cat 5 cable from inverter to all 3 devices, noting that interface 1 returned zero errors and worked well. Given this, it dismisses the cable as being an issue. The PUSR device has a lot of settings which obviously I have played with, with no success. The High Flying Device has very little settings, and simply just did not work at all. Both devices do not have any display logs, though I believe that both devices have cmdline options to log into these boxes. This I have not investigated yet.
Any suggestions would be greatly appreciated!

Hi @snaven1 ,
I'm no longer getting any issued since @kellerza revised the code with the scheduled reading of sensor batches, and at a similar time I noticed that the pymodbus driver was noted as being best for an RS485/TCP adapter (not sure if this was a similar time). I'm using pymodbus without any errors in the log like I used to have. And there seems to be no irregularity in the reading of sensors like there used to be. I used to have long 60 second odd gaps after the timeouts, but otherwise working fine. Now it's perfect, although I do want to increase the frequency of some of my sensors being read.

Hi Zit501,
Thanks for the quick response. Unlike your case, using the Kellerza integration (latest version), I get connectivity, however I return no  modbus data due to the constant timeouts. It is only through the windows software (QModmaster) that I get some sort of connectivity, with partial timeouts occurring. Additionally, I have attempted to use the direct modbus interface built into Home Assistant which uses the pymodbus interface. It also gives me constant timeout errors. Additionally, I note that you are using a High Flying product, but is RS232 based where what I am using is RS485 based. I will keep investigating!!! Thanks

Further Update, after constant attempts of changing all setting possible on the RS485/Tcp units, I have not improved my situation with partial timeout occurrences. I have moved successfully to a new solution that involves running ESP32 chip hooked to a RS485 interface chip and downloaded ESPHOME on home assistant. To that end, I am now obtaining all data from my 3 phase Sunsynk Inverter without issue. An additional advantage of this solution, is that the ESP32 chip allows for an internal website to be deployed which displays all coded parameters in a nicely formatted box. To that end, it is a bit like having a website deployed to your inverter which Sunsynk/Deye does not deploy. I have provided a display of web output from the esp32 chip. Maybe this will give some help to those who are having the same timeout issues that I have experienced when using these RS485/TCP units.


Convert home page UI to neumorphic UI

Can we convert the home page UI to neumorphic UI?

If yes then I would like to work on this.

Can we convert the home page UI to neumorphic UI?

If yes then I would like to work on this.

I have some plans for custom animation incorporation ( involving gamification) to the home page and education page. So meanwhile could you please raise an issue for the experience page regarding the same

Can we convert the home page UI to neumorphic UI?

If yes then I would like to work on this.

I have some plans for custom animation incorporation ( involving gamification) to the home page and education page. So meanwhile could you please raise an issue for the experience page regarding the same


Parser problem in pattern matching (?)

this returns a tree and i think it should not:
"""9 match{ case i > 4 => 5 }""".parse[Stat]

Is this beginner friendly, could I get started on this?

I don't think this is a bug. i > 4 is parsed as an infix extractor.
scala> """9 match{ case i > 4 => 5 }""".parse[Stat]
res0: scala.meta.Stat = 9 match{ case i > 4 => 5 }

scala> res0.show[Structure]
res1: String = Term.Match(Lit(9), Seq(Case(Pat.ExtractInfix(Pat.Var.Term(Term.Name("i")), Term.Name(">"), Seq(Lit(4))), None, Lit(5))))


Refactor

Everything seems to be in order. New make target is hardcoded to look at this PR:

fluxcd/website#1573

Before we can use this in a GitHub Action, we will need to adjust it so that it can infer the PR to test from the context.


Check the CMake registry for pre-configured Asio and TinyXML2 packages.

Find modules override the CMake package registry by default.  On Windows, we have no standard file system hierarchy to check for installed libraries and using the CMake package registry [1] is the easiest way to advertise installed dependencies to dependents.
These changes will force CMake to look in the package registry by passing the CONFIG directive to find_package, if no package is found, the existing find module logic will be used.
This change should not affect builds on systems where the existing logic is successful unless those systems also include entries in the CMake package registry and those entries are invalid.

Thanks @nuclearsandwich


Logging to Azure SQL database not working

I am using version 5.7.0 of the sink form a .Net framework app deployed to an Azure app service, logging to a database hosted in Azure SQL. When running the app locally, logs show up in the database correctly, however when deployed to an app service, no logs show up at all.
The app is long running so disposal is not a problem, and the connection is correct as the table is automatically created. I have tried turning on Serilog self logging but do not get any errors in any trace log, or log file in Azure. Any help would be appreciated.
My config:
var logConfig = new LoggerConfiguration()
logConfig = logConfig.WriteTo.MSSqlServer(
    connectionString: "ConnectionString",
    sinkOptions: new MSSqlServerSinkOptions
    {
        TableName = "Log",
        AutoCreateSqlTable = true,
    });
Log.Logger = logConfig.CreateLogger();

If the MSSQL sink cannot write to the table it writes the exception to SelfLog but also rethrows. So you should see it in the logs\EventLog.xml file on the app service (accessible with Kudu). Please check there for errors.

Hi @Steve887!
Did you find out why no logs are written? If the problem you see it not due to a bug in the sink, I would like to close this issue soon. Please let us know.

I didn't work it out, wasn't seeing anything in SelfLog or eventlog.

I am having a similar issue - if I point the connection string when debugging on my local machine to my Azure SQL Server database, the Serilog entries are written to the database just fine in debug mode, so I know that the user permissions in the database aren't blocking the entries from being written. When I deploy the app to Azure with the same connection string pointing to the same Azure SQL Server database with the same user, the Serilog entries are written to text log file in wwwroot but not to the Azure SQL Server database (I have both File and MSSqlServer sinks configured). The only entries in the home\LogFiles\eventlog.xml file pertain to shutting down the app and restarting it - nothing related to Serilog; so I'm also having issues trying to determine where the issue is occurring.
In my case I am using ASP.NET Core 7.0.1.

@jennifer-reusser Which version of the MSSQL sink are you using? We upgraded the Microsoft.Data.SqlClient to 5.0.1 in sink release 6.0.0. Therefore I recommend that you use the latest version.
Please enable SelfLog (https://github.com/serilog/serilog/wiki/Debugging-and-Diagnostics#selflog) and check the exception you get.

@ckadluba I have been using Serilog.Sinks.MSSqlServer version 6.1.0.  Thank you for providing the link to the selflog instructions. It was a firewall issue on the SQL Server - after I allowed the IP address for the logger activity, it worked fine.

Glad I could help you. ☺


UTF8-Support for german letters (Ö, Ä, Ü)

The bot can't handle the UTF8 Charset, a expression from a result was:
POL-HB: Nr.:0522 --Fl�chtiger Tankstellenr�uber--
But has to be
POL-HB: Nr.:0522 --Flüchtiger Tankstellenräuber--
The correct conversion has to be provided.

I just copy pasted the phrase " POL-HB: Nr.:0522 --Flüchtiger Tankstellenräuber--" into the title of an article for a test feed and it came out fine in Discord:

Otherwise please provide a feed to work with


1,Support filt object by prefix when migration. 2, Optimize some codes.

1,Support prefix-filter for migration.
2,Check and make sure plan name is unique.
3,Optimize logs of datamover and delete unused code.

LGTM


AADSTS650057: Invalid resource

Hi
I don't get access token from Postman
return log:

Sign in
Sorry, but we’re having trouble signing you in.
AADSTS650057: Invalid resource. The client has requested access to a resource which is not listed in the requested permissions in the client's application registration. Client app ID: *********(xxxxxxxxx). Resource value from request: https://azurehealthcareapis.com. Resource app ID: ******. List of valid resources from app registration: ********, 00000003-0000-0000-c000-000000000000.

@TiLegend Thank you for your feedback, could you please share which document you are referring to?

@TiLegend Thank you for your feedback, could you please share which document you are referring to?

Hi I tried this tutorial https://docs.microsoft.com/en-us/azure/healthcare-apis/access-fhir-postman-tutorial

hi it my own mistake
I set wrong audience


[YUNIKORN-2370] Proper event handling for failed headroom checks

What is this PR for?
Send proper events whenever a queue/user quota check fails. Currently, we send only one per application per second. So, in case of multiple pods, only the first one will be updated with a new event. The message is also incorrect, because it's a request that exceeds the quota, not the application.
New events:

Queue headroom check failed (once per pod/ask)
User quota check failed (once per pod/ask)
Queue headroom check passed if previously failed (once per pod/ask)
User quota check passed if previously failed (once per pod/ask)
Predicate failed (once in every 15 seconds)

What type of PR is it?

[ ] - Bug Fix
[x] - Improvement
[ ] - Feature
[ ] - Documentation
[ ] - Hot Fix
[ ] - Refactoring

Todos

[ ] - Task

What is the Jira issue?
https://issues.apache.org/jira/browse/YUNIKORN-2370
How should this be tested?
Screenshots (if appropriate)
Questions:

[ ] - The licenses files need update.
[ ] - There is breaking changes for older versions.
[ ] - It needs documentation.

Note to self: enhance coverage.

TestRequestDoesNotFitQueueEvents: implement the same for user quota
TestPreconditions: check allocation log as well


Use shared navbar component and colocate data fetch

Preparing for #843 and #725, but since there was some refactoring involved I thought this could make a separate PR.

Merges the two navbar components to a single one
Always render providers in _app
Navbar data fetching logic using withStaticProps

The VippsAnonymous page has some deviations, where the "Logg in" button is replaced with the "Min side" button from the previous main layout navbar. Could be fixed, but had the initial thought this would be more consistent.

Tested on devices

[ ] Desktop 💻
[ ] Mobile 📱

Tests

[ ] All tests are running ✔
[ ] Test are updated 🧪
[ ] Code Review 👩💻
[ ] QA 👌

Checkpoints
Check these to flag for a more thurough review, as they could be potentially breaking changes

[ ] Packages updated
[ ] Other infrastructure updated (such as node version or similar)

⏲ Time spent on CR:
⏲ Time spent on QA:

Seems like there is a broken cypress test on main, see #845


fix(amplify-codegen-appsync-model-plugin): use LazyCollection (JS/TS)

Connected models to use LazyCollection in the generated Java Script and TypeScript code
Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report

Merging #2905 into master will decrease coverage by 0.69%.
The diff coverage is 69.23%.

@@            Coverage Diff            @@
##           master    #2905     +/-   ##
=========================================
- Coverage   63.37%   62.67%   -0.7%
=========================================
  Files         217      222      +5
  Lines       11042    11176    +134
  Branches     2292     2165    -127
=========================================
+ Hits         6998     7005      +7
- Misses       3732     3863    +131
+ Partials      312      308      -4

Impacted Files
Coverage Δ

...model-plugin/src/visitors/appsync-swift-visitor.ts
0% <ø> (ø)
:arrow_up:

...-plugin/src/visitors/appsync-typescript-visitor.ts
0% <0%> (ø)
:arrow_up:

...-plugin/src/visitors/appsync-javascript-visitor.ts
0% <0%> (ø)
:arrow_up:

...ify-codegen-appsync-model-plugin/src/utils/warn.ts
100% <100%> (ø)

...psync-model-plugin/src/visitors/appsync-visitor.ts
83.96% <75%> (+0.12%)
:arrow_up:

packages/amplify-cli/src/context-extensions.ts
25.69% <0%> (ø)
:arrow_up:

...lify-graphql-types-generator/src/compiler/index.ts
90.32% <0%> (ø)
:arrow_up:

...y-graphql-types-generator/src/compiler/legacyIR.ts
96.72% <0%> (ø)
:arrow_up:

...ges/amplify-graphql-types-generator/src/loading.ts
74.5% <0%> (ø)
:arrow_up:

...simulator/src/data-loader/dynamo-db/utils/index.ts

... and 8 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 374937f...769bcb2. Read the comment docs.


Drag multiple objects

Would it make sense to add the ability to drag multiple element at once?
e.g. after selecting two or more item, it would be possible to drag them all at once.

Possibly, though that would not be particularly easy to implement at this stage.

Hey! Is this something you're still interested in and would consider a PR for? This is a feature that is mandatory for a project I'm working on and I'd rather not maintain a private fork.
I just cobbled up a working solution in my local fork. So if you're interested, we could go over it and I could clean it up, add some docs and tests.


Getting AttributeError in bluetooth-scanner example

When running the bluetooth-scanner example on a raspberry pi with python3 (https://github.com/Adversitx/bluetooth-proximity actually, but in this case there should be no difference I think) I get the following error:
Exception in thread Thread-1: Traceback (most recent call last):   File "/usr/lib/python3.7/threading.py", line 917, in _bootstrap_inner     self.run()   File "/usr/lib/python3.7/threading.py", line 865, in run     self._target(*self._args, **self._kwargs)   File "bluetooth_scanner.py", line 47, in bluetooth_listen     rssi = b.request_rssi()   File "/usr/local/lib/python3.7/dist-packages/bt_proximity-0.2-py3.7.egg/bt_proximity/bt_rssi.py", line 60, in request_rssi     rssi = struct.unpack('b', rssi[3].to_bytes(1, 'big')) AttributeError: 'str' object has no attribute 'to_bytes'
Why is this? I have not changed a thing in the code…
Also, if I bypass this just to see that the rest works by encoding it with latin1 instead of using to_bytes I get a runtime error after a few seconds:
line 63, in request_rssi     rssi = bt.hci_send_req(self.hci_sock, bt.OGF_STATUS_PARAM, bt.OCF_READ_RSSI, bt.EVT_CMD_COMPLETE, 4, self.cmd_pkt) UnicodeDecodeError: 'utf-8' codec can't decode byte 0xfe in position 3: invalid start byte

In the code, change rssi[3] with int(rssi[3]). This should be done because int has a to_bytes method whereas str doesn't.


How I can create a new admin account?

⚠ Please verify that this bug has NOT been raised before.

[X] I checked and didn't find similar issue

🛡 Security Policy

[X] I agree to have read this project Security Policy

📝 Describe your problem
How I can renew the admin account or add a new account?
🐻 Uptime-Kuma Version
latest
💻 Operating System and Arch
Ububto 20.40
🌐 Browser
Firefox
🐋 Docker Version
No response
🟩 NodeJS Version
No response

It is currently not possible to add an account.
Multiple users has already been requested in issue #128 #1039 #1255


Incorrect directory permissions after executing the CIS security script under Catalina

After Audit 5.1.3 from the Security Remediation script was executed, chmod o-w gets now applied to /private/tmp/
This is wrong and applications can then no longer write to the directory and therefore no longer run as intended.
Please adjust the script so that this no longer happens.

A correction can look as follows:
if [ "$Audit5_1_3" = "1" ]; then
	IFS=$'\n'
	for sysPermissions in $( find /System -type d -perm -2 | grep -v "Public/Drop Box\|Data/private/tmp" ); do
		chmod -R o-w "$sysPermissions"
	done
	echo $(date -u) "5.1.3 enforced" | tee -a "$logFile"


SASI controller has to delegate command dispatching

The execute() method of the SASI controller shall delegate dispatching commands to the affected device, just like the SCSI controller does it in its execute() method.
The fact that the controller knows how to execute specific commands breaks encapsulation and makes it impossible to clean up the Disk class.
This is a serious issue and is more and more blocking progress elsewhere.

@akuker Is there anybody who can test the result of addressing this ticket? IMO in the ideal case we would remove all the SASI stuff. The implementation is bad and it is only causing troubles and wastes time. Any chance to get rid of it? Is anybody using/testing this at all?

I brought it up in the Discord chat a while back, and there are quite a few people using the SASI stuff. I agree that it makes the code much more confusing and harder to work with. But, if people are using it, I think we should try to leave it in.

@akuker I agree, if it is still being used it should not be removed. Nevertheless, I would like to improve the code. Is there anybody who is willing to test my changes with the required hardware?

@akuker Any chance to ask somebody from those using SASI to test the changes required for this ticket? If not it's probably best to completely decouple the SCSI from the SASI implementation (this will unfortunately duplicate code), so that the SASI implementation can be frozen and does not block further progress.

@akuker Are you really sure that somebody is using the SASI emulation? I just tried to create a SASI device, and on first access there is a segfault. I am quite sure you can reproduce this with a Mac, just be running "rascsi -hd 0 SOMETHING" and then trying to access this drive.
I checked the code and found that it has been wrong since release 21.10.01. It always crashes when something else than REQUEST SENSE is sent because of an uninitialized pointer.
Looks as if those who once claimed in Discord that they were using SASI are no longer using it. Or they do not use current RaSCSI releases. IMO this shows that the time has come to get rid of this code.

Its quite likely that users aren't updating with every version of RaSCSI. I'll bring it up in the discord dev channel and see what the reaction is.

@uweseimet - Unless we get a strong reaction from the community - I propose that version 22.03 is the last to support SASI. If someone really needs SASI, they're probably not going to be using some of the new features that are in work. So, they could use GIMONS version, or just fall back to 22.03.

@akuker OK, let's see whether there is any reaction. If somebody complains she/he should be willing to run regular tests. IMO there should be a reasonable number of users to justify keeping the SASI code. This code makes it harder to add SCSI improvements. But even better SCSI support would probably be more relevant and result in more potential RaSCSI users than keeping SASI support instead.

I want to merge in the "caching" changes, then I think I'm ready to release. By default, there won't be a change in operation - the other method of caching will only be enabled if you add a command line parameter.

Closing this ticket because with https://github.com/akuker/RASCSI/pull/724 the code has changed in a way that this ticket is no longer appropriate.

@akuker Any idea when the caching changes will be available? Looks as if there has not been any activity in the respective branch for thw last two weeks.
There are already a lot of user visible changes in the develop branch, i.e. a missing feature should probably not postpone the release for too long, if there is not enough time to work on this feature.


[gcp][feat] OnDemand cost information for GcpDiskType

Description
OnDemand cost information for GcpDiskType
To-Dos

[x] Add test coverage for new or updated functionality
[x] Lint and test with tox

Code of Conduct
By submitting this pull request, I agree to follow the code of conduct.

The current collector has a logic
if resource.region(graph).name == "undefined" and resource.zone(graph).name == "undefined":
    log.debug(f"Resource {resource.rtdname} has no region or zone" " - removing from graph")
    graph.remove_node(resource)
    return

Is this still implemented somewhere?

Is this still implemented somewhere?

@lloesche Not in this form, no. We do remove DiskType nodes when they don't have any successors, i.e. aren't used by any actual disk. The new collector defaults to create edges to project if region or zone can't be determined for any resource. I'm not sure on what the initial intention was with the above code. Ultimately we do not keep any unused or otherwise dangling DiskType nodes around.


Fixed jsdoc-abort bug with "||" in jsdoc type

jsdoc aborts on x||y found in types..

Well, this doesn't fix the jsdoc issue, but it fixes the troublesome jsdoc tag..


how to show qtip modal as iframe

hello,,
i want to ask about how to show qtip as iframe like in colorbox
$.colorbox({width:'500px',height:'500px',iframe:true,href:'http://www.google.com'});
thanks :)

thanks but i want to load the contents through ajax.
i want to load a PDF File through ajax.
how to do that using qtip ajax :)
thanks again.

That's not possible, since browsers don't parse PDF files, unless of course you're parsing it server-side and sending back the actual PDF text.
Regarding the AJAX, check the documentation: http://craigsworks.com/projects/qtip2/docs/plugins/ajax/


Ramda

buggy declarations of functions I need:

[ ] map

buggy declarations of functions I probably don't need:

[ ] propSatisfies
[ ] propSatisfies


Plugins folder situation in repo could be better

It seems to me that the "Plugins" folder is useless, and having someone go there just to find that they have to go somewhere else seems odd. It might be advisable to add the link to the plugins repo in the main README and then remove the Plugins directory. This could be improved upon further by moving the plugin creation information to a space in the wiki, thus removing a lot of clutter and making finding the link to the plugins repo easier. Plus, many users who may not want to make a plugin themselves may find all that information overwhelming.

In the end the best thing imho would be a real preferences window for BitBar, with tabs, one "general" tab (with start at login, set/change plugin folder location or display default location), and with a plugins tab that gets a list from a remote "official" repository plus the ability of the user to download single plugins (or all) from that repo, add plugins locally (Finder "where is it" open window), enable/disable/delete plugins, open plugins folder, open plugin script in > select: TextEdit, BBEdit etc., refresh remote plugin list (automatic schedule, manual), notify of repo or individual script updates (OS X notification center), setting: download updates automatically yes/no, activate & refresh automatically yes/no, with the plugin list having two sections, one "official" (from the BitBar repo), one "user scripts"… and then one "About" tab with Github link, Support link (this Issues section), the official website, the manual. Make it "real" Mac application. But that should really be a no-brainer, right?

I agree with both of you. For now, I'll delete the plugin folder. The preferences thing is going to take a bit more work.


Question about python version

https://github.com/dridk/QJsonModel/blob/1386e400fd06b95071c6ff3e95bbe732518288dc/qjsonmodel.py#L97-L124
Hi,
Great work, your new model is so helpful! Quick question, in the "load" method there are some recursive calls like this:
child = self.load(value, rootItem)
although the function signature is like this:
def load(self, value, parent=None, sort=True):
Just wanted to confim, is this root item meant to be a "parent" in the function call?
Thanks again!!

Thanks!
Yes bad name. It should be rename to "item" instead of "rootItem" to avoid confusing

Thanks for the quick reply @dridk ! Got it working now.


[mainnet] added paraswap-v5

[x] added PARASWAP-V5-A
[x] added PARASWAP-A

https://github.com/Instadapp/dsa-connectors/pull/126


[WIP] Re-organize documentation layout

Is this good to merge @lucperkins or is it still WIP?

@mfdii Still WIP. I'm currently working on migrating the content into the new org system.

@mfdii Okay, this is ready for review

LGTM. Thanks again for this.


Visual Customizer Builder for KIRKI

Hi,
This is not an issue. Just wanted to share something i made with your plugin.
Currently to add customizer fields, codes has to be written but now that will be over.
I have made a plugin "Visual Customizer Builder for KIRKI". With this plugin you can make customizer fields within minutes.
Link of plugin : https://github.com/ravishakya/visual-customizer-builder-kirki
Features

Visually create your Fields
All kirki fields are supported plus extra 3 fields( Page ID, Taxomony and users )
Drag and drop options
Supports Panels and Sections amd many more .............

@ravishakya Thanks for sharing!

It would be grt if I had feedback and suggestions on that to improve. :)

@ravishakya that's awesome! Thank you!
I installed it and took a look earlier today, seems to be working great!
I haven't taken a look at the code yet... I'll do that later today. I'll be rebuilding the main kirki site soon to add some tools & resources and I'd love to add that too... I'm just prioritizing a rewrite of the plugin at the moment (see the modular branch)

Thank you. You liked it.
You want to add the plugin "Visual Customizer Builder for KIRKI" inside KIRKI ??

I like it.  Export/import configs would be awesome.  Especially export to php.  Perfect use for rapid customizer theme or plugin builder.
Another idea to promote rapid development could be in providing the empty php code blocks that can be copied to the clipboard easily.  I like where this is going because one of the things that attracts me to Kirki in the first place is to short-circuit the much longer wp method to reduce dev time.

"Export to php" is also completed but i haven't release the code yet.

When you release "Export to PHP" feature? This feature is important for theme developers.


Splitting fluid-framework api docs based on exported packages.

Closes https://github.com/microsoft/FluidFramework/issues/10310.
fluid-framework folds and re-exports four different packages, causing generated API docs to lack organization and clarity. Furthermore, fluid-framework does not give reader any deeper context about APIs it exports other than stating it "bundles a collection of Fluid Framework client packages for easy use". With this PR we are splitting fluid-framework docs based on exported packages. We are keeping it transparent what packages are folded within fluid-framework and we are letting the user drill into api docs for those packages, as they explore fluid-framework.
This seems like the most natural logical boundary/grouping we can use to improve fluid-framework api doc organization, without needing to create another, more synthetic, categorization schema. Each sub-package offers the reader further context they can use to reason about the APIs and functionality they offer. In the long term, if we decide to re-export further packages from fluid-framework, they will get their own api docs grouping with some minor config changes. On the other hand, if we decide to get rid of fluid-framework and export packages individually at some point in time, being transparent about the re-exported packages from the get-go, may help us present that direction change, as a smaller, somewhat natural progression.

I love the overall simplicity of this change, but it is a reminder that the way the navigation works in the site template is RIDICULOUS and complex.

I'm getting familiar with templating here but generally agree - not too much flexibility there as well.


Adding PyPI Support

I rebased the most recent commits into my fork/branch before making any changes. PyPI requires the package name to be in lower case, hence my not following the established camel case convention. I saw pull requests from a year ago or so attempting to implement this same functionality that were closed. I have no problem just rebasing my fork whenever major releases occur upstream, but figured I'd make a pull request in case this is something you want do want to implement. I already pushed my fork build to PyPI, but I can delete it or transfer ownership on PyPI to Ganapati if the pull request does wind up being approved. The only unit tests that are failing on my fork are also failing on a fresh pull from upstream, so I'm like 99.9% sure I didn't bork anything.

I just realized I didn't update README.md with pip/pipx installation instructions, or change the examples to 'rsactftool' instead of './RsaCtfTool.py'. I'm not sure if I can amend pull requests after submitting them, so I'm just going to leave it for now.

I've never pushed a package to pypi, so this PR will take longer to check for me ! thx for the work :)

I'm closing it for some time, i'll do some research on pypi and check it later with more attention.
Thanks for the cool work ! Don't worry, it will be used :)

Glad to hear it! I'll just keep my fork rebased and push updates to PyPI until then for myself to use. I'll add you as the owner on PyPI whenever you're ready.


Support Windows ARM64 builds

Handle the "ARM64" system processor type.

@compnerd

@swift-ci please test macOS platform

@swift-ci please test macOS platform

@compnerd Mind triggering the mac test again?

@swift-ci please test macOS platform

@swift-ci please test macOS platform

Please test with following PRs:
https://github.com/apple/swift-corelibs-foundation/pull/4886
@swift-ci please test macOS platform

Please test with following PRs:
https://github.com/apple/swift-corelibs-foundation/pull/4886
@swift-ci please test macOS platform

@swift-ci please test macOS platform

CC: @shahmishal @stmontgomery - it seems that the failures on macOS are due to the runner and build configuration being out of sync. Can we get this change merged? It is a build only change which doesn't impact macOS.


Respect --exclude-flags 0

Update tracks.py to set duplicate and vendorFailed in Bam track's options to True. Otherwise, igv.js will filter out duplicate and vendorFailed reads even though --exclude-flags is 0.
Since pysam filters out reads before serializing the data into data url, this PR fixes this bug by making igv.js to show all reads.

@jrobinso  PTAL. To reproduce the bug,

have a few reads that are marked vendorFailed or PCR duplicates.
pass --exclude-filter 0 when creating a report.
Observe that the HTML generated will filter out reads even though user explicitly specified --exclude-filter 0

I don't understand this change, it looks like you are turning off vendor failed and exclude duplicates flags irrespective of input flags.

I don't understand this change, it looks like you are turning off vendor failed and exclude duplicates flags irrespective of input flags.

The input flag (i.e. --exclude-flag) is passed to pysam for filtering out reads here: https://github.com/igvteam/igv-reports/blob/b684d696c82cea273aa6f38a9880462e456edc1b/igv_reports/bam.py#L47 Therefore, the reads serialized into data url will respect --exclude-flag. However, because igv-reports isn't setting igv.js options right, igv.js will additionally filter out vendor failed and duplicates.
To respect --exclude-flag, igv-reports needs to turn off all default reads filtering in igv.js and make igv.js display all reads , as the reads being serialized into data urls have gone through filtering (by pysam).

If you wish to customize igv options for a track you can do that with the --track-configs option.

Ok great. Thanks. That seems to work. For anyone else, the --track-config should look like
[
    {
      "name": "Alignments",
      "url": "path/to/bam.bam",
      "filter": {
        "duplicate": false,
        "vendorFailed": false
      }
    }
]

I'm going to reopen as a reminder to allow pass-thru flags to pysam,  I was just suggesting --track-config as a workaround.

Oh disregard, you can already do that.  Sorry for confusion, too many projects.

This PR would be good, BTW, if you included a check on the value of --exclude-flags at line 24 of tracks.py.  The problem with it was disabling the filter for all reports.

Actually I just understood the logic of this PR,  I think your solution is fine.  Sorry for my confusion.


[BUG] Stuck at Generating Report

Is there an existing issue for this?

[X] I have searched the existing issues

Description
I have been following the tutorial After the tests are completed, it is stuck at the report creating phase.
Screenshot 1: Main page

Screenshot 2: Generating report page

Current Behavior
No response
Expected Behavior
No response
Steps To Reproduce
No response
Environment
- Operating System and Version: Ubuntu 22.04
- AI Verify Version: 0.9 (Docker tag version)
- Built with Dockerfile

Screenshots/ Code snippets
No response
Additional Context
No response
Possible Solution (Optional)
No response

Hi @stephenllh, thanks for raising this issue to us. May I know how long did it took for the report to generate? I see from the screenshot above that the Test Completed Successfully.

I waited for hours before I restarted the container. After restarting, it tried to auto-generate the report but I did not see any generated report. That is the weird part - the stdout did mention the report has been generated, but I do not see anything from the frontend.

Hi @stephenllh, let me check on this and get back to you on it..


more array libfuncs

snapshot pop front
snapshot pop back

Codecov Report

Merging #203 (7284408) into main (3d04da8) will decrease coverage by 1.30%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##             main     #203      +/-   ##
==========================================
- Coverage   52.44%   51.14%   -1.30%
==========================================
  Files          66       66
  Lines        5749     5895     +146
==========================================
  Hits         3015     3015
- Misses       2734     2880     +146

Impacted Files
Coverage Δ

src/libfuncs/array.rs
82.77% <0.00%> (-16.81%)
:arrow_down:

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Refactor examples to fix their use of the Domain module

Since Domain.id was made a private type, the examples for Reagents have no longer been compiling as they relied on Domain.id being an integer.  This pull:

Refactors the non-affine and affine schedulers into a single scheduler.  This greatly improves the maintainability of the scheduler and unifies the interfaces of the schedulers (the fork_on method now has the same signature for the non-affine and affine schedulers).  It also makes it clear how the affine scheduler differs to the non-affine scheduler.
Refactors the scheduler to create a separation between the idea of queues and domains.  Now, the scheduler only exposes queues and threads.  Queues still mapping 1-to-1 onto domains as before, but the abstraction is more obvious now.  Modules using the scheduler now reference a queue with fork_on rather than a domain.  This means that modules can continue referencing the "domain" they are executed on with an integer.
Exposes a new get_qid method on the scheduler to return the queue the function is being executed from.  This replaces instances of the opaque type Domain.id with something that can be printed.

Fixes #18.

Brilliant. Thanks!