Deleting a dynamic PVC of openebs-jiva-default class does not empty the pods in openebs namespace.

I have originally asked this question on microk8s repo (https://github.com/ubuntu/microk8s/issues/2434), as it is what I'm using, but they claim I should ask you guys here.
When I create a pod with an OpenEbs storage requirement, except for the PVCs, microk8s also spins up pods on each node. These pods remain even after the deployment has been deleted and I need to go through them and delete them manually.
Is this the correct behaviour and I should delete them manually, or is this a bug in openebs?

cc @kmova @Ab-hishek @vishnuitta @shubham14bajpai

Hi @turowicz These volume related deployments should get deleted when the PVC is deleted.

These pods remain even after the deployment has been deleted

Are you deleting the PVC as well when the deployment is deleted?

Yes because I helm uninstall a release, so everything should be gone.

Can you please once try uninstall and check if the PVC gets deleted or not

@turowicz is it StatefulSet based volumes ?.

@shubham14bajpai yes the PVC are deleted on helm uninstall, only openebs pods remain for each node.
@prateekpandey14 yes this is connected to stateful sets. Delete is the reclaim policy.

@turowicz can you share the openebs-apiserver pods logs here, wanted to check if there are any errors , also what is the k8s version ?

K8S: microk8s 1.21
openebs-apiserver:
+ MAYA_API_SERVER_NETWORK=eth0
+ ip -4 addr show scope global dev eth0
+ grep inet
+ awk '{print $2}'
+ cut -d / -f 1
+ CONTAINER_IP_ADDR=<IP_ADDRESS>
+ exec /usr/local/bin/maya-apiserver start '--bind=<IP_ADDRESS>'
I0713 21:41:15.150762 1 start.go:148] Initializing maya-apiserver...
I0713 21:41:15.214979 1 start.go:279] Starting maya api server ...
W0713 21:41:15.278331 1 warnings.go:70] apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition
W0713 21:41:15.296687 1 warnings.go:70] apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition
W0713 21:41:15.302111 1 warnings.go:70] apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition
W0713 21:41:15.308734 1 warnings.go:70] apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition
W0713 21:41:15.315719 1 warnings.go:70] apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition
W0713 21:41:15.322711 1 warnings.go:70] apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition
W0713 21:41:15.328128 1 warnings.go:70] apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition
W0713 21:41:15.335605 1 warnings.go:70] apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition
W0713 21:41:15.340637 1 warnings.go:70] apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition
W0713 21:41:15.347689 1 warnings.go:70] apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition
W0713 21:41:15.352659 1 warnings.go:70] apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition
W0713 21:41:15.359746 1 warnings.go:70] apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition
W0713 21:41:15.364637 1 warnings.go:70] apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition

openebs-provisioner-855f4d7598-4zdlr.log

In the provisioner logs there are no PVC Delete request for the newly provisioned PVCs. for example pvc-09ce295b-ce5a-4db0-b45f-5f4384f241f4 only have provisioned logs, no delete request have been made. what is the pvc status, are they deleted from the cluster ? what kubectl get pvc --all-namespace says ?

Yes, the PVCs from uninstalled releases are gone.

@prateekpandey14 @shubham14bajpai can you send me an example helm template that should have this working correctly? Perhaps I am missing something in my definitions.

@turowicz you can install any application helm charts like prometheus, mongo etc from their stable charts repo, or you can check out some example statefulset example here in openebs docs.

@prateekpandey14 I am using these charts:
helm repo add bitnami https://charts.bitnami.com/bitnami
helm repo update

helm upgrade --wait -f values/Database/cql.openebs.yaml my-database-cql bitnami/cassandra --version 7.6.1

cql.openebs.yaml:
replicaCount: 2
cluster:
  endpointSnitch: GossipingPropertyFileSnitch
image:
  registry: surveily.azurecr.io
  repository: cassandra
  tag: "20210414.1"
  pullSecrets:
    - s-dev-repo
dbUser:
  user: sa
  forcePassword: true
  password: [redacted]
persistence:
  size: 100Gi
  enabled: true
  storageClass: openebs-jiva-default
metrics:
  serviceMonitor:
    enabled: true
    interval: 15s
resources:
  limits:
    cpu: 4000m
    memory: 8Gi
  requests:
    cpu: 4000m
    memory: 8Gi

So as you can see nothing out of the ordinary. Deleting that release keeps the pods in openebs namespace.

@turowicz i just tried installing the bitnami/cassandra chart in my local cluster, since its a Statefulset, uninstalling a chart, will not delete the PVC automatically its by design in k8s, and you have to delete the pvc using a kubectl command.
Deleting and/or scaling a StatefulSet down will not delete the volumes associated with the StatefulSet. This is done to ensure data safety, which is generally more valuable than an automatic purge of all related StatefulSet resources.

@prateekpandey14  Well that is not what I am experiencing:
PVCs:

134 pods in openbs namespace:

also PVs:

On cassandra example:

Deployment creates a PVC that automatically gets a PV with a GUID.
OpenEbs creates a pod for that GUID PV.
Uninstalling removes the PVC and PV, but the pod remains.

Uninstalling removes the PVC and PV, but the pod remains.

But PVC/PV exists in above screenshot, is that they are not the deleted one ?
So basically just to see the behavior, i tried below steps

install charts with  1 Replica count in SC

helm install cassandra --set persistence.storageClass=openebs-jiva bitnami/cassandra

pod and pvc

$ kubectl get pods
NAME          READY   STATUS    RESTARTS   AGE
cassandra-0   0/1     Running   0          30s

$ kubectl get pvc
NAME               STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS   AGE
data-cassandra-0   Bound    pvc-9ff5b909-f607-4f65-ac28-f12ab6d310e6   8Gi        RWO            openebs-jiva   2m8s

$ kubectl get pods -n openebs -l openebs.io/persistent-volume=pvc-9ff5b909-f607-4f65-ac28-f12ab6d310e6
NAME                                                              READY   STATUS    RESTARTS   AGE
pvc-9ff5b909-f607-4f65-ac28-f12ab6d310e6-ctrl-7668c87cd4-465vr    2/2     Running   0            45s
pvc-9ff5b909-f607-4f65-ac28-f12ab6d310e6-rep-1-58c8d8c87f-hxk7n   1/1     Running   0          45s

Uninstall charts will remove the charts only not the PVC (as expected)

$ helm uninstall cassandra
release "cassandra" uninstalled

$ kubectl get pods
NAME          READY   STATUS        RESTARTS   AGE
cassandra-0   1/1     Terminating   0          2m

kubectl get pods
No resources found in default namespace.

kubectl get pvc
NAME               STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS   AGE
data-cassandra-0   Bound    pvc-9ff5b909-f607-4f65-ac28-f12ab6d310e6   8Gi        RWO            openebs-jiva   7m23s

kubectl get pods -n openebs -l openebs.io/persistent-volume=pvc-9ff5b909-f607-4f65-ac28-f12ab6d310e6
NAME                                                              READY   STATUS    RESTARTS   AGE
pvc-9ff5b909-f607-4f65-ac28-f12ab6d310e6-ctrl-7668c87cd4-465vr    2/2     Running   0          9m55s
pvc-9ff5b909-f607-4f65-ac28-f12ab6d310e6-rep-1-58c8d8c87f-hxk7n   1/1     Running   0          9m48s

Delete the PVC to delete the Jiva pods

$ kubectl delete pvc data-cassandra-0
persistentvolumeclaim "data-cassandra-0" deleted

$ kubectl get pods -n openebs -l openebs.io/persistent-volume=pvc-9ff5b909-f607-4f65-ac28-f12ab6d310e6
No resources found in openebs namespace.

I will test the above.

But PVC/PV exists in above screenshot, is that they are not the deleted one ?

There are 27 PVs and 134 pods in openebs namespace. For 3 nodes there should be 27x3 pods. This means there are phantom pods for PVs/PVCs that no longer exist.

There is a difference here, on microk8s the storage class is called openebs-jiva-default
So I need to deploy with:
helm install cassandra --set persistence.storageClass=openebs-jiva-default bitnami/cassandra

After helm uninstall and deleting the PVC I still have deployments and pods remaining.
kubectl get deployment -n openebs
NAME                                             READY   UP-TO-DATE   AVAILABLE   AGE
openebs-apiserver                                1/1     1            1           7m13s
openebs-provisioner                              1/1     1            1           7m13s
openebs-localpv-provisioner                      1/1     1            1           7m13s
openebs-admission-server                         1/1     1            1           7m13s
openebs-snapshot-operator                        1/1     1            1           7m13s
openebs-ndm-operator                             1/1     1            1           7m13s
pvc-39d66aa2-0896-4508-b305-63c11cabec99-rep-2   0/1     1            0           2m6s
pvc-39d66aa2-0896-4508-b305-63c11cabec99-rep-3   0/1     1            0           2m6s
pvc-39d66aa2-0896-4508-b305-63c11cabec99-rep-1   1/1     1            1           2m6s
pvc-39d66aa2-0896-4508-b305-63c11cabec99-ctrl    1/1     1            1           2m6s

kubectl get pod -n openebs
NAME                                                              READY   STATUS    RESTARTS   AGE
openebs-ndm-rfrlh                                                 1/1     Running   0          7m16s
openebs-apiserver-76494788bc-t5phx                                1/1     Running   0          7m16s
openebs-provisioner-7cb669f466-2xlp8                              1/1     Running   0          7m16s
openebs-localpv-provisioner-66b9f8ff98-qw2sq                      1/1     Running   0          7m16s
openebs-admission-server-84bd769954-mvj54                         1/1     Running   0          7m16s
openebs-snapshot-operator-669696cd5d-5rdlc                        2/2     Running   0          7m16s
openebs-ndm-operator-79d596bd67-p7g72                             1/1     Running   0          7m16s
pvc-39d66aa2-0896-4508-b305-63c11cabec99-rep-2-6497f4b58b-ldtxx   0/1     Pending   0          2m9s
pvc-39d66aa2-0896-4508-b305-63c11cabec99-rep-3-6497f4b58b-2pshx   0/1     Pending   0          2m9s
pvc-39d66aa2-0896-4508-b305-63c11cabec99-rep-1-6497f4b58b-d42rm   1/1     Running   0          2m9s
pvc-39d66aa2-0896-4508-b305-63c11cabec99-ctrl-5bfb7686d8-5s8rm    2/2     Running   0          2m9s

Steps to reproduce:

sudo snap install microk8s --channel 1.21/latest --classic
sudo microk8s enable openebs
helm install cassandra --set persistence.storageClass=openebs-jiva-default bitnami/cassandra
helm uninstall cassandra
kubectl delete pvc ... (drop all cassandra pvcs)

@turowicz -- Able to reproduce the issue.
This seems to happen only when all of the replicas (in this case replicass =3, and 1/3 are available) are not available and the PVC is not bound. This might be because you have insufficient nodes in the cluster. You'll need at least 3 to schedule all 3 replicas.
When all the replicas are available, and the PVC is bound, the volume is made available to the application pod. On delete, cleanup occurs successfully.
Tested on Ubuntu 18.04
Microk8s channel 1.21/stable (classic)
OpenEBS version 2.11.0
cc: @prateekpandey14

My cluster has 3 nodes, all available:

Each node has 48 cores and 128GB RAM

For the case where all of the replica controller are scheduled, and not pending, the cleanup seems to work as expected, for me.
@turowicz -- Can we jump into a meeting so I may be able to take a closer look at your system over a screen-share? For a meeting, it will be convenient if you joined the Kubernetes workspace. You can use these links to join:

Join Kubernetes workspace -- https://slack.k8s.io
OpenEBS channel in the Kubernetes workspace -- https://kubernetes.slack.com/messages/openebs

@niladrih how about just a Google Meet? We use Discord at work instead of Slack.

Sure @turowicz. A Google Meet is good for me. I am at +5:30 UTC (IST). When is a good time for you?

@turowicz -- 11:30 - 12:30 (CEST) tomorrow? Drop me your email address, I'll send you an invite.

Sounds good<EMAIL_ADDRESS>

ADOPTERS.md over at openebs/openebs --> https://github.com/openebs/openebs/blob/master/ADOPTERS.md
You can add your Adopters' entry by dropping comment here --> https://github.com/openebs/openebs/issues/2719

Thank you for the call, it helped me a lot.
The solution is to never delete PV manually and just remove the PVC. The framework will automatically handle the deletion of PV and the pods.

You can use the following script to get rid of the clutter pods. USE AT OWN RISK.
#!/bin/bash

set -e

readarray -t volumes < <(kubectl get pv --no-headers -o custom-columns=":metadata.name")

for fn in `kubectl get deployment -n openebs --no-headers -o custom-columns=":metadata.name"`; do
    if  [[ $fn == pvc-* ]] ;
    then
        target=${fn:0:40}

        if  [[ ! ${volumes[@]} =~ ${target} ]] ;
        then
            kubectl delete deployment $fn -n openebs
        fi
    fi
done

echo "End"


Workflow - Add an input for Electrical Isolation in the workflow

Expected outcome

Edward edit 18.12.23 -> can we build in automated functionality in the workflow? to be discussed with Magnus & IDris
A list of all circuits present in the Release Control - this should pull through the description of the circuits. Think this is Circuit.Description or something similar.
Then, there should be a Electrical Isolation Column, that is a manual input for each circuit that includes:

Working without Disconnection
Disconnecting of entire Circuit
Disconnection of junction box / turned off at switch

There should then also be a column for Junction boxes, which is only available if the option "- Disconnection of junction box / turned off at switch" is selected, then the user needs to input at least one junction box tag into that box (should be a searchable field)

We also need some way to see all circuits in the system, and their isolation status (I think it might be a legal requirement) - potentially this needs to be done in PBI, as we can have Many Circuits tagged against a single RC stored in an Array. @JoneUE  - could you provide input :) ?

Acceptance Criteria

Table with:

[ ] Circuit - that is auto picked up from the HTs you enter
[ ] Circuit Description - auto picked up from the circuit
[ ] Electrical Isolation field selection with three options [- Working without Disconnection, - Disconnecting of entire Circuit, -Disconnection of junction box / turned off at switch]
[ ] A field to pick up Junction boxes if the user selects the option "- Disconnection of junction box / turned off at switch"

we need to reset the electrical isolations options to all being connected (as thats worst case), as some people may have edited the isolations in p&ht - we do not want people in release control to get the wrong picture on if something is isolated or not
We also need to disable the Isolation ability in P&HT, so that Circuit isolations can only be done in RC app. and that only the Functional role of RC - Electro Commissioning can make these changes

not planned. superceeded


Use cargo-make as the main task runner for the project

Proposed changes

Hi, unfortunately I did not have time to finish this ticket. All I added was a basic Makefile.toml, where I defined some tasks.
There is also a makefile.toml that Lukasz created a while back, which I am pasting below.
[env]
CARGO_MAKE_EXTEND_WORKSPACE_MAKEFILE = true

[config]
default_to_workspace = false

[tasks.format]
install_crate = "rustfmt"
command = "cargo"
args = ["fmt", "--", "--check"]

[tasks.clippy]
install_crate = "clippy"
command = "cargo"
args = ["clippy"]

[tasks.tarpaulin]
install_crate = "cargo-tarpaulin"
command = "cargo"
args = ["tarpaulin"]

[tasks.audit]
install_crate = "cargo-audit"
command = "cargo"
args = ["audit"]

[tasks.outdated]
install_crate = "cargo-outdated"
command = "cargo"
args = ["outdated"]

[tasks.msrv]
install_crate = "cargo-msrv"
command = "cargo"
args = ["msrv", "--minimum", "1.54.0"]

[tasks.clean]
command = "cargo"
args = ["clean"]

[tasks.build]
command = "cargo"
args = ["build", "--release"]
dependencies = []

[tasks.test]
command = "cargo"
args = ["test", "--verbose"]
dependencies = []

[tasks.test-apt-plugin]
env = { "CARGO_TARGET_X86_64_UNKNOWN_LINUX_GNU_RUNNER" = "sudo -E" }
command = "cargo"
args = ["test", "-p", "tedge_apt_plugin", "--features", "sudo-runner"]
dependencies = []

[tasks.run-mosquitto]
command = "mosquitto"
args = ["-p", "55555"]

[tasks.test-mosquitto-available-run]
command = "cargo"
args = ["test", "-p", "tedge_mapper", "--features", "mosquitto-available"]
dependencies = []

[tasks.test-mosquitto-available]
run_task = { name = ["run-mosquitto", "test-mosquitto-available-run"], parallel = true }

[tasks.test-mosquitto-available-all]
dependencies = ["test-mosquitto-available", "post-test-mosquitto-available"]

[tasks.post-test-mosquitto-available]
command = "killall"
args = ["mosquitto"]

[tasks.commit-all]
dependencies = [
    "format",
    "clippy",
    "build",
    "tarpaulin",
    "audit",
    "outdated",
    "msrv",
    "test",
    "test-apt-plugin"
]

[tasks.commit-tests]
dependencies = [
    "format",
    "clippy",
    "test"
]

[tasks.commit-build-tests]
dependencies = [
    "format",
    "clippy",
    "build",
    "test"
]

Lukasz' version is already quite complete.
What I think is missing is:

[ ] adding a cross compilation task
[ ] using this makefile in the pipeline

Paste Link to the issue

#1659

Thanks Alex. We will take this as a seed.
What I think is missing is:

A quick check/test coding workflow.
A pre-commit check that enforces clean commits.
A release workflow including cross compilation.

I did not get what is the motivation to use the cargo-make instead of existing build tools.

I did not get what is the motivation to use the cargo-make instead of existing build tools.

See the motivation given by @reubenmiller : https://github.com/thin-edge/thin-edge.io/issues/1659


problem calling elements in inherit routes

Hi, small bug I guess:
const AppRouter = {
   routes: [
      {
         name: "Home",
         path: "/",
         element: () =>
Home Page
,
      },
      {
         path: "/user",
         routes: [
            {
               name: "AuthLogin",
               path: "/login",
               element: <Login />,
            },
            {
               name: "AuthRegister",
               path: "/register",
               element: <Register />,
            },
         ],
      },
   ]
}

elements  and  are not called unless they are only at the same level as the Home route.

Try doing this:
const AppRouter = {
   routes: [
      {
         name: "Home",
         path: "/",
         element: () =>
Home Page
,
      },
      {
         path: "/user",
         element: () => <RouterView/>
         routes: [
            {
               name: "AuthLogin",
               path: "/login",
               element: () => <Login />,
            },
            {
               name: "AuthRegister",
               path: "/register",
               element: () => <Register />,
            },
         ],
      },
   ]
}

it does not work and after a few minutes I have an out of memory

Ah sorry. It was Outlet, not RouterView

oh indeed. Thanks for the quick replies :D


No exported module IPickerConfiguration

I'm receiving the following error:

Module '"../node_modules/ng2-color-picker/index"' has no exported member 'IPickerConfiguration'.

In my module, I've imported the ColorPickerModule as:
import { ColorPickerModule } from 'ng2-color-picker'

@NgModule({
  imports: [ColorPickerModule]
})

In my html, I have:
<color-picker [(ngModel)]="myColor" [pickerConfig]="colorConfig" name="color-picker"><color-picker>
Finally, in my .ts file:
import { IPickerConfiguration } from 'ng2-color-picker'

//@Component Stuff
export class MyColorComponent implements OnInit {
  public colorConfig:  IPickerConfiguation;

constructor(){}

ngOnInit(){
  this.colorConfig = { availableColors: ["#33cccc", "#99cc99"]};
}
}

Looks like this is simply a documentation change as IPickerConfiguration has been renamed to IColorPickerConfiguration.


Cannot find color scheme 'aura-dark'

i get error like this, is there any way to fix it? tks

Did you reopen the editor after installation?

Did you reopen the editor after installation? Run :PackerSync or :PlugInstall

yes

yes

Remove colorscheme from init.lua, sync and add colorscheme back to init.lua

still not work :(

aura-theme is not a colorscheme, the available colorschemes are described here: https://github.com/baliestri/aura-theme/tree/feat/neovim-port/packages/neovim#usage

still not work :(

aura-theme is not a colorscheme, the available colorschemes are described here: https://github.com/baliestri/aura-theme/tree/feat/neovim-port/packages/neovim#usage

it works with the current file but when opening a new file it gives an error
https://user-images.githubusercontent.com/43894751/156621705-c0ae72f9-9ed9-4633-b211-f6bd41e28d3b.mov

it works with the current file but when opening a new file it gives an error

I believe I found the problem, I just fixed it, please update and try again

it works with the current file but when opening a new file it gives an error

I believe I found the problem, I just fixed it, please update and try again

still the same bro :(

still the same bro :(

I believe it is now resolved, remove the plugin completely and follow the instructions at https://github.com/baliestri/aura-theme/tree/feat/neovim-port/packages/neovim

it works perfectly but the tab's color is hard to distinguish

it works perfectly but the tab's color is hard to distinguish

Okay, I'll start making adjustments soon

it works perfectly but the tab's color is hard to distinguish

Okay, I'll start making adjustments soon

you should also change the CursorLine colour. so thanks 👍

I'm having the same error.
I installed and got the same error from screenshotof @sieuda0kid . After this, I uninstalled the theme and reinstalled the theme and doesn't change anything.
After this I check if packer was downloading correctly the files and yes, it's doing right.

I'm having the same error.
I installed and got the same error from screenshotof @sieuda0kid . After this, I uninstalled the theme and reinstalled the theme and doesn't change anything. After this I check if packer was downloading correctly the files and yes, it's doing right.

Does your configuration in packer look like this?
use { 'nvim-treesitter/nvim-treesitter', run = ':TSUpdate' } -- Recommended, not required.
use {
  'baliestri/aura-theme',
  branch = 'feat/neovim-port',
  rtp = 'packages/neovim',
  config = function()
    vim.cmd("colorscheme aura-dark") -- Or any Aura theme available
  end
}


Unable to Reproduce Results with DeBERTa-v3-base and Questions on Epochs

Hello,
I'm facing a couple of issues while trying to replicate the results . I am using the DeBERTa-v3-base model and have followed the provided instructions closely. However, I encountered some problems that I hope you could help me resolve.
Question about Training Epochs:
I noticed in the code that only 6 epochs are used for training. Could you provide more context on why this number was chosen? Is it based on any specific observations or experiments?
Difficulty in Reproducing Results:
I attempted to reproduce the experimental results by using almost the same hyperparameters as specified, with the exception of the versions of the packages, CUDA, and the GPU model.
Despite these minor differences, I couldn't achieve the results reported in the paper. Notably, the performance is nearly identical when using both real and generated datasets, which seems unusual.
Additionally, even when training on the test set, the model does not overfit, which leads me to suspect there might be an issue with the codebase or my setup.
To ensure I've configured everything correctly, I double-checked the following:
The input and output paths are correctly set.
The rest of the hyperparameters match those in the original configuration.
I have tried different datasets (real and synthetic) but observed no significant difference in outcomes.
Could you please check if there's anything I may be missing or if there is a potential bug in the repository that could affect the reproducibility of the results? Any advice or guidance would be greatly appreciated.
Thank you in advance for your time and assistance.
The log is as bellow:
test_tryoverfit_log_file.txt
train_with_Ture_data_log_file.txt

Hi,
Thanks for reaching out. After reviewing your log, I noticed the following lines:
10/16/2024 19:30:33 - INFO - utils -   Loading features from cached file amazon/cache/cached_train_amazon_deberta-v3-base_128
10/16/2024 19:30:34 - INFO - utils -   Loading features from cached file amazon/cache/cached_dev_amazon_deberta-v3-base_128
10/16/2024 19:30:34 - INFO - utils -   Loading features from cached file amazon/cache/cached_test_amazon_deberta-v3-base_128

This suggests that the same cached files might be reused across different training rounds. To avoid this, try assigning unique names to your cached files for each dataset or training run.

Thank you for your prompt response and the insightful suggestion. I have indeed implemented the unique naming for the cached files, which has helped to resolve some of the issues I was facing.
I'm happy to say that I can now reproduce most of the results, but there's still one thing that's bugging me. During some of the experiments, the loss on the test set occasionally turns into NaN during evaluation. Have you ever run into something similar? Could it be due to data preprocessing, numerical instability, or maybe something else entirely?
Any thoughts or advice you could share would be super helpful.

I haven't encountered this issue in my experiments, but I recommend printing the model's predictions along with the labels. This way, you can check if any "NaN" values appear in either the test labels or the model's output.

I haven't encountered this issue in my experiments, but I recommend printing the model's predictions along with the labels. This way, you can check if any "NaN" values appear in either the test labels or the model's output.

Thank you for your reply!


Integration fail, can´t connect

Hi,
Like a week ago, started the integration to fail, and cannot import Connection
Logger: homeassistant.setup
Source: setup.py:214
First occurred: May 29, 2023 at 06:12:52 (1 occurrences)
Last logged: May 29, 2023 at 06:12:52

Setup failed for custom integration seatconnect: Unable to import component: cannot import name 'Connection' from 'seatconnect' (/usr/local/lib/python3.10/site-packages/seatconnect/__init__.py)

Also, I tried to remove the integration and create a new one but got almost the same fail.
Logger: homeassistant.config_entries
Source: config_entries.py:863
First occurred: 18:57:50 (1 occurrences)
Last logged: 18:57:50

Error occurred loading flow for integration seatconnect: cannot import name 'Connection' from 'seatconnect' (/usr/local/lib/python3.10/site-packages/seatconnect/__init__.py)

Any idea?
I appreciate any help you can provide.

I am the only one with the issue? I finally can remove the integration, then I re-downloaded in HACS, but when I try to add the integration the config flow fails, because of the same issue.
Logger: homeassistant.config_entries
Source: config_entries.py:863
First occurred: 15:45:43 (1 occurrences)
Last logged: 15:45:43

Error occurred loading flow for integration seatconnect: cannot import name 'Connection' from 'seatconnect' (/usr/local/lib/python3.10/site-packages/seatconnect/__init__.py)

I have the latest version of Home Assistant right now.
Home Assistant 2023.5.4
Supervisor 2023.04.1
Operating System 10.2
Frontend 20230503.3 - latest

If I have time I will try to make in a virtual machine a new installation and see if happens again, and I will try to download the library and check if locally without Home Assistant works the connection.

It was my problem, and finally I fixed.
Somehow, the seatconnect library package was corrupted (probably after an hass update), and stop to work. I created a VM and tested and worked correctly, so I knew it was not a integration issue, just for my installation. I tried to uninstall, remove from HACS, and everything, but when I installed again (after reboots, etc), I got the same error, so I knew something happened with the package installed in site packages.
Finally through a SSH I was able to enter to the "homeassistant" docker container, look for the folder, remove all the related content to this integration, uninstall everything from HACS related to this plugin, reboot the machine, and after it just try to install it normally, and it is working correctly again.
I write this here, so maybe it is helpful for someone in the future.


Typo fix

certiicate-based to certificate-based

@johnlokerse : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Looks good; thanks for this update @johnlokerse.


Enter nothing in REPL or just type space should just clear the current line without doing anything

For the first case, there should be no response from REPL, rather than reopening a new line for input
For the second case it should be like the first case, except that the input spaces are deleted
Continue https://github.com/erg-lang/erg/issues/56 because it was not really done

This is not actually an accidental act, but a functional suggestion @mtshiba

Now the input can be cleared by typing :clear (note that this does not reset the execution state).
Empty code is enabled as a program that does nothing.


Appendix P - update and fix

Import and improve Appendix P
Improvements from CP-ITI-948 from @ElliotSilver
https://docs.google.com/document/d/1vT9YVA0JiBm2K8JeYf4CZKNY4ss6DpgX/edit#heading=h.30j0zll
Plus update to FHIR Consent, and anything

@mojitoj would this page be a good place for the concepts in your latest blog?
https://jafarim.net/consent-overarching-policy/
Note that the current text is historic, it exists in ITI Technical Framework - Volume 1 - as Appendix P -- https://profiles.ihe.net/ITI/TF/Volume1/ch-P.html
We will be updating it in whatever way we need to. It will still be informative, and it will still be mostly about the original scope of policy, how to create them, what they need to cover, and how one might process them. There is some edits identified by Elliot Silver. I think your blog does a fantastic job.

Thanks John. If we are creating an inventory of existing literature on consent, there are also a number of blog posts from the LEAP project here: https://sdhealthconnect.github.io/leap/posts.html

I can create a PR for that.

https://github.com/IHE/ITI.PCF/pull/2


'Required' fields on Personal Information form are not validated

Description
Currently, when submitting the Personal Information form, you are allowed to advance even if you do not provide a value for Official First Name, Official Last Name, Preferred Name, Company Name and Mentor, even though the labels for these have an asterisk indicating they are required fields.
Expected behavior
Any field that displays with an asterisk in the field label should have an associated validator that stops the form submission and informs you that the field is required. This should also block it if a 'whitespace-only' value (like a space) is provided.
Steps To Reproduce

Go to /Application
Advance your form to the Personal stage
Ensure that Preferred Name, Company Name, and Mentor have no values.
Press the "Next" button.
The form will advance to the Objectives stage

NOTE: I later tested removing values for official first name, and the same thing happened. Seems to be a form-wide issue of no validation.
Possible Fix
Field validation should be added to ensure empty values are checked for on mandatory fields.
Screenshots

Closed as a dupe of #97 (Currently being deployed)


Option for the barges mod?

Hi,
in germany we have the Niederfinow Boat Lift. Would it be possible to create an additional asset like that for barges? :-)

Hey! I planned to do a locks mod at some point in the future, which I guess would include boat lifts.


Linux binary doesn't run on Kubuntu 20.04 LTS

Downloaded the latest linux binary from the releases page.
Extracted and tried to run it on Kubuntu 20.04 LTS. I get the following error:
bash: ./hastyscribe: No such file or directory

ldd hastyscribe gives:
./hastyscribe: error while loading shared libraries: /lib/x86_64-linux-gnu/libc.so: invalid ELF header

file hastyscribe gives:
hastyscribe: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), dynamically linked, interpreter /lib/ld-musl-x86_64.so.1, with debug_info, not stripped

So, I guess I need to install musl in order to use hastyscribe binary?

Yeah, annoying. I can reproduce it on my linux machine... The problem is that I run my release scripts from my mac and I cross-compile the executables for linux and windows. I'll try to see what the problem is. In theory it should run fine and it should be compiled statically.


Building a package or workspace in a subdirectory

I have a directory structure that looks like this:
.
├── backend
│   ├── Cargo.lock
│   ├── Cargo.toml
...
├── frontend
...

Up until now I've been able to set src = ./backend but now I need to access some files that live in the root.
I've gotten as far as this:
{
  src = ./.;
  cargoToml = ./backend/Cargo.toml;
  cargoLock = ./backend/Cargo.lock;
  cargoExtraArgs = "--manifest-path ./backend/Cargo.toml";
}

but now I seem to be stuck because cargo metadata doesn't get cargoExtraArgs: https://github.com/ipetkov/crane/blob/0017a8da6824c5f27c48cce7d614d3e590e75e35/lib/setupHooks/installFromCargoBuildLogHook.sh#L34
Is there a better way to approach this?

Best way IMO, is the filter src with an explicit list of stuff to include. Example from our project: https://github.com/fedimint/fedimint/blob/65b2058e52b773f83e023a7cbb1d13988bc19197/flake.nix#L424

If I understand correctly, I think you’re suggesting using a filter to make it look like the contents of the backend directory (in my case) are at the root. Is that correct?
If not, could you help me understand how filtering would help? The issue seems to be that Cargo.toml isn’t at the root.

If I understand correctly, I think you’re suggesting using a filter to make it look like the contents of the backend directory (in my case) are also at the root. Is that correct?

I think this approach would be problematic anyway because it would require changing relative paths that are looking for other files at the root and then that wouldn’t work in a dev shell when using cargo directly.

I think I’m going to see if introducing cargoManifestExtraArgs (which would default to cargoExtraArgs) fixes my issue and then maybe make a PR.

If I understand correctly, I think you’re suggesting using a filter to make it look like the contents of the backend directory (in my case) are also at the root. Is that correct?

No, I was going to suggest making them a workspace, and just filtering necessary files.

I already have a workspace in ./backend and build specific crates using -p so not sure how that helps. I'm trying to say src = ./. and still have crane be able to find what it needs without changing any of the existing directory structure.
I've been using naersk for a while and it differentiates between src and root for this purpose, although it doesn't work as it's supposed to at the moment.

I'm trying to say src = ./. and still have crane be able to find what it needs without changing any of the existing directory structure.

@paulyoung Have you tried setting sourceRoot = "source/backend"; and building that way? It's probably a much simpler solution to change into the directory which contains the workspace root (and still be able to access the parent directory).
If your build needs to work from the parent directory, you can always update the installPhaseCommand to temporarily move into the directory:
buildPackage {
  # other settings...
  installPhaseCommand = ''
    pushd ./backend
    installFromCargoBuildLog "$out" "$cargoBuildLog"
    popd
  '';
}

@ipetkov I haven’t (I wasn’t aware I could do that) but that sounds like a better approach. I’ll give it a try.
I was hoping there’d be a better way than what I’ve tried so far.

@paulyoung I believe this is probably the simplest way to achieve it. Also made things a bit easier and documented the approach in https://github.com/ipetkov/crane/pull/212 in case you want to give that a try!

Using sourceRoot instead gets me to the same place as what I was doing with #210 but with either approach the parent directory of the workspace isn't what I'd expect it to be.
I have a test which ascends to a parent directory with ../../... When I run this test with cargo it finds my root directory containing my backend directory and some other files that I want to use during the test.
When I run this with Nix, the directory I end up in contains:
.
|- tmp.xYwl96bE4K
|- .sandbox.sb
|- source
'- env-vars

I can provide an example if necessary.

Using installPhaseCommand instead of sourceRoot results in the same thing.

I can provide an example if necessary.

An example would be great!
It does look like your build script is hitting the root of the builder sandbox itself (the source directory should contain the actual unpacked version of the src input to the derivation). I'm not sure if maybe the way Nix cleans the sources it ends up omitting one parent directory or something. I think being able to look at your specific configs would help!

@ipetkov please see https://github.com/paulyoung/crane-nested-issue

Actually, I did something different in that repo (I found that I had to use craneLib.cleanCargoSource this time or I got an error) and that appears to be able to reach the root.
The file I'm interested in is missing but that's probably because of cleanCargoSource

On that, the error I was getting was chmod: cannot access 'source/nested': No such file or directory
I wasn't getting that in my actual repo but may have been on a slightly older version.

Thanks for the minimal example @paulyoung, I've figured out the issue!
So turns out that the generic unpack phase will create a directory based on the name of the derivation that is passed in:

When using src = pkgs.lib.cleanSource ./.; (which cleanCargoSources also does) the source name defaults to source (though it is possible to override this).
When using src = ./nested; the source name defaults to "nested"
When using src = ./.; the source name defaults to <store-hash>-source

So in pretty much all the cases except the first trying to set sourceRoot = "source/whatever" fails since the root of the source isn't named source!
There's pretty much a different workaround we need to use (and I'll update the docs with this) which uses a postPatch hook to cd in there without having to guess what the source is called. Then things should work whether or not a source filter is used!
# Changing the package definition to this works for me:
craneLib.buildPackage {
  inherit cargoArtifacts;
  pname = "foo";
  src = ./.;
  postUnpack = ''
    cd $sourceRoot/nested
    sourceRoot="."
  '';
  cargoToml = ./nested/Cargo.toml;
  cargoLock = ./nested/Cargo.lock;
  nativeBuildInputs = [
    pkgs.libiconv
  ];
  doCheck = true;
}

Thanks. That definitely fixes the standalone example but still isn't working for me in my real project. I'll keep trying to reproduce the issue.

When I run this with Nix, the directory I end up in contains:

.
|- .sandbox.sb
|- env-vars
|- source
'- tmp.xYwl96bE4K

I'm seeing the above when using src = ./.; and that doesn't seem to line up with what you said about how things should be named so wondering if that's somehow related to the issue I'm having.

Not sure, what version of Nix are you using?
Also in case you weren't familiar with this flag, you can run nix build .# --keep-failed to keep the directory after the builder exits so you can explore it interactively

Thanks, I’ll try that. I was looking for the equivalent of -K.

I think this just confirms what I already knew.
note: keeping build directory '/private/tmp/nix-build-rust-workspace-unknown.drv-1'

$ ls /private/tmp/nix-build-rust-workspace-unknown.drv-1
env-vars  source  tmp.W3JFsPQ3WN

$ ls /private/tmp/nix-build-rust-workspace-unknown.drv-1/source
Cargo.lock  Cargo.toml	src  target


Why don't use full URLs intead of relatives?

I always have a lot of problem configuring this library due it generate relative URLs instead of full ones.
Why don't add an option to set if Stolz will generate relative or full urls?

Well, the library generates the kind of URLs you give to it. If you give relative URLs, it will generate relative URLs and if you give absolute URLs, you'll get absolute URL.
The default configuration is for using relative URLs but it can be changed. Why default to relative URLs configuration?

To save space and take advantage of hierarchical locality,
To avoid nightmares when deploying to multiple environment.
And for a ton more of reasons every web programmer with experience should know.

If you want to to use absolute URLs by default you have many options:

Always provide absolute URLs.

Include your base URL in the css_dir and js_dir options:
// config.php
'css_dir' => 'http://mydomain.com/css',
'js_dir' => 'http://mydomain.com/js',

Set use the <base> HTML tag pointing to your root  base absolute URL.

Use the closure feature of the css and js functions to convert the URLs to your needs

If you have problems configuring and using the relative links, here are two good documents to read:

http://www.w3.org/TR/html401/struct/links.html#h-12.4.1 (including the links to the RCFs)
http://tools.ietf.org/html/rfc3986#section-4

When I declare css_dir and js_dir as an url, I get this error:
ErrorException in Manager.php line 464:
mkdir(): Invalid argument (View: D:\Progetti\studioelps.com\StudioElps\resources\views\master.blade.php) (View: D:\Progetti\studioelps.com\StudioElps\resources\views\master.blade.php)

Using absolute URLs work, but causes a mkdir error when pipeline is enabled

@fede91it , sorry for the late response.
I forgot the pipeline uses 'css_dir' and 'js_dir' for creating the dir. Then I'm afraid if you want to default to absolute URL you need to use one of the above approaches.

Ok thanks, I'll send you a PR for this issue asap


java.lang.ClassNotFoundException: org.springframework.security.oauth2.provider.token.UserAuthenticationConverter

I use Eclipse to search, it appears in spring-security-oauth2.jar, version 2.3.4.RELEASE
however, my effective POM is using 2.0.15.RELEASE. It is from the spring-security-oauth2-autoconfigure 2.1.1.RELEASE.
If I upgrade the version to 2.0.16.RELEASE, it will complain another class not found
java.lang.ClassNotFoundException: org.springframework.boot.context.properties.bind.Bindable
How do I fix this issue? which version of which is compatible with JWK token info ?

I am facing same issue, any solution for this?


Fix inheritance of some keys in provision step data

Some plugins did not inherit fields from the parent class correctly, which resulted in help texts being dropped, and become seems to be misplaced.
Pull Request Checklist

[x] implement the feature
[x] write the documentation

/packit test --identifier full


setBoundary and NPM

Hey, love the package. Just one thing, I don't believe that the latest update that added setBoundary is published to npm yet, and that caused some confusion. Would be great if that could be resolved.
Thanks!

I have the same needs , Please help solve it , Thanks a lot!

I have the same needs , Please help solve it , Thanks a lot!

Also, I am in same situation. Still the release is stuck at v3.0.0. If some maintainer of npm package see this, I hope you to release new version.

I'm now a maintainer.  v3.0.1 released https://github.com/form-data/form-data/releases/tag/v3.0.1

Thank you @niftylettuce.


(PEAR-135): Add automatic documentation generation for V2 code

Description
Add automatic documentation generation for V2 code
Screenshots/Screen Recordings (if Appropriate)

changes can be made to the design of the template if needed, this is just how it looks out of the box.


AsyncDaemon does not restart after transient database problem

Marten version: 2.8.0
Problem
After transient database connection problem, the daemon does not restart the projections. In fact, it seems to be stuck on stopping the projection.  Repro can be found here.
When I restart my postgres database running in docker, the last thing that gets logged from daemon logger is:
Npgsql.NpgsqlException (0x80004005): Exception while reading from stream ---> System.IO.EndOfStreamException: A
ttempted to read past the end of the stream.
   at Npgsql.ReadBuffer.Ensure(Int32 count, Boolean async, Boolean dontBreakOnTimeouts)
   at Npgsql.ReadBuffer.Ensure(Int32 count, Boolean async, Boolean dontBreakOnTimeouts)
   at Npgsql.NpgsqlConnector.DoReadMessage(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readin
gNotifications, Boolean isPrependedMessage)
   at Npgsql.NpgsqlConnector.ReadPrependedMessages(Boolean async)
   at Npgsql.NpgsqlConnector.ReadMessage(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingN
otifications)
   at Npgsql.NpgsqlConnector.ReadExpecting[T](Boolean async)
   at Npgsql.NpgsqlDataReader.NextResult(Boolean async)
   at Npgsql.NpgsqlDataReader.<NextResultAsync>b__31_0()
   at Npgsql.NpgsqlCommand.Execute(CommandBehavior behavior, Boolean async, CancellationToken cancellationToken
)
   at Npgsql.NpgsqlCommand.ExecuteDbDataReader(CommandBehavior behavior, Boolean async, CancellationToken cance
llationToken)
   at Npgsql.NpgsqlCommand.<>c__DisplayClass90_0.<<ExecuteDbDataReaderAsync>b__0>d.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at Marten.Events.Projections.Async.Fetcher.buildEventPage(Int64 from, NpgsqlCommand cmd)
   at Marten.Events.Projections.Async.Fetcher.fetchNextPage(Int64 lastEncountered)
   at Marten.Events.Projections.Async.Fetcher.<>c__DisplayClass26_0.<<FetchNextPage>b__0>d.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at Marten.Events.Projections.Async.ErrorHandling.DaemonErrorHandler.TryAction(Func`1 action, IMonitoredActiv
ity activity, Int32 attempts)
Stopping projection MartenDeamonProblem.CounterValue

Notice "stopping" but no "stopped". The daemon does not resume projections after database is up again.
Expected behaviour
The daemon should resume projections when database is reachable again.
Possible cause of the problem
I tried to track the problem and it seems to originate in the "pause" action in exception handling.
private async Task pause(IMonitoredActivity activity)
{
	try
	{
		await activity.Stop().ConfigureAwait(false);
	}
	catch (Exception e)
	{
		_logger.Error(e);
	}

	await Task.Delay(_handling.Cooldown).ConfigureAwait(false);

	try
	{
		await activity.Start().ConfigureAwait(false);
	}
	catch (Exception e)
	{
		_logger.Error(e);
	}
}

The pause action waits for the ProjectionTrack to stop, which in turn waits for the Fetcher to stop. But Fetcher stop action is this:
public Task Stop()
{
	if (State != FetcherState.Active)
	{
		return Task.CompletedTask;
	}

	State = FetcherState.Waiting;

	return _fetchingTask;
}

The fetching task will never complete, because it is this task that initiated the pause in the first place. So basically this task awaits itself to complete but at the same time prevents itself from completing.
If the pause code was changed to this:
private Task pause(IMonitoredActivity activity)
{
	try
	{
		activity.Stop().ConfigureAwait(false);
	}
	catch (Exception e)
	{
		_logger.Error(e);
	}

	Task.Run(async () =>
	{
		await Task.Delay(_handling.Cooldown);
		try
		{
			await activity.Start().ConfigureAwait(false);
		}
		catch (Exception e)
		{
			_logger.Error(e);
		}
	});

	return Task.CompletedTask;

}

Then the daemon behaves as expected.  Any idea how to solve it in a better way?

I don't think the Fetcher.Stop() is a necessarily a problem unless it's a threading issue that deadlocks somewhere. Your code just kicks it into a different thread, right?
I don't have a better idea and there's not points for style here, so I'm going to use your fix in 2.9 and see how this goes for now

Hi Jeremy,
The deadlock was exactly the problem I observed, with the task waiting for itself to complete but at the same time preventing itself from completing.
The sample solution I posted is not very well tested. However the basic path worked: when postgres was down, the deamon was in a stop-pause-start loop and resumed when postgres was back online. Probably behavior in edge cases needs to be considered.

"Fixed" for now with https://github.com/JasperFx/marten/commit/e6e41776302dc1a759d17f689b77e20696953de1


iOS 13 detection as MacOS

On iOS 13 window.navigator.userAgent in Safari on iOS 13 is same as on MacOS. Something like this:
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0 Safari/605.1.15

the reason is because "Request Desktop Website" parameter is now enabled by default, so instead of os-ios we get os-mac on iOS 13
Indeed, while option change in Settings may be a good solution for the user, any developer can't rely on that. It is as weird as to ask the user to not to use dark mode cause your app doesn't support it instead of opt-out of it using plist.
Proposal is to add additional validation for os-mac:
const isIOS = navigator.platform === 'MacIntel' && navigator.maxTouchPoints > 1

real macs have no multi-touch support, this solution is ideal to detect iOS 13 devices which are the only multi-touch "MacIntel" devices in existence

Introducing a reference to navigator within parseUserAgent would break the idempotent design for the module and I would prefer not to do that.
To continue the current design I suggest to add the required information as an option to parseUserAgent the same as the user agent is sent.
To keep things as generic as possible I would add two distinct new options:

platform [optional]: can be initialized from navigator.platform
maxTouchPoints [optional]: can be initialized from navigator.maxTouchPoints

That would change usage from:
var deviceInfo=window.uaDeviceDetector.parseUserAgent({
      userAgent:/*Useragent*/,
});

To:
var deviceInfo=window.uaDeviceDetector.parseUserAgent({
      userAgent:/*Useragent*/,
      platform: navigator.platform,
      maxTouchPoints: navigator.maxTouchPoints
});

Would that be good for you?


Add Privacy Policy To The Site

The copy of the privacy policy can be found here: https://hackmd.io/@scopelift/HyEpN9iln
The Privacy Policy should be added as a "link" next to the "How does it work?" link. It should bring up a modal with the contents in the same way as that link does.

#143 Closed this


Confusing license terms for end-users - unclear pricing

Provide a link to the page with an issue:
https://www.pachyderm.com/about/pachyderm-community-license-faq/
Describe what is wrong:
The License FAQ goes into great detail on the whole "competing solution" topic. But we are just looking into using pachyderm on our on-prem Kubernetes cluster. The FAQ does not explain what this license means for users. It only talks about redistribution.
The FAQ mentions that it is not a commercial license. So is pachyderm complete free to use for on-prem clusters? Or are the features locked behind a paywall? Or how does this work?
Describe the suggested changes:
Explain in the FAQ what the license means for end-users and pricing.
AB#132

Hi @Spenhouet , thanks for opening this issue.
Pachyderm is free of use for on-prem/self-managed clusters, with some limitations as described here.

Community Users can deploy up to 16 pipelines.
Community Users can run up to 8 workers in parallel on each pipeline.

Besides these limitations, the commercial Pachyderm version comes with authentication, a GUI, and a few other bells and whistles.
I'm happy to chat with you about this in more detail, feel free to book 30 min with me: https://calendly.com/pachyderm-jan/
Btw, we'll make sure to make the community vs commercial differences more clear in the documentation.

Btw, we'll make sure to make the community vs commercial differences more clear in the documentation.

This would be very helpful. The differences you describe where totally unknown to me from the webpage.
We are looking into running something like Kubeflow for the ETL pipelines, so I guess the limits on pipelines would not affect us.
But stuff like

authentication, a GUI
definitely affects. Maybe you could also clarify these differences in more detail on the coming documentation?
Like what type of authentication is available for the community version? None? Or does the commercial version just add auth. features like single sign on, LDAP, 2FA?
Does this mean the community edition comes completely without GUI? What does this GUI show?

Sorry if these questions seem trivial but for someone evaluating if we even should spend time taking a closer look into pachyderm these details are necessary.
Looking forward to the coming documentation / comparison on this.

@Spenhouet we're currently working on updating https://www.pachyderm.com/platform/#enterprise, which would likely address your questions.
We'll make sure to clarify the specific features which are part of the community edition vs the enterprise version.
You're correct that the community edition comes only with a CLI interface and an API but not with a GUI. Authentication such as SAML and OIDC is also part of the enterprise version only.  The GUI has just recently been reworked and gives you a good overview of what's running in your cluster and helps to quickly debug any pipelines which may have stopped/failed.
If you're interested, I'm happy to give you a quick demo of the new GUI and we can talk through the community vs enterprise differences. We're used to guiding users, like yourself, based on their needs to either recommend the community or the enterprise product.

Hi @Spenhouet
Let us know if the rewording of the enterprise features page gives you a better sense of what the enterprise edition adds to Core Pachyderm. See the attached PR.
I'll go ahead and close this issue but feel free to re-open it if you feel like the issue has not been addressed.
Thank you for being a user.


The request was sent to a wrong person

Subject: The request was sent to a wrong person
Description:
I found a host, checked out his references, open a profile of one of the guys from references, returned back to the host profile and wrote a request.
Results:
The request was sent to the guy from references instead of the host, I wrote it from the host profile page though.
Backend version: develop-53223cb2
Frontend version: develop-53223cb2
User Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/<IP_ADDRESS> Safari/537.36
Page: https://couchers.org/messages/request/87535
User: jeffyololo (41753)

Might be godo to investigate this further


add deflection functionality

create deflection plots by integrating the M/EI eqn w.r.t. x

Done.. Added deflection plot for simple beam


Disabling animation when changing ItemSource

Hi @AndreiMisiukevich,
Is there a way to remove the animation when changing ItemSource?
Code to repro could be the following:
resetting the item where myContentList is a pointer to another container that has been refreshed but not picked up by ItemSource event handler. Forcing a reset by changing the source to Null before resetting it to myContentList
ContentCarouselView.ItemSource = null;
ContentCarouselView.ItemSource = myContentList;

or simply changing the itemsource to another container
ContentCarouseView.ItemSource = new List<ContentDataModel>() {
                        new ContentDataModel() { RawText = "hello world!" }
                    };

Hi @AndreiMisiukevich
With the newest version, I can not disable the bounce effect on CoverFlowView with your custom class above. Please help.

@sonbt56 please show me a short video, what exactly do you want to disable?

Hi.
I think that @sonbt56 refers to this => https://github.com/LuisM000/CardView/commit/04457b8aaebd4f7b1ce59dde68cb29440f36b5dc

@LuisM000 what the reason to have this line https://github.com/LuisM000/CardView/commit/04457b8aaebd4f7b1ce59dde68cb29440f36b5dc#diff-967abc1dc5b5c72b0e48c637da8cffb1R56
?
Items is observable collection

@LuisM000 what the reason to have this line LuisM000@04457b8#diff-967abc1dc5b5c72b0e48c637da8cffb1R56
?
Items is observable collection

It is just an example.
It is for you to see that, when updating the ItemsSource, an animation (unwanted) occurs
Thanks!

@LuisM000
class CustomCoverflowView : CoverflowView {
    protected override HardSetAsync()
    {
        SetAllViews(true);
    }
}

@AndreiMisiukevich works fine!
Thanks!

@AndreiMisiukevich This is still a problem for me, despite trying both of your fixes above. I don't mind the animation so much but it is causing major issues for me when, in iOS, I background the app, then changes are made to the remote source, and I foreground it again. The animation gets "stuck" half way through and is partially faded/scaled out? I also tried setting IsAutoNavigatingAnimationEnabled to false. I just want to stop the animation!

@AndreiMisiukevich This is still a problem for me, despite trying both of your fixes above. I don't mind the animation so much but it is causing major issues for me when, in iOS, I background the app, then changes are made to the remote source, and I foreground it again. The animation gets "stuck" half way through and is partially faded/scaled out? I also tried setting IsAutoNavigatingAnimationEnabled to false. I just want to stop the animation!

//Application class
protected override void OnSleep() {
carousel.IsAutoNavigatingAnimationEnabled = false;
carousel.ForceRedrawViews();
}

protected override void OnResumed() {
carousel.ForceRedrawViews();
carousel.IsAutoNavigatingAnimationEnabled = true;
}

or provide me a sample with issue


Comparison operation inconsistent when byte-lengths differ

crunch.compare(crunch.parse("2"), crunch.parse("-100")) // -> 1
crunch.compare(crunch.parse("2"), crunch.parse("-1000")) // -> -1
crunch.compare(crunch.parse("-256"), crunch.parse("-65535")) // -> 1
crunch.compare(crunch.parse("-256"), crunch.parse("-65536")) // -> -1

It seems that any multi-byte negative representation is treated as greater than any single-byte representation, and the same for other differing sizes.

In addition to the above problem, two negative values are compared as if they are both positive.
// Using "raw" mode.
var x = [1];
x.negative = true;
var y = [2];
y.negative = true;
console.log(crunch.compare(x, y)); // Should be 1. Prints -1.

Should I do a pull request to fix both the above problems? (It's a pretty simple change to cmp.)

Please do if you have solved the issue.
Thanks,
Nenad
On 23 September 2016 at 18:39, Jeff Thompson<EMAIL_ADDRESS>wrote:

Should I do a pull request to fix both the above problems? (It's a pretty
simple change to cmp.)
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/vukicevic/crunch/issues/16#issuecomment-249241598,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AEyiusmDKMmtpH3Ez16BHIUmT4pLUFAJks5qtADEgaJpZM4GtrF7
.

Additionally, fixed the parse then compare bug in #26


Backport 2.7: Add missing return value check in ECDSA test suite

This is the backport to Mbed TLS 2.7 of #2107.

retest

Jenkins is now passing, so marking as 'ready for merge'.


PowerToys Run: Working directory based on explorer.exe

Set the working directory of the started program to the top-most open explorer.exe path.
This can be done by querying SHDocVw for open explorer.exe windows, building Z-order and getting path from the top-most window.
This should however not be the default behaviour for all executables.
I propose to use this feature only when executing a program with the Alt + Enter shortcut.
Use case:
If you want to run let's say terminal emulator in your currently open folder.
Sample project:
Querying the SHDocVw for currently open explorer.exe windows: https://github.com/keombre/spotlight/blob/d10b5c5af2b9302ff175a1d0bd96dd6d107d46f4/Spotlight/Parser.cs#L99

@keombre
can you please add you suggestion to https://github.com/microsoft/PowerToys/issues/3159 that is the tracker for this problem.
Thanks.

@keombre
can you please add you suggestion to https://github.com/microsoft/PowerToys/issues/3159 that is the tracker for this problem.
Thanks.


Benchmarking using other image metrics

instead on only PSNR what about
MS-SSIM¹²
GMSD¹
or
Perceptual Loss¹²
or maybe OCR recognition rates¹
?train using a weighted-average function of the metrics?.
option to take into account often neglected sRGB-nonlinearity ¹
(not for non-linearity inconsiderate downscaled images)

SSIM and Jaccard Index(for segmentation) is supported on dev branch.
Basically we aim to improve only PSNR(or some kind of metric that is based on pixel-by-pixel), because I think that it is not good to modify the textures drew by artists without permission.


Document/test what parts of IHE Invoke Image Display are working

Request
I understand that some support for IHE IID was added here.
Is there documentation or examples/tests?
Here's some of the documentation:
https://wiki.ihe.net/index.php/Invoke_Image_Display
https://en.wikipedia.org/wiki/Invoke_Image_Display
https://www.ihe.net/uploadedFiles/Documents/Radiology/IHE_RAD_Suppl_IID.pdf
Why should we prioritize this feature?
This is a standard that would allow OHIF to integrate with some other hospital IT systems (like medical records systems that give an option to look at radiology images).

Note that #1695 (commit #f7162ce6 ) added IHEInvokeImageDisplay routes back into viewer.
Currently STUDY Type requests recovered partial functionality ( requestType=STUDY ).


RPRBLND-1396: USD Instancing node

PURPOSE
USD Instancing node, behavior as Blender menu Object Properties -> Instancing.
EFFECT OF CHANGE
The instances of primitive can be scattered over the source object.
TECHNICAL STEPS
Added new menu item to Converter category.
Added new node node "Instancing" (usd_nodes/nodes/instancing.py).

Discussed offline to make some changes in feature design.


Setup CoreDNS at home to serve my libvirt machines

On each VM:
sudo nmcli con mod "System eth0" ipv4.dns "<IP_ADDRESS> <IP_ADDRESS> <IP_ADDRESS>"

Documented in https://github.com/avnes/freehold/blob/main/README.md


doubledown: Decider screen not showing timer modal when player screens do

All screens should have the timer modal when the players do. This is reflected in the mockups and the reason is it helps the decider know when to end another player's turn if they start to speak beyond the time they have allocated.
right now, the decider screen stays on the dialog box. This is not the end of the world. Therefore, I am putting into icebox.

closed the duplicate of this issue, #206

Currently the decider sees the speech bubble throughout the entire "screen" rather than seeing the timer.
from #206 :
" Right now the decider instructions/speech bubble, player options, and timer are all on one screen. Deciders should have 2 different sets of instructions for the speech bubble and for the timer. This means separating the timer into its own screen. "


feat: run cargo tests on ci

we can't just make use of nigiri on CI unfortunately, hence, we copied the docker-compose file from https://github.com/vulpemventures/nigiri and changed it slightly to use docker-managed containers.
resolves #113

System tests run only occasionally and only if all unit tests have passed. We run integration tests only on bors r+. Once this branch builds, it is automatically merged into master.

Fixed :) 6d17d41 (#117) and fa22cdf (#117)

We only run tests for what has been changed. E.g. If a user only does frontend changes, we only run tests for the frontend.

I'll create a follow-up ticket for that

@holzeis : feel free to take over and bors it any time.

I'm giving the new github action with bors a try :)
bors r+

Integration tests are being run: https://github.com/get10101/10101/actions/runs/4139289572/jobs/7156693794 but failed. Trying to fix it in #121


NetExport autoExport doest not work

FF nightly 39.0a1 (2015-02-23) + firebug-3.0.0-alpha.9.xpi
I tried like you recommend here https://groups.google.com/forum/#!topic/firebug/oJwLFniRs-E
and tried window.NetExport.triggerExport("harFile") get undefined and no file is create in the har folder

Can you please provide detailed steps describing how to reproduce the problem?
Do you have a test page I could use?
Honza

HAR export feature is now built-in Firefox, so related report needs to be reported in Bugzilla
https://bugzilla.mozilla.org/
There is also an extension that is exposing HAR API in  to the content, see:
https://github.com/firebug/har-export-trigger/
http://www.softwareishard.com/blog/har-export-trigger/
window.NetExport.triggerExport()  is now -> HAR.triggerExport()
If there is an issue with using HAR  API report it here:
https://github.com/firebug/har-export-trigger/issues
Honza


global: add authentication handling

closes #62

I will add some tests for the AuthenticationGuard component but feel free to start reviewing the logic :)

@topless Can you check again the PR to see if you are ok now with the code so we can continue to merge this?


✨ Create SSW Internship Program page

This is priority after the core website infra is done
### Tasks
- [ ] Create a new page Implementing the Figma designs linked below
- [ ] Add a link to the page on the MegaMenu under Training | SSW Internship Programs | Fullstack developer
- [ ] Add a link to the new page on About Us | Who we are | Employment Opportunities | Current Positions

https://www.figma.com/file/6IU1jg9Stosfecs4YfawoR/SSW-Internship-Program
As per my conversation with @pierssinclairssw the new page url should be ssw.com.au/training/internship/fullstack (confirm this with Adam + Camilla)

@BrookJeynes what is the status of this feature?

@BrookJeynes How is this tracking?

CC: @bradystroud
Hey @pierssinclairssw, sorry for the late response
The page is coming along well! All that's really left now is

Fix some style issues and getting updated icons
Updating the pages content
Building the event countdown component
Hooking up the footer "Subscribe to get notified about SSW training programs" to actually subscribe an email (this can be left out for now as from last I recall the subscribe system hasn't been created yet)


Install Codecov to Notary Project org

Pain point
Code coverage is not updated for the main branch of notation, notation-go, notation-core-go repos since 2 months ago and thus the code coverage badge is not accurate.
RCA
Codecov requires token to upload code coverage in v4 (v3 stopped working)
Proposal
Install Codecov to Notary Project org to obtain the codecov token.
Requested Permissions

Related Issues

https://github.com/notaryproject/notation/issues/921

Related PRs

https://github.com/notaryproject/notation/pull/920
https://github.com/notaryproject/notation-core-go/pull/199

Actions
Please respond LGTM or REJECT (with reasoning).

LGTM

LGTM

LGTM

LGTM

Got 4 votes. I've installed the Codecov app on to the Notary Project org.


Update directives-reference.mdx/added a comma

Description (required)
Added an Oxford comma that was personally driving sarah insane
(also corrected similar to similarly)
Related issues & labels (optional)

Suggested label: docs

Lunaria Status Overview
🌕 This pull request will trigger status changes.

Learn more
By default, every PR changing files present in the Lunaria configuration's files property will be considered and trigger status changes accordingly.
You can change this by adding one of the keywords present in the ignoreKeywords property in your Lunaria configuration file in the PR's title (ignoring all files) or by including a tracker directive in the merged commit's description.

Tracked Files

Locale
File
Note

en
reference/directives-reference.mdx
Source changed, localizations will be marked as outdated.

Warnings reference

Icon
Description

🔄
The source for this localization has been updated since the creation of this pull request, make sure all changes in the source have been applied.


Documentation / Example needed for find_program

So, currently, installing tools with vcpkg and then trying to find them with 'find_program' isn't as straightforward as on traditional unix packaging systems.
For example, installing 'glslang' package on a typical system would put wherever 'glslangValidator' is in 'PATH', and then 'find_program(glsval glslangValidator)' would work with no additional setup.
Not so with vcpkg as far as I could find out.
The examples here are all about using libraries, not tools, so that is a problem as well.

It seems be not only a documentation issue but a issue on vcpkg tweaks for cmake, that is good for find_package but not enough for find_program.

This issue hasn’t been updated in a year; if it is still an issue, please reopen this issue.


Implement an Image Pull Policy that Could Override Kubernetes' Policy

What is the goal / desired outcome?
Kubernetes' pull policy focuses solely on the Docker image name and tag.  Thus, if a Docker image is updated, but the tag is not changed, k8s will not recognize it as a new image and won't pull it if an image with that name and tag has already been pulled.  This makes it possible to end up in situations where different pods are running different versions of a given Docker image.  Issue #5440 is about generating warnings if Pachyderm detects that this has happened.  This goal of this issue would be to create our own Pachyderm pull policy which would take the image hash into consideration as well.
This is definitely a long-term request, which would require a lot of careful planning and consideration of the implications. It may well be that we decide that the risk/effort isn't worth the benefits.
If there is a way to accomplish this today via workaround, what does that require?
(Optional) What is your proposal for a feature to solve this?

Environment?:

Kubernetes version (use kubectl version):
Pachyderm CLI version (use pachctl version):
Cloud provider (e.g. aws, azure, gke) or local deployment (e.g. minikube vs dockerized k8s):
OS (e.g. from /etc/os-release):
Others:

We've had a number of discussions about pull policy and we've always come to the conclusion that the risk isn't worth the benefits. Reusing a tag always creates a risk that you wind up using the wrong version of the image. Even if you set the right pull policy there's a chance that you'll hit a cache and get the old version. The big worry we have is that it's really confusing when this doesn't work, so an implementation that fails 10% of the time can actually be worse than one that fails 100% of the time. Because in that 10% you really have no idea what's going on since it's worked before. With our current semantics users who want to reuse tags generally figure out that it's not running new code fairly quickly, I worry it would take them a lot longer if it worked sometimes.


update supported configuration values

The variable list needs to updated to include all possible values. https://github.com/balena-io/docs/blob/2470040d9c32e4abfdbe1170da656619545102c1/pages/learn/manage/configuration.md#variable-list
Right now it's missing:
"RESIN_HOST_EXTLINUX_fdt": "custom.dtb"
"RESIN_HOST_ODMDATA_configuration": "6"

opened by mistake.


#03 platform event even after the function result completed

PR details
What is the purpose of this pull request? (put an "X" next to an item)

[ ] Documentation update
[ ] Bug fix
Error Label Appears after several minutes of having refreshed

What changes did you make? (Give an overview)
The page remains listening to the result platform event even after the function result completed. To fix this unsubscribe from platform event as soon as the result completes and the table is retendered.

Is there anything you'd like reviewers to focus on?
...

what would happen if one clicks on the Refresh button after you unsubscribed? will it re-subscribe?

on the bug ticket you wrote this is dependent on #103  - changing this pr to DRAFT to reflect that


Add user_seat_expiration_inactive_time field to Access org

Description
Adds the user_seat_expiration_inactive_time field to Access organizations. API docs will be updated soon to show this new field as well.
Types of changes

[X] New feature (non-breaking change which adds functionality)

Codecov Report

Merging #1159 (11efaeb) into master (6153c1e) will decrease coverage by 0.11%.
The diff coverage is 50.67%.

@@            Coverage Diff             @@
##           master    #1159      +/-   ##
==========================================
- Coverage   49.40%   49.29%   -0.12%
==========================================
  Files         127      128       +1
  Lines       12290    12397     +107
==========================================
+ Hits         6072     6111      +39
- Misses       4840     4885      +45
- Partials     1378     1401      +23

Impacted Files
Coverage Δ

access_organization.go
64.70% <ø> (ø)

utils.go
72.72% <ø> (ø)

mtls_certificates.go
26.59% <26.59%> (ø)

dns.go
68.69% <92.45%> (+4.97%)
:arrow_up:

workers.go
57.14% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


sem: 0.28.2 -> 0.28.3

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/semaphoreci/cli/releases.
meta.description for sem is: A cli to operate on semaphore ci (2.0)
meta.homepage for sem is: https://github.com/semaphoreci/cli
meta.changelog for sem is: https://github.com/semaphoreci/cli/releases/tag/v0.28.3
Updates performed

Golang update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.28.3 with grep in /nix/store/27pgyhwcbs28vkzj61jw6azbms73308l-sem-0.28.3
found 0.28.3 in filename of file in /nix/store/27pgyhwcbs28vkzj61jw6azbms73308l-sem-0.28.3

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
sem

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/27pgyhwcbs28vkzj61jw6azbms73308l-sem-0.28.3 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A sem https://github.com/r-ryantm/nixpkgs/archive/94202fcdadacfd646218a5ccdeb82f79b84b5328.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/94202fcdadacfd646218a5ccdeb82f79b84b5328#sem

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/27pgyhwcbs28vkzj61jw6azbms73308l-sem-0.28.3
ls -la /nix/store/27pgyhwcbs28vkzj61jw6azbms73308l-sem-0.28.3/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

sem

Maintainer pings
cc @liberatys for testing.

Result of nixpkgs-review pr 255868 run on x86_64-linux 1

1 package built:

sem


[network][connmgr] reset both address and backoff on update

When receiving an updated set of address for a peer, we reset their dial
state (if we're already trying to dial them). As a result, we will begin
our next dial attempt from the first address (which might have changed)
and from a fresh backoff (since the current backoff delay might be maxed
out if we can't reach any of their previous addresses).
This change should help to mitigate some of the issues we've been having
with paritions healing very slowly (2-5 min!) when a peer has some
invalid or unreachable addresses in on-chain discovery.
This change also sets the maximum retry delay to 1 minute (up from 10
seconds prev, down from 10 minutes prev^2). 10 seconds is too aggressive
with this change and spams the logs too much. We already have logic to
reduce the max delay if we're not fully connected.

Question - do you want to get any data points to actually confirm how this change affected recovery?
As a cluster test advertising - one option for this, for example 10% down experiment and compare graphs between master and this diff to see if recovery time improves?
You could do this by those two commands:
# Reference
./scripts/cti --master --run bench -- --percent-nodes-down 10
# This PR
./scripts/cti --pr <PR> --run bench -- --percent-nodes-down 10

They print link to dashboard in the end, so in theory those links can be used to see a difference

The alignment of the comment looks weird... is it at 80 chars and the code at 100?

looks like the cluster initially connects much more quickly with this fix
current master:

with pr:

Thats awesome!
First picture(master) is exactly problem that we seen today with @sherry-x  in premainnet drill

@bors-libra r=davidiw

:pushpin: Commit 0eebc6d has been approved by davidiw

forgot the top level metrics : p
before: 10% down : 1285 TPS, 3160 ms latency, 7550 ms p99 latency, no expired txns
after:  10% down : 1333 TPS, 3050 ms latency, 4350 ms p99 latency, no expired txns

:hourglass: Testing commit 0eebc6d2d908c3a34a00f1d1d06c1094cebe891e with merge 0c8b47b0c4ae0becc59b95bae7791149b0f7e904...

:sunny: Test successful - checks-actions_land_blocking_test, checks-circle_commit_workflow
Approved by: davidiw
Pushing 0c8b47b0c4ae0becc59b95bae7791149b0f7e904 to master...


ASM App TRANSFER returns ERR INVALID

I seem to have everything correct but the ")"??
i have my Asm(prgmTRANSFER) and when I select goto, it goes to ")".
It's unarchived and everything.
SPECS; Ti84+
OS 5.55

If you are on OS 5.5 or later, you'll need to follow the steps on https://yvantt.github.io/arTIfiCE/

If you are on OS 5.5 or later, you'll need to follow the steps on https://yvantt.github.io/arTIfiCE/

oh i do? thanks! i though that was just for ce

Uh, it is for the CE only. If you have the 84+ (non-CE), it won't work obviously but also this program here will not work either, as it's made for the CE.

Uh, it is for the CE only. If you have the 84+ (non-CE), it won't work obviously but also this program here will not work either, as it's made for the CE.
Oh, okay. Thanks.
and you probably have 2.55, then, not 5.55...
Oops! i did mistype that. Sorry.


Set proper timestamps to actual date of observation

The API returns last_polled_time which is the actual time of the observation. We should add that to the output to give prometheus a better idea of when the data actually happened. However, this currently blocked on https://github.com/tikv/rust-prometheus/issues/382.

Sadly that's not an option as the API backend asynchronously does those monitoring checks whenever it feels like it and a run might take some minutes. I can only poll and hope I don't miss any data. Works pretty well the way I have it actually so I'd just need manual timestamps.

Sadly that's not an option as the API backend asynchronously does those monitoring checks whenever it feels like it and a run might take some minutes. I can only poll and hope I don't miss any data. Works pretty well the way I have it actually so I'd just need manual timestamps.


The list of filtered set

Greets! Could you share the list of filtered set?

Here are two lists:
Positive top 100k link.
Positive top 400k link.

Here are two lists:
Positive top 100k link.
Positive top 400k link.

Thanks!


R5 scene controller

Hi,
I didn’t find anything related to this issue yet : I have to stay on update 3.5.4 for my R5 controller to keep working. With any newer version HA won’t receive any command from it.
Am I missing something ?
Thanks

This is the first time I've heard such a claim

All of my R5's work as expected with the latest HA versions.
BTW - any chance to override the propriety protocol and have R5 directly connected to HA?

@Jey1310 I was having the same issue, and bumped on this thread. While trying to figure out why no events were reaching HA, I realised the R5 only works when the config is set to Cloud.
After changing it to Cloud, all events showed up and it's working as expected.

@Jey1310 I was having the same issue, and bumped on this thread. While trying to figure out why no events were reaching HA, I realised the R5 only works when the config is set to Cloud.
After changing it to Cloud, all events showed up and it's working as expected.

Hi, thank you ! It did solve my issue !

Within the eWeLink platform, it is the same. R5 operation requires a connection to the cloud even when a parent device is involved. Strange, as the eWeLink Remote was intended to replace RF remotes that did not need the cloud. Not sure why Sonoff came up with it that way. Not a good idea and it will probably be difficult to get away from this dependency.


Create new URI system for loading games

Should be able to use a standardized path system for loading games. The root should automatically resolve to the correct path on the user's system. There should be two roots, System (internal) and Workspace (user defined).

There is a new internal URI pattern for loading games and tools.


various documentation updates

Which issue does this PR close?

Closes #1352
Closes #3001
Closes #2866
You can also close #2558 and close #1813 though they're not directly related to this PR
Rationale for this change

What changes are included in this PR?

removes the python docs per issue #2866 (there's a related PR in the new python repo to bring the docs over there https://github.com/apache/arrow-datafusion-python/pull/23
fix some links and typos and do consolidation of duplicate material
replace some .rst files with .md in
fix docker build for datafusion-cli and update docs related to that
improve left nav link naming for clarity (under Specification)
consolidated the documentation for the CLI into one page per issue #1352
fix the CSV schema inference in datafusion-cli docs per #3001
update README.md to point to new location of DataFusion Python project
update README.md with link to slides from Andrew Lamb and Daniel Heres

Are there any user-facing changes?

The docs are slightly better.

Codecov Report

Merging #3005 (854c3ff) into master (193fc3b) will increase coverage by 0.00%.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #3005   +/-   ##
=======================================
  Coverage   85.83%   85.83%
=======================================
  Files         283      283
  Lines       51603    51603
=======================================
+ Hits        44292    44294    +2
+ Misses       7311     7309    -2

Impacted Files
Coverage Δ

datafusion/expr/src/logical_plan/plan.rs
77.60% <0.00%> (+0.34%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us.

Updated per review. I'm not done with this. Still working on organizing the content and creating new content.

@andygrove sure, yes, I can do that. I got a little exploratory and just kept making changes, unsure how they would work out. I'll submit separate PR for the simple cleanups and see how I can break this up further for easier review. I've been away from this for a few days, maybe fresh eyes will help.

closing this PR as it was exploratory and too big and all it's changes are going in other PRs


fixup: e2e test after merging #4195

Description
This PR fixes e2e tests after change from https://github.com/Dynatrace/dynatrace-operator/pull/4195
How can this be tested?
make test/e2e/applicationmonitoring/metadataenrichment

:warning: Please install the  to ensure uploads and comments are reliably processed by Codecov.
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 64.51%. Comparing base (c42d46f) to head (1f6c584).

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@           Coverage Diff           @@
##             main    #4202   +/-   ##
=======================================
  Coverage   64.51%   64.51%
=======================================
  Files         399      399
  Lines       26795    26795
=======================================
  Hits        17287    17287
  Misses       8147     8147
  Partials     1361     1361

Flag
Coverage Δ

unittests
64.51% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


🧑🔬 experiment: Precompute zero'd Page cache

Overview
Experiment for adding a precomputed cache for zero'd out pages when they're allocated.

This yielded subpar results, probably due to the overhead of having to invalidate part of the tree upon allocation. In the few benchmarks I did, we get a somewhat frequent drag towards the lower end, but it's not consistent across 5-6 runs.


LVGL 9.0

This PR will be perma-draft until LVGL 9.0 is stable and the branch will serve to keep us up to date with LVGL 9.0-dev so the transition will be as painless as possible when it comes to it.
What's currently broken:

TBD (likely more or less everything)

Are there any plans to go forward with LVGL 9.x?


Make list targets work again

to: @airbnb/streamalert-maintainers
related to:
resolves:
Background
Deploy a fresh copy of release-3-1-0 branch to staging environment, for, fun 🤷♀ and found couple minor bugs.
Changes

python manage.py list-targets command is broken due to recent change of terraform files path.
Add use test cases to test the code change.
Add a space when print out WARNING messing to remind user to update file_format setting.
Add a Note in getting_started doc to remind user to update file_format setting.

Testing

Fresh checkout release-3-1-0 branch
 python manage.py configure aws_account_id<PHONE_NUMBER>11
python manage.py configure prefix cylinrelease31
python manage.py init
A ConfigError warming to set "file_format" to "parquet" in "athena_partition_refresh_config" raised.
Update "file_format" to "parquet" and re-init
python manage.py init and StreamAlert initialization was successful.
Create a kinesis stream in cluster "prod"

  "modules": {
    "cloudwatch_monitoring": {
      "enabled": true,
      "kinesis_alarms_enabled": false,
      "lambda_alarms_enabled": true
    },
    "kinesis": {
      "streams": {
        "create_user": true,
        "retention": 24,
        "shards": 1,
        "terraform_outputs": [
          "arn",
          "access_key_id",
          "secret_key"
        ]
      }
    },
    "kinesis_events": {
      "batch_size": 100,
      "enabled": true
    }
  }

Add new kinesis name to the "data_sources" filed in conf/clusters/prod.json

  "data_sources": {
    "kinesis": {
      "prefix_cluster1_streamalert": [
        "cloudwatch",
        "ghe",
        "osquery"
      ],
      "cylinrelease31_prod_streamalert": [
        "cloudwatch",
        "osquery"
      ]
    },

Run build and deploy "prod" classifier

python manage.py build --target kinesis_events_prod kinesis_prod
python manage.py deploy --function classifier

Send testing cloudwatch events to the kinesis to trigger classifier, rules engine, alert processor, alert merger.
Enable firehose and run build to create firehose and athena tables for cloudwatch events. in conf/global.json

  "infrastructure": {
    "alerts_table": {
      "read_capacity": 5,
      "write_capacity": 5
    },
    "firehose": {
      "use_prefix": true,
      "buffer_interval": 900,
      "buffer_size": 128,
      "enabled": true,
      "enabled_logs": {
        "cloudwatch": {},
        "osquery": {}
      }
    },

python manage.py build
python manage.py deploy --function classifier
python manage.py deploy --function athena
Send testing cloudwatch events to the kinesis to trigger classifier, rules engine, alert processor, alert merger and athena partition lambda function.
Alerts and cloudWatch events are searchable in Athena table/

Coverage remained the same at 95.424% when pulling d08bf77eb265ad7f9710e143c6bdef7bd827d89d on make_list_targets_work_again into 530a154fd446a133868a49997bfbb47deb598c82 on release-3-1-0.


added 5 extra settings for user specified protocols

added 5 extra settings that can be used for defining user specified protocols
Solves the feature request #251

@pekkakaho I have also modified things, check if the changes are ok to you:

Add "BrowserFullScreen" & "SwitchNewTabs" ConfigTag settings
If "DeniedExtensions" / "DomainsAllowed" contains "null" = Set to null to ignore this feature
Test new features using ( "init_workflow_test" +) "runTestWebdriverParabankLogin" gradle task
"webdriver_generic" & "webdriver_gwt" contains an explanation about Webdriver settings and features in the protocol.

TODO (maybe next release? or do we want for this pull?):

Move DOM login feature customization to the new Webdriver settings
Should we create a new tab in the GUI for this Webdriver settings?
Update this new way of settings configuration (probably HandsOn)


RFP - gtools

1. Checklist

[x] The package I am requesting does not already exist on https://chocolatey.org/packages;
[x] There is no open issue for this package;
[x] The issue title starts 'RFP - ';
[x] The download URL is public and not locked behind a paywall / login;

2. Package Details
Software project URL : http://www.p-nand-q.com/download/gtools/
Direct download URL for the software / installer : http://www.p-nand-q.com/download/gtools/gtools-current.exe
Software summary / short description: set Windows tools

3. Package Expectations
Windows users lost data, if user add new value for PATH environment variable via set or setx, but existing value are long. See more about this problem:

Adding directory to PATH Environment Variable in Windows
Overcoming the 1024 character limit with setx

No built-in method to add new variable programmatically. pathed — part of gtools — solve this problem.
Thanks.

This is an old software; code was hosted on Google Code, and home page was last updated in 2014. According to the source repository, the project is distributed with BSD-3-Clause license, so we can probably embed the source.
With Google I found two GitHub mirrors exported from the Google Code project: https://github.com/maphew/pserv4 and https://github.com/gersonkurz/pserv4.

Type: Reply

This is an old software; code was hosted on Google Code, and home page was last updated in 2014.

@FranklinYu , yes, I know it, but I can't find any another tool, that simply and without loss data risks add new value for PATH environment. See 3 item of my request.
Thanks.

Status: Review
https://chocolatey.org/packages/gtools

Status: Published
https://chocolatey.org/packages/gtools
Can be closed.


Hyperparameter for mujoco environment

Hi I was able to get the desired plot for Reacher -v1 using PPO but was unable to do it for the HalfCheetah-v1 env. Did you use the same set of hyperparameter values for all the Mujoco game environments for PPO algorithm?

Hi,
plots are a little bit outdated (see the exact commit that added the plots to get the same results).
Also HalfCheetah has very large variance, so you need to run it multiple times to get similar plots.
How big is the difference for HalfCheetah?


Refactor NifiCluster state management CRD Configuration

Is your feature request related to a problem?
No
Describe the solution you'd like to see
With NiFi 2.0.0, the zookeeper configuration becomes optional with the addition of kubernetes-based cluster state management. Update the NifiCluster CRD to:

Make zookeeper configuration optional
Consolidate cluster state management configuration in the CRD

The following changes should be made to v2alpha1/NifiCluster:
apiVersion: nifi.konpyutaika.com/v2alpha1
kind: NifiCluster
metadata:
  name: nifi-cluster
spec:
  stateManagement:
    kubernetes:
      identifier: my-cluster
    zookeeper:
      zkPath: /my-cluster
      zkAddress: zookeeper.zookeeper:2181

One of kubernetes or zookeeper should be configured and this should be enforced by the operator.
Update all documentation to reflect these changes.
Describe alternatives you've considered
No response
Additional context
This issue requires #359 to be completed first.

A field should exist to chose which one (zk or k8s) you want to use, no?

I should give two examples. I believe it can be an either/or. So you'd configure either:
apiVersion: nifi.konpyutaika.com/v2alpha1
kind: NifiCluster
metadata:
  name: nifi-cluster
spec:
  stateManagement:
    zookeeper:
      zkPath: /my-cluster
      zkAddress: zookeeper.zookeeper:2181

OR
apiVersion: nifi.konpyutaika.com/v2alpha1
kind: NifiCluster
metadata:
  name: nifi-cluster
spec:
  stateManagement:
    zookeeper:
      zkPath: /my-cluster
      zkAddress: zookeeper.zookeeper:2181

And the existence of one or the other is how nifikop will know which to configure.


group severity bar charts together (triptych)

The format of the grouped bars kind of handles this.


Fix issue where test nondeterministically failed if SwiftPM doesn't return build settings quickly

We might not have build settings at the time when we get the first diagnostics notification here and thus might get syntactic fallback diagnostics that don't contain 'Cannot find ... in scope'

@swift-ci Please test


Migrate iOS code into Xcode 8 and Swift 2.3

Closing in favor of thaliproject/Thali_CordovaPlugin#1081