Instance + Broker Pod disappears

Describe the bug
I'm having an issue where my Instance and it is associated Broker pod seem to disappear and won't come back until I either restart my agent and udev discovery pods, or it seems I can simply modify my Configuration resource which triggers it to come back.
Output of kubectl get pods,akrii,akric -o wide
NAME                                                 READY   STATUS    RESTARTS   AGE     IP             NODE                 NOMINATED NODE   READINESS GATES
pod/aeotec-gen-5-79e1a1-pod                          1/1     Running   0          9m21s   <IP_ADDRESS>     talos-192-168-32-2   <none>           <none>
pod/akri-agent-daemonset-cv95v                       1/1     Running   0          23d     <IP_ADDRESS>     talos-192-168-32-3   <none>           <none>
pod/akri-agent-daemonset-kpqzq                       1/1     Running   0          13h     <IP_ADDRESS>   talos-192-168-32-2   <none>           <none>
pod/akri-agent-daemonset-pwdj6                       1/1     Running   0          25d     <IP_ADDRESS>     talos-192-168-32-4   <none>           <none>
pod/akri-controller-deployment-5496f7c977-p75v6      1/1     Running   0          17h     <IP_ADDRESS>    talos-192-168-32-4   <none>           <none>
pod/akri-udev-discovery-daemonset-6kw69              1/1     Running   0          23d     <IP_ADDRESS>     talos-192-168-32-3   <none>           <none>
pod/akri-udev-discovery-daemonset-gkhzv              1/1     Running   0          25d     <IP_ADDRESS>     talos-192-168-32-4   <none>           <none>
pod/akri-udev-discovery-daemonset-np5dt              1/1     Running   0          13h     <IP_ADDRESS>   talos-192-168-32-2   <none>           <none>
pod/chrony-5jqss                                     1/1     Running   0          17d     <IP_ADDRESS>   talos-192-168-32-2   <none>           <none>
pod/chrony-5vhn5                                     1/1     Running   0          17d     <IP_ADDRESS>     talos-192-168-32-4   <none>           <none>
pod/chrony-94xlv                                     1/1     Running   0          17d     <IP_ADDRESS>     talos-192-168-32-3   <none>           <none>
pod/intel-gpu-plugin-2wkdw                           1/1     Running   0          46h     <IP_ADDRESS>     talos-192-168-32-4   <none>           <none>
pod/intel-gpu-plugin-rrj4w                           1/1     Running   4          75d     <IP_ADDRESS>   talos-192-168-32-2   <none>           <none>
pod/intel-gpu-plugin-s8j6k                           1/1     Running   0          75d     <IP_ADDRESS>     talos-192-168-32-3   <none>           <none>
pod/node-feature-discovery-master-7f48f68ccf-v7jb2   1/1     Running   0          17h     <IP_ADDRESS>    talos-192-168-32-4   <none>           <none>
pod/node-feature-discovery-worker-kssph              1/1     Running   13         75d     <IP_ADDRESS>     talos-192-168-32-3   <none>           <none>
pod/node-feature-discovery-worker-n7vmv              1/1     Running   8          75d     <IP_ADDRESS>     talos-192-168-32-4   <none>           <none>
pod/node-feature-discovery-worker-zs5cn              1/1     Running   75         75d     <IP_ADDRESS>   talos-192-168-32-2   <none>           <none>

NAME                                   CONFIG         SHARED   NODES                    AGE
instance.akri.sh/aeotec-gen-5-79e1a1   aeotec-gen-5   false    ["talos-192-168-32-2"]   9m24s

NAME                                 CAPACITY   AGE
configuration.akri.sh/aeotec-gen-5   1          43d
configuration.akri.sh/conbee-ii      1          43d
configuration.akri.sh/ti-cc2531      1          43d

Kubernetes Version: 1.21.3
Logs
I believe these are applicable logs from the controller. I just had my conbee-ii instance disappear on me. The discussion we had in Slack points to potential race conditions happening when the Configuration resources are updated. Typically as a result of Flux updating metadata on the resources to manage its state. So we would likely have multiple resources being updated at nearly the same time.
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] internal_do_instance_watch - aquired sync lock
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance - enter
[2021-09-02T18:00:41Z INFO  controller::util::instance_action] handle_instance - deleted Akri Instance aeotec-gen-5-79e1a1: Instance { configuration_name: "aeotec-gen-5", broker_properties: {"UDEV_DEVNODE": "/dev/ttyACM1"}, shared: false, nodes: ["talos-192-168-32-2"], device_usage: {"aeotec-gen-5-79e1a1-0": "talos-192-168-32-2"} }
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - enter Remove
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - nodes tracked from instance={"talos-192-168-32-2": PodContext { node_name: None, namespace: None, action: NoAction }}
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - find all pods that have akri.sh/instance=aeotec-gen-5-79e1a1
[2021-09-02T18:00:41Z TRACE akri_shared::k8s::pod] find_pods_with_selector with label_selector=Some("akri.sh/instance=aeotec-gen-5-79e1a1") field_selector=None
[2021-09-02T18:00:41Z TRACE akri_shared::k8s::pod] find_pods_with_selector PRE pods.list(...).await?
[2021-09-02T18:00:41Z TRACE akri_shared::k8s::pod] find_pods_with_selector return
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - found 1 pods
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - update actions based on the existing pods
[2021-09-02T18:00:41Z TRACE controller::util::pod_action] select_pod_action phase="Running" action=Remove unknown_node=false
[2021-09-02T18:00:41Z TRACE controller::util::pod_action] choice_for_pod_action phase="Running" action=Remove unknown_node=false trace_node_name="aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:41Z TRACE controller::util::pod_action] choice_for_pods_on_known_nodes phase="Running" action=Remove trace_node_name="aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:41Z TRACE controller::util::pod_action] choice_for_running_pods action=Remove trace_node_name="aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:41Z TRACE controller::util::pod_action] choice_for_running_pods - Running Pod (tracked) ... PodAction::Remove ("aeotec-gen-5-79e1a1-pod")
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - nodes tracked after querying existing pods={"talos-192-168-32-2": PodContext { node_name: Some("talos-192-168-32-2"), namespace: Some("host-system"), action: Remove }}
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_deletion_work - pod::create_pod_app_name("aeotec-gen-5-79e1a1", "talos-192-168-32-2", false, "pod")
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_deletion_work - pod::remove_pod name="aeotec-gen-5-79e1a1-pod", namespace="host-system"
[2021-09-02T18:00:41Z TRACE akri_shared::k8s::pod] remove_pod enter
[2021-09-02T18:00:41Z INFO  akri_shared::k8s::pod] remove_pod pods.delete(...).await?:
[2021-09-02T18:00:41Z INFO  akri_shared::k8s::pod] remove_pod pods.delete return: "aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_deletion_work - pod::remove_pod succeeded
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - exit
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] internal_do_instance_watch - aquired sync lock
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance - enter
[2021-09-02T18:00:41Z INFO  controller::util::instance_action] handle_instance - deleted Akri Instance conbee-ii-55a336: Instance { configuration_name: "conbee-ii", broker_properties: {"UDEV_DEVNODE": "/dev/ttyACM2"}, shared: false, nodes: ["talos-192-168-32-2"], device_usage: {"conbee-ii-55a336-0": "talos-192-168-32-2"} }
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - enter Remove
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - nodes tracked from instance={"talos-192-168-32-2": PodContext { node_name: None, namespace: None, action: NoAction }}
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - find all pods that have akri.sh/instance=conbee-ii-55a336
[2021-09-02T18:00:41Z TRACE akri_shared::k8s::pod] find_pods_with_selector with label_selector=Some("akri.sh/instance=conbee-ii-55a336") field_selector=None
[2021-09-02T18:00:41Z TRACE akri_shared::k8s::pod] find_pods_with_selector PRE pods.list(...).await?
[2021-09-02T18:00:41Z TRACE controller::util::pod_watcher] handle_pod - enter [event: Modified event]
[2021-09-02T18:00:41Z TRACE controller::util::pod_watcher] handle_pod - pod name "aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:41Z TRACE controller::util::pod_watcher] handle_pod - pod phase "Running"
[2021-09-02T18:00:41Z TRACE controller::util::pod_watcher] handle_running_pod_if_needed - enter
[2021-09-02T18:00:41Z TRACE controller::util::pod_watcher] handle_running_pod_if_needed - last_known_state: Running
[2021-09-02T18:00:41Z TRACE akri_shared::k8s::pod] find_pods_with_selector return
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - found 1 pods
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - update actions based on the existing pods
[2021-09-02T18:00:41Z TRACE controller::util::pod_action] select_pod_action phase="Running" action=Remove unknown_node=false
[2021-09-02T18:00:41Z TRACE controller::util::pod_action] choice_for_pod_action phase="Running" action=Remove unknown_node=false trace_node_name="conbee-ii-55a336-pod"
[2021-09-02T18:00:41Z TRACE controller::util::pod_action] choice_for_pods_on_known_nodes phase="Running" action=Remove trace_node_name="conbee-ii-55a336-pod"
[2021-09-02T18:00:41Z TRACE controller::util::pod_action] choice_for_running_pods action=Remove trace_node_name="conbee-ii-55a336-pod"
[2021-09-02T18:00:41Z TRACE controller::util::pod_action] choice_for_running_pods - Running Pod (tracked) ... PodAction::Remove ("conbee-ii-55a336-pod")
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - nodes tracked after querying existing pods={"talos-192-168-32-2": PodContext { node_name: Some("talos-192-168-32-2"), namespace: Some("host-system"), action: Remove }}
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_deletion_work - pod::create_pod_app_name("conbee-ii-55a336", "talos-192-168-32-2", false, "pod")
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_deletion_work - pod::remove_pod name="conbee-ii-55a336-pod", namespace="host-system"
[2021-09-02T18:00:41Z TRACE akri_shared::k8s::pod] remove_pod enter
[2021-09-02T18:00:41Z INFO  akri_shared::k8s::pod] remove_pod pods.delete(...).await?:
[2021-09-02T18:00:41Z TRACE controller::util::pod_watcher] handle_pod - enter [event: Modified event]
[2021-09-02T18:00:41Z TRACE controller::util::pod_watcher] handle_pod - pod name "conbee-ii-55a336-pod"
[2021-09-02T18:00:41Z TRACE controller::util::pod_watcher] handle_pod - pod phase "Running"
[2021-09-02T18:00:41Z TRACE controller::util::pod_watcher] handle_running_pod_if_needed - enter
[2021-09-02T18:00:41Z TRACE controller::util::pod_watcher] handle_running_pod_if_needed - last_known_state: Running
[2021-09-02T18:00:41Z INFO  akri_shared::k8s::pod] remove_pod pods.delete return: "conbee-ii-55a336-pod"
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_deletion_work - pod::remove_pod succeeded
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - exit
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] internal_do_instance_watch - aquired sync lock
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance - enter
[2021-09-02T18:00:41Z INFO  controller::util::instance_action] handle_instance - added Akri Instance aeotec-gen-5-79e1a1: Instance { configuration_name: "aeotec-gen-5", broker_properties: {"UDEV_DEVNODE": "/dev/ttyACM1"}, shared: false, nodes: ["talos-192-168-32-2"], device_usage: {"aeotec-gen-5-79e1a1-0": ""} }
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - enter Add
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - nodes tracked from instance={"talos-192-168-32-2": PodContext { node_name: None, namespace: None, action: Add }}
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - find all pods that have akri.sh/instance=aeotec-gen-5-79e1a1
[2021-09-02T18:00:41Z TRACE akri_shared::k8s::pod] find_pods_with_selector with label_selector=Some("akri.sh/instance=aeotec-gen-5-79e1a1") field_selector=None
[2021-09-02T18:00:41Z TRACE akri_shared::k8s::pod] find_pods_with_selector PRE pods.list(...).await?
[2021-09-02T18:00:41Z TRACE akri_shared::k8s::pod] find_pods_with_selector return
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - found 1 pods
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - update actions based on the existing pods
[2021-09-02T18:00:41Z TRACE controller::util::pod_action] select_pod_action phase="Running" action=Add unknown_node=false
[2021-09-02T18:00:41Z TRACE controller::util::pod_action] choice_for_pod_action phase="Running" action=Add unknown_node=false trace_node_name="aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:41Z TRACE controller::util::pod_action] choice_for_pods_on_known_nodes phase="Running" action=Add trace_node_name="aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:41Z TRACE controller::util::pod_action] choice_for_running_pods action=Add trace_node_name="aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:41Z TRACE controller::util::pod_action] choice_for_running_pods - Running Pod (tracked) ... PodAction::NoAction ("aeotec-gen-5-79e1a1-pod")
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - nodes tracked after querying existing pods={"talos-192-168-32-2": PodContext { node_name: Some("talos-192-168-32-2"), namespace: Some("host-system"), action: NoAction }}
[2021-09-02T18:00:41Z TRACE controller::util::instance_action] handle_instance_change - exit
[2021-09-02T18:00:42Z TRACE controller::util::pod_watcher] handle_pod - enter [event: Modified event]
[2021-09-02T18:00:42Z TRACE controller::util::pod_watcher] handle_pod - pod name "conbee-ii-55a336-pod"
[2021-09-02T18:00:42Z TRACE controller::util::pod_watcher] handle_pod - pod phase "Running"
[2021-09-02T18:00:42Z TRACE controller::util::pod_watcher] handle_running_pod_if_needed - enter
[2021-09-02T18:00:42Z TRACE controller::util::pod_watcher] handle_running_pod_if_needed - last_known_state: Running
[2021-09-02T18:00:42Z TRACE controller::util::pod_watcher] handle_pod - enter [event: Modified event]
[2021-09-02T18:00:42Z TRACE controller::util::pod_watcher] handle_pod - pod name "aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:42Z TRACE controller::util::pod_watcher] handle_pod - pod phase "Running"
[2021-09-02T18:00:42Z TRACE controller::util::pod_watcher] handle_running_pod_if_needed - enter
[2021-09-02T18:00:42Z TRACE controller::util::pod_watcher] handle_running_pod_if_needed - last_known_state: Running
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_pod - enter [event: Modified event]
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_pod - pod name "conbee-ii-55a336-pod"
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_pod - pod phase "Running"
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_running_pod_if_needed - enter
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_running_pod_if_needed - last_known_state: Running
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_pod - enter [event: Deleted event]
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_pod - Deleted: "conbee-ii-55a336-pod"
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_deleted_pod_if_needed - enter
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_deleted_pod_if_needed - last_known_state: Running
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_deleted_pod_if_needed - call handle_non_running_pod
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_non_running_pod - enter
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] get_instance_and_configuration_from_pod - enter
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] find_pods_and_cleanup_svc_if_unsupported - enter
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] find_pods_and_cleanup_svc_if_unsupported - find_pods_with_label(akri.sh/instance=conbee-ii-55a336)
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::pod] find_pods_with_selector with label_selector=Some("akri.sh/instance=conbee-ii-55a336") field_selector=None
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::pod] find_pods_with_selector PRE pods.list(...).await?
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::pod] find_pods_with_selector return
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] find_pods_and_cleanup_svc_if_unsupported - found 0 pods
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] cleanup_svc_if_unsupported - num_non_terminating_pods: 0
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] cleanup_svc_if_unsupported - service::remove_service app_name="conbee-ii-55a336-svc", namespace="host-system"
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::service] remove_service enter
[2021-09-02T18:00:43Z INFO  akri_shared::k8s::service] remove_service svcs.create(...).await?:
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::service] remove_service - service already deleted
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] cleanup_svc_if_unsupported - service::remove_service succeeded
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] find_pods_and_cleanup_svc_if_unsupported - enter
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] find_pods_and_cleanup_svc_if_unsupported - find_pods_with_label(akri.sh/configuration=conbee-ii)
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::pod] find_pods_with_selector with label_selector=Some("akri.sh/configuration=conbee-ii") field_selector=None
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::pod] find_pods_with_selector PRE pods.list(...).await?
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::pod] find_pods_with_selector return
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] find_pods_and_cleanup_svc_if_unsupported - found 0 pods
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] cleanup_svc_if_unsupported - num_non_terminating_pods: 0
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] cleanup_svc_if_unsupported - service::remove_service app_name="conbee-ii-svc", namespace="host-system"
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::service] remove_service enter
[2021-09-02T18:00:43Z INFO  akri_shared::k8s::service] remove_service svcs.create(...).await?:
[2021-09-02T18:00:43Z INFO  akri_shared::k8s::service] remove_service svcs.delete return: "Success"
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] cleanup_svc_if_unsupported - service::remove_service succeeded
[2021-09-02T18:00:43Z TRACE akri_shared::akri::instance] find_instance enter
[2021-09-02T18:00:43Z TRACE akri_shared::akri::instance] find_instance kube_client.request::<KubeAkriInstance>(akri_instance_type.get(...)?).await?
[2021-09-02T18:00:43Z TRACE akri_shared::akri::instance] find_instance kube_client.request returned kube error: ErrorResponse { status: "Failure", message: "instances.akri.sh \"conbee-ii-55a336\" not found", reason: "NotFound", code: 404 }
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_pod - enter [event: Modified event]
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_pod - pod name "aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_pod - pod phase "Running"
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_running_pod_if_needed - enter
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_running_pod_if_needed - last_known_state: Running
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_pod - enter [event: Deleted event]
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_pod - Deleted: "aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_deleted_pod_if_needed - enter
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_deleted_pod_if_needed - last_known_state: Running
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_deleted_pod_if_needed - call handle_non_running_pod
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] handle_non_running_pod - enter
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] get_instance_and_configuration_from_pod - enter
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] find_pods_and_cleanup_svc_if_unsupported - enter
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] find_pods_and_cleanup_svc_if_unsupported - find_pods_with_label(akri.sh/instance=aeotec-gen-5-79e1a1)
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::pod] find_pods_with_selector with label_selector=Some("akri.sh/instance=aeotec-gen-5-79e1a1") field_selector=None
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::pod] find_pods_with_selector PRE pods.list(...).await?
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::pod] find_pods_with_selector return
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] find_pods_and_cleanup_svc_if_unsupported - found 0 pods
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] cleanup_svc_if_unsupported - num_non_terminating_pods: 0
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] cleanup_svc_if_unsupported - service::remove_service app_name="aeotec-gen-5-79e1a1-svc", namespace="host-system"
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::service] remove_service enter
[2021-09-02T18:00:43Z INFO  akri_shared::k8s::service] remove_service svcs.create(...).await?:
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::service] remove_service - service already deleted
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] cleanup_svc_if_unsupported - service::remove_service succeeded
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] find_pods_and_cleanup_svc_if_unsupported - enter
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] find_pods_and_cleanup_svc_if_unsupported - find_pods_with_label(akri.sh/configuration=aeotec-gen-5)
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::pod] find_pods_with_selector with label_selector=Some("akri.sh/configuration=aeotec-gen-5") field_selector=None
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::pod] find_pods_with_selector PRE pods.list(...).await?
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::pod] find_pods_with_selector return
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] find_pods_and_cleanup_svc_if_unsupported - found 0 pods
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] cleanup_svc_if_unsupported - num_non_terminating_pods: 0
[2021-09-02T18:00:43Z TRACE controller::util::pod_watcher] cleanup_svc_if_unsupported - service::remove_service app_name="aeotec-gen-5-svc", namespace="host-system"
[2021-09-02T18:00:43Z TRACE akri_shared::k8s::service] remove_service enter
[2021-09-02T18:00:43Z INFO  akri_shared::k8s::service] remove_service svcs.create(...).await?:
[2021-09-02T18:00:44Z INFO  akri_shared::k8s::service] remove_service svcs.delete return: "Success"
[2021-09-02T18:00:44Z TRACE controller::util::pod_watcher] cleanup_svc_if_unsupported - service::remove_service succeeded
[2021-09-02T18:00:44Z TRACE akri_shared::akri::instance] find_instance enter
[2021-09-02T18:00:44Z TRACE akri_shared::akri::instance] find_instance kube_client.request::<KubeAkriInstance>(akri_instance_type.get(...)?).await?
[2021-09-02T18:00:44Z TRACE akri_shared::akri::instance] find_instance return
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - enter Update
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - nodes tracked from instance={"talos-192-168-32-2": PodContext { node_name: None, namespace: None, action: Add }}
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - find all pods that have akri.sh/instance=aeotec-gen-5-79e1a1
[2021-09-02T18:00:44Z TRACE akri_shared::k8s::pod] find_pods_with_selector with label_selector=Some("akri.sh/instance=aeotec-gen-5-79e1a1") field_selector=None
[2021-09-02T18:00:44Z TRACE akri_shared::k8s::pod] find_pods_with_selector PRE pods.list(...).await?
[2021-09-02T18:00:44Z TRACE akri_shared::k8s::pod] find_pods_with_selector return
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - found 0 pods
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - update actions based on the existing pods
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - nodes tracked after querying existing pods={"talos-192-168-32-2": PodContext { node_name: None, namespace: None, action: Add }}
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - find configuration for "aeotec-gen-5"
[2021-09-02T18:00:44Z TRACE akri_shared::akri::configuration] find_configuration enter
[2021-09-02T18:00:44Z TRACE akri_shared::akri::configuration] find_configuration kube_client.request::<KubeAkriConfig>(akri_config_type.get(...)?).await?
[2021-09-02T18:00:44Z TRACE akri_shared::akri::configuration] find_configuration return
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - found configuration for "aeotec-gen-5"
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_addition_work - Create new Pod for Node="talos-192-168-32-2"
[2021-09-02T18:00:44Z TRACE akri_shared::k8s::pod] create_new_pod_from_spec enter
[2021-09-02T18:00:44Z TRACE akri_shared::k8s::pod] create_new_pod_from_spec return
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_addition_work - New pod spec=Pod { metadata: Some(ObjectMeta { annotations: None, cluster_name: None, creation_timestamp: None, deletion_grace_period_seconds: None, deletion_timestamp: None, finalizers: None, generate_name: None, generation: None, labels: Some({"akri.sh/configuration": "aeotec-gen-5", "akri.sh/instance": "aeotec-gen-5-79e1a1", "akri.sh/target-node": "talos-192-168-32-2", "app": "aeotec-gen-5-79e1a1-pod", "controller": "akri.sh"}), managed_fields: None, name: Some("aeotec-gen-5-79e1a1-pod"), namespace: Some("host-system"), owner_references: Some([OwnerReference { api_version: "akri.sh/v0", block_owner_deletion: Some(true), controller: Some(true), kind: "Instance", name: "aeotec-gen-5-79e1a1", uid: "e2ef5ff0-20a1-447a-8cc6-73244dc20a35" }]), resource_version: None, self_link: None, uid: None }), spec: Some(PodSpec { active_deadline_seconds: None, affinity: Some(Affinity { node_affinity: Some(NodeAffinity { preferred_during_scheduling_ignored_during_execution: None, required_during_scheduling_ignored_during_execution: Some(NodeSelector { node_selector_terms: [NodeSelectorTerm { match_expressions: None, match_fields: Some([NodeSelectorRequirement { key: "metadata.name", operator: "In", values: Some(["talos-192-168-32-2"]) }]) }] }) }), pod_affinity: None, pod_anti_affinity: None }), automount_service_account_token: None, containers: [Container { args: None, command: None, env: Some([EnvVar { name: "DEVICE_OPTIONS", value: Some("9600"), value_from: None }]), env_from: None, image: Some("ammmze/akri-ser2net-broker:1.0.4"), image_pull_policy: Some("IfNotPresent"), lifecycle: None, liveness_probe: None, name: "aeotec-gen-5-broker", ports: Some([ContainerPort { container_port: 2000, host_ip: None, host_port: None, name: Some("device"), protocol: None }]), readiness_probe: None, resources: Some(ResourceRequirements { limits: Some({"akri.sh/aeotec-gen-5-79e1a1": Quantity("1"), "cpu": Quantity("100m"), "memory": Quantity("200Mi")}), requests: Some({"akri.sh/aeotec-gen-5-79e1a1": Quantity("1"), "cpu": Quantity("10m"), "memory": Quantity("50Mi")}) }), security_context: Some(SecurityContext { allow_privilege_escalation: None, capabilities: None, privileged: Some(true), proc_mount: None, read_only_root_filesystem: None, run_as_group: None, run_as_non_root: None, run_as_user: None, se_linux_options: None, windows_options: None }), startup_probe: None, stdin: None, stdin_once: None, termination_message_path: None, termination_message_policy: None, tty: None, volume_devices: None, volume_mounts: None, working_dir: None }], dns_config: None, dns_policy: None, enable_service_links: None, ephemeral_containers: None, host_aliases: None, host_ipc: None, host_network: None, host_pid: None, hostname: None, image_pull_secrets: None, init_containers: None, node_name: None, node_selector: None, overhead: None, preemption_policy: None, priority: None, priority_class_name: None, readiness_gates: None, restart_policy: None, runtime_class_name: None, scheduler_name: None, security_context: None, service_account: None, service_account_name: None, share_process_namespace: None, subdomain: None, termination_grace_period_seconds: None, tolerations: None, topology_spread_constraints: None, volumes: None }), status: None }
[2021-09-02T18:00:44Z TRACE akri_shared::k8s::pod] create_pod enter
[2021-09-02T18:00:44Z INFO  akri_shared::k8s::pod] create_pod pods.create(...).await?:
[2021-09-02T18:00:44Z INFO  akri_shared::k8s::pod] create_pod pods.create return: "aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_addition_work - pod::create_pod succeeded
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_addition_work - POST nodeInfo.SetNode

[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - exit
[2021-09-02T18:00:44Z TRACE controller::util::pod_watcher] handle_pod - enter [event: Added event]
[2021-09-02T18:00:44Z TRACE controller::util::pod_watcher] handle_pod - pod name "aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:44Z TRACE controller::util::pod_watcher] handle_pod - pod phase "Pending"
[2021-09-02T18:00:44Z TRACE controller::util::pod_watcher] handle_pod - enter [event: Modified event]
[2021-09-02T18:00:44Z TRACE controller::util::pod_watcher] handle_pod - pod name "aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:44Z TRACE controller::util::pod_watcher] handle_pod - pod phase "Pending"
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] internal_do_instance_watch - aquired sync lock
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance - enter
[2021-09-02T18:00:44Z INFO  controller::util::instance_action] handle_instance - modified Akri Instance aeotec-gen-5-79e1a1: Instance { configuration_name: "aeotec-gen-5", broker_properties: {"UDEV_DEVNODE": "/dev/ttyACM1"}, shared: false, nodes: ["talos-192-168-32-2"], device_usage: {"aeotec-gen-5-79e1a1-0": "talos-192-168-32-2"} }
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - enter Update
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - nodes tracked from instance={"talos-192-168-32-2": PodContext { node_name: None, namespace: None, action: Add }}
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - find all pods that have akri.sh/instance=aeotec-gen-5-79e1a1
[2021-09-02T18:00:44Z TRACE akri_shared::k8s::pod] find_pods_with_selector with label_selector=Some("akri.sh/instance=aeotec-gen-5-79e1a1") field_selector=None
[2021-09-02T18:00:44Z TRACE akri_shared::k8s::pod] find_pods_with_selector PRE pods.list(...).await?
[2021-09-02T18:00:44Z TRACE akri_shared::k8s::pod] find_pods_with_selector return
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - found 1 pods
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - update actions based on the existing pods
[2021-09-02T18:00:44Z TRACE controller::util::pod_action] select_pod_action phase="Pending" action=Update unknown_node=false
[2021-09-02T18:00:44Z TRACE controller::util::pod_action] choice_for_pod_action phase="Pending" action=Update unknown_node=false trace_node_name="aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:44Z TRACE controller::util::pod_action] choice_for_pods_on_known_nodes phase="Pending" action=Update trace_node_name="aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:44Z TRACE controller::util::pod_action] choice_for_non_running_pods action=Update trace_node_name="aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:44Z TRACE controller::util::pod_action] time_choice_for_non_running_pods
[2021-09-02T18:00:44Z TRACE controller::util::pod_action] time_choice_for_non_running_pods - no start time found ... give it more time? ("aeotec-gen-5-79e1a1-pod")
[2021-09-02T18:00:44Z TRACE controller::util::pod_action] time_choice_for_non_running_pods - give_it_more_time: (true)
[2021-09-02T18:00:44Z TRACE controller::util::pod_action] time_choice_for_non_running_pods - Pending Pod (tracked) ... PodAction::NoAction ("aeotec-gen-5-79e1a1-pod")
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - nodes tracked after querying existing pods={"talos-192-168-32-2": PodContext { node_name: Some("talos-192-168-32-2"), namespace: Some("host-system"), action: NoAction }}
[2021-09-02T18:00:44Z TRACE controller::util::instance_action] handle_instance_change - exit
[2021-09-02T18:00:44Z TRACE controller::util::pod_watcher] handle_pod - enter [event: Modified event]
[2021-09-02T18:00:44Z TRACE controller::util::pod_watcher] handle_pod - pod name "aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:44Z TRACE controller::util::pod_watcher] handle_pod - pod phase "Pending"
[2021-09-02T18:00:45Z TRACE controller::util::pod_watcher] handle_pod - enter [event: Modified event]
[2021-09-02T18:00:45Z TRACE controller::util::pod_watcher] handle_pod - pod name "aeotec-gen-5-79e1a1-pod"
[2021-09-02T18:00:45Z TRACE controller::util::pod_watcher] handle_pod - pod phase "Running"
[2021-09-02T18:00:45Z TRACE controller::util::pod_watcher] handle_running_pod_if_needed - enter
[2021-09-02T18:00:45Z TRACE controller::util::pod_watcher] handle_running_pod_if_needed - last_known_state: Pending
[2021-09-02T18:00:45Z TRACE controller::util::pod_watcher] handle_running_pod_if_needed - call handle_running_pod
[2021-09-02T18:00:45Z TRACE controller::util::pod_watcher] handle_running_pod - enter
[2021-09-02T18:00:45Z TRACE controller::util::pod_watcher] get_instance_and_configuration_from_pod - enter
[2021-09-02T18:00:45Z TRACE akri_shared::akri::configuration] find_configuration enter
[2021-09-02T18:00:45Z TRACE akri_shared::akri::configuration] find_configuration kube_client.request::<KubeAkriConfig>(akri_config_type.get(...)?).await?
[2021-09-02T18:00:45Z TRACE akri_shared::akri::configuration] find_configuration return
[2021-09-02T18:00:45Z TRACE akri_shared::akri::instance] find_instance enter
[2021-09-02T18:00:45Z TRACE akri_shared::akri::instance] find_instance kube_client.request::<KubeAkriInstance>(akri_instance_type.get(...)?).await?
[2021-09-02T18:00:45Z TRACE akri_shared::akri::instance] find_instance return
[2021-09-02T18:00:45Z TRACE controller::util::pod_watcher] add_instance_and_configuration_services - instance="aeotec-gen-5-79e1a1"
[2021-09-02T18:00:45Z TRACE controller::util::pod_watcher] create_or_update_service - instance="aeotec-gen-5-79e1a1" with ownership:OwnershipInfo { object_type: Configuration, object_uid: "2fcf85d6-d59c-4236-8424-5b0f3788c38e", object_name: "aeotec-gen-5" }
[2021-09-02T18:00:45Z TRACE akri_shared::k8s::service] find_services_with_selector with selector="akri.sh/configuration=aeotec-gen-5"
[2021-09-02T18:00:45Z TRACE akri_shared::k8s::service] find_services_with_selector PRE svcs.list(...).await?
[2021-09-02T18:00:45Z TRACE akri_shared::k8s::service] find_services_with_selector return
[2021-09-02T18:00:45Z TRACE controller::util::pod_watcher] create_or_update_service - New instance svc spec=Service { metadata: Some(ObjectMeta { annotations: None, cluster_name: None, creation_timestamp: None, deletion_grace_period_seconds: None, deletion_timestamp: None, finalizers: None, generate_name: None, generation: None, labels: Some({"akri.sh/configuration": "aeotec-gen-5", "app": "aeotec-gen-5-svc", "controller": "akri.sh"}), managed_fields: None, name: Some("aeotec-gen-5-svc"), namespace: Some("host-system"), owner_references: Some([OwnerReference { api_version: "akri.sh/v0", block_owner_deletion: Some(true), controller: Some(true), kind: "Configuration", name: "aeotec-gen-5", uid: "2fcf85d6-d59c-4236-8424-5b0f3788c38e" }]), resource_version: None, self_link: None, uid: None }), spec: Some(ServiceSpec { cluster_ip: None, external_ips: None, external_name: None, external_traffic_policy: None, health_check_node_port: None, ip_family: None, load_balancer_ip: None, load_balancer_source_ranges: None, ports: Some([ServicePort { name: Some("device"), node_port: None, port: 2000, protocol: Some("TCP"), target_port: Some(String("device")) }]), publish_not_ready_addresses: None, selector: Some({"akri.sh/configuration": "aeotec-gen-5", "controller": "akri.sh"}), session_affinity: None, session_affinity_config: None, type_: Some("ClusterIP") }), status: None }
[2021-09-02T18:00:45Z TRACE akri_shared::k8s::service] create_service enter
[2021-09-02T18:00:45Z INFO  akri_shared::k8s::service] create_service svcs.create(...).await?:
[2021-09-02T18:00:45Z INFO  akri_shared::k8s::service] create_service services.create return: "aeotec-gen-5-svc"

I think there are two issues happening here:

The Akri Controller is deleting and re-applying configurations when the yaml metadata or status are changed, which flux is doing as @ammmze  mentioned above. (This could be a good first issue)
The delete and re-add of the Configuration is not working properly sometimes. There may be race cases here. Maybe the discovery handler connection is not being dropped before reconnecting.

👍🏻  I have zero rust knowledge, but I think for issue #1 (which I think in large part would stabilize my usage of Akri), the area of the code we'd be looking at is here.
So I guess the first thing is we need to be able to check to see what changed. And if its just metadata or status, then we ignore the change, otherwise do what we do today.

👍🏻 I have zero rust knowledge, but I think for issue #1 (which I think in large part would stabilize my usage of Akri), the area of the code we'd be looking at is here.
So I guess the first thing is we need to be able to check to see what changed. And if its just metadata or status, then we ignore the change, otherwise do what we do today.

@ammmze, i agree that's where the action needs to happen.
I dont think there is a simple way of checking if metadata or status changed, since we aren't storing the previous Configuration. We could add that to the ConfigInfo struct here in handle_config_add when the Configuration is applied. ConfigInfo is an entry of ConfigMap, so then, when we get a Modified event, we could pull the previous Configuration from the `ConfigMap in order to see what changed and act accordingly.
It's not super trivial, but would you be interested in putting in the fix? Trying out rust?

👍🏻  Yea I am up for giving it a go. Probably won't happen super quick since it'll happen between work and family life stuff, but it seems reasonably simple for a intro to rust 😀

For the race condition issue, maybe this doesn't do what I'm thinking (again still very much a noob with rust ... I come from primarily java and javascript), but this seems odd to me that we are cloning the config map when we do the delete. Then the add happens on the original config_map. I'm probably missing something or not fully understanding it, but just figured I'd toss it out there since I'm looking at this thing.

For the race condition issue, maybe this doesn't do what I'm thinking (again still very much a noob with rust ... I come from primarily java and javascript), but this seems odd to me that we are cloning the config map when we do the delete. Then the add happens on the original config_map. I'm probably missing something or not fully understanding it, but just figured I'd toss it out there since I'm looking at this thing.

That is cloning a reference to the shared map which is of type Arc<Mutex<HashMap<String, ConfigInfo>>>. Arc is a reference counter that is often used in rust when sharing data between threads. Its implementation of clone is to increment the number of references to the map. You've pointed out a very Rust-y behavior. I anticipate that the race case is in the discovery operator

#373

I did some investigation into the instances not being recreated, and like you mention in #373, i think this started after v0.6.5. Specifically, I think it is a result of updating to the latest kube-rs in #361 and using Api::watch instead of kube::runtime::watcher. I was able to re-pro unexpected behavior. I put additional notes in a PR https://github.com/deislabs/akri/pull/378 with the change and created issue https://github.com/deislabs/akri/issues/374 to track it. Thanks for bringing this up @ammmze!

I did some investigation into the instances not being recreated, and like you mention in #373, i think this started after v0.6.5. Specifically, I think it is a result of updating to the latest kube-rs in #361 and using Api::watch instead of kube::runtime::watcher. I was able to re-pro unexpected behavior. I put additional notes in a PR #378 with the change and created issue #374 to track it. Thanks for bringing this up @ammmze!

Awesome! Thank you! Excited to see these changes 🎉 !


Duplicate checks

I found duplicate checks in the sections. I do not understand why? Version goss 0.4.3 immediately speaks about this.
Example, please check
section_3/cis_3.3/cis_3.3.7.yml
check duplicated net.ip4.conf.all.rp_filter
And this problem exists in all sections

hi @sysop200
Thank you again for raising this issue.
These should all be merged now. I will close this issue, please feel free to reopen if this is still an issue.
many thanks
uk-bolly


Crash when ars nouveau scribes table is within certain range of research table

Version 4.0.9 of primal magick and version 4.12.4 of ars nouveau  Minecraft 1.20.1
When the ars nouveau scribes table is within range to be able to attempt to pull from the inventory of the research table when trying to make a spell the scribe's table will constantly tick, causing a crash. Within the same chunk they two are fine as long as they're far enough apart. After the first image I moved the scribe's table within 3 blocks, tried to make a light spell at the scribe's table, and the game froze and then crashed within a few seconds before I could grab a screenshot.
crash-2024-08-06_12.32.20-server.txt

Edit: Got a response from the ars nouveau discord so thought I'd edit it in here.

Thank you for the report. After looking into the issue further, it looks like this bug was fixed in v4.1.0-beta of Primal Magick, the version immediately following the one you're playing on for Minecraft 1.20.2. If you encounter this issue again on that updated version, please file a new ticket.


Added my profile and skills

Added my profile in profile.js and updated skills in skill.js

Thanks for contributing!


Set-DbaSpn - error in documentation?

Hi team,
it seems that there is a tiny error in the documentation for Set-DbaSpn.
On https://docs.dbatools.io/#Set-DbaSpn it sais:
PS C:> Set-DbaSpn -SPN MSSQLSvc\SQLSERVERA.domain.something -ServiceAccount domain\account
but it should be:
PS C:> Set-DbaSpn -SPN MSSQLSvc/SQLSERVERA.domain.something -ServiceAccount domain\account
notice that the backslash after MSSQLSvc is now a "/".
Otherwise you get the following error in Power Shell:
WARNING: [09:06:22][Set-DbaSpn] Could not add SPN. Exception calling "CommitChanges" with "0"
argument(s): "A constraint violation occurred."
Maybe you can correct the documentation for this command
Kind Regards

Thanks for the report! I'll take a look today.


Reorganizing tube-by-tube collection efficiency implementation.

This should produce no change in behavior.  It simply moves around where things are defined so we are better prepared when we run with multiple tube types in the same detector.

Looks good.  In addition to removing those functions from the new file did you "rm" the now empty file also?  It looks like no but maybe I'm wrong..

Yes, the file has been removed.  It still appears to be there for the sake of the diff, but once it is merged it should be gone.

OK I will merge.


HWKAPM-655 | python example app with kafka transport

https://issues.jboss.org/browse/HWKAPM-655
Python example application with kafka transport. Go application will be added in next PR.
@objectiser could you please review?

Modified images(ruby, swarm, python) have been pushed to the hub.


HANFUN: Deregistration problem of a PP at DSPG FP

The deregistration of a PP doesn't work correctly. The device is still registered at the DECT module.

Fixed by 7ba12e81b287ef4fd3a8610132df7b330468ec6e

Fixed in develop, de893b8c47f7631ab18202bd020551b8c1626300


Help using Arbiter for CWE-134 (example: CVE-2005-0105)

Hi all,
I just read the paper and I think Arbiter is pretty neat, but I'm having some troubles understanding how to use the system.
As a demo, I'm trying to detect CVE-2005-0105. I picked this because it is a small program with a straightforward PoC to reproduce:
$ HOME="%s%%.%dx%%%d$hn%%.%dx%%%d$hn" ./typespeed
Segmentation fault

Here is the analysis from my own tool, ARCUS, for reference (truncated for brevity):
INFO    | 2022-03-17 14:32:04,834 | analysis | Disassembling PT trace for PID: 1109945
[...]
INFO    | 2022-03-17 14:32:07,985 | analysis | Starting symbolic analysis
INFO    | 2022-03-17 14:32:08,000 | angrpt | Trace: 89527/766929 __libc_start_main+0x0 in extern-address space (0x528)
[...]
INFO    | 2022-03-17 14:32:11,090 | angrpt | Trace: 89616/766929 PLT.malloc+0x0 in 5639bd4ce000-typespeed (0x2320)
INFO    | 2022-03-17 14:32:11,199 | angrpt | Trace: 89616/766929 malloc+0x0 in extern-address space (0x2d0)
INFO    | 2022-03-17 14:32:11,215 | angrpt | Trace: 109007/766929 readconfig+0x25 in 5639bd4ce000-typespeed (0x3acc)
INFO    | 2022-03-17 14:32:11,222 | angrpt | Trace: 109008/766929 PLT.getenv+0x0 in 5639bd4ce000-typespeed (0x2040)
INFO    | 2022-03-17 14:32:11,227 | angrpt | Trace: 109008/766929 getenv+0x0 in extern-address space (0x1c0)
ERROR   | 2022-03-17 14:32:11,284 | plugins.hooks.libc | Error in getenv hook: args' length must all be equal
INFO    | 2022-03-17 14:32:11,288 | angrpt | Trace: 109048/766929 readconfig+0x34 in 5639bd4ce000-typespeed (0x3adb)
INFO    | 2022-03-17 14:32:11,298 | angrpt | Trace: 109049/766929 PLT.sprintf+0x0 in 5639bd4ce000-typespeed (0x23e0)
WARNING | 2022-03-17 14:32:11,299 | plugins.detectors.format_string | Symbolic format string pointer
INFO    | 2022-03-17 14:32:11,303 | angrpt | Trace: 109049/766929 sprintf+0x0 in extern-address space (0x5f8)
[...]
INFO    | 2022-03-17 14:32:11,718 | plugins.detectors.format_string | Blaming for corrupting format string: readconfig+0x34 in 5639bd4ce000-typespeed (0x3adb)
INFO    | 2022-03-17 14:32:11,718 | analysis | ** Analysis complete, final results **
INFO    | 2022-03-17 14:32:11,718 | analysis | Reached Trace End: False
INFO    | 2022-03-17 14:32:11,718 | analysis |               Active: 1
INFO    | 2022-03-17 14:32:11,718 | analysis |        Format String: 1
INFO    | 2022-03-17 14:32:11,718 | analysis | Format String Details:
[...]

The bug is in an invocation of sprintf, which I believe the example script vuln_templates/CWE134.py should already handle?
Here's what I tried:
git clone https://github.com/jkrshnmenon/arbiter.git
cd arbiter
python setup.py build && python setup.py install
pip install python-json-logger
mkdir logs
python ./vuln_templates/CWE134.py ./typespeed

And the output I get is:
WARNING | 2022-03-17 14:47:58,994 | cle.backends.externs | Symbol was allocated without a known size; emulation may fail if it is used non-opaquely: stdscr
WARNING | 2022-03-17 14:47:58,996 | cle.loader | The main binary is a position-independent executable. It is being loaded with a base address of 0x400000.
WARNING | 2022-03-17 14:47:58,998 | cle.loader | For more information about "Symbol was allocated without a known size", see https://docs.angr.io/extending-angr/environment#simdata
Deprecation warning: Use self.model.get_any_node() instead of get_any_node
ERROR   | 2022-03-17 14:48:02,400 | arbiter.master_chief.sa_advanced | Got constant value
ERROR   | 2022-03-17 14:48:02,894 | arbiter.master_chief.sa_advanced | Got constant value
ERROR   | 2022-03-17 14:48:02,911 | arbiter.master_chief.sa_advanced | Got constant value
ERROR   | 2022-03-17 14:48:04,054 | arbiter.master_chief.sa_advanced | Got constant value
ERROR   | 2022-03-17 14:48:04,084 | arbiter.master_chief.sa_advanced | Got constant value
WARNING | 2022-03-17 14:48:04,761 | angr.state_plugins.callstack | Returning to an unexpected address 0x2020202020202020
ERROR   | 2022-03-17 14:48:05,026 | arbiter.master_chief.sa_advanced | Got constant value
ERROR   | 2022-03-17 14:48:05,601 | arbiter.master_chief.sa_advanced | Got constant value
ERROR   | 2022-03-17 14:48:09,431 | arbiter.master_chief.sa_advanced | Got constant value
ERROR   | 2022-03-17 14:48:10,509 | arbiter.master_chief.sa_advanced | Got constant value
ERROR   | 2022-03-17 14:48:10,529 | arbiter.master_chief.sa_advanced | Got constant value
ERROR   | 2022-03-17 14:48:10,568 | arbiter.master_chief.sa_advanced | Got constant value
ERROR   | 2022-03-17 14:48:10,596 | arbiter.master_chief.sa_advanced | Got constant value
ERROR   | 2022-03-17 14:48:10,623 | arbiter.master_chief.sa_advanced | Got constant value
ERROR   | 2022-03-17 14:48:10,640 | arbiter.master_chief.sa_advanced | Got constant value
ERROR   | 2022-03-17 14:48:10,660 | arbiter.master_chief.sa_advanced | Got constant value
ERROR   | 2022-03-17 14:48:10,674 | arbiter.master_chief.sa_advanced | Got constant value
ERROR   | 2022-03-17 14:48:10,693 | arbiter.master_chief.sa_advanced | Got constant value
WARNING | 2022-03-17 14:48:10,714 | angr.project | Address is already hooked, during hook(0x5000b8, <SimProcedure StrlenHook>). Re-hooking.
WARNING | 2022-03-17 14:48:10,715 | angr.project | Address is already hooked, during hook(0x5000e0, <SimProcedure StrchrHook>). Re-hooking.
WARNING | 2022-03-17 14:48:10,716 | angr.project | Address is already hooked, during hook(0x500028, <SimProcedure GetenvHook>). Re-hooking.
ERROR   | 2022-03-17 14:48:10,716 | angr.project | Could not find symbol strdup
ERROR   | 2022-03-17 14:48:10,717 | angr.project | Could not find symbol gettext
ERROR   | 2022-03-17 14:48:10,718 | angr.project | Could not find symbol dcgettext
ERROR   | 2022-03-17 14:48:10,718 | angr.project | Could not find symbol dgettext
WARNING | 2022-03-17 14:48:10,720 | angr.calling_conventions | Guessing call prototype. Please specify prototype.
WARNING | 2022-03-17 14:48:10,734 | angr.storage.memory_mixins.default_filler_mixin | The program is accessing register with an unspecified value. This could indicate unwanted behavior.
WARNING | 2022-03-17 14:48:10,734 | angr.storage.memory_mixins.default_filler_mixin | angr will cope with this by generating an unconstrained symbolic variable and continuing. You can resolve this by:
WARNING | 2022-03-17 14:48:10,734 | angr.storage.memory_mixins.default_filler_mixin | 1) setting a value to the initial state
WARNING | 2022-03-17 14:48:10,734 | angr.storage.memory_mixins.default_filler_mixin | 2) adding the state option ZERO_FILL_UNCONSTRAINED_{MEMORY,REGISTERS}, to make unknown regions hold null
WARNING | 2022-03-17 14:48:10,734 | angr.storage.memory_mixins.default_filler_mixin | 3) adding the state option SYMBOL_FILL_UNCONSTRAINED_{MEMORY,REGISTERS}, to suppress these messages.
WARNING | 2022-03-17 14:48:10,734 | angr.storage.memory_mixins.default_filler_mixin | Filling register r12 with 8 unconstrained bytes referenced from 0x403aa7 (readconfig+0x0 in typespeed (0x3aa7))
WARNING | 2022-03-17 14:48:10,736 | angr.storage.memory_mixins.default_filler_mixin | Filling register rbp with 8 unconstrained bytes referenced from 0x403aa9 (readconfig+0x2 in typespeed (0x3aa9))
WARNING | 2022-03-17 14:48:10,738 | angr.storage.memory_mixins.default_filler_mixin | Filling register rbx with 8 unconstrained bytes referenced from 0x403aaa (readconfig+0x3 in typespeed (0x3aaa))
WARNING | 2022-03-17 14:48:11,028 | angr.state_plugins.heap.heap_base | Allocation request of<PHONE_NUMBER> bytes exceeded maximum of 128 bytes; allocating 128 bytes
WARNING | 2022-03-17 14:48:11,096 | angr.project | Refusing to unhook external symbol strlen, replace it with another hook if you want to change it
WARNING | 2022-03-17 14:48:11,096 | angr.project | Address is already hooked, during hook(0x5000b8, <SimProcedure strlen>). Re-hooking.
WARNING | 2022-03-17 14:48:11,096 | angr.project | Refusing to unhook external symbol strchr, replace it with another hook if you want to change it
WARNING | 2022-03-17 14:48:11,097 | angr.project | Address is already hooked, during hook(0x5000e0, <SimProcedure strchr>). Re-hooking.
WARNING | 2022-03-17 14:48:11,097 | angr.project | Could not find symbol strdup
WARNING | 2022-03-17 14:48:11,097 | angr.project | Address is already hooked, during hook(0x500028, <SimProcedure ReturnUnconstrained>). Re-hooking.
WARNING | 2022-03-17 14:48:11,134 | angr.storage.memory_mixins.default_filler_mixin | Filling register rdx with 8 unconstrained bytes referenced from 0x4024c0 (_start+0x0 in typespeed (0x24c0))
WARNING | 2022-03-17 14:48:11,135 | angr.storage.memory_mixins.default_filler_mixin | Filling memory at 0x7ffffffffff0000 with 8 unconstrained bytes referenced from 0x4024c5 (_start+0x5 in typespeed (0x24c5))
WARNING | 2022-03-17 14:48:11,138 | angr.storage.memory_mixins.default_filler_mixin | Filling register rax with 8 unconstrained bytes referenced from 0x4024cd (_start+0xd in typespeed (0x24cd))
ERROR   | 2022-03-17 14:48:11,146 | arbiter.master_chief.symbolic_execution | No paths found

The last line leads me to believe I did something wrong. Any suggestions or guidance?
Thanks!

I can't exactly figure out what's going wrong from the output. If you have the binary available, I could take a look at it and figure out what's going on.


Training Failed - implementation for device cuda:0 not found.

** Setting base model to SD1.5 **
--------uuid:  qw
----------work_dir:  C:\Users\ralfl\Downloads\ai\stable-diffusion-webui\extensions\facechain\worker_data\qw\ly261666/cv_portrait_model\person1
2023-12-07 10:01:02,344 - modelscope - INFO - Use user-specified model revision: v1.0.0
2023-12-07 10:01:04,752 - modelscope - INFO - Use user-specified model revision: v1.0.0
2023-12-07 10:01:07,119 - modelscope - INFO - Use user-specified model revision: v1.0.0
2023-12-07 10:01:09,272 - modelscope - INFO - Use user-specified model revision: v1.0.0
2023-12-07 10:01:12,438 - modelscope - INFO - Use user-specified model revision: v1.0.0
2023-12-07 10:01:15,041 - modelscope - INFO - Use user-specified model revision: v1.0.0
2023-12-07 10:01:17,431 - modelscope - INFO - Use user-specified model revision: v1.0.0
2023-12-07 10:01:19,965 - modelscope - INFO - Use user-specified model revision: v1.0.0
2023-12-07 10:01:22,694 - modelscope - INFO - Use user-specified model revision: v1.0.0
2023-12-07 10:01:24,933 - modelscope - INFO - Use user-specified model revision: v1.0.0
bin C:\Users\ralfl\Downloads\ai\stable-diffusion-webui\venv\Lib\site-packages\bitsandbytes\libbitsandbytes_cuda118.dll
A matching Triton is not available, some optimizations will not be enabled.
Error caught was: No module named 'triton'
2023-12-07 10:02:05,052 - modelscope - INFO - PyTorch version 2.0.1+cu118 Found.
2023-12-07 10:02:05,056 - modelscope - INFO - Loading ast index from C:\Users\ralfl\.cache\modelscope\ast_indexer
2023-12-07 10:02:05,218 - modelscope - INFO - Loading done! Current index file version is 1.9.5, with md5 d5bd6a17a97bfa66f514e27ec01b558b and a total number of 945 components indexed
2023-12-07 10:02:12,635 - modelscope - INFO - Use user-specified model revision: v4.0
2023-12-07 10:02:17,100 - modelscope - INFO - Use user-specified model revision: v1.0.1
2023-12-07 10:02:17,757 - modelscope - WARNING - ('PIPELINES', 'skin-retouching-torch', 'skin-retouching-torch') not found in ast index file
2023-12-07 10:02:17,757 - modelscope - INFO - initiate model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_unet_skin_retouching_torch
2023-12-07 10:02:17,758 - modelscope - INFO - initiate model from location C:\Users\ralfl\.cache\modelscope\hub\damo\cv_unet_skin_retouching_torch.
2023-12-07 10:02:17,763 - modelscope - WARNING - No preprocessor field found in cfg.
2023-12-07 10:02:17,763 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
2023-12-07 10:02:17,763 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'C:\\Users\\ralfl\\.cache\\modelscope\\hub\\damo\\cv_unet_skin_retouching_torch'}. trying to build by task and model information.
2023-12-07 10:02:17,764 - modelscope - WARNING - Find task: skin-retouching-torch, model type: None. Insufficient information to build preprocessor, skip building preprocessor
2023-12-07 10:02:22,111 - modelscope - WARNING - Model revision not specified, use revision: v2.0.2
2023-12-07 10:02:24,499 - modelscope - INFO - initiate model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface
2023-12-07 10:02:24,499 - modelscope - INFO - initiate model from location C:\Users\ralfl\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface.
2023-12-07 10:02:24,507 - modelscope - WARNING - No preprocessor field found in cfg.
2023-12-07 10:02:24,507 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
2023-12-07 10:02:24,508 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'C:\\Users\\ralfl\\.cache\\modelscope\\hub\\damo\\cv_resnet50_face-detection_retinaface'}. trying to build by task and model information.
2023-12-07 10:02:24,510 - modelscope - WARNING - Find task: face-detection, model type: None. Insufficient information to build preprocessor, skip building preprocessor
2023-12-07 10:02:24,522 - modelscope - INFO - loading model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_resnet50_face-detection_retinaface\pytorch_model.pt
2023-12-07 10:02:24,850 - modelscope - INFO - load model done
2023-12-07 10:02:26.4367882 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2649'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.4424361 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2644'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.4476586 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2647'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.4539665 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2658'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.4603276 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2648'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.4668787 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2657'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.4728854 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2653'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.4781193 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2652'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.4847790 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2645'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.4901577 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2643'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.4960393 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2641'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.5011255 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2633'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.5079757 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2632'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.5151724 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2624'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.5207215 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2614'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.5265524 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2613'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.5354438 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2606'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.5445020 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2598'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.5495662 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2596'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:26.5561368 [W:onnxruntime:, graph.cc:3543 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'const_fold_opt__2594'. It is not used by any node and should be removed from the model.
2023-12-07 10:02:29,728 - modelscope - INFO - Use user-specified model revision: v1.1
2023-12-07 10:02:30,327 - modelscope - INFO - initiate model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_ddsar_face-detection_iclr23-damofd
2023-12-07 10:02:30,328 - modelscope - INFO - initiate model from location C:\Users\ralfl\.cache\modelscope\hub\damo\cv_ddsar_face-detection_iclr23-damofd.
2023-12-07 10:02:30,329 - modelscope - INFO - initialize model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_ddsar_face-detection_iclr23-damofd
2023-12-07 10:02:36,244 - mmcv - INFO - initialize PAFPN with init_cfg {'type': 'Xavier', 'layer': 'Conv2d', 'distribution': 'uniform'}
2023-12-07 10:02:36,245 - mmcv - INFO -
lateral_convs.0.conv.weight - torch.Size([16, 64, 1, 1]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:36,246 - mmcv - INFO -
lateral_convs.0.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:36,246 - mmcv - INFO -
lateral_convs.1.conv.weight - torch.Size([16, 120, 1, 1]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:36,246 - mmcv - INFO -
lateral_convs.1.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:36,246 - mmcv - INFO -
lateral_convs.2.conv.weight - torch.Size([16, 160, 1, 1]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:36,246 - mmcv - INFO -
lateral_convs.2.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:36,247 - mmcv - INFO -
fpn_convs.0.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:36,247 - mmcv - INFO -
fpn_convs.0.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:36,247 - mmcv - INFO -
fpn_convs.1.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:36,247 - mmcv - INFO -
fpn_convs.1.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:36,247 - mmcv - INFO -
fpn_convs.2.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:36,248 - mmcv - INFO -
fpn_convs.2.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:36,248 - mmcv - INFO -
downsample_convs.0.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:36,248 - mmcv - INFO -
downsample_convs.0.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:36,248 - mmcv - INFO -
downsample_convs.1.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:36,248 - mmcv - INFO -
downsample_convs.1.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:36,248 - mmcv - INFO -
pafpn_convs.0.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:36,248 - mmcv - INFO -
pafpn_convs.0.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:36,249 - mmcv - INFO -
pafpn_convs.1.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:36,249 - mmcv - INFO -
pafpn_convs.1.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:36,249 - modelscope - INFO - loading model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_ddsar_face-detection_iclr23-damofd\pytorch_model.pt
load checkpoint from local path: C:\Users\ralfl\.cache\modelscope\hub\damo\cv_ddsar_face-detection_iclr23-damofd\pytorch_model.pt
2023-12-07 10:02:36,551 - modelscope - INFO - load model done
2023-12-07 10:02:40,268 - modelscope - INFO - Use user-specified model revision: v1.0.1
2023-12-07 10:02:40,857 - modelscope - INFO - initiate model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_resnet101_image-multiple-human-parsing
2023-12-07 10:02:40,858 - modelscope - INFO - initiate model from location C:\Users\ralfl\.cache\modelscope\hub\damo\cv_resnet101_image-multiple-human-parsing.
2023-12-07 10:02:40,861 - modelscope - INFO - initialize model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_resnet101_image-multiple-human-parsing
2023-12-07 10:02:41,172 - modelscope - INFO - loading model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_resnet101_image-multiple-human-parsing\pytorch_model.pt
2023-12-07 10:02:41,622 - modelscope - INFO - criterion.empty_weight doesn't exist in current model, skip loading.
2023-12-07 10:02:41,656 - modelscope - INFO - load model done
2023-12-07 10:02:41,682 - modelscope - WARNING - No preprocessor field found in cfg.
2023-12-07 10:02:41,682 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
2023-12-07 10:02:41,683 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'C:\\Users\\ralfl\\.cache\\modelscope\\hub\\damo\\cv_resnet101_image-multiple-human-parsing'}. trying to build by task and model information.
2023-12-07 10:02:41,683 - modelscope - WARNING - No preprocessor key ('m2fp', 'image-segmentation') found in PREPROCESSOR_MAP, skip building preprocessor.
2023-12-07 10:02:44,344 - modelscope - INFO - Use user-specified model revision: v2.0.2
2023-12-07 10:02:45,987 - modelscope - INFO - initiate model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_resnet34_face-attribute-recognition_fairface
2023-12-07 10:02:45,987 - modelscope - INFO - initiate model from location C:\Users\ralfl\.cache\modelscope\hub\damo\cv_resnet34_face-attribute-recognition_fairface.
2023-12-07 10:02:45,993 - modelscope - WARNING - No preprocessor field found in cfg.
2023-12-07 10:02:45,993 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
2023-12-07 10:02:45,993 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'C:\\Users\\ralfl\\.cache\\modelscope\\hub\\damo\\cv_resnet34_face-attribute-recognition_fairface'}. trying to build by task and model information.
2023-12-07 10:02:45,993 - modelscope - WARNING - Find task: face-attribute-recognition, model type: None. Insufficient information to build preprocessor, skip building preprocessor
2023-12-07 10:02:50,930 - modelscope - WARNING - Model revision not specified, use revision: v1.1
2023-12-07 10:02:51,426 - modelscope - INFO - initiate model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_ddsar_face-detection_iclr23-damofd
2023-12-07 10:02:51,426 - modelscope - INFO - initiate model from location C:\Users\ralfl\.cache\modelscope\hub\damo\cv_ddsar_face-detection_iclr23-damofd.
2023-12-07 10:02:51,428 - modelscope - INFO - initialize model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_ddsar_face-detection_iclr23-damofd
2023-12-07 10:02:51,450 - mmcv - INFO - initialize PAFPN with init_cfg {'type': 'Xavier', 'layer': 'Conv2d', 'distribution': 'uniform'}
2023-12-07 10:02:51,451 - mmcv - INFO -
lateral_convs.0.conv.weight - torch.Size([16, 64, 1, 1]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:51,451 - mmcv - INFO -
lateral_convs.0.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:51,451 - mmcv - INFO -
lateral_convs.1.conv.weight - torch.Size([16, 120, 1, 1]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:51,451 - mmcv - INFO -
lateral_convs.1.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:51,452 - mmcv - INFO -
lateral_convs.2.conv.weight - torch.Size([16, 160, 1, 1]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:51,452 - mmcv - INFO -
lateral_convs.2.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:51,452 - mmcv - INFO -
fpn_convs.0.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:51,453 - mmcv - INFO -
fpn_convs.0.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:51,453 - mmcv - INFO -
fpn_convs.1.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:51,453 - mmcv - INFO -
fpn_convs.1.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:51,453 - mmcv - INFO -
fpn_convs.2.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:51,453 - mmcv - INFO -
fpn_convs.2.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:51,453 - mmcv - INFO -
downsample_convs.0.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:51,453 - mmcv - INFO -
downsample_convs.0.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:51,454 - mmcv - INFO -
downsample_convs.1.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:51,454 - mmcv - INFO -
downsample_convs.1.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:51,454 - mmcv - INFO -
pafpn_convs.0.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:51,454 - mmcv - INFO -
pafpn_convs.0.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:51,454 - mmcv - INFO -
pafpn_convs.1.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:02:51,454 - mmcv - INFO -
pafpn_convs.1.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:02:51,454 - modelscope - INFO - loading model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_ddsar_face-detection_iclr23-damofd\pytorch_model.pt
load checkpoint from local path: C:\Users\ralfl\.cache\modelscope\hub\damo\cv_ddsar_face-detection_iclr23-damofd\pytorch_model.pt
2023-12-07 10:02:51,480 - modelscope - INFO - load model done
2023-12-07 10:02:51,490 - modelscope - INFO - loading model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_resnet34_face-attribute-recognition_fairface\pytorch_model.pt
2023-12-07 10:02:51,850 - modelscope - INFO - load model done
2023-12-07 10:02:54,369 - modelscope - INFO - Use user-specified model revision: v2.5
2023-12-07 10:02:55,052 - modelscope - INFO - initiate model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_manual_facial-landmark-confidence_flcm
2023-12-07 10:02:55,053 - modelscope - INFO - initiate model from location C:\Users\ralfl\.cache\modelscope\hub\damo\cv_manual_facial-landmark-confidence_flcm.
2023-12-07 10:02:55,058 - modelscope - WARNING - No preprocessor field found in cfg.
2023-12-07 10:02:55,059 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
2023-12-07 10:02:55,059 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': 'C:\\Users\\ralfl\\.cache\\modelscope\\hub\\damo\\cv_manual_facial-landmark-confidence_flcm'}. trying to build by task and model information.
2023-12-07 10:02:55,059 - modelscope - WARNING - Find task: face-2d-keypoints, model type: None. Insufficient information to build preprocessor, skip building preprocessor
2023-12-07 10:03:00,673 - modelscope - WARNING - Model revision not specified, use revision: v1.1
2023-12-07 10:03:01,258 - modelscope - INFO - initiate model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_ddsar_face-detection_iclr23-damofd
2023-12-07 10:03:01,258 - modelscope - INFO - initiate model from location C:\Users\ralfl\.cache\modelscope\hub\damo\cv_ddsar_face-detection_iclr23-damofd.
2023-12-07 10:03:01,260 - modelscope - INFO - initialize model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_ddsar_face-detection_iclr23-damofd
2023-12-07 10:03:01,281 - mmcv - INFO - initialize PAFPN with init_cfg {'type': 'Xavier', 'layer': 'Conv2d', 'distribution': 'uniform'}
2023-12-07 10:03:01,282 - mmcv - INFO -
lateral_convs.0.conv.weight - torch.Size([16, 64, 1, 1]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:03:01,282 - mmcv - INFO -
lateral_convs.0.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:03:01,282 - mmcv - INFO -
lateral_convs.1.conv.weight - torch.Size([16, 120, 1, 1]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:03:01,283 - mmcv - INFO -
lateral_convs.1.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:03:01,283 - mmcv - INFO -
lateral_convs.2.conv.weight - torch.Size([16, 160, 1, 1]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:03:01,283 - mmcv - INFO -
lateral_convs.2.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:03:01,283 - mmcv - INFO -
fpn_convs.0.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:03:01,283 - mmcv - INFO -
fpn_convs.0.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:03:01,283 - mmcv - INFO -
fpn_convs.1.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:03:01,283 - mmcv - INFO -
fpn_convs.1.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:03:01,284 - mmcv - INFO -
fpn_convs.2.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:03:01,284 - mmcv - INFO -
fpn_convs.2.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:03:01,284 - mmcv - INFO -
downsample_convs.0.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:03:01,285 - mmcv - INFO -
downsample_convs.0.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:03:01,285 - mmcv - INFO -
downsample_convs.1.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:03:01,285 - mmcv - INFO -
downsample_convs.1.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:03:01,285 - mmcv - INFO -
pafpn_convs.0.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:03:01,285 - mmcv - INFO -
pafpn_convs.0.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:03:01,286 - mmcv - INFO -
pafpn_convs.1.conv.weight - torch.Size([16, 16, 3, 3]):
XavierInit: gain=1, distribution=uniform, bias=0

2023-12-07 10:03:01,286 - mmcv - INFO -
pafpn_convs.1.conv.bias - torch.Size([16]):
The value is the same before and after calling `init_weights` of PAFPN

2023-12-07 10:03:01,286 - modelscope - INFO - loading model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_ddsar_face-detection_iclr23-damofd\pytorch_model.pt
load checkpoint from local path: C:\Users\ralfl\.cache\modelscope\hub\damo\cv_ddsar_face-detection_iclr23-damofd\pytorch_model.pt
2023-12-07 10:03:01,377 - modelscope - INFO - load model done
2023-12-07 10:03:01,394 - modelscope - INFO - loading model from C:\Users\ralfl\.cache\modelscope\hub\damo\cv_manual_facial-landmark-confidence_flcm\pytorch_model.pt
2023-12-07 10:03:01,424 - modelscope - INFO - load model done
cathed for image process of 000.jpg
Error: nms_impl: implementation for device cuda:0 not found.

cathed for image process of 001.jpg
Error: nms_impl: implementation for device cuda:0 not found.

cathed for image process of 002.jpg
Error: nms_impl: implementation for device cuda:0 not found.

cathed for image process of 003.jpg
Error: nms_impl: implementation for device cuda:0 not found.

cathed for image process of 004.jpg
Error: nms_impl: implementation for device cuda:0 not found.

cathed for image process of 005.jpg
Error: nms_impl: implementation for device cuda:0 not found.

cathed for image process of 006.jpg
Error: nms_impl: implementation for device cuda:0 not found.

cathed for image process of 007.jpg
Error: nms_impl: implementation for device cuda:0 not found.

cathed for image process of 008.jpg
Error: nms_impl: implementation for device cuda:0 not found.

cathed for image process of 009.jpg
Error: nms_impl: implementation for device cuda:0 not found.

[]
Error: result is empty.
instance_data_dir C:\Users\ralfl\Downloads\ai\stable-diffusion-webui\extensions\facechain\worker_data\qw\training_data\ly261666/cv_portrait_model\person1
Traceback (most recent call last):
  File "C:\Users\ralfl\Downloads\ai\stable-diffusion-webui\extensions\facechain/facechain/train_text_to_image_lora.py", line 31, in <module>
    import datasets
ModuleNotFoundError: No module named 'datasets'
Error executing the command: Command '['python', 'C:\\Users\\ralfl\\Downloads\\ai\\stable-diffusion-webui\\extensions\\facechain/facechain/train_text_to_image_lora.py', '--pretrained_model_name_or_path=ly261666/cv_portrait_model', '--revision=v2.0', '--sub_path=film/film', '--output_dataset_name=C:\\Users\\ralfl\\Downloads\\ai\\stable-diffusion-webui\\extensions\\facechain\\worker_data\\qw\\training_data\\ly261666/cv_portrait_model\\person1', '--caption_column=text', '--resolution=512', '--random_flip', '--train_batch_size=1', '--num_train_epochs=200', '--checkpointing_steps=5000', '--learning_rate=1.5e-04', '--lr_scheduler=cosine', '--lr_warmup_steps=0', '--seed=42', '--output_dir=C:\\Users\\ralfl\\Downloads\\ai\\stable-diffusion-webui\\extensions\\facechain\\worker_data\\qw\\ly261666/cv_portrait_model\\person1', '--lora_r=4', '--lora_alpha=32', '--lora_text_encoder_r=32', '--lora_text_encoder_alpha=32', '--resume_from_checkpoint=fromfacecommon']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "C:\Users\ralfl\Downloads\ai\stable-diffusion-webui\extensions\facechain\app.py", line 147, in train_lora_fn
    subprocess.run(command, check=True)
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.1776.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['python', 'C:\\Users\\ralfl\\Downloads\\ai\\stable-diffusion-webui\\extensions\\facechain/facechain/train_text_to_image_lora.py', '--pretrained_model_name_or_path=ly261666/cv_portrait_model', '--revision=v2.0', '--sub_path=film/film', '--output_dataset_name=C:\\Users\\ralfl\\Downloads\\ai\\stable-diffusion-webui\\extensions\\facechain\\worker_data\\qw\\training_data\\ly261666/cv_portrait_model\\person1', '--caption_column=text', '--resolution=512', '--random_flip', '--train_batch_size=1', '--num_train_epochs=200', '--checkpointing_steps=5000', '--learning_rate=1.5e-04', '--lr_scheduler=cosine', '--lr_warmup_steps=0', '--seed=42', '--output_dir=C:\\Users\\ralfl\\Downloads\\ai\\stable-diffusion-webui\\extensions\\facechain\\worker_data\\qw\\ly261666/cv_portrait_model\\person1', '--lora_r=4', '--lora_alpha=32', '--lora_text_encoder_r=32', '--lora_text_encoder_alpha=32', '--resume_from_checkpoint=fromfacecommon']' returned non-zero exit status 1.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\ralfl\Downloads\ai\stable-diffusion-webui\venv\Lib\site-packages\gradio\routes.py", line 488, in run_predict
    output = await app.get_blocks().process_api(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\ralfl\Downloads\ai\stable-diffusion-webui\venv\Lib\site-packages\gradio\blocks.py", line 1431, in process_api
    result = await self.call_function(
             ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\ralfl\Downloads\ai\stable-diffusion-webui\venv\Lib\site-packages\gradio\blocks.py", line 1103, in call_function
    prediction = await anyio.to_thread.run_sync(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\ralfl\Downloads\ai\stable-diffusion-webui\venv\Lib\site-packages\anyio\to_thread.py", line 33, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\ralfl\Downloads\ai\stable-diffusion-webui\venv\Lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
    return await future
           ^^^^^^^^^^^^
  File "C:\Users\ralfl\Downloads\ai\stable-diffusion-webui\venv\Lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
    result = context.run(func, *args)
             ^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\ralfl\Downloads\ai\stable-diffusion-webui\venv\Lib\site-packages\gradio\utils.py", line 707, in wrapper
    response = f(*args, **kwargs)
               ^^^^^^^^^^^^^^^^^^
  File "C:\Users\ralfl\Downloads\ai\stable-diffusion-webui\extensions\facechain\app.py", line 801, in run
    train_lora_fn(base_model_path=base_model_path,
  File "C:\Users\ralfl\Downloads\ai\stable-diffusion-webui\extensions\facechain\app.py", line 150, in train_lora_fn
    raise gr.Error("训练失败 (Training failed)")
gradio.exceptions.Error: '训练失败 (Training failed)'

check available cuda: torch.cuda.is_available()

I have the same error but when I look at the webui I see this:
torch: 2.1.1+cu118
and it the start up I also see:
[+] torch version 2.1.1+cu118 installed.
I realize you used:
python: py3.8, py3.10
pytorch: torch2.0.0, torch2.0.1
CUDA: 11.7
CUDNN: 8+
OS: Ubuntu 20.04, CentOS 7.9
GPU: Nvidia-A10 24G
In the txt2img tab, I can generate images and I see my gpu go to 100% which makes me believe it is working but not for FaceChain.  Is there anyway in FC I can force it to point to the device by changing something in the script?
Thank you very much for all you hard work and efforts, and greatly - for sharing!

please try out the newest train-free, 10s inference version facechain-fact.


Stack algorithm

I have added Three stack related problems solution.
Kindly merge it with your repo
Thanks & regards

Hacktoberfest 2020 please kindly merge it


C++ template type in function declaration

Hi!
In general, highlight.js is highlighting C++ function declarations with a special syntax so the function names and arguments do stand out. However if there is a template anywhere in there, it fails. Example:
boost::optional<application> handle_key(application state, key_code key, coord size);

Is highlighted all in the same basic color.   Right now it's pretty open ended.  You could probably even reuse the existing ident:
var IDENT_RE = hljs.IDENT_RE + '(<...>)?;

If this was tightened up a little and you added a markup test (or updated one if there is one that makes sense) and submitted a PR we'd be happy to look at it more closely.

Might first confirm we haven't fixed this in the meanwhile already? :)


Added DELETE methods to the api.

To note I didn't add it to the command line script, wanted your input on that if you thought it would be good or not?

As far as I know, delete is not part of DICOMweb for study/series/instance.
E.e. it's not listed here:
https://www.dicomstandard.org/dicomweb/restful-structure/
Note that google supports proprietary versions here:
https://cloud.google.com/healthcare/docs/dicom#deletion
I totally agree that this is a needed feature, but probably it should be flagged in the docs as a non-standard API.  Ideally we could make this a "draft standard" API to be used in a change proposal.

@pieper I understand that DELETE is not part of the dicomweb standard so I do agree that we should make it as clear as possible to the users. Adding it to the docs is a good suggestion.

Thanks Markus!

I fixed all flake8 formatting issues and the test passes now. However I seem to be getting unrelated failures... Not sure if this is known and I should ignore it or not.

FAILED setup.py::FLAKE8 - AttributeError: 'Application' object has no attribute 'parse_preliminary_options_and_args'

parse_preliminary_options_and_args

I experienced these issues locally on my Macbook at some point as well. However, the tests seem to run fine on TravisCI, so it doesn't seem to be a general issue.

Thanks for your contribution @codezizo. Will draft a new release within the next days and update the package distribution on PyPI.


ERROR running force:source:deploy:  Parse error in file /home/runner/.sfdx/***.json on line 1 FILE HAS NO CONTENT

Summary
We have git actions to deploy validate in salesforce, We think issue is in one of these commands
npm install<EMAIL_ADDRESS>node_modules/sfdx-cli/bin/run --version
node_modules/sfdx-cli/bin/run plugins --core
npm install @actions/core
npm install @actions/github
node_modules/sfdx-cli/bin/run force:source:deploy -
Steps To Reproduce:
Expected result
We should be able to validate in Salesforce
Actual result
We get an error stated below
ERROR running force:source:deploy:  Parse error in file /home/runner/.sfdx/***.json on line 1
FILE HAS NO CONTENT

Could not deploy changes: ERROR running force:source:deploy:  Parse error in file /home/runner/.sfdx/***.json on line 1
FILE HAS NO CONTENT

Error: Process completed with exit code 1.

Additional information
Seems like autorization of org is fine , but cant say 100% Successfully authorized *** with org ID 00D8******
SFDX CLI Version(to find the version of the CLI engine run sfdx --version): 7.88.4 and previously 7.85.1
SFDX plugin Version(to find the version of the CLI plugin run sfdx plugins --core) Don't know
OS and version: Macintosh

This issue is being tracked via issue #867.
Closing this issue.


issue on line 12 in main.py

I've done all the steps (multiple times) and I have my assets folder in the same one as main.py, but my migration never begins because I get the following error:
line 12, in
f = open(TWEETS_JS_PATH)
FileNotFoundError: [Errno 2] No such file or directory: './data/tweets.js'
Anyone have a fix for this?

Here's a screenshot of exactly what I see in my terminal (with my username pseudo-covered, because I don't know) whenever I complete the final step and try to initiate the migration. Confusing.

Solved it. The existing insructions have you move the assets folder from your downloaded Twitter data to the twitter-to-bsky-master folder, but you also need to move the data folder. That was the issue for me, anyway, as those two folders were separate within the Twitter data folder. I'm basically a computer genius now.

Nice!


use github address

Thanks, I solved this differently (conditionally) in v1.7.5.

@tuncer It works. Thanks for your work.


datepicker decrements date on blur

I'm also getting this bug. using v0.0.19

Hey @hyperonic, what does your format look like? I changed mine from MM/dd/yy to MM/dd/yyyy and it worked after that.

@Hyperonic please refer https://github.com/Promact/md2/tree/master/src/lib/datepicker docs of datepicker

@letthewookieewin @dharmeshpipariya.  I'm using format y. After selecting year, If I click anywhere outside the field, the year moves back 1 year

@Hyperonic could you provide more details or plunkr demo?

@dharmeshpipariya http://plnkr.co/edit/GSdXakoZigRGrrBrWb7N

I open a similar issue few days ago #186

I fix date parsing bug by overriding "parseDate" method in DateUtil class and changing regex that match keyword format from /[dmhkyhs]/i to /[dmMHys]/ (avoid insensitive case and list only letter listing in the doc.
@dharmeshpipariya, I can create a pull-request if it's looking good for you ?

@laurentperroteau thanks, yes you can create PR


Aadhi-DOA

Hi Hope you're doing well.
Thank you for taking the time to solve the all the questions. We really appreciate your efforts. We will verify your submission and your certificate will be sent to you in your email. Thank you for participating. Keep an eye on our social media page for our upcoming events.
an you please specify your college/institution name and your mail for the certificate.

Also kindly specify your full name for the certificates.

Hi,
There has been some issue in contacting you via mail. Can you please share the following details to the specified mail Id.
Full name, college/institution name and your mail id.
Share the details to<EMAIL_ADDRESS>


config control mechanism

Description
Added config control mechanism for {{SERVER_PORT}} in the startup command ./altv-server, since alt:v supports the --port startup parameter. The port can no longer be mangled with by user.
Checklist for all submissions

[x] Have you followed the guidelines in our Contributing document?
[x] Have you checked to ensure there aren't other open Pull Requests for the same update/change?
[x] Have you tested and reviewed your changes with confidence that everything works?
[x] Did you branch your changes and PR from that branch and not from your master branch?

If not, why?:

[x] You verify that the start command applied does not use a shell script

[ ] If some script is needed then it is part of a current yolk or a PR to add one

[ ] The egg was exported from the panel

Sorry it wasn't exported i didn't mean to click that.
And using startup": "./altv-server --port {{SERVER_PORT}}", ensures that the server always starts with the allocated port in pterodactyl. Ff it is only config parsed users can mangle with it. This way pterodactyl can ensure, the server always starts with the allocated port.

This is needed because pterodactyl only forwards allocated ports, if port 7788 is allocated but the user changes the port in the config to 7789, the server will not be online.

If the user changes it, it is automatically replaced again. Only admins can change this port and not the users

This is needed because pterodactyl only forwards allocated ports, if port 7788 is allocated but the user changes the port in the config to 7789, the server will not be online.

If the user changes it, it is automatically replaced again. Only admins can change this port and not the users

No it is not as seen on the screenshots.
The user can change the port in server.toml and the pterodactyl set allocation is ignored.

then sth with parsing is wrong

I did some checking and this line seems only parsed during first setup, it's what is creating the initial server.toml
after that the server just reads all values from server.toml which makes users able to change the port in server.toml which would result in a server not being accessable because docker only fordwards the in panel allocated port.
That's why --port as standard parameter is usefull, this will always run with the allocated port from the panel and ignore the port value from the config.

It should be parsed/replaced every startup, so unless the server is super slow and the user replaces it before the server can read the file, it shouldn't be an issue. Regardless, I feel like this could be resolved fairly quickly by just removing the Configuration Files line for replacing the port and simply moving it to the Startup Command like you did (and exporting it from the panel, as required). In most cases for Eggs, I think parameters placed in the Startup Command are preferred over Configuration Files (if the application allows). So, if done right, I think this PR would likely be favorable.

@Oratorian Wy the close, I was waiting on a revieuw but we were going to merge this


To support task display_name

Description
When running models that have names containing multibyte characters, runtime errors occur in Airflow environments where statsd is enabled (e.g., MWAA uses this statsd metric for collecting metrics in Cloudwatch).
Related Issue: https://github.com/apache/airflow/issues/18010
To address this, Airflow 2.9 introduced the ability to render tasks using display_name, which allows task names to be rendered separately from their task_id.
Reference: https://airflow.apache.org/docs/apache-airflow/stable/_modules/airflow/example_dags/example_display_name.html
This PR adds support for display_name, enabling users who use non-ASCII characters as their native language to display task names in their own language, even in environments like MWAA.
Details
The set_task_id_by_node parameter is added to RenderConfig.
This option accepts a function to generate a task ID from a node. This allows users to generate arbitrary task IDs from models. If a function is passed to this option, Cosmos will use the model name as the display_name for tasks while rendering them.
def set_task_id_by_node(node):
    """
    This function takes a node and returns a new task_id.
    """
    if node.name == "ＭＵＬＴＩＢＹＴＥ＿ＭＯＤＥＬ＿ＮＡＭＥ":
        return "MULTIBYTE_MODEL_NAME"

render_config = RenderConfig(
    set_task_id_by_node=set_task_id_by_node
)

Related Issue(s)
closes https://github.com/astronomer/astronomer-cosmos/issues/1277
Breaking Change?

Checklist

[x] I have made corresponding changes to the documentation (if required)
[x] I have added tests that prove my fix is effective or that my feature works

Hi team, ( @tatiana @pankajkoti )
This PR is ready. Could you please review this?

Hi @tatiana @pankajkoti ,
Thank you for the review, and I appreciate your acceptance of this proposal. I have revised the implementation to avoid impacting the core logic as much as possible.
PR Changes

Renamed the added parameter to normalize_task_id.
Modified the code with minimal changes.
Updated the documentation.

Hi @tatiana, @pankajkoti
I am also working on the following PR, and I plan to modify the same generate_task_or_group function in both: https://github.com/astronomer/astronomer-cosmos/pull/1317
Therefore, I’d like to complete this PR first before moving on to the next PR’s changes. If possible, could you please review this PR again? I believe I’ve completed the code adjustments. If there are still any issues, please let me know. Thank you, and I apologize if further modifications are needed.
(Also, I believe that some of the previously failing tests in this PR have now passed thanks to everyone’s improvements. I’m grateful because I wasn’t able to fix it on my own. Thank you.)