Error when evaluating on Kubric dataset

I'm trying to evaluate TAP-Net on the Kubric dataset, and I'm getting the error shown below. I am running the following script: python3 ./tapnet/experiment.py --config=./tapnet/configs/tapnet_config.py --jaxline_mode=eval_kubric   --config.checkpoint_dir=/data3/tap/tap/tapnet_checkpoint/.
Any idea how to fix this? Thanks!
I0228 19:56:23.706737<PHONE_NUMBER>33120 train.py:152] Evaluating with config:
best_model_eval_metric: ''
best_model_eval_metric_higher_is_better: true
checkpoint_dir: /data3/tap//tap/tapnet_checkpoint/
checkpoint_interval_type: null
dataset_names: &id001 !!python/tuple
- kubric
eval_initial_weights: true
eval_modes: &id002 !!python/tuple
- eval_davis_points
- eval_jhmdb
- eval_robotics_points
- eval_kinetics_points
evaluate_every: 10000
experiment_kwargs:
  config:
    checkpoint_dir: /data3/tap//tap/tapnet_checkpoint/
    datasets:
      dataset_names: *id001
      kubric_kwargs:
        batch_dims: 8
        shuffle_buffer_size: 128
        train_size: !!python/tuple
        - 256
        - 256
    davis_points_path: ''
    eval_modes: *id002
    evaluate_every: 10000
    fast_variables: !!python/tuple []
    inference:
      input_video_path: ''
      num_points: 20
      output_video_path: ''
      resize_height: 256
      resize_width: 256
    jhmdb_path: ''
    optimizer:
      adam_kwargs:
        b1: 0.9
        b2: 0.95
        eps: 1.0e-08
      base_lr: 0.002
      cosine_decay_kwargs:
        end_value: 0.0
        init_value: 0.0
        warmup_steps: 5000
      max_norm: -1
      optimizer: adam
      schedule_type: cosine
      weight_decay: 0.01
    robotics_points_path: ''
    save_final_checkpoint_as_npy: true
    shared_modules:
      shared_module_names: &id003 !!python/tuple
      - tapnet_model
      tapnet_model_kwargs: {}
    supervised_point_prediction_kwargs:
      prediction_algo: cost_volume_regressor
    sweep_name: default_sweep
    training:
      n_training_steps: 100000
interval_type: secs
log_all_train_data: false
log_tensors_interval: 60
log_train_data_interval: 120.0
logging_interval_type: null
max_checkpoints_to_keep: 5
one_off_evaluate: false
random_mode_eval: same_host_same_device
random_mode_train: unique_host_unique_device
random_seed: 42
save_checkpoint_interval: 10
shared_module_names: *id003
train_checkpoint_all_hosts: false
training_steps: 100000

I0228 19:56:23.755014<PHONE_NUMBER>33120 xla_bridge.py:173] Remote TPU is not linked into jax; skipping remote TPU.
I0228 19:56:23.755347<PHONE_NUMBER>33120 xla_bridge.py:357] Unable to initialize backend 'tpu_driver': Could not initialize backend 'tpu_driver'
I0228 19:56:24.424445<PHONE_NUMBER>33120 xla_bridge.py:357] Unable to initialize backend 'rocm': NOT_FOUND: Could not find registered platform with name: "rocm". Available platform names are: Interpreter Host CUDA
I0228 19:56:24.425570<PHONE_NUMBER>33120 xla_bridge.py:357] Unable to initialize backend 'tpu': module 'jaxlib.xla_extension' has no attribute 'get_tpu_client'
I0228 19:56:28.558446<PHONE_NUMBER>33120 supervised_point_prediction.py:979] Saving videos to /data3/tap//tap/tapnet_checkpoint/eval_kubric/0
I0228 19:56:28.567507<PHONE_NUMBER>33120 dataset_info.py:565] Load dataset info from /data3/tap/kubric/movi_e/256x256/1.0.0
W0228 19:56:28.572742<PHONE_NUMBER>33120 dtype_utils.py:43] You use TensorFlow DType <dtype: 'uint8'> in tfds.features This will soon be deprecated in favor of NumPy DTypes. In the meantime it was converted to uint8.
W0228 19:56:28.574135<PHONE_NUMBER>33120 dtype_utils.py:43] You use TensorFlow DType <dtype: 'uint16'> in tfds.features This will soon be deprecated in favor of NumPy DTypes. In the meantime it was converted to uint16.
I0228 19:56:28.620231<PHONE_NUMBER>33120 dataset_info.py:654] Fields info.[splits] from disk and from code do not match. Keeping the one from code.
I0228 19:56:28.620935<PHONE_NUMBER>33120 dataset_builder.py:522] Reusing dataset movi_e (/data3/tap/kubric/movi_e/256x256/1.0.0)
W0228 19:56:28.622349<PHONE_NUMBER>33120 feature.py:64] `TensorInfo.dtype` is deprecated. Please change your code to use NumPy with the field `TensorInfo.np_dtype` or use TensorFlow with the field `TensorInfo.tf_dtype`.
W0228 19:56:28.622643<PHONE_NUMBER>33120 dtype_utils.py:43] You use TensorFlow DType <dtype: 'float32'> in tfds.features This will soon be deprecated in favor of NumPy DTypes. In the meantime it was converted to float32.
W0228 19:56:28.622788<PHONE_NUMBER>33120 feature.py:64] `TensorInfo.dtype` is deprecated. Please change your code to use NumPy with the field `TensorInfo.np_dtype` or use TensorFlow with the field `TensorInfo.tf_dtype`.
W0228 19:56:28.622916<PHONE_NUMBER>33120 feature.py:64] `TensorInfo.dtype` is deprecated. Please change your code to use NumPy with the field `TensorInfo.np_dtype` or use TensorFlow with the field `TensorInfo.tf_dtype`.
W0228 19:56:28.623071<PHONE_NUMBER>33120 dtype_utils.py:43] You use TensorFlow DType <dtype: 'int32'> in tfds.features This will soon be deprecated in favor of NumPy DTypes. In the meantime it was converted to int32.
W0228 19:56:28.623173<PHONE_NUMBER>33120 feature.py:64] `TensorInfo.dtype` is deprecated. Please change your code to use NumPy with the field `TensorInfo.np_dtype` or use TensorFlow with the field `TensorInfo.tf_dtype`.
W0228 19:56:28.623292<PHONE_NUMBER>33120 feature.py:64] `TensorInfo.dtype` is deprecated. Please change your code to use NumPy with the field `TensorInfo.np_dtype` or use TensorFlow with the field `TensorInfo.tf_dtype`.
W0228 19:56:28.623408<PHONE_NUMBER>33120 feature.py:64] `TensorInfo.dtype` is deprecated. Please change your code to use NumPy with the field `TensorInfo.np_dtype` or use TensorFlow with the field `TensorInfo.tf_dtype`.
W0228 19:56:28.623907<PHONE_NUMBER>33120 feature.py:64] `TensorInfo.dtype` is deprecated. Please change your code to use NumPy with the field `TensorInfo.np_dtype` or use TensorFlow with the field `TensorInfo.tf_dtype`.
W0228 19:56:28.624111<PHONE_NUMBER>33120 dtype_utils.py:43] You use TensorFlow DType <dtype: 'string'> in tfds.features This will soon be deprecated in favor of NumPy DTypes. In the meantime it was converted to object.
W0228 19:56:28.624262<PHONE_NUMBER>33120 feature.py:64] `TensorInfo.dtype` is deprecated. Please change your code to use NumPy with the field `TensorInfo.np_dtype` or use TensorFlow with the field `TensorInfo.tf_dtype`.
W0228 19:56:28.624418<PHONE_NUMBER>33120 feature.py:64] `TensorInfo.dtype` is deprecated. Please change your code to use NumPy with the field `TensorInfo.np_dtype` or use TensorFlow with the field `TensorInfo.tf_dtype`.
W0228 19:56:28.624617<PHONE_NUMBER>33120 feature.py:64] `TensorInfo.dtype` is deprecated. Please change your code to use NumPy with the field `TensorInfo.np_dtype` or use TensorFlow with the field `TensorInfo.tf_dtype`.
W0228 19:56:28.625051<PHONE_NUMBER>33120 dtype_utils.py:43] You use TensorFlow DType <dtype: 'int64'> in tfds.features This will soon be deprecated in favor of NumPy DTypes. In the meantime it was converted to int64.
W0228 19:56:28.625315<PHONE_NUMBER>33120 dtype_utils.py:43] You use TensorFlow DType <dtype: 'bool'> in tfds.features This will soon be deprecated in favor of NumPy DTypes. In the meantime it was converted to bool.
I0228 19:56:29.712036<PHONE_NUMBER>33120 logging_logger.py:49] Constructing tf.data.Dataset movi_e for split None, from /data3/tap/kubric/movi_e/256x256/1.0.0
W0228 19:56:32.420510<PHONE_NUMBER>33120 deprecation.py:337] From /data/anaconda3/envs/tapnet/lib/python3.8/site-packages/tensorflow/python/util/dispatch.py:1082: multinomial (from tensorflow.python.ops.random_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.random.categorical` instead.
W0228 19:56:39.477390<PHONE_NUMBER>33120 deprecation.py:541] From /data/anaconda3/envs/tapnet/lib/python3.8/site-packages/tensorflow/python/util/dispatch.py:1082: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version.
Instructions for updating:
box_ind is deprecated, use box_indices instead
2023-02-28 19:56:44.292071: E tensorflow/core/grappler/optimizers/meta_optimizer.cc:828] shape_optimizer failed: INVALID_ARGUMENT: Subshape must have computed start >= end since stride is negative, but is 1 and 3 (computed from start 1 and end<PHONE_NUMBER>854775807 over shape with rank 3 and stride-1)
2023-02-28 19:56:45.191140: E tensorflow/core/grappler/optimizers/meta_optimizer.cc:828] shape_optimizer failed: INVALID_ARGUMENT: Subshape must have computed start >= end since stride is negative, but is 1 and 3 (computed from start 1 and end<PHONE_NUMBER>854775807 over shape with rank 3 and stride-1)
Traceback (most recent call last):
  File "./tapnet/experiment.py", line 429, in <module>
    app.run(main)
  File "/home/ubuntu/.local/lib/python3.8/site-packages/absl/app.py", line 308, in run
    _run_main(main, args)
  File "/home/ubuntu/.local/lib/python3.8/site-packages/absl/app.py", line 254, in _run_main
    sys.exit(main(argv))
  File "./tapnet/experiment.py", line 421, in main
    platform.main(
  File "/data/anaconda3/envs/tapnet/lib/python3.8/site-packages/jaxline/utils.py", line 484, in inner_wrapper
    return f(*args, **kwargs)
  File "/data/anaconda3/envs/tapnet/lib/python3.8/site-packages/jaxline/platform.py", line 137, in main
    train.evaluate(experiment_class, config, checkpointer, writer,
  File "/data/anaconda3/envs/tapnet/lib/python3.8/site-packages/jaxline/utils.py", line 620, in inner_wrapper
    return fn(*args, **kwargs)
  File "/data/anaconda3/envs/tapnet/lib/python3.8/site-packages/jaxline/train.py", line 225, in evaluate
    scalar_values = utils.evaluate_should_return_dict(experiment.evaluate)(
  File "/data/anaconda3/envs/tapnet/lib/python3.8/site-packages/jaxline/utils.py", line 521, in evaluate_with_warning
    evaluate_out = f(*args, **kwargs)
  File "./tapnet/experiment.py", line 404, in evaluate
    eval_scalars = point_prediction_task.evaluate(
  File "/home/ubuntu/contractive/tapnet/supervised_point_prediction.py", line 514, in evaluate
    self._eval_epoch(
  File "/home/ubuntu/contractive/tapnet/supervised_point_prediction.py", line 1005, in _eval_epoch
    scalars, viz = eval_batch_fn(params, state, inputs, rng)
  File "/home/ubuntu/contractive/tapnet/supervised_point_prediction.py", line 766, in _eval_batch
    occlusion_logits, tracks, loss_scalars = self._infer_batch(
  File "/home/ubuntu/contractive/tapnet/supervised_point_prediction.py", line 577, in _infer_batch
    output, _ = functools.partial(
  File "/data/anaconda3/envs/tapnet/lib/python3.8/site-packages/haiku/_src/transform.py", line 357, in apply_fn
    out = f(*args, **kwargs)
  File "./tapnet/experiment.py", line 122, in forward
    return self.point_prediction.forward_fn(
  File "/home/ubuntu/contractive/tapnet/supervised_point_prediction.py", line 313, in forward_fn
    return shared_modules['tapnet_model'](
  File "/data/anaconda3/envs/tapnet/lib/python3.8/site-packages/haiku/_src/module.py", line 426, in wrapped
    out = f(*args, **kwargs)
  File "/data/anaconda3/envs/tapnet/lib/python3.8/contextlib.py", line 75, in inner
    return func(*args, **kwds)
  File "/data/anaconda3/envs/tapnet/lib/python3.8/site-packages/haiku/_src/module.py", line 272, in run_interceptors
    return bound_method(*args, **kwargs)
  File "/home/ubuntu/contractive/tapnet/tapnet_model.py", line 341, in __call__
    latent = self.tsm_resnet(
  File "/data/anaconda3/envs/tapnet/lib/python3.8/site-packages/haiku/_src/module.py", line 426, in wrapped
    out = f(*args, **kwargs)
  File "/data/anaconda3/envs/tapnet/lib/python3.8/contextlib.py", line 75, in inner
    return func(*args, **kwds)
  File "/data/anaconda3/envs/tapnet/lib/python3.8/site-packages/haiku/_src/module.py", line 272, in run_interceptors
    return bound_method(*args, **kwargs)
  File "/home/ubuntu/contractive/tapnet/models/tsm_resnet.py", line 383, in __call__
    net = hk.Conv2D(
  File "/data/anaconda3/envs/tapnet/lib/python3.8/site-packages/haiku/_src/module.py", line 426, in wrapped
    out = f(*args, **kwargs)
  File "/data/anaconda3/envs/tapnet/lib/python3.8/contextlib.py", line 75, in inner
    return func(*args, **kwds)
  File "/data/anaconda3/envs/tapnet/lib/python3.8/site-packages/haiku/_src/module.py", line 272, in run_interceptors
    return bound_method(*args, **kwargs)
  File "/data/anaconda3/envs/tapnet/lib/python3.8/site-packages/haiku/_src/conv.py", line 200, in __call__
    w = hk.get_parameter("w", w_shape, inputs.dtype, init=w_init)
  File "/data/anaconda3/envs/tapnet/lib/python3.8/site-packages/haiku/_src/base.py", line 448, in wrapped
    return wrapped._current(*args, **kwargs)
  File "/data/anaconda3/envs/tapnet/lib/python3.8/site-packages/haiku/_src/base.py", line 524, in get_parameter
    raise ValueError(
ValueError: Unable to retrieve parameter 'w' for module 'tap_net/~/tsm_resnet_video/tsm_resnet_stem' All parameters must be created as part of `init`.

Could you verify if /data3/tap/tap/tapnet_checkpoint/checkpoint.npy exists?

Yes, the path was wrong. Thanks for catching that!


support hyperdrive 0.5.1

updates time stretch to use correct formula

this PR also addresses the final task in https://github.com/delvtech/agent0/issues/1230


Easy to click preview mode when slide.

Could you fix to run preview mode when I only click not swipe ?
I just tried sliding to see next slide of pictures, but preview is also running.

Also, slide should be only horizontal not vertical.
in terms of mobile, scroll is not working when I touched to scroll down on ngx-gallery.

Hi @junimohano, are you swiping main image or maybe thumbnails? You are right about second comment, could you create separate ticket for that?

okay i will make it

Can you check again for first comment ?
When you swipe, it runs both preview and slide if mouse is up inside of picture,

Hi @junimohano swipe is working fine on touch devices. Do you really need swipe on desktop (using mouse)?

um... then, forget about it...
im gonna use for awhile and then let you know again
thank you


Discord Server Invite Expired

Hello, is their a discord server? The invite on the website is expired and does not work.

Join here https://discord.gg/2gPy75zgbW
Updated the invite! Thanks


[Bloc] Horizontal linear layout does not ignore "gone" children during layout

In the following example both red and blue elements match parent. On click we change visibility of the red rectangle to "gone". We expect the blue rectangle to occupy the rest of the space, however, it stays at the previous position:


Litra Beam: brightness range not properly mapped

Hi,
First of all: the package is really cool!
Here's an issue I'm facing: using Logitech's own G Hub software, I can get my Litra Bream to shine much brighter than when I'm using this package's CLI. While I can control the brightness of my Litra Beam with both litra-brightness and litra-brightness-lm, in both cases the maximum supported number does not correspond to the maximum brightness of the device.
It seems that the maximum brightness value is not mapped properly.
My setup:

Litra Beam
MacBook Air M1 2020 with macOS 13.2.1 (22D68)
npm view litra version -> 4.4.0

Please let me know which other information I could provide to help debug this.

Very interesting! I don't have a Beam, so it's a bit hard for me to test.

Thanks for the swift response!
I've been debugging a little this afternoon, but I'm a noob when it comes to USB and I haven't coded much for years. However, I believe I found the reason: the bug seems to be that in setBrightnessInLumen the integerToBytes conversion is missing (which you have for the color temperature). With the Beam, the lumen range exceeds 255 and so you get an overflow. I changed the code in the JS file locally and it works!
But given that I'm a noob I don't feel like opening a PR …

@bernhardvogler Thanks again for looking into this and figuring out the issue. Would you be able to give my code change in #135 a try?

I can confirm that after fetching the branch and checking out timrogers/fix-132 running node litra-brightness-lm.js 400 in dist/commonjs/cli works as expected. Also, the percentage-based brightness settings are now working. 🎉
Thanks a lot for maintaining the library!


Fix for symlinks bug

Description
Update to CEWorkspaceFile and CEWorkspaceFileManager to support symlinks. It separates the id from the url on CEWorkspace file so there can be different files pointing to the same file url, similar to how Visual Studio Code handles symlinks.
Related Issues
closes #1839
Checklist

[x] I read and understood the contributing guide as well as the code of conduct
[x] The issues this PR addresses are related to each other
[x] My changes generate no new warnings
[x] My code builds and runs on my machine
[x] My changes are all related to the related issue above
[x] I documented my code

Screenshots

This fixes #1839, correct?

Where are we with this? Are we close?

@austincondiff I've updated the PR so it ready for another round of reviews


Error stack trace should not include Zod internals

Currently the stack trace includes Zod internals like this:
ZodError: event.data.new.title: Invalid input: expected string, received undefined
-    at new ZodError (/Users/b/c/infra/node_modules/zod/lib/src/ZodError.js:36:28)
-    at ZodObject.parse (/Users/b/c/infra/node_modules/zod/lib/src/parser.js:142:17)
    at exports.handler (webpack-internal:///./functions/hasura/eventCreated.ts:41:39)
    at InProcessRunner.run (/Users/b/c/infra/node_modules/serverless-offline/dist/lambda/handler-runner/in-process-runner/InProcessRunner.js:100:16)
    at processTicksAndRejections (internal/process/task_queues.js:97:5)
    at async process.<anonymous> (/Users/b/c/infra/node_modules/serverless-offline/dist/lambda/handler-runner/child-process-runner/childProcessHelper.js:39:14)
}

But what I want is this:
ZodError: event.data.new.title: Invalid input: expected string, received undefined
    at exports.handler (webpack-internal:///./functions/hasura/eventCreated.ts:41:39)
    at InProcessRunner.run (/Users/b/c/infra/node_modules/serverless-offline/dist/lambda/handler-runner/in-process-runner/InProcessRunner.js:100:16)
    at processTicksAndRejections (internal/process/task_queues.js:97:5)
    at async process.<anonymous> (/Users/b/c/infra/node_modules/serverless-offline/dist/lambda/handler-runner/child-process-runner/childProcessHelper.js:39:14)
}

Version
zod: 1.9.0

Open to a PR for this. TBH I don't know how to do this.


Cluster creation hangs if oidc_issuer_enabled=true

Is there an existing issue for this?

[X] I have searched the existing issues

Greenfield/Brownfield provisioning
greenfield
Terraform Version
1.5.0.
Module Version
6.8.0
AzureRM Provider Version
3.61
Affected Resource(s)/Data Source(s)
azurerm_kubernetes_cluster
Terraform Configuration Files
oidc_issuer_enabled                   = true

tfvars variables values
na

Debug Output/Panic Output
No panic other than timeout

Expected Behaviour
Creation of cluster
Actual Behaviour
The creation phase times out
Steps to Reproduce
terraform apply
As a workaround I can leave these options as false on create then change to true and the deployment is correct
Important Factoids
No response
References
No response

@ryanfaircloth I am not able to reproduce the problem. It worked for me:
% terraform version
Terraform v1.5.0
on darwin_arm64
+ provider registry.terraform.io/hashicorp/azurerm v3.61.0
+ provider registry.terraform.io/hashicorp/tls v4.0.4

This is how I use the module:
module "aks" {
  source                            = "Azure/aks/azurerm"
  version                           = "6.8.0"
  oidc_issuer_enabled                   = true

  resource_group_name               = azurerm_resource_group.this.name
  kubernetes_version                = var.kubernetes_version
  orchestrator_version              = var.kubernetes_version
  prefix                            = "istio"
  network_plugin                    = "azure"
  vnet_subnet_id                    = module.network.vnet_subnets[0]
  os_disk_size_gb                   = 50
  sku_tier                          = "Standard"
  role_based_access_control_enabled = true
  rbac_aad                          = false
  private_cluster_enabled           = false
  http_application_routing_enabled  = false
  enable_auto_scaling               = true
  enable_host_encryption            = false
  log_analytics_workspace_enabled   = false
  agents_min_count                  = 1
  agents_max_count                  = 5
  agents_count                      = null # Please set `agents_count` `null` while `enable_auto_scaling` is `true` to avoid possible `agents_count` changes.
  agents_max_pods                   = 100
  agents_pool_name                  = "system"
  agents_availability_zones         = ["1", "2"]
  agents_type                       = "VirtualMachineScaleSets"
  agents_size                       = var.agents_size

  agents_labels = {
    "nodepool" : "defaultnodepool"
  }

  agents_tags = {
    "Agent" : "defaultnodepoolagent"
  }

  ingress_application_gateway_enabled = false

  network_policy                 = "azure"
  net_profile_dns_service_ip     = "<IP_ADDRESS>"
  net_profile_docker_bridge_cidr = "<IP_ADDRESS>/16"
  net_profile_service_cidr       = "<IP_ADDRESS>/16"

  key_vault_secrets_provider_enabled = true
  secret_rotation_enabled            = true
  secret_rotation_interval           = "3m"

  depends_on = [module.network]
}

This is my plan:
  # module.aks.azurerm_kubernetes_cluster.main will be created
  + resource "azurerm_kubernetes_cluster" "main" {
      + api_server_authorized_ip_ranges     = (known after apply)
      + azure_policy_enabled                = false
      + dns_prefix                          = "istio"
      + fqdn                                = (known after apply)
      + http_application_routing_enabled    = false
      + http_application_routing_zone_name  = (known after apply)
      + id                                  = (known after apply)
      + image_cleaner_enabled               = false
      + image_cleaner_interval_hours        = 48
      + kube_admin_config                   = (sensitive value)
      + kube_admin_config_raw               = (sensitive value)
      + kube_config                         = (sensitive value)
      + kube_config_raw                     = (sensitive value)
      + kubernetes_version                  = (known after apply)
      + location                            = (known after apply)
      + name                                = "istio-aks"
      + node_resource_group                 = (known after apply)
      + node_resource_group_id              = (known after apply)
      + oidc_issuer_enabled                 = true
      + oidc_issuer_url                     = (known after apply)
      + portal_fqdn                         = (known after apply)
      + private_cluster_enabled             = false
      + private_cluster_public_fqdn_enabled = false
      + private_dns_zone_id                 = (known after apply)
      + private_fqdn                        = (known after apply)
      + public_network_access_enabled       = true
      + resource_group_name                 = "istio-aks"
      + role_based_access_control_enabled   = true
      + run_command_enabled                 = true
      + sku_tier                            = "Standard"
      + workload_identity_enabled           = false

      + default_node_pool {
          + enable_auto_scaling    = true
          + enable_host_encryption = false
          + enable_node_public_ip  = false
          + kubelet_disk_type      = (known after apply)
          + max_count              = 5
          + max_pods               = 100
          + min_count              = 1
          + name                   = "system"
          + node_count             = (known after apply)
          + node_labels            = {
              + "nodepool" = "defaultnodepool"
            }
          + orchestrator_version   = (known after apply)
          + os_disk_size_gb        = 50
          + os_disk_type           = "Managed"
          + os_sku                 = (known after apply)
          + scale_down_mode        = "Delete"
          + tags                   = {
              + "Agent" = "defaultnodepoolagent"
            }
          + type                   = "VirtualMachineScaleSets"
          + ultra_ssd_enabled      = false
          + vm_size                = "Standard_D2s_v3"
          + vnet_subnet_id         = (known after apply)
          + workload_runtime       = (known after apply)
          + zones                  = [
              + "1",
              + "2",
            ]
        }

      + identity {
          + principal_id = (known after apply)
          + tenant_id    = (known after apply)
          + type         = "SystemAssigned"
        }

      + key_vault_secrets_provider {
          + secret_identity          = (known after apply)
          + secret_rotation_enabled  = true
          + secret_rotation_interval = "3m"
        }

      + network_profile {
          + dns_service_ip     = "<IP_ADDRESS>"
          + docker_bridge_cidr = "<IP_ADDRESS>/16"
          + ip_versions        = (known after apply)
          + load_balancer_sku  = "standard"
          + network_mode       = (known after apply)
          + network_plugin     = "azure"
          + network_policy     = "azure"
          + outbound_type      = "loadBalancer"
          + pod_cidr           = (known after apply)
          + pod_cidrs          = (known after apply)
          + service_cidr       = "<IP_ADDRESS>/16"
          + service_cidrs      = (known after apply)
        }
    }

I need you to provide the complete module configuration to reproduce the problem, like this:
module "aks" {
  source                            = "Azure/aks/azurerm"
  version                           = "6.8.0"
  oidc_issuer_enabled                   = true
[...ADD ALL THE PARAMETERS..]
}

Thank you

Full module config is here
https://github.com/logscale-contrib/teraform-azure-aks-cluster/blob/main/main.tf
resource_group = "logsrlife-events-prod"
cluster_name   = "logsrlife-events-prod"
location       = "EastUS"
admins_group_id = "8df18126-81a9-4cc6-b18f-23f2941e81de"
vault_id       = "/subscriptions/1b0f918f-3c13-43ad-b400-436773701221/resourceGroups/logsrlife-events-prod/providers/Microsoft.KeyVault/vaults/logsrlife-events-prod"

subnet_id    = "/subscriptions/1b0f918f-3c13-43ad-b400-436773701221/resourceGroups/logsrlife-events-prod/providers/Microsoft.Network/virtualNetworks/vnet/subnets/k8s"
subnet_id_ag = "/subscriptions/1b0f918f-3c13-43ad-b400-436773701221/resourceGroups/logsrlife-events-prod/providers/Microsoft.Network/virtualNetworks/vnet/subnets/ag"

agent_size         = "Standard_B2s"
agent_max          = 3

tags = { test = "true" }

registry_id = "/subscriptions/1b0f918f-3c13-43ad-b400-436773701221/resourceGroups/logsrlife-events-prod/providers/Microsoft.ContainerRegistry/registries/logsrlifeeventsprod"

workload_identity_enabled = true
ingress_application_gateway_enabled = true

Plan that hangs

  # module.aks_cluster_name.azurerm_kubernetes_cluster.main will be created
  + resource "azurerm_kubernetes_cluster" "main" {
      + api_server_authorized_ip_ranges     = (known after apply)
      + automatic_channel_upgrade           = "patch"
      + azure_policy_enabled                = true
      + disk_encryption_set_id              = "/subscriptions/1b0f918f-3c13-43ad-b400-436773701221/resourceGroups/logsrlife-events-prod/providers/Microsoft.Compute/diskEncryptionSets/des"
      + dns_prefix                          = "cwd"
      + fqdn                                = (known after apply)
      + http_application_routing_enabled    = false
      + http_application_routing_zone_name  = (known after apply)
      + id                                  = (known after apply)
      + image_cleaner_enabled               = false
      + image_cleaner_interval_hours        = 48
      + kube_admin_config                   = (sensitive value)
      + kube_admin_config_raw               = (sensitive value)
      + kube_config                         = (sensitive value)
      + kube_config_raw                     = (sensitive value)
      + kubernetes_version                  = "1.26"
      + local_account_disabled              = false
      + location                            = "eastus"
      + name                                = "logsrlife-events-prod"
      + node_resource_group                 = (known after apply)
      + node_resource_group_id              = (known after apply)
      + oidc_issuer_enabled                 = true
      + oidc_issuer_url                     = (known after apply)
      + portal_fqdn                         = (known after apply)
      + private_cluster_enabled             = false
      + private_cluster_public_fqdn_enabled = false
      + private_dns_zone_id                 = (known after apply)
      + private_fqdn                        = (known after apply)
      + public_network_access_enabled       = false
      + resource_group_name                 = "logsrlife-events-prod"
      + role_based_access_control_enabled   = true
      + run_command_enabled                 = true
      + sku_tier                            = "Free"
      + workload_identity_enabled           = true

      + azure_active_directory_role_based_access_control {
          + admin_group_object_ids = [
              + "8df18126-81a9-4cc6-b18f-23f2941e81de",
            ]
          + managed                = true
          + tenant_id              = (known after apply)
        }

      + default_node_pool {
          + enable_auto_scaling    = true
          + enable_host_encryption = false
          + enable_node_public_ip  = false
          + kubelet_disk_type      = (known after apply)
          + max_count              = 3
          + max_pods               = 100
          + min_count              = 1
          + name                   = "system"
          + node_count             = (known after apply)
          + node_labels            = (known after apply)
          + orchestrator_version   = (known after apply)
          + os_disk_size_gb        = 30
          + os_disk_type           = "Managed"
          + os_sku                 = (known after apply)
          + scale_down_mode        = "Delete"
          + tags                   = {
              + "Environment"   = "production"
              + "GitRepository" = "https://github.com/logsrlife/terragrunt-it-infra.git"
              + "Project"       = "infra"
              + "Role"          = "tenants"
            }
          + type                   = "VirtualMachineScaleSets"
          + ultra_ssd_enabled      = false
          + vm_size                = "Standard_B2s"
          + workload_runtime       = (known after apply)
          + zones                  = [
              + "1",
              + "2",
              + "3",
            ]
        }

      + identity {
          + identity_ids = [
              + "/subscriptions/1b0f918f-3c13-43ad-b400-436773701221/resourceGroups/logsrlife-events-prod/providers/Microsoft.ManagedIdentity/userAssignedIdentities/logsrlife-events-prod-identity",
            ]
          + principal_id = (known after apply)
          + tenant_id    = (known after apply)
          + type         = "UserAssigned"
        }

      + ingress_application_gateway {
          + effective_gateway_id                 = (known after apply)
          + gateway_name                         = "cwd-agw"
          + ingress_application_gateway_identity = (known after apply)
          + subnet_id                            = "/subscriptions/1b0f918f-3c13-43ad-b400-436773701221/resourceGroups/logsrlife-events-prod/providers/Microsoft.Network/virtualNetworks/vnet/subnets/ag"
        }

      + key_management_service {
          + key_vault_key_id         = "https://logsrlife-events-prodv.vault.azure.net/keys/etcdenc/2902b53310bc405dab1c7a84f2d2727a"
          + key_vault_network_access = "Private"
        }

      + maintenance_window {
          + allowed {
              + day   = "Sunday"
              + hours = [
                  + 22,
                  + 23,
                ]
            }
        }

      + network_profile {
          + dns_service_ip     = (known after apply)
          + docker_bridge_cidr = (known after apply)
          + ip_versions        = (known after apply)
          + load_balancer_sku  = "standard"
          + network_mode       = (known after apply)
          + network_plugin     = "azure"
          + network_policy     = "azure"
          + outbound_type      = "loadBalancer"
          + pod_cidr           = (known after apply)
          + pod_cidrs          = (known after apply)
          + service_cidr       = (known after apply)
          + service_cidrs      = (known after apply)
        }
    }

Confirmed this is not a issue in the module. The vnet i was using has a vault in the instance where I was using OIDC additional vault level authorization is required


Reduce docker image size from 1.1G to 321MB

The slim image does not loose any meaningful functionality, and this may make the image way faster to push/pull on low bandwidth scenarios.
Also, pip does not require cache for a docker image, that save a couple of extra MB.

Thanks for the PR. Everything seems fine


Release notes for version 4.1

Push the release notes for the version 4.1
Current work on it : https://hackmd.io/CzSvxiluSaK9CHHLNWvIgQ

@ykafia I can provide you with some images for the release notes. I will add the images in the hackmd file, but the actual images will have to be donwloaded to the specific local folder, once the release notes are added to the site. Is it okay if I post them here?

Yes sure!

I fixed a bunch of typos, reworded a couple of sentences and left comments on the hack.md document

Thanks a bunch, i will working on it today hopefully

Yes, I should have a bit more time to work on the two clauses I added at the end of the document

Should we included the amount that people have donated?
I made a csv export and organised the relevant data. Added some base text for the (financial) contributors. https://docs.google.com/spreadsheets/d/1fxsZqYBJUuSZ8lH05FjcHzx-8saIs_NBW77azKEnb_g/edit?usp=sharing

Could be a great idea to add this info on the call for action section, something like a "thank you" note and a reminder that this money is here for contributors.

updated the release notes slightly, with the call to arms. Eideren had a good argument regarding 'what is strider' (ergo removing this section).  How about the listing of the Github contributors?

Removed the aforementioned section, rewrote a couple of sentences. Where do we want to go from there ? Write sections for the major features / changes ? Tutorial needs one I think but what about the rest ?

Added some more details, screenshots and videos underneath the summary.

This is a checklist from another version of the above document..
Existing Pages need to be updated?

[ ] Manual - Requirements

Update IDE to VS 2022
Update Run games made with Stride section?

[ ] Manual - Install Stride

New screenshots?
No need .NET 4.7.2?

[ ] Manual - Launch Stride
[ ] Manual - Visual Studio extension
[ ] Stride Web - Home Page

Mention C# 10, .NET 6 (web search / SEO purpose)

[ ] Manual - Features Page

Mention C# 10, .NET 6 (web search / SEO purpose)

Added latest version to doc and website repo


Granting Dex permissions not present when deploying Epinio v.1.7.1 in Rancher Dashboard (Possible regression)

Issue
We have 2 failures (link) on the Epinio-Rancher e2e tests because the screen granting permission for Dex is missing since 04/08/23):
Check Dex login works with granted access
Check Dex deny access
Tests are done in Rancher 2.7.1 installing latest epinio chart 1.7.1. Same happens in 2.7.2

This ticket is first to clarify if this is expected behavior or a possible regression

Confirmed it is not a bug but a feature from Dex. It was detected in Rancher earlier than in STD UI because in STD we needed an update in submodules that were not present then.
Adapting UI tests accordingly here: https://github.com/epinio/epinio-end-to-end-tests/pull/318
Removing bug filter
Changing the title reflecting it is not a regression.


Feature/mktmpdir

This is simply a rebase of #2911 to current master (03-01-2017)

👍

@bramswenson do you want to make the changes? because if I would require access to your fork/branch.

@marceloboeira @RX14 Done! Thanks!

@bramswenson great!

@bramswenson Thank you for this!
In general the PR looks very good. However:

I'm not sure about adding Dir.rm_r. In general we have simple methods in File and Dir, and more complex methods in FileUtils. FileUtils has methods that you can find in bash, like rm_r or mkdir_p.
I'm also not sure about Dir.tmpdir, but I think it's OK (similar to Ruby, related to Dir and not Tempfile), but this is a small breaking change and we should note it.

I'm all the time unsure about File, Dir, FileUtils and where to put things. Maybe things are too complex/messy right now. I'll discuss this with the team, maybe we can just put all methods in File and Dir and remove FileUtils.

For now we can merge your change if it doesn't introduce breaking changes (Use Tmpfile.dirname instead of Dir.tmpdir and keeps FileUtils.rm_r instead of Dir.rm_r)). That's at least if we want this included in the next patch release.

@asterite Thanks for the kind words, but I did nothing but the rebase to master out of selfish desire to use this feature ;) @marceloboeira Did the actual work and there was reasonable discussion about the move between Dir and FileUtils in #2911 between @marceloboeira and @RX14. I really don't have a dog in that fight and will be happy to see the feature wherever you all decide is most appropriate. Thanks!

I will say that the removal of FileUtils in preference for File and Dir makes sense to me. I also think these methods should closely resemble their unix counterparts in naming as unix file modification executable names are common knowledge (or should be). But that is just my 2 cents.

I didn't have time to take a look at the comments yet folks, but I will do it soon. @bramswenson thanks for the invitation to your repository and the efforts on making it happen. 👍

I was about to (suggest to) add this!
@bramswenson, will you work on this anytime soon ? (I'd really like something like that to refactor some compiler specs)
About naming I was thinking, since we already have the Tempfile class, we could have Tempdir ?
And put the two in a Temporary module with a simple API like:
Temporary::File.new # gives a file
Temporary::Dir.new # gives a dir

Temporary::Dir.open do |dir|
  # do something with the `dir`
  puts dir.path
end # the block ensures that the temp dir is deleted

Temporary.create_name("foo.XXX") # gives a (file/dir)name following a pattern
# etc..

I think we shouldn't have "tempdir" and "tempfile" classes, just methods on Dir and File which create tempoary versions of themselves.

Why does Tempfile currently not inherit File? It makes little sense to me.

I thought the same, I'll fix that.

@RX14 any updates here?

@marceloboeira Tempfile was removed in #6485. We still need to decide what to do about FileUtils, I say that most of it's methods belong on Path once that is merged.

Too old, I think should be closed now. A new PR can be opened if wanted.
As now, to create a temp dir:
dir = File.tempname
Dir.mkdir dir
begin
  # do things
ensure
  FileUtils.rm_rf dir
end

Too old, I think should be closed now. A new PR can be opened if wanted.
As now, to create a temp dir:
dir = File.tempname
Dir.mkdir dir
begin
  # do things
ensure
  FileUtils.rm_rf dir
end


Open ai code generation and serialization failing using ruby

OPENAPI: openai links
Method: Post /chat/completions
device: mac m1
language: Ruby
versions: microsoft_kiota_abstractions-0.14.0, microsoft_kiota_authentication_oauth-0.6.0, microsoft_kiota_faraday-0.10.0, microsoft_kiota_serialization_json-0.9.0, microsoft_kiota_authentication_oauth-0.8.0
I want to run a openai, /chat/completions, code seem to generate with a little mistake which i tried to ignore (I do not think is this part relevant)
gen file : create_chat_completion_request.rb

                def self.create_from_discriminator_value(parse_node)
                    raise StandardError, 'parse_node cannot be null' if parse_node.nil?
                    mapping_value_node = parse_node.get_child_node("")
                    unless mapping_value_node.nil? then
                        mapping_value = mapping_value_node.get_string_value
                        case mapping_value
                        end
                    end
                    return Completions.new
                end

by just using StringCompletion.new as return of case for else and 'string'.
after that it got error serializing temperature
on this line
microsoft_kiota_serialization_json-0.9.0/lib/microsoft_kiota_serialization_json/json_serialization_writer.rb:169:in write_object_value': undefined method serialize' for 0.5:Float (NoMethodError)
after a little debug it try to serialize
float value
running code
require 'microsoft_kiota_abstractions'
require 'microsoft_kiota_serialization_json'
require 'microsoft_kiota_authentication_oauth'
require 'microsoft_kiota_faraday'

require_relative './api_chat'

BearerKey = 'sk-<your secret key>'

# ApiKeyAuthenticationProvider
auth_provider = MicrosoftKiotaAbstractions::BaseBearerTokenAuthenticationProvider.new(BearerKey)

request_adapter = MicrosoftKiotaFaraday::FaradayRequestAdapter.new(auth_provider,
                                                                   MicrosoftKiotaSerializationJson::JsonParseNodeFactory.new,
                                                                   MicrosoftKiotaSerializationJson::JsonSerializationWriterFactory.new)

gpt = ApiSdk::ApiChat.new(request_adapter)

chat_params = ApiSdk::Models::CreateChatCompletionRequest.new
chat_params.model = 'gpt-3.5-turbo'
chat_params.max_tokens = 50
chat_params.temperature = 0.5 # this value got error for serialization

message = ApiSdk::Models::ChatCompletionRequestMessage.new
message.content = "Why Hinton is called the father of deep learning?"
message.role = ApiSdk::Models::ChatCompletionRequestMessageRole[:User]

chat_params.messages = [message]

chat = gpt.chat.completions.post(chat_params)

print(chat.choices[0].text)

tnx for response
@baywet @mtodd

Thanks for reporting this.
This is caused because Ruby generation is still experimental and doesn't implement composed type serialization which open ai API description uses a lot.
This work is tracked by #1816 however we don't currently have a developer working on Ruby so contributions are welcome.

I guess you could try to get around it by poking the models and manually implementing the correct serialization. I suggest you generate a client for the same API in a language you're familiar with which supports composed types (go/java/c#) and compare.


Migration from 1.X to 2.0.1 is failing with helm chart (0.8.4 -> 0.8.8)

How to reproduce the bug

Install superset helm chart superset-0.8.4  (version 1.X of superset by default)
Upgrade to superset helm chart superset-0.8.8 (version 2.X of superset by default)

helm upgrade --install --values superset-values.yaml  superset     superset/superset --wait

Expected results
Upgrade and DB migration sre working fine and the application is usable.
Actual results
The application is not usable, all dashboards are broken. This is the error I get in the worker:
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/util/compat.py", line 182, in raise_
    raise exception
  File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context
    self.dialect.do_execute(
  File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute
    cursor.execute(statement, parameters)
sqlalchemy.exc.ProgrammingError: (psycopg2.errors.UndefinedColumn) column dbs.allow_multi_schema_metadata_fetch does not exist
LINE 1: ..., dbs.force_ctas_schema AS dbs_force_ctas_schema, dbs.allow_...
                                                             ^
[SQL: SELECT dbs.uuid AS dbs_uuid, dbs.created_on AS dbs_created_on, dbs.changed_on AS dbs_changed_on, dbs.id AS dbs_id, dbs.verbose_name AS dbs_verbose_name, dbs.database_name AS dbs_database_name, dbs.sqlalchemy_uri AS dbs_sqlalchemy_uri, dbs.password AS dbs_password, dbs.cache_timeout AS dbs_cache_timeout, dbs.select_as_create_table_as AS dbs_select_as_create_table_as, dbs.expose_in_sqllab AS dbs_expose_in_sqllab, dbs.configuration_method AS dbs_configuration_method, dbs.allow_run_async AS dbs_allow_run_async, dbs.allow_file_upload AS dbs_allow_file_upload, dbs.allow_ctas AS dbs_allow_ctas, dbs.allow_cvas AS dbs_allow_cvas, dbs.allow_dml AS dbs_allow_dml, dbs.force_ctas_schema AS dbs_force_ctas_schema, dbs.allow_multi_schema_metadata_fetch AS dbs_allow_multi_schema_metadata_fetch, dbs.extra AS dbs_extra, dbs.encrypted_extra AS dbs_encrypted_extra, dbs.impersonate_user AS dbs_impersonate_user, dbs.server_cert AS dbs_server_cert, dbs.is_managed_externally AS dbs_is_managed_externally, dbs.external_url AS dbs_external_url, dbs.created_by_fk AS dbs_created_by_fk, dbs.changed_by_fk AS dbs_changed_by_fk
FROM dbs
WHERE dbs.id = %(param_1)s]
[parameters: {'param_1': 1}]
(Background on this error at: http://sqlalche.me/e/13/f405)

Screenshots
Several 500 error code here and there.
Environment

EKS/Kubernetes
browser type and version: 'Edge 111.0.1661.44'
superset version: 2.0.1
python version: 3.8.12
helm chart version: 0.8.8
node.js version: not found
I just set the superset password in values.yaml, nothig else.
OIDC is setup with keycloak
any feature flags active: FEATURE_FLAGS = { "ENABLE_TEMPLATE_PROCESSING": True, "EMBEDDED_SUPERSET": True, "ALLOW_FULL_CSV_EXPORT": True, "DASHBOARD_CROSS_FILTERS": True, "DASHBOARD_FILTERS_EXPERIMENTAL": True }

Checklist
Make sure to follow these steps before submitting your issue - thank you!

[x] I have checked the superset logs for python stacktraces and included it here as text if there are any.
[x] I have reproduced the issue with at least the latest released version of superset.
[x] I have checked the issue tracker for the same issue and I haven't found one similar.

Additional context
Same issue on SOF: https://stackoverflow.com/questions/74519670/error-while-upgrading-superset-to-2-0-0-psycopg2-errors-undefinedcolumn
At first I thought it was the same as https://github.com/apache/superset/issues/19100 but no the error is not the same, in my case it's the column dbs.allow_multi_schema_metadata_fetch does not exist. So I looked at the migration script adding it and simply run this in postgreSQL:
ALTER TABLE dbs ADD COLUMN allow_multi_schema_metadata_fetch boolean DEFAULT true;
So now at least the application is usable. But the superset-init-db pod keeps restarting (it's on the same image apache/superset:2.0.1). There are no errors at all, just few warnings:
Requirement already satisfied: psycopg2-binary==2.9.1 in /usr/local/lib/python3.8/site-packages (2.9.1)
Requirement already satisfied: redis==3.5.3 in /usr/local/lib/python3.8/site-packages (3.5.3)
Collecting flask-oidc==1.4.0
  Downloading flask-oidc-1.4.0.tar.gz (30 kB)
Collecting itsdangerous==2.0.1
  Downloading itsdangerous-2.0.1-py3-none-any.whl (18 kB)
Collecting Flask-OpenID==1.3.0
  Downloading Flask_OpenID-1.3.0-py3-none-any.whl (9.3 kB)
Requirement already satisfied: Flask in /usr/local/lib/python3.8/site-packages (from flask-oidc==1.4.0) (2.0.3)
Collecting oauth2client
  Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Requirement already satisfied: six in /usr/local/lib/python3.8/site-packages (from flask-oidc==1.4.0) (1.16.0)
Collecting python3-openid>=2.0
  Downloading python3_openid-3.2.0-py3-none-any.whl (133 kB)
Requirement already satisfied: Jinja2>=3.0 in /usr/local/lib/python3.8/site-packages (from Flask->flask-oidc==1.4.0) (3.0.3)
Requirement already satisfied: click>=7.1.2 in /usr/local/lib/python3.8/site-packages (from Flask->flask-oidc==1.4.0) (8.0.4)
Requirement already satisfied: Werkzeug>=2.0 in /usr/local/lib/python3.8/site-packages (from Flask->flask-oidc==1.4.0) (2.0.3)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/site-packages (from Jinja2>=3.0->Flask->flask-oidc==1.4.0) (2.0.1)
Collecting defusedxml
  Downloading defusedxml-0.7.1-py2.py3-none-any.whl (25 kB)
Collecting rsa>=3.1.4
  Downloading rsa-4.9-py3-none-any.whl (34 kB)
Collecting pyasn1-modules>=0.0.5
  Downloading pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting httplib2>=0.9.1
  Downloading httplib2-0.22.0-py3-none-any.whl (96 kB)
Collecting pyasn1>=0.1.7
  Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in /usr/local/lib/python3.8/site-packages (from httplib2>=0.9.1->oauth2client->flask-oidc==1.4.0) (3.0.6)
Building wheels for collected packages: flask-oidc
  Building wheel for flask-oidc (setup.py): started
  Building wheel for flask-oidc (setup.py): finished with status 'done'
  Created wheel for flask-oidc: filename=flask_oidc-1.4.0-py2.py3-none-any.whl size=17528 sha256=77c26729c52f7fce863151210570d03c856f727266bd4f410f20cb5815faa235
  Stored in directory: /root/.cache/pip/wheels/c4/43/01/872857ed98e5030fbb5ea60f3e61d5ff0c6afdccb1ad8e0526
Successfully built flask-oidc
Installing collected packages: pyasn1, rsa, pyasn1-modules, itsdangerous, httplib2, defusedxml, python3-openid, oauth2client, Flask-OpenID, flask-oidc
  Attempting uninstall: itsdangerous
    Found existing installation: itsdangerous 2.1.1
    Uninstalling itsdangerous-2.1.1:
      Successfully uninstalled itsdangerous-2.1.1
Successfully installed Flask-OpenID-1.3.0 defusedxml-0.7.1 flask-oidc-1.4.0 httplib2-0.22.0 itsdangerous-2.0.1 oauth2client-4.1.3 pyasn1-0.4.8 pyasn1-modules-0.2.8 python3-openid-3.2.0 rsa-4.9
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
WARNING: You are using pip version 21.2.4; however, version 23.0.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
Upgrading DB schema...
logging was configured successfully
2023-03-22 22:31:29,925:INFO:superset.utils.logging_configurator:logging was configured successfully
2023-03-22 22:31:29,930:INFO:root:Configured event logger of type <class 'superset.utils.log.DBEventLogger'>
We haven't found any Content Security Policy (CSP) defined in the configurations. Please make sure to configure CSP using the TALISMAN_CONFIG key or any other external software. Failing to configure CSP have serious security implications. Check https://developer.mozilla.org/en-US/docs/Web/HTTP/CSP for more information. You can disable this warning using the CONTENT_SECURITY_POLICY_WARNING key.
2023-03-22 22:31:29,931:WARNING:superset.initialization:We haven't found any Content Security Policy (CSP) defined in the configurations. Please make sure to configure CSP using the TALISMAN_CONFIG key or any other external software. Failing to configure CSP have serious security implications. Check https://developer.mozilla.org/en-US/docs/Web/HTTP/CSP for more information. You can disable this warning using the CONTENT_SECURITY_POLICY_WARNING key.
Falling back to the built-in cache, that stores data in the metadata database, for the following cache: `FILTER_STATE_CACHE_CONFIG`. It is recommended to use `RedisCache`, `MemcachedCache` or another dedicated caching backend for production deployments
2023-03-22 22:31:29,934:WARNING:superset.utils.cache_manager:Falling back to the built-in cache, that stores data in the metadata database, for the following cache: `FILTER_STATE_CACHE_CONFIG`. It is recommended to use `RedisCache`, `MemcachedCache` or another dedicated caching backend for production deployments
Falling back to the built-in cache, that stores data in the metadata database, for the following cache: `EXPLORE_FORM_DATA_CACHE_CONFIG`. It is recommended to use `RedisCache`, `MemcachedCache` or another dedicated caching backend for production deployments
2023-03-22 22:31:29,939:WARNING:superset.utils.cache_manager:Falling back to the built-in cache, that stores data in the metadata database, for the following cache: `EXPLORE_FORM_DATA_CACHE_CONFIG`. It is recommended to use `RedisCache`, `MemcachedCache` or another dedicated caching backend for production deployments
INFO  [alembic.runtime.migration] Context impl PostgresqlImpl.
INFO  [alembic.runtime.migration] Will assume transactional DDL.
Loaded your LOCAL configuration at [/app/pythonpath/superset_config.py]

I think I get it, since I didn't set anything in the values.yaml file, by default it was using the latest image because image.tag = "" in the default values.yaml file.
But since helm chart version 0.8.5, the default version has changed and is now set to 2.0.1 ! So I moved from a latest version installed around February 3rd 2023 (very likely a version close to 2.1.0) and did a downgrade to 2.0.1 !
Without any notice anywhere...
While latest is not a version, moving from it to an actual version by default should trigger by warnings.
Anyway, I'm going to upgrade to 2.1.0 and I hope this will fix my issues.

The issue is you deployed latest which means latest master. You'd likely way ahead of 2.1.0 or 2.01, hence your db schema is out of sync.
You need to get back on latest and run flask db downgrade f3c2d8ec8595 which is the version 2.1.0 is on. (or do the same for 2.0.1, you can run flask db heads to find out the head revision)

While latest is not a version, moving from it to an actual version by default should trigger big WARNINGS.

I think the latest helm chart has image.tag updated to an official version instead of latest, so this should hopefully be less of an issue moving forward.

This version of Superset is no longer supported. If anyone is still encountering this in current versions (3.x) please open a new Issue or a PR to address the problem.


[QUESTION] improving metalic Noise in synthesized speech?

Hi, thanks for good repo
I'm using fine-tuned fastspeech2 + gan vocoder trained on libritts. Synthesized speech has some metalic noise.
Is there any way to remove metalic noise without finetuning vocoder on ground-truth aligned mel?
Example)
https://user-images.githubusercontent.com/30820469/154622169-7f30a72f-61a1-48f6-9449-b66b9b1f2315.mp4

In my experiments, GAN vocoders without noise input causes such a noise when we do not perform fine-tuning with GTA outputs. On the other hand, GAN vocoders with noise input have less such a noise even without fine-tuning. So if you do not want to fine-tune, try PWG or style MelGAN.

@kan-bayashi I tried both PWG, and style MelGAN. It sounds bit better. Thank you!


Enable CART to run out of the box

Did my best to enable an out of the box run. I.e. a make demo would run if the user doesn't make any changes, and just clicks Click here to calculate routes. This didn't work for a few different reasons detailed below (each corresponds to a commit). These were my best guesses, and may need some tweaking to keep in line with the vision of the project.

The compiled OSRM python library bindings couldn't be found by python, so the adjusting the python path environment variable was updated to be an absolute path.
The build_parameter.yml file was expected to be in the same path python is started from, but the container does not start python in the root directory. There may be better solutions that what I've done, but specifying the path to build_parameter.yml as one directory level below local_dir seems to be resilient to both containerized and host-based runs. It is, however, generally brittle due to being specified in a different location than runs are specified (e.g. will break if another directory layer is added between the data folders and the root directory). This does work for the time being. Is the root directory where build_parameter.yml should be located?
Uploaded files are dropped into the /data{session_id} folder, which is not the same as the WORKING_DATA_DIR path. Updated the INPUT_DATA_DIR to correctly reflect this (I think this is intended behavior given the upload paths created by the streamlit app). Also, for the out of the box (oob) behavior, there is no session id, so get_solution() was updated to enable oob runs.
*request_solution() and download_solution() were also updated to enable oob runs.

Address Issue 60.

I will decline it if you confirm it runs out of the box now. A fresh build from main seems to solve all the issues.

Also, I'll avoid touching the input data dirs defaults since this was working fine for the Google Drive integration and I intend to keep it compatible.
The root directory is the intended location for the build parameters yaml file given it's, in production context, done at build time rather than associated with specific route scenarios.

Thanks so much for providing input and addressing the concerns!
Running from the dkroutingtool directory addresses the first two points, and PR 62 addresses the last two points. I'll mark this one closed. Thanks!


remove and refactor methods on Rotolo

Removals
The following methods were removed because they were unused:

Rotolo::inspect_all_arguments
Rotolo::take_pack_by_name
Rotolo::get_scopes
Rotolo::packs_to_owned
Rotolo::iter_as_arcs
Rotolo::iter_clean_as_arcs

Extracting packs from Rotolo
The Rotolo::clean_packs_to_owned and Rotolo::is_success methods were used in rotonda and roto, but I've changed it to a packs method that returns a Result. The advantage of this is that we cannot forget to do a success checks before getting the packs (and discarding the miscompiled filters).
as_arcs and as_refs
The Rotolo::retrieve_pack_as_arcs was used, but all occurrences could be removed with Rotolo::retrieve_pack_as_refs so I removed it, but I could put it back if it makes sense to keep it. A bunch of the other as_arcs methods seemed to be redundant too.
Other

Rotolo::retrieve_first_pack_as_arcs was used only in tests and there it seemed to not make a lot of sense, because it could be replaced by getting the filter by name, with a better error message.
I've refactored a few methods.
I converted a few comments to doc comments.
Rotolo::retrieve_pack now returns the error of the retrieved pack if there was a miscompilation.
I ran rustfmt on this file.

This will require a small change in rotonda:
diff --git a/src/common/roto.rs b/src/common/roto.rs
index bf358c0..af3852b 100644
--- a/src/common/roto.rs
+++ b/src/common/roto.rs
@@ -359,24 +359,25 @@ impl RotoScripts {
         let rotolo = Compiler::build(roto_script)
             .map_err(|err| RotoError::compile_err(&origin, err))?;

-        if !rotolo.is_success() {
-            let report = rotolo.get_mis_compilations().iter().fold(
-                String::new(),
-                |mut acc, (scope, err)| {
-                    acc.push_str(&format!("Scope: {scope}, Error: {err}; "));
-                    acc
-                },
-            );
-            let report = report.trim_end_matches("; ");
-            return Err(RotoError::CompileError {
-                origin,
-                err: report.into(),
-            });
-        }
-
         // Extract all the packs that are Filter(Map)s. Filter(Map)s can't
         // live in the Global scope, so these all have filter names.
-        let new_filter_maps = rotolo.clean_packs_to_owned();
+        let new_filter_maps = match rotolo.packs() {
+            Ok(packs) => packs,
+            Err(miscompilations) => {
+                let report = miscompilations.iter().fold(
+                    String::new(),
+                    |mut acc, (scope, err)| {
+                        acc.push_str(&format!("Scope: {scope}, Error: {err}; "));
+                        acc
+                    },
+                );
+                let report = report.trim_end_matches("; ");
+                return Err(RotoError::CompileError {
+                    origin,
+                    err: report.into(),
+                });
+            }
+        };

         // Check if any of the compiled filters have the same name as one that
         // we've already seen. If so, abort, as each Filter(Map) name must be


HTML  tag not work in header and footer

I try to add link in the header.js and footer.js, but all not work for me! Is it a bug ?
My footer is like this:
module.exports = function (info) {
    var dateFormat = function () {
        return (new Date()).toLocaleDateString('en-US', {
            weekday: 'long',
            year: 'numeric',
            month: 'short',
            day: 'numeric',
            hour: '2-digit',
            minute: '2-digit'
        });
    };
    return {
        height: '1cm',
        contents: '
Page {{page}}/{{pages}}

© Copyright by CAKE. corp released at ' + dateFormat() + '
'
    };
};

Hello, sorry, but I will no longer maintain the project.
This project is archived because the owner no longer uses the Atom Editor.
It would be very good to find a new owner for this project, who will take care of updating and expanding the Atom package. A new version based on Chrome Headless has already been prepared in a feature branch.


The CalendarView doesn't sync a current month view with the selected date

Describe the bug
Hi, if I've set the MinDate of CalendarView it doesn't scroll into view by a selected date. It displays MinDate's month instead of the month with the selected date.
Steps to reproduce the bug
<Window
    x:Class="App3.MainWindow"
    xmlns="http://schemas.microsoft.com/winfx/2006/xaml/presentation"
    xmlns:x="http://schemas.microsoft.com/winfx/2006/xaml"
    xmlns:d="http://schemas.microsoft.com/expression/blend/2008"
    xmlns:mc="http://schemas.openxmlformats.org/markup-compatibility/2006"
    mc:Ignorable="d">

    <Grid x:Name="root">
      <StackPanel Orientation="Horizontal" HorizontalAlignment="Center" VerticalAlignment="Top">
          <CalendarView x:Name="calendar"/>
      </StackPanel>
    </Grid>
</Window>

    public sealed partial class MainWindow : Window {
        public MainWindow() {
            this.InitializeComponent();
            this.root.Loaded += Root_Loaded;
        }

        private void Root_Loaded(object sender, RoutedEventArgs e) {
            calendar.MinDate = DateTime.Now.AddMonths(-2); // 5/26/2021
            calendar.SelectedDates.Clear();
            calendar.SelectedDates.Add(DateTime.Now.AddDays(1)); // 7/27/2021
        }
    }

Expected behavior
When the SelectedDate changed the displayed month should be correspond
Screenshots

Version Info

NuGet package version:
[WinUI 3 - Project Reunion 0.8 Preview: 0.8.0-preview]

Windows app type:

UWP
Win32

Yes

Windows version
Saw the problem?

Insider Build (xxxxx)

October 2020 Update (19042)

May 2020 Update (19041)
Yes

November 2019 Update (18363)

May 2019 Update (18362)

October 2018 Update (17763)

April 2018 Update (17134)

Fall Creators Update (16299)

Creators Update (15063)

Device form factor
Saw the problem?

Desktop
Yes

Xbox

Surface Hub

IoT

Additional context

@RBrid have you seen this before? Do you know the intended design?

@StephenLPeters, @alexdi220,
Yes, this is by design. Selection is irrelevant when it comes to displayed dates.  CalendarView.SetDisplayDate(DateTimeOffset) is the method to change the dates shown.   Selected and displayed dates are two distinct concepts.

@RBrid It's weird behavior. Can't imagine if anyone wants to select and display various dates. In addition, it's not the MVVM way, an user can't bind just one property to manage the calendar. Instead of this to set a single selected date we write a code like this:
void Select(DateOffset date){
    calendarView.SelectedDates.Clear();
    calendarView.SelectedDates.Add(date);
    calendarView.SetDisplayDate(date);
}

Would be nice if you could change this. Another must-have feature is the SelectedDate (get\set) property to bind a date in a single selection mode.


Could not find balance for token decrease (token:

Aftter my issue with the request limit of infura (https://github.com/AugurProject/augur-node/issues/848), the sync now stopped at another block with the following error:
Fetching blocks details from 6832112 to 6832112
new block: 6832104,<PHONE_NUMBER> (Wed Dec 05 2018 18:35:10 GMT+0000 (Coordinated Universal Time))
Processing 8 logs
Could not find balance for token decrease (token: 0x1985365e9f78359a9b6ad760e32412f4a445e862, owner: 0xc6a07b6cf5b3295ff1fef54e6c6e35a44d0db2b1)
Error: Could not find balance for token decrease (token: 0x1985365e9f78359a9b6ad760e32412f4a445e862, owner: 0xc6a07b6cf5b3295ff1fef54e6c6e35a44d0db2b1)
    at Object.<anonymous> (/home/ec2-user/new-augur-node/augur-node/build/blockchain/log-processors/token/decrease-token-balance.js:20:19)
    at Generator.next (<anonymous>)
    at fulfilled (/home/ec2-user/new-augur-node/augur-node/build/blockchain/log-processors/token/decrease-token-balance.js:4:58)

I get the same error using infura and the alchemy node (also the alchemy node gave me a rate limit error after a while)

@SebastianMetzger You need to delete your database and re-sync. This error is a symptom of a corrupt database.


[Bug] NoSuchMethodError: org.apache.spark.sql.catalyst.trees.TreePattern$.SCALAR_SUBQUERY_REFERENCE

Search before asking

[X] I searched in the issues and found nothing similar.

Paimon version
0.7.0
Compute Engine
Spark 3.4.2
Minimal reproduce step
bin/spark-sql
--conf spark.sql.catalog.spark_catalog=org.apache.paimon.spark.SparkGenericCatalog
--conf spark.sql.extensions=org.apache.paimon.spark.extensions.PaimonSparkSessionExtensions
--jars paimon-spark-3.4-0.7.0-incubating.jar

show tables;

Tips: This Operation is normal on Spark 3.2.2
What doesn't meet your expectations?
can show tables
Anything else?
No response
Are you willing to submit a PR?

[ ] I'm willing to submit a PR!

Can you try with the latest 0.8 snapshot


Allow working with preloaded VSSetup module

Description
Current implementation required VSSetup module to be installed in location where PowerShell can find it automatically. Now, before trying to import VSSetup, psake will check if it's not already loaded. This allows to work with VSSetup committed to repository, loading it either by psake-config.ps1 or manually in helper script.
Related Issue
Somewhat fixes #241, because now you don't have to install and maintain additional modules on build servers.
Motivation and Context
It's not always feasible to install additional modules on build server.
How Has This Been Tested?

I did not have VSSetup module installed. I have copied VSSetup module to a folder in repository. Then I modified psake-config.ps1 to include VSSetup.psd1 in $config.modules. After this psake used MSBuild 15 and build succeeded, whereas before the change it used version 14.
Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[x] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes.
[x] All new and existing tests passed.

Makes sense @havranek1024. Thanks for the addition!


GoogleCast: Allow to change the cast channel's namespace

Description: https://github.com/ConnectSDK/Connect-SDK-iOS-Google-Cast/issues/6

Hi there, were you able to figure this out?


Package Requested

[X] I would like someone else to build the manifest.
[ ] I would like help so I can submit the manifest.
[X] I have performed a search and couldn't find this package.
[ ] I have checked that the installer for this package is not a standalone or portable executable or a .zip file
[ ] I think there is a new version available and I have provided the URL.

Please provide the following information
Publisher: KDE e.V.
Publisher Url: http://kde.org
Package Name: KDE.Kate.Release
Description: http://apps.kde.org/kate
Package Version: master-1514
Installer URL: http://binary-factory.kde.org/view/Windows 64-bit/job/Kate_Release_win64/lastSuccessfulBuild/artifact/kate-21.12.0-1514-windows-msvc2019_64-cl-sideload.appx
Current Package Identifier (for new versions): master-1514

Although I have attempted to replace the current installer with one "APPX" package at "http://github.com/microsoft/winget-pkgs/pull/33731", I did not accomplish the replacement. Consequently, I am requesting assistance.

Duplicate of #39190
Please post your KDE requests here


Close Main Navigation Menu with Back button

Steps to reproduce the behaviour

Click on the "home" button to open Main Navigation Menu

Click back button

Open "General Preferences"

Click back button

Expected behaviour

The Main Navigation Menu should close

"General Preferences" are closing and return to Preference List

Actual behaviour

GnuCashAndroid is closed

"General Preferences" closes and returns to Account Activity

Software specifications

GnuCash Android version: 2.4.0
System Android version: 9.0
Device type: Samsung Galaxy Note 8

I'have corrected this issue in eb38f2e60ef3966fb172c438d9fde345210e6106, but I don't know yet how to give it to you

thanks @JeanGarf


Connection Timeout Error on run.py Script when Executing Task File

I encountered a timeout error when running the run.py script with the task1.json file. The script attempts to connect to a local server (IP <IP_ADDRESS>, port 5000), but it fails to establish the connection, resulting in the following error:
$ python3 run.py --task-file task1.json
Waiting for the server to start...
Failed to get hello: HTTPConnectionPool(host='<IP_ADDRESS>', port=5000): Max retries exceeded with url: /probe (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7fcf4c41c5e0>, 'Connection to <IP_ADDRESS> timed out. (connect timeout=7)'))
Retrying...
I tried waiting and retrying the process, but the issue persists. I would appreciate any assistance in understanding possible causes and recommended solutions for this timeout error.
Kind Regards.

Please have a try with this solution. Good luck:)


drop test-infra code

This code was pulled into knative/pkg from knative/test-infra long ago
This code isn't need or living in knative/toolbox repo.
/assign @upodroid
/assign @cardil
/cc @pierDipi

Diff is too large
/override "style / Golang / Lint"

/lgtm


avoid Mojito as a dependency

It's possible to drop Mojito and just use native httpc directly. This is 1 less dependency which can easily get in the way of a normal production app.  Would this be reasonable? I can PR it.
base_url = "https://ziglang.org/"
# choose either an official release or a yolo tarball
# zig_tarball = "download/0.7.0/zig-0.7.0.tar.xz"
zig_tarball = builds/zig-0.7.0+4fd27719b.tar.xz"
Application.ensure_all_started :inets
Application.ensure_all_started :ssl
{:ok, {{_version, 200, _reason}, _headers, zig_src}} = :httpc.request(baseurl <> zig_tarball)
File.write!("zig.txz", zig_src)

It's also possible to add TLS peer verification, or use a sha512 or something of the source tarball.

I'll accept a pr switching it out, but the readme suggests to use zigler as runtime: false dependency so it should not be available at runtime.  Also I thought httpc was going to be deprecated from otp.

Going to close this out since mojito should not be present at runtime, but still open to a pr.


Update how-to-create-test-certificates.md

Updated the file names to show the correct name of files created by New-CACertsEdgeDevice "<CA cert name>". The documentation erroneously adds "-ca" to the file name when that part isn't present in the real file names generated.

@PatAltimore
Can you review the proposed changes?
Important: When the changes are ready for publication, adding a #sign-off comment is the best way to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

@PatAltimore
Can you review this old PR and determine whether it needs to be closed or merged?
@MicrosoftDocs/public-repo-pr-review-team

Hi @scout208,
Thanks for opening the fix. I didn't realize there was a prefix difference between the Powershell and Bash tools. The change looks good.
Thanks,
Pat
#sign-off


eBPF 1% of inbound connections stall on create

When running Calico in eBPF mode, 0.1% to 1% of connections stall when created towards a ServiceIP / LoadBalancer IP of certain applications. Accessing the Pod IPs directly leads to no stalls, neither does switching back service proxy to kube-proxy. The connection is successfully opened (SYN-ACK) but no further data is received.
This behavior has been proven with the following applications:

traefik
istio

Expected Behavior
All connections should succeed.
Current Behavior
hey -z 48h -t 20 -c 1 http://my-traefik-service

Summary:
  Total:        44.7973 secs
  Slowest:      0.0555 secs
  Fastest:      0.0275 secs
  Average:      0.0298 secs
  Requests/sec: 3.6386

  Total data:   2093 bytes
  Size/request: 13 bytes

Response time histogram:
  0.028 [1]     |
  0.030 [124]   |■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■
  0.033 [32]    |■■■■■■■■■■
  0.036 [3]     |■
  0.039 [0]     |
  0.042 [0]     |
  0.044 [0]     |
  0.047 [0]     |
  0.050 [0]     |
  0.053 [0]     |
  0.055 [1]     |

Latency distribution:
  10% in 0.0285 secs
  25% in 0.0286 secs
  50% in 0.0290 secs
  75% in 0.0300 secs
  90% in 0.0325 secs
  95% in 0.0330 secs
  99% in 0.0555 secs

Details (average, fastest, slowest):
  DNS+dialup:   0.0000 secs, 0.0275 secs, 0.0555 secs
  DNS-lookup:   0.0000 secs, 0.0000 secs, 0.0000 secs
  req write:    0.0001 secs, 0.0000 secs, 0.0015 secs
  resp wait:    0.0291 secs, 0.0273 secs, 0.0544 secs
  resp read:    0.0003 secs, 0.0000 secs, 0.0025 secs

Status code distribution:
  [200] 161 responses

Error distribution:
  [2]   Get http://<IP_ADDRESS>: net/http: request canceled (Client.Timeout exceeded while awaiting headers)

Possible Solution

Steps to Reproduce (for bugs)

Run traefik in a Pod on a node with calico eBPF service proxy
Use hey or similar tool to launch a bunch of sequential requests to a Service IP of that pod
See how a few connections stall and time out

Context
Your Environment

Calico version: 3.16.0 and 3.18.0
Orchestrator version (e.g. kubernetes, mesos, rkt): Kubernetes 1.18.0
Operating System and version: Linux g4efbf7 5.4.0-54-generic #60~18.04.1-Ubuntu SMP Fri Nov 6 17:25:16 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Link to your project (optional): http://www.coreweave.com

Do not see any RSTs. The connection just stalls after the SYN-ACK.

cc @fasaxc , @tomastigera - sounds like the initial question of RSTs has been answered. Any other hypotheses that we can ask @salanki to take a look for?

@salanki Where are you running hey?  In a pod, on the host with Traefik?  On an external host?

External host, outside of the cluster.

Do you see the same with a super simple service, such as an nginx pod?

Let me run another test with Nginx. I have tested many different applications (Istio, Traefik) but all of them are written in Go. Would be interesting to try something written in C.

@salanki Can you give more details of how to set up Traefik, for example, in order to repro this.  I thought Traefik was an ingress controller so what exactly is the set up that you're using and what is Traefik providing ingress for?

Got same issue with nodePorts/externalIPs of services having more than one endpoint.
Service:
NAME      TYPE       CLUSTER-IP       EXTERNAL-IP     PORT(S)        AGE
nginx     NodePort   <IP_ADDRESS>   <IP_ADDRESS>   80:31471/TCP   144m

hey running on the external vm in the same subnet as all k8s nodes.
# hey -disable-keepalive  -z 60s  http://<IP_ADDRESS>/

Summary:
  Total:	73.9967 secs
  Slowest:	20.0002 secs
  Fastest:	0.0003 secs
  Average:	0.0017 secs
  Requests/sec:	6921.9191

  Total data:	313391736 bytes
  Size/request:	612 bytes

Response time histogram:
  0.000 [1]	|
  2.000 [512075]	|■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■
  4.000 [0]	|
  6.000 [0]	|
  8.000 [0]	|
  10.000 [0]	|
  12.000 [0]	|
  14.000 [0]	|
  16.000 [0]	|
  18.000 [0]	|
  20.000 [2]	|

Latency distribution:
  10% in 0.0007 secs
  25% in 0.0010 secs
  50% in 0.0012 secs
  75% in 0.0017 secs
  90% in 0.0027 secs
  95% in 0.0037 secs
  99% in 0.0066 secs

Details (average, fastest, slowest):
  DNS+dialup:	0.0005 secs, 0.0003 secs, 20.0002 secs
  DNS-lookup:	0.0000 secs, 0.0000 secs, 0.0000 secs
  req write:	0.0001 secs, 0.0000 secs, 0.0088 secs
  resp wait:	0.0009 secs, 0.0001 secs, 0.2094 secs
  resp read:	0.0002 secs, 0.0000 secs, 19.9970 secs

Status code distribution:
  [200]	512078 responses

Error distribution:
  [121]	Get "http://<IP_ADDRESS>/": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

Calico 3.18.1, ebpf dataplane, vxlan overlay, k8s 1.20.4, ubuntu 18.04 with 5.4 kernel
No errors in ipvs mode.
Also, ebpf dataplane does not honor externalTrafficPolicy: Local for externalIPs, or maybe I misunderstood  something?
#calico-node -bpf nat dump
...
<IP_ADDRESS> port 80 proto 6 id 12 count 2 local 1 #xeternalIP
	12:0	 <IP_ADDRESS>:80
	12:1	 <IP_ADDRESS>:80

<IP_ADDRESS> port 31471 proto 6 id 14 count 1 local 0 #nodePort
	14:0	 <IP_ADDRESS>:80
<IP_ADDRESS> port 31471 proto 6 id 12 count 1 local 1 #nodePort
	12:0	 <IP_ADDRESS>:80

I've also tried fasaxc/calico-node:ct-syns-2 image with same result, seems like this issue is not related to #4290

@alloran can you give this image a try: calico/node:v3.19.0-0.dev-121-gf2ea8a855295
That's the latest cut of v3.19.  It has some more fixes for external IPs.

@fasaxc
Tested with calico/node:v3.19.0-0.dev-121-gf2ea8a855295, same result
3.19, single nginx pod
Summary:
  Total:	60.0054 secs
  Slowest:	0.0218 secs
  Fastest:	0.0012 secs
  Average:	0.0062 secs
  Requests/sec:	8079.4499

  Total data:	296704332 bytes
  Size/request:	612 bytes

Response time histogram:
  0.001 [1]	|
  0.003 [866]	|
  0.005 [198000]	|■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■
  0.007 [218379]	|■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■
  0.009 [17051]	|■■■
  0.012 [41242]	|■■■■■■■■
  0.014 [6301]	|■
  0.016 [2535]	|
  0.018 [311]	|
  0.020 [96]	|
  0.022 [29]	|

Latency distribution:
  10% in 0.0048 secs
  25% in 0.0050 secs
  50% in 0.0056 secs
  75% in 0.0064 secs
  90% in 0.0098 secs
  95% in 0.0108 secs
  99% in 0.0126 secs

Details (average, fastest, slowest):
  DNS+dialup:	0.0007 secs, 0.0012 secs, 0.0218 secs
  DNS-lookup:	0.0000 secs, 0.0000 secs, 0.0000 secs
  req write:	0.0000 secs, 0.0000 secs, 0.0109 secs
  resp wait:	0.0053 secs, 0.0003 secs, 0.0203 secs
  resp read:	0.0001 secs, 0.0000 secs, 0.0138 secs

Status code distribution:
  [200]	484811 responses

3.19, two nginx pods
Summary:
  Total:	79.7519 secs
  Slowest:	20.0002 secs
  Fastest:	0.0009 secs
  Average:	0.0029 secs
  Requests/sec:	4629.4847

  Total data:	225881856 bytes
  Size/request:	612 bytes

Response time histogram:
  0.001 [1]	|
  2.001 [369085]	|■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■
  4.001 [0]	|
  6.001 [0]	|
  8.001 [0]	|
  10.001 [0]	|
  12.000 [0]	|
  14.000 [0]	|
  16.000 [0]	|
  18.000 [0]	|
  20.000 [2]	|

Latency distribution:
  10% in 0.0016 secs
  25% in 0.0018 secs
  50% in 0.0020 secs
  75% in 0.0027 secs
  90% in 0.0045 secs
  95% in 0.0068 secs
  99% in 0.0125 secs

Details (average, fastest, slowest):
  DNS+dialup:	0.0010 secs, 0.0009 secs, 20.0002 secs
  DNS-lookup:	0.0000 secs, 0.0000 secs, 0.0000 secs
  req write:	0.0000 secs, 0.0000 secs, 0.0082 secs
  resp wait:	0.0016 secs, 0.0002 secs, 0.2068 secs
  resp read:	0.0002 secs, 0.0000 secs, 19.9977 secs

Status code distribution:
  [200]	369088 responses

Error distribution:
  [122]	Get "http://<IP_ADDRESS>/": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

We still have this issue running latest version of Calico and latest 5.13 mainline kernel as well as Ubuntu kernels. This is reproducible in VMs as well as on bare metal.

This issue regretfully still exists as of today (Felix HEAD https://github.com/projectcalico/felix/commit/012f8389275c2c55257de87c8306f020a53ed56e).
This is the manifest we are using to reproduce:
apiVersion: apps/v1
kind: Deployment
metadata:
  name: nginx-deployment
  labels:
    app: nginx
spec:
  replicas: 1
  selector:
    matchLabels:
      app: nginx
  template:
    metadata:
      labels:
        app: nginx
    spec:
      containers:
      - name: nginx
        image: nginx:1.14.2
        ports:
        - containerPort: 80
---
apiVersion: v1
kind: Service
metadata:
  name: nginx
  labels:
    app: nginx
spec:
  ports:
    - port: 80
      name: http
  selector:
    app: nginx
  type: LoadBalancer
  externalTrafficPolicy: Local

$ hey -disable-keepalive  -z 60s  http://<IP_ADDRESS>/

Summary:
  Total:	75.6985 secs
  Slowest:	1.0014 secs
  Fastest:	0.0005 secs
  Average:	0.0030 secs
  Requests/sec:	17487.5167

  Total data:	810151524 bytes
  Size/request:	810 bytes

Response time histogram:
  0.000 [1]	|
  0.101 [999995]	|■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■
  0.201 [2]	|
  0.301 [0]	|
  0.401 [0]	|
  0.501 [0]	|
  0.601 [0]	|
  0.701 [0]	|
  0.801 [0]	|
  0.901 [0]	|
  1.001 [2]	|

Latency distribution:
  10% in 0.0017 secs
  25% in 0.0018 secs
  50% in 0.0021 secs
  75% in 0.0025 secs
  90% in 0.0029 secs
  95% in 0.0032 secs
  99% in 0.0061 secs

Details (average, fastest, slowest):
  DNS+dialup:	0.0006 secs, 0.0005 secs, 1.0014 secs
  DNS-lookup:	0.0000 secs, 0.0000 secs, 0.0000 secs
  req write:	0.0001 secs, 0.0000 secs, 0.0481 secs
  resp wait:	0.0020 secs, 0.0001 secs, 0.0927 secs
  resp read:	0.0002 secs, 0.0000 secs, 0.0528 secs

Status code distribution:
  [200]	1000000 responses

Error distribution:
  [2]	Get http://<IP_ADDRESS>/: net/http: request canceled (Client.Timeout exceeded while awaiting headers)

The LoadBalancer IP is allocated via MetalLB and announced by Calico BGP.

@tomastigera: I can regretfully confirm that this issue still exists with https://github.com/projectcalico/felix/pull/2983. Tested via: calico/node:v3.21.0-0.dev-121-g2004f2a17a2.
$ hey -disable-keepalive  -z 60s -t 1  http://<IP_ADDRESS>/

Summary:
  Total:	60.0027 secs
  Slowest:	0.0241 secs
  Fastest:	0.0003 secs
  Average:	0.0029 secs
  Requests/sec:	28774.3879

  Total data:<PHONE_NUMBER> bytes
  Size/request:	1056 bytes

Response time histogram:
  0.000 [1]	|
  0.003 [780832]	|■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■
  0.005 [205750]	|■■■■■■■■■■■
  0.007 [10612]	|■
  0.010 [2051]	|
  0.012 [481]	|
  0.015 [190]	|
  0.017 [45]	|
  0.019 [27]	|
  0.022 [9]	|
  0.024 [2]	|

Latency distribution:
  10% in 0.0005 secs
  25% in 0.0006 secs
  50% in 0.0014 secs
  75% in 0.0026 secs
  90% in 0.0031 secs
  95% in 0.0036 secs
  99% in 0.0054 secs

Details (average, fastest, slowest):
  DNS+dialup:	0.0006 secs, 0.0003 secs, 0.0241 secs
  DNS-lookup:	0.0000 secs, 0.0000 secs, 0.0000 secs
  req write:	0.0002 secs, 0.0000 secs, 0.0159 secs
  resp wait:	0.0019 secs, 0.0001 secs, 0.0197 secs
  resp read:	0.0002 secs, 0.0000 secs, 0.0220 secs

Status code distribution:
  [200]	1000000 responses

Error distribution:
  [70]	Get "http://<IP_ADDRESS>/": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

https://github.com/projectcalico/calico/issues/4712 seems related, however our issue does not occur with externalTrafficPolicy: Cluster.

So @salanki this commint causes the troubles for you, right? https://github.com/projectcalico/felix/pull/2686

#4310 may look similar, but uses 3.17 while the :arrow_up:  PR was merged in 3.19 :thinking:

The key problem in this is that an unrelated feature in our kube-proxy replacement overwrites data used by the cleaner that removes conntrack entries when a backend no longer exists. This clash only happens with the NodePort having ExternalTrafficPolicy set to Local and it shows the symptoms if there is more than a single backend. The result is that when we sweep the connections (every ~10s) we erroneously remove the conntrack entry of a live connection. Since there are 2 entries for NATed connections, the BPF logs show different symptoms depending on which of the 2 entries got removed first and when new packets on the connection pass through. Due to removing the conntrack entries, the connection stalls.
Note that LoadBalancers ultimately create NodePorts.
cc @seh


Include AWS region in ToilTest class (resolves #998)

jenkins, test this please.

The current approach has the desired interface but its a little hacky. I think it would be better to change the AWSRegion variable into a regular function and live with the slightly uglier invocation rather than risk breaking things if the code is reorganized.

regular function

Agreed.

jenkins, test this please

@hannes-ucsc test failures are unrelated


[WIP] tests: do not call methods on None

Could you also please add the following change to this PR:
https://github.com/wizardsardine/liana/pull/1222#discussion_r1740303324
Thanks :pray:

Could you also please add the following change to this PR: #1222 (comment)
Thanks 🙏

sure, i let this wip for now, i plan to do a check round for handle all this None "unwraping"


Allow TestBehavior.AFTER_EACH with DBT_MANIFEST load method

Context
When running cosmos with LoadMode.DBT_MANIFEST, I noticed that all tests would disappear when trying to filter via RenderConfig.select. The tests show up properly when rendering the full dbt project (removing the select filter), so I assumed this issue was related to the select/exclude logic. I tested this on my own project as well as with cosmos_manifest_example.py in this repo. Below are some screenshots of the behavior I observed with the example DAG in this repo.
With
render_config=RenderConfig(load_method=LoadMode.DBT_MANIFEST),

The tests show up properly here.
With
render_config=RenderConfig(load_method=LoadMode.DBT_MANIFEST, select=["+customers"]),

The tests do not show up once the select=["+customers"] is included in the RenderConfig.
Upon further investigation, it seems as though this issue stems from the fact that test nodes are not included in the depends_on field in manifest.json. The logic in selector.py builds the dbt graph based on this depends_on field and therefore winds up filtering out all test nodes so that they are not included in the filtered_nodes by this step in graph.py
            self.filtered_nodes = select_nodes(
                project_dir=self.execution_config.project_path,
                nodes=nodes,
                select=self.render_config.select,
                exclude=self.render_config.exclude,
            )

Solution
There's a few different ways we could update the logic to allow model filtering while maintaining the proper testing behavior.

update the update_node_dependency() method which gets called after the filtering process is completed. We can update the logic here to add any test nodes which are tests for a node in self.filtered_nodes.

update the resources dict to add all test nodes to the depends_on field of node(s) they are testing.

update the selector.py logic to account for the fact that test nodes do not show up in the depends_on field of nodes they are testing. This is probably the most complex solution as it would require updating the filtering logic itself. It seems the GraphSelector class is the one that would need updating.

I can put up a PR for option 1 but am open to any thoughts or suggestions on what makes the most sense. Also please let me know if there is an easier fix or workaround that I am missing. Thanks!
BTW I'm seeing a failure in the pre-commit mypy check even without any changes yet made on my feature branch. I noticed other PR's seem to skip that check, is that something I should be doing? Is there a way to skip it?

Hi @chris-okorodudu, thanks for reporting, suggesting fixes, and being available to fix this issue!
I believe (1) is a pragmatic solution to the problem; please go ahead, and we'll review whether there are any corner cases we may not be considering as a starting point.
I just logged an issue so we could fix the pre-commit issue; I hadn't realized we had this problem: #952
While this issue is not solved, you should be able to use SKIP=mypy-python:
https://pre-commit.com/#temporarily-disabling-hooks


[Device Specific] Uploaded Photo not shown in profile icon on Create Account page.

Frequency: 100%
Repro on build version: Play Store build V1.12.2
Does not repro version: App store build V1.12.2
Repro on devices: Samsung Galaxy S4(4.4.2)
Does not repro devices HTC Desire 526G+ (4.4.2) , samsung galaxy S4(5.0.1), LG K7i(6.0), Samsung  Galaxy A5(7.0), Samsung  Galaxy M31 (10.0) , iPhone XR (14.4.1), iPhone 6+ (12)
Repro Steps:

Launch the application & select “Create Account” option.
Now tap on “Add Photo” icon & upload photo by selecting “Choose from Gallary” option.
Observed that,
Current Behavior:  Uploaded photo not displayed in profile icon.
Expected Behavior:  Uploaded photos should display in the Profile icon.
Impact: Users are not able to see uploaded photos.
Investigation: Also we have observed same issue for editing profile through Settings option.

Hey @MuckT we have verified the above on Android Internal Release build V 1.37.1 and observed that issue is not reproducible
Device : Samsung Galaxy A3(5.0.2)
Thanks..!


added support for Default Values in MapWrapper Generation

Codecov Report

Merging #13 into master will increase coverage by 0.04%.
The diff coverage is 100%.

@@             Coverage Diff              @@
##             master      #13      +/-   ##
============================================
+ Coverage     93.83%   93.88%   +0.04%
  Complexity      141      141
============================================
  Files            21       21
  Lines           519      523       +4
  Branches         52       52
============================================
+ Hits            487      491       +4
  Misses           19       19
  Partials         13       13

Impacted Files
Coverage Δ
Complexity Δ

...ava/com/kaufland/generation/WrapperGeneration.java
98.88% <100%> (+0.05%)
7 <0> (ø)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9b47315...fe161d0. Read the comment docs.


Cuboid volume

Why:

Closes #86
Closes #88

cuboid program C and C++ done

Hey @KaptainCS3
Please comment !assign on #86 #88 , to prevent any conflict
!assign

!assign

Hey @KaptainCS3, !assign command is only for good first issue !!!
Please choose another issue.
Thanks for your interest in contributing to this project.

update naming conversion and change function return type.

print hello world program done waiting on your review


[Bug] Deprecated-statement rule incorrectly triggered for use of [RETURN]

What happened?
A robot keyword using the correct [RETURN] statement triggers a deprecated-statement error
What command/code did you try to run?
python -m robocop on our robot test suite
What is the full error message?
[W] 0319 '[Return]' is deprecated since Robot Framework version 5.*, use 'RETURN' instead (deprecated-statement)
What did you expect to happen instead?
No error should be reported
Operating System
Ubuntu   22.04.3   LTS
Robocop version
robotframework-robocop-4.1.1

Are you using Robot Framework >=5? While it's not officially deprecated yet (with deprecated message) you can read here https://robotframework.org/robotframework/latest/RobotFrameworkUserGuide.html#using-return-setting that The [Return] setting is effectively deprecated and the RETURN statement should be used. That's why we report this as an issue. If you get this message with RF <5 then it's indeed bug (it should be only reported from 5 onwards).

@bhirsz Hi, thanks for the quick reply. Yes, I am using [RETURN] in the robot file, but the rule is still firing incorrectly for some reason.

Closing as it's not an bug (and apologies for late reply): [Return] is in fact deprecated since RF 5.0 and will be removed in RF 8.0.  The syntax is still correct but could be replaced with new syntax. That's why deprecated-statement warns about it.


Update roadmap on index page

If you need help, please ask in our #engineering channel on Discord.
We use issues for tracking features, bugs and discussions.
Let's change it to this.
May 2017
Idea conception and demo DApp development
September 2017
Product Brief and Whitepaper released
December 2017
Launch alpha on Ethereum testnet
Q2 2018
Beta on testnet and community sale
Q3 2018
Platform launch and token distribution
2019
Launch of 3rd-party DApps and additional services

This seems to have been completed by https://github.com/OriginProtocol/company-website/commit/0c2b48d264aa0b53ff0a08ad23a7ad291b821b38.


Fading out the path as it draws

Thanks for this @RobinChao. I used it as a guide to create another animation. I was wondering if you know how to fade the beginning of the path as it writes? Ie add some animation that after a delay begins to fade out the text. But not the whole text, the bit that lets say has been "written" for 5s or something.
So the idea is that by the end of the writing animation, there is actually no text. Not sure if you understand what I mean. The animation I'm working on is a heartbeat signature similar to https://jsfiddle.net/j46kxvj5/4/

sorry ,Bro. maybe you can see ElectrocardiogramAnimation.
sometimes later, i will change it to swift style. thanks.


DISTMYSQL-206 adding gnupg2 curl

as per https://jira.percona.com/browse/DISTMYSQL-206

Thank you! This has already been addressed via https://github.com/percona/pdmysql-docs/pull/51 (even though it would be better if the Percona Server package would actually depend on these packages, so the user does not have to take care of resolving these dependencies manually)


How to parse arguments

Hello,
could you please help me resolve the task with arguments parsing of my TCL function?
I have TCL function which run in following way:
my_fun -type typeName -text "3 TEXT" -refName { "name1" "name_2" "name_3" }
How can I register this function in Gothic package and just parse/read out all function arguments
type: typeName
text:  3 TEXT
refName: "name1" "name_2" "name_3"
Regards.

Parsing is out of scope of gothic.  I'm not even sure gothic supports variadic arguments. Yeah, probably it doesn't.
Gothic was never meant to be a lib which provides proper TCL bindings, it's for using tcl/tk mostly.
You can see how I call a go func from tcl here: https://github.com/nsf/gothic/blob/master/interpreter.go#L562-L600
To do command-like functions support for variable amount of arguments needs to be added for sure.


Error after installing Apps from Geo App Market

Hi,
I don't understand these errors; I installed a few apps as below

cartoview_map_viewer
cartoview_feature_list
cartoview_charts_viewer
cartoview_summary_viewer
cartoview_collector
cartoview_webapp_builder
cartoview_dashboard
cartoview_time_data_viewer
cartoview_buffer_tool

"(arsm_app) kiki@ubuntu:~/sam_v1$ python manage.py runserver <IP_ADDRESS>:8000
Performing system checks...
System check identified some issues:
WARNINGS:
base.ResourceBase.tkeywords: (fields.W340) null has no effect on ManyToManyField.
System check identified 1 issue (0 silenced).
August 12, 2017 - 08:04:53
Django version 1.8.18, using settings 'sam_v1.settings'
Starting development server at http://<IP_ADDRESS>:8000/
Quit the server with CONTROL-C.
Traceback (most recent call last):
File "/usr/lib/python2.7/wsgiref/handlers.py", line 85, in run
self.result = application(self.environ, self.start_response)
File "/home/kiki/.virtualenvs/arsm_app/local/lib/python2.7/site-packages/django/contrib/staticfiles/handlers.py", line 63,            in call
return self.application(environ, start_response)
File "/home/kiki/.virtualenvs/arsm_app/local/lib/python2.7/site-packages/django/core/handlers/wsgi.py", line 170, in __call           __
self.load_middleware()
File "/home/kiki/.virtualenvs/arsm_app/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 52, in load_middleware
mw_instance = mw_class()
File "/home/kiki/.virtualenvs/arsm_app/local/lib/python2.7/site-packages/django/middleware/locale.py", line 24, in init
for url_pattern in get_resolver(None).url_patterns:
File "/home/kiki/.virtualenvs/arsm_app/local/lib/python2.7/site-packages/django/core/urlresolvers.py", line 401, in url_pat           terns
patterns = getattr(self.urlconf_module, "urlpatterns", self.urlconf_module)
File "/home/kiki/.virtualenvs/arsm_app/local/lib/python2.7/site-packages/django/core/urlresolvers.py", line 395, in urlconf           _module
self._urlconf_module = import_module(self.urlconf_name)
File "/usr/lib/python2.7/importlib/init.py", line 37, in import_module
import(name)
File "/home/kiki/.virtualenvs/arsm_app/local/lib/python2.7/site-packages/cartoview/urls.py", line 17, in
(r'^apps/', include('cartoview.app_manager.urls')),
File "/home/kiki/.virtualenvs/arsm_app/local/lib/python2.7/site-packages/django/conf/urls/init.py", line 33, in include
urlconf_module = import_module(urlconf_module)
File "/usr/lib/python2.7/importlib/init.py", line 37, in import_module
import(name)
File "/home/kiki/.virtualenvs/arsm_app/local/lib/python2.7/site-packages/cartoview/app_manager/urls.py", line 94, in
urlpatterns.append(app_url(app_config.name))
File "/home/kiki/.virtualenvs/arsm_app/local/lib/python2.7/site-packages/cartoview/app_manager/urls.py", line 85, in app_url
include('%s.urls' % app),
File "/home/kiki/.virtualenvs/arsm_app/local/lib/python2.7/site-packages/django/conf/urls/init.py", line 33, in include
urlconf_module = import_module(urlconf_module)
File "/usr/lib/python2.7/importlib/init.py", line 37, in import_module
import(name)
File "/home/kiki/sam_v1/apps/cartoview_collector/urls.py", line 2, in
import views
File "/home/kiki/sam_v1/apps/cartoview_collector/views.py", line 6, in
from cartoview_feature_list.viewer_widgets import widgets as feature_list_widgets
ImportError: No module named viewer_widgets "
How to manually uninstall the apps?
Thanks.

for now you can fix this error by removing cartoview_collector from apps folder and remove it record from apps.yml file and restart server then goto you admin panel under app_manager section open Apps and remove collector App .
we are working on a new version of this app , the new version will be available on App Market soon