Integ test framework should allow to create multiple clusters

Is your feature request related to a problem? Please describe
https://github.com/opensearch-project/OpenSearch/pull/15462#discussion_r1740832376
Describe the solution you'd like
https://github.com/opensearch-project/OpenSearch/pull/15462#discussion_r1740832376
Related component
Other
Describe alternatives you've considered
No response
Additional context
No response

This should already be possible from a framework perspective.
https://github.com/opensearch-project/OpenSearch/blob/9f814797d0fe57457359a1f8a1b222cea80dc003/test/framework/src/main/java/org/opensearch/test/OpenSearchIntegTestCase.java#L2012-L2081
Following is an example to create 3 clusters which I had tried in the past for some local verification:
    private InternalTestCluster[] clusters;

    @Before
    public void setupClusters() throws Exception {
        clusters = new InternalTestCluster[3];
        clusters[0] = (InternalTestCluster) buildTestCluster(Scope.TEST, randomLong());
        clusters[1] = (InternalTestCluster) buildTestCluster(Scope.TEST, randomLong());
        clusters[2] = (InternalTestCluster) buildTestCluster(Scope.TEST, randomLong());
    }

    @After
    public void teardownClusters() throws Exception {
        for (InternalTestCluster testCluster: clusters) {
            for (String nodeName : testCluster.getNodeNames()) {
                testCluster.getNode(nodeName).close();
            }
            testCluster.afterTest();
            testCluster.close();
        }
    }

[Catch All Triage - 1, 2, 3]
@sachinpkale Can you follow up if @mgodwan's example will solve your issue?


README needs information about redis

When installing clipper and attempting to run ipython tutorial I get the following:

Possibly need documentation about installing redis before running clipper?

Fixed by #71


Source-map needs to be updated to 0.8.0-beta.0

See https://github.com/terser/terser/pull/1164 for reasoning.  This breaks Node.js v18.

In the interim, @cspotcode/source-map-support may work as a drop-in replacement.  I'm not 100% sure, but I checked the code and I don't think it has the fetch check.  Might not work if you need browser support.


Rich text Internal links

Additions

registered cfgov link handler for rich text fields.
This strips the hostname from internal links allowing them to be relative.

Changes

refactored atomic element templates to not use .source attribute of rich text fields as this renders links & embedded data incorrectly and therefore doesn't allow full use of editor features.

Testing

Create a DemoPage and create a text introduction.
In the Intro field create an internal link and share it. Visit shared page and verify link has content.localhost associated with it
Publish created page. Visit published page url and verify link has localhost associated with it

Review

@kurtw
@richaagarwal

Checklist

[ ] Changes are limited to a single goal (no scope creep)
[ ] Code can be automatically merged (no conflicts)
[ ] Code follows the standards laid out in the front end playbook
[ ] Passes all existing automated tests
[ ] New functions include new tests
[ ] New functions are documented (with a description, list of inputs, and expected output)
[ ] Placeholder code is flagged
[ ] Visually tested in supported browsers and devices
[ ] Project documentation has been updated (including the "Unreleased" section of the CHANGELOG)

@kave I tested this and it works as stated, but I also followed those steps in the flapjack branch, and it works the same way. Is there something I'm missing?

@richaagarwal lets do a screenshare today and i can show you the scenario

:+1: great work with this


Improve the comment section

Implement a better comments section, and enable comment replies.

Would work on implementation in v1.6


Allow the user to disable showing text

Thanks for your contributions!
(And sorry for the huge delay :smile: )

Sorry about leaving out the documentation, good job updating it!


editted default value of email and password

removed the default value of email and password in sign in page

Good job @sohan2410 , Thanks for contributing! I'll merge these changes.


sabnzbd: use sabyenc3 4.0.0

Description of changes
SABnzbd requires sabyenc3 at version 4.0.0, but it was updated to 5.0.1.
I've added a sabyenc3_4 Python module so that we can require that explicitly
in the SABnzbd definition.
This fixes the error:
SABYenc disabled: no correct version found! (Found v5.0.1, expecting v4.0.0)

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[x] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[x] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

I'm closing this as it seems that other changes to master have made this fix unnecessary. I'll keep an eye on it to see if it comes up again.

Actually, I just added an NZB and tested it more thoroughly and it looks like this is still required

@FRidh

Thanks. I've made https://github.com/NixOS/nixpkgs/pull/170875 instead which uses an override. I'll merge it once CI passes.

Great, thank you. Closing


Error when load model with layer tensorflow.keras.layers.experimental.preprocessing.Normalization()

Hello,
I have an issue with tensorflow.keras.layers.experimental.preprocessing.Normalization().
I can't load my model when I use it.
System information

Have I custom un example script provided TensorFlow code
Linux Ubuntu 20.04
TensorFlow installed from binary

== env ==========================================================
LD_LIBRARY_PATH is unset
DYLD_LIBRARY_PATH is unset

== nvidia-smi ===================================================
Thu Jan 14 12:47:29 2021
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 460.27.04    Driver Version: 460.27.04    CUDA Version: 11.2     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  GeForce GTX 166...  On   | 00000000:08:00.0  On |                  N/A |
|  0%   49C    P8    12W / 120W |    535MiB /  5941MiB |      7%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|    0   N/A  N/A      1217      G   /usr/lib/xorg/Xorg                346MiB |
|    0   N/A  N/A      1943      G   /usr/bin/kwin_x11                  57MiB |
|    0   N/A  N/A      1956      G   /usr/bin/plasmashell               72MiB |
|    0   N/A  N/A      2367      G   ...gAAAAAAAAA --shared-files       10MiB |
|    0   N/A  N/A      3078      G   ...AAAAAAAA== --shared-files       41MiB |
+-----------------------------------------------------------------------------+

== cuda libs  ===================================================
/usr/local/cuda-11.0/targets/x86_64-linux/lib/libcudart.so.11.0.221
/usr/local/cuda-11.0/targets/x86_64-linux/lib/libcudart_static.a
/usr/local/cuda-11.0/doc/man/man7/libcudart.7
/usr/local/cuda-11.0/doc/man/man7/libcudart.so.7

== tensorflow installed from info ==================
Name: tensorflow
Version: 2.4.0
Summary: TensorFlow is an open source machine learning framework for everyone.
Home-page: https://www.tensorflow.org/
Author-email<EMAIL_ADDRESS>License: Apache 2.0
Location: /home/user/works/test-libs/venv/lib/python3.8/site-packages
Required-by:

== python version  ==============================================
(major, minor, micro, releaselevel, serial)
(3, 8, 5, 'final', 0)

== bazel version  ===============================================

Describe the current behavior
I can't load my model when I use it.
Describe the expected behavior
I would like to be able to read a model with this layer. I know it's an experimental layer but it should work.  If you have no idea how to solve it, can you advise me of an alternative?
Thank you :-)
Standalone code to reproduce the issue
import numpy as np
import pandas as pd
import tensorflow as tf
from tensorflow import keras
from tensorflow.keras import layers
from tensorflow.keras.layers.experimental import preprocessing

data = [{"a": 20.0, "b": 5.0, "c": 0.2972786923202068}, {"a": 20.0, "b": 10.0, "c": 0.10673704592967688}]
train_dataset = pd.DataFrame.from_dict(data)

train_features = train_dataset.copy()
train_labels = train_features.pop('c')

normalizer = preprocessing.Normalization()
normalizer.adapt(np.array(train_features))

dnn_model = keras.Sequential([
    normalizer,
    layers.Dense(64, activation='relu'),
    layers.Dense(64, activation='relu'),
    layers.Dense(1)
])

dnn_model.compile(loss='mean_absolute_error', optimizer=tf.keras.optimizers.Adam(0.001))
dnn_model.save('file.h5')

# ValueError: Attempt to convert a value (None) with an unsupported type (<class 'NoneType'>) to a Tensor.
new_model = tf.keras.models.load_model('file.h5')

logs
2021-01-14 12:27:41.950145: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2021-01-14 12:27:42.758932: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2021-01-14 12:27:42.759555: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2021-01-14 12:27:42.796836: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-01-14 12:27:42.797239: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties:
pciBusID: 0000:08:00.0 name: GeForce GTX 1660 Ti computeCapability: 7.5
coreClock: 1.8GHz coreCount: 24 deviceMemorySize: 5.80GiB deviceMemoryBandwidth: 268.26GiB/s
2021-01-14 12:27:42.797264: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2021-01-14 12:27:42.798974: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2021-01-14 12:27:42.799021: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2021-01-14 12:27:42.799743: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2021-01-14 12:27:42.799901: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2021-01-14 12:27:42.801635: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2021-01-14 12:27:42.802036: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2021-01-14 12:27:42.802131: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2021-01-14 12:27:42.802239: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-01-14 12:27:42.802663: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-01-14 12:27:42.802998: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2021-01-14 12:27:42.803643: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2021-01-14 12:27:42.803719: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-01-14 12:27:42.804062: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties:
pciBusID: 0000:08:00.0 name: GeForce GTX 1660 Ti computeCapability: 7.5
coreClock: 1.8GHz coreCount: 24 deviceMemorySize: 5.80GiB deviceMemoryBandwidth: 268.26GiB/s
2021-01-14 12:27:42.804079: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2021-01-14 12:27:42.804092: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2021-01-14 12:27:42.804101: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2021-01-14 12:27:42.804110: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2021-01-14 12:27:42.804119: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2021-01-14 12:27:42.804128: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2021-01-14 12:27:42.804136: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2021-01-14 12:27:42.804145: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2021-01-14 12:27:42.804191: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-01-14 12:27:42.804558: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-01-14 12:27:42.804884: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0
2021-01-14 12:27:42.804907: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2021-01-14 12:27:43.183218: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2021-01-14 12:27:43.183266: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      0
2021-01-14 12:27:43.183273: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0:   N
2021-01-14 12:27:43.183488: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-01-14 12:27:43.183873: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-01-14 12:27:43.184214: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:941] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2021-01-14 12:27:43.184529: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4868 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1660 Ti, pci bus id: 0000:08:00.0, compute capability: 7.5)
Traceback (most recent call last):
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/ops/array_ops.py", line 2873, in zeros
    shape = constant_op._tensor_shape_tensor_conversion_function(
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/framework/constant_op.py", line 355, in _tensor_shape_tensor_conversion_function
    raise ValueError(
ValueError: Cannot convert a partially known TensorShape to a Tensor: (None,)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "save.py", line 30, in <module>
    new_model = tf.keras.models.load_model('file.h5')
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/saving/save.py", line 206, in load_model
    return hdf5_format.load_model_from_hdf5(filepath, custom_objects,
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/saving/hdf5_format.py", line 183, in load_model_from_hdf5
    model = model_config_lib.model_from_config(model_config,
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/saving/model_config.py", line 64, in model_from_config
    return deserialize(config, custom_objects=custom_objects)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/layers/serialization.py", line 173, in deserialize
    return generic_utils.deserialize_keras_object(
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/utils/generic_utils.py", line 354, in deserialize_keras_object
    return cls.from_config(
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/engine/sequential.py", line 494, in from_config
    model.add(layer)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/training/tracking/base.py", line 517, in _method_wrapper
    result = method(self, *args, **kwargs)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/engine/sequential.py", line 223, in add
    output_tensor = layer(self.outputs[0])
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/engine/base_layer.py", line 951, in __call__
    return self._functional_construction_call(inputs, args, kwargs,
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/engine/base_layer.py", line 1090, in _functional_construction_call
    outputs = self._keras_tensor_symbolic_call(
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/engine/base_layer.py", line 822, in _keras_tensor_symbolic_call
    return self._infer_output_signature(inputs, args, kwargs, input_masks)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/engine/base_layer.py", line 862, in _infer_output_signature
    self._maybe_build(inputs)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/engine/base_layer.py", line 2710, in _maybe_build
    self.build(input_shapes)  # pylint:disable=not-callable
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/layers/preprocessing/normalization.py", line 174, in build
    self.mean = self._add_state_variable(
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/engine/base_preprocessing_layer.py", line 110, in _add_state_variable
    weight = self.add_weight(
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/engine/base_layer.py", line 623, in add_weight
    variable = self._add_variable_with_custom_getter(
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/training/tracking/base.py", line 805, in _add_variable_with_custom_getter
    new_variable = getter(
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 130, in make_variable
    return tf_variables.VariableV1(
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/ops/variables.py", line 260, in __call__
    return cls._variable_v1_call(*args, **kwargs)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/ops/variables.py", line 206, in _variable_v1_call
    return previous_getter(
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/ops/variables.py", line 199, in <lambda>
    previous_getter = lambda **kwargs: default_variable_creator(None, **kwargs)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/ops/variable_scope.py", line 2604, in default_variable_creator
    return resource_variable_ops.ResourceVariable(
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/ops/variables.py", line 264, in __call__
    return super(VariableMetaclass, cls).__call__(*args, **kwargs)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/ops/resource_variable_ops.py", line 1574, in __init__
    self._init_from_args(
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/ops/resource_variable_ops.py", line 1712, in _init_from_args
    initial_value = initial_value()
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/ops/init_ops.py", line 114, in __call__
    return array_ops.zeros(shape, dtype)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/util/dispatch.py", line 201, in wrapper
    return target(*args, **kwargs)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/ops/array_ops.py", line 2819, in wrapped
    tensor = fun(*args, **kwargs)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/ops/array_ops.py", line 2877, in zeros
    shape = ops.convert_to_tensor(shape, dtype=dtypes.int32)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/profiler/trace.py", line 163, in wrapped
    return func(*args, **kwargs)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/framework/ops.py", line 1540, in convert_to_tensor
    ret = conversion_func(value, dtype=dtype, name=name, as_ref=as_ref)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/framework/constant_op.py", line 339, in _constant_tensor_conversion_function
    return constant(v, dtype=dtype, name=name)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/framework/constant_op.py", line 264, in constant
    return _constant_impl(value, dtype, shape, name, verify_shape=False,
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/framework/constant_op.py", line 276, in _constant_impl
    return _constant_eager_impl(ctx, value, dtype, shape, verify_shape)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/framework/constant_op.py", line 301, in _constant_eager_impl
    t = convert_to_eager_tensor(value, ctx, dtype)
  File "/home/user/works/test-libs/venv/lib/python3.8/site-packages/tensorflow/python/framework/constant_op.py", line 98, in convert_to_eager_tensor
    return ops.EagerTensor(value, ctx.device_name, dtype)
ValueError: Attempt to convert a value (None) with an unsupported type (<class 'NoneType'>) to a Tensor.

I have tried in colab with TF-GPU version 2.4, nightly version(2.5.0-dev20210114) and I am not seeing any issue.Colab uses cuda 10.1.Please, find the gist here.Thanks!
`

I have tried in colab with TF-GPU version 2.4, nightly version(2.5.0-dev20210114) and I am not seeing any issue.Colab uses cuda 10.1.Please, find the gist here.Thanks!
`

Hello,
Thank you for your reply.
Did you run the last line of the program? In your dashboard I do not see
this line ...
The problem is in the leader function.
Le ven. 15 janv. 2021 à 17:03, ravikyram<EMAIL_ADDRESS>a
écrit :

I have tried in colab with TF-GPU version 2.4, nightly version(
2.5.0-dev20210114) and I am not seeing any issue.Colab uses cuda
10.1.Please, find the gist here
https://colab.research.google.com/gist/ravikyram/f63d9dea8f90ba37ba2ea9f594e79cd5/untitled0.ipynb
.Thanks!
`
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/tensorflow/tensorflow/issues/46427#issuecomment-761028543,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADMP3G5RGI7X5H4UYUM37NLS2BRL5ANCNFSM4WCJ74BA
.

Hello,
Thank you for your reply.
Did you run the last line of the program? In your dashboard I do not see
this line ...
The problem is in the leader function.
Le ven. 15 janv. 2021 à 17:03, ravikyram<EMAIL_ADDRESS>a
écrit :

I have tried in colab with TF-GPU version 2.4, nightly version(
2.5.0-dev20210114) and I am not seeing any issue.Colab uses cuda
10.1.Please, find the gist here
https://colab.research.google.com/gist/ravikyram/f63d9dea8f90ba37ba2ea9f594e79cd5/untitled0.ipynb
.Thanks!
`
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/tensorflow/tensorflow/issues/46427#issuecomment-761028543,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADMP3G5RGI7X5H4UYUM37NLS2BRL5ANCNFSM4WCJ74BA
.

I just added it to your colab and the problem is the same as on my computer.
'''
new_model = tf.keras.models.load_model('file.h5')
'''

I just added it to your colab and the problem is the same as on my computer.
'''
new_model = tf.keras.models.load_model('file.h5')
'''

I have tried in colab with TF nightly version and was able to reproduce the issue .Please, find the gist here.Thanks!

I have tried in colab with TF nightly version and was able to reproduce the issue .Please, find the gist here.Thanks!

@manuel-masiello Looks like there is an issue when saving in h5 format. However, there was no issue when tf format is used for saving the model. Please check the gist here. Thanks!
#dnn_model.save('file.h5')
dnn_model.save('file',save_format='tf')

new_model = tf.keras.models.load_model('file')

@manuel-masiello Looks like there is an issue when saving in h5 format. However, there was no issue when tf format is used for saving the model. Please check the gist here. Thanks!
#dnn_model.save('file.h5')
dnn_model.save('file',save_format='tf')

new_model = tf.keras.models.load_model('file')

Hello. Thanks for finding me an alternative.  :-)
I will modify my code.
FYI, I just tested with Json serialization and the error also exists. Please found the gist here.
json_config = dnn_model.to_json()
new_model = keras.models.model_from_json(json_config)

Is there a parameter equivalent to save format = 'tf' for json?
Best regards,
Manuel

Hello. Thanks for finding me an alternative.  :-)
I will modify my code.
FYI, I just tested with Json serialization and the error also exists. Please found the gist here.
json_config = dnn_model.to_json()
new_model = keras.models.model_from_json(json_config)

Is there a parameter equivalent to save format = 'tf' for json?
Best regards,
Manuel

@manuel-masiello There is no equivalent to save format = 'tf'. save_format has two options only ('tf' or 'h5'). Thanks!

@manuel-masiello I think the issue with 'h5' is due to its limitation. There are some limitations on what can be saved as part of h5 format. Please check this guide to know more about it.
I am closing this issue as this was resolved. Please feel free to reopen if I am mistaken. Thanks!


DXT5/BC3 S3TCSRGB compressed texture is rendering in linear colour space (?)

Version

Phaser Version: 3.80.1

Operating system: Mac

Browser: Chrome

Description

Using an example image and compressing to DXT5 SRGB with pvrtextool, it renders too dark (in linear colour space?)
Original image

PVR Tex Tool settings

Rendered image

Example Test Code

Codepen: https://codepen.io/mikewong/pen/qBwdyaa
Additional Information

Thanks for putting compressed textures through their paces! It's good to make sure it's all working properly.
The Problem
I've completed a survey of WebGL's colour handling, and how various people have tried to solve it.
The problem is that WebGL just treats compressed textures as the darker color space. I believe that OpenGL has some facilities for adjusting this, but they do not exist in WebGL.
The good news is, everything in that color space is handled properly. I took your PNG and converted it to linear and SRGB PVR formats, then sampled individual pixels with PVRTexTool. The linear pixels have lower values than the SRGB pixels. However, both textures render exactly the same in WebGL (and they render darker than desired). Thus, we prove that WebGL is getting the same color values from the different textures, because it knows what color space they're encoded in. It's just getting that color space consistently dark.
Possible Solutions
It's possible to write shader code to apply gamma correction to texture samples, as part of a fully color managed pipeline. This is impractical for Phaser right now.
The more practical solution is to brighten the image instead. This is what many projects appear to have done around the web - but it's always been haphazardly implemented. Everybody gets this wrong! Projects borrow test images from other projects, and update them to newer formats like ASTC, but fail to apply the color adjustments, so some of their images render correctly and some render dark, within the same demos. This appears to be a very sparsely understood area of WebGL texture handling.
A Practical Solution
Here's what I've found to be the best solution:

Create the base texture as a PNG. This could be a spritesheet out of TexturePacker, complete with texture atlas.
Create an interim lightened PNG.
Convert the lightened PNG to compressed textures as necessary.

Lightening Images
I used ImageMagick to correct PNG brightness. This is the OG of image adjustment tools and it does the job right, so far as I can tell. I have assumed that the issue is indeed sRGB/linear color conversion, and not some hidden gamma value.
I follow their discussion of sRGB Colorspace Correction. Basically, sRGB is a bit more complicated than a simple gamma curve, so it's best to be very specific about color conversion. That boils down to the following command:
magick image.png -set colorspace RGB -colorspace sRGB image-lightened.png

You can probably find other tools to do colorspace correction, but this one is direct and easy to automate.
Converting to Compressed Textures
Now encode your compressed textures from the new lightened data.
Converting with TexturePacker
TexturePacker will do this happily. Import the lightened image to a new project, select the appropriate encoding, and ensure that you've disabled all extrusion, margins etc. You just want the same image, with new encoding. TP also supports command-line encoding, if you have several types of encoding to do.
Accessibility: buy TexturePacker to access compressed texture options.
Converting with PVRTexTool
PVRTexTool is also very useful. It's not a texture packer, just a texture encoder, but the GUI is extremely good at showing you exactly what's going on with compressed textures. It also supports generating MIPMaps if you know exactly what you're doing (this is a quick way to crash WebGL, because MIPMaps have very strict requirements - basically, don't use MIPMaps unless your texture width and height are powers of two). It can also do command-line encoding, for those automated pipelines.
Accessibility: PVRTexTool is free, but requires a developer account to access the download.
Converting with ImageMagick
I was unable to find documentation for using ImageMagick to create the compressed textures directly, but it wouldn't surprise me if somebody out there has figured it out.
Accessibility: "magick" with a "K".
Conclusion
WebGL compressed textures must be lightened before encoding. Fortunately, the tools to do this are accessible. I hope this helps get the most out of compressed textures!

Thanks for providing the detailed instructions on how to convert the texture image 👍

Hm, still running into issues with the rendering (not sure if this should be a separate ticket) where semi transparent alpha images are rendering as solid colour https://codepen.io/mikewong/pen/NWmxKVa
Original image:

Converted to DXT5 with Texture Packer to:
semi-transparent.pvr.zip
Which when previewed, looks like this:

But in Phaser 3.70.0 (doesn't run in Phaser 3.80.1 due to https://github.com/phaserjs/phaser/issues/6756), it looks like this:

I'm loading the full atlas above via the multi texture atlas route in 3.80.1 as that renders but still has solid colour where there should be semi transparent pixels

This texture actually will work in 3.80! Change the type from S3TC to S3TCSRGB (WebGL implements these as different extensions, apparently because it was an early extension and they didn't know any better). It will appear darker, of course, but my machine produces the following results from your code:

The alpha certainly appears to be misbehaving when we're misinterpreting the data as linear S3TC in 3.70. I'm not certain why that is, but I suspect it's because we're just giving it the wrong data. I know there are some minor differences between S3TC and S3TCSRGB beyond just the colorspace; for example, the S3TCSRGB extension has different rules for MIPMap dimensions. I'm not sure it's worth figuring out the exact reason why it's getting alpha wrong, though, because it was never intended to be used this way. Phaser 3.80 is correct - or at least as correct as I can understand to make it!

WebGL can be a bit obtuse with the error codes. We've tried to make them a bit friendlier, so if you try to load this texture with S3TC it says Compressed Texture Invalid: "labs". Texture format S3TC with internal format 35919 not supported by the GPU. Texture invalid. This is often due to the texture using sRGB instead of linear RGB.. But what is internal format 35919? All the documentation around WebGL uses hexcodes instead. We can use the browser console to get (35919).toString(16) = 0x8c4f, which will eventually lead you to the format COMPRESSED_SRGB_ALPHA_S3TC_DXT5_EXT. In Phaser 3.70 we accidentally interpreted it as COMPRESSED_RGBA_S3TC_DXT5_EXT.
The other way to see what you're looking at is to just use PVRTexTool, which will open the PVR and immediately tell you BC3 UNorm sRGB in the bottom-left corner. BC3 means DXT5, which is part of the S3TC/S3TCSRGB set of formats; UNorm means it's in the data representation expected for WebGL, unsigned as opposed to signed; and sRGB means sRGB. PVRTexTool also shows me that the alpha values are encoded as expected in the squares you pointed out (75 instead of 255).
I hope that helps you properly identify texture compression! It's pretty obscure stuff unless you know where to look.

This texture actually will work in 3.80!

Ah, changing it to S3TCSRGB works for the codepen but not in our actual project 🤔 . We are loading it a different way but don't see errors in the console.log
        loader.texture('somekey', {
          S3TCSRGB: { type: "PVR", multiAtlasURL: { textures: [someJsonData] } },
        }),

Apologies, I didn't see this until just now. GitHub is not very good at showing me updates for some reason!
This is difficult to debug without looking at the actual files, I'm afraid. Is it possible to link the relevant files? Original, lightened, and compressed would give me good points to check. Obviously the texture was encoded incorrectly - it looks like the alpha is 1-bit, which looks more like DXT1/BC1 than DXT5. Or maybe premultiplication did something unexpected.

This is difficult to debug without looking at the actual files, I'm afraid. Is it possible to link the relevant files?

I will have to come back to this in a week or so as it's already taking too much dev time on my end trying to debug the issue and we've already deprioritised it.


Clear notification based on other notification

Hi,
I am building an app which uses the phonegap-plugin-push for notifications, but I want to have to ability to clear notification on a device through my server. As far as I am aware this is currently not possible. But I had the idea to make use of the local clearNotification method, if the received notification contains a specific payload, lets says clearNotificiationId, and we have that notification id, then clear it.
This allows developers to clear notification on devices when the app is not running. I am willing to make PR for this, considering I need it myself. But I was wondering what your thoughts are about this before providing it. Or if you know of a way to do this already.
If the given solution is not wanted, or should be implemented differently, I am all ears. If its not wanted I will just make a fork and implemented it myself. But I hope it is possible to keep it in the upstream.

Can't you send the notification id and use it to clear it with clearnotification method?
https://github.com/phonegap/phonegap-plugin-push/blob/master/docs/API.md#pushclearnotificationid-successhandler-errorhandler---ios--android-only

Well yes ofcourse, but that would only work if the app is not killed, the idea is to make it possible from the background swell.

@wolfenrain sure, I'd love to see a PR on this.

Not even the Gmail app features this.... notifications for read emails persist in the phone notifications bar. The current approach is to simply update the old notification with a newer, updated one, and it's not that bad anyway.

@andreszs Well that is how GMail works. But what if you build a chat application or a phone call application? I can imagine the use-case that people would like to send a notification to a user, notify-ing them that there are unread chats. But the user has multiple devices hooked to the chat application and reads the messages on device 1. On device 2 we would like to completely remove that notification.
Same goes for a phone application. If a user has 2 devices hooked to the application and both are ringing because of a push messages. On 1 device you answer. On the other device you would like to remove the push notification as the call has been answered.
I guess there are use-cases you can imagine that is useful for having this solution.

@macdonst I will start working on the PR now. :-)


SA1134 exception for auto-properties

SA1134 prevents attributes from sharing the line with other code.
Consider this line of code:
public bool? DisableCaching { get; [UsedImplicitly] set; }

[UseImplicitly] is a Resharper annotation to avoid "Auto-property accessor never used warning" (UnusedAutoPropertyAccessor.Global).
Making this auto-property span over three lines just to avoid SA1134 seems wrong:
public bool? DisableCaching { get;
    [UsedImplicitly]
    set; }

Disabling the rule also "costs" three lines:
#pragma warning disable SA1134
    public bool? DisableBundling { get; [UsedImplicitly] set; }
#pragma warning restore SA1134

Can we have an exception for SA1134 for this case (like we already have for attributes for (type) parameters)?

Duplicate of #1938


feat(ci): add trufflehog secrets detection

What does this PR do?
Adding a GH action to scan for leaked secrets on each commit.

Job seems to fail: https://github.com/huggingface/huggingface.js/actions/runs/9517113121/job/26234899723

Looks like you used a ' in your commit message and the script wasn't expecting it. Let me check if I can find a way to circumvent.


water is invisible through a transparent player

Description

Steps to Reproduce
NeoForge 47.1.104
Shoulder Surfing Reloaded 1.20.1-3.1.0
(no other mods)
Minecraft version
1.20.1
Game Logs
https://mclo.gs/O3vzqVZ
Additional Information
No response

This is a bug of vanilla minecraft, there is nothing I can do about this.


Input type email doesn't work in combination with setting different user agent

What is your Test Scenario?
I need to start up Chrome using a different user-agent to trigger certain behavior, then I need to fill in an email input field.
What is the Current behavior?
TestCafé types the first character of the email 40ish times and then crashes. Except when AppleWebKit is contained in the user-agent string.
What is the Expected behavior?
Email is typed into email field
What is your web application and your TestCafe test code?
https://github.com/BobLuursema/testcafe-issue-demo
Steps to Reproduce:
git clone https://github.com/BobLuursema/testcafe-issue-demo.git
cd testcafe-issue-demo
npm install
node run.js

See that the email field isn't filled in correctly. Now change the commented lines in run.js to see that it works.
Your Environment details:

testcafe version:                   1.7.1
node.js version:                    12.2
browser name and version: Chrome 79.0.3945.88
platform and version:          Windows 10 1809

This is probably the most specific bug I've found anywhere :-P

Please look at the following issue where we discussed this behavior: https://github.com/DevExpress/testcafe/issues/3109.


⚠ gorzdrav.org has degraded performance

In 0fe8dac, gorzdrav.org (https://gorzdrav.org) experienced degraded performance:

HTTP code: 200
Response time: 1728 ms

Resolved: gorzdrav.org performance has improved in 431a611.


Crash in Crashlytics - android.app.Activity.startActivityForResult(android.content.Intent, int)' on a null object reference

Steps to Reproduce
Brand: samsung
Model: Galaxy A3
Orientation: Portrait
RAM free: 467.27 MB
Disk free: 717.11 MB
Version: 6.0.1
Orientation: Portrait
Rooted: No

Unfortunately, I don't have any steps.
Expected results:
The application can be used without crashes.
Actual results:
Crash in crashlytics

Logs

Fatal Exception: java.lang.NullPointerException: Attempt to invoke virtual method 'void android.app.Activity.startActivityForResult(android.content.Intent, int)' on a null object reference
       at i.a.b.a.a.a.a()
       at i.a.b.a.a.a.a()
       at i.a.b.a.a.a$f.onFailure()
       at b.c.b.a.h.u.run()
       at android.os.Handler.handleCallback(Handler.java:739)
       at android.os.Handler.dispatchMessage(Handler.java:95)
       at android.os.Looper.loop(Looper.java:148)
       at android.app.ActivityThread.main(ActivityThread.java:7331)
       at java.lang.reflect.Method.invoke(Method.java)
       at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:1230)
       at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:1120)

Doctor summary (to see all details, run flutter doctor -v):
[✓] Flutter (Channel stable, v1.17.1, on Mac OS X 10.15.4 19E287, locale en-GB)

[✓] Android toolchain - develop for Android devices (Android SDK version 29.0.2)
[✓] Xcode - develop for iOS and macOS (Xcode 11.5)
[✓] Android Studio (version 3.6)
[!] IntelliJ IDEA Community Edition (version 2019.3.4)
    ✗ Flutter plugin not installed; this adds Flutter specific functionality.
    ✗ Dart plugin not installed; this adds Dart specific functionality.
[✓] Connected device (1 available)

Adding [crash.log] logs file:
(https://github.com/flutter/flutter/files/4676819/com._issue_66334f4f17db8c4e6c16b0b5e4e797e7_crash_session_5ECA43A8011C00013EAAC581546CEFCF_DNE_0_v2.log)

Hi @GyuriMajercsik
can you please provide your flutter doctor -v and flutter run --verbose?
Also, to better address the issue, would be helpful if you could post a minimal code sample to reproduce the problem
Thank you

Hi Taha,
Thanks for taking a look into this. Unfortunately I can't provide with any steps or code sample since this crash was collected by Crashlytics.
I'm attaching the requested files. Please let me know if I can assist you with anything.
flutter_doctor_verbose.txt
flutter_run_verbose.txt
Thank you,
Gyuri

One more crash reported by Crashlytics:
Brand: samsung
Model: Galaxy S5
Orientation: Portrait
RAM free: 396.59 MB
Disk free: 593.16 MB
Version: 6.0.1
Orientation: Portrait
Rooted: No
Fatal Exception: java.lang.NullPointerException: Attempt to invoke virtual method 'void android.app.Activity.startActivityForResult(android.content.Intent, int)' on a null object reference
       at i.a.b.a.a.a.a()
       at i.a.b.a.a.a.a()
       at i.a.b.a.a.a$f.onFailure()
       at b.c.b.a.h.u.run()
       at android.os.Handler.handleCallback(Handler.java:739)
       at android.os.Handler.dispatchMessage(Handler.java:95)
       at android.os.Looper.loop(Looper.java:158)
       at android.app.ActivityThread.main(ActivityThread.java:7224)
       at java.lang.reflect.Method.invoke(Method.java)
       at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:1230)
       at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:1120)

Hello guys,
Have you found any solution for this problem? I have a similar issue.

@luisbazan s stack trace seems to indicate a different issue to the OP. Would it be possible to deobfuscate the stack trace or provide a reduced test case? Without that, it is hard to make progress on this bug.

Without additional information, we are unfortunately not sure how to resolve this issue.
We are therefore reluctantly going to close this bug for now.
Please don't hesitate to comment on the bug if you have any more information for us; we will reopen it right away!
Thanks for your contribution.
Could everyone who still has this problem please file a new issue with the exact description of what happens, logs, and the output of flutter doctor -v.
All system setups can be slightly different, so it's always better to open new issues and reference related issues.


Add blog link that speaks about how kam cli works

Signed-off-by: Samyak Jain<EMAIL_ADDRESS>What type of PR is this?
/kind documentation
What does this PR do / why we need it:
Just a quick PR to add the blog link so everyone going through documentation can refer for verbose information.
Have you updated the necessary documentation?

[x] Documentation update is required by this PR.
[x] Documentation has been updated.

/test v4.8-integration-e2e


feat(platform): add documentation for scoped API tokens

We're adding public facing documentation for a new feature, tokens with limited permissions, aka scoped tokens.
Full context is available in the design doc.

Hey folks, asking for early review. What's missing are screenshots, which I won't be able to provide before we finish the UI. However, the copy is final (= ready for review) from my PoV.
Also tagged @jirimoravcik as he is only semi-familiar with the project, so he'll be able to give useful feedback if the documentation is easy to understand / sufficiently detailed.

Updated the documentation:

Added short instructions on how to create a scoped token
Added 2 temporary screenshots, to be replaced with the actual ones once the UI is finished (I see no other use cases for screenshots)
Unified callouts to use note across the board
Minor copy changes

Currently the docs are missing [...], and what all the various permissions are.

Agreed with Franta that this is not necessary.

I also think the API page should be displayed more prominently, not just two levels deep in Integrations, where it gets a bit lost. But that's a problem for another task.

Hmm I guess. cc @TC-MO

Cool, thanks for the review :heart:
Let's wait now for Kuba and for how we decide to proceed with the UI.

Changes look good, let's wait to final design implementation.

Alright, this PR is pretty much ready.
We synced with @TC-MO and made some changes together:

We got rid of some of the gerunds in headings
We kept the generic admotion titles ("Tip" / "Note") to see if people like them

I resolved all the pending conversions which were related to these topics.
@TC-MO @drobnikj feel free to take a look and approve :pray:

I merged the public release to develop today, we can manage it to prod today.
Let's merge this @tobice

Won't make it to today's release. Lets's merge it tomorrow.


Add configuration for console-plus.js

I know I can scroll down and edit the code to change username, password and port but it would be nice to have this in the config file :)

No, because console-plus is an addition to the server.

ok then I will make my own console-plus.json config file ¯_(ツ)_/¯


Training model on custom dataset

Could you tell whether it is possible to train one of already implemented models on custom dataset for mask simulation? if yes, could you provide an instruction or may be an example in collab? it would be super cool :)

Sorry for replying late. This can be achieved by adding the new model or dataset in lithobench/train.py and lithobench/test.py.


Suggestion: Instructions should point to an alternative to "curl | sh" method of installation

You know, all this wonderful effort goes into creating nice signed distro packaging, and yet I have to study some random shell scripts or dig through 3rd-party blogs just to find the information I needed to configure our whitelists appropriately and get docker running without having to run some unsigned script piped into my shell over https :-)
I'm talking about the instructions at:

https://docs.docker.com/installation/debian/ (gives a sources.list line example, but it's for debian's repo which is stuck on 1.7)
https://docs.docker.com/installation/ubuntulinux/ (for the words that are dedicated to installing and using curl, it seems we could just as easily have explained how to add a sources.list and apt-key one-liner :-)

Over the past 12 months, it seems my whitelists have contained:

get.docker.io
get.docker.com
apt.dockerproject.org

Each time this changes, it seems weird there's no canonical place which points to where the current official packages are being published to.
But perhaps it's just me that's weird...

Hi!
Please read this important information about creating issues.
If you are reporting a new issue, make sure that we do not have any duplicates already open. You can ensure this by searching the issue list for this repository. If there is a duplicate, please close your issue and add a comment to the existing issue instead.
If you suspect your issue is a bug, please edit your issue description to include the BUG REPORT INFORMATION shown below. If you fail to provide this information within 7 days, we cannot debug your issue and will close it. We will, however, reopen it if you later provide the information.
This is an automated, informational response.
Thank you.
For more information about reporting issues, see https://github.com/docker/docker/blob/master/CONTRIBUTING.md#reporting-other-issues

BUG REPORT INFORMATION
Use the commands below to provide key information from your environment:
docker version:
docker info:
uname -a:
Provide additional environment details (AWS, VirtualBox, physical, etc.):
List the steps to reproduce the issue:
1.
2.
3.
Describe the results you received:
Describe the results you expected:
Provide additional info you think is important:
----------END REPORT ---------
#ENEEDMOREINFO

I'm not sure that this bug report fits the required template...

@csirac2 I think this would be handled when #16593 will be taken care of, don't you think ?
So I'm tempted to close one of it as it's duplicate.

And the PR that should fix it is there : #16662 :wink:

@vdemeester I standardized as rpm/yum being the way to go.  Curl is the if you must version.  This once can get closed.

This can be closed, neither #16593 nore #16662 didn't exist when I created this. Thanks!

Cool :wink:

@csirac2 Thank you for contributing the issue...really appreciate that.


refactor: Use Python 3.9 type annotations

what.

Refactor codebase to use old-style type annotations like Union and Optional in place of Python 3.10's new | (union) operator.
Update workflows to run tests against Python 3.9, simplify publishing pipeline
Update workflows to install Poetry via github action
Update README and other docs mentioning minimum supported version.

why.
To support still alive Python 3.9 version.
There might be more work needed in order to support earlier versions, I just need this to work under 3.9.
IMHO rewriting this to support Py3.7 is not worth it, as it's going EOL in 9 months. Maybe 3.8 is worth supporting.
references.
Fixes #109
https://endoflife.date/python

FYI @arthurio, @sizfx

@bartelemi Thank you so much, taking a look now.

@bartelemi If you give me permissions to push code I can commit the stuff you missed.

I missed the fact that you wanted me to update the notation in docs as well. I wanted to do similar thing to what fastapi docs have - separate examples for Py3.10 and earlier versions, but I am not familiar with the syntax for that. So I've just updated the syntax to be Py3.9 compatible for now.

I missed the fact that you wanted me to update the notation in docs as well. I wanted to do similar thing to what fastapi docs have - separate examples for Py3.10 and earlier versions, but I am not familiar with the syntax for that. So I've just updated the syntax to be Py3.9 compatible for now.

I don't know the notation either haha, but it's a good idea, I'll look into it.

Feel free to kick off test pipelines and merge this PR if you're happy with it 👍🏻

We'll do, thanks a lot!


How to create pages menu which when I click open an external page

Describe the problem feature solves
I have a use case where I need to create menu which opens to the external page. How I do that in Admin bro?
Describe the solution you'd like
A simple API to create menu and include the link or admin bro path

you have 2 optons:

one is to create a simple page (https://adminbro.com/AdminBroOptions.html#pages), but there you will have to create a component rendering it there is no way of linking to external URL right now)
the second is to override footer component:

// somewhere in the code
AdminBro.bundle('./your-new-component', 'SidebarFooter')

and your-new-component will appear on the bottom of the sidebar - where you can put whatever you like
hint: Another option would be to override an entire SidebarResourceSection where you can order menu as you like

@wojtek-krysiak an possibilities to add a custom sub-menu in the sidebar? Is the sidebar already extendable?

yes. take a look at AdminBro.bundle. as the second argument you can pass component name which you want to override. Not all components are overridable. In frontend/utils/overridable-component.ts there is a list of component names. This not documented well yet

Any update to this issue or are we still stuck with the same limitation?


We should be using modelFroms for profile

When you edit the profile your First Name, Last Name and Bio return 500 errors if you make them longer than is allowed

Ok, maybe not. This would kill all of our form error css which i would rather not re-implement. Seems like we need two things: limit the first_name / last_name fields to 30 characters and make a migration that allows us to have up to 255 characters for our display name.


startFullscreen causing Dom objects hidden

Version

Phaser Version:

3.17

Operating system:

Browser:

chrome, firefox, chrome android
Description

If i set my game to fullscreen (startFullscreen), all Dom objects are hidden (iframe, text input, img), if exit fullscreen, dom object are shown.
Example Test Code

this.scale.startFullscreen();
this.add.dom(640,360).createFromCache('contact').setOrigin(0.5,0.5);
Additional Information

We are also facing the same issue. Any updates ?

You can only fullscreen one single dom element (and its children) at a time. So create one in your page, make sure Phaser uses it as the parent in the game config and set that as being the fullscreen target.

Yes. creating a div explicitly in html and passing that as the parent to the game object solved the issue. thanks.


added no videos msg to the preview boxes

Added msg for when no videos are displayed in the preview boxes.

Replace "No videos here yet" text with "These aren't the videos you are looking for" - COMPLETED
replacement text element should completely replace "Loading..." within the same page space using the same styles - COMPLETED

"Loading..." should exist by default - COMPLETED
replacement text should conditionally replace "Loading..." if no videos are returned - COMPLETED
replacement text should conditionally replace "Loading..." after 10s if no videos are returned - NOT COMPLETE, we decided to defer this for now given the amount of time to complete this task with the current framework
If replacement text is fired fadeOut "Loading.." and pop replacement text in...this could also be done the opposite way...really..this one will take a little tweaking...the goal is to smooth out the transition - COMPLETE, decided to use a "blink" operation on the cell along with fade for the text

Tested on Safari, Chrome, and Firefox.  No obvious issues that I can see in any of those browsers.


IdentityServer3.MongoDb and IdentityServer3.MongoDb.Admin not working together with latest version of both

Hi,
i am trying to run one of our solution to add Identity Server Client to mongo Db bu start getting erro after i upgraded idenittyserver3.MongoDb to 2.1.1 same work if i use 2.0.1
i am getting below error
Method not found: 'MongoDB.Driver.ObjectFilterDefinition`1<MongoDB.Bson.BsonDocument> IdentityServer3.MongoDb.Filter.ById(System.Object)'.

yeah, i didn't have time to update admin yet, it is on my todo list for this weekend

Ok, part of the problem is that 2.0.1 is a package i thought i had unlisted because the id of the module changed. you want to be using IdentityServer3.MongoDb.Admin version 3.1.0. I have updated that to work with the latest version, please migrate to the new package and let me know if that fixes your issues

Thanks , it is working now

awesome :)

Hi, i just noticed that even identiyserver3 version alos get updated , is it necessary ? as we started gettting some error in our application after that update of identityserver 2.6 previously it was on 2.4

I believe so. what error are you getting?
On 13 February 2017 at 12:26, VjParmar<EMAIL_ADDRESS>wrote:

Hi, i just noticed that even identiyserver3 version alos get updated , is
it necessary ? as we started gettting some error in our application after
that update of identityserver 2.6 previously it was on 2.4
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/jageall/IdentityServer.v3.MongoDb/issues/43#issuecomment-279374862,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AEYR6eeGAFMR5r4FBm34o48-xJEXmTnFks5rcEwLgaJpZM4L9WlQ
.


WIP - Aligned the CSV with the output from the 'gen-csv' command

This is the first step in getting #604 done.

A new CSV was generated using operator-sdk olm-catalog gen-csv --csv-channel=stable --default-channel --csv-version=1.13.1, and its contents replaced with the current CSV. A new CSV was then generated for the "next" version, and most of the upcoming changes were cherry-picked.
The first commit still has the current CSV file, to make it easy to compare the changes. The second commit then removes the CSV.
The diff between 1.13.1 and a hypothetical 1.13.2 is as follows:
5c5,54
<     alm-examples: '[{"apiVersion":"io.jaegertracing/v1alpha1","kind":"Jaeger","metadata":{"name":"example-jaeger"}},{"apiVersion":"jaegertracing.io/v1","kind":"Jaeger","metadata":{"name":"example-jaeger"}}]'
---
>     alm-examples: |-
>       [
>         {
>           "apiVersion": "jaegertracing.io/v1",
>           "kind": "Jaeger",
>           "metadata": {
>             "name": "my-jaeger"
>           },
>           "spec": {
>             "strategy": "allInOne",
>             "allInOne": {
>               "image": "jaegertracing/all-in-one:1.13",
>               "options": {
>                 "log-level": "debug",
>                 "query": {
>                   "base-path": "/jaeger"
>                 }
>               }
>             },
>             "ui": {
>               "options": {
>                 "dependencies": {
>                   "menuEnabled": false
>                 },
>                 "tracking": {
>                   "gaID": "UA-000000-2"
>                 },
>                 "menu": [
>                   {
>                     "label": "About Jaeger",
>                     "items": [
>                       {
>                         "label": "Documentation",
>                         "url": "https://www.jaegertracing.io/docs/latest"
>                       }
>                     ]
>                   }
>                 ]
>               }
>             },
>             "storage": {
>               "options": {
>                 "memory": {
>                   "max-traces": 100000
>                 }
>               }
>             }
>           }
>         }
>       ]
9c58
<     containerImage: docker.io/jaegertracing/jaeger-operator:1.13.2
---
>     containerImage: docker.io/jaegertracing/jaeger-operator:1.13.1
15c64
<   name: jaeger-operator.v1.13.2
---
>   name: jaeger-operator.v1.13.1
90c139
<     mediatype: image/svg+xml
---
>     mediatype: image/svg+xml
310c359
<   replaces: jaeger-operator.v1.13.1
---
>   replaces: jaeger-operator.v1.13.0
314c363
<   version: 1.13.2
---
>   version: 1.13.1

Note that the change related to alm-examples is caused by https://github.com/operator-framework/operator-sdk/issues/1847. That's the reason why this PR isn't including the generation of new CSVs during the release process.

Also may need to confirm with operatorhub team when the community operators should use the subfolders for CSVs - currently they use a flat structure.

This actually depends on #607, as the gen-csv for 0.8.2 is kinda broken for our case. I'd also only consider merging this once operator-framework/operator-sdk#1847 is fixed, which might mean that we need to wait for 0.10.1 or 0.11.0.
In the meantime, I'll open an issue with the operatorhub team, asking about the flat structure.

I rebased this on top of #665, which is based on master. This now looks good, but requires an unreleased version of the Operator SDK, otherwise we'd hit both operator-framework/operator-sdk#1847 and operator-framework/operator-sdk#1846 .
I took a diff between the new CSV (temporarily set to 1.14.1) and the previous one (1.14.0), sorting the YAML keys, and this is what I got:
89c89
<   name: jaeger-operator.v1.14.0
---
>   name: jaeger-operator.v1.14.1
207a208,211
>                 - replicasets
>                 - deployments
>                 - daemonsets
>                 - statefulsets
239a244,260
>             -
>               apiGroups:
>                 - rbac.authorization.k8s.io
>               resources:
>                 - clusterrolebindings
>               verbs:
>                 - "*"
>             -
>               apiGroups:
>                 - apps
>                 - extensions
>               resourceNames:
>                 - jaeger-operator
>               resources:
>                 - deployments/finalizers
>               verbs:
>                 - update
252d272
<                 creationTimestamp: ~
386c406
<   replaces: jaeger-operator.v1.13.1
---
>   replaces: jaeger-operator.v1.14.0
390c410
<   version: "1.14.0"
---
>   version: "1.14.1"

The difference in the permissions are probably due to the roles.yaml file being changed without performing the same changes to the CSV.
After that, I generated 1.14.2 and cherry-picked the changes back to 1.14.1. When a new version is generated, this is the expected diff:
87c87
<   name: jaeger-operator.v1.14.1
---
>   name: jaeger-operator.v1.14.2
370c370
<   replaces: jaeger-operator.v1.4.0
---
>   replaces: jaeger-operator.v1.14.1
374c374
<   version: 1.14.1
---
>   version: 1.14.2

With all that, I'm confident the YAMLs are equivalent. Once we get this one here merged, I'll work on automating the release with the gen-csv command.

@objectiser I think I would merge this one rather soon, as the release process is somewhat manual until I figure out the proper way to handle that in GitHub Actions. This does require a master version of the operator-sdk for the moment, until 0.11.0 is released.

@jpkrohling Fine with me, just need to make sure we know any changes to the release process in case others are doing it.

I updated this PR to include:

an update to RELEASE.md, with current instructions on how to release the operator
a script that copies the generated CSV/package files to the Operator Hub repository, potentially submitting a PR if hub is available (see operator-framework/community-operators#699 and operator-framework/community-operators#700 for examples).


Skipping repeated sixels

I am stuck trying to figure out if there is a good way in the libsixel code to skip drawing sixels that contain the same pixels as the previously drawn frame. This would, in combination with ordered/positionally stable dithers which I have already implemented - probably result in size/bandwidth savings for some uses like qemu/sdl/vnc/video.
See http://pippin.gimp.org/a_dither/ for examples of similar size savings for GIF animations, and https://github.com/hodefoting/libsixel for a branch with a commit adding positionally stable dithers - and a commit starting to work on tracking frame deltas.

In SIXEL terminals as far as I know, there is no way to apply delta frames into the last frame.
Instead, we can overwrite SIXEL image in a unit of a text cell area.
In SDL1.2-SIXEL and Xsixel, only the cells including the updated rectangle is rendered.
Or we might be able to reduce the number of colors while maintaining the quality of images, by using dithering along the time axis.
Since libsixel have only error diffusion algorithm, I'm interested in your dither algorithm. PR is welcome.

Updating single cells would be the next best thing over updating a full sixel (or even just some pixels within a sixel). I haven't looked into the details of how multiple layes of color are put down, but was imagining it to be some form of per color overwrite...  a pull request with the positional methods have been made :)

Have looked into documentation on the sixel format. The initialization sequence for sixel takes, and have implemented a converter https://gist.github.com/hodefoting/272889a5d9d7859cb8aabc187901e6bc for taking a PNG and turning it into a 15grays put down in layers converter. (scale images down before converting). This works as expected and thus permits partial frame updates with xerm, however with mlterm the contents is always replaced with backgrour color - not sure what behavior actual terminals have.
vw.sixel.txt


fix(transform): remove dead code

Removes some lingering deps. Thanks!

Current coverage is 97.22% (diff: 100%)

Merging #104 into master will increase coverage by 1.22%

@@             master       #104   diff @@
==========================================
  Files             2          2
  Lines           150        144     -6
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
- Hits            144        140     -4
+ Misses            6          4     -2
  Partials          0          0

Powered by Codecov. Last update e0cb38d...ab216c5

:+1:


What happens if the user forgets there password?

Trying to think of a worse case scenario - if the local data is encrypted using a user generated password and then they forget it.
Is the local data unrecoverable?  The constraint we have is its a local Javascript application so can be decompiled if the laptop was stolen and the other Windows security measures fail (Secure Login / Bitlocker).
I guess we could store the users password on the server so it could be recovered but of course this is bad practice.
Any suggestions?

yes the data would be unrecoverable without knowing the password

Closing this issue for now, since it's been a few years :)


Ispn 6679/healthcheck api

Opened as a rebased and refreshed version of https://github.com/infinispan/infinispan/pull/4499
https://issues.jboss.org/browse/ISPN-6679
https://issues.jboss.org/browse/ISPN-7028
Still to be done:

https://issues.jboss.org/browse/ISPN-7268, as soon as the new code is available in Wildfly release

Highlights:

I managed to get rid of synthetic node
Switched to ReversedLinesFileReader from Commons-IO

Thanks @slaskawi :)


Error when verify.js throw errors

Hello,
I have a problem, the errors that throw in the file "src/verify.ts" do not go up in the console.
I encounter an error, here is the console output:
[2:20:54 PM] [semantic-release] › ✖  An error occurred while running semantic-release: AggregateError
    at verify (/builds/mlaplanche/**/node_modules/@droidsolutions-oss/semantic-release-nuget/dist/src/verify.js:50:15)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at async validator (/builds/mlaplanche/**/node_modules/semantic-release/lib/plugins/normalize.js:34:24)
    at async /builds/mlaplanche/**/node_modules/semantic-release/lib/plugins/pipeline.js:37:34
    at async /builds/mlaplanche/**/node_modules/semantic-release/lib/plugins/pipeline.js:31:3
    at async Object.pluginsConf.<computed> [as verifyConditions] (/builds/mlaplanche/**/node_modules/semantic-release/lib/plugins/index.js:80:11)
    at async run (/builds/mlaplanche/**/node_modules/semantic-release/index.js:103:3)
    at async module.exports (/builds/mlaplanche/**/node_modules/semantic-release/index.js:269:22)
    at async module.exports (/builds/mlaplanche/**/node_modules/semantic-release/cli.js:55:5) {
  pluginName: '@droidsolutions-oss/semantic-release-nuget'
}
AggregateError:
    AggregateError
        at verify (/builds/mlaplanche/**/node_modules/@droidsolutions-oss/semantic-release-nuget/dist/src/verify.js:50:15)
        at processTicksAndRejections (node:internal/process/task_queues:96:5)
        at async validator (/builds/mlaplanche/**/node_modules/semantic-release/lib/plugins/normalize.js:34:24)
        at async /builds/mlaplanche/**/node_modules/semantic-release/lib/plugins/pipeline.js:37:34
        at async /builds/mlaplanche/**/node_modules/semantic-release/lib/plugins/pipeline.js:31:3
        at async Object.pluginsConf.<computed> [as verifyConditions] (/builds/mlaplanche/**/node_modules/semantic-release/lib/plugins/index.js:80:11)
        at async run (/builds/mlaplanche/**/node_modules/semantic-release/index.js:103:3)
        at async module.exports (/builds/mlaplanche/**/node_modules/semantic-release/index.js:269:22)
        at async module.exports (/builds/mlaplanche/**/node_modules/semantic-release/cli.js:55:5)
    at /builds/mlaplanche/**/node_modules/semantic-release/lib/plugins/pipeline.js:54:11
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at async Object.pluginsConf.<computed> [as verifyConditions] (/builds/mlaplanche/**/node_modules/semantic-release/lib/plugins/index.js:80:11)
    at async run (/builds/mlaplanche/**/node_modules/semantic-release/index.js:103:3)
    at async module.exports (/builds/mlaplanche/**/node_modules/semantic-release/index.js:269:22)
    at async module.exports (/builds/mlaplanche/**/node_modules/semantic-release/cli.js:55:5)

I use the latest version.
Thank you for your feedback

Hi,
can you test this version of the plugin:
<EMAIL_ADDRESS>

@LaplancheMaxime Could you verify that the error message is visible now? I would like like to merge it but hadn't had an opportunity to test it myself.

I merged the changes to the main branch which is included in 1.2.0. I'll close this issue, if the problem containues to exist, please comment and I'll reopen it.


netdata: most plugins not working

Describe the bug
When starting netdata, most collector plugins fail to start. Here is a list of the failing plugins:

freeipmi.plugin
perf.plugin
charts.d.plugin
python.d.plugin
ioping.plugin
fping.plugin
node.d.plugin

Steps To Reproduce
Steps to reproduce the behavior:

services.netdata.enable = true;
journalctl -u netdata.service

Expected behavior
I expected the plugins to work. (duh)
I remember them working earlier, but in the git history I cannot find anything that would affect their performance, apart from maybe https://github.com/NixOS/nixpkgs/pull/72187
Screenshots
journalctl snippet:
Jun 16 22:31:36 z800 netdata[1115906]: connected to '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/nfacct.plugin' running on pid 1115976
Jun 16 22:31:36 z800 netdata[1115906]: connected to '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/node.d.plugin' running on pid 1115977
Jun 16 22:31:36 z800 netdata[1115906]: connected to '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/go.d.plugin' running on pid 1115980
Jun 16 22:31:36 z800 netdata[1115906]: connected to '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/ioping.plugin' running on pid 1115982
Jun 16 22:31:36 z800 netdata[1115906]: connected to '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/fping.plugin' running on pid 1115981
Jun 16 22:31:36 z800 netdata[1115906]: connected to '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/python.d.plugin' running on pid 1115983
Jun 16 22:31:36 z800 netdata[1115906]: connected to '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/charts.d.plugin' running on pid 1115984
Jun 16 22:31:36 z800 netdata[1115906]: connected to '/nix/store/83jwyriqvra4fpvxlc8ch3120880h1vm-wrapped-plugins/libexec/netdata/plugins.d/freeipmi.plugin' running on pid 1115986
Jun 16 22:31:36 z800 netdata[1115906]: connected to '/nix/store/83jwyriqvra4fpvxlc8ch3120880h1vm-wrapped-plugins/libexec/netdata/plugins.d/perf.plugin' running on pid 1115987
Jun 16 22:31:36 z800 netdata[1115906]: connected to '/nix/store/83jwyriqvra4fpvxlc8ch3120880h1vm-wrapped-plugins/libexec/netdata/plugins.d/apps.plugin' running on pid 1115985
Jun 16 22:31:36 z800 netdata[1115906]: read failed: end of file
Jun 16 22:31:36 z800 netdata[1115906]: PARSER ended
Jun 16 22:31:36 z800 netdata[1115906]: '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/node.d.plugin' (pid 1115977) disconnected after 0 successful data collections (ENDs).
Jun 16 22:31:36 z800 netdata[1115906]: child pid 1115977 exited with code 127.
Jun 16 22:31:36 z800 netdata[1115906]: '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/node.d.plugin' (pid 1115977) exited with error code 127 and haven't collected any data. Disabling it.
Jun 16 22:31:36 z800 netdata[1115906]: thread with task id 1115964 finished
Jun 16 22:31:36 z800 netdata[1115906]: read failed: end of file
Jun 16 22:31:36 z800 netdata[1115906]: PARSER ended
Jun 16 22:31:36 z800 netdata[1115906]: child pid 1115979 exited with code 127.
Jun 16 22:31:36 z800 netdata[1115906]: '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/fping.plugin' (pid 1115981) disconnected after 0 successful data collections (ENDs).
Jun 16 22:31:36 z800 netdata[1115906]: TC: tc-qos-helper.sh exited with code 127. Disabling it.
Jun 16 22:31:36 z800 netdata[1115906]: cleaning up...
Jun 16 22:31:36 z800 netdata[1115906]: thread with task id 1115955 finished
Jun 16 22:31:36 z800 netdata[1115906]: child pid 1115981 exited with code 127.
Jun 16 22:31:36 z800 netdata[1115906]: '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/fping.plugin' (pid 1115981) exited with error code 127 and haven't collected any data. Disabling it.
Jun 16 22:31:36 z800 netdata[1115906]: read failed: end of file
Jun 16 22:31:36 z800 netdata[1115906]: thread with task id 1115963 finished
Jun 16 22:31:36 z800 netdata[1115906]: child pid 1115978 exited with code 127.
Jun 16 22:31:36 z800 netdata[1115906]: PARSER ended
Jun 16 22:31:36 z800 netdata[1115906]: Execution of anonymous statistics script returned 127.
Jun 16 22:31:36 z800 netdata[1115906]: '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/ioping.plugin' (pid 1115982) disconnected after 0 successful data collections (ENDs).
Jun 16 22:31:36 z800 netdata[1115906]: child pid 1115982 exited with code 127.
Jun 16 22:31:36 z800 netdata[1115906]: thread created with task id 1115988
Jun 16 22:31:36 z800 netdata[1115906]: '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/ioping.plugin' (pid 1115982) exited with error code 127 and haven't collected any data. Disabling it.
Jun 16 22:31:36 z800 netdata[1115906]: set name of thread 1115988 to ANALYTICS
Jun 16 22:31:36 z800 netdata[1115906]: thread with task id 1115957 finished
Jun 16 22:31:36 z800 netdata[1115906]: read failed: end of file
Jun 16 22:31:36 z800 netdata[1115906]: PARSER ended
Jun 16 22:31:36 z800 netdata[1115906]: '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/python.d.plugin' (pid 1115983) disconnected after 0 successful data collections (ENDs).
Jun 16 22:31:36 z800 netdata[1115906]: child pid 1115983 exited with code 127.
Jun 16 22:31:36 z800 netdata[1115906]: '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/python.d.plugin' (pid 1115983) exited with error code 127 and haven't collected any data. Disabling it.
Jun 16 22:31:36 z800 netdata[1115906]: thread with task id 1115959 finished
Jun 16 22:31:36 z800 netdata[1115906]: read failed: end of file
Jun 16 22:31:36 z800 netdata[1115906]: PARSER ended
Jun 16 22:31:36 z800 netdata[1115906]: '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/charts.d.plugin' (pid 1115984) disconnected after 0 successful data collections (ENDs).
Jun 16 22:31:36 z800 netdata[1115906]: child pid 1115984 exited with code 127.
Jun 16 22:31:36 z800 netdata[1115906]: '/nix/store/wzq6fzxc2s5rpcw1kfcgq1fim9zrbnq0-netdata-1.34.1/libexec/netdata/plugins.d/charts.d.plugin' (pid 1115984) exited with error code 127 and haven't collected any data. Disabling it.
Jun 16 22:31:36 z800 netdata[1115906]: thread with task id 1115961 finished
Jun 16 22:31:36 z800 netdata[1115906]: called DISABLE. Disabling it.
Jun 16 22:31:36 z800 netdata[1115906]: PARSER ended
Jun 16 22:31:36 z800 netdata[1115906]: '/nix/store/83jwyriqvra4fpvxlc8ch3120880h1vm-wrapped-plugins/libexec/netdata/plugins.d/perf.plugin' (pid 1115987) disconnected after 0 successful data collections (ENDs).
Jun 16 22:31:36 z800 netdata[1115906]: child pid 1115987 exited with code 1.
Jun 16 22:31:36 z800 netdata[1115906]: '/nix/store/83jwyriqvra4fpvxlc8ch3120880h1vm-wrapped-plugins/libexec/netdata/plugins.d/perf.plugin' (pid 1115987) exited with error code 1 and haven't collected any data. Disabling it.
Jun 16 22:31:36 z800 netdata[1115906]: thread with task id 1115966 finished
Jun 16 22:31:36 z800 netdata[1115906]: read failed: end of file
Jun 16 22:31:36 z800 netdata[1115906]: PARSER ended
Jun 16 22:31:36 z800 netdata[1115906]: '/nix/store/83jwyriqvra4fpvxlc8ch3120880h1vm-wrapped-plugins/libexec/netdata/plugins.d/freeipmi.plugin' (pid 1115986) disconnected after 0 successful data collections (ENDs).
Jun 16 22:31:36 z800 netdata[1115906]: child pid 1115986 exited with code 1.
Jun 16 22:31:36 z800 netdata[1115906]: '/nix/store/83jwyriqvra4fpvxlc8ch3120880h1vm-wrapped-plugins/libexec/netdata/plugins.d/freeipmi.plugin' (pid 1115986) exited with error code 1 and haven't collected any data. Disabling it.
Jun 16 22:31:36 z800 netdata[1115906]: thread with task id 1115967 finished

Additional context
Since there is a python plugin, I would expect pkgs.python3 to be included in the buildInputs, however it doesn't seem to be. Could this be the problem, or am I missing something?
Notify maintainers

No one is currently maintaining the netdata package.
Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
[user@system:~]$ nix-shell -p nix-info --run "nix-info -m"
 - system: `"x86_64-linux"`
 - host os: `Linux 5.15.43-hardened1, NixOS, 22.11 (Raccoon), 22.11.20220611.90cd545`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.9.1`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

I have also seen this issue and researched it a bit. Here's what I found:

https://github.com/netdata/netdata/issues/9166
https://github.com/netdata/netdata/issues/9156
https://github.com/netdata/netdata/pull/9158

The change from the pull request in question is already applied to the current Netdata version in nixpkgs:
 > grep -A1 pluginsd_space $(nix show-derivation 'nixpkgs#netdata' | jq -r '.[].env.src')/parser/parser.c
    if (unlikely(!find_keyword(input, command, PLUGINSD_LINE_MAX, pluginsd_space)))
        return 0;

I also thought it was due to services.netdata.python.enable not being enabled, but it has no effect.

Thanks for the research! The issue indeed seems resolved now, at least for me. So I'll close the issue


Job selection probes are broken

Hi. With Bacalhau 1.1.0, I don't see --job-selection-probe-http cli arg working This worked fine in v1.0.3.
I'm running with LOG_LEVEL='debug'. Is there a particular log line that I could look for that shows that probe endpoint being called?
I can see the log shows flag being passed in with correct endpoint:
os.Args: [bacalhau serve --node-type requester --ipfs-connect <ipfs-conenct> --private-internal-ipfs=false --labels owner=labdao --job-selection-accept-networked --job-selection-data-locality anywhere --peer none --job-selection-probe-http http://<endpoint>]

related https://bacalhauproject.slack.com/archives/C052BAZJVEU/p1697312898982309

The issue is related to how we map CLI flags to compute and request config. The job selection flags are linked to NodeRequesterXXX key/prefix.
https://github.com/bacalhau-project/bacalhau/blob/75ce16214a6f9ccf8307adc9a1b0d64750124265/cmd/util/flags/configflags/job_selection.go#L20
The flags are working fine with the requester node, and the requester is able to set its own job selection policy just fine since it is reading config with key NodeRequesterXXX
https://github.com/bacalhau-project/bacalhau/blob/badd1ce5fd9508bd615f9a8e08bd8ce44d2eceb7/cmd/cli/serve/util.go#L57
That is not the case for the compute node since it is reading configs with key NodeComputeXXX
https://github.com/bacalhau-project/bacalhau/blob/badd1ce5fd9508bd615f9a8e08bd8ce44d2eceb7/cmd/cli/serve/util.go#L29
This is also visible when printing the node configs:
serve --node-type requester,compute --job-selection-accept-networked
...
13:37:22.561 | DBG pkg/node/config_compute.go:190 > Compute config: ...
JobSelectionPolicy:{Locality:Anywhere RejectStatelessJobs:false AcceptNetworkedJobs:false ProbeHTTP: ProbeExec:}
...

13:37:22.572 | DBG pkg/node/config_requester.go:59 > Requester config: ...
JobSelectionPolicy:{Locality:Anywhere RejectStatelessJobs:false AcceptNetworkedJobs:true ProbeHTTP: ProbeExec:}
 ...

Not sure what the right fix here. It doesn't look like our config supports one flag that sets multiple configurations @frrist

Both the Requester and the Compute node configs contain a JobSelectionPolicy. But I don’t see where we use the JobSelectionPolicy field for the requester, it looks like we never read from the value once it’s set. Would it make sense to simply remove the field from the requesters config?

via https://github.com/bacalhau-project/bacalhau/pull/2936


Allow flags with spaces

So that multiple options can be passed in

Can one of the admins verify this patch?

ok to test

@agios Thanks for the PR! LGTM. Will merge once the tests pass.


Fix wrong positionning in 2d arena creation

The 2D arena were wrongly created: their collide lines were shifted from their BodyPos

This change is

Umm, I don't think this is correct, this will always force the arena to the center of the screen. The coordinates you give to the function define the extents of the arena.

Hmm, I'll have to draw this out to make sure it's correct.

I think the non-0 coordinates are wrong on the Lines, it should be the offset from the center point, not min/max directly.

Yeah, I just experienced that. Now it works.

Could you bump the version number in Cargo.toml also? Just bump the patch number.


pdf do not show video thumbnails

I'm trying to take pdf of a youtube video but pdf doesn't capture the thumbnail of the video.
A similar issue is discussed here(#1256) with taking a screenshot but I didn't come to any conclusion after reading the thread. Why exactly this is happening or feature itself is like this?
Steps to reproduce

Trying to take screenshot "await page.goto(url, {waitUntil: 'networkidle0'});"
Here url: "https://www.youtube.com/watch?v=tjQeYo60Wls"

About your environment:

Puppeteer version: 1.8.1
Platform / OS version: macOS High Sierra 10.13.6
URLs (if applicable): https://www.youtube.com/watch?v=tjQeYo60Wls
Node.js version: v12.5.0
Chrome version: HeadlessChrome/77.0.3835.0

What is the expected result?
youtubeonly12.pdf should contain thumbnail of the video ie. youtubeonly12.pdf should look like the below image.

What happens instead?
youtubeonly12.pdf doesn't contain the thumbnail of the video.
youtubeonly12.pdf

Is there any update on this?

Is this issue resolved?
I am facing this issue.


Move coderetreat.org to archive.coderetreat.org and add CNAME for coderetreat.org to coderetreat.github.io

Needs to contain a link to old site (via blog post provided by Raimo)

Done as of 8:00am CDT


License and project vision

I had the same idea of building a lightweight middleware that can capture API metrics natively in the service.

What is your vision or goal with this project? Maybe, we can collaborate in building this project.
Also, what is the license for this project?

That's great! The goal is a user-friendly analytics service that you can easily add on to your existing API to effectively gain insight into previous usage and monitor future usage. Plans are in progress for easy self-hosting of the backend using a docker compose file for fully private request logs storage.
MIT license, do as you wish :)


Correctly parse and transform yield

We didn't handle expression-less yield expressions correctly before.
Fixes #1899

@johnjbarton PTAL

LGTM


How to use the binaries built, calling them by themselves, out of the context of cargo?

By following the Hello XDP! section on the book, one ends up with 2 binaries:

user space -> target/debug/myapp
ebpf -> target/bpfel-unknown-none/debug/myapp

well, actually a 3rd one:

target/debug/xtask

And one can execute the user space one through cargo xtask run according to the documentation.  Is there a way to execute the binaries out of the context of cargo?  Meaning just executing the binaries...  Or are the user space executables always bound to be used with cargo?

Ohh, I just missed the verbosity level when trying, but this works:
RUST_LOG=info ./target/debug/xtask run

is there a way to execute the binaries out of the context of cargo? Meaning just executing the binaries...

of course - cargo xtask run is just a convenient, you can also run sudo ./target/debug/xdp-hello without cargo (or copy it to other servers, and run it there, or package that binary into a docker image etc.).   The "ebpf binary" target/bpfel-unknown-none/debug/myapp is not an executable - you cannot run it by itself - it is a BPF object file that gets included into the user-space binary


README/help: add info on IPS mode tests creation - v1

It is possible to create a test that runs in IPS mode by just adding ips to its name. But that is not documented.
Task #7039
Ticket
If your pull request is related to a Suricata ticket, please provide
the full URL to the ticket here so this pull request can monitor
changes to the ticket status:
Redmine ticket:
https://redmine.openinfosecfoundation.org/issues/7039

Replaced by: https://github.com/OISF/suricata-verify/pull/1965


feat(TemplateOption) added tabindex, placeholder, step to be handled …

…using elementRef

#171

Have to upgrade the repo again as we did not export FieldType class 😢


Regexp should replace any existing seeds seeting in cassandra.yaml. Not just <IP_ADDRESS>

Currently, the sed matches and replaces the seeds configuration only on the first run when the seeds is set to <IP_ADDRESS>.
Considering the use case for this image is development, it is very likely that the container will not always be allocated the same ip. If the seeds ip is not correct, gossip will fail and cassandra will shutdown.
Proposed solution: #14

PR merged and should be released in the 5.1.1 image.


PLEASE JOHNP SMITH ADD COMPATIBILITY FOR .NET 8.0

Jiban.Domain -> Microsoft.EntityFrameworkCore 8.0.0 -> Microsoft.EntityFrameworkCore.Abstractions (>= 8.0.0)
Jiban.Domain -> AuthPermissions.AspNetCore 6.0.0 -> Npgsql.EntityFrameworkCore.PostgreSQL 7.0.0 -> Microsoft.EntityFrameworkCore.Abstractions (>= 7.0.0 && < 8.0.0). @JonPSmith

Hi @raulidavid,
I will update AuthP library to .NET 8, but I have to update three of my libraries that AuthP uses to .NET 8 first. I'm currently waiting for the Npgsql.EntityFrameworkCore.PostgreSQL NuGet to get to .NET 8.

@JonPSmith https://www.nuget.org/packages/Npgsql.EntityFrameworkCore.PostgreSQL#versions-body-tab is ready for .NET 8.0 😎

I have released various libraries see my twitter feed, some of which I needed to make AuthP supports .NET 8. However I found some breaking changes in the  .NET 8. EF Core release that stops from AuthP working with .NET 8.
I will look at this but it will take some time. When I have solved these problems I will close this issue as completed.

I have released AuthPermissions.AspNetCore 6.1.0. The release adds .NET 8 support to this library, so version 6.1.0 supports .NET 6, 7, and 8.
This release took some time because:

Creating libraries that supports multiple .NET releases is complex.
The AuthP library if very big, and its easy to miss a change to NuGet libraries. That's why you MUST have unit tests for each .NET release version.
There were two changes in the .NET 8 EF Core code that caused problems in the unit tests and require extra code.


I2304 multiple models to solver

Description
IDAKLU solver cannot setup more than one model. We have decided to restrict the BaseSolver to only setup a single model at at time. If multiple models are passed in a RuntimeError is raised
Fixes #2304
Type of change

[x] Bug fix (breaking change which fixes an issue)

Key checklist:

[x] No style issues: $ flake8
[x] All tests pass: $ python run-tests.py --unit
[x] The documentation builds: $ cd docs and then $ make clean; make html

You can run all three at once, using $ python run-tests.py --quick.
Further checks:

[x] Code is commented, particularly in hard-to-understand areas
[x] Tests added that prove fix is effective or that feature works

Thanks @tinosulzer! I'll make those fixes. FYI, I'm quite happy with one-model-one-solver approach. There is always going to be significant setup for any model-solver pairing, and it makes sense to have setup stuff done within an __init__() rather than anywhere else

Ok fair enough, if it isn't broken don't fix it I guess
Updates look good so happy to merge once tests pass (merging develop should do it)


Saving better model crash.

Hello.
info,20.02.2016 21:08:27 [TRACE] In training: log probability = -6539,9872918264
9, cross-entropy = 0,0073893168866162, perplexity = 1,00513502343797
info,20.02.2016 21:08:27
info,20.02.2016 21:08:27 Saving better model into file model.bin...
info,20.02.2016 21:08:27 Saving input2hidden weights...
info,20.02.2016 21:08:28 Saving matrix with VQ 256...
info,20.02.2016 21:10:28 Sorting data set (size:<PHONE_NUMBER>)...
Process is terminated due to StackOverflowException.
Process is terminated due to StackOverflowException.
Process is terminated due to StackOverflowException.

Seems an error occurs in AdvUtils.dll

I'm not sure, but the problem seems to be in the method Split Cluster.

Hi,
Yes, this is a bug in AdvUtils.dll. The values of data may be not balanced, so we call SplitCluster so deep, and then stack is overflow.
I have checked-in some new RNNSharp code, and disable model vector quantization by default, so far, this problem has been mitigated, and I will fix this problem in AdvUtils project.
I suggest you to use the latest RNNSharp or its demo package, since I have done lots of performance optimization for encoding, especially for LSTM. Your training will be much faster than before.

Great!
Thanks for the support.


fix: upsell callback events to fire before unmounting from inline cart

This PR was absorbed into release v1.5.0. Closing pull request.


Feature/contact page

Closes #3

Deploy preview ready!
Built with commit de2619c26c3fdee40a63c22c91f48d5675775646
https://deploy-preview-11--blanket.netlify.com


[PHP] Syntax highlighting broken by part of my code.

VSCode Version: 1.5.0-insider (had this issue in older builds as well)
OS Version: Windows 10 64bit (Anniversary Update)

I tried with different color themes as well. Same issue.
First of all, I know that having such long php files is not a good thing. BUT the syntax highlighting breaks in my php file after a certain section (which has a lot of quotation marks and apostrophes).
My file is 389 lines but it breaks at line 303. I don't want to copy-paste the whole code, but I can copy the section which seems to break my syntax highlighting.

		<input name="value<?=($plan['col'])?>[]" value="<?=$data[$plan['col']]['value']?>" type="text" class="form-control">

		<select name="unit<?=($plan['col'])?>[]" class="form-control">
			<option value="-1"<?=($data[$plan['col']]['unit'] == -1 ? ' selected' : '')?>>-</option>
			<option value="1"<?=($data[$plan['col']]['unit'] == 1 ? ' selected' : '')?>>Ft</option>
			<option value="2"<?=($data[$plan['col']]['unit'] == 2 ? ' selected' : '')?>>%</option>
			<option value="3"<?=($data[$plan['col']]['unit'] == 3 ? ' selected' : '')?>>kbit/s**</option>
			<option value="4"<?=($data[$plan['col']]['unit'] == 4 ? ' selected' : '')?>>perc</option>
			<option value="5"<?=($data[$plan['col']]['unit'] == 5 ? ' selected' : '')?>>MB</option>
			<option value="6"<?=($data[$plan['col']]['unit'] == 6 ? ' selected' : '')?>>GB</option>
			<option value="7"<?=($data[$plan['col']]['unit'] == 7 ? ' selected' : '')?>>db</option>
		</select>

Copying this section in itself doesn't break syntax highlighting, but if I take this part out, the syntax starts working again. I tried to add extra code to stretch the file out to 390+ lines again after taking out this part of the code and it still worked. I didn't find any issues like this (tried with and without extensions as well).
Here is where it breaks:

I take out the "bad" part:

I add the "bad" part at the end of the file and yet it breaks the syntax highlight again:

I completely take out the "bad" part (end of my file):

Leaving the "bad" code where it was, this is the end of my file (file in original state):

related? #11043

Definitely looks familiar.

Most likely all of these issues relate to https://github.com/Microsoft/vscode/issues/9937#issuecomment-242934557, where there are answers from developers.

@aeschli Could be related to #9937, assigning to you initially so that you can take a look from php side and dup it if it is.

The reason for the colorization stop is that the colorizer grammar has too any states on the scope stack, same as in #9937.
The reason for this can be a bug in the grammar, but just a very nested example and our limit is too small.
I wasn't able to reproduce it with the provided snippet. @realee94 If you have a link (e.g. in a GitHub repo) that has the whole file, then I gladly investigate if it is a bug in the PHP grammar.
Otherwise, we plan to increase the limit, so hopefully this won't be seen anymore so easily.


When you change ts file folder will get the "Duplicate identifier" message

VSCode Version:1.0.0
OS Version:window7 sp1 build 7601
VS2015: commuity 2015 update1
system path:  C:\Program Files (x86)\Microsoft SDKs\TypeScript\1.7;

Steps to Reproduce:
1.add two ts file and compile

2.add new folder

move all ts file and js file to new folder

supplement: when I change namespace  "Wd3.Test" -> "Wd3" is work
Steps to Reproduce:
1.

@wangyibu can you provide the content of the tsconfig.json file?

not set config
tsconfig.json is empty

Moving to TS since it looks like the tsserver doesn't honor the move of files correctly.

This issue was moved to Microsoft/TypeScript#8543


Question regarding query timeout implementation

Hi!
Thanks for your driver. It is great.
https://github.com/hmsonline/storm-cassandra-cql/blame/master/src/main/java/com/hmsonline/trident/cql/CassandraCqlStateFactory.java#L21
Query timeout configuration does not seem to be implemented.
When do you plan to implement it ?
Do you need help ?
Cheers,
Lucas

Your right.  We plan to implement it, but I'm not sure when we'll get around to it.
If you would like to take a stab at it, we love pull requests. =)

This is coming in 0.3.0.  You'll be able to configure pretty much anything you can configure with a Cluster.Builder or pass your own Cluster instance into CqlClientFactory.

Now merged into master.  Have a look at:
https://github.com/hmsonline/storm-cassandra-cql/blob/master/src/test/java/com/hmsonline/trident/cql/MapConfiguredCqlClientFactoryTest.java
Updated documentation (README) to reference this as well.
@lbruand-poctu let us know if this doesn't meet your needs, or if you have suggestions on a better way to expose it.
This will be available in 0.3.0, closing issue.