TensorFlow 1.14 self-compiled build installs successfully but fails at runtime with 'ParallelInterleaveDataset' object has no attribute '_flat_structure'

System information

OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Linux CentOS 7.6
TensorFlow installed from (source or binary): source
TensorFlow version: "git clone --branch r1.14 https://github.com/tensorflow/tensorflow.git"
Python version: "Python 3.6.8"
Installed using virtualenv? pip? conda?: "bazel built pip package"
Bazel version (if compiling from source): "https://github.com/bazelbuild/bazel/releases/download/0.24.1/bazel-0.24.1-installer-linux-x86_64.sh"
GCC/Compiler version (if compiling from source): "gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39)"
CUDA/cuDNN version: CUDA "10.0", cuDNN "7-<IP_ADDRESS>-1.cuda10.0"
GPU model and memory: "Tesla K80, 11441MiB"

Describe the problem
The problem occurs after a error-free tensorflow source build. Trying to use this self-built package with the Object Detection API "train.py" legacy script results in the error shown below. The script runs without problems when using the official pip tensorflow-gpu package.
The error:
Use `tf.data.Dataset.interleave(map_func, cycle_length, block_length, num_parallel_calls=tf.data.experimental.AUTOTUNE)` instead. If sloppy execution is desired, use `tf.data.Options.experimental_determinstic`.
Traceback (most recent call last):
  File "/tensorflow/train.py", line 184, in <module>
    tf.app.run()
  File "/usr/local/lib/python3.6/site-packages/tensorflow/python/platform/app.py", line 40, in run
    _run(main=main, argv=argv, flags_parser=_parse_flags_tolerate_undef)
  File "/usr/local/lib/python3.6/site-packages/absl/app.py", line 299, in run
    _run_main(main, args)
  File "/usr/local/lib/python3.6/site-packages/absl/app.py", line 250, in _run_main
    sys.exit(main(argv))
  File "/usr/local/lib/python3.6/site-packages/tensorflow/python/util/deprecation.py", line 324, in new_func
    return func(*args, **kwargs)
  File "/tensorflow/train.py", line 180, in main
    graph_hook_fn=graph_rewriter_fn)
  File "/tensorflow/models/research/object_detection/legacy/trainer.py", line 280, in train
    train_config.prefetch_queue_capacity, data_augmentation_options)
  File "/tensorflow/models/research/object_detection/legacy/trainer.py", line 59, in create_input_queue
    tensor_dict = create_tensor_dict_fn()
  File "/tensorflow/train.py", line 121, in get_next
    dataset_builder.build(config)).get_next()
  File "/tensorflow/models/research/object_detection/builders/dataset_builder.py", line 141, in build
    config.input_path[:], input_reader_config)
  File "/tensorflow/models/research/object_detection/builders/dataset_builder.py", line 86, in read_dataset
    sloppy=config.shuffle))
  File "/usr/local/lib/python3.6/site-packages/tensorflow/python/data/ops/dataset_ops.py", line 1853, in apply
    return DatasetV1Adapter(super(DatasetV1, self).apply(transformation_func))
  File "/usr/local/lib/python3.6/site-packages/tensorflow/python/data/ops/dataset_ops.py", line 1290, in apply
    dataset = transformation_func(self)
  File "/usr/local/lib/python3.6/site-packages/tensorflow/python/data/experimental/ops/interleave_ops.py", line 94, in _apply_fn
    buffer_output_elements, prefetch_input_elements)
  File "/usr/local/lib/python3.6/site-packages/tensorflow/python/data/ops/readers.py", line 253, in __init__
    **self._flat_structure)
AttributeError: 'ParallelInterleaveDataset' object has no attribute '_flat_structure'

Importing this self built package works without any apparent problems:
[root@b39e843663d1 tensorflow]# python3
Python 3.6.8 (default, Aug  7 2019, 17:28:10)
[GCC 4.8.5 20150623 (Red Hat 4.8.5-39)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import tensorflow
2019-10-01 09:25:39.270112: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library libcudart.so.10.0
>>>

Provide the exact sequence of commands / steps that you executed before running into the problem
I've created a docker container to build the package with the following settings:
...
ENV PYTHON_BIN_PATH="/usr/bin/python3"
ENV PYTHON_LIB_PATH="/usr/local/lib64/python3.6/site-packages"
ENV TF_ENABLE_XLA="Y"
ENV TF_NEED_OPENCL_SYCL="N"
ENV TF_NEED_ROCM="N"
ENV TF_NEED_CUDA="Y"
ENV TF_NEED_TENSORRT="Y"
ENV TF_CUDA_VERSION="10"
ENV TF_CUDNN_VERSION="7"
ENV TF_NCCL_VERSION="2.4.8"
ENV TF_TENSORRT_VERSION="5"
ENV TF_CUDA_PATHS="/lib64,/usr/lib64,/usr/include,/usr/local/cuda-10.0"
ENV TF_CUDA_COMPUTE_CAPABILITIES="7.5,3.7"
ENV TF_CUDA_CLANG="N"
ENV GCC_HOST_COMPILER_PATH="/usr/bin/gcc"
ENV TF_NEED_MPI="N"
ENV CC_OPT_FLAGS="-mavx -mavx2 -mfma -mfpmath=both -msse4.2 -march=native"
ENV TF_SET_ANDROID_WORKSPACE="N"

RUN bash configure

RUN bazel build --config=opt --config=mkl --config=numa --config=noignite --config=nokafka //tensorflow/tools/pip_package:build_pip_package
RUN ./bazel-bin/tensorflow/tools/pip_package/build_pip_package /tmp/tensorflow_pkg
RUN pip3 install /tmp/tensorflow_pkg/tensorflow-*.whl
...

Any other info / logs
Include any logs or source code that would be helpful to diagnose the problem. If including tracebacks, please include the full traceback. Large logs and files should be attached.
[root@b39e843663d1 tensorflow]# python3 /tensorflow/train.py --logtostderr --train_dir=/training_dataset/ --pipeline_config_path=/training_dataset/model.config
2019-10-01 09:23:10.704622: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library libcudart.so.10.0
WARNING:tensorflow:
The TensorFlow contrib module will not be included in TensorFlow 2.0.
For more information, please see:
  * https://github.com/tensorflow/community/blob/master/rfcs/20180907-contrib-sunset.md
  * https://github.com/tensorflow/addons
  * https://github.com/tensorflow/io (for I/O related ops)
If you depend on functionality not listed there, please file an issue.

WARNING:tensorflow:From /tensorflow/models/research/slim/nets/inception_resnet_v2.py:373: The name tf.GraphKeys is deprecated. Please use tf.compat.v1.GraphKeys instead.

WARNING:tensorflow:From /tensorflow/models/research/slim/nets/mobilenet/mobilenet.py:397: The name tf.nn.avg_pool is deprecated. Please use tf.nn.avg_pool2d instead.

WARNING:tensorflow:From /tensorflow/train.py:55: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.

WARNING:tensorflow:From /tensorflow/train.py:184: The name tf.app.run is deprecated. Please use tf.compat.v1.app.run instead.

WARNING:tensorflow:From /usr/local/lib/python3.6/site-packages/absl/app.py:250: main (from __main__) is deprecated and will be removed in a future version.
Instructions for updating:
Use object_detection/model_main.py.
W1001 09:23:13.366838<PHONE_NUMBER>64288 deprecation.py:323] From /usr/local/lib/python3.6/site-packages/absl/app.py:250: main (from __main__) is deprecated and will be removed in a future version.
Instructions for updating:
Use object_detection/model_main.py.
WARNING:tensorflow:From /tensorflow/train.py:90: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

W1001 09:23:13.367076<PHONE_NUMBER>64288 deprecation_wrapper.py:119] From /tensorflow/train.py:90: The name tf.gfile.MakeDirs is deprecated. Please use tf.io.gfile.makedirs instead.

WARNING:tensorflow:From /tensorflow/models/research/object_detection/legacy/trainer.py:266: create_global_step (from tensorflow.contrib.framework.python.ops.variables) is deprecated and will be removed in a future version.
Instructions for updating:
Please switch to tf.train.create_global_step
W1001 09:23:13.375600<PHONE_NUMBER>64288 deprecation.py:323] From /tensorflow/models/research/object_detection/legacy/trainer.py:266: create_global_step (from tensorflow.contrib.framework.python.ops.variables) is deprecated and will be removed in a future version.
Instructions for updating:
Please switch to tf.train.create_global_step
WARNING:tensorflow:num_readers has been reduced to 1 to match input file shards.
W1001 09:23:13.398977<PHONE_NUMBER>64288 dataset_builder.py:72] num_readers has been reduced to 1 to match input file shards.
WARNING:tensorflow:From /tensorflow/models/research/object_detection/builders/dataset_builder.py:86: parallel_interleave (from tensorflow.contrib.data.python.ops.interleave_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.data.experimental.parallel_interleave(...)`.
W1001 09:23:13.406527<PHONE_NUMBER>64288 deprecation.py:323] From /tensorflow/models/research/object_detection/builders/dataset_builder.py:86: parallel_interleave (from tensorflow.contrib.data.python.ops.interleave_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.data.experimental.parallel_interleave(...)`.
WARNING:tensorflow:From /usr/local/lib/python3.6/site-packages/tensorflow/contrib/data/python/ops/interleave_ops.py:77: parallel_interleave (from tensorflow.python.data.experimental.ops.interleave_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.data.Dataset.interleave(map_func, cycle_length, block_length, num_parallel_calls=tf.data.experimental.AUTOTUNE)` instead. If sloppy execution is desired, use `tf.data.Options.experimental_determinstic`.
W1001 09:23:13.406693<PHONE_NUMBER>64288 deprecation.py:323] From /usr/local/lib/python3.6/site-packages/tensorflow/contrib/data/python/ops/interleave_ops.py:77: parallel_interleave (from tensorflow.python.data.experimental.ops.interleave_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use `tf.data.Dataset.interleave(map_func, cycle_length, block_length, num_parallel_calls=tf.data.experimental.AUTOTUNE)` instead. If sloppy execution is desired, use `tf.data.Options.experimental_determinstic`.
Traceback (most recent call last):
  File "/tensorflow/train.py", line 184, in <module>
    tf.app.run()
  File "/usr/local/lib/python3.6/site-packages/tensorflow/python/platform/app.py", line 40, in run
    _run(main=main, argv=argv, flags_parser=_parse_flags_tolerate_undef)
  File "/usr/local/lib/python3.6/site-packages/absl/app.py", line 299, in run
    _run_main(main, args)
  File "/usr/local/lib/python3.6/site-packages/absl/app.py", line 250, in _run_main
    sys.exit(main(argv))
  File "/usr/local/lib/python3.6/site-packages/tensorflow/python/util/deprecation.py", line 324, in new_func
    return func(*args, **kwargs)
  File "/tensorflow/train.py", line 180, in main
    graph_hook_fn=graph_rewriter_fn)
  File "/tensorflow/models/research/object_detection/legacy/trainer.py", line 280, in train
    train_config.prefetch_queue_capacity, data_augmentation_options)
  File "/tensorflow/models/research/object_detection/legacy/trainer.py", line 59, in create_input_queue
    tensor_dict = create_tensor_dict_fn()
  File "/tensorflow/train.py", line 121, in get_next
    dataset_builder.build(config)).get_next()
  File "/tensorflow/models/research/object_detection/builders/dataset_builder.py", line 141, in build
    config.input_path[:], input_reader_config)
  File "/tensorflow/models/research/object_detection/builders/dataset_builder.py", line 86, in read_dataset
    sloppy=config.shuffle))
  File "/usr/local/lib/python3.6/site-packages/tensorflow/python/data/ops/dataset_ops.py", line 1853, in apply
    return DatasetV1Adapter(super(DatasetV1, self).apply(transformation_func))
  File "/usr/local/lib/python3.6/site-packages/tensorflow/python/data/ops/dataset_ops.py", line 1290, in apply
    dataset = transformation_func(self)
  File "/usr/local/lib/python3.6/site-packages/tensorflow/python/data/experimental/ops/interleave_ops.py", line 94, in _apply_fn
    buffer_output_elements, prefetch_input_elements)
  File "/usr/local/lib/python3.6/site-packages/tensorflow/python/data/ops/readers.py", line 253, in __init__
    **self._flat_structure)
AttributeError: 'ParallelInterleaveDataset' object has no attribute '_flat_structure'

Haven't seen this error anywhere yet with googling, so not sure whether this is a fault of my own build or a bug :/
Any help with this will be very appreciated!

@Atharex Looks like an issue with building from source. Can you describe the steps you followed in building from source? Also, can you please try TF1.15.0rc2 and let us know whether the issue persists with latest TF version. thanks!

I would suggest skipping the r1.14 branch as it is in a bad state. We tried to make a patch release there but it was too bad so we decided to make a 1.15 release instead.

@mihaimaruseac thanks for the suggestion! I've tried git clone --branch r1.15 https://github.com/tensorflow/tensorflow.git and now I get a different error.
[root@b7b9b599c04b native]# bazel build --config=mkl --config=numa --config=noignite --config=nokafka //tensorflow/tools/pip_package:build_pip_package
Starting local Bazel server and connecting to it...
INFO: Options provided by the client:
  Inherited 'common' options: --isatty=1 --terminal_columns=239
INFO: Reading rc options for 'build' from /native/.bazelrc:
  'build' options: --apple_platform_type=macos --define framework_shared_object=true --define open_source_build=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone --strategy=Genrule=standalone -c opt --announce_rc --define=grpc_no_ares=true --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include
INFO: Reading rc options for 'build' from /native/.tf_configure.bazelrc:
  'build' options: --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/local/lib64/python3.6/site-packages --python_path=/usr/bin/python3 --config=xla --config=tensorrt --action_env TF_CUDA_VERSION=10 --action_env TF_CUDNN_VERSION=7 --action_env TF_TENSORRT_VERSION=5 --action_env TF_NCCL_VERSION=2.4.8 --action_env TF_CUDA_PATHS=/lib64,/usr/lib64,/usr/include,/usr/local/cuda-10.0 --action_env CUDA_TOOLKIT_PATH=/usr/local/cuda-10.0 --action_env TF_CUDA_COMPUTE_CAPABILITIES=7.5,3.7 --action_env GCC_HOST_COMPILER_PATH=/usr/bin/gcc --config=cuda --action_env TF_CONFIGURE_IOS=0
INFO: Found applicable config definition build:xla in file /native/.tf_configure.bazelrc: --define with_xla_support=true
INFO: Found applicable config definition build:tensorrt in file /native/.bazelrc: --action_env TF_NEED_TENSORRT=1
INFO: Found applicable config definition build:cuda in file /native/.bazelrc: --config=using_cuda --define=using_cuda_nvcc=true
INFO: Found applicable config definition build:using_cuda in file /native/.bazelrc: --define=using_cuda=true --action_env TF_NEED_CUDA=1 --crosstool_top=@local_config_cuda//crosstool:toolchain
INFO: Found applicable config definition build:mkl in file /native/.bazelrc: --define=build_with_mkl=true --define=enable_mkl=true --define=tensorflow_mkldnn_contraction_kernel=0 -c opt
INFO: Found applicable config definition build:numa in file /native/.bazelrc: --define=with_numa_support=true
INFO: Found applicable config definition build:noignite in file /native/.bazelrc: --define=no_ignite_support=true
INFO: Found applicable config definition build:nokafka in file /native/.bazelrc: --define=no_kafka_support=true

ERROR: error loading package '': Encountered error while reading extension file 'repositories/repositories.bzl': no such package '@io_bazel_rules_docker//repositories': Traceback (most recent call last):
        File "/root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/bazel_tools/tools/build_defs/repo/git.bzl", line 164
                _clone_or_update(ctx)
        File "/root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/bazel_tools/tools/build_defs/repo/git.bzl", line 74, in _clone_or_update
                fail(("error cloning %s:\n%s" % (ctx....)))
error cloning io_bazel_rules_docker:
+ cd /root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external
+ rm -rf /root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/io_bazel_rules_docker /root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/io_bazel_rules_docker
+ git clone https://github.com/bazelbuild/rules_docker.git /root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/io_bazel_rules_docker
+ git -C /root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/io_bazel_rules_docker reset --hard 251f6a68b439744094faff800cd029798edf9faa
Unknown option: -C
usage: git [--version] [--help] [-c name=value]
           [--exec-path[=<path>]] [--html-path] [--man-path] [--info-path]
           [-p|--paginate|--no-pager] [--no-replace-objects] [--bare]
           [--git-dir=<path>] [--work-tree=<path>] [--namespace=<name>]
           <command> [<args>]
+ git -C /root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/io_bazel_rules_docker fetch origin 251f6a68b439744094faff800cd029798edf9faa:251f6a68b439744094faff800cd029798edf9faa
Unknown option: -C
usage: git [--version] [--help] [-c name=value]
           [--exec-path[=<path>]] [--html-path] [--man-path] [--info-path]
           [-p|--paginate|--no-pager] [--no-replace-objects] [--bare]
           [--git-dir=<path>] [--work-tree=<path>] [--namespace=<name>]
           <command> [<args>]
+ git -C /root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/io_bazel_rules_docker fetch origin 251f6a68b439744094faff800cd029798edf9faa:251f6a68b439744094faff800cd029798edf9faa
Unknown option: -C
usage: git [--version] [--help] [-c name=value]
           [--exec-path[=<path>]] [--html-path] [--man-path] [--info-path]
           [-p|--paginate|--no-pager] [--no-replace-objects] [--bare]
           [--git-dir=<path>] [--work-tree=<path>] [--namespace=<name>]
           <command> [<args>]
ERROR: error loading package '': Encountered error while reading extension file 'repositories/repositories.bzl': no such package '@io_bazel_rules_docker//repositories': Traceback (most recent call last):
        File "/root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/bazel_tools/tools/build_defs/repo/git.bzl", line 164
                _clone_or_update(ctx)
        File "/root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/bazel_tools/tools/build_defs/repo/git.bzl", line 74, in _clone_or_update
                fail(("error cloning %s:\n%s" % (ctx....)))
error cloning io_bazel_rules_docker:
+ cd /root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external
+ rm -rf /root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/io_bazel_rules_docker /root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/io_bazel_rules_docker
+ git clone https://github.com/bazelbuild/rules_docker.git /root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/io_bazel_rules_docker
+ git -C /root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/io_bazel_rules_docker reset --hard 251f6a68b439744094faff800cd029798edf9faa
Unknown option: -C
usage: git [--version] [--help] [-c name=value]
           [--exec-path[=<path>]] [--html-path] [--man-path] [--info-path]
           [-p|--paginate|--no-pager] [--no-replace-objects] [--bare]
           [--git-dir=<path>] [--work-tree=<path>] [--namespace=<name>]
           <command> [<args>]
+ git -C /root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/io_bazel_rules_docker fetch origin 251f6a68b439744094faff800cd029798edf9faa:251f6a68b439744094faff800cd029798edf9faa
Unknown option: -C
usage: git [--version] [--help] [-c name=value]
           [--exec-path[=<path>]] [--html-path] [--man-path] [--info-path]
           [-p|--paginate|--no-pager] [--no-replace-objects] [--bare]
           [--git-dir=<path>] [--work-tree=<path>] [--namespace=<name>]
           <command> [<args>]
+ git -C /root/.cache/bazel/_bazel_root/ce6b201fa2cce1ac8c0a389f89f76729/external/io_bazel_rules_docker fetch origin 251f6a68b439744094faff800cd029798edf9faa:251f6a68b439744094faff800cd029798edf9faa
Unknown option: -C
usage: git [--version] [--help] [-c name=value]
           [--exec-path[=<path>]] [--html-path] [--man-path] [--info-path]
           [-p|--paginate|--no-pager] [--no-replace-objects] [--bare]
           [--git-dir=<path>] [--work-tree=<path>] [--namespace=<name>]
           <command> [<args>]
INFO: Elapsed time: 8.351s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (0 packages loaded)

@jvishnuvardhan here is a "high-level" docker file I'm using for the build. Some steps that involve private storage have been removed, but the main gist of the build steps is still there.
Dockerfile.txt

Please update git version, -C has been supported since at least 2.2.0

Nice catch! Probably other default centos repo packages are also too old.
I'll do the updates and let you know afterwards if the problems are gone.

Update: Newer versions of git (2.16.5) & gcc (6.5.0) solved the build problems.
Now I get an installable 1.15.0-rc3 pip package.
The package itself loads tensorflow normally and even correctly starts the Object Detection API scripts, however they die soon after startup (below an example of after 70 steps of training)
Does this look like a build problem or something connected to the release candidate of TF 1.15?
INFO:tensorflow:Running local_init_op.
I1005 16:35:40.917297<PHONE_NUMBER>02944 session_manager.py:500] Running local_init_op.
INFO:tensorflow:Done running local_init_op.
I1005 16:35:41.896291<PHONE_NUMBER>02944 session_manager.py:502] Done running local_init_op.
INFO:tensorflow:Starting Session.
I1005 16:35:52.812674<PHONE_NUMBER>02944 learning.py:754] Starting Session.
INFO:tensorflow:Saving checkpoint to path /training_dataset/model.ckpt
I1005 16:35:53.223033<PHONE_NUMBER>96000 supervisor.py:1117] Saving checkpoint to path /training_dataset/model.ckpt
INFO:tensorflow:Starting Queues.
...
I1005 16:37:26.352100<PHONE_NUMBER>02944 learning.py:507] global step 69: loss = 6.4212 (0.210 sec/step)
INFO:tensorflow:global step 70: loss = 5.3100 (0.210 sec/step)
I1005 16:37:26.564062<PHONE_NUMBER>02944 learning.py:507] global step 70: loss = 5.3100 (0.210 sec/step)
2019-10-05 16:37:28.040392: E tensorflow/stream_executor/cuda/cuda_event.cc:29] Error polling for event status: failed to query event: CUDA_ERROR_ILLEGAL_ADDRESS: an illegal memory access was encountered
2019-10-05 16:37:28.040429: W tensorflow/core/framework/op_kernel.cc:1651] OP_REQUIRES failed at non_max_suppression_op.cu.cc:649 : Internal: Cuda call failed with an illegal memory access was encountered
2019-10-05 16:37:28.040494: F tensorflow/core/common_runtime/gpu/gpu_event_mgr.cc:273] Unexpected Event status: 1
Fatal Python error: Aborted

Thread 0x00007fe25f006700 (most recent call first):
  File "/usr/lib64/python3.6/threading.py", line 295 in wait
  File "/usr/lib64/python3.6/threading.py", line 551 in wait
  File "/usr/local/lib64/python3.6/site-packages/tensorflow_core/python/training/coordinator.py", line 311 in wait_for_stop
  File "/usr/local/lib64/python3.6/site-packages/tensorflow_core/python/training/queue_runner_impl.py", line 293 in _close_on_stop
  File "/usr/lib64/python3.6/threading.py", line 864 in run
  File "/usr/lib64/python3.6/threading.py", line 916 in _bootstrap_inner
  File "/usr/lib64/python3.6/threading.py", line 884 in _bootstrap

Thread 0x00007fe290ff8700 (most recent call first):
  File "/usr/local/lib64/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1443 in _call_tf_sessionrun
  File "/usr/local/lib64/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1287 in _single_operation_run
  File "/usr/local/lib64/python3.6/site-packages/tensorflow_core/python/training/queue_runner_impl.py", line 257 in _run
  File "/usr/lib64/python3.6/threading.py", line 864 in run
  File "/usr/lib64/python3.6/threading.py", line 916 in _bootstrap_inner
  File "/usr/lib64/python3.6/threading.py", line 884 in _bootstrap

Thread 0x00007fe2917f9700 (most recent call first):
  File "/usr/lib64/python3.6/threading.py", line 295 in wait
  File "/usr/lib64/python3.6/threading.py", line 551 in wait
  File "/usr/local/lib64/python3.6/site-packages/tensorflow_core/python/training/coordinator.py", line 311 in wait_for_stop
  File "/usr/local/lib64/python3.6/site-packages/tensorflow_core/python/training/queue_runner_impl.py", line 293 in _close_on_stop
  File "/usr/lib64/python3.6/threading.py", line 864 in run
  File "/usr/lib64/python3.6/threading.py", line 916 in _bootstrap_inner
  File "/usr/lib64/python3.6/threading.py", line 884 in _bootstrap

Thread 0x00007fe291ffa700 (most recent call first):
  File "/usr/local/lib64/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1443 in _call_tf_sessionrun
  File "/usr/local/lib64/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1287 in _single_operation_run
  File "/usr/local/lib64/python3.6/site-packages/tensorflow_core/python/training/queue_runner_impl.py", line 257 in _run
  File "/usr/lib64/python3.6/threading.py", line 864 in run
  File "/usr/lib64/python3.6/threading.py", line 916 in _bootstrap_inner
  File "/usr/lib64/python3.6/threading.py", line 884 in _bootstrap

Thread 0x00007fe2927fb700 (most recent call first):
  File "/usr/local/lib64/python3.6/site-2019-10-05 16:37:28.042576: W tensorflow/core/framework/op_kernel.cc:1651] OP_REQUIRES failed at non_max_suppression_op.cu.cc:649 : Internal: Cuda call failed with an illegal memory access was encountered
packages/tensorflow_core/py2019-10-05 16:37:28.042619: W tensorflow/core/framework/op_kernel.cc:1651] OP_REQUIRES failed at non_max_suppression_op.cu.cc:649 : Internal: Cuda call failed with an illegal memory access was encountered
thon/client/session2019-10-05 16:37:28.042643: W tensorflow/core/framework/op_kernel.cc:1651] OP_REQUIRES failed at non_max_suppression_op.cu.cc:649 : Internal: Cuda call failed with an illegal memory access was encountered
.py", line 1443 in _call_tf_ses2019-10-05 16:37:28.042664: W tensorflow/core/framework/op_kernel.cc:1651] OP_REQUIRES failed at non_max_suppression_op.cu.cc:649 : Internal: Cuda call failed with an illegal memory access was encountered
sionrun
  File "/usr/local/lib64/python3.6/site-packages/tensorflow_core/python/client/session.py", line 1287 in _single_operation_run
2019-10-05 16:37:28.042785: W tensorflow/core/framework/op_kernel.cc:1651] OP_REQUIRES failed at non_max_suppression_op.cu.cc:649 : Internal: Cuda call failed with an illegal memory access was encountered
  File "/usr/local/lib64/python3.6/site-packages/tensorflow_core/python/training/queue_runner_impl.py", line 257 in _run
  File "/usr/lib64/python3.6/threading.py", line 864 in run
  File "/usr/lib64/python3.6/threading.py", line 916 in _bootstrap_inner
  File "/usr/lib64/python3.6/threading.py", line 884 in _bootstrap

That looks like a runtime error. Can you please open a new issue for that? And close this one as it seems solved?

Sure! I'll create the new issue.
Thanks for the help!


Serializer Refactoring

Issue #, if available:
https://bitquill.atlassian.net/browse/AN-1005
Description of changes:
Refactored Graph Binary Serializer.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Some ideas:

Remove reader/writer from graphBinarySerializer, have single codec or something.
Remove mime type, use constant that is above 'graphBinaryMimeType'
Remove getDataType call, replace with struct use
Add error check and return on readTypeValue buffer.ReadValue()
Rename things like myListSerializer to just listSerializer


Crash when swiping on App Library - iOS 14

When swiping on App Library, cylinder will cause the device to enter safe mode.

Can x2 this, happens to me too. Except my device just stays at the black loading screen. I have to restart & rejailbreak. iOS 14.2 with an iPhone 7, 128 gig.

Can x2 this, happens to me too. Except my device just stays at the black loading screen. I have to restart & rejailbreak. iOS 14.2 with an iPhone 7, 128 gig.

Are you using the newest version of checkra1n? I know on older versions there is no safe mode so the device will just respring loop. I'm using oddyseyra1n so I have safe mode.

I just had to rejailbreak it with checkra1n 12.0. I’m not too sure how to use odysseyra1n, and it also says that the code “could break stuff” so I’m not sure how reliable odyssey could be. Thoughts?

Crash log anyone?

Here's mine on iOS 14.4 iPhone 8: crash.log


toolchain: common.h: Rename STRINGIFY to Z_STRINGIFY

"STRINGIFY" is the default name for this macro for every other
project out there. Using such with Zephyr will lead to macro
redifinition warning, which can easily become errors with -Werror.
For reference, a specific case where this happened is with open62541
project.
Fixes: #12935
Signed-off-by: Paul Sokolovsky<EMAIL_ADDRESS>

Patch in the same vein as https://github.com/zephyrproject-rtos/zephyr/pull/13277

Could get rid of the warning by doing #undef STRINGIFY before the #define too. Makes the code less cluttered.
Should probably explain why the Z_ prefix is there in a comment if it's kept.

so everyone in the world get to call it STRINGiFY but us?

Codecov Report

Merging #13426 into master will increase coverage by 0.02%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master   #13426      +/-   ##
==========================================
+ Coverage   48.56%   48.58%   +0.02%
==========================================
  Files         319      319
  Lines       46567    46572       +5
  Branches    10761    10766       +5
==========================================
+ Hits        22616    22628      +12
+ Misses      19360    19353       -7
  Partials     4591     4591

Impacted Files
Coverage Δ

include/net/buf.h
100% <ø> (ø)
:arrow_up:

include/device.h
100% <ø> (ø)
:arrow_up:

include/kernel.h
94.44% <ø> (ø)
:arrow_up:

include/logging/log_backend.h
45.65% <ø> (ø)
:arrow_up:

kernel/init.c
73.43% <100%> (ø)
:arrow_up:

drivers/clock_control/nrf_power_clock.c
50% <0%> (-2.11%)
:arrow_down:

arch/posix/core/posix_core.c
91.91% <0%> (+1.01%)
:arrow_up:

boards/posix/nrf52_bsim/argparse.c
46.98% <0%> (+13.25%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 95e8a58...a37cbe4. Read the comment docs.

Using undef or ifndef seems more sane.

I do not think this is a bug and this should not go into 1.14. By that definition I can create a project that reuses all zephyr macro names and force zephyr to keep renaming left and right.

I don't think Zephyr should be polluting the preprocessor (or C) namespace with whatever random names we have in toolchain.h, ideally everything in there has a z_ or k_ prefix
this is probably a better thing to tackle for 1.15 though, and rename everything not just STRINGIFY

@ulfalizer:

Could get rid of the warning by doing #undef STRINGIFY before the #define too. Makes the code less cluttered.

@SebastianBoe:

Using undef or ifndef seems more sane.

I'm not sure what you guys are talking about. There's millions projects out there. There's this new wannabe "Zephyr" OS, which claims support for various well-known standards like BSD Sockets or POSIX. Nowhere do they say that the header X.h described by the standard defines a macro named STRINGIFY. Thus, millions of projects rightfully just define it in use. Nobody will patch a million of projects with #indef and #ifndef. Either Zephyr frees the space, of it'll become infamous for its "compatibility" with the standards.
Perhaps that indeed was better explained by @andrewboie:

I don't think Zephyr should be polluting the preprocessor (or C) namespace with whatever random names we have in toolchain.h, ideally everything in there has a z_ or k_ prefix

@nashif:

so everyone in the world get to call it STRINGiFY but us?

Exactly, that captures the idea well, in a humble and polite wording. However can be made more explicit: everyone in the world can think they're smarter than everyone else and use a bareword like STRINGIFY. But Zephyr should be actually smarter, and prefix all its stuff, to play along with everyone else in the world, no matter how mad they are.

I do not think this is a bug and this should not go into 1.14.

This was submitted on the hot steps of https://github.com/zephyrproject-rtos/zephyr/pull/13277. If that gigantic, and at the same time, half-baked patch (again, it should have been Z_MIN/Z_MAX) was merged, that it should be a piece of cake to merge this one.

By that definition I can create a project that reuses all zephyr macro names and force zephyr to keep renaming left and right.

Right, as was pointed out, "z_" is too short a prefix, likely used by many projects already. For example, guess what, Z_DATA_ERROR is an zlib symbol, and who knows which more. I personally don't think we'll be done with the matter until we consistently use distinguishable prefix like zph_ for everything.

Also, Z_ has been used for internal APIs

STRINGIFY is exactly an internal API.

Nobody will patch a million of projects with #indef and #ifndef. Either Zephyr frees the space, of it'll become infamous for its "compatibility" with the standards.

@pfalcon

I tried to say that Zephyr should use undef of ifndef, not the external projects.

I tried to say that Zephyr should use undef of ifndef, not the external projects.

I see, I guessed it, but the situation is that an existing project has an include for ANSI C/POSIX header, then includes its local headers, which defines STRINGIFY. Perhaps, I need to reword commit message to make that clearer. As mentioned, this did happen with https://github.com/open62541/open62541 , which also had -Werror in its CFLAGS.
(For full disclosure, this STRINGIFY issue is not the only one leading to warning (as error) building open62541. That's the whole matter - we'll need to make a hundred of changes like this to achieve good POSIX, etc. portability to Zephyr. And we'd better be ready for that, whereas now it's quite erratic - #13277 was voted up unanimously and merged quickly, whereas here suddenly bikeshedding starts, while both are of the same nature, and this one is only simpler re: amount of changes.)

stale for a long time already..


Typed dict JSON schema does not pay attention to extra_behavior argument

Initial Checks

[X] I confirm that I'm using Pydantic V2

Description
When creating a JSON schema from a typed dict core schema, the core schema uses the attribute extra_behavior to determine whether additional unspecified fields are allowed. However the code for generating JSON schemas, at https://github.com/pydantic/pydantic/blob/v2.4.2/pydantic/json_schema.py#L1194, instead checks for the key extra, so the setting is ignored.
Example Code
from pydantic.json_schema import GenerateJsonSchema
import pydantic.version
import pydantic_core.core_schema as core_schema

schema = core_schema.typed_dict_schema(
        {'a': core_schema.typed_dict_field(core_schema.str_schema())},
        extra_behavior='forbid',
        )

json_schema = GenerateJsonSchema().generate(schema)

try:
    assert json_schema['additionalProperties'] == False
except (KeyError, AssertionError):
    print('Generated JSON schema missing correct extra_behavior output')
    print('Input schema:')
    print(repr(schema))
    print('Generated schema:')
    print(repr(json_schema))
    print('Version info:')
    print(pydantic.version.version_info())

Python, Pydantic & OS Version
pydantic version: 2.4.2
        pydantic-core version: 2.10.1
          pydantic-core build: profile=release pgo=false
                 install path: /home/adam/.local/lib/python3.11/site-packages/pydantic
               python version: 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0]
                     platform: Linux-6.1.21-v8+-aarch64-with-glibc2.36
             related packages: typing_extensions-4.8.0 email-validator-2.0.0.post2 typing_extensions-4.4.0 mypy-1.0.1

Hmm. My naive fix at #7810 might not be sufficient here; this is complicated by the current setup using extra in ConfigDict to mean the same thing, so it might be that this wants to be fixed by changing pydantic_core to expect an extra argument here, instead of or as well as the extra_behavior argument…

@me-and,
Thanks for reporting this and for the contribution! I'll get back to you on Monday with a more detailed review of your PR 😄.


Fragment 'key' attribute is not used in react output

I am interested in helping provide a fix!
Yes
Which generators are impacted?

[ ] All
[ ] Angular
[ ] HTML
[ ] Preact
[ ] Qwik
[X] React
[ ] React-Native
[ ] Solid
[ ] Stencil
[ ] Svelte
[ ] Vue
[ ] Web components

Reproduction case
https://mitosis.builder.io/playground/?code=JYWwDg9gTgLgBAbzgMWgGhVAhgcxAUwDt4BfOAMyghDgHIABAIwFdgAbAE3ygDpgIA9CGAwIAZ2BjaAbgBQsgMYRCY%2BDHyq4AXjgBtAERZ9GfY2Nx9C%2FQF05s%2FAA9IsOF3JZmbeOWaEFMfkI4ACEsCQVUKGRsPCIYAAoASkRZODgofBhmKCD41LS4AB4OYAA3AD58gqLIuHwsBQALLQRdWixaDFpGTroFWmsSSurqhHiIMADlZK1yuDyRkcLo3AJiOABrfABPFoADLe2AWgASBAmpwhI9oarFgsKxMCxCcvPJwJJCgSeX4fu0t8VrFiP9FokSHdAQJIpUoTVoHUGs0EOpVLcAWMLoEMMBCFwHDM5gsATUYmt4IcWniCRjSWl3pdIfSgeS4mCRhD4UDoBzviUKvlEnISEA%3D%3D%3D
Expected Behaviour
As per docs:
The Fragment component accepts the key prop, which is typically used when the Fragment is the direct child of a For loop component.
However this has no effect on the output code. I would expect that using key in Fragment would result in following output in react:
<Fragment key={yourKey}>  .... </Fragment>, otherwise, what's the point of using key in the mitosis jsx?
Actual Behaviour
Mitosis either drops the fragment completely from output or outputs fragment in short syntax, which does not give us possibility to use the key attribute:
      {test?.map((option, index) => (         <>{option}</>       ))}
Additional Information
No response

This is an issue with our playground not using the latest version of mitosis. I just updated it to the latest version and the output for react is now:
import * as React from "react";

const test = ["a", "b", "c"];

function BasicForFragment(props) {
  return (

      {["a", "b", "c"]?.map((option) => (
        <React.Fragment key={`key-${option}`}>
          {option}
        </React.Fragment>
      ))}
      {test?.map((option, index) => (
        <React.Fragment key={index}>{option}</React.Fragment>
      ))}

  );
}

export default BasicForFragment;


TypeScript entry point

Looks like javascript entry point (main.js) is locked. Since TypeScript loader is available it makes sense to allow TypeScript entry point.

@m1gu3l Im not familiar with how Typescript works, could you elaborate on what you mean? Is it manner of renaming the file extension or are there others steps required?

Renaming the file extension should do. See https://github.com/TypeStrong/ts-loader example.

@christianalfoni this should be fairly easy to solve right?


Do encryption scopes apply to ADLS gen2 or just Azure Blob Storage?

Its not clear if encryption scopes are a feature offered only for Azure Blob Storage or also for ADLS gen2. I followed these links to get to the encryption scopes doc with the understanding that this content applied to ADLSG gen2, but when I tried the capability it failed.

https://azure.microsoft.com/en-us/blog/under-the-hood-performance-scale-security-for-cloud-analytics-with-adls-gen2/
https://docs.microsoft.com/en-us/azure/storage/common/customer-managed-keys-configure-key-vault?toc=%2Fazure%2Fstorage%2Fblobs%2Ftoc.json&tabs=portal
https://docs.microsoft.com/en-us/azure/storage/common/storage-service-encryption

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 41969b7b-5eaf-0a9d-9c13-d6d18838148f
Version Independent ID: 03737566-bfde-8c4b-8458-a6275ebcd07a
Content: Encryption scopes for Blob storage
Content Source: articles/storage/blobs/encryption-scope-overview.md
Service: storage
Sub-service: common
GitHub Login: @tamram
Microsoft Alias: tamram

@meenalsri Thanks for your question. We are checking on this and will respond to you soon.

@meenalsri This articles explain the major difference feature of ADLS gen2 and Blob encryption
https://docs.microsoft.com/en-us/azure/storage/blobs/storage-feature-support-in-storage-accounts
This article shows whether a feature is fully supported, supported at the preview level, or is not yet supported. Support levels are impacted by storage account type, and whether certain capabilities or protocols are enabled on the account.
We are currently targeting for encryption scopes on ADLS Gen2 to specify an encryption scope at the container level. For the existing data in the account, those would need to be rewritten by specifying the encryption scope as it requires re-encryption of the data.
all data is encrypted at rest https://docs.microsoft.com/en-us/azure/storage/common/storage-service-encryption?toc=/azure/storage/blobs/toc.json#about-azure-storage-encryption
Encryption Scopes in Azure Blob storage. You can refer to our documentation on encryption scopes for more details on the feature.
We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.


Not all errors added when using same code on multiple fields

Suppose this class:
public class UserCreationParameters {

    @Email(message = PROPERTY_IS_NOT_EMAIL)
    @NotEmpty(message = PROPERTY_SHOULD_NOT_BE_EMPTY)
    private String email;

    @NotEmpty(message = PROPERTY_SHOULD_NOT_BE_EMPTY)
    private String firstName;

    @NotEmpty(message = PROPERTY_SHOULD_NOT_BE_EMPTY)
    private String lastName;

    @NotEmpty(message = PROPERTY_SHOULD_NOT_BE_EMPTY)
    private String password;

   ...
}

With the constants:
public final class ErrorCodes {
    public static final String PROPERTY_SHOULD_NOT_BE_EMPTY = "PROPERTY_SHOULD_NOT_BE_EMPTY";
    public static final String PROPERTY_IS_NOT_EMAIL = "PROPERTY_IS_NOT_EMAIL";
}

If I test this with the 4 fields of UserCreationParameters empty, I only get 1 item in the errors array:
I checked in SpringValidationWebErrorHandler and there are 4 errors in the BindingResult. However, since they map to the same key and they are put in a Set only 1 remains.
It is possible to support re-use of error codes to avoid having a lot of nearly the same translations of the error codes to error messages? I wrote a custom HttpErrorAttributesAdapter to add the name of the property in the resulting JSON so I can have the same error codes.

@wimdeblauwe That's right. We've designed this small library to have one error code for each error case. That's why we maintain the error codes inside an instance of a Set.
Anyway, we could evaluate the possibility of this feature to 1.5 release. For example, we can report one error code along with more than one argument describing the related fields.

Ok, great that you are open to this. Ideally, if there is only a single error message for a single annotation, it would be great if we could just define this in a central way, so that I can skip repeating the message = PROPERTY_SHOULD_NOT_BE_EMPTY argument for each @NotEmpty annotation. (Adding it to have a specific error message as an override should remain possible of course).

Issue can be closed as I wrote my own library -> https://github.com/wimdeblauwe/error-handling-spring-boot-starter

Would it be possible to reopen this issue?
I came accross it recently and, even though I technically can declare a message by error case, it would make much more sense to support multiple error messages for one error type.
This is a little frustrating to see that #105 seems to tick all the boxes but hasn't been merged yet 😞


Generic type comparison using Enums throws incompatible type errors

TypeScript Version:  2.8 (using typescript playground)
Search Terms: Enum, Generics, Typescript, Type alias
Code
type Action<T, P = undefined, M = undefined> = { type: T, payload: P, meta: M };

enum MyActionType {
    MY_ACTION = 'MY_ACTION',
    TEST = 'TEST'
}

type MyAction = Action<MyActionType.MY_ACTION, string>;

const createAction = <T, P, M>(type: T, payload?: P, meta?: M): Action<T, P, M> => ({ type, payload, meta });

const createMyAction = (payload: string): MyAction =>
    createAction(MyActionType.MY_ACTION, payload);

Expected behavior:
No errors.
Actual behavior:
Type 'Action<MyActionType, string, undefined>' is not assignable to type 'Action<MyActionType.MY_ACTION, string, undefined>'.
  Types of property 'type' are incompatible.
    Type 'MyActionType' is not assignable to type 'MyActionType.MY_ACTION'.

Important to note that if createAction is updated to have T extending string, for example:
const createAction = <T extends string, P, M>(type: T, payload?: P, meta?: M): Action<T, P, M> => ({ type, payload, meta });

It works as expected.
Playground Link: Link
Related Issues: Couldn't find anything related in existing open issues.

Literal types are not inferred automatically, as @andy-ms mentioned. you can instruct the compiler to infer literal types by adding a constraint on the type parameter, e.g.:
const createAction = <T extends MyActionType, P, M>(type: T, payload?: P, meta?: M): Action<T, P, M> => ({ type, payload, meta });

Will cause the compiler to infer the more specific type at the call site.

Alright, that makes sense. I somehow thought this was supported already.
Thanks for the answers!


Add batch context object to microbatch jinja context

Resolves #11025
Problem
We need to get an id for a batch into the jinja context for batches of models
Solution
Add a BatchContext object under the batch key for a ModelNodel. The BatchContext contains an id, event_time_start, and event_time_end. The id field sets out the original problem we set out to solve. The event_time_start and event_time_end, formalize and supercede what we previously used __dbt_internal_event_time_start and __dbt_internal_event_time_end
As part of this work, we also stopped double compiling each batch. Previously we were
(1) Compiling for the batch prior to instantiating the jinja context for the batch
(2) Compiling for the batch after instantiating the jinja context for the batch
We have stopped doing (1). As a side effect of this, the compiled .sql file for the microbatch model that had no event time filtering will no longer be outputted. Each batch specific compiled .sql file will still be produced. This should be safe as microbatch is a new kind of model node being added in 1.9 and 1.9 GA has not been released yet. As such, nobody should be depending on its existence. If it does prove to be problematic, we've already spiked out some work on how to bring it back.
Checklist

[X] I have read the contributing guide and understand what's expected of me.
[X] I have run this code in development, and it appears to resolve the stated issue.
[X] This PR includes tests, or tests are not required or relevant for this PR.
[X] This PR has no interface changes (e.g., macros, CLI, logs, JSON artifacts, config files, adapter interface, etc.) or this PR has already received feedback and approval from Product or DX.
[X] This PR includes type annotations for new and modified functions.

16 commits for +90/-41, great job me 🫠

Kicked off dbt-snowflake tests, since Snowflake's microbatch implementation depends on the now-legacy (but still supported) model.config attributes: https://github.com/dbt-labs/dbt-snowflake/actions/runs/12057315923


Client api docs

Provides manual documentation of the JSON RPC schema defined in the @statechannels/client-api-schema package.

@geoknee going to respond with some thoughts

I think we need to stick with the autogenerated route (it should be easier to maintain, version and so on)

I agree 100% that autogenerated documentation is easy to maintain. If you want to go down that route, we can keep this file alive (we can move it if need be) as a spec for the finalized core RPC interface (including errors, params, etc).

currently one has to dig around for e.g. CreateChannelParams in a massive list of type aliases

Yeah, there is an interesting tradeoff between using fancy typescript and defining everything explicitly so your documentation can be easily autogenerated. In general we've tended towards maximizing type reuse and defaulting to manual documentation, but we have had a history of out of date documentation.
Happy to reorganize some of the type definitions to make it easier to catch by the documentation tool, but not keen to setup + debug the documentation generation pipeline. Still think the doc should be kept alive as a spec, and the PR opened to collect comments (though can move to issues if thats easier)

@snario I am not totally clear why we want to strip out all of the browser specific stuff. We still want to support that, right? The schema is currently used by the browser wallet and accompanying packages, and not yet used by the server wallet. So it makes sense to me to continue to document all of the browser-specific stuff.
I would be in favour of having a core set of types, and a core schema to go with, that is extended by some browser specific stuff and a browser specific schema (which is essentially a bit more permissive when you validate requests against it). But that can all live in this package.

@snario I am not totally clear why we want to strip out all of the browser specific stuff. We still want to support that, right? The schema is currently used by the browser wallet and accompanying packages, and not yet used by the server wallet. So it makes sense to me to continue to document all of the browser-specific stuff.
I would be in favour of having a core set of types, and a core schema to go with, that is extended by some browser specific stuff and a browser specific schema (which is essentially a bit more permissive when you validate requests against it). But that can all live in this package.

I agree with your suggestion. I just want to make sure we are all on the same page that these browser specific methods should not be assumed to be fundamental wallet requirements.
In addition to being browser specific, ApproveBudgetAndFund is even virtual channel specific in its current form. These are shortcuts / shorthands.

I am on your page 💯 .

I'm going to keep this doc linked to only the core types then.
To regurgitate what was in slack, I propose the following changes to the error types:
We should keep the general HTTP *xx error code mapping, but prefix them with some other number to indicate the error was from the channel (e.g. 404 becomes 1404), then we can follow the general error mappings:
1400 -- invalid data supplied
1401 -- unauthorized action
1403 -- forbidden action
1404 -- * not found in storage

Which means (by method) we would see the following errors (roughly):
CreateChannel
Signing address not found (1404)
Invalid participants (1400)
Insufficient funds (1401)
Unsupported/invalid token (1400)
Invalid app definition (1400)
Invalid app data (1400)

JoinChannel
Channel not found (1404)
Invalid transition (1403)
Channel has invalid status (1403)

UpdateChannel
Channel not found (1404)
Invalid transition (1403)
Invalid app data (1400)
Not your turn (1403)
Channel has invalid status (1403)

CloseChannel
Channel not found (1404)
Not your turn (1403)

DefundChannel
Channel not found (1404)
Not your turn (1403)
Channel has invalid status (1403)

Withdraw
Channel not found (1404)
Not your turn (1403)
Channel has invalid status (1403)

ChallengeChannel
Channel not found (1404)

GetChannels

GetState
Channel not found (1404)

GetWalletInformation
Signing wallet not found (1404)

PushMessage
Participant not found (1404)
Unauthorized (1403)

I'm still not clear if this is 100% of the methods we would use though. Wondering specifically about deposit and clearChallenge, but there could be other core methods I'm missing


Debugger Keeps attaching itself when calling any npm package

Issue Type: Bug
Summary
On startup of a couple of projects, the debugger attaches itself in the terminal and i must exit with ctr + c.
Debugger listening on ws://<IP_ADDRESS>:53672/c5f5e056-3a6f-4a18-b1ee-4d9195fc62b3
For help, see: https://nodejs.org/en/docs/inspector

and whenever I call anything with npm it triggers the same attachment. The same happens when a script calls npm. This happens when calling sls, eslint, slss which is installed under /root/.nvm/versions/node/v12.14.1/bin/ and npm is installed under /root/.nvm/versions/node/v12.14.1/bin/npm however calling aws does not trigger this as its installed under /usr/local/bin/aws
Testing this in another vscode window in a working project folder does not exhibit the same problems, despite using the same extensions and connection to WSL: Ubuntu-18.04
This project has worked before with the same extensions, and npm packages so not sure what triggered this to happen in these folders.
Troubleshooting steps:
Removed .vscode
Turned Auto Attach Off
Deleted entire folder and entered same project
Changed terminal types from zsh to bash
Tested this with a working project folder, all packages and npm is installed in same location but it does not exhibit the same behavior.
Ran ls -al to make sure repo was empty and it was.
Using a separate terminal (windows terminal) in the same location works as intended.
Switching between a broken project folder to a working one works fine.
Cloning the same project and opening it in a different location works as intended.
Calling .code to open the broken project folder exhibits the broken behavior.
So it looks like vscode decides to attach itself/exhibits this behavior ONLY when they're launched from these specific folder paths.
Working path /root/work/api-node-platform-integrationsTest
Broken Path /root/work/api-node-platform-integrations
Other things I noticed:
When calling exit on bash in the broken project window, I receive The terminal process "/bin/zsh" terminated with exit code:130 or exit code 126. But when calling exit in a working vscode window it exits without throwing an error.
When trying to enter bash from the zsh console by typing bash I should expect it to switch to bash, however it shows the debugger attachment, and then after a ctr + c it enters bash.  I can not npm update or install anything now without opening a terminal outside of VS Code.

Please check out the instructions here for a fix: https://github.com/microsoft/vscode/issues/102057#issuecomment-657728467
/duplicate


Custom Field without create a module

Hi.
I'm trying to create a custom field without creating a module because this field I will use in differents modules. I've followed this guide:
https://www.elegantthemes.com/documentation/developers/how-to-create-a-custom-field-for-a-divi-builder-module/
I have no the Divi extension standard structure because I have a plugin already created with another structure. When I write "npm run build" it says to me that no exists "includes/loader.js". I don't know how to change this location, so I had to create the loader.js in this location:
Now, when I run "npm run build" :
Creating an optimized production build...
Failed to compile.

Module not found: Error: Can't resolve 'C:/..../my-plugin/'

It needs a module ( includes/modules/ ) to create a custom field?

Hello @gonzalesc sorry you have to create a module in order to create a custom field. Could you please consider rewriting your extension as is in the official doc so as to better align with our API/Framework and tutorials?


QS does nothing when the 'Open' or 'Open URL' actions are used

ß60 10.6.7
Roughly once a day, sending an Open app or Open URL Command fails. QS disappears as usual, but nothing else happens. Sending the Command again usually works. I've never seen this in previous versions. A user on twitter appears to be having the same issue, I'll ask for more details.

Some updates to master have fixed this problem (due to the asynchro loading of plugins)
I also plan on releasing a QS update soon that'll make the actions appear instantly - yes, that's right!


pyany: add is_instance

Adds PyAny::is_instance::<T>().
This is an alternative to Python::is_instance() which offers slightly nicer syntax. I think there's a good consistency argument to adding this:

We expose other builtins like dir(), hash(), len() as PyAny::dir instead of Python::dir - is_instance has been a special case.
It's also consistent with PyErr::is_instance::<T>(py).

To encourage only one way to do things, I'm very tempted to mark #[deprecated] on Python::is_instance and Python::is_subclass (which is already redundant to PyType::is_subclass). What do you think of this?
Comparing from the documentation:
Python::is_instance:
fn main() {
    let gil = Python::acquire_gil();
    let py = gil.python();
    assert!(py.is_instance::<PyBool, _>(PyBool::new(py, true)).unwrap());
    let list = PyList::new(py, &[1, 2, 3, 4]);
    assert!(!py.is_instance::<PyBool, _>(list).unwrap());
    assert!(py.is_instance::<PyList, _>(list).unwrap());
}

PyAny::is_instance:
fn main() {
    let gil = Python::acquire_gil();
    let py = gil.python();
    assert!(PyBool::new(py, true).is_instance::<PyBool>().unwrap());
    let list = PyList::new(py, &[1, 2, 3, 4]);
    assert!(!list.is_instance::<PyBool>().unwrap());
    assert!(list.is_instance::<PyList>().unwrap());
}

cc @kngwyu - as this is a new public API that would be added to PyAny, I'd like to check you're ok with this before I merge.

Nice catch, thanks.

I'm very tempted to mark #[deprecated] on Python::is_instance and Python::is_subclass

:+1:


Could not find an option named "target-platform".

*** flutter upgrade to 1.7.9 ***
Could not find an option named "target-platform".
delete "args": ["--target-platform", "android-arm64"]
build error

See this https://github.com/flutter/flutter/pull/34369
And I don't think it's right to remove this. See my comment.

I think it's safe to close the issue as it doesn't lead anywhere.

Solution is here :+1:
https://stackoverflow.com/a/67370078/8712102


Enhance our schema hover link to jump to the right table

Currently, our schema link just points to the file. However, we can link to the specific table for the model, which is a richer experience.
One possibility of how we can do this is by

Start returning the table name from our middleware
During the activate call parse schema.rb and create a hash of table names to locations
When executing hover, search the hash for the right line to jump to

Concerns

If there are modifications in schema.rb, we would need to rebuild the hash. For that, we need file watching to be merged in the Ruby LSP and then we have to design a way in which extensions can ask the Ruby LSP to notify them when certain files are changed.
This won't work for structure.sql. We probably don't want a SQL parser, but we might be able to achieve something with regexes

Thanks! Although in this project I'm not storing the locations of the tables, I'm using rubocop-ast to parse the source. This gives you access to the path and location in the file for every node.
So in the schema.rb the approach would be to:

Look for create_table method calls (lets call it the ddl_node)
Constantize its first argument using ActiveSupport's string helpers and get the model name
Get children line, column, last_line, last_column from ddl_node.location

I have a Visitor::Schema that I borrowed from rubocop-rails's SchemaLoader that basically does that, except for the location storing part.
I hope this makes sense.

Yeah, that makes sense. Although we'd use Prism and not rubocop-ast here. So you can probably do something like
class SchemaCollector < Prism::Visitor
  def initialize
    @tables = {}
  end

  def visit_call_node(node)
    # check if it's a `create_table` call
    # add it to the hash of tables
  end
end


App is not running on IE 11

App is not running on IE 11, it looks that there is an polyfils.js issue. Could you check it out please?

@Vencalekl have you tried uncommenting the appropriate polyfills? What specific issue are you having? Can you provide more details?

Thank you @asadsahi for your message, I did not try to uncomment the appropriate polyfills, will try and let you know. I guess that will do the trick.

Possible issue with enabling polyfills. Escalate if there is any further issues.


Units fix

We should always identify measure, both sensor measures and models measures, by a combination of name and units. This PR makes it so. Before this we were doing this correctly in some places, but in other places we relied on the name only.
Closes #245

Codecov Report
Attention: Patch coverage is 95.34884% with 6 lines in your changes are missing coverage. Please review.

Project coverage is 91.06%. Comparing base (298e014) to head (69c5045).
 Consider uploading reports for the commit a17d14b to get more accurate results

Files
Patch %
Lines

dtbase/backend/database/models.py
89.28%
3 Missing :warning:

dtbase/backend/database/sensors.py
88.88%
1 Missing :warning:

dtbase/frontend/app/models/routes.py
92.30%
1 Missing :warning:

dtbase/frontend/app/sensors/routes.py
80.00%
1 Missing :warning:

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #254      +/-   ##
==========================================
+ Coverage   90.83%   91.06%   +0.22%
==========================================
  Files          78       78
  Lines        5674     5695      +21
==========================================
+ Hits         5154     5186      +32
+ Misses        520      509      -11

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


awesome-vehicle-security

Add NIST Automotive Cybersecurity Community of Interest (COI) to websites

Done, thank you for sharing this @jacobdjwilson!
https://github.com/jaredthecoder/awesome-vehicle-security/commit/474a367948ec487b770fdcf1b3d34f846d66c0fc


button order

How can I control the order that the buttons are displayed in. Specifically I want to place the CUSTOM IFRAME at the bottom of the list. Currently it appears between big cursor and reading guide and it would make more sense to me at the top or bottom of the list

Hi @brianteeman,
I think we could kill two birds with one stone (related issue). We can expose the order CSS attribute as a variable to each option. That way the developer would be able to determine the desired order.
WDYT?

my understanding is that using "order" is not a good approach for accessibility https://developer.mozilla.org/en-US/docs/Web/CSS/order#accessibility_concerns
tbh my only real desire here is to place the custom iframe at the bottom of the list

@brianteeman I see your point. we'll add a new option to sort the modules.

thanks

Closing as fixed in 5.0.0


Duplicate defines under a type do not highlight correct text

The above is a SyntaxError - might be that syntax errors in language are not 0 based.

Confirming that java implementation of SyntaxError is 1 based, with no adjustment.
https://github.com/openfga/language/blob/main/pkg/java/src/main/java/dev/openfga/language/OpenFgaDslErrorListener.java#L25-L27

Should be fixed once https://github.com/openfga/language/commit/eb1335af2891d24e6be31c932d0023fadcab466a is released and adopted.

Validated as fixed by language upgrade


cargo run requires --bin

I had to use --bin to specify which executable:
cargo run --bin miri tests/run-pass/vecs.rs

This is because there's also a cargo-miri exe

Would be trivial to fix by adding a sub-crate for cargo-miri. Opinions?

It seems subcrates are not built per default, so the instructions have to change to cargo build --all. Also, they are not installed, and there is no cargo install --all, so one has to run cargo install --debug && cargo install --path cargo-miri --debug...

FWIW, I pushed "cargo-miri as a subcrate" to https://github.com/RalfJung/miri/tree/subcrate. However, due to the reasons stated above (in particular the installation part), I am doubtful whether that's really making things any better.

I wonder it it would make sense to add a default binary setting to cargo.toml since I've seen this issue show up in a few projects now...

You mean like this? https://github.com/rust-lang/cargo/issues/2200

This got fixed by using the experimental default-run feature.


Feature/auto experiment hpo

This PR adds

optimizer to evaluator
AutoExplanation.optimize
Explainer.copy and Metric.copy
Explainer.set_kwargs and Metric.set_kwargs

modifies

(rename) AutoExperiment to AutoExplanation

and removes

metrics from RecommenderOutput

@shiningstone23 You can check the example usage of AutoExplanation.optimize in tutorials/auto_explanation_imagenet_example.py

@enver1323 Could you, if you have some time, update AutoExplanationForTabularClassification for supporting your use case, after merge this PR? @shiningstone23 and I tried to do it on feature/auto-experiment-for-tabular branch (please check auto_experiment.py, experiment.py and recommender.py), but I'm not sure it can also support the current status of your use case.


add changelog entry for pinning gitlab

Tests in #735 are failing because of a change in NARKOZ/gitlab that breaks this gem for us. This PR will exhibit the breaking build, then pin the version to the last known good commit.

Yeah so this is currently broken, I only added the changelog entry to see it fail first. Now if I make the commit to pin the gitlab gem to 0cc49d008c6448d652fa27b3f9b3f60202dffab3 it should be green.

Ah note that I rather think #738 is the way to go here, I think I wann close this.


Custom Repo Fixes

What this PR does / why we need it:
This PR adds a few fixes for the custom repos feature.

Adds code to fill defaults in the extra_repos section of the spec.
Adds a permissions field to the http source. This allows us to fill in the permissions by default if they are on an http source that is nested under a key. It is important that fetched gpg keys have the proper permissions, otherwise apt cannot import them properly. Assuming that they do have proper permissions, apt can handle both .asc and .gpg keys just fine. This makes the explicit de-armor step unnecessary and means we no longer need gpg as a dependency in the jammy worker images.
Adds armored and de-armored key test variants to the custom repo tests to ensure everything is working properly.

Which issue(s) this PR fixes (optional, using fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when the PR gets merged):
Fixes #425
Special notes for your reviewer:

So this is no longer dearmoring keys at all?

So this is no longer dearmoring keys at all?

Yes. It should not be needed as long as the file extension on the keys is correct.

There may be something in the docs about this, can you update that?


Search by _id doesn't work

expecting a valid json all the time
must accept a string (regexp, no spaces, only usable characters)
http://grabberapp.com/z52hvp

this is done
2 things to be done:

set filterSelector of Template.Documents to {} on collection change
keep the input filled with the searched string / json

Done, but has to be eval()-ed on server side. Maybe we could use ESJON later to be able to pass RegExp or other values, but might be unnecessary.


Overly long tooltip text when playing

a very long tooltip text is shown with instructions on how to play. This text shows when hovering over any button.
Ideally, only the text relevant to a particular button should be shown when hovering it. Maybe add a "help" button in the top-right corner that opens an overlay with the help text.
The text also shows when hovering anywhere if the graph overlay is shown.

#142


streaming support for LLM, from huggingface

from the notebook  It says: LangChain provides streaming support for LLMs. Currently, we support streaming for the OpenAI, ChatOpenAI. and Anthropic implementations, but streaming support for other LLM implementations is on the roadmap.
I am more interested in using the commercially open-source LLM available on Hugging Face, such as Dolly V2. I am wondering whether LangChain has plans to include streaming support for Hugging Face's LLM in their roadmap. Additionally, is there any timeline for its integration? Thank you.

@jloganolson thank you so much Logan!
I just learnt TextStreamer from you today. I did some research and found it was released two weeks ago by huggingface in the transformers package:, released two weeks ago by huggingface in the transformers package: https://huggingface.co/docs/transformers/internal/generation_utils#transformers.TextStreamer, https://github.com/huggingface/transformers/blob/main/src/transformers/generation/streamers.py
from transformers import AutoModelForCausalLM, AutoTokenizer, TextStreamer, pipeline
streamer = TextStreamer(tokenizer, skip_prompt=True)
pipe = pipeline(
    "text-generation",
    model=model_fintuned,
    tokenizer=tokenizer,
    max_length=2048,
    temperature=0.6,
    pad_token_id=tokenizer.eos_token_id,
    top_p=0.95,
    repetition_penalty=1.2,
    device=device,
    streamer=streamer
)
pipe(prompts[0])

inputs = tokenizer(prompts[0], return_tensors="pt").to(device)
streamer = TextStreamer(tokenizer, skip_prompt=True)
_ = model_fintuned.generate(**inputs, streamer=streamer, pad_token_id=tokenizer.eos_token_id, max_length=248, temperature=0.8, top_p=0.8,
                        repetition_penalty=1.25)

related issues: https://github.com/databrickslabs/dolly/issues/84

close this issue, since it is solved thanks to @jloganolson

langchain+gradio chatbot, streaming output
        streamer = TextIteratorStreamer(tokenizer, timeout=10., skip_prompt=True, skip_special_tokens=True)
        pipe = pipeline(
            "text-generation",
            model=base_model,
            tokenizer=tokenizer,
            max_length=2048,
            temperature=0.6,
            pad_token_id=tokenizer.eos_token_id,
            top_p=0.95,
            repetition_penalty=1.2,
            streamer=streamer
        )
        local_llm = HuggingFacePipeline(pipeline=pipe)
        enhanced_rqa = RetrievalQA.from_chain_type(llm=local_llm, chain_type="stuff", retriever=product_retriever)
        from threading import Thread
        def run_enhanced_rqa(message):
            enhanced_rqa.run(message)

        t = Thread(target=run_enhanced_rqa, args=(input_message,))
        t.start()

        history[-1][1] = ""
        for new_text in streamer:
            history[-1][1]  += new_text
            time.sleep(0.05)
            yield history

I am creating an indexer, for that I want to use CustomLLM. How can I use this streaming method in this type of object.
Note: I can't use HuggingFacePipeline or any similar framework. My work is limited to CustomLLM.

langchain+gradio chatbot, streaming output
        streamer = TextIteratorStreamer(tokenizer, timeout=10., skip_prompt=True, skip_special_tokens=True)
        pipe = pipeline(
            "text-generation",
            model=base_model,
            tokenizer=tokenizer,
            max_length=2048,
            temperature=0.6,
            pad_token_id=tokenizer.eos_token_id,
            top_p=0.95,
            repetition_penalty=1.2,
            streamer=streamer
        )
        local_llm = HuggingFacePipeline(pipeline=pipe)
        enhanced_rqa = RetrievalQA.from_chain_type(llm=local_llm, chain_type="stuff", retriever=product_retriever)
        from threading import Thread
        def run_enhanced_rqa(message):
            enhanced_rqa.run(message)

        t = Thread(target=run_enhanced_rqa, args=(input_message,))
        t.start()

        history[-1][1] = ""
        for new_text in streamer:
            history[-1][1]  += new_text
            time.sleep(0.05)
            yield history

This is not working for me . Getting thread empty error. Could you pls share the complete gradio code

I use Llma 2
Use a pipeline for later
from transformers import pipeline, TextStreamer
streamer = TextStreamer(tokenizer, skip_prompt=True)
pipe = pipeline("text-generation",
model=model,
tokenizer= tokenizer,
torch_dtype=torch.bfloat16,
device_map="auto",
max_new_tokens = 512,
do_sample=True,
top_k=10,
num_return_sequences=1,
streamer=streamer,
eos_token_id=tokenizer.eos_token_id
)
It is working for me!

it streams to stdout not as generator variable

Added TextStreamer for HuggingFacePipeline, but doesn't seem to change anything to issue

https://github.com/langchain-ai/langserve/issues/218

@NajiAboo same, have you solved it?
i'm getting _queue.Empty error

if the response has im_start or im_end and you are annoyed with, use skip_special_tokens as keyword arguments in TextStreamer
streamer = TextStreamer(tokenizer, skip_prompt=True, skip_special_tokens=True)

prompt = "How to make sandwich ?"
streamer = TextStreamer(tokenizer,skip_prompt=True)
This is my code, I want to stop
pipe = pipeline(task="text-generation", model=model, tokenizer=tokenizer,max_length=512,
min_length = 30,
temperature=0.6,
pad_token_id=tokenizer.eos_token_id,
top_p=0.95,
encoder_repetition_penalty = 0.3,
num_return_sequences=1,
repetition_penalty=1.2,
length_penalty= 0.5,
streamer=streamer)

result = pipe(f"[INST] {prompt} [/INST]")
the output stops at instantly without completing the full sentence, I want it as minimum response, Is there any parameter I'm missing,
for example:
"Spread soft bread with mayonnaise or mustard, add your favorite meat and cheese, and enjoy! 2. What is the difference between"  It stops like this
I new to this.

langchain+gradio chatbot, streaming output
        streamer = TextIteratorStreamer(tokenizer, timeout=10., skip_prompt=True, skip_special_tokens=True)
        pipe = pipeline(
            "text-generation",
            model=base_model,
            tokenizer=tokenizer,
            max_length=2048,
            temperature=0.6,
            pad_token_id=tokenizer.eos_token_id,
            top_p=0.95,
            repetition_penalty=1.2,
            streamer=streamer
        )
        local_llm = HuggingFacePipeline(pipeline=pipe)
        enhanced_rqa = RetrievalQA.from_chain_type(llm=local_llm, chain_type="stuff", retriever=product_retriever)
        from threading import Thread
        def run_enhanced_rqa(message):
            enhanced_rqa.run(message)

        t = Thread(target=run_enhanced_rqa, args=(input_message,))
        t.start()

        history[-1][1] = ""
        for new_text in streamer:
            history[-1][1]  += new_text
            time.sleep(0.05)
            yield history

How to initialise tokenizer with chat_template here?

langchain+gradio chatbot, streaming output
        streamer = TextIteratorStreamer(tokenizer, timeout=10., skip_prompt=True, skip_special_tokens=True)
        pipe = pipeline(
            "text-generation",
            model=base_model,
            tokenizer=tokenizer,
            max_length=2048,
            temperature=0.6,
            pad_token_id=tokenizer.eos_token_id,
            top_p=0.95,
            repetition_penalty=1.2,
            streamer=streamer
        )
        local_llm = HuggingFacePipeline(pipeline=pipe)
        enhanced_rqa = RetrievalQA.from_chain_type(llm=local_llm, chain_type="stuff", retriever=product_retriever)
        from threading import Thread
        def run_enhanced_rqa(message):
            enhanced_rqa.run(message)

        t = Thread(target=run_enhanced_rqa, args=(input_message,))
        t.start()

        history[-1][1] = ""
        for new_text in streamer:
            history[-1][1]  += new_text
            time.sleep(0.05)
            yield history

How to initialise tokenizer with chat_template here?

Is there any updates with this?  I'm getting the following error: ValueError: Cannot use chat template functions because tokenizer.chat_template is not set and no template argument was passed!
tokenizer = transformers.AutoTokenizer.from_pretrained(
model_path,
local_files_only=True)
tokenizer.chat_template = "{% for message in messages %}{{'<|start_header_id|>' + message['role'] + '<|end_header_id|>' + message['content'] + '<|eot_id|>' + '\n'}}{% endfor %}"
streamer = TextStreamer(tokenizer)
pipeline = transformers.pipeline(
model=model,
tokenizer=tokenizer,
return_full_text=True,
task='text-generation',
temperature=0.5,
max_length=4096,
repetition_penalty=1.15,
streamer=streamer,
)
llm = HuggingFacePipeline(pipeline=pipeline)
model = ChatHuggingFace( llm=llm)


Revert "Closes #105 "

Reverts idaholab/raven#106
waiting for Josh

Merge Review Checklist

[x] 1. Review all computer code. Done
[x] 2. If any changes occur to the input syntax, there must be an accompanying change to the user manual and xsd schema. If the input syntax change deprecates existing input files, a conversion script needs to be added (see Conversion Scripts).  There is a change to the user manual to revert to original
[x] 3. Make sure the Python code and commenting standards are respected (camelBack, etc.) - See on the wiki for details. Yes
[x] 4. Automated Tests should pass, including run_tests, pylint, manual building and xsd tests. If there are changes to Simulation.py or JobHandler.py the qsub tests must pass. Yes
[x] 5. If significant functionality is added, there must  be tests added to check this. Tests should cover all possible options.  Multiple short tests are preferred over one large test. If new development on the internal JobHandler parallel system is performed, a cluster test must be added setting, in  XML block, the node <internalParallel> to True.  No functionality added.
[x] 6. If the change modifies or adds a requirement or a requirement based test case, the Change Control Board's Chair or designee also needs to approve the change.  The requirements and the requirements test shall be in sync. No change
[x] 7. The merge request must reference an issue.  If the issue is closed, the issue close checklist shall be done.   Related to https://github.com/idaholab/raven/issues/97
[x] 8. If an analytic test is changed/added is the the analytic documentation updated/added?  No change


feat(filters): added channelMix and lowPass

Blocked on https://github.com/freyacodes/Lavalink/pull/485

Codecov Report

Merging #27 (087f514) into main (0a060df) will increase coverage by 0.65%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main      #27      +/-   ##
==========================================
+ Coverage   74.79%   75.45%   +0.65%
==========================================
  Files          13       13
  Lines        1996     2049      +53
  Branches        5        5
==========================================
+ Hits         1493     1546      +53
  Misses        503      503

Impacted Files
Coverage Δ

src/types/OutgoingPayloads.ts
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0a060df...087f514. Read the comment docs.

uhh when is this going to be added

Whenever it gets added in Lavalink, there's no point on releasing a feature we can't use yet, @kakarot-dev.

There'll be a release later today including this in, make sure to update your LL image too! @kakarot-dev


dynamicFields with / in key

Hi,
I would like to use dynamicFields with kyes which has '/' characters.
Part of the templated yaml:
spec:
    template:
        metadata:
            annotations:
                checksum/values: 30da9af9da506b1fc3aa378d47e2d916f1d62e0e30dda84b25e855053233fd33

This is the  .chartignore
dynamicFields:
  - apiVersion: apps/v1
    kind: Deployment
    name: cosmo-auth-env
    jsonPath:
      - /spec/template/metadata/annotaions/checksum/values

I got the following error:
chart=. values=test/test.yaml err=failed to replace json path: failed to replace json path: failed to patch JSON6902: replace operation does not apply: doc is missing path: /spec/template/metadata/annotaions/checksum/values: missing value:

I tried the following escape segments:
/spec/template/metadata/annotaions/"checksum/values"
/spec/template/metadata/annotaions/'checksum/values'
/spec/template/metadata/annotaions/checksum%2Fvalues
None of the worked for me.
How can I escape the / in the key character?
Thank you for your help!

Hi @bendzsak-dpc Thank you for raising!
chartsnap use JSON Patch for dynamicField replacement and it comes from a famous Go library: https://github.com/evanphx/json-patch
In JSON Patch, escaping the / character is documented in RFC6901, section 3
   Because the characters '~' (%x7E) and '/' (%x2F) have special
   meanings in JSON Pointer, '~' needs to be encoded as '~0' and '/'
   needs to be encoded as '~1' when these characters appear in a
   reference token.

So you need to specifiy the path which has / like this:
/spec/template/metadata/annotaions/checksum~1values

Hi @jlandowner
Thank you for your help! I tried your suggestion and works like a charm.
It would be really helpful if you could add this to the documentation.
Anyway thank you again for your quick and helpful answer!


Can't pip install realesrgan on M1

Looks like it tries to build numpy from source.
Build output (too long to include here): https://gist.github.com/user799595/7544428976415caa49fc134edaa8cb4d
Related: https://github.com/xinntao/Real-ESRGAN/issues/425

The reason is it requires numpy-1.20.3 which is unsupported with the python version required for this repo.

Here is a temporary fix until cog.yaml file is fixed on GFPGAN's repo.
Clone gfpgan repo and install locally:
git clone git@github.com:TencentARC/GFPGAN.git
cd GFPGAN
pip install basicsr facexlib
pip install -r requirements.txt
python setup.py develop

Then you can run pip install realesrgan successfully.

I was able to switch to python 3.10.4 with no problems:
diff --git a/environment-mac.yaml b/environment-mac.yaml
index 44cd1ef..c0cc6ca 100644
--- a/environment-mac.yaml
+++ b/environment-mac.yaml
@@ -3,7 +3,7 @@ channels:
   - pytorch-nightly
   - conda-forge
 dependencies:
-  - python==3.9.13
+  - python==3.10.4
   - pip==22.2.2

   # pytorch-nightly, left unpinned

Then I ran:
conda env update -f environment-mac.yaml --prune

@cgodley numpy-1.20.3 doesn't seem to work any better with 3.10.4 for me

Here is a temporary fix until cog.yaml file is fixed on GFPGAN's repo.
Clone gfpgan repo and install locally:
git clone git@github.com:TencentARC/GFPGAN.git
cd GFPGAN
pip install basicsr facexlib
pip install -r requirements.txt
python setup.py develop

Then you can run pip install realesrgan successfully.

This fixed the installation error for me, thank you.

try using the requirements.txt setup here: https://github.com/lstein/stable-diffusion/issues/302#issue-1359489755

Thanks @stillmatic
Did you ever figure out the RuntimeError: expected scalar type BFloat16 but found Float error?

i'll take a deeper look this weekend, but it's probably something like adding
        if self.device.type in ['mps', 'cpu']:
            scope = nullcontext

to simplet2i.py. About 70% sure that's it, if so I'll send a PR to fix


Updating appstarter with composer does not take composer.phar into account

When you use composer via composer.phar (see installation instructions) you get an error during composer update due to a "wrong" post-update-cmd in composer.json because you didn't install composer as a globally available binary/script.
Steps to reproduce
$ php composer.phar create-project codeigniter4/appstarter -s beta --no-dev
Installing codeigniter4/appstarter (v4.0.0-beta.2)
[...]
$ cd appstarter
$ php ../composer.phar update --no-dev
Loading composer repositories with package information
Updating dependencies
Generating autoload files
> composer dump-autoload
sh: 1: composer: not found
Script composer dump-autoload handling the post-update-cmd event returned with error code 127

The line producing the error in composer.json is:
{
    ...
    "scripts": {
        "post-update-cmd": [
            "composer dump-autoload"
        ]
    },
    ...
}

Changing this line to php ../composer.phar dump-autoload leads to a successful update in my use-case (composer.phar above project root).
I don't know how to resolve this. Maybe composer has information on how it was started? Or there is a more generic way to call composer in composer.json.
While writing this issue, I found a solution: I found this. Replacing composer with @composer works in my test case. Has to be tested with a regular, global composer installation.

Your description does not sound like globally installed composer, which would then be accessible as "composer" or "php composer.phar" anywhere. It sounds more like you have a local install in the folder you first run it from.
Having said that, the "@composer" modification you refer to does sound like a better approach, and we can fix that


Add LICENSE file

There is no LICENSE file in this repository. This makes it difficult for other to re-use the contents of this repository. See https://choosealicense.com/no-permission/ on why this is a problem.

@schwadim since you are the main developer, please licence the repository with our preferred MIT


Search option defaults to "Near Location" for some users

Thanks heaps for building tsml-ui. It's working great for the DA Australian website
However, I've had a few people report that they can't see certain meetings on our list. After checking further it seems it's defaulting to near location.

hi @jeznag something must be getting lost in  translation, could you please include more details? perhaps describe the correspondence that you had with a user?
the search in your screenshot above is not near location. what does it show or not show?

Sorry that was the wrong screenshot. In Near Location, only some meetings appear

vs Search mode

I'd like to actually disable the Near Location option and only show search as almost all of our meetings are online only.
People seem to be getting the Near Location filter without purposefully selecting it.

ok thanks - that's right that only geographic meetings show as options when "near location" mode is enabled, which i think makes sense.
the only way to get into that mode without clicking on it is to visit the link - https://www.debtorsanonymous.org.au/?mode=location - perhaps some users have it bookmarked?
there's currently not a setting to remove the option from TSML UI - you could try adding some javascript to the page to remove mode=location from the URL if present when coming from a bookmark:
<script>
  var url = new URL(window.location.href);
  if (url.searchParams.get('mode')) {
    url.searchParams.delete('mode');
    window.history.replaceState({}, '', url);
  }
</script>

Thanks I've added that in.
One thing that confuses me is that some of the zoom meetings are showing up as in person meetings and some are not even though they have the same kind of location data. Meeting list is at https://debtorsanonymous.org.au/

vs

Source google sheet: https://docs.google.com/spreadsheets/d/1YRpUph8Xfw-hX-2IegFx_S4YQUprFTqLPYxfL42Pb98/edit#gid=0

@jeznag yeah it can be confusing, especially with google sheets because there isn't built-in feedback ui to show you what's going on
the location column in your sheet is a the name of the place, often this is a building name, or could be "Online" - but it has no impact in terms of wehther
in your case TSML UI is looking at your coordinates column to decide if the meeting is at a specific address or not. (it can use other signals, but since you have that column that's what it prefers). in-person meetings should have a single comma (lat,lng) vs online meetings that have three commas (lat,lng,lat,lng) which should describe a rectangle


Add getStats() to PCTransport

Add getStats() to PCTransport.
We used to manually collect and analyze PeerConnection stats like this:
room.engine.publisher.pc.getStats();

However, this became unavailable with the changes in #903, So, we wanted to add a way to call getStats() as an alternative.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Got it, and thanks for the review!


Add support for passing directory name suffixes

This adds support for passing suffixes to modify directory names when using iOSSnapshotTestCase instead of always defaulting to FBSnapshotTestCaseDefaultSuffixes().

Have you signed our CLA?

Signed 👍


Update no results found text

Bug/issue #92438198, if applicable:
Summary
We should simply say no results found.
Dependencies
NA
Testing
Describe how a reviewer can test the functionality of your PR. Provide test content to test with if
applicable.
Steps:

Open a .doccarchive with navigation
Use the filter input with random text
Assert that feedback text when no results is updated

Checklist
Make sure you check off the following items. If they cannot be completed, provide a reason.

[x] Added tests
[x] Ran npm test, and it succeeded
[x] Updated documentation if necessary

@swift-ci test

@swift-ci test

@swift-ci test


🎮 Game Request
Game logic
The KeySymphony game is an interactive game depicting a real piano. Users can play musical notes by clicking on the piano keys or using their keyboard. This project provides a fun experience, allowing users to practice piano playing directly in their web browser.
Point down the features
Game points
Interactive Keyboard
Visual Feedback
Audio Playback
Responsive Design
Select program in which you are contributing
GSSoC24
Code of Conduct

[X] I follow CONTRIBUTING GUIDELINE of this project.

/assign

Hey @AdityaP700 !
Thank you for raising an issue 💗
You can self assign the issue by commenting /assign in comment 😀
Make sure you follow CODE OF CONDUCT and CONTRIBUTING GUIDELINES 🚀
Don’t Forget to ⭐ our GameZone🎮
Make sure you join our Discord🕹

Hello @AdityaP700, Time's up!⏰
Sorry for closing your issue!
But it's more than a week since we haven't received anything from your side 😢 .
Come up with new ideas, create a new issue and make sure you finish it within a week! 🔥
All the best! 🚀
Happy Hacking! 💗

Hey @AdityaP700 ! Thank you so much for your raising the issue💗
It’s all yours, you can come anytime again and make some contributions! 🚀
Alone, we can do little, but together we can do so much! 😇


1.9.x - Gitlab Metaphor are missing icons of metaphor

Sample

Metaphor has icon
Metaphor-go: don't have it
Metaphor-frontend: don't have it

in order to address this issue, there simply needs to be a logo.png added to the repository root in the respective template repos. see:
https://github.com/kubefirst/metaphor-template/blob/main/logo.png

logo added to repos.


Error when opening file created using the test page

Failed to open up a file created using the test tool at http://evidenceprime.github.io/html-docx-js/test/sample.html

Test document at https://drive.google.com/file/d/0By6nm3ACZguvM2FPekZsVjlfamM/view?usp=sharing

Per the docs:

"IMPORTANT: please pass a complete, valid HTML (including DOCTYPE, html and body tags). This may be less convenient, but gives you possibility of including CSS rules in style tags."

When I include all of that in the demo, it generates a file that works fine for me.

Yes, that is right. This is slightly embarrassing that the demo doesn't reflect what was written in the documentation, I will fix this soon.

I just typed some text in the HTML textbox on the screen as a test, to decide whether to proceed with testing the code further.
Taking a look again I didn't think it's clear that to get the demo to work, one needs to edit the HTML to add a doctype, html and body tags.

Nice, thanks!

This is still causing problems.
Can you give us an example of a valid HTML to test on?

@aymanar The current demo adds HTML tags automatically (this is the fix I've deployed), so it is no longer necessary to add them yourself. Please remember that it only works when opened in MS Word though.

I just created some content on the demo page, downloaded the docx but Word (Office 2013) only gives me an error. Am I overlooking something obvious?


fix(security): mitigate Cross-Site Scripting attack (XSS).

Unsanitized input from an HTTP parameter flows into send, where it is used to render an HTML page returned to the user. This may result in a Cross-Site Scripting attack (XSS).
Signed-off-by: Bhaskar<EMAIL_ADDRESS>

@bhaskarvilles User input req.params.id is fed to escapeHtml before res.send sees it. Are there cases that output from escapeHtml can still be harmful?

Yes, in some cases it happens, So we have to  Sanitize data input in an HTTP request before reflecting it back, ensuring all data is validated, filtered or escaped before echoing anything back to the user, such as the values of query parameters during searches. And also convert special characters into their respective HTML or URL encoded equivalents.

@bhaskarvilles ok, thanks!
LGTM
I've approved it, but do you mind if I asked for an example or url to docs including an example describing the risk you mentioned?

You can Find here

@izuru0
I think you haven't merged my pr and not referenced in any commit if merged ?

@bhaskarvilles Please squash the commits into a single one with an interactive rebase. Let me know if you need help and if you do make sure to invite me to your fork as a collaborator.

I've invited you as collaborators, please squash and commit changes.

@bhaskarvilles LGTM, thank you!
FYI: I fixed the commits for you, please double check that you are also happy with them as-is before we merge.

I'm happy to see my contributions publicly, always ❤ Open-Source. Thank you for helping me in squashing @petermetz


fix(rest): never resolving when status 204

This fix the never resolving promise on the 204 status code response, that cause getting stuck on for example deferredMessage which you need to followup after.

thank you


Bookmarks autocompletion in :open should match description/keyword.

Hi, thank you for this great extension.
I have an issue related to URL autocompletion for bookmarks. Let's say that
I did  set complete=bookmarks,... and when I type :open  I have a bookmark entry
in the completion candidate list. For example
http://massimolauria.wordpress.com              (keyword: blog tags: math,cs) Hard Theorems

I would expect to be able to type, say, Theo and to have this entry to be selected. Or maybe to type blog with the same result. Unfortunately it seems that typed string is only matched against the URL and not against the additional fields.
Matching keywords, tags and descriptions would be better for several reasons:

the info is shown and highlighter in the completion candidate, and the user would naturally use this info to filter completion candidates;
keywords, tags and descriptions are usually more mnemonic than URLs
For bookmarklets the URL contains only javascript horror, while keyword and tags are actual words.

I know that you can filer by tag or keyword using :bmarks command, but it is dramatically more convenient to access all this features in the :open command (and :tabopen as well of course)

Hi Massimo, I don't see any Pentadactyl setting to adjust the behavior, but what you describe as being desireable is what I see. If I do :open and type in a tag name or a string that only appears in the title and not the url, I see the matching bookmark. I think Pentadactyl uses Firefox's default address bar engine (what you would get by typing into the address bar instead of the Pentadactyl command prompt) to do the url completions. Have you changed any of the settings for that in about:config?

I am experiencing the same issue as MassimoLauria. Typing :open matches history titles but not bookmark titles. I have not made any changes to about:config relevant to this issue.


parity: 1.10.8 -> 1.10.9

Motivation for this change

https://github.com/paritytech/parity/releases/tag/v1.10.9

Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Fits CONTRIBUTING.md.

Success on aarch64-linux (full log)
Attempted: parity
Partial log (click to expand)
installing
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/8zwfki2h8gcfjn73q3mff7fa765l0785-parity-1.10.9
shrinking /nix/store/8zwfki2h8gcfjn73q3mff7fa765l0785-parity-1.10.9/bin/librlp_derive.so
shrinking /nix/store/8zwfki2h8gcfjn73q3mff7fa765l0785-parity-1.10.9/bin/parity
strip is /nix/store/0pjsgkxz0rp5baycq5sp2s72lrr5q9sg-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/8zwfki2h8gcfjn73q3mff7fa765l0785-parity-1.10.9/bin
patching script interpreter paths in /nix/store/8zwfki2h8gcfjn73q3mff7fa765l0785-parity-1.10.9
checking for references to /build in /nix/store/8zwfki2h8gcfjn73q3mff7fa765l0785-parity-1.10.9...
/nix/store/8zwfki2h8gcfjn73q3mff7fa765l0785-parity-1.10.9

Failure on x86_64-linux (full log)
Attempted: parity
Partial log (click to expand)
   = help: call with fully qualified syntax `itertools::Itertools::flatten(...)` to keep using the current method

   Compiling ethcore-migrations v0.1.0 (file:///tmp/nix-build-parity-1.10.9.drv-0/source/ethcore/migrations)
   Compiling price-info v1.7.0 (file:///tmp/nix-build-parity-1.10.9.drv-0/source/price-info)
   Compiling parity-hash-fetch v1.9.0 (file:///tmp/nix-build-parity-1.10.9.drv-0/source/hash-fetch)
   Compiling parity-ui v1.9.0 (file:///tmp/nix-build-parity-1.10.9.drv-0/source/dapps/ui)
   Compiling ethcore v1.9.0 (file:///tmp/nix-build-parity-1.10.9.drv-0/source/ethcore)
   Compiling parity-dapps v1.9.0 (file:///tmp/nix-build-parity-1.10.9.drv-0/source/dapps)
building of ‘/nix/store/xv831bghvqsk3rzr1qchn5xsvd253ddy-parity-1.10.9.drv’ timed out after 1800 seconds
error: build of ‘/nix/store/xv831bghvqsk3rzr1qchn5xsvd253ddy-parity-1.10.9.drv’ failed

build timed out on ofborg but  succeeds on my local machine.


Update syntax highlighting in README

Github supports highlighting .vue files, so I updated the syntax highlighting in the README to use that.

@dflock Thanks for the hint! Our latest README.md does not contain any vue code anymore, so I'm going to close this PR, but I've used this in our Wiki's installation guide.