The unit test //tensorflow/python/client/session_clusterspec_prop_test is failing

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): No
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Linux Ubuntu 16.04
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device: N/A
TensorFlow installed from (source or binary): source
TensorFlow version (use command below): v1.8.0-17632-g14ecf71 1.12.0
Python version: 3.5.2
Bazel version (if compiling from source): 0.19.2
GCC/Compiler version (if compiling from source): gcc (Ubuntu 5.4.0-6ubuntu1~16.04.11) 5.4.0 20160609
CUDA/cuDNN version: N/A
GPU model and memory: N/A

Describe the current behavior
$ bazel test --config=opt -- //tensorflow/python:session_clusterspec_prop_test
DEBUG: /home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/external/build_bazel_rules_apple/apple/repositories.bzl:35:5:
WARNING: `build_bazel_rules_apple` depends on `bazel_skylib` loaded from https://github.com/bazelbuild/bazel-skylib.git (tag 0.6.0), but we have detected it already loaded into your workspace from None (tag None). You may run into compatibility issues. To silence this warning, pass `ignore_version_differences = True` to `apple_rules_dependencies()`.

WARNING: /home/user/src/tensorflow/tensorflow/python/BUILD:3178:1: in py_library rule //tensorflow/python:standard_ops: target '//tensorflow/python:standard_ops' depends on deprecated target '//tensorflow/python/ops/distributions:distributions': TensorFlow Distributions has migrated to TensorFlow Probability (https://github.com/tensorflow/probability). Deprecated copies remaining in tf.distributions will not receive new features, and will be removed by early 2019. You should update all usage of `tf.distributions` to `tfp.distributions`.
INFO: Analysed target //tensorflow/python:session_clusterspec_prop_test (0 packages loaded, 0 targets configured).
INFO: Found 1 test target...
FAIL: //tensorflow/python:session_clusterspec_prop_test (see /home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/testlogs/tensorflow/python/session_clusterspec_prop_test/test.log)
Target //tensorflow/python:session_clusterspec_prop_test up-to-date:
  bazel-bin/tensorflow/python/session_clusterspec_prop_test
INFO: Elapsed time: 4.492s, Critical Path: 4.03s, Remote (0.00% of the time): [queue: 0.00%, setup: 0.00%, process: 0.00%]
INFO: 1 process: 1 local.
INFO: Build completed, 1 test FAILED, 2 total actions
//tensorflow/python:session_clusterspec_prop_test                        FAILED in 4.0s
  /home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/testlogs/tensorflow/python/session_clusterspec_prop_test/test.log

INFO: Build completed, 1 test FAILED, 2 total actions

Describe the expected behavior
$ bazel test --config=opt -- //tensorflow/python:session_clusterspec_prop_test
DEBUG: /home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/external/build_bazel_rules_apple/apple/repositories.bzl:35:5:
WARNING: `build_bazel_rules_apple` depends on `bazel_skylib` loaded from https://github.com/bazelbuild/bazel-skylib.git (tag 0.6.0), but we have detected it already loaded into your workspace from None (tag None). You may run into compatibility issues. To silence this warning, pass `ignore_version_differences = True` to `apple_rules_dependencies()`.

WARNING: /home/user/src/tensorflow/tensorflow/python/BUILD:3178:1: in py_library rule //tensorflow/python:standard_ops: target '//tensorflow/python:standard_ops' depends on deprecated target '//tensorflow/python/ops/distributions:distributions': TensorFlow Distributions has migrated to TensorFlow Probability (https://github.com/tensorflow/probability). Deprecated copies remaining in tf.distributions will not receive new features, and will be removed by early 2019. You should update all usage of `tf.distributions` to `tfp.distributions`.
INFO: Analysed target //tensorflow/python:session_clusterspec_prop_test (1 packages loaded, 1518 targets configured).
INFO: Found 1 test target...
Target //tensorflow/python:session_clusterspec_prop_test up-to-date:
  bazel-bin/tensorflow/python/session_clusterspec_prop_test
INFO: Elapsed time: 2.186s, Critical Path: 0.54s, Remote (0.00% of the time): [queue: 0.00%, setup: 0.00%, process: 0.00%]
INFO: 2 processes: 2 local.
INFO: Build completed successfully, 3 total actions
//tensorflow/python:session_clusterspec_prop_test               (cached) PASSED in 4.4s

INFO: Build completed successfully, 3 total actions

Code to reproduce the issue
$ bazel test --config=opt -- //tensorflow/python:session_clusterspec_prop_test
Other info / logs
======================================================================
ERROR: testClusterSpecPropagationWorker1Placement (__main__.SessionClusterSpecPropagationTest)
testClusterSpecPropagationWorker1Placement (__main__.SessionClusterSpecPropagationTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/client/session_clusterspec_prop_test.py", line 109, in testClusterSpecPropagationWorker1Placement
    output = self.evaluate(const)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 1692, in evaluate
    return sess.run(tensors)
  File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 1811, in test_session
    yield cached
  File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 2523, in _constrain_devices_and_set_default
    yield sess
  File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/ops.py", line 5438, in get_controller
    yield g
  File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/ops.py", line 5245, in get_controller
    yield default
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/ops.py", line 5438, in get_controller
    yield g
  File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/eager/context.py", line 480, in _mode
    yield
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/ops.py", line 5438, in get_controller
    yield g
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 2523, in _constrain_devices_and_set_default
    yield sess
  File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/ops.py", line 5245, in get_controller
    yield default
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 2523, in _constrain_devices_and_set_default
    yield sess
  File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/ops.py", line 4405, in device
    yield
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 2523, in _constrain_devices_and_set_default
    yield sess
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 1811, in test_session
    yield cached
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 1692, in evaluate
    return sess.run(tensors)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 1419, in run
    return super(ErrorLoggingSession, self).run(*args, **kwargs)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/client/session.py", line 930, in run
    run_metadata_ptr)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/client/session.py", line 1078, in _run
    raise RuntimeError('The Session graph is empty.  Add operations to the '
RuntimeError: The Session graph is empty.  Add operations to the graph before calling run().

======================================================================
ERROR: testMultipleLocalDevices (__main__.SessionClusterSpecPropagationTest)
testMultipleLocalDevices (__main__.SessionClusterSpecPropagationTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/client/session_clusterspec_prop_test.py", line 211, in testMultipleLocalDevices
    output = self.evaluate(sum3)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 1692, in evaluate
    return sess.run(tensors)
  File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 1811, in test_session
    yield cached
  File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 2523, in _constrain_devices_and_set_default
    yield sess
  File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/ops.py", line 5438, in get_controller
    yield g
  File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/ops.py", line 5245, in get_controller
    yield default
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/ops.py", line 5438, in get_controller
    yield g
  File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/eager/context.py", line 480, in _mode
    yield
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/ops.py", line 5438, in get_controller
    yield g
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 2523, in _constrain_devices_and_set_default
    yield sess
  File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/ops.py", line 5245, in get_controller
    yield default
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 2523, in _constrain_devices_and_set_default
    yield sess
  File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/ops.py", line 4405, in device
    yield
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 2523, in _constrain_devices_and_set_default
    yield sess
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 1811, in test_session
    yield cached
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 1692, in evaluate
    return sess.run(tensors)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 1419, in run
    return super(ErrorLoggingSession, self).run(*args, **kwargs)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/client/session.py", line 930, in run
    run_metadata_ptr)
  File "/home/user/.cache/bazel/_bazel_user/59a925eeb655b30b5c683f8317fe569e/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/python/session_clusterspec_prop_test.runfiles/org_tensorflow/tensorflow/python/client/session.py", line 1078, in _run
    raise RuntimeError('The Session graph is empty.  Add operations to the '
RuntimeError: The Session graph is empty.  Add operations to the graph before calling run().

----------------------------------------------------------------------

PR https://github.com/tensorflow/tensorflow/pull/25832 fixes the issue.

The PR has been merged. Therefore closing this issue. Thanks!


Add Logseq quick capture extension

Add extension support Logseq Protocol quick capture function.
Allow user create note in Logseq via popclip.

Thanks! Merged in 7de2615c5e0c0694456f301ba27b94512b0bb989


Build error.  Could not resolve dependency

Run npm install<EMAIL_ADDRESS>npm ERR! code ERESOLVE
npm ERR! ERESOLVE could not resolve
npm ERR!
npm ERR! While resolving<EMAIL_ADDRESS>npm ERR! Found<EMAIL_ADDRESS>npm ERR! node_modules/react
npm ERR!   peer<EMAIL_ADDRESS>from<EMAIL_ADDRESS>npm ERR!   node_modules/@emotion/react
npm ERR<EMAIL_ADDRESS>from the root project
npm ERR<EMAIL_ADDRESS>from<EMAIL_ADDRESS>npm ERR!     packages/faircells-composer
npm ERR<EMAIL_ADDRESS>npm ERR!       node_modules/@jupyter_vre/faicells-composer
npm ERR!         workspace packages/faircells-composer from the root project
npm ERR!     1 more (@emotion/styled)
npm ERR!   peer<EMAIL_ADDRESS>from<EMAIL_ADDRESS>npm ERR!   node_modules/@emotion/styled
npm ERR<EMAIL_ADDRESS>from the root project
npm ERR<EMAIL_ADDRESS>from<EMAIL_ADDRESS>npm ERR!     packages/faircells-composer
npm ERR<EMAIL_ADDRESS>npm ERR!       node_modules/@jupyter_vre/faicells-composer
npm ERR!         workspace packages/faircells-composer from the root project
npm ERR!   3 more (@mrblenny/react-flow-chart, react-dom, styled-components)
npm ERR!
npm ERR! Could not resolve dependency:
npm ERR<EMAIL_ADDRESS>from the root project
npm ERR!
npm ERR! Conflicting peer dependency<EMAIL_ADDRESS>npm ERR! node_modules/react
npm ERR!   peer<EMAIL_ADDRESS>|| ^18.0.0" from<EMAIL_ADDRESS>npm ERR!   node_modules/@mui/material
npm ERR<EMAIL_ADDRESS>from the root project
npm ERR!
npm ERR! Fix the upstream dependency conflict, or retry
npm ERR! this command with --force, or --legacy-peer-deps
npm ERR! to accept an incorrect (and potentially broken) dependency resolution.
npm ERR!
npm ERR! See /home/runner/.npm/eresolve-report.txt for a full report.
npm ERR! A complete log of this run can be found in:
npm ERR!     /home/runner/.npm/_logs/2022-05-04T16_09_12_287Z-debug-0.log
Error: Process completed with exit code 1.

added --force


Apply consistent coding and documenting styling

Outline & Motivation
Without enforcing the same formatting, developers end up committing code/files that only changes formatting, making it hard to review.
Pitch
We might need a Makefile and add either the formatting here and modify the root pyproject.toml, as described in the contributor guide that commit hook is applied here.
Additional context
No response

Doesn't just running the pre-commit hooks locally (black and ruff) ensure this consistency ?

If that is the case, how did your pr results so many different files?

I ran the pre-commit hooks on all files before committing so the changes are white spaces and formatting that the linter enforced - I only added one file in my PR

there is no black and ruff config in the pyproject.toml

https://github.com/SylphAI-Inc/AdalFlow/pull/274/files

Yes I assumed that the fact that they were part of the .pre-commit-config.yaml means they are enforced. I will have a look

I ran the pre-commit hooks suggested on all files, made the changes https://github.com/SylphAI-Inc/AdalFlow/pull/274/commits/3196631c01bd759d5f4464d09d8415864aea8654. Maybe this can be merged and then the styling will be consistent ? @liyin2015

Proposed Changes

Update the formatting tools configuration:

Add explicit Black and Ruff configurations to root pyproject.toml
Configure both tools to use the same line length (88) and Python version
Set consistent exclude patterns for docs and non-Python files

Improve the Makefile commands:

Make format and lint commands use the pyproject.toml config
Add Ruff format alongside Black for complete formatting coverage

Update .pre-commit-config.yaml:

Point all hooks to use the pyproject.toml config
Add Ruff format hook
Maintain consistent exclude patterns

Implementation steps:

Add proposed configurations
Run make setup and make format on all files
Verify with make lint

This should resolve the inconsistent formatting issues we're seeing across PRs. I can implement these changes if everyone agrees with this approach.

Proposed Changes

Update the formatting tools configuration:

Add explicit Black and Ruff configurations to root pyproject.toml
Configure both tools to use the same line length (88) and Python version
Set consistent exclude patterns for docs and non-Python files

Improve the Makefile commands:

Make format and lint commands use the pyproject.toml config
Add Ruff format alongside Black for complete formatting coverage

Update .pre-commit-config.yaml:

Point all hooks to use the pyproject.toml config
Add Ruff format hook
Maintain consistent exclude patterns

Implementation steps:

Add proposed configurations
Run make setup and make format on all files
Verify with make lint

This should resolve the inconsistent formatting issues we're seeing across PRs. I can implement these changes if everyone agrees with this approach.

Yea I think this works you can do a PR again if you wish. Thanks


Invoking a Lambda requires docker

I want to use moto to mock invoking a Lambda in my code. However, it requires docker. My tests are already running inside of a container (using docker-in-docker in CI), which makes this infeasible.
Ideally I would be able to specify an arbitrary callable to invoke, rather than the overhead and complexity of having to run docker.

Hi @mwgamble! This looks like a duplicate of #5721 - so I'm going to close this in favor of that.
Like I mentioned there, it would be a useful feature, and it's own our radar, but I don't know yet how it is going to be implemented. Either as a callable, or by specifying a fixed response, or something else entirely.

Sorry for the duplicate. That didn't turn up in my search because the word "invoke" doesn't appear anywhere in the issue.


Detect crashed scripts and exit run

If an error prevents the page load from completing, the run will hang forever. We should add a configurable timeout for preventing this.

This should be resolved with the latest 4.0 major release of tracerbench.

FWIW
--sampleTimeout=sampleTimeout
      [default: 30] The number of seconds to wait for a sample.


AuthName comparison

In the ApiClient class, the String authName comparison is done with == like so
public ApiClient(String oAuthBasePath, String[] authNames) {
    this();
    this.setOAuthBasePath(oAuthBasePath);
    for(String authName : authNames) {
      Authentication auth;
      if (authName == "docusignAccessCode") {
        auth = new OAuth(httpClient, OAuthFlow.accessCode, oAuthBasePath + "/oauth/auth", oAuthBasePath + "/oauth/token", "all");
      } else if (authName == "docusignApiKey") {
        auth = new ApiKeyAuth("header", "docusignApiKey");
      } else {
        throw new RuntimeException("auth name \"" + authName + "\" not found in available auth names");
      }
      addAuthorization(authName, auth);
    }
  }

It should use equals instead.

@santa010 thank you for catching this. The fix will be deployed very soon in the official 2.9.0 version.

Hi, We have fixed the issues with new eSignature API version and new SDK release candidate.
Please have a look at v2.9.0 of the Maven/Gradle package.
Let us know if this resolves the issue.

Hi, the issue seems to be resolved with v2.9.0.


Update Change the Subject version

What maintenance needs to be done?
Update Change the Subject version to reflect new config
Level of urgency

[x] High (needs to be done prior to reindexing SCSB records)
[ ] Moderate
[ ] Low

Why is this maintenance needed?

Need to use up-to-date terminology for marginalized group

Acceptance criteria

[ ] Bibdata Production uses latest version of Change the Subject

Implementation notes, if any
Make sure https://github.com/pulibrary/change_the_subject/issues/26 has been implemented and released prior to working on this ticket.

Deployed to production


Cut nova requirement, causing composer issues

Composer spits out this when trying to composer require [this-package]
Problem 1
    - Installation request for saintsystems/nova-resource-group-menu ^0.0.10 -> satisfiable by saintsystems/nova-resource-group-menu[0.0.10].
    - saintsystems/nova-resource-group-menu 0.0.10 requires laravel/nova >=1.0 -> no matching package found.

This is caused when following the manual install of nova (drop a folder in, and add manually to composer.json). However, if you use composer directly, this doesn't pop.
Considering that the main documented method is the manual method, I'd assume it's the most common installation method at the moment.
Going to push a PR for cutting the nova requirement from composer.json.

For reference, I've hit this on a few repos, it's purely because of this requirement in this repo's composer.json.


function build using the ast

Resolves #1520
This is based on the same approach that #1521 took, however I converted it from bytecode generation to ast building to hopefully make it a little easier to understand / maintain.
This approach is slightly slower than the existing approach but fixes the memory leak -- more on the speed later.
The core problem of the memory leak is as follows, I'll be using the disassembler to explain this, hopefully this explanation is somewhat accessible ;)
Here's an example disassembly from the original functions before I changed them:
The rule I'm using throughout is Rule('/a/<string:b>')
dis.dis(rule._build)
  1           0 LOAD_CONST               0 ('')
              2 LOAD_CONST               1 ('/a/')
              4 LOAD_CONST               2 (<bound method BaseConverter.to_url of <werkzeug.routing.UnicodeConverter object at 0x7f48f0359320>>)
              6 LOAD_FAST                0 (b)
              8 CALL_FUNCTION            1
             10 BUILD_STRING             2
             12 BUILD_TUPLE              2
             14 RETURN_VALUE
(Pdb) dis.dis(rule._build_unknown)
  1           0 LOAD_CONST               0 ('')
              2 LOAD_CONST               1 ('/a/')
              4 LOAD_CONST               2 (<bound method BaseConverter.to_url of <werkzeug.routing.UnicodeConverter object at 0x7f48f0359320>>)
              6 LOAD_FAST                0 (b)
              8 CALL_FUNCTION            1
             10 LOAD_FAST                1 (.keyword_arguments)
             12 JUMP_IF_TRUE_OR_POP     20
             14 LOAD_CONST               0 ('')
             16 DUP_TOP
             18 JUMP_FORWARD            10 (to 30)
        >>   20 LOAD_CONST               3 (functools.partial(<function url_encode at 0x7f48f0618730>, charset='utf-8', sort=False, key=None))
             22 ROT_TWO
             24 CALL_FUNCTION            1
             26 LOAD_CONST               4 ('?')
             28 ROT_TWO
        >>   30 BUILD_STRING             4
             32 BUILD_TUPLE              2
             34 RETURN_VALUE

This ~roughly equates to the following functions (I'm using python3.6, the output is slightly different before that due to f-strings but it's not important for this discussion)
def f(b):  # _build
    return ('', f'{"/a/"}{to_url(b)}')   # to_url is loaded from `co_consts`

def f(b, **kwargs):  # _build_unknown
    if kwargs:
        q, params = '?', url_encode(kwargs)  # url_encode is loaded from `co_consts`
    else:
        q, params = '', ''

    return ('', f'{"/a/"}{to_url(b)}{q}{params}')  # to_url is loaded from `co_consts`

(in fact, here's the disassembly of those function(s) -- you can mostly ignore the FORMAT_VALUE opcodes, those are used to prepare f-strings and are noops for strings (which is what we're dealing with!)):
>>> dis.dis(f)  # _build
  9           0 LOAD_CONST               1 ('')
              2 LOAD_CONST               2 ('/a/')
              4 FORMAT_VALUE             0
              6 LOAD_GLOBAL              0 (to_url)
              8 LOAD_FAST                0 (b)
             10 CALL_FUNCTION            1
             12 FORMAT_VALUE             0
             14 BUILD_STRING             2
             16 BUILD_TUPLE              2
             18 RETURN_VALUE

>>> dis.dis(f)  # _build_unknown
 26           0 LOAD_FAST                1 (kwargs)
              2 POP_JUMP_IF_FALSE       20

 27           4 LOAD_CONST               1 ('?')
              6 LOAD_GLOBAL              0 (url_encode)
              8 LOAD_FAST                1 (kwargs)
             10 CALL_FUNCTION            1
             12 ROT_TWO
             14 STORE_FAST               2 (q)
             16 STORE_FAST               3 (params)
             18 JUMP_FORWARD             8 (to 28)

 29     >>   20 LOAD_CONST               4 (('', ''))
             22 UNPACK_SEQUENCE          2
             24 STORE_FAST               2 (q)
             26 STORE_FAST               3 (params)

 31     >>   28 LOAD_CONST               2 ('')
             30 LOAD_CONST               3 ('/a/')
             32 FORMAT_VALUE             0
             34 LOAD_GLOBAL              1 (to_url)
             36 LOAD_FAST                0 (b)
             38 CALL_FUNCTION            1
             40 FORMAT_VALUE             0
             42 LOAD_FAST                2 (q)
             44 FORMAT_VALUE             0
             46 LOAD_FAST                3 (params)
             48 FORMAT_VALUE             0
             50 BUILD_STRING             4
             52 BUILD_TUPLE              2
             54 RETURN_VALUE

Anyway, the issue with the original compiled function are these opcodes:
              4 LOAD_CONST               2 (<bound method BaseConverter.to_url of <werkzeug.routing.UnicodeConverter object at 0x7f48f0359320>>)

        >>   20 LOAD_CONST               3 (functools.partial(<function url_encode at 0x7f48f0618730>, charset='utf-8', sort=False, key=None))

In particular, this opcode causes co_consts to contain these values:
(Pdb) rule._build.__code__.co_consts
('', '/a/', <bound method BaseConverter.to_url of <werkzeug.routing.UnicodeConverter object at 0x7f48f0359320>>)

Usually, co_consts should only contain constants!  In particular, when the garbage collection machinery of cpython considers function objects, it doesn't consider the constants as potential trash because normally they're just constants (I don't have a citation for this, it's mostly based on what I observed while poking around with gc.get_referrers as can be seen here: https://github.com/pallets/werkzeug/issues/1520#issuecomment-485980372 -- notably you can see the tuple of the co_consts but not that a code object refers to it)
Because of this, it cannot detect the cycle that's introduced:
Map -> Rule -> code object -> co_consts tuple -> to_url method -> UnicodeConverter -> Map
And because it doesn't know about that, it can't collect the cycle during cyclical gc
The fix to this is to take the non-constant constants out of co_consts and instead refer to the objects directly.
My new versions of these functions adds a self argument to the generated methods, and attaches them as bound methods to the Rule class on creation.  The converters are then looked up on the Rule instance as they're called.  Here's the replacement disassembly, we can also look at the ast that produces these and the "unparsed" ast (using a modified astunparse)
rule._build
(Pdb) dis.dis(locs[func_ast.name])
  1           0 LOAD_CONST               1 ('')
              2 LOAD_CONST               2 ('/a/')
              4 LOAD_FAST                0 (.self)
              6 LOAD_ATTR                0 (_converters)
              8 LOAD_CONST               3 ('b')
             10 BINARY_SUBSCR
             12 LOAD_ATTR                1 (to_url)
             14 LOAD_FAST                1 (b)
             16 CALL_FUNCTION            1
             18 BUILD_STRING             2
             20 BUILD_TUPLE              2
             22 RETURN_VALUE
(Pdb) astpretty.pprint(func_ast, show_offsets=False)
FunctionDef(
    name="<builder:'/a/<string:b>'>",
    args=arguments(
        args=[
            arg(arg='.self', annotation=None),
            arg(arg='b', annotation=None),
        ],
        vararg=None,
        kwonlyargs=[],
        kw_defaults=[],
        kwarg=arg(arg='.kwargs', annotation=None),
        defaults=[],
    ),
    body=[
        Return(
            value=Tuple(
                elts=[
                    Str(s=''),
                    JoinedStr(
                        values=[
                            Str(s='/a/'),
                            Call(
                                func=Attribute(
                                    value=Subscript(
                                        value=Attribute(
                                            value=Name(id='.self', ctx=Load()),
                                            attr='_converters',
                                            ctx=Load(),
                                        ),
                                        slice=Index(
                                            value=Str(s='b'),
                                        ),
                                        ctx=Load(),
                                    ),
                                    attr='to_url',
                                    ctx=Load(),
                                ),
                                args=[Name(id='b', ctx=Load())],
                                keywords=[],
                            ),
                        ],
                    ),
                ],
                ctx=Load(),
            ),
        ),
    ],
    decorator_list=[],
    returns=None,
)
(Pdb) print(astunparse.unparse(func_ast))

def <builder:'/a/<string:b>'>(.self, b, **.kwargs):
    return ('', f"/a/{.self._converters['b'].to_url(b)}")

rule._build_unknown
(Pdb) dis.dis(locs[func_ast.name])
  1           0 LOAD_FAST                2 (.kwargs)
              2 POP_JUMP_IF_FALSE       20

  2           4 LOAD_CONST               1 ('?')
              6 STORE_FAST               3 (.q)

  3           8 LOAD_FAST                0 (.self)
             10 LOAD_ATTR                0 (_encode_query_vars)
             12 LOAD_FAST                2 (.kwargs)
             14 CALL_FUNCTION            1
             16 STORE_FAST               4 (.params)
             18 JUMP_FORWARD             8 (to 28)

  5     >>   20 LOAD_CONST               2 ('')
             22 DUP_TOP
             24 STORE_FAST               3 (.q)
             26 STORE_FAST               4 (.params)

  1     >>   28 LOAD_CONST               2 ('')
             30 LOAD_CONST               3 ('/a/')
             32 LOAD_FAST                0 (.self)
             34 LOAD_ATTR                1 (_converters)
             36 LOAD_CONST               4 ('b')
             38 BINARY_SUBSCR
             40 LOAD_ATTR                2 (to_url)
             42 LOAD_FAST                1 (b)
             44 CALL_FUNCTION            1
             46 LOAD_FAST                3 (.q)
             48 LOAD_FAST                4 (.params)
             50 BUILD_STRING             4
             52 BUILD_TUPLE              2
             54 RETURN_VALUE
(Pdb) astpretty.pprint(func_ast, show_offsets=False)
FunctionDef(
    name="<builder:'/a/<string:b>'>",
    args=arguments(
        args=[
            arg(arg='.self', annotation=None),
            arg(arg='b', annotation=None),
        ],
        vararg=None,
        kwonlyargs=[],
        kw_defaults=[],
        kwarg=arg(arg='.kwargs', annotation=None),
        defaults=[],
    ),
    body=[
        If(
            test=Name(id='.kwargs', ctx=Load()),
            body=[
                Assign(
                    targets=[Name(id='.q', ctx=Store())],
                    value=Str(s='?'),
                ),
                Assign(
                    targets=[Name(id='.params', ctx=Store())],
                    value=Call(
                        func=Attribute(
                            value=Name(id='.self', ctx=Load()),
                            attr='_encode_query_vars',
                            ctx=Load(),
                        ),
                        args=[Name(id='.kwargs', ctx=Load())],
                        keywords=[],
                    ),
                ),
            ],
            orelse=[
                Assign(
                    targets=[
                        Name(id='.q', ctx=Store()),
                        Name(id='.params', ctx=Store()),
                    ],
                    value=Str(s=''),
                ),
            ],
        ),
        Return(
            value=Tuple(
                elts=[
                    Str(s=''),
                    JoinedStr(
                        values=[
                            Str(s='/a/'),
                            Call(
                                func=Attribute(
                                    value=Subscript(
                                        value=Attribute(
                                            value=Name(id='.self', ctx=Load()),
                                            attr='_converters',
                                            ctx=Load(),
                                        ),
                                        slice=Index(
                                            value=Str(s='b'),
                                        ),
                                        ctx=Load(),
                                    ),
                                    attr='to_url',
                                    ctx=Load(),
                                ),
                                args=[Name(id='b', ctx=Load())],
                                keywords=[],
                            ),
                            Name(id='.q', ctx=Load()),
                            Name(id='.params', ctx=Load()),
                        ],
                    ),
                ],
                ctx=Load(),
            ),
        ),
    ],
    decorator_list=[],
    returns=None,
)
(Pdb) print(astunparse.unparse(func_ast))

def <builder:'/a/<string:b>'>(.self, b, **.kwargs):
    if .kwargs:
        .q = '?'
        .params = .self._encode_query_vars(.kwargs)
    else:
        .q = .params = ''
    return ('', f"/a/{.self._converters['b'].to_url(b)}{.q}{.params}")

So we basically replaced the illegal co_consts lookup with lookups on self

Running the perf benchmark from the original PR, this seems to make these ever-so-slightly slower.
        Equivalent to compile(source, filename, mode, PyCF_ONLY_AST).
        """
>       return compile(source, filename, mode, PyCF_ONLY_AST)
E         File "<unknown>", line 1
E       SyntaxError: more than 255 arguments

/usr/lib/python3.6/ast.py:35: SyntaxError
====================== 1 failed, 5 passed in 1.31 seconds ======================

I don't think url_for needs to support more than 255 arguments. TBH, even a tenth of it would most likely be more than enough for pretty much all usecases.

I figured it out, just needed to modify the ast object instead of parsing it with all the args

This fails if a parameter name is a keyword. I could add a test but even having a test for that feels like an xkcd 463 situation.
I'm impressed with the performance, and at how little code it takes to handle the Python 2/3 differences in _join. I don't love the quote-and-exec stuff though. If we're going to do it this way, can we construct AST directly?

fixed up the keyword bit.
I'm not sure what you mean by quote-and-exec, this is building the full ast and then compiling that.  I took a few shortcuts on building some of the ast objects to avoid handling version differences (both calls and function objects change quite a bit in the versions that are supported here) -- as a plus I think the constant code is a lot easier to read
Compare:
https://github.com/pallets/werkzeug/blob/4911f7ff40b04faf94d2a7a64de0e5a92587800e/src/werkzeug/routing.py#L502-L509
vs
If(
    test=Name(id='.kwargs', ctx=Load()),
    body=[
        Assign(
            targets=[Name(id='.q', ctx=Store())],
            value=Str(s='?'),
        ),
        Assign(
            targets=[Name(id='.params', ctx=Store())],
            value=Call(
                func=Attribute(
                    value=Name(id='.self', ctx=Load()),
                    attr='_encode_query_vars',
                    ctx=Load(),
                ),
                args=[Name(id='.kwargs', ctx=Load())],
                keywords=[],
            ),
        ),
    ],
    orelse=[
        Assign(
            targets=[
                Name(id='.q', ctx=Store()),
                Name(id='.params', ctx=Store()),
            ],
            value=Str(s=''),
        ),
    ],
)

I'm slowly watching through your video, and I definitely understand you wanting a string template vs. bytecode or ast. I'd still be interested to compare a string template, but I think this is a good step along the way at least, it cuts the complexity back down to a single function. I'm ok with parsing strings to shortcut writing some of the tree by hand. I'm ok with exec-ing the result vs shoving it in a code and function object directly, as it's going to accomplish the same thing.

I'll copy over my (amended) writeup from #1521 so we don't lose that context as well

The tools used above to generate outputs:

astpretty
astunparse

I needed to add this to handle our ~unconventional string-only f-strings:
--- unparser.old	2019-04-26 08:59:13.533000186 -0700
+++ venv/lib/python3.6/site-packages/astunparse/unparser.py	2019-04-26 08:59:21.664659408 -0700
@@ -501,6 +501,11 @@
             meth(t.format_spec, write)
         write("}")

+    def _fstring_Call(self, t, write):
+        self._fstring_FormattedValue(ast.FormattedValue(t, -1, None), write)
+
+    _fstring_Name = _fstring_Call
+
     def _Name(self, t):
         self.write(t.id)

Would you do git rebase --onto origin/0.15.x master to move this to the 0.15.x branch?

yep! doing that now

reparented and rebased!


Changed-to-download-v4

Download v4 required

Getting this error when adding the module:
import-module : The module to process 'C:\Program Files\WindowsPowerShell\Modules\PSParquet\bin/PSParquet.dll', listed
in field 'NestedModules' of module manifest 'C:\Program Files\WindowsPowerShell\Modules\PSParquet\PSParquet.psd1' was
not processed because no valid module was found in any module directory.
Any help would be greatly appreciated.
Thanks!

Hi @msmith257
What PowerShell version are you using?

Name                           Value

PSVersion                      5.1.22621.3958
PSEdition                      Desktop
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
BuildVersion                   10.0.22621.3958
CLRVersion                     4.0.30319.42000
WSManStackVersion              3.0
PSRemotingProtocolVersion      2.3
SerializationVersion           <IP_ADDRESS>

From: Axel B. Andersen @.>
Sent: Monday, September 30, 2024 9:05 PM
To: Agazoth/PSParquet @.>
Cc: Smith, Matthew @.>; Mention @.>
Subject: [EXTERNAL SOURCE] Re: [Agazoth/PSParquet] Changed-to-download-v4 (PR #10)
CAUTION: EMAIL IS FROM AN EXTERNAL SOURCE.

Hi @msmith257https://github.com/msmith257
What PowerShell version are you using?
—
Reply to this email directly, view it on GitHubhttps://github.com/Agazoth/PSParquet/pull/10#issuecomment-2384740655, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BLVKFUHXFOL7E5EBF3ZKAE3ZZINQNAVCNFSM6AAAAABOURASVWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBUG42DANRVGU.
You are receiving this because you were mentioned.
Disclaimer: The email and files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the original recipient or the person responsible for the delivering the email to the intended recipient, be advised that you have received this email in error, and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. If you received this email in error, please delete it from your system without copying it, and notify the sender by reply email so that our address record can be corrected. Thank you. Surgery Partners, Inc.

@msmith257 unfortunately Windows PowerShell is not supported. Please install Microsoft PowerShell to use the module.

Ok I'll take a look.
I didn't catch that it was Microsoft Powershell and not Windows Powershell.
Thank you

From: Axel B. Andersen @.>
Sent: Tuesday, October 1, 2024 9:36 AM
To: Agazoth/PSParquet @.>
Cc: Smith, Matthew @.>; Mention @.>
Subject: [EXTERNAL SOURCE] Re: [Agazoth/PSParquet] Changed-to-download-v4 (PR #10)
CAUTION: EMAIL IS FROM AN EXTERNAL SOURCE.

@msmith257https://github.com/msmith257 unfortunately Windows PowerShell is not supported. Please install Microsoft PowerShell to use the module.
—
Reply to this email directly, view it on GitHubhttps://github.com/Agazoth/PSParquet/pull/10#issuecomment-2386479988, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BLVKFUAUEKLRDA4TXWQC67TZZLFSRAVCNFSM6AAAAABOURASVWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBWGQ3TSOJYHA.
You are receiving this because you were mentioned.Message ID: @.***>
Disclaimer: The email and files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the original recipient or the person responsible for the delivering the email to the intended recipient, be advised that you have received this email in error, and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. If you received this email in error, please delete it from your system without copying it, and notify the sender by reply email so that our address record can be corrected. Thank you. Surgery Partners, Inc.

Ok so I have PowerShell 7.4.5 installed.
When I try to import-module psparquet I get The specified module 'psparquet' was not loaded because no valid module file was found in any module directory.
I put the module in c:\program data\windowspowershell\modules.
Should this be put into a different directory? I don't have a ton of experience with Microsoft Powershell. I've only used Windows Powershell in the past.
Also one question. Will this allow me to export a parquet file to .csv? Also is there a way to have it look in a directory, then import the parquet file and output a csv for each file found? I'm trying to get a process built to bulk import .csv files in the MSSQL.
Thank you for all your help!
Matthew

From: Axel B. Andersen @.>
Sent: Tuesday, October 1, 2024 9:36 AM
To: Agazoth/PSParquet @.>
Cc: Smith, Matthew @.>; Mention @.>
Subject: [EXTERNAL SOURCE] Re: [Agazoth/PSParquet] Changed-to-download-v4 (PR #10)
CAUTION: EMAIL IS FROM AN EXTERNAL SOURCE.

@msmith257https://github.com/msmith257 unfortunately Windows PowerShell is not supported. Please install Microsoft PowerShell to use the module.
—
Reply to this email directly, view it on GitHubhttps://github.com/Agazoth/PSParquet/pull/10#issuecomment-2386479988, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BLVKFUAUEKLRDA4TXWQC67TZZLFSRAVCNFSM6AAAAABOURASVWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBWGQ3TSOJYHA.
You are receiving this because you were mentioned.Message ID: @.***>
Disclaimer: The email and files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the original recipient or the person responsible for the delivering the email to the intended recipient, be advised that you have received this email in error, and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. If you received this email in error, please delete it from your system without copying it, and notify the sender by reply email so that our address record can be corrected. Thank you. Surgery Partners, Inc.

Did you run Install-Module PSParquet in PowerShell to install the module from the gallery? If so, the module loads automatically when you open a new shell.
Import-Parquet can import data from a parquet file. You can export that data to any format you want using any cmdlet you choose. Export-Csv would solve your question. You can also export the data to json or excel, but that requires other cmdlets. You can also import data directly from parquet and pipe it to your cmdlet of choice thar sends the data to sql.
Get the module installed first. Then run Get-Help on Import-Parquet and Export-Parquet with the example switch. That will give you the examples required to get a basic understanding of the functionality of the cmdlets.

Thank you,
I'll see what I can do. Seems that it isn't getting fully installed for me.
When I run a get-module -listavailable I see the PSParquet module. It's showing ver 0.2.14 atm.
However when I run import-parquet c:\Users\BCCSERVER\Ducuments\SQL Parquet\dc_2\administrations I get the following error message:
Import-parquet: The 'import-parquet' command was found in the module 'PSParquet', but the module could not be loaded. For more information, run 'Import-Module PSParquet.
So then I try and run the Import-Module PSParquet -verbose and get:
Import-Module: The specified module 'PSParquet'was not loaded because no valid module file was found in any module directory.
Do I have the module in the wrong location to start it from or something?
Thanks again!
Matthew

From: Axel B. Andersen @.>
Sent: Tuesday, October 1, 2024 10:55 AM
To: Agazoth/PSParquet @.>
Cc: Smith, Matthew @.>; Mention @.>
Subject: [EXTERNAL SOURCE] Re: [Agazoth/PSParquet] Changed-to-download-v4 (PR #10)
CAUTION: EMAIL IS FROM AN EXTERNAL SOURCE.

Did you run Install-Module PSParquet in PowerShell to install the module from the gallery? If so, the module loads automatically when you open a new shell.
Import-Parquet can import data from a parquet file. You can export that data to any format you want using any cmdlet you choose. Export-Csv would solve your question. You can also export the data to json or excel, but that requires other cmdlets. You can also import data directly from parquet and pipe it to your cmdlet of choice thar sends the data to sql.
Get the module installed first. Then run Get-Help on Import-Parquet and Export-Parquet with the example switch. That will give you the examples required to get a basic understanding of the functionality of the cmdlets.
—
Reply to this email directly, view it on GitHubhttps://github.com/Agazoth/PSParquet/pull/10#issuecomment-2386617737, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BLVKFUHJIHAR4T2AZHPFHY3ZZLOZZAVCNFSM6AAAAABOURASVWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBWGYYTONZTG4.
You are receiving this because you were mentioned.Message ID: @.***>
Disclaimer: The email and files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the original recipient or the person responsible for the delivering the email to the intended recipient, be advised that you have received this email in error, and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. If you received this email in error, please delete it from your system without copying it, and notify the sender by reply email so that our address record can be corrected. Thank you. Surgery Partners, Inc.

Hmm, sounds like something alreadt has a hook on one of the dlla in the module.
Is it possible to reboot the machine. Start Microsoft PowerShell right after reboot and try again?

Rebooted then started Powershell and am still getting the same results.
Am I trying to put the module in the wrong location or something? Where should it reside on this workstation?

From: Axel B. Andersen @.>
Sent: Tuesday, October 1, 2024 11:20 AM
To: Agazoth/PSParquet @.>
Cc: Smith, Matthew @.>; Mention @.>
Subject: [EXTERNAL SOURCE] Re: [Agazoth/PSParquet] Changed-to-download-v4 (PR #10)
CAUTION: EMAIL IS FROM AN EXTERNAL SOURCE.

Hmm, sounds like something alreadt has a hook on one of the dlla in the module.
Is it possible to reboot the machine. Start Microsoft PowerShell right after reboot and try again?
—
Reply to this email directly, view it on GitHubhttps://github.com/Agazoth/PSParquet/pull/10#issuecomment-2386672701, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BLVKFUCNHAM4W2QYEQ2MGILZZLRVJAVCNFSM6AAAAABOURASVWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBWGY3TENZQGE.
You are receiving this because you were mentioned.Message ID: @.***>
Disclaimer: The email and files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the original recipient or the person responsible for the delivering the email to the intended recipient, be advised that you have received this email in error, and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. If you received this email in error, please delete it from your system without copying it, and notify the sender by reply email so that our address record can be corrected. Thank you. Surgery Partners, Inc.

If you install the module from the gallery, it should place itself in the correct location. You can read more about the subject here: https://learn.microsoft.com/en-us/powershell/module/microsoft.powershell.core/about/about_psmodulepath?view=powershell-7.4
Please provide the output of Get-Module PSParquet -ListAvailable. What OS are you on?

Windows version 10.0.22631.4169
Directory c:\Program Files\powershell\7\Modules\PSParquet-main
Script 0.2.14     PSPaquet    Desk  Import-Paquet, Export-Parquet

From: Axel B. Andersen @.>
Sent: Tuesday, October 1, 2024 11:46 AM
To: Agazoth/PSParquet @.>
Cc: Smith, Matthew @.>; Mention @.>
Subject: [EXTERNAL SOURCE] Re: [Agazoth/PSParquet] Changed-to-download-v4 (PR #10)
CAUTION: EMAIL IS FROM AN EXTERNAL SOURCE.

If you install the module from the gallery, it should place itself in the correct location. You can read more about the subject here: https://learn.microsoft.com/en-us/powershell/module/microsoft.powershell.core/about/about_psmodulepath?view=powershell-7.4https://learn.microsoft.com/en-us/powershell/module/microsoft.powershell.core/about/about_psmodulepath?view=powershell-7.4
Please provide the output of Get-Module PSParquet -ListAvailable. What OS are you on?
—
Reply to this email directly, view it on GitHubhttps://github.com/Agazoth/PSParquet/pull/10#issuecomment-2386719954, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BLVKFUDZJENC3KSXV5ENGXTZZLUZJAVCNFSM6AAAAABOURASVWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBWG4YTSOJVGQ.
You are receiving this because you were mentioned.Message ID: @.***>
Disclaimer: The email and files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the original recipient or the person responsible for the delivering the email to the intended recipient, be advised that you have received this email in error, and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. If you received this email in error, please delete it from your system without copying it, and notify the sender by reply email so that our address record can be corrected. Thank you. Surgery Partners, Inc.

Your export should look something like this:
PS C:\repos> get-module -ListAvailable psparquet

    Directory: C:\Users\axel\Documents\PowerShell\Modules

ModuleType Version    PreRelease Name                                PSEdition ExportedCommands
---------- -------    ---------- ----                                --------- ----------------
Script     0.2.14                PSParquet                           Desk      {Import-Parquet, Export-Parquet}
Script     0.2.13                PSParquet                           Desk      {Import-Parquet, Export-Parquet}

First starte PowerShell with the NoProfile switch. Thiois can be done from the Run Windows+R dialog, pwsh -noprofile
In order to import the module with the above configuration, I would run the line below. You need to adjust to your environment
Import-Module  C:\Users\axel\Documents\PowerShell\Modules\PSParquet\ -Verbose -Force -Debug

The command produces an output like this:
VERBOSE: Loading module from path 'C:\Users\axel\Documents\PowerShell\Modules\PSParquet\0.2.14\PSParquet.psd1'.
VERBOSE: Populating RepositorySourceLocation property for module PSParquet.
VERBOSE: Loading module from path 'C:\Users\axel\Documents\PowerShell\Modules\PSParquet\0.2.14\bin\PSParquet.dll'.
VERBOSE: Importing cmdlet 'Export-Parquet'.
VERBOSE: Importing cmdlet 'Import-Parquet'.
VERBOSE: Loading module from path 'C:\Users\axel\Documents\PowerShell\Modules\PSParquet\0.2.14\PSParquet.psm1'.
VERBOSE: Exporting cmdlet 'Export-Parquet'.
VERBOSE: Exporting cmdlet 'Import-Parquet'.
VERBOSE: Importing cmdlet 'Export-Parquet'.
VERBOSE: Importing cmdlet 'Import-Parquet'.

Please try that and send me the complete result of the output.
It seems you have been shuffeling your modules around. It is quite difficult to support your scenario.

I think your post is missing something

I just tried to remove-module psparquet, and also uninstall-module and neither seems to  work. I've just now rebooted the machine and will try again.

From: Axel B. Andersen @.>
Sent: Wednesday, October 2, 2024 8:46 AM
To: Agazoth/PSParquet @.>
Cc: Smith, Matthew @.>; Mention @.>
Subject: [EXTERNAL SOURCE] Re: [Agazoth/PSParquet] Changed-to-download-v4 (PR #10)
CAUTION: EMAIL IS FROM AN EXTERNAL SOURCE.

I think your post is missing something
—
Reply to this email directly, view it on GitHubhttps://github.com/Agazoth/PSParquet/pull/10#issuecomment-2389014674, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BLVKFUDBXYFVRCT67YNJEHLZZQINLAVCNFSM6AAAAABOURASVWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBZGAYTINRXGQ.
You are receiving this because you were mentioned.Message ID: @.***>
Disclaimer: The email and files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the original recipient or the person responsible for the delivering the email to the intended recipient, be advised that you have received this email in error, and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. If you received this email in error, please delete it from your system without copying it, and notify the sender by reply email so that our address record can be corrected. Thank you. Surgery Partners, Inc.

From your site I did a download of the files in a zip file. Then extracted them to the documents folder. I removed them from any of the other locations before doing this as well.
So I have no idea what I could be missing.

From: Axel B. Andersen @.>
Sent: Wednesday, October 2, 2024 8:46 AM
To: Agazoth/PSParquet @.>
Cc: Smith, Matthew @.>; Mention @.>
Subject: [EXTERNAL SOURCE] Re: [Agazoth/PSParquet] Changed-to-download-v4 (PR #10)
CAUTION: EMAIL IS FROM AN EXTERNAL SOURCE.

I think your post is missing something
?
Reply to this email directly, view it on GitHubhttps://github.com/Agazoth/PSParquet/pull/10#issuecomment-2389014674, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BLVKFUDBXYFVRCT67YNJEHLZZQINLAVCNFSM6AAAAABOURASVWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBZGAYTINRXGQ.
You are receiving this because you were mentioned.Message ID: @.***>
Disclaimer: The email and files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the original recipient or the person responsible for the delivering the email to the intended recipient, be advised that you have received this email in error, and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. If you received this email in error, please delete it from your system without copying it, and notify the sender by reply email so that our address record can be corrected. Thank you. Surgery Partners, Inc.

From your site I did a download of the files in a zip file. Then extracted them to the documents folder. I removed them from any of the other locations before doing this as well. So I have no idea what I could be missing.

That code needs to be compiled. You need to follow the developer instructions in the readme to get that working.
I stead you could just Install-Module PSParquet from the gallery.

Ok so I was able to a import-psparquet file it seems like it's loading it to memory. How do I Export-CSV that info?

From: Axel B. Andersen @.>
Sent: Wednesday, October 2, 2024 9:37 AM
To: Agazoth/PSParquet @.>
Cc: Smith, Matthew @.>; Mention @.>
Subject: [EXTERNAL SOURCE] Re: [Agazoth/PSParquet] Changed-to-download-v4 (PR #10)
CAUTION: EMAIL IS FROM AN EXTERNAL SOURCE.

From your site I did a download of the files in a zip file. Then extracted them to the documents folder. I removed them from any of the other locations before doing this as well. So I have no idea what I could be missing.
That code needs to be compiled. You need to follow the developer instructions in the readme to get that working.
I stead you could just Install-Module PSParquet from the gallery.
—
Reply to this email directly, view it on GitHubhttps://github.com/Agazoth/PSParquet/pull/10#issuecomment-2389119279, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BLVKFUH6B2OERHZCKYD6W2TZZQOOLAVCNFSM6AAAAABOURASVWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBZGEYTSMRXHE.
You are receiving this because you were mentioned.
Disclaimer: The email and files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the original recipient or the person responsible for the delivering the email to the intended recipient, be advised that you have received this email in error, and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. If you received this email in error, please delete it from your system without copying it, and notify the sender by reply email so that our address record can be corrected. Thank you. Surgery Partners, Inc.

Something like this:
Import-Parquet <your parquet file> | Export-Csv <path to your csv file>

Ok think I have it.
Thank you for all your help on this one! Sorry for being so lacking in knowledge on this subject. Just never had a need for intensive PS stuff in the past, nor have I ever tried a module from GitHub before.
Have a great day!
Matthew

From: Axel B. Andersen @.>
Sent: Wednesday, October 2, 2024 10:15 AM
To: Agazoth/PSParquet @.>
Cc: Smith, Matthew @.>; Mention @.>
Subject: [EXTERNAL SOURCE] Re: [Agazoth/PSParquet] Changed-to-download-v4 (PR #10)
CAUTION: EMAIL IS FROM AN EXTERNAL SOURCE.

Something like this:
Import-Parquet  | Export-Csv
—
Reply to this email directly, view it on GitHubhttps://github.com/Agazoth/PSParquet/pull/10#issuecomment-2389196661, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BLVKFUG65DBV5S6HGIREQVTZZQS3LAVCNFSM6AAAAABOURASVWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBZGE4TMNRWGE.
You are receiving this because you were mentioned.Message ID: @.***>
Disclaimer: The email and files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the original recipient or the person responsible for the delivering the email to the intended recipient, be advised that you have received this email in error, and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. If you received this email in error, please delete it from your system without copying it, and notify the sender by reply email so that our address record can be corrected. Thank you. Surgery Partners, Inc.

Ok I guess I do have one more question. How can I load multiple parquet files and then export them to separate csv files in one script?
Hope you have time to answer this one.
Thank you again for all your assistance!
Matthew

From: Axel B. Andersen @.>
Sent: Wednesday, October 2, 2024 10:15 AM
To: Agazoth/PSParquet @.>
Cc: Smith, Matthew @.>; Mention @.>
Subject: [EXTERNAL SOURCE] Re: [Agazoth/PSParquet] Changed-to-download-v4 (PR #10)
CAUTION: EMAIL IS FROM AN EXTERNAL SOURCE.

Something like this:
Import-Parquet  | Export-Csv
—
Reply to this email directly, view it on GitHubhttps://github.com/Agazoth/PSParquet/pull/10#issuecomment-2389196661, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BLVKFUG65DBV5S6HGIREQVTZZQS3LAVCNFSM6AAAAABOURASVWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOBZGE4TMNRWGE.
You are receiving this because you were mentioned.Message ID: @.***>
Disclaimer: The email and files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the original recipient or the person responsible for the delivering the email to the intended recipient, be advised that you have received this email in error, and that any use, dissemination, forwarding, printing or copying of this email is strictly prohibited. If you received this email in error, please delete it from your system without copying it, and notify the sender by reply email so that our address record can be corrected. Thank you. Surgery Partners, Inc.


Corrections

Hy,
Two corrections. Doesn't work without this modifications in my project. What do you meen about this?
Thanks.

-		fullApdu[4] = -1;
+		fullApdu[4] = Byte.parseByte(Integer.toHexString(payload.length),16);
 		System.arraycopy(payload, 0, fullApdu, 5, payload.length);

The command in the second suggested correction is setting fullApdu[4] with the size of the payload; but this is already done by the System.arraycopy() in the next line. So if you need this line for your code to work, this probably means that you are not setting the size correctly in the payload that you are sending into the library.
The correct payload format is in the documentation of writeData and writeRecord in Line 1042 and Line 1204. Format:
	 * @param payload	a byte array with the following contents:
	 *
file number (1 byte),
	 *
offset within the record (3 bytes LSB),
	 *
length of the data to be written (3 bytes LSB),
	 *
the data (1+ bytes)

You appear to be missing length of the data to be written (3 bytes LSB).

See the file sample/Example1 for an example on how to write data with the proper payload. The first line has the size 0x05 which corresponds to the length of the data. The data is in the second line (0x1a, 0x2b, 0x3c, 0x4d, 0x5e).
desfire.writeData(new byte[] {
	fid, 0x00, 0x00, 0x00, 0x05, 0x00, 0x00,
	0x1a, 0x2b, 0x3c, 0x4d, 0x5e
});

Good luck!


Web-exported game - Error: Could not load game data at path '.'. Is the .pck file missing?

Godot version:
8f3fea20 (3.1 branch) + a custom module, built with
scons -j2 platform=javascript tools=no target=release CXXFLAGS=--std=c++11
OS/device including version:
Windows 7 64-bit, browsers Firefox and Chrome
emscripten 64 bit latest (1.38.46)
Issue description:
When exporting the game for web and running, I get:
Error: Could not load game data at path '.'. Is the .pck file missing?
But if really remove the pck file (to check the suggestion from the message above), I get this instead:
Failed loading file 'index.pck': File not found
Export for Windows (same commit, compiled with Visual Studio 2017) runs without the error
Steps to reproduce:

Made a html5 game export
Hosted on local python server (python -m http.server) or itch.io
After game loading bar finished, the browser popped up the error message box

Minimal reproduction project:
Any project I tried, including Godot examples
GLES 2 renderer at least, can't test WebGL 2 on my computer

Tried the examples on 3.1.1 stable and stock templates, sometimes they are black screen, sometimes OK, sometimes give some errors saying about render buffer and/or audio context...
It seems to me that, sadly, web export is in kind of half-baked state in Godot?

This bug sounds very similar to #32117. Make sure the project name doesn't contain a dot
Render buffer and audio context errors have been reported in other issues. Unfortunately, few people are knowledgeable with Emscripten in general, which leads to issues being fixed at a slower pace compared to most other platforms.

Sometimes (rarely) I get the same message, but usually hard-refreshing solves it. (I shift-click the refresh button.)
Try hard-refreshing a few times, also you can (I only had to do this for unity, but maybe it helps) open the dev tools in your browser, switch to the network tab, and tick disable cache, and then hard-refresh (while it's still open). Try it multiple times.
If it still doesn't work try uploading an exported project that has issues.
The renderbuffer and audio context errors are usually not the real problem, they just get thrown after something else has already failed.

It doesn't contain a dot except the extension, if export is "index.html" (plus index.pck and so on), still doesn't work

Okay I updated my emscripten, and the same error instantly appeared. But I forgot to clean caches, so I'll need to test it again, because half the code was compiled with an older version. I'll fo it a bit later.
However then I tried the emscripten version from the other issue, and that works, but it turns out this is the proper command to install it from scratch:
.\emsdk.bat install sdk-1.38.27-64bit
.\emsdk.bat activate sdk-1.38.27-64bit

according to the manual anything before 1.38.33 need to be installed like this.
(Also sdks older than this should work, I was 2 versions below this originally).
When rebuilding don't forget to clear your scons cache, and your build directory from javascript object files, before rebuilding, like I did first.
Also I git cleaned, and updated my emscripten install before doing this, just to be safe.

The downgrade helped, my game now works in Chrome, but gives just black screen in Firefox. Console output is about the same, hinting the game loaded. Probably there is something wrong with the browser, since Unity games are also black screen.

Downgrading did work but my export made the test button blurry

@sprite-1 Do other exported projects (e.g. this one) look blurry using the same browser?

@Calinou Not as far as I can tell

I just experienced the same .pck file missing error after I exported to HTML5 (bomb demo). I've tried hard-refreshing like it says in previous comments. But doesn't work. I just downloaded godot today, so I could be doing something wrong.

@nrcionline Using pre-built Godot 3.1.2? Did you try hosting the game on python server as suggested here https://docs.godotengine.org/en/3.1/getting_started/workflow/export/exporting_for_web.html?

Yes I'm using the default standard Godot 3.1.2 stable win64 version. I don't use python. I use iis. It should work on any webserver, right? If I edit the .html file and hardcode the PCK file to include a "." before it, it works, but then gives another error:
const EXECUTABLE_NAME = 'Bomb';
const MAIN_PACK = '.\Bomb.pck';
Failed loading file '.wasm': Not Found
I access this by going to localhost/Bomb/Bomb.html
All the game files are named Bomb. and they are all there.

@nrcionline Sorry, can't reproduce, unfortunately. The "multiplayer bomber" demo game starts for me with python -m http.server, in both Firefox and Chrome. I had to do a regular page refresh on Chrome though.
Fresh downloaded the engine, templates, and demo.

Yes I'm using the default standard Godot 3.1.2 stable win64 version. I don't use python. I use iis. It should work on any webserver, right? If I edit the .html file and hardcode the PCK file to include a "." before it, it works, but then gives another error:
const EXECUTABLE_NAME = 'Bomb';
const MAIN_PACK = '.\Bomb.pck';
Failed loading file '.wasm': Not Found
I access this by going to localhost/Bomb/Bomb.html
All the game files are named Bomb. and they are all there.

For those trying to help - to reproduce I'm using IIS not python.

It should work on any webserver, right?

Right.

For those trying to help - to reproduce I'm using IIS not python.

I don't know what is IIS, but if it's working on a simple dummy python server, but not on IIS, than it's likely the problem with IIS, not with Godot, right?

Anyone who is familiar with IIS want to help? Has no one ever tried IIS during any testing? Any help file to know how to configure the output for IIS?

If you are storing your .pck file in github LFS for a web build you must go into index.js and change mainPack from nil to the raw link to your pck file.


are you going to open both training/inference codes?

are you going to open both training/inference codes?
Thanks a lot for your contribution =D
I liked your paper so much!

Sincerely thank you for your interest !
We plan to release all the codes in June this year. 😄

Our code is available now! @AwayFromKeyboardwarrior

Thank you!


Internationalization has not taken effect

Describe the Bug

Where are you running VSCode? (Optional)
Windows
Which OpenAI model are you using? (Optional)
None
Additional context (Optional)
No response

I can't find the corresponding function in this line of code
this.sendMessage({ type: 'setTranslations', value: serializedTranslations });


rust nightly - error: attribute 'nightly-2019-12-05' missing

to build c2rust, i must pin the rust version to rust nightly-2019-12-05
naive solution
# flake.nix
{
          #rustChannel = "1.56.1";
          rustChannel = "nightly-2019-12-05"; # error: attribute 'nightly-2019-12-05' missing
          rustChannel = "nightly"; # error: attribute 'nightly' missing

https://github.com/cargo2nix/cargo2nix/blob/ae8a5e699f57b446f9507b97a3c97a4e9fe06aa3/overlay/make-package-set/simplified.nix#L17

default.nix with buildRustPackage
this works by creating one large derivation, but i want many small derivations, hence cargo2nix
/*
nix-build -E 'with import <nixpkgs> {}; callPackage ./default.nix {}'
*/

/*
usage
  to generate compile_commands.json, use
  nix-shell -p python3Packages.compiledb
  cd your_c_project && ./configure && compiledb -n make
*/

{ lib, pkgs, fetchFromGitHub, callPackage, makeRustPlatform }:

let

  # use custom rust version
  # fix: error[E0462]: found staticlib `rustc` instead of rlib or dylib
  # https://github.com/immunant/c2rust/issues/254#issuecomment-624631037
  # https://github.com/immunant/c2rust/blob/master/rust-toolchain

  rustPlatform = mkRustPlatform {
    date = "2019-12-05";
    channel = "nightly";
  };

  mkRustPlatform = { date, channel }:
    let
      mozillaOverlay = fetchFromGitHub {
        owner = "mozilla";
        repo = "nixpkgs-mozilla";
        rev = "cbc7435f5b0b3d17b16fb1d20cf7b616eec5e093";
        sha256 = "LKqAcdL+woWeYajs02bDQ7q8rsqgXuzhC354NoRaV80=";
      };
      mozilla = callPackage "${mozillaOverlay.out}/package-set.nix" {};
      rustSpecific = (mozilla.rustChannelOf { inherit date channel; }).rust;
    in
    makeRustPlatform {
      cargo = rustSpecific;
      rustc = rustSpecific;
    };

in

rustPlatform.buildRustPackage rec {
  pname = "c2rust";
  version = "2021-08-29";

  src = ./git/c2rust;

  buildType = "debug"; # build faster

  /*
  src = fetchFromGitHub {
    owner = "immunant";
    repo = pname;
    rev = "9d6f830ee7672d31e816df1158b4ba4aad81d8c0";
    sha256 = "Wkf1mM6+eUQBf4Zg3fFXGK14jTvCoD3Nk96MVht8pSs=";
  };
  */

  nativeBuildInputs = [
    pkgs.python3 # c2rust-refactor -> python3 process_ast.py
    pkgs.pkgconfig # c2rust-bitfields-derive -> pkg-config --libs --cflags openssl
    pkgs.llvm # c2rust-ast-exporter -> llvm-config
    pkgs.llvm.dev # c2rust-ast-exporter -> #include "llvm/Support/CommandLine.h"
    pkgs.cmake # c2rust-ast-exporter

    pkgs.tinycbor # c2rust-ast-exporter
  ];

  /*
    FIXME c2rust-ast-exporter
    -- Could NOT find Clang (missing: Clang_DIR)
  */

  # copy paste from c2rust/shell.nix
  buildInputs = [
    pkgs.openssl
    pkgs.zlib
    pkgs.clang

    #pkgs.tinycbor # c2rust-ast-exporter
  ];

  cargoSha256 = "FsPHWZisxGPlDIfx3SJrJpC2meNWL3ReJQx6Ha/z1Bc=";
  #cargoSha256 = "0000000000000000000000000000000000000000000000000000";

  cargoBuildFlags = [ "--locked" ];

  meta = with lib; {
    description = "Migrate C code to Rust";
    homepage = "https://github.com/immunant/c2rust";
    license = licenses.bsd3;
    #maintainers = [ maintainers.todo ];
  };
}

I started work on a patch for this
https://github.com/cargo2nix/cargo2nix/pull/224/commits/90e3f29717bf2074544dec02f854e9ad2f26fc38
Commit notes and doc updates should explain what all behavior I tried to encode.  In general we have some shortcuts for using oxalica from makePackageSet' but we also will support a user-created rustToolchain for advanced use
Will merge in #224
Feel free to cherry pick if you need it now but please do some more testing if you want to PR a cherry into master faster


Unable to restrict bucket access by Cognito User Group when importing auth

Before opening, please confirm:

[X] I have installed the latest version of the Amplify CLI (see above), and confirmed that the issue still persists.
[X] I have searched for duplicate or closed issues.
[X] I have read the guide for submitting bug reports.
[X] I have done my best to include a minimal, self-contained set of instructions for consistently reproducing the issue.
[X] I have removed any sensitive information from my code snippets and submission.

How did you install the Amplify CLI?
npm
If applicable, what version of Node.js are you using?
14.15.0
Amplify CLI Version
8.0.1
What operating system are you using?
Mac
Did you make any manual changes to the cloud resources managed by Amplify? Please describe the changes made.
No manual changes made
Amplify Categories
auth, storage
Amplify Commands
configure
Describe the bug
When importing a Cognito User Pool, the option to restrict CRUD actions for storage by User Groups is no longer there.
Expected behavior
The ability to restrict access to Storage by Cognito User Groups when importing a User Pool.
Reproduction steps

amplify import auth (follow prompts to import existing Cognito User Pool)
amplify add storage

GraphQL schema(s)
N/A
Log output
N/A
Additional information
After digging through some of the code it seems in this line:
https://github.com/aws-amplify/amplify-cli/blob/1daf72029bda79645ee95997c40a887741499164/packages/amplify-category-storage/src/provider-utils/awscloudformation/service-walkthroughs/s3-walkthrough.ts#L83
Must be returning an empty list when it should probably return the imported User Pool's groups.
Looking at this line:
https://github.com/aws-amplify/amplify-cli/blob/1daf72029bda79645ee95997c40a887741499164/packages/amplify-cli/src/extensions/amplify-helpers/get-userpoolgroup-list.ts#L7
It seems it gets the user groups from a file from the repo. Which isn't created when importing auth.
Any help would be greatly appreciated!! 🙏

Hello @zacbrannelly, Thank you for reaching out. On testing this in my local amplify application, I was able to reproduce the behavior. Additionally tested the amplify add api to see if the CLI will provide the option to access by groups when using an imported authentication resource but observed the prompt was not provided.
https://docs.amplify.aws/cli/restapi/restapi/#create-rest-api-and-restrict-specific-routes-to-specific-user-pool-groups
Marking this as feature request.


Revert " test cases for PoetBlockPublisher finalize_block()"

Reverts hyperledger/sawtooth-core#518

Should we hold off on this until we get the master fix in on the validator argument changes?

It looks like these tests passed in @delventhalz's PR. So, I'd suggest we wait until master passes and then close this revert.


Requiring Display name in creator

This fixes one part of #1074
There is additionally a bug where any required field can be left off the form if the user deletes all of the input forms requiring the field.

Coverage remained the same at 74.674% when pulling 7bc3a3a204f2d5bbc525afcb14fd64ec8352edf9 on i#1074 into a7a2941dfdcd258d72b4118d4215460498889efc on develop.

Coverage remained the same at 74.674% when pulling 7bc3a3a204f2d5bbc525afcb14fd64ec8352edf9 on i#1074 into a7a2941dfdcd258d72b4118d4215460498889efc on develop.


Voice control added via CMU Sphinx

Added installation of CMU Sphinx for voice recognition.
There are two ways of initiating a response:
1.) the same pushbutton as before.  Audio will be recorded for as long as the button is pressed, then sent for processing as soon as it is released.
2.) when it hears "alexa", it begins recording for 5 seconds.  When time is up, the audio is sent for processing.

I've finally had some time to look at this project, I've spent the last week refactoring the code to be a lot more modular so that we can support multiple different setups and different ways of triggering eg, button, Spinx, Snowboy etc. I'm going to close this PR but will try and incorporate but where I can then hopefully we can move forward on the new modular codebase.


Compilation fails on Julia 1.7

Creating a system image with FluxArchitectures fails when using PackageCompiler 2.0.2 and Julia 1.7. It works fine with Julia 1.6.4.
See: https://github.com/JuliaLang/PackageCompiler.jl/issues/643

Thank you for letting me know. I haven't used PackageCompiler before, so I will need to dig into this a bit. My first suspicion would be that it could be related to FluxArchitectures pinning the version of Zygote to an older one.

Sorry for pushing that further on... The issue seems to be coming directly from Flux' setup - in https://github.com/sdobber/FluxPkgCompilerIssue.jl, Flux is the only dependency, and cannot be compiled on 1.7. You might want to open an issue there - unfortunately, I don't have enough knowledge about all its inner workings...
Ping JuliaLang/PackageCompiler.jl#643


Voice Echoing on Rejoin

When we host a game, player voices are normal, but if we close the lobby and rejoin it, everyone has an echoing voice which is frustrating. The only fix we found is to completely relaunch the game.

Thank you for reporting the bug.
This bug should normally be fixed next update of this mod.
Do note that the new version there will be some null errors something about Occlude audio.
But that is only during the loading screen while you make/join a lobby, it should not break the game.
The new version should be coming out today.


Intersect Town Hall - Thursday, 29th August 2024

Tevo and Vani facilitating
Stephen - support and tracking-
Slides - https://docs.google.com/presentation/d/1k-MBrrEkao-1Gueo5kY0l676wIvuc4oPuRGKgHkqTCw/edit?usp=sharing
[ ] Tevo to request inclusion of Youtube Description to Intersect Town Hall

Improved Call Out for slide creation and posted again in Discord  https://discord.com/channels/1136727663583698984/1245340231482474506/1270082264801349662
Testing shorter Call out to bring attention to Intersect Town Hall stuff in first place
https://discord.com/channels/1136727663583698984/1136727664036692103/1270085069444354193

Since low response and now call out permissions in Discord, will now be attempting the spam mode.
Shared the call out in all group related channels

Slide deck request emails sent to all Committees 14.08
Publicity shared 27th and 28th https://docs.google.com/document/d/1_n2cMAk8uhVoNWanUWEMS8AkLxW8EN0uegHiXBvc6XE/edit#heading=h.ycptt3kp3wuw
And here starting drafting TH Summary: https://docs.google.com/document/d/1RCOuLRuwBg3xWrX6datkllsrmy-6oZdVwo43Pfz2HGw/edit


Some areas are not compatible with Dark Mode themes

Hello, just writing to let you know that I've found a couple places where Dark Mode is ignored.

On the View Configuration Screen:

On User Settings:

This may specifically be an issue with the Sketchy by Bootswatch theme. Adding the following Custom CSS fixed it:
table th, table td {
background-color: #212529;
}


(WinUI 3) AppWindow.TitleBar.SetDragRectangles not working with multiple drag areas.

Describe the bug
The new AppWindowTitleBar has a method to define drag areas when using a custom TitleBar, accepting a RectInt32 array as parameter. So I suppose it should draw different drag areas given their X, Y, Width and Height properties. My app has a SearchBox inside the titlebar, and some other buttons. In total, I need WinUI to draw 3 drag rects on my Window, but it only loads the first one in the array.
Given DragRect, DragRect2 and DragRect3, when only appending one of them to the array they work as expected. However, when appending two or all of them, only the first one is applied.
Steps to reproduce the bug

Create a Project with WinUI 3 on Desktop - Blank App on VS2022. WindowsAppSDK 1.0.0 experimental should be installed, not 0.8.1.
Set the MainWindow's Titlebar to ExtendContent m_titleBar.ExtendsContentIntoTitleBar = true;
Try to calculate and apply some drag areas with TitleBar.SetDragRectangles(dragRectsArray);
Only the first rect is applied. Others are ignored.

Expected behavior
I expected WinUI to draw all the Drag Area Rects inside the array.
Version Info

NuGet package version:
[WinUI 3 - Windows App SDK 1.0: 1.0.0-experimental]
Windows app type:

UWP
Win32

Yes

Windows version
Saw the problem?

Insider Build (22000.132)
Yes

May 2021 Update (19043)

October 2020 Update (19042)

May 2020 Update (19041)

November 2019 Update (18363)

May 2019 Update (18362)

October 2018 Update (17763)

April 2018 Update (17134)

Fall Creators Update (16299)

Creators Update (15063)

Device form factor
Saw the problem?

Desktop
Yes

Xbox

Surface Hub

IoT

I am closing this as I reviewed my code and found that the mistake was my fault. It's now working as expected. Thank you!

I am closing this as I reviewed my code and found that the mistake was my fault. It's now working as expected. Thank you!

what was the mistake?