Remove the requirement for venv from the build_and_deploy script

In working #56 I discovered that Ceilyn does not use virtual environments and that I am assuming that users are.
I need to fix the build script so that it does not assume a virtual environment.

This run is without a virtual environment.
barry@ubuntux64-20230604:~/Documents/github_reporting/framework_05$ /home/barry/PycharmProjects/iqss_gh_reporting/scripts/scaffolding/framework_05.sh -s /home/barry/PycharmProjects/iqss_gh_reporting/scripts -w /home/barry/Documents/github_reporting/framework_05
processing command line
processing command line option: s
Processing option 's' with '/home/barry/PycharmProjects/iqss_gh_reporting/scripts' argument
Setting SCRIPT_DIR: /home/barry/PycharmProjects/iqss_gh_reporting/scripts
processing command line option: w
Processing option 'w' with '/home/barry/Documents/github_reporting/framework_05' argument
Setting WRK_DIR_RT: /home/barry/Documents/github_reporting/framework_05
--
executing file: /home/barry/PycharmProjects/iqss_gh_reporting/scripts/scaffolding/framework_05.sh
pwd:  /home/barry/Documents/github_reporting/framework_05
venv: <></>
find . -type f
./input_file.yaml
./log.out
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-snapshot_summary.tsv
Next step: build_and_deploy_local.sh

press  to continue
~/PycharmProjects/iqss_gh_reporting/scripts ~/Documents/github_reporting/framework_05
Current file: ./build_and_deploy_local.sh
pwd: /home/barry/PycharmProjects/iqss_gh_reporting/scripts
venv: <></>
The script is going to to build the sources and then deploy it with pip
MUST be run from the ./scripts directory in the project tree.
e.g /home/barry/PycharmProjects/iqss_gh_reporting/scripts
where /home/barry/PycharmProjects/iqss_gh_reporting is the root of the project
press  to continue
~/PycharmProjects/iqss_gh_reporting ~/PycharmProjects/iqss_gh_reporting/scripts
Building the code here:
../
Building....
running bdist_wheel
running build
running build_py
running build_scripts
copying and adjusting workflows/create_iq_snapshot_init -> build/scripts-3.10
copying and adjusting workflows/create_iq_snapshot -> build/scripts-3.10
copying and adjusting workflows/process_labels -> build/scripts-3.10
/usr/lib/python3/dist-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
installing to build/bdist.linux-x86_64/wheel
running install
running install_lib
creating build/bdist.linux-x86_64/wheel
creating build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/init.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/process_labels_util.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/sprint_metadata.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/fetch_from_repository.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/legacy.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/graphql_query_lib.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/pdata.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/utils.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/transformer.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
running install_egg_info
running egg_info
writing iqss_gh_reporting.egg-info/PKG-INFO
writing dependency_links to iqss_gh_reporting.egg-info/dependency_links.txt
writing requirements to iqss_gh_reporting.egg-info/requires.txt
writing top-level names to iqss_gh_reporting.egg-info/top_level.txt
reading manifest file 'iqss_gh_reporting.egg-info/SOURCES.txt'
adding license file 'LICENSE.txt'
writing manifest file 'iqss_gh_reporting.egg-info/SOURCES.txt'
Copying iqss_gh_reporting.egg-info to build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.egg-info
running install_scripts
creating build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data
creating build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data/scripts
copying build/scripts-3.10/create_iq_snapshot -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data/scripts
copying build/scripts-3.10/create_iq_snapshot_init -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data/scripts
copying build/scripts-3.10/process_labels -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data/scripts
changing mode of build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data/scripts/create_iq_snapshot to 775
changing mode of build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data/scripts/create_iq_snapshot_init to 775
changing mode of build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data/scripts/process_labels to 775
adding license file "LICENSE.txt" (matched pattern "LICEN[CS]E*")
creating build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.dist-info/WHEEL
creating 'dist/iqss_gh_reporting-0.5-py3-none-any.whl' and adding 'build/bdist.linux-x86_64/wheel' to it
adding 'iqss_gh_reporting/init.py'
adding 'iqss_gh_reporting/fetch_from_repository.py'
adding 'iqss_gh_reporting/graphql_query_lib.py'
adding 'iqss_gh_reporting/legacy.py'
adding 'iqss_gh_reporting/pdata.py'
adding 'iqss_gh_reporting/process_labels_util.py'
adding 'iqss_gh_reporting/sprint_metadata.py'
adding 'iqss_gh_reporting/transformer.py'
adding 'iqss_gh_reporting/utils.py'
adding 'iqss_gh_reporting-0.5.data/scripts/create_iq_snapshot'
adding 'iqss_gh_reporting-0.5.data/scripts/create_iq_snapshot_init'
adding 'iqss_gh_reporting-0.5.data/scripts/process_labels'
adding 'iqss_gh_reporting-0.5.dist-info/LICENSE.txt'
adding 'iqss_gh_reporting-0.5.dist-info/METADATA'
adding 'iqss_gh_reporting-0.5.dist-info/WHEEL'
adding 'iqss_gh_reporting-0.5.dist-info/top_level.txt'
adding 'iqss_gh_reporting-0.5.dist-info/RECORD'
removing build/bdist.linux-x86_64/wheel
Installing....
Defaulting to user installation because normal site-packages is not writeable
Processing /home/barry/PycharmProjects/iqss_gh_reporting
Preparing metadata (setup.py) ... done
Requirement already satisfied: PyGithub in /home/barry/.local/lib/python3.10/site-packages (from iqss-gh-reporting==0.5) (1.58.2)
Requirement already satisfied: aiohttp in /home/barry/.local/lib/python3.10/site-packages (from iqss-gh-reporting==0.5) (3.8.4)
Requirement already satisfied: gql in /home/barry/.local/lib/python3.10/site-packages (from iqss-gh-reporting==0.5) (3.4.1)
Requirement already satisfied: graphql-py in /home/barry/.local/lib/python3.10/site-packages (from iqss-gh-reporting==0.5) (0.8.1)
Requirement already satisfied: numpy in /home/barry/.local/lib/python3.10/site-packages (from iqss-gh-reporting==0.5) (1.24.3)
Requirement already satisfied: pandas in /home/barry/.local/lib/python3.10/site-packages (from iqss-gh-reporting==0.5) (2.0.2)
Requirement already satisfied: pathvalidate in /home/barry/.local/lib/python3.10/site-packages (from iqss-gh-reporting==0.5) (3.0.0)
Requirement already satisfied: pyyaml in /usr/lib/python3/dist-packages (from iqss-gh-reporting==0.5) (5.4.1)
Requirement already satisfied: attrs>=17.3.0 in /home/barry/.local/lib/python3.10/site-packages (from aiohttp->iqss-gh-reporting==0.5) (23.1.0)
Requirement already satisfied: charset-normalizer<4.0,>=2.0 in /home/barry/.local/lib/python3.10/site-packages (from aiohttp->iqss-gh-reporting==0.5) (3.1.0)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/barry/.local/lib/python3.10/site-packages (from aiohttp->iqss-gh-reporting==0.5) (6.0.4)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in /home/barry/.local/lib/python3.10/site-packages (from aiohttp->iqss-gh-reporting==0.5) (4.0.2)
Requirement already satisfied: yarl<2.0,>=1.0 in /home/barry/.local/lib/python3.10/site-packages (from aiohttp->iqss-gh-reporting==0.5) (1.9.2)
Requirement already satisfied: frozenlist>=1.1.1 in /home/barry/.local/lib/python3.10/site-packages (from aiohttp->iqss-gh-reporting==0.5) (1.3.3)
Requirement already satisfied: aiosignal>=1.1.2 in /home/barry/.local/lib/python3.10/site-packages (from aiohttp->iqss-gh-reporting==0.5) (1.3.1)
Requirement already satisfied: graphql-core<3.3,>=3.2 in /home/barry/.local/lib/python3.10/site-packages (from gql->iqss-gh-reporting==0.5) (3.2.3)
Requirement already satisfied: backoff<3.0,>=1.11.1 in /home/barry/.local/lib/python3.10/site-packages (from gql->iqss-gh-reporting==0.5) (2.2.1)
Requirement already satisfied: ply>=3.6 in /home/barry/.local/lib/python3.10/site-packages (from graphql-py->iqss-gh-reporting==0.5) (3.11)
Requirement already satisfied: python-dateutil>=2.8.2 in /home/barry/.local/lib/python3.10/site-packages (from pandas->iqss-gh-reporting==0.5) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in /usr/lib/python3/dist-packages (from pandas->iqss-gh-reporting==0.5) (2022.1)
Requirement already satisfied: tzdata>=2022.1 in /home/barry/.local/lib/python3.10/site-packages (from pandas->iqss-gh-reporting==0.5) (2023.3)
Requirement already satisfied: deprecated in /home/barry/.local/lib/python3.10/site-packages (from PyGithub->iqss-gh-reporting==0.5) (1.2.14)
Requirement already satisfied: pyjwt[crypto]>=2.4.0 in /home/barry/.local/lib/python3.10/site-packages (from PyGithub->iqss-gh-reporting==0.5) (2.7.0)
Requirement already satisfied: pynacl>=1.4.0 in /usr/lib/python3/dist-packages (from PyGithub->iqss-gh-reporting==0.5) (1.5.0)
Requirement already satisfied: requests>=2.14.0 in /usr/lib/python3/dist-packages (from PyGithub->iqss-gh-reporting==0.5) (2.25.1)
Requirement already satisfied: cryptography>=3.4.0 in /usr/lib/python3/dist-packages (from pyjwt[crypto]>=2.4.0->PyGithub->iqss-gh-reporting==0.5) (3.4.8)
Requirement already satisfied: cffi>=1.4.1 in /home/barry/.local/lib/python3.10/site-packages (from pynacl>=1.4.0->PyGithub->iqss-gh-reporting==0.5) (1.15.1)
Requirement already satisfied: six>=1.5 in /usr/lib/python3/dist-packages (from python-dateutil>=2.8.2->pandas->iqss-gh-reporting==0.5) (1.16.0)
Requirement already satisfied: idna>=2.0 in /usr/lib/python3/dist-packages (from yarl<2.0,>=1.0->aiohttp->iqss-gh-reporting==0.5) (3.3)
Requirement already satisfied: wrapt<2,>=1.10 in /home/barry/.local/lib/python3.10/site-packages (from deprecated->PyGithub->iqss-gh-reporting==0.5) (1.15.0)
Requirement already satisfied: pycparser in /home/barry/.local/lib/python3.10/site-packages (from cffi>=1.4.1->pynacl>=1.4.0->PyGithub->iqss-gh-reporting==0.5) (2.21)
Building wheels for collected packages: iqss-gh-reporting
Building wheel for iqss-gh-reporting (setup.py) ... done
Created wheel for iqss-gh-reporting: filename=iqss_gh_reporting-0.5-py3-none-any.whl size=27453 sha256=8ade04d3d79c2331a0417d52e7058748d021ba75aeab979e435c30d12a0a5a50
Stored in directory: /tmp/pip-ephem-wheel-cache-1kycple8/wheels/60/48/4e/67cf42315ddb16f7c572094bf1015d4b40f5e098bd02a712fe
Successfully built iqss-gh-reporting
Installing collected packages: iqss-gh-reporting
Attempting uninstall: iqss-gh-reporting
Found existing installation: iqss-gh-reporting 0.5
Uninstalling iqss-gh-reporting-0.5:
Successfully uninstalled iqss-gh-reporting-0.5
Successfully installed iqss-gh-reporting-0.5
[notice] A new release of pip is available: 23.2.1 -> 23.3.1
[notice] To update, run: pip install --upgrade pip
~/PycharmProjects/iqss_gh_reporting/scripts
============================
current file: ./build_and_deploy_local.sh
pwd: /home/barry/PycharmProjects/iqss_gh_reporting/scripts
venv: <></>
Build and install complete.
The build will put these files and their associated libraries in your path.
create_iq_snapshot_init
create_iq_snapshot
Next Steps:
() Check that the build actually completed succesfully by reviewing the output.
() Test out the create_iq_snapshot_init build correctly using
create_iq_snapshot_init --help
() Follow the rest of the instructions in the readme
press  to continue
~/Documents/github_reporting/framework_05
--
executing file: /home/barry/PycharmProjects/iqss_gh_reporting/scripts/scaffolding/framework_05.sh
pwd:  /home/barry/Documents/github_reporting/framework_05
venv: <></>
find . -type f
./input_file.yaml
./log.out
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-snapshot_summary.tsv
Next step: setting directories for this run

press  to continue
rm: cannot remove '/home/barry/Documents/github_reporting/framework_05/out/*.json': No such file or directory
--
Time Stamp: 20231130_143836
Directories:
SCRIPT_DIR: "/home/barry/PycharmProjects/iqss_gh_reporting/scripts"
WRK_DIR_RT: "/home/barry/Documents/github_reporting/framework_05"
INDIR: "/home/barry/Documents/github_reporting/framework_05/in"
WRKDIR: "/home/barry/Documents/github_reporting/framework_05/wrk"
OUTDIR: "/home/barry/Documents/github_reporting/framework_05/out"
Current Directory Contents: /home/barry/Documents/github_reporting/framework_05
<>
/home/barry/Documents/github_reporting/framework_05/input_file.yaml
/home/barry/Documents/github_reporting/framework_05/log.out
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-matrix.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-sized.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-snapshot_summary.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-sized.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-matrix.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-snapshot_summary.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-matrix.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-snapshot_summary.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-sized.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-matrix.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-sized.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-snapshot_summary.tsv
</>
input file:
/home/barry/Documents/github_reporting/framework_05/in/
Note: This test is using the API so WRK_FILE will not be defined.
--

--
executing file: /home/barry/PycharmProjects/iqss_gh_reporting/scripts/scaffolding/framework_05.sh
pwd:  /home/barry/Documents/github_reporting/framework_05
venv: <></>
find . -type f
./input_file.yaml
./log.out
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-snapshot_summary.tsv
Next step: kickoff the Test

press  to continue
Yaml file path: /home/barry/Documents/github_reporting/framework_05/input_file.yaml
No yaml file found. Setting defaults
YAML data is valid!
Defaults currently mapped to Command Line input:
Any changes you just made will be written back to the yaml file
you can run this file repeatedly to update the defaults
collection_flag:
h: 'str: valid values: start | snapshot | end. api=required. file=Ignored.'
v: snapshot
data_collected_time:
h: 'str: When working with file input,use this.-special_char] ok:'''' no
trailing /. api=ignored. file=required.'
v: ''
organization_name:
h: 'str: e.g: IQSS. Always required.'
v: IQSS
output_base_dir:
h: 'str: /mnt/hgfs/iq_reporting_collab/run/out;no[ ,.-special_char] ok:''''.
No trailing /. api=ignored. file=Optional'
v: /home/barry/Documents/github_reporting/framework_05/out/
output_file_base_name:
h: 'str: e.g. sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig  .api=ignored.
file=not required.'
v: ''
project_name:
h: 'str: e.g: IQSS/dataverse. Always required.'
v: IQSS/dataverse
sprint_name:
h: 'str: e.g. sprint_2023_04_26;no[ ,.-special_char] ok:''''; api=required.file=required.'
v: snaps_collection
src_dir_name:
h: 'str: e.g: ~/iqss_gh_reporting/run/in no[ ,.-special_char] ok:'''' no
trailing /. api=ignored. file=required.'
v: ''
src_file_name:
h: 'str: e.g: sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig.tsv
.api=ignored. file=required.'
v: sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig.tsv
src_type:
h: 'str: valid values: api | file. Always required.'
v: api
workflow_name:
h: very short description or code.no[ ,.-special_char] ok:'_' Optional.
v: '000'
==========================================================================
You have set the run parameters.
Summary:
collection_flag:
v: snapshot
data_collected_time:
v: ''
organization_name:
v: IQSS
output_base_dir:
v: /home/barry/Documents/github_reporting/framework_05/out/
output_file_base_name:
v: ''
project_name:
v: IQSS/dataverse
sprint_name:
v: snaps_collection
src_dir_name:
v: ''
src_file_name:
v: sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig.tsv
src_type:
v: api
workflow_name:
v: '000'
==========================================================================
To actually run the analysis or collection and analysis run
create_iq_snapshot
from this same directory.
press  to continue
Running /home/barry/.local/bin/create_iq_snapshot as the main program
YAML data is valid!
input arguments:
collection_flag:
h: 'str: valid values: start | snapshot | end. api=required. file=Ignored.'
v: snapshot
data_collected_time:
h: 'str: When working with file input,use this.-special_char] ok:'''' no trailing
/. api=ignored. file=required.'
v: ''
organization_name:
h: 'str: e.g: IQSS. Always required.'
v: IQSS
output_base_dir:
h: 'str: /mnt/hgfs/iq_reporting_collab/run/out;no[ ,.-special_char] ok:''''. No
trailing /. api=ignored. file=Optional'
v: /home/barry/Documents/github_reporting/framework_05/out/
output_file_base_name:
h: 'str: e.g. sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig  .api=ignored.
file=not required.'
v: ''
project_name:
h: 'str: e.g: IQSS/dataverse. Always required.'
v: IQSS/dataverse
sprint_name:
h: 'str: e.g. sprint_2023_04_26;no[ ,.-special_char] ok:''''; api=required.file=required.'
v: snaps_collection
src_dir_name:
h: 'str: e.g: ~/iqss_gh_reporting/run/in no[ ,.-special_char] ok:'''' no trailing
/. api=ignored. file=required.'
v: ''
src_file_name:
h: 'str: e.g: sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig.tsv .api=ignored.
file=required.'
v: sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig.tsv
src_type:
h: 'str: valid values: api | file. Always required.'
v: api
workflow_name:
h: very short description or code.no[ ,.-special_char] ok:'_' Optional.
v: '000'
output_file_base_name 4api: snaps_collection-snapshot-000-api-2023_11_30_143853
directory exists or was created now: /home/barry/Documents/github_reporting/framework_05/out/snaps_collection
projects: looking to match IQSS/dataverse with IQSS/consilience
projects: looking to match IQSS/dataverse with IQSS/dataverse
Pandas version:2.0.2
start: 0 cards processed: IQSS/dataverse, Column â¶ SPRINT READY
end: 9 cards processed: IQSS/dataverse, Column â¶ SPRINT READY
start: 9 cards processed: IQSS/dataverse, Column This Sprint ðâï¸ ð
end: 15 cards processed: IQSS/dataverse, Column This Sprint ðâï¸ ð
start: 15 cards processed: IQSS/dataverse, Column IQSS Team - In Progress  ð»
end: 23 cards processed: IQSS/dataverse, Column IQSS Team - In Progress  ð»
start: 23 cards processed: IQSS/dataverse, Column Ready for Review â©
end: 34 cards processed: IQSS/dataverse, Column Ready for Review â©
start: 34 cards processed: IQSS/dataverse, Column In Review ð
end: 38 cards processed: IQSS/dataverse, Column In Review ð
start: 38 cards processed: IQSS/dataverse, Column Ready for QA â©
end: 41 cards processed: IQSS/dataverse, Column Ready for QA â©
start: 41 cards processed: IQSS/dataverse, Column QA â
end: 44 cards processed: IQSS/dataverse, Column QA â
start: 44 cards processed: IQSS/dataverse, Column Done ð

50 # cards IQSS/dataverse: Done ð                         ,Issue ,9996,dataverse ,[Spike - API] Extend the API to replicate the JSF behavior of downloading all dataset files
100 # cards IQSS/dataverse: Done ð                         ,PullRequest ,10014,dataverse ,Extend Datasets getDownloadSize API endpoint to support file search criteria and deaccessioned datasets
150 # cards IQSS/dataverse: Done ð                         ,PullRequest ,171,dataverse-frontend ,167 - Files table UI [1/2] - Integration filters and search
200 # cards IQSS/dataverse: Done ð                         ,PullRequest ,4,UNF ,Release to Maven Central
250 # cards IQSS/dataverse: Done ð                         ,PullRequest ,9736,dataverse ,9725 files lookup performance
300 # cards IQSS/dataverse: Done ð                         ,PullRequest ,9673,dataverse ,Added documentation about metadata block display facet properties
350 # cards IQSS/dataverse: Done ð                         ,PullRequest ,87,dataverse-frontend ,65 - Containerized development environment
400 # cards IQSS/dataverse: Done ð                         ,Issue ,75,dataverse.harvard.edu ,Spike: finalize the plan for transition to Make Data Count, how to display the metrics, how to handle legacy counts
450 # cards IQSS/dataverse: Done ð                         ,PullRequest ,8970,dataverse ,class field can be replaced by local variable
500 # cards IQSS/dataverse: Done ð                         ,PullRequest ,9241,dataverse ,document ongoing security and practices #3215
550 # cards IQSS/dataverse: Done ð                         ,PullRequest ,9030,dataverse ,Initialize transient fields with empty HashMap instead of null
600 # cards IQSS/dataverse: Done ð                         ,Issue ,179,dataverse.harvard.edu ,Spike. Unpublished datasets and some published datasets with missing files have file download counts
650 # cards IQSS/dataverse: Done ð                         ,PullRequest ,8696,dataverse ,GDCC/8605-add-archival-status-support
700 # cards IQSS/dataverse: Done ð                         ,PullRequest ,8685,dataverse ,remove unused imports from SettingsWrapper
750 # cards IQSS/dataverse: Done ð                         ,PullRequest ,8565,dataverse ,Update structure.css
800 # cards IQSS/dataverse: Done ð                         ,PullRequest ,8402,dataverse ,improve guestbook guides and link to them, add download button
850 # cards IQSS/dataverse: Done ð                         ,PullRequest ,8242,dataverse ,remove invalid characters from input #8018
end: 865 cards processed: IQSS/dataverse, Column Done ð
required list entries: ['Project', 'Column', 'Type', 'Number', 'Labels', 'Repo', 'State']
submitted list entries: Index(['Project', 'Column', 'Card', 'CardURL', 'Type', 'Number', 'Labels',
'Repo', 'State', 'CreatedAt', 'UpdatedAt', 'ClosedAt', 'ClosedBy',
'Title'],
dtype='object')
All desired entries are present.
Saving result to file.
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-sized.tsv
required list entries: ['Project', 'Column', 'Type', 'Number', 'Labels', 'Repo', 'State']
submitted list entries: Index(['Project', 'Column', 'Card', 'CardURL', 'Type', 'Number', 'Labels',
'Repo', 'State', 'CreatedAt', 'UpdatedAt', 'ClosedAt', 'ClosedBy',
'Title', 'Size'],
dtype='object')
All desired entries are present.
Saving results to file.
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-matrix.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-matrix.tsv
Values: ['This Sprint ð\u200dâï¸ ð', 'IQSS Team - In Progress  ð»', 'Ready for Review â©', 'In Review ð']
Values: ['This Sprint ð\u200dâï¸ ð', 'IQSS Team - In Progress  ð»', 'Ready for Review â©', 'In Review ð']
Saving results to file.
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-snapshot_summary.tsv

This run is INSIDE a virtual environment.
barry@ubuntux64-20230604:~/Documents/github_reporting/framework_05$ /home/barry/PycharmProjects/iqss_gh_reporting/scripts/scaffolding/framework_05.sh -s /home/barry/PycharmProjects/iqss_gh_reporting/scripts -w /home/barry/Documents/github_reporting/framework_05 -v "/home/barry/PycharmProjects/iqss_gh_reporting/venv/bin/activate"
processing command line
processing command line option: s
Processing option 's' with '/home/barry/PycharmProjects/iqss_gh_reporting/scripts' argument
Setting SCRIPT_DIR: /home/barry/PycharmProjects/iqss_gh_reporting/scripts
processing command line option: w
Processing option 'w' with '/home/barry/Documents/github_reporting/framework_05' argument
Setting WRK_DIR_RT: /home/barry/Documents/github_reporting/framework_05
processing command line option: v
Processing option 'v' with '/home/barry/PycharmProjects/iqss_gh_reporting/venv/bin/activate' argument
Activating virtual environment: /home/barry/PycharmProjects/iqss_gh_reporting/venv/bin/activate
Virtual environment active
VIRTUAL_ENV=/home/barry/PycharmProjects/iqss_gh_reporting/venv
-
--
executing file: /home/barry/PycharmProjects/iqss_gh_reporting/scripts/scaffolding/framework_05.sh
pwd:  /home/barry/Documents/github_reporting/framework_05
venv: <>VIRTUAL_ENV=/home/barry/PycharmProjects/iqss_gh_reporting/venv</>
--
find . -type f
./input_file.yaml
./log.out
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-snapshot_summary.tsv
--
Next step: build_and_deploy_local.sh
--
-
press <enter> to continue
============================

~/PycharmProjects/iqss_gh_reporting/scripts ~/Documents/github_reporting/framework_05
============================
Current file: ./build_and_deploy_local.sh
pwd: /home/barry/PycharmProjects/iqss_gh_reporting/scripts
venv: <>VIRTUAL_ENV=/home/barry/PycharmProjects/iqss_gh_reporting/venv</>

The script is going to to build the sources and then deploy it with pip

MUST be run from the ./scripts directory in the project tree.
e.g /home/barry/PycharmProjects/iqss_gh_reporting/scripts
where /home/barry/PycharmProjects/iqss_gh_reporting is the root of the project

press <enter> to continue
============================

~/PycharmProjects/iqss_gh_reporting ~/PycharmProjects/iqss_gh_reporting/scripts

Building the code here:
../

Building....

running bdist_wheel
running build
running build_py
running build_scripts
copying and adjusting workflows/create_iq_snapshot_init -> build/scripts-3.10
copying and adjusting workflows/create_iq_snapshot -> build/scripts-3.10
copying and adjusting workflows/process_labels -> build/scripts-3.10
/usr/lib/python3/dist-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
installing to build/bdist.linux-x86_64/wheel
running install
running install_lib
creating build/bdist.linux-x86_64/wheel
creating build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/__init__.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/process_labels_util.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/sprint_metadata.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/fetch_from_repository.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/legacy.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/graphql_query_lib.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/pdata.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/utils.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
copying build/lib/iqss_gh_reporting/transformer.py -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting
running install_egg_info
running egg_info
writing iqss_gh_reporting.egg-info/PKG-INFO
writing dependency_links to iqss_gh_reporting.egg-info/dependency_links.txt
writing requirements to iqss_gh_reporting.egg-info/requires.txt
writing top-level names to iqss_gh_reporting.egg-info/top_level.txt
reading manifest file 'iqss_gh_reporting.egg-info/SOURCES.txt'
adding license file 'LICENSE.txt'
writing manifest file 'iqss_gh_reporting.egg-info/SOURCES.txt'
Copying iqss_gh_reporting.egg-info to build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.egg-info
running install_scripts
creating build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data
creating build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data/scripts
copying build/scripts-3.10/create_iq_snapshot -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data/scripts
copying build/scripts-3.10/create_iq_snapshot_init -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data/scripts
copying build/scripts-3.10/process_labels -> build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data/scripts
changing mode of build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data/scripts/create_iq_snapshot to 775
changing mode of build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data/scripts/create_iq_snapshot_init to 775
changing mode of build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.data/scripts/process_labels to 775
adding license file "LICENSE.txt" (matched pattern "LICEN[CS]E*")
creating build/bdist.linux-x86_64/wheel/iqss_gh_reporting-0.5.dist-info/WHEEL
creating 'dist/iqss_gh_reporting-0.5-py3-none-any.whl' and adding 'build/bdist.linux-x86_64/wheel' to it
adding 'iqss_gh_reporting/__init__.py'
adding 'iqss_gh_reporting/fetch_from_repository.py'
adding 'iqss_gh_reporting/graphql_query_lib.py'
adding 'iqss_gh_reporting/legacy.py'
adding 'iqss_gh_reporting/pdata.py'
adding 'iqss_gh_reporting/process_labels_util.py'
adding 'iqss_gh_reporting/sprint_metadata.py'
adding 'iqss_gh_reporting/transformer.py'
adding 'iqss_gh_reporting/utils.py'
adding 'iqss_gh_reporting-0.5.data/scripts/create_iq_snapshot'
adding 'iqss_gh_reporting-0.5.data/scripts/create_iq_snapshot_init'
adding 'iqss_gh_reporting-0.5.data/scripts/process_labels'
adding 'iqss_gh_reporting-0.5.dist-info/LICENSE.txt'
adding 'iqss_gh_reporting-0.5.dist-info/METADATA'
adding 'iqss_gh_reporting-0.5.dist-info/WHEEL'
adding 'iqss_gh_reporting-0.5.dist-info/top_level.txt'
adding 'iqss_gh_reporting-0.5.dist-info/RECORD'
removing build/bdist.linux-x86_64/wheel

Installing....

Processing /home/barry/PycharmProjects/iqss_gh_reporting
Preparing metadata (setup.py) ... done
Requirement already satisfied: PyGithub in ./venv/lib/python3.10/site-packages (from iqss-gh-reporting==0.5) (1.58.2)
Requirement already satisfied: gql in ./venv/lib/python3.10/site-packages (from iqss-gh-reporting==0.5) (3.4.1)
Requirement already satisfied: pathvalidate in ./venv/lib/python3.10/site-packages (from iqss-gh-reporting==0.5) (3.0.0)
Requirement already satisfied: pandas in ./venv/lib/python3.10/site-packages (from iqss-gh-reporting==0.5) (2.0.3)
Requirement already satisfied: pyyaml in ./venv/lib/python3.10/site-packages (from iqss-gh-reporting==0.5) (6.0)
Requirement already satisfied: graphql-py in ./venv/lib/python3.10/site-packages (from iqss-gh-reporting==0.5) (0.8.1)
Requirement already satisfied: aiohttp in ./venv/lib/python3.10/site-packages (from iqss-gh-reporting==0.5) (3.8.4)
Requirement already satisfied: numpy in ./venv/lib/python3.10/site-packages (from iqss-gh-reporting==0.5) (1.24.3)
Requirement already satisfied: attrs>=17.3.0 in ./venv/lib/python3.10/site-packages (from aiohttp->iqss-gh-reporting==0.5) (23.1.0)
Requirement already satisfied: charset-normalizer<4.0,>=2.0 in ./venv/lib/python3.10/site-packages (from aiohttp->iqss-gh-reporting==0.5) (3.1.0)
Requirement already satisfied: multidict<7.0,>=4.5 in ./venv/lib/python3.10/site-packages (from aiohttp->iqss-gh-reporting==0.5) (6.0.4)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in ./venv/lib/python3.10/site-packages (from aiohttp->iqss-gh-reporting==0.5) (4.0.2)
Requirement already satisfied: yarl<2.0,>=1.0 in ./venv/lib/python3.10/site-packages (from aiohttp->iqss-gh-reporting==0.5) (1.9.2)
Requirement already satisfied: frozenlist>=1.1.1 in ./venv/lib/python3.10/site-packages (from aiohttp->iqss-gh-reporting==0.5) (1.3.3)
Requirement already satisfied: aiosignal>=1.1.2 in ./venv/lib/python3.10/site-packages (from aiohttp->iqss-gh-reporting==0.5) (1.3.1)
Requirement already satisfied: graphql-core<3.3,>=3.2 in ./venv/lib/python3.10/site-packages (from gql->iqss-gh-reporting==0.5) (3.2.3)
Requirement already satisfied: backoff<3.0,>=1.11.1 in ./venv/lib/python3.10/site-packages (from gql->iqss-gh-reporting==0.5) (2.2.1)
Requirement already satisfied: ply>=3.6 in ./venv/lib/python3.10/site-packages (from graphql-py->iqss-gh-reporting==0.5) (3.11)
Requirement already satisfied: python-dateutil>=2.8.2 in ./venv/lib/python3.10/site-packages (from pandas->iqss-gh-reporting==0.5) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in ./venv/lib/python3.10/site-packages (from pandas->iqss-gh-reporting==0.5) (2023.3)
Requirement already satisfied: tzdata>=2022.1 in ./venv/lib/python3.10/site-packages (from pandas->iqss-gh-reporting==0.5) (2023.3)
Requirement already satisfied: deprecated in ./venv/lib/python3.10/site-packages (from PyGithub->iqss-gh-reporting==0.5) (1.2.14)
Requirement already satisfied: pyjwt[crypto]>=2.4.0 in ./venv/lib/python3.10/site-packages (from PyGithub->iqss-gh-reporting==0.5) (2.7.0)
Requirement already satisfied: pynacl>=1.4.0 in ./venv/lib/python3.10/site-packages (from PyGithub->iqss-gh-reporting==0.5) (1.5.0)
Requirement already satisfied: requests>=2.14.0 in ./venv/lib/python3.10/site-packages (from PyGithub->iqss-gh-reporting==0.5) (2.31.0)
Requirement already satisfied: cryptography>=3.4.0 in ./venv/lib/python3.10/site-packages (from pyjwt[crypto]>=2.4.0->PyGithub->iqss-gh-reporting==0.5) (41.0.1)
Requirement already satisfied: cffi>=1.4.1 in ./venv/lib/python3.10/site-packages (from pynacl>=1.4.0->PyGithub->iqss-gh-reporting==0.5) (1.15.1)
Requirement already satisfied: six>=1.5 in ./venv/lib/python3.10/site-packages (from python-dateutil>=2.8.2->pandas->iqss-gh-reporting==0.5) (1.16.0)
Requirement already satisfied: idna<4,>=2.5 in ./venv/lib/python3.10/site-packages (from requests>=2.14.0->PyGithub->iqss-gh-reporting==0.5) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./venv/lib/python3.10/site-packages (from requests>=2.14.0->PyGithub->iqss-gh-reporting==0.5) (2.0.2)
Requirement already satisfied: certifi>=2017.4.17 in ./venv/lib/python3.10/site-packages (from requests>=2.14.0->PyGithub->iqss-gh-reporting==0.5) (2023.5.7)
Requirement already satisfied: wrapt<2,>=1.10 in ./venv/lib/python3.10/site-packages (from deprecated->PyGithub->iqss-gh-reporting==0.5) (1.15.0)
Requirement already satisfied: pycparser in ./venv/lib/python3.10/site-packages (from cffi>=1.4.1->pynacl>=1.4.0->PyGithub->iqss-gh-reporting==0.5) (2.21)
Building wheels for collected packages: iqss-gh-reporting
Building wheel for iqss-gh-reporting (setup.py) ... done
Created wheel for iqss-gh-reporting: filename=iqss_gh_reporting-0.5-py3-none-any.whl size=27439 sha256=130585b8dab0fe7626ff82e7e7a59f2ad512c82f4a03cff488caf3cd86c4c8f5
Stored in directory: /tmp/pip-ephem-wheel-cache-ea7x93w2/wheels/60/48/4e/67cf42315ddb16f7c572094bf1015d4b40f5e098bd02a712fe
Successfully built iqss-gh-reporting
Installing collected packages: iqss-gh-reporting
Attempting uninstall: iqss-gh-reporting
Found existing installation: iqss-gh-reporting 0.5
Uninstalling iqss-gh-reporting-0.5:
Successfully uninstalled iqss-gh-reporting-0.5
Successfully installed iqss-gh-reporting-0.5

[notice] A new release of pip is available: 23.1.2 -> 23.3.1
[notice] To update, run: pip install --upgrade pip
~/PycharmProjects/iqss_gh_reporting/scripts

============================
current file: ./build_and_deploy_local.sh
pwd: /home/barry/PycharmProjects/iqss_gh_reporting/scripts
venv: <>VIRTUAL_ENV=/home/barry/PycharmProjects/iqss_gh_reporting/venv</>

Build and install complete.
The build will put these files and their associated libraries in your path.
create_iq_snapshot_init
create_iq_snapshot

Next Steps:
() Check that the build actually completed succesfully by reviewing the output.
() Test out the create_iq_snapshot_init build correctly using

create_iq_snapshot_init --help

() Follow the rest of the instructions in the readme

press <enter> to continue
============================

~/Documents/github_reporting/framework_05
-
--
executing file: /home/barry/PycharmProjects/iqss_gh_reporting/scripts/scaffolding/framework_05.sh
pwd:  /home/barry/Documents/github_reporting/framework_05
venv: <>VIRTUAL_ENV=/home/barry/PycharmProjects/iqss_gh_reporting/venv</>
--
find . -type f
./input_file.yaml
./log.out
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-snapshot_summary.tsv
--
Next step: setting directories for this run
--
-
press <enter> to continue
============================

rm: cannot remove '/home/barry/Documents/github_reporting/framework_05/out/*.json': No such file or directory
-
--
Time Stamp: 20231130_144936
Directories:
SCRIPT_DIR: "/home/barry/PycharmProjects/iqss_gh_reporting/scripts"
WRK_DIR_RT: "/home/barry/Documents/github_reporting/framework_05"
INDIR: "/home/barry/Documents/github_reporting/framework_05/in"
WRKDIR: "/home/barry/Documents/github_reporting/framework_05/wrk"
OUTDIR: "/home/barry/Documents/github_reporting/framework_05/out"
--
Current Directory Contents: /home/barry/Documents/github_reporting/framework_05
<>
/home/barry/Documents/github_reporting/framework_05/input_file.yaml
/home/barry/Documents/github_reporting/framework_05/log.out
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-snapshot_summary.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-matrix.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-sized.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-snapshot_summary.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-matrix.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-sized.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-matrix.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-snapshot_summary.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-matrix.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-snapshot_summary.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-sized.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-matrix.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-sized.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-sized.tsv
/home/barry/Documents/github_reporting/framework_05/out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-snapshot_summary.tsv
</>
--
#    input file:
#    /home/barry/Documents/github_reporting/framework_05/in/
#    Note: This test is using the API so WRK_FILE will not be defined.
--
-
-
--
executing file: /home/barry/PycharmProjects/iqss_gh_reporting/scripts/scaffolding/framework_05.sh
pwd:  /home/barry/Documents/github_reporting/framework_05
venv: <>VIRTUAL_ENV=/home/barry/PycharmProjects/iqss_gh_reporting/venv</>
--
find . -type f
./input_file.yaml
./log.out
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_29_162235-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-snapshot_summary.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_091559-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-matrix.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_143853-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_104724-sized.tsv
./out/snaps_collection/snaps_collection-snapshot-000-api-2023_11_30_101729-snapshot_summary.tsv
--
Next step: kickoff the Test
--
-
press <enter> to continue
============================

Yaml file path: /home/barry/Documents/github_reporting/framework_05/input_file.yaml
No yaml file found. Setting defaults
YAML data is valid!
------------------------------
Defaults currently mapped to Command Line input:
Any changes you just made will be written back to the yaml file
you can run this file repeatedly to update the defaults

collection_flag:
h: 'str: valid values: start | snapshot | end. api=required. file=Ignored.'
v: snapshot
data_collected_time:
h: 'str: When working with file input,use this.-special_char] ok:''_'' no
trailing /. api=ignored. file=required.'
v: ''
organization_name:
h: 'str: e.g: IQSS. Always required.'
v: IQSS
output_base_dir:
h: 'str: /mnt/hgfs/iq_reporting_collab/run/out;no[ ,.-special_char] ok:''_''.
No trailing /. api=ignored. file=Optional'
v: /home/barry/Documents/github_reporting/framework_05/out/
output_file_base_name:
h: 'str: e.g. sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig  .api=ignored.
file=not required.'
v: ''
project_name:
h: 'str: e.g: IQSS/dataverse. Always required.'
v: IQSS/dataverse
sprint_name:
h: 'str: e.g. sprint_2023_04_26;no[ ,.-special_char] ok:''_''; api=required.file=required.'
v: snaps_collection
src_dir_name:
h: 'str: e.g: ~/iqss_gh_reporting/run/in no[ ,.-special_char] ok:''_'' no
trailing /. api=ignored. file=required.'
v: ''
src_file_name:
h: 'str: e.g: sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig.tsv
.api=ignored. file=required.'
v: sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig.tsv
src_type:
h: 'str: valid values: api | file. Always required.'
v: api
workflow_name:
h: very short description or code.no[ ,.-special_char] ok:'_' Optional.
v: '000'

Running /home/barry/PycharmProjects/iqss_gh_reporting/venv/bin/create_iq_snapshot as the main program
YAML data is valid!
input arguments:

collection_flag:
h: 'str: valid values: start | snapshot | end. api=required. file=Ignored.'
v: snapshot
data_collected_time:
h: 'str: When working with file input,use this.-special_char] ok:''_'' no trailing
/. api=ignored. file=required.'
v: ''
organization_name:
h: 'str: e.g: IQSS. Always required.'
v: IQSS
output_base_dir:
h: 'str: /mnt/hgfs/iq_reporting_collab/run/out;no[ ,.-special_char] ok:''_''. No
trailing /. api=ignored. file=Optional'
v: /home/barry/Documents/github_reporting/framework_05/out/
output_file_base_name:
h: 'str: e.g. sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig  .api=ignored.
file=not required.'
v: ''
project_name:
h: 'str: e.g: IQSS/dataverse. Always required.'
v: IQSS/dataverse
sprint_name:
h: 'str: e.g. sprint_2023_04_26;no[ ,.-special_char] ok:''_''; api=required.file=required.'
v: snaps_collection
src_dir_name:
h: 'str: e.g: ~/iqss_gh_reporting/run/in no[ ,.-special_char] ok:''_'' no trailing
/. api=ignored. file=required.'
v: ''
src_file_name:
h: 'str: e.g: sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig.tsv .api=ignored.
file=required.'
v: sprint_2023_05_03-snapshot-2023_05_22_11_00-api-000-orig.tsv
src_type:
h: 'str: valid values: api | file. Always required.'
v: api
workflow_name:
h: very short description or code.no[ ,.-special_char] ok:'_' Optional.
v: '000'

output_file_base_name 4api: snaps_collection-snapshot-000-api-2023_11_30_144941
directory exists or was created now: /home/barry/Documents/github_reporting/framework_05/out/snaps_collection
projects: looking to match IQSS/dataverse with IQSS/consilience
projects: looking to match IQSS/dataverse with IQSS/dataverse
Pandas version:2.0.3
start: 0 cards processed: IQSS/dataverse, Column ▶ SPRINT READY
end: 9 cards processed: IQSS/dataverse, Column ▶ SPRINT READY
start: 9 cards processed: IQSS/dataverse, Column This Sprint 🏃♀ 🏃
end: 15 cards processed: IQSS/dataverse, Column This Sprint 🏃♀ 🏃
start: 15 cards processed: IQSS/dataverse, Column IQSS Team - In Progress  💻
end: 23 cards processed: IQSS/dataverse, Column IQSS Team - In Progress  💻
start: 23 cards processed: IQSS/dataverse, Column Ready for Review ⏩
end: 34 cards processed: IQSS/dataverse, Column Ready for Review ⏩
start: 34 cards processed: IQSS/dataverse, Column In Review 🔎
end: 38 cards processed: IQSS/dataverse, Column In Review 🔎
start: 38 cards processed: IQSS/dataverse, Column Ready for QA ⏩
end: 41 cards processed: IQSS/dataverse, Column Ready for QA ⏩
start: 41 cards processed: IQSS/dataverse, Column QA ✅
end: 44 cards processed: IQSS/dataverse, Column QA ✅
start: 44 cards processed: IQSS/dataverse, Column Done 🚀
>>>>>> 50 # cards IQSS/dataverse: Done 🚀                         ,Issue ,9996,dataverse ,[Spike - API] Extend the API to replicate the JSF behavior of downloading all dataset files
>>>>>> 100 # cards IQSS/dataverse: Done 🚀                         ,PullRequest ,10014,dataverse ,Extend Datasets getDownloadSize API endpoint to support file search criteria and deaccessioned datasets
>>>>>> 150 # cards IQSS/dataverse: Done 🚀                         ,PullRequest ,171,dataverse-frontend ,167 - Files table UI [1/2] - Integration filters and search
>>>>>> 200 # cards IQSS/dataverse: Done 🚀                         ,PullRequest ,4,UNF ,Release to Maven Central
>>>>>> 250 # cards IQSS/dataverse: Done 🚀                         ,PullRequest ,9736,dataverse ,9725 files lookup performance
>>>>>> 300 # cards IQSS/dataverse: Done 🚀                         ,PullRequest ,9673,dataverse ,Added documentation about metadata block display facet properties
>>>>>> 350 # cards IQSS/dataverse: Done 🚀                         ,PullRequest ,87,dataverse-frontend ,65 - Containerized development environment
>>>>>> 400 # cards IQSS/dataverse: Done 🚀                         ,Issue ,75,dataverse.harvard.edu ,Spike: finalize the plan for transition to Make Data Count, how to display the metrics, how to handle legacy counts
>>>>>> 450 # cards IQSS/dataverse: Done 🚀                         ,PullRequest ,8970,dataverse ,class field can be replaced by local variable
>>>>>> 500 # cards IQSS/dataverse: Done 🚀                         ,PullRequest ,9241,dataverse ,document ongoing security and practices #3215

going back to work #56


[FLINK-10419][checkpoint] fix ClassNotFoundException while deserializing user exceptions

What is the purpose of the change
DeclineCheckpoint tries to make sure that it does wrap any exception which can be and/or contain user code into a SerializedThrowable. It also contains special handling of a few exceptions that are not wrapped into SerializedThrowable (CheckpointDeclineException sub-classes are claimed to not contain user-code) but if these carry user-code exceptions as suppressed exceptions, the deserialization at the JobManager will fail and the RPC call will not be processed at all - we thus rely on another method to actually get rid of the checkpoint, e.g. a timeout.
Brief change log

remove the special handling of CheckpointDeclineException sub-classes

Verifying this change
This change is already covered by existing tests, such as checkpoint tests and IT cases.
I also manually verified that no code is relying on checks such as instanceof CheckpointDeclineException or the explicitly mentioned sub-classes, so that it is ok to replace these with SerializedThrowable in the RPC.
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): no
The public API, i.e., is any changed class annotated with @Public(Evolving): no
The serializers: no
The runtime per-record code paths (performance sensitive): no
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: yes
The S3 file system connector: no

Documentation

Does this pull request introduce a new feature? no
If yes, how is the feature documented? JavaDocs

True, this only helps with the old non-Flip6 code. I guess, the declineCheckpoint() RPC method should have a DeclineCheckpoint parameter instead which then properly wraps the exception using this code. At the moment, I don't have time to follow-up on this though - closing for now in the hopes that someone else can take over maybe re-using this code (or going another way).


Update README.md

General

✏ Mark the necessary items without changing the structure of the PR template.

[x] Pull request template structure not broken

Type

ℹ  What types of changes does your code introduce?

👉 Put an x in the boxes that apply

[x] Fix
[ ] Feature

Checklist

ℹ  Check all checkboxes - this will indicate that you have done everything in accordance with the rules in CONTRIBUTING.

👉  Put an x in the boxes that apply.

[x] Title as described
[x] Make sure you put things in the right category!
[x] Always add your items to the end of a list

Open Source

[ ] Link description does not contain a link to an author / third-party resource
[ ] The documentation (README) contains a description of the project, illustration of the project with a demo or screenshots and a CONTRIBUTING section
[ ] The documentation is in English.
[ ] The project is active and maintained.
[ ] The project accepts contributions.
[ ] Not a commercial product

Apps/Websites

[ ] The website is available without errors or ssl certificate problems, and load in a reasonable amount of time.
[ ] The website is using vuejs intensively. It should detect vue with vue-devtools.

If you cannot detect vue with vue-devtools due to work at non public pages (e.g. for enterprise website), you can send Pull Request with screenshot that detected it.

[ ] The website is original and not too simple. For that reason, blogs and simple landing pages are rejected.
[ ] A commercial product using Vue, provided that guests could reasonably check out how Vue was used A commercial product using Vue, provided that guests could reasonably check out how Vue was used (i.e. A headless CMS which uses Vue for the Admin/editor Area and offers a free tier).

I Hope I am doing this right... That was alot of information to take in just to report a dead link
The links are dead. Looks like the maintainer deleted the repos? :disappointed: I was excited when I stumbled upon the vuetify one.

I Hope I am doing this right... That was alot of information to take in just to report a dead link
The links are dead. Looks like the maintainer deleted the repos? 😞 I was excited when I stumbled upon the vuetify one.

You did everything right 👍  Thanks


Failed to start machine (Windows)

Using boot2docker 1.7.1 (latest), Git 1.9.5, and Windows 7, I am unable to start the machine using boot2docker up. Full log here ( https://gist.github.com/jakirkham/4144f4a3fd4cd7ec1d14 )

Boot2Docker Owners/Maintainers:
I have experienced the same problem (and unknowingly created a duplicate issue). Please check out #1010 if you would like more information.

So, I completely wiped the installation. Removed all copies of Git, MinGW, boot2docker, and VirtualBox with the uninstaller and deleted all remaining files manually. Also, I removed the .boot2docker directory in my home directory and all of its contents. Did a fresh installation and ran "Boot2Docker Start" and was able to get docker up and running again. However, I now get a new issue ( #1017 ).

Interesting, I wiped everything (minus Git) as well as part of my troubleshooting, but wasn't able to achieve the same results.

I should add that I downloaded a new copy of the installer. Maybe it is worth wiping Git, as well.

I've downloaded many, many copies of the installer without luck but I may have to try removing Git as well. That seems like a really weird thing to have to do though.

Weird, but maybe needed. Also, make sure you remove the .boot2docker directory from your user directory.

Uninstalled, removed .boot2docker directory, and reinstalled. No luck. I'm not going to uninstall git to get this to work because it'll take too long to get the access to reinstall it on my work laptop.

Any luck?

No, I haven't tried anything since. I ended up having to move on to something else entirely, so I never went back to deal with this. Short of uninstalling Git, I'm out of options anyways.

I think Boot2Docker CLI is no longer maintained.
I suggest closing this issue.
People who are hitting this issue can use Docker Machine instead: https://docs.docker.com/windows/step_one/


Add "Profile" feature

Hi all,
Would love to if you guys can add feature to be able to save profiles so i can switch it when i switch games. would love to use this feature in many kind of games. not just one type of game. might be applications for that matter.
OR
maybe a feature to select the JSON Settings files instead of profile
Thank you.

i'm planning to add file options to load/save different settings at some point
for now you have to use writer.exe, more info here

ok, thanks. yeah. currently using that.

In the rawaccel folder, the only json's are profiles.
I built a simple script to easily change them.
https://gist.github.com/dougg0k/867d3d883a3719748d8fb02ab00fdd46


SS-582 solve the issue with images in user guide

Description
This is a small fix that allows images to be displayed in django-wiki. Solves issue SS-582.
Checklist

[x] This pull request is against develop branch (not applicable for hotfixes)
[x] I have included a link to the issue on GitHub or JIRA (if any)
[ ] I have included migration files (if there are changes to the model classes)
[x] I have included, reviewed and executed tests (unit and end2end) to complement my changes
[ ] I have updated the related documentation (if necessary)
[ ] I have updated the release notes (releasenotes.md)
[x] I have added a reviewer for this pull request
[x] I have added myself as an author for this pull request
[ ] In the case I have modified settings.py, then I have also updated the studio-settings-configmap.yaml file in serve-charts

If it passes E2E, then i think we can merge this.


Ensure Synapse creation does not fail if some user IDs are bad

It will now not fail if any of the project settings cannot be created/set.
PR: https://github.com/pcstout/sls_ki_synapse/pull/17


d20190919_MIGLIAVACCA

Entered metadata, upload email sent

Data uploaded, report sent. Questions asked:

What was the measurement length? E.g., 60 seconds, 90 seconds, etc.?
There’s nothing listed for publication or data DOI—is this correct?
If you know it, what was the area (cm2) of the measurement chambers?
If you know it, what was the insertion depth (cm) into the soil of the measurement collars?
What was the depth of “Soiltemp” in the data? I’ve put 5 cm for now


Add the groups parameter to ECAPA_TDNN

Add the groups parameter to ECAPA_TDNN. This enables to use the groups parameter in the TDNN conv1d blocks.
Using the groups parameter helps to reduce the number of parameters.
My own experiment showed that the total number of trainable parameters of the speaker verification (training) model can be reduced from 22.2M to 11.8M (by reducing the number of parameters in the ECAPA_TDNN model itself from 20.8M to 10.4M).
The accuracy stayed the same.
These are the parameters which I used:

embedding_model: !new:speechbrain.lobes.models.ECAPA_TDNN.ECAPA_TDNN
    input_size: !ref <n_mels>
    channels: [1032, 1032, 1032, 1032, 3096]
    kernel_sizes: [5, 3, 3, 3, 1]
    dilations: [1, 2, 3, 4, 1]
    groups: [1, 3, 3, 3, 3]

this is the output of the train_log.txt
epoch: 1, lr: 7.46e-04 - train loss: 5.49 - valid loss: 1.52, valid ErrorRate: 4.47e-02
epoch: 2, lr: 5.07e-04 - train loss: 1.93 - valid loss: 9.08e-01, valid ErrorRate: 2.59e-02
epoch: 3, lr: 2.39e-04 - train loss: 1.94 - valid loss: 7.75e-01, valid ErrorRate: 2.30e-02
epoch: 4, lr: 9.85e-04 - train loss: 1.50 - valid loss: 9.32e-01, valid ErrorRate: 2.62e-02
epoch: 5, lr: 2.69e-04 - train loss: 1.47 - valid loss: 5.82e-01, valid ErrorRate: 1.88e-02
epoch: 6, lr: 4.78e-04 - train loss: 1.54 - valid loss: 7.19e-01, valid ErrorRate: 2.15e-02
epoch: 7, lr: 7.76e-04 - train loss: 1.22 - valid loss: 6.98e-01, valid ErrorRate: 2.07e-02
epoch: 8, lr: 2.97e-05 - train loss: 1.42 - valid loss: 5.13e-01, valid ErrorRate: 1.74e-02
epoch: 9, lr: 7.17e-04 - train loss: 1.31 - valid loss: 7.52e-01, valid ErrorRate: 2.28e-02
epoch: 10, lr: 5.37e-04 - train loss: 1.14 - valid loss: 5.40e-01, valid ErrorRate: 1.72e-02

Thank you @goexle! As for the performance, more than the accuracy on the speaker-id part (which is almost perfect in all the cases) it makes sense to compare the models in the speaker verification task.

Thank you @goexle! As for the performance, more than the accuracy on the speaker-id part (which is almost perfect in all the cases) it makes sense to compare the models in the speaker verification task.

@mravanelli thanks for your positive reply!
Yes, makes sense to me. I assume that I could take the output of the script speaker_verification_cosine.py to compare the models? Or do you have something else in mind to compare the models in the speaker verification task?

I run the script speaker_verification_cosine.py to compute the EER and minDCF.
I got the following result for the ECAPA_TDNN model with grouped convolution:
EER(%)=0.765733
minDCF=0.083124
I got the following results for the standard, pretrained model (loaded from hugging face):
EER(%)=0.670017
minDCF=0.084820
Given that, the ECAPA_TDNN model with grouped convolution seems to perform a bit worse (although I don't know if it is significant).
@mravanelli if you prefer, I could revert the changes in the config file recipes/VoxCeleb/SpeakerRec/hparams/train_ecapa_tdnn.yaml  s.t. the default model would not be modified. However, I think it is worth adding the group parameter in general so that it can be used.

I think we can give the users the possibility to use grouped convolution,
as you suggested in this PR. However, by default we can keep the standard
convolution in the recipe because for now it seems to give slightly better
results. We can thus do what you proposed in the previous message.
On Mon, 27 Sept 2021 at 07:24, Gabriel Oexle @.***>
wrote:

I run the script speaker_verification_cosine.py to compute the EER and
minDCF.
I got the following result for the ECAPA_TDNN model with grouped
convolution:
EER(%)=0.765733
minDCF=0.083124
I got the following results for the standard, pretrained model (loaded
from hugging face
https://huggingface.co/speechbrain/spkrec-ecapa-voxceleb):
EER(%)=0.670017
minDCF=0.084820
Given that, the ECAPA_TDNN model with grouped convolution seems to perform
a bit worse (although I don't know if it is significant).
@mravanelli https://github.com/mravanelli if you prefer, I could revert
the changes in the config file recipes/VoxCeleb/SpeakerRec/hparams/train_ecapa_tdnn.yaml
s.t. the default model would not be modified. However, I think it is worth
adding the group parameter in general so that it can be used.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/speechbrain/speechbrain/pull/1006#issuecomment-927781229,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AEA2ZVUUEXWIJJFXZ4CDH43UEBIAVANCNFSM5EVM3QKQ
.

@mravanelli ok, I updated the PR accordingly


Please separate Tunnels from SSH Connections

The SSH connection list, sourced directly from local configuration files, appears promptly upon opening the panel, providing instant access to my remote servers. Unfortunately, this efficiency contrasts starkly with the tunnel detection process, which can be notably lengthy due to its more complex nature. As both lists are currently merged within a single interface, the delay encountered during tunnel loading significantly prolongs the overall responsiveness of the panel. This waiting period, while necessary for comprehensive tunnel detection, hinders immediate access to SSH connections, impacting workflow efficiency.

I am advocating for the implementation of a distinct SSH Connections panel prominently featured at the apex of the Remote Explorer interface, akin to the intuitive design of the Dev Containers section.

We can probably show SSH connections before tunnels have loaded

This feature request is now a candidate for our backlog. The community has 60 days to upvote the issue. If it receives 20 upvotes we will move it to our backlog. If not, we will close it. To learn more about how we handle feature requests, please see our documentation.
Happy Coding!


[PE-D][Tester B] Pie chart ui flaw

There is only one income but there is a separation on the pie chart.

Labels: type.FeatureFlaw severity.VeryLow
original: mqchua/ped#3

This should not be declared as a bug, this is due to the implementation from JavaFX's graph library. Even with the line separation, it is apparent to the user that 100% of the graph is made up of the Income entry Tuition Teaching under the Salary category. Hence we will not be fixing this issue.


Cannot edit config.toml without "unexpected error"

I apologize if this might be a simple problem, but I've had no luck in trying to fix this; I'm attempting to edit the config.toml to utilize my own information but whenever I do - even if it is just to open and save the config file without making any changes - I get an unexpected token error from Hugo. Any idea what might be causing this?

With the latest version of this theme in #23 there should'nt be any issues when you follow the Installation and Configuration section from the README  by using the latest hugo version.


crash with particle collision 2d demo

hello, i rebuild the godot and run your demo, it is normal . but when i click spawn 1 or spawn rnd, the program will crash with only information that says:

I used 3.2 stable version.

And can you give me some information about the principle of your methods? I see the shadertoy but not find any principle. I only know each particle has unique index...

Hello.
You talk about particle_self_collision from this repository?

when i click spawn 1 or spawn rnd, the program will crash with only information that says:
What GPU you use?
I have no problem launching it, does linked web-demo work for you?

I did not check it in Godot 3.2, I do not think there should be any problem, can you try prebuild Web or .exe version?

And can you give me some information about the principle of your methods? I see the shadertoy but not find any principle. I only know each particle has unique index...
Source code is very simple, I will not teach you "how shaders work", I think information on its shadertoy shader enough for understand it.

To more information you can check my post in Russian language about this code https://habr.com/ru/post/474676/
Proper educational resource about this method is this link on Research Article also in Russian. I do not have english resource for this, google yourself.

thanks for your reply. the web demo is ok for me , and my gpu is nvidia 1050, i think it is not the problem of GPU.
yes, i only want to know the principle . I know clearly how shader works. https://habr.com/ru/post/474676/
this link is perfect for me . thank you very much .
for the crash problem, I will look carefully in to the code and if i have progress, i will tell you

Okay I check latter today this project in Godot 3.2, to see if my code has any problem on Godot side.
Will reply latter

Yes, it was a bug, thanks. Fixed now.


Placeholder text is not visible enough in search bar.

Placeholder text is not visible enough in search bar.

@ricardogalvez , by the way, I had to add specific CSS rules for the placeholder for different browsers. Here's the appropriate PR in the UI. Sorry, I didn't know this was a ticket in the Design-Toolkit or else I would've told you sooner.


Incorrect test run start date in report in report overview

Hi all,
I found that start date is shown incorrectly in version 1.4.24.
1.4.23:

1.4.24:

test suite xml used:
<test-suite xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="urn:model.allure.qatools.yandex.ru" start="1464840970825" stop="1464841010050"

Thanks for report!
I confirm the issue, will look at it.


Create mx edu unidep cul.txt

cul.unidep.edu.mx add the school unidep

how i can send to you the proof? https://unidep.mx/ is the main domain of the school and the email hava a prefix @cul.unidep.edu.mx for example "cul" is the city of the student "unidep" is the school name , "edu" of education and "mx" of the country

@CesarIgnacioCamposMillan Yes, you are right. I see that https://unidep.mx/ is the main domain of the school.
The options to prove that cul.unidep.edu.mx is recognized by the school I suggested are:

A copy of instruction (a hard-copy or electronic one) given to you by the school that tells you to use an email address in this email domain
An URL of a page at the official school website that says that students use this email domain
A reference to a recognized journal where an article was published by someone from the school, with explicit affiliation to the school, and e-mail address from the email domain
A WHOIS data that link the email domain to the school somehow
A copy of official letter from the school representative saying that the school provides e-mail addresses in this domain to the students
Anything else that can prove this fact in similar way, i.e. can be verified independently.

There should be something we can look at. The domain cul.unidep.edu.mx is not mentioned anywhere at the official website, thus there shall be some material (printed or online) that tells the students that the domain for them is cul.unidep.edu.mx. Please attach the copy of this material to this issue as a comment.
Please attach it via browser, not by email, because GitHub strips out all attachments sent by email.

@CesarIgnacioCamposMillan You might miss my previous comment. Please react.

@CesarIgnacioCamposMillan I am sorry, this request remains unanswered for a while. I have to close it without merging. Please reopen and comment if you have an update regarding the aforementioned issue. Thank you for your understanding!


enhance notice shortcode

Enhances the notice shortcode by:

adding more notice types
adding and changing colors
adding icons
adding background color
adding rounded corners

This is heavily inspired by Obsidian Callouts.
The icons are from Heroicons.

Preview
Light mode

Dark mode

default

Backwards compatability

@somratpro if you like this and want to merge it, i will add documentation.
Right now i'm to tired, good night from germany :)
(btw. awesome tools! Thanks a lot!)

Hey @IoannisNezis, you did a really good job here, thanks for submitting this PR, just change a little bit here, use this code.
.notice {
  margin-bottom: 1.5rem;
  border: 1px solid;
  padding: 1.5rem;
  border-color: currentColor;
}

I don't want to put the border-radius by default, because many of the theme needs the square style, and if anyone needs rounded, they can add custom CSS. thanks.

@tfsomrat done :+1:


Pricing Asian Option with Exotic Engine

Codecov Report
Patch coverage has no change and project coverage change: -0.26 :warning:

Comparison is base (c1fc0f3) 97.96% compared to head (320965f) 97.70%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
Additional details and impacted files
@@            Coverage Diff             @@
##           master      #30      +/-   ##
==========================================
- Coverage   97.96%   97.70%   -0.26%
==========================================
  Files          12       12
  Lines         393      393
==========================================
- Hits          385      384       -1
- Misses          8        9       +1

see 1 file with indirect coverage changes

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


[BUGFIX] [MXNET-1456] Added support for OptimizeForBackend in C++ API

Fixes TensorRT support in C++ API. Updated unit tests / examples.
Description
TensorRT support is broken in C++ API. (fixes #19550, fixes #20307). This PR adds support for OptimizeForBackend which mirrors the modern Python approach (http://mxnet.apache.org/versions/1.8.0/api/python/docs/tutorials/performance/backend/tensorrt/tensorrt.html))
Changes

Add mxnet::cpp::Symbol::OptimizeForBackend
Option to pass flags to mxnet::cpp::Executor (needed to pass static_alloc and static_shape needed for TensorRT)
Update example/inference/imagenet_inference.cpp to reflect the new way of using TensorRT (used by ...example/inference/unit_test_imagenet_inference.sh )

The failed check seems unrelated to the PR (cuda out of mem error), what are the next steps here?

@mxnet-bot run ci centos-gpu

@mxnet-bot run ci [centos-gpu]

run ci [unix-gpu]

LGTM! Could you also help add related tests into https://github.com/apache/incubator-mxnet/blob/master/cpp-package/tests/ci_test.sh . Thanks!

I did some work on the ci_tests. But for the tensorRT tests to run, you would have to have set default docker runtime to nvidia and manually run ./build.py -p ubuntu_tensorrt_cu114 /work/runtime_functions.sh citest_cpp_package

Hi @tpyl , I saw that as a part of your change you are changing oneDNN submodule. Are those changes intentional? If so please tell me what is their purpose.

Hi @tpyl , I saw that as a part of your change you are changing oneDNN submodule. Are those changes intentional? If so please tell me what is their purpose.

I think it was accidental, not sure how that happened. Maybe due to switching between branches and forgetting to update submodules every time. I reverted that change now.


Sync with upstream CVSS v4 bug fixes.

The changes need to be synced from https://www.first.org/cvss/cvss-v4.0.json to:
https://github.com/CVEProject/cve-schema/blob/5.1.0/schema/v5.0/imports/cvss/cvss-v4.0.json
***************
*** 24,28 ****
    "$schema": "http://json-schema.org/draft-07/schema#",
    "title": "JSON Schema for Common Vulnerability Scoring System version 4.0",
!   "$id": "https://www.first.org/cvss/cvss-v4.0.json?20231011",
    "type": "object",
    "definitions": {
--- 24,28 ----
    "$schema": "http://json-schema.org/draft-07/schema#",
    "title": "JSON Schema for Common Vulnerability Scoring System version 4.0",
!   "$id": "https://www.first.org/cvss/cvss-v4.0.json?20240216",
    "type": "object",
    "definitions": {
***************
*** 87,96 ****
        "modifiedSubCType": {
            "type": "string",
!           "enum": [ "NONE", "LOW", "HIGH", "NOT_DEFINED" ],
            "default": "NOT_DEFINED"
        },
        "modifiedSubIaType": {
            "type": "string",
!           "enum": [ "NONE", "LOW", "HIGH", "SAFETY", "NOT_DEFINED" ],
            "default": "NOT_DEFINED"
        },
--- 87,96 ----
        "modifiedSubCType": {
            "type": "string",
!           "enum": [ "NEGLIGIBLE", "LOW", "HIGH", "NOT_DEFINED" ],
            "default": "NOT_DEFINED"
        },
        "modifiedSubIaType": {
            "type": "string",
!           "enum": [ "NEGLIGIBLE", "LOW", "HIGH", "SAFETY", "NOT_DEFINED" ],
            "default": "NOT_DEFINED"
        },
***************
*** 135,144 ****
            "default": "NOT_DEFINED"
        },
-       "scoreType": {
-         "type": "number",
-         "minimum": 0.0,
-         "maximum": 10.0,
-         "multipleOf": 0.1
-       },
        "noneScoreType": {
            "type": "number",
--- 135,138 ----
***************
*** 170,177 ****
            "multipleOf": 0.1
        },
-       "severityType": {
-         "type": "string",
-         "enum":["NONE", "LOW", "MEDIUM", "HIGH", "CRITICAL"]
-       },
        "noneSeverityType": {
            "const": "NONE"
--- 164,167 ----
***************
*** 200,205 ****
            "pattern": "^CVSS:4[.]0\/AV:[NALP]\/AC:[LH]\/AT:[NP]\/PR:[NLH]\/UI:[NPA]\/VC:[HLN]\/VI:[HLN]\/VA:[HLN]\/SC:[HLN]\/SI:[HLN]\/SA:[HLN](\/E:[XAPU])?(\/CR:[XHML])?(\/IR:[XHML])?(\/AR:[XHML])?(\/MAV:[XNALP])?(\/MAC:[XLH])?(\/MAT:[XNP])?(\/MPR:[XNLH])?(\/MUI:[XNPA])?(\/MVC:[XNLH])?(\/MVI:[XNLH])?(\/MVA:[XNLH])?(\/MSC:[XNLH])?(\/MSI:[XNLHS])?(\/MSA:[XNLHS])?(\/S:[XNP])?(\/AU:[XNY])?(\/R:[XAUI])?(\/V:[XDC])?(\/RE:[XLMH])?(\/U:(X|Clear|Green|Amber|Red))?$"
        },
-       "baseScore": { "$ref": "#/definitions/scoreType" },
-       "baseSeverity": { "$ref": "#/definitions/severityType" },
        "attackVector":                   { "$ref": "#/definitions/attackVectorType" },
        "attackComplexity":               { "$ref": "#/definitions/attackComplexityType" },
--- 190,193 ----
***************
*** 396,400 ****
        }
    ],
!   "required": [ "version", "vectorString", "baseScore", "baseSeverity" ],
!   "additionalProperties": false
  }
--- 384,387 ----
        }
    ],
!   "required": [ "version", "vectorString", "baseScore", "baseSeverity" ]
  }

@chandanbn Has this been completed? Since it's from March and the last change to https://github.com/CVEProject/cve-schema/commits/5.1.0/schema/imports/cvss/cvss-v4.0.json was in April. I assume this can be safely closed?

It can be closed. CVSS SIG had some debate if implementation nuances should require a schema change, but had agreed this should be considered in the next incremental update to CVSS spec, since the current spec (and associated JSON) was already released and frozen.


blog: DVC with Jupyter notebooks

@jurasan

Any progress on such example?

@mlisovyi I’ve been using Jupiter in a pipeline with a command like:
jupyter nbconvert Train.ipynb --clear-output --inplace --execute --ExecutePreprocessor.timeout=-1

This executes the notebook and overwrites it in-place, as if I had opened it in Jupyter and ran the entire notebook manually and saved it. I then commit the resulting notebook to git.  I also specify some outputs which are cached: a directory for model checkpoints and a directory for logs. For dependencies, I specify the notebook itself as well as a directory of supporting modules.
I believe the initial command to set it up looked something like
dvc run -d Train.ipynb -d src/ -o checkpoints/ -o logs/ jupyter nbconvert Train.ipynb --clear-output --inplace --execute --ExecutePreprocessor.timeout=-1

You might also need to specify a name for the pipeline step somewhere in that command — I used train.dvc, which I can then execute using dvc repro train.dvc.

Do we envision this as a regular part of our DVC user guide, or as a blog post? Cc WDYT @flippedcoder thanks

Cc WDYT @flippedcoder thanks

Cc @jendefig
Also cc @dberenbaum — I think we discussed this topic at some point. Do you still have your DVC/Jupyter Notebook examples handy? Thanks

I would think a best practices for migration would be good for the docs and blog post.  Showing different ways to do it in a series of blog posts?

Strongly would recommend taking a look at https://github.com/nteract/papermill :)

Ping @jendefig 🙂

@jorge Thanks! @flippedcoder is finishing up one on this now here.  Not sure she is familiar with Papermill @casperdcl.  With what you know could you take a look and see if there are any significant advantages over the approach being used now?

done

Does https://iterative.ai/blog/jupyter-notebook-dvc-pipeline close this? WDYT @dberenbaum @jendefig
Cc @RCdeWit is there an issue for the planned blog follow-up? (Getting to an actual pipeline)
Thanks

@jorgeorpinel I would think that until the follow-up one to the papermill one is done this isn't quite closed.  But plans for the next one are already in our backlog, so it won't be lost.

I think we can close this for now. No need to track it here as a separate issue.


Changed hide retry on some errors

After several retries failed random tests, don't concern changes in PR


Wrap list make unnecessary new line if only 2 or 3 choices.

class _ExcelSheetConfigState extends State<ExcelSheetConfig> {
  // List<String> choices = ['sheet1', 'sheet2'];
  List<String> choices = [
    'sheet1',
    'sheet2',
    'sheet3',
    'sheet4',
    'sheet5',
    'sheet6'
  ];

  String? selectedValue;

  void setSelectedValue(String? value) {
    setState(() => selectedValue = value);
  }

  @override
  Widget build(BuildContext context) {
    return Container(
      padding: const EdgeInsets.all(7),
      child: Column(
        children: [
          InlineChoice<String>.single(
            clearable: false,
            value: selectedValue,
            onChanged: setSelectedValue,
            itemCount: choices.length,
            itemBuilder: (state, i) {
              return ChoiceChip(
                selected: state.selected(choices[i]),
                onSelected: state.onSelected(choices[i]),
                label: Text(choices[i]),
              );
            },
            listBuilder: ChoiceList.createWrapped(
              spacing: 10,
              runSpacing: 10,
            ),
          ),
        ],
      ),
    );
  }
}

Hi there! It's common to see this behavior when a Wrap widget is placed inside a Column. To fix it, try adding crossAxisAlignment: CrossAxisAlignment.stretch to the Column widget.

Hi there! It's common to see this behavior when a Wrap widget is placed inside a Column. To fix it, try adding crossAxisAlignment: CrossAxisAlignment.stretch to the Column widget.


ReceiveContext.Receive is not invoked

I've added a test that asserts that ActorContextDecorator.Receive is called before ActorContext.Receive.
https://github.com/AsynkronIT/protoactor-dotnet/blob/dev/tests/Proto.Actor.Tests/MiddlewareTests.cs#L41
cc @jrouaix
Am I misunderstanding the usecase, because this case works

It need to have a receive middleware to trigger the decorator.
https://github.com/jrouaix/protoactor-dotnet/blob/8c27f704d365429a38f514fadfaf98e90f084e72/src/Tracing/Proto.OpenTracing/OpenTracingExtensions.cs#L31

Confirmed.
I've added a new test and fixed the issue


Add API_LEVEL_5 JSON files for Nano fonts

Description
Contains the .json files with font data for Nano X & Nano S+
(those files are JSON versions of the .inc files, to be able to use them with Python to fix speculos OCR troubles)

@dmorais-ledger Can we indent the JSON files?
What do you think of checking that they indeed correspond to the .inc files with a CI check maybe?

@dmorais-ledger Can we indent the JSON files?

Those JSON files are not intended to be read by human, but its done.

What do you think of checking that they indeed correspond to the .inc files with a CI check maybe?

The .inc & .json files are generated at the same time by the ttf2inc.py script, which is now part of the SDK.
I don't see why anyone would modify one of these files.
If someone really want to change a glyph, the simplest way to do it is to change the corresponding picture.
(they are located in lib_bagl/fonts, in latest SDKs)


rkt release 1.8.0

LGTM

Still building and testing locally and on semaphore.

LGTM :+1:

Aaand... it's finally :green_heart:!


ISSUE: results format without paging

- Cache working well if has paging enable in Service.
Configs
const options = {
    name: 'service-name',
    Model,
    paginate
}

Results format
{
    "total": 135,
    "limit": 50,
    "skip": 0,
    "data": [...],
    "cache": {
        "cached": true,
        "duration": 900,
        "expiresOn": "2018-02-28T04:44:12.601Z",
        "parent": "xxx",
        "group": "group-xxx",
        "key": "xxx"
    }
}

- But Service without paging! results format will different the first time (before cache)
Configs
const options = {
    name: 'service-name',
    Model
}

Results format
{
    "cache": {
        "wrapped": [ ... // data cache HERE ... ],
        "cached": true,
        "duration": 900,
        "expiresOn": "2018-02-28T04:44:12.601Z",
        "parent": "xxx",
        "group": "group-xxx",
        "key": "xxx"
}

I could reproduce the issue. I do not think it is linked to paginate but to the fact that you are returning an Array instead of an Object. Normally the the hooks should have been able to handle it. I ll dig into it.
Normally it should wrap and un-wrap the data.


Which repositories should we build and/or inherit?

Let's discuss what should be adopted from other people or organizations and what other things we should include as part of some overarching vision.
@tkelman mentioned a couple to start off the list.

[ ] Cxx.jl
[ ] Clang.jl

Could this be a home for jlcall?

@tkelman suggestions welcome. It might also be worth considering just moving the functionality into MATLAB.jl, which was my initial intention when I put the project together.

something with mex and/or matlab in the name. or discuss at matlab.jl how they might be combined.

PyCall.jl and JavaCall.jl  make a lot of sense to have here.

PyCall.jl has been transferred to the newly founded JuliaPy organization. PyJulia, currently under JuliaInterop, may be transferred to JuliaPy.

julialang site needs and update with all these various new organizations to make it clear and easy for new users.
Perhaps also some sectioning to separate closely related organizations from each other

If you're referring to http://julialang.org/community/, I agree it could use some updating, as things have been moving around a lot.

yeah

You could open an issue at https://github.com/JuliaLang/julialang.github.com

If you open an issue it'll get closed as a duplicate of https://github.com/JuliaLang/julialang.github.com/issues/383. Open a PR.

closing as we can take any further discussion related to this on discourse or slack


g and G flatten a list

When passed a multidimensional list, these two builtins flatten the list first. I think it would make more sense for it to do lexicographic comparison. Onions?

Sure. I like this.


How to use api to call a multi-model with local image?

Hi, I'm using the poe api to call a multimodal model, like gpt-4v or claude3-opus. I refer to an example in the diagram, but I can't find the code on how to load the local image into the request. May I know how can I implement this? I noticed that the new documentation mentions "attachment.parsed_content", should I use this? What is the format of parsed_content? Should I process the image to base64 or use binary read?
Looking for your reply

I had a similar problem too. I wrote codes like this:
import asyncio
from typing import AsyncIterable
import fastapi_poe as fp
from sse_starlette.sse import ServerSentEvent
from fastapi_poe.types import ContentType, ProtocolMessage, Attachment, PartialResponse

api_key = 'KEY'
prompt = """ Describe the attachment image in detail."""
attachment = Attachment(url="https://pfst.cf2.poecdn.net/base/image/xxxxxxxxxxxxxxxxxxxxxxx?w=1024&h=1024", \
                        content_type="image/png", name="image.png")
message = fp.ProtocolMessage(role="user", content=prompt, attachments=[attachment])

async def get_bot_response(messages: list[ProtocolMessage], bot_name: str, api_key: str) -> AsyncIterable[PartialResponse | ServerSentEvent]:
    chuncks = []
    async for partial in fp.get_bot_response(messages=[message], bot_name=bot_name, api_key=api_key):
        chuncks.append(partial.text)
    print(''.join(chuncks))

asyncio.run(get_bot_response([message], 'Claude-3-Sonnet', api_key))

I expected the Claude model to read the attached image, but it obviously did not, and returned the following information:
"Unfortunately, you have not actually attached or uploaded any images to our conversation yet.  If you do upload an image, I will be happy to describe it in detail for you.  Please let me know once you have attached an image."
I wonder if it is possible to invoke a multi-modal via API, thanks.

I had a similar problem too. I wrote codes like this:
import asyncio
from typing import AsyncIterable
import fastapi_poe as fp
from sse_starlette.sse import ServerSentEvent
from fastapi_poe.types import ContentType, ProtocolMessage, Attachment, PartialResponse

api_key = 'KEY'
prompt = """ Describe the attachment image in detail."""
attachment = Attachment(url="https://pfst.cf2.poecdn.net/base/image/xxxxxxxxxxxxxxxxxxxxxxx?w=1024&h=1024", \
                        content_type="image/png", name="image.png")
message = fp.ProtocolMessage(role="user", content=prompt, attachments=[attachment])

async def get_bot_response(messages: list[ProtocolMessage], bot_name: str, api_key: str) -> AsyncIterable[PartialResponse | ServerSentEvent]:
    chuncks = []
    async for partial in fp.get_bot_response(messages=[message], bot_name=bot_name, api_key=api_key):
        chuncks.append(partial.text)
    print(''.join(chuncks))

asyncio.run(get_bot_response([message], 'Claude-3-Sonnet', api_key))

I expected the Claude model to read the attached image, but it obviously did not, and returned the following information: "Unfortunately, you have not actually attached or uploaded any images to our conversation yet. If you do upload an image, I will be happy to describe it in detail for you. Please let me know once you have attached an image."
I wonder if it is possible to invoke a multi-modal via API, thanks.

Yes I got the same response when using claude model.
While I was checking the latest documentation and api code, I found out that poe has added a new parsed_content field for attachment, I wonder if this would be a way to do it, maybe we can handle the image as a parsed_content style, I'm trying it out, and you can try it too!

I had a similar problem too. I wrote codes like this:
import asyncio
from typing import AsyncIterable
import fastapi_poe as fp
from sse_starlette.sse import ServerSentEvent
from fastapi_poe.types import ContentType, ProtocolMessage, Attachment, PartialResponse

api_key = 'KEY'
prompt = """ Describe the attachment image in detail."""
attachment = Attachment(url="https://pfst.cf2.poecdn.net/base/image/xxxxxxxxxxxxxxxxxxxxxxx?w=1024&h=1024", \
                        content_type="image/png", name="image.png")
message = fp.ProtocolMessage(role="user", content=prompt, attachments=[attachment])

async def get_bot_response(messages: list[ProtocolMessage], bot_name: str, api_key: str) -> AsyncIterable[PartialResponse | ServerSentEvent]:
    chuncks = []
    async for partial in fp.get_bot_response(messages=[message], bot_name=bot_name, api_key=api_key):
        chuncks.append(partial.text)
    print(''.join(chuncks))

asyncio.run(get_bot_response([message], 'Claude-3-Sonnet', api_key))

I expected the Claude model to read the attached image, but it obviously did not, and returned the following information: "Unfortunately, you have not actually attached or uploaded any images to our conversation yet. If you do upload an image, I will be happy to describe it in detail for you. Please let me know once you have attached an image."
I wonder if it is possible to invoke a multi-modal via API, thanks.

Yes I got the same response when using claude model. While I was checking the latest documentation and api code, I found out that poe has added a new parsed_content field for attachment, I wonder if this would be a way to do it, maybe we can handle the image as a parsed_content style, I'm trying it out, and you can try it too!

Did you solved this problem？I tried add parsed_content field but useless.

+1

+1

+1

@JohntheLi

Sorry for the delay on the response. The API is designed such that only attachments uploaded through the UI (Poe Client) are sent to the LLM. Files are processed and linked to the message upon the user uploading them from the client, so attaching arbitrary files from the bot server does not work.
To recap, with the current API, we only support:

attachments in user message (request) that are attached via the Poe client
attachments in bot message (response) that are attached via post_message_attachment as seen here: https://creator.poe.com/docs/server-bots-functional-guides#sending-files-with-your-response

I can already see how this could be a limitation for bot creators, but I am still curious what use cases you all are working on that could benefit from attaching files to the user message via the API?

I can already see how this could be a limitation for bot creators, but I am still curious what use cases you all are working on that could benefit from attaching files to the user message via the API?

@JohntheLi A typical case is parsing pdf. When user uploads a long pdf, we certainly need to preprocess it into image pages, text pages, running all sorts of different tasks for different parts we extract on our own. Directly sending the full document to a bot is pointless.

Agree with your example that it will be useful to have. I will bring this up with the team.
Keep in mind that there are some complexities with this - this would essentially be linking new attachments to the user message and we need to see how that might break existing product expectations. So I don't think its a small task, but it'll be on our radar. Thanks for reporting it!

Many thanks. Cannot be more excited to work on some new M-LLM applications.


ValueError: 'auto' is not a valid RerankerModelClass

I'm having the above problem with fine tuning and it seems that auto is not defined,thanks!

Thank you for pointing out the issue! We have updated the code. You can clone the repository again.


apollo-cache-inmemory v1 -> v1.1 breaks interfaces

After updating, interface fragments do not appear in data.

➤ Cory Deppen commented:
The return type of the read method in InMemoryCache (T | null) doesn't match the signature in ApolloCache (T). If null is truly a valid return type for this method, it looks like the signature should be updated in ApolloCache.

➤ Cory Deppen commented:
Actually, this appears to be a duplicate of #2503.


ads-replacement: adding hook and cluster-manager support

Commit Message: ads-replacement: adding hook and cluster-manager support
Additional Description:
Follow up to #36155 - as part of #35956.
This PR adds the setAdsConfigSource() method to replace the current ADS source. It can be invoked through the xdsManager() method from the Server::Instance.
The main change is the validation of the incoming ads_config, and the call to the grpc-mux that will disconnect and connect to the new server.
Note that not all the fields in the ads_config can be replaced, so there's added validation and comparing it with the bootstrap.
Risk Level: low - new feature, requires invoking the setAdsConfigSource() method.
Testing: Added unit and integration tests.
Docs Changes: N/A
Release Notes: Added.
Platform Specific Features: N/A

This is a followup to: #36155
@nezdolik will you be able to do the maintainer review?
/assign @nezdolik

/assign-from @envoyproxy/senior-maintainers

/retest


Caveats support

See https://authzed.com/docs/reference/caveats for the official documentation.
The attached patch might be helpful as it contains the ground work for this feature.
caveats.patch
Sadly I have issues to build locally so I would be grateful if someone else could implement this.
Many thanks.

What kind of issues do you have?

warning: the following paths have collided (e.g. case-sensitive paths
on a case-insensitive filesystem) and only one from the same
colliding group is in the working tree:

  'grpc/client/src/main/java/com/authzed/api/v1alpha1/WatchResourcesService.java'
  'grpc/client/src/main/java/com/authzed/api/v1alpha1/WatchresourcesService.java'

which, with bin/generate.sh later leads to
[ERROR] /Users/mk/Repositories/quarkus-authzed-client/grpc/client/src/main/java/com/authzed/api/v1alpha1/WatchResourcesService.java:[6,14] class WatchresourcesService is public, should be declared in a file named WatchresourcesService.java

Tried to work around it but couldn't.

Let me try that


📑 Feature Request: Enhance Landing Page

IMPORTANT TO CHECK BEFORE ISSUE

[X] You check that same issue is not present in the repository
[X] You have read contribution guidelines and rules

Please describe your feature request related to a problem?
The landing page of your website can be improved to a lot of extent.
Describe your solution to problem
The landing page is not looking good and to get more people the user intefrace must look interesting.
Describe alternatives you have considered
No response
Additional context
No response
Add Relevant Screenshot (if available)
No response

UI changes are not needed as of now, if any functionality you want to add you can open a new issue for that.!