Add remaining metadata

@briandealwis @loosebazooka  @patflynn @etanshaul got a bit confused by the capitalization, but this is the current branch

I don't know enough about this api stuff, perhaps someone on the intellij team who might be using it can review?

Ping

I'm checking with the internal Javascript stylists to see if they prefer "foo":"bar" or "foo" : "bar".

The PRD specifies that the selector should also include a link to the issue tracker for each library. Should we add this?

What's the purpose of the issue tracker link? Is this something we want to expose in the UI?

For making requests for changes or enhancements to the APIs?  Saves the developer from having to hunt the right tracker down, and becoming confused by the com.google.api.* vs com.google.cloud.* repositories.

I'm very skeptical of exposing the API issue trackers in the IDEs. This is unlikely to appear at a place where the user might want it (on the code). It's more likely to collect random bugs that have nothing to do with the APIs or CT4E.

I think its convenient (and can't hurt) to have this link. At a minimum, it gives the user the ability to quickly view open issues & activity prior to adding the library. I do this sometimes myself.
However I'll defer to the PRD authors. @patflynn wdyt?

It's easier to add something later than take it out, so I default to leaving fields out until we have consensus that they're needed.
Also note that for these libraries there is exactly one issue tracker for all 23 APIs, not separate issue trackers for each.

I think it's something we want eventually but I'm fine leaving it out for now.  Like Elliotte said, for this first batch of libraries they're all in the same github tracker and the phase 0 UX would probably only display the tracker info way before the user has had a chance to find any issues.


Type generation outputs to file instead of terminal

Describe the bug
A clear and concise description of what the bug is.
I tried running
npx supabase gen types typescript --linked > types/supabase.ts
The command "froze" so I had a look at the output file and found a message there 😅
Need to install the following packages<EMAIL_ADDRESS>Ok to proceed? (y)
{
  "version": "0.1.0",
  "private": true,
  "scripts": {
    "dev": "next dev",
    "build": "next build",
    "start": "next start",
    "lint": "next lint",
    "gen-types": "npx supabase gen types typescript --linked > types/supabase.ts"
  },
  "dependencies": {
    "@supabase/auth-helpers-nextjs": "0.7.0",
    "@supabase/supabase-js": "2.23.0",
    "@types/node": "20.2.5",
    "@types/react": "18.2.7",
    "@types/react-dom": "18.2.4",
    "encoding": "^0.1.13",
    "eslint": "8.41.0",
    "eslint-config-next": "13.4.4",
    "next": "13.4.4",
    "react": "18.2.0",
    "react-dom": "18.2.0",
    "server-only": "^0.0.1",
    "swr": "2.1.5",
    "typescript": "5.0.4"
  },
  "devDependencies": {
    "autoprefixer": "^10.4.14",
    "postcss": "^8.4.24",
    "supabase": "^1.64.3", // I just added this to follow the prompt
    "tailwindcss": "^3.3.2"
  }
}

To Reproduce
Steps to reproduce the behavior:
In a project without Supabase installed as a devdependency run:
npx supabase gen types typescript --linked > types/supabase.ts
Expected behavior
Script outputs to the terminal
Screenshots

Desktop (please complete the following information):

OS: [e.g. iOS] Mac os Ventura 13.2.1
Version of CLI - I installed the latest version and don't know what I had before :/
Version of supabase-js (if applicable) 2.23.0
Version of Node.js (if applicable) v20.2.0

Additional context
Add any other context about the problem here.

Thanks @EliasTouil! As per the instructions, you'd need to run npm install --save-dev supabase first before running npx supabase.


[C++][Parquet] Build testing conda artifacts in debug mode

The intent of this is to help us fix the broken build being discussed in ARROW-247
https://github.com/apache/arrow/pull/111
Reporter: Wes McKinney / @wesm
Assignee: Wes McKinney](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=wesm) / @wesm
Note: This issue was originally created as PARQUET-672. Please see the migration documentation for further details.

Wes McKinney / @wesm:
Issue resolved by pull request 141
https://github.com/apache/parquet-cpp/pull/141


Update the Logo of MRSMIGGLES

We have been listed on Coingecko and through that, our token was automatically imported into Metamask. The logo has changed in the meantime, hence this PR to update the token logo to the current Version. The committed logo is also visible on Coingecko.
Website: https://mrsmigglesbase.com/
Coingecko: https://www.coingecko.com/en/coins/mrs-miggles
Twitter: https://x.com/MrsMiggles_Base

SVG image is required

SVG image is required

the svg has been uploaded and the contract-map.json changed to the correct file extension. The png has been removed

Hello again,
people have been bugging me multiple times about the wrong (old) logo in MetaMask. Could you review this again and merge the pull request please?
Kind regards

Hey @MrsMigglesOnBase
This repo supports only Ethereum, to update token on Base would you guys be able to add the token to the following lists?:
Coingecko: https://tokens.coingecko.com/polygon-pos/all.json
sushiswap: https://token-list.sushi.com/
UniswapLabs: https://gateway.ipfs.io/ipns/tokens.uniswap.org

Thanks for the info. The weird part is, we are already listed on CG, I
suppose that's how we ended up in metamask in the first place. However,
since we've changed the logo in between, I imagined, you just had to
refresh the Metadata from CG. I will send CG an email anyway, I'd be glad
if you could check out the refreshing the data route (if that exists)
https://www.coingecko.com/en/coins/mrs-miggles
Thanks
Mrs miggles team
MRabenda @.***> schrieb am Mo., 19. Aug. 2024, 10:07:

SVG image is required
—
Reply to this email directly, view it on GitHub
https://github.com/MetaMask/contract-metadata/pull/1345#issuecomment-2295929018,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BKTUKSCZ5KGFEYFENHQJKCDZSGRTPAVCNFSM6AAAAABMWTCLO2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOJVHEZDSMBRHA
.
You are receiving this because you authored the thread.Message ID:
@.***>


add option to control how history is updated

Use update option to only process inbound request from URL (no updates on navigation)
Use history option to control whether history is maintained

I've introduced two different controls.
The first, "update", controls whether the URL is updated after the page is loaded. If the value is false, the deck is advanced to the hash indicated by the URL, but does not continue to update on navigation. The default is to update the URL.
The second, "history" controls whether the history is overwritten on each slide change or whether the history is preserved. The default is to preserve the history. A value of false disables this behavior so that the history remains unchanged.


Error occurred in handler for 'startGameDownload': TypeError: Cannot read properties of undefined (reading 'id')

Hello Everyone,
I got this error on try does download of any game.
Does anyone know how to resolve this error? Could this be a bug?
#######
Error
#######
[2380:0427/144908.404:ERROR:CONSOLE(1)] "Request Autofill.enable failed. {"code":-32601,"message":"'Autofill.enable' wasn't found"}", source: devtools://devtools/bundled/core/protocol_client/protocol_client.js (1)
Error occurred in handler for 'startGameDownload': TypeError: Cannot read properties of undefined (reading 'id')
at D:\Users\root\Downloads\hydra.webpack\main\index.js:325219:25
at Generator.next ()
at fulfilled (D:\Users\root\Downloads\hydra.webpack\main\index.js:325188:58)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
Exception in thread Thread-2:
Traceback (most recent call last):
File "C:\Program Files\Python39\lib\threading.py", line 980, in _bootstrap_inner
self.run()
File "C:\Program Files\Python39\lib\threading.py", line 917, in run
self._target(*self._args, **self._kwargs)
File "D:\Users\root\Downloads\hydra\torrent-client\main.py", line 84, in listen_to_socket
msg = read_fifo.recv(1024 * 2)
File "D:\Users\root\Downloads\hydra\torrent-client\fifo.py", line 21, in recv
result, data = win32file.ReadFile(self.socket_handle, bufSize)
pywintypes.error: (109, 'ReadFile', 'O pipe foi finalizado.')
#################
My Environment:
#################
#> pip list
Package           Version

cx_Freeze         7.0.0
cx_Logging        3.2.0
libtorrent        2.0.9
lief              0.14.1
pip               22.0.4
pywin32           306
setuptools        69.5.1
typing_extensions 4.11.0
wheel             0.43.0
#> python3
Python 3.9.14 (main, Dec 20 2022, 23:40:07) [MSC v.1929 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
#> python
Python 3.9.14 (main, Dec 20 2022, 23:40:07) [MSC v.1929 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.

quit()

#> yarn version
yarn version v1.22.22
info Current version: 1.1.0
#> npm version
{
hydra: '1.1.0',
npm: '10.5.0',
node: '20.12.2',
acorn: '8.11.3',
ada: '2.7.6',
ares: '1.27.0',
base64: '0.5.2',
brotli: '1.1.0',
cjs_module_lexer: '1.2.2',
cldr: '44.1',
icu: '74.2',
llhttp: '8.1.2',
modules: '115',
napi: '9',
nghttp2: '1.60.0',
nghttp3: '0.7.0',
ngtcp2: '0.8.1',
openssl: '3.0.13+quic',
simdutf: '4.0.8',
tz: '2024a',
undici: '5.28.4',
unicode: '15.1',
uv: '1.46.0',
uvwasi: '0.0.20',
v8: '<IP_ADDRESS>-node.19',
zlib: '<IP_ADDRESS>-motley-40e35a7'
}
combined.log
error.log
info.log

Lack of SteamGridDB API key, please read the whole README.

Lack of SteamGridDB API key, please read the whole README.

Thank you for your response. I did go through the README documentation, but one part left me a bit confused:
Regarding the line: "If you want to have onlinefix," I interpreted this as being optional. However, after fixing the .env file, everything seems to be working fine now.


Add files via upload

Few logistical  comments:

Making a push via command line is significantly easier: https://opensource.com/article/19/7/create-pull-request-github

branch names can be a bit more simple: dlee0156-patch-1-1 is hard to type out vs dleedev.

The file should probably go inside notebooks/ and not the root directory.

Few setup comments:

It's easier to read when you have 1 cell for imports grouped by some semantics (maybe function, or lower level vs higher level libraries; you'll get used to it as we go along). Then you can create notes in the actual jupyter notebook (e.g. Markdown cell) which makes that cell write like a Markdown file (.md extension; you can google some basic syntax; it's jsut a glorified text cell).

Then you can  add actual code to do loading, then plotting.


NER HuggingFace example can't find required packages

Describe the bug
I have tried reproducing the code on this example, in the official presidio documentation, but I get a value error saying ValueError: NLP engine 'transformers' is not available. Make sure you have all required packages installed
To Reproduce
Steps to reproduce the behavior:

Go to this page and copy all the code into a Jupyter notebook and install the transformers, presidio, huggingface_hub and the en_core_web_sm spacy model. Create a config.yaml.
Install and download everything and click on run all.
See error ValueError: NLP engine 'transformers' is not available. Make sure you have all required packages installed

Expected behavior
The code to run without errors.
Screenshots

Additional context
All code were copied from the example without modifications. If I deleted the config.yaml, it runs no problem.
My notebook:
%pip install transformers presidio huggingface_hub keras torch torchvision torchaudio
!python -m spacy download en_core_web_sm

from presidio_analyzer import AnalyzerEngine, RecognizerRegistry
from presidio_analyzer.nlp_engine import NlpEngineProvider
import transformers
from huggingface_hub import snapshot_download
from transformers import AutoTokenizer, AutoModelForTokenClassification

transformers_model = "obi/deid_roberta_i2b2"
snapshot_download(repo_id=transformers_model)

# Instantiate to make sure it's downloaded during installation and not runtime
AutoTokenizer.from_pretrained(transformers_model)
AutoModelForTokenClassification.from_pretrained(transformers_model)

# Create configuration containing engine name and models
conf_file = 'config.yaml'

# Create NLP engine based on configuration
provider = NlpEngineProvider(conf_file=conf_file)
nlp_engine = provider.create_engine()

# Pass the created NLP engine and supported_languages to the AnalyzerEngine
analyzer = AnalyzerEngine(
    nlp_engine=nlp_engine,
    supported_languages=["en"]
)

results_english = analyzer.analyze(text="My name is Morris", language="en")
print(results_english)

Transformers aren't installed by default. Please this these installations docs: https://microsoft.github.io/presidio/installation/#__tabbed_1_2

I did the pip install "presidio_analyzer[transformers]", but that didn't did the trick. Am I missing something?
Thank you for your time. :)

Did the installation complete successfully? Is your Jupyter kernel mapped to the environment in which you installed? have you restarted your kernel? I might be stating the obvious but these are the initial things I would look into.
You can also do !pip freeze in a jupyter cell and make sure you have spacy-huggingface-pipeliens installed as well as transformers.

spacy-huggingface-pipeliens

Thank you.
I have tried restarting the kernel as well, but I guess the spacy-huggingface-pipeliens did the trick.

Great. Closing the issue, feel free to reooen if needed


Revert Teamviewer to 15.42.6

[x] Have you signed the Contributor License Agreement?
[x] Have you checked that there aren't other open pull requests for the same manifest update/change?
[x] This PR only modifies one (1) manifest
[x] Have you validated your manifest locally with winget validate --manifest <path>?

[x] Does your manifest conform to the 1.4 schema?

Note: <path> is the name of the directory containing the manifest you're submitting.

Microsoft Reviewers: codeflow:open?pullrequest=https://github.com/microsoft/winget-pkgs/pull/109243&drop=dogfoodAlpha

Shoot I still have to change the folder name, don't I?

I think so; And you will probably have to change the version in all 3 files for TeamViewer :(

@Trenly Apparently just a force push isn't good enough? I'm not well-versed in Git, how do I do a backwards merge?

f

Why is the installer validation STILL in progress?


Exits the editor

Tested versions
In the 4.3 stable
System information
Xiaomi mi 8 lite snapdragon 660
Issue description
I'm in the 3D tab either adding the player script when suddenly it exits godot
Steps to reproduce
The problem is not in the code but in the editor
Minimal reproduction project (MRP)
I just don't understand what you're referring to.

Can you please provide more information?
Also, please write responses in English (a machine translation is fine). This is an English speaking community, so we ask that everyone use English to interact.

Thank you for your report, but there isn't enough information here to do anything with this report, so I am closing this issue
If you provide more information this can be reopened


Nutrition Tracker

Title : Nutrition Tracking
Issue No. : https://github.com/Open-Code-Crafters/FitFlex/issues/76
This pull request implements the Nutrition Tracker feature, enabling users to log meals by entering food items, portion sizes, and meal types. It fetches nutritional data from the Nutritionix API, displays meal history, and calculates total calories and macronutrients. This feature enhances user engagement by promoting healthier eating habits and providing valuable insights into dietary choices.
Close https://github.com/Open-Code-Crafters/FitFlex/issues/76

Checklist:
[X ] I have mentioned the issue number in my Pull Request.
[ X] I have commented my code, particularly in hard-to-understand areas
I have created a helpful and easy to understand README.md if its a new page/tech stack
[ X] I have gone through the contributing.md file before contributing
Are you contributing under any Open-source programme?
[ yes ] I'm a GSSOC-EXT contributor
[ yes ] I'm a HACKTOBERFEST contributor

@meghanakn473 where you integrated this in FITFLEX website. It seems you have sent the saperate app.

@meghanakn473 where you integrated this in FITFLEX website. It seems you have sent the saperate app.

yes

@meghanakn473 where you integrated this in FITFLEX website. It seems you have sent the saperate app.

yes

Integrate this Nutrition tracking page in the website.


Docs request: datapackage details onto readthedocs

Is your feature request related to a problem? Please describe.
When I'm hunting for a particular variable, I'm often unsure which dataset it's in, or if PUDL has a cleaned version.
Describe the solution you'd like
It would be great to have the readthedocs site describe the tables and variables that are present in the current zenodo release. Things like table names, variable names, and years covered would be really useful.
It seems like you've already done the hard part by creating writing the computer-readable datapackage.json descriptions. (I'm not familiar with the details, so I'm sure it's more difficult than I realize.)
Describe alternatives you've considered
Just download the datapackage.json file and search.
Additional context
This issue particularly comes up for FERC form 1, where some tables are left uncleaned.

This is definitely doable and something I've been thinking about.  A couple of examples of data package metadata posted on the web in a more readable form:

The Glacier Thickness Database repo on Gitlab
Datahub.io for example my attempt to package up the MSHA Mines & Production data

this is done now with our data dictionaries.


How are partial hypotheses managed ?

Hi there!
May I ask how partial hypotheses are handled in your n-gram rescoring implementation? For instance, what if the AM outputs BPE tokens while the n-gram LM is at the word level? How is rescoring performed to ensure that all hypotheses are checked and the rescoring isn't applied only once the first space token is encountered?
Thanks!

Hi Titouan, thanks for the question. The token merging happens on the decoder level, before it gets sent off to the LM scoring part, so from an lm perspective there isn't much of a difference compared to character level. As for how it's scored: any finished word (with a trailing space decoded, or in bpe followed by a _ token) will be part of kenlm scoring, and any unfinished word will be scored using a trie to check if the partial word is OOV (including a consideration for length). Does that make sense? We have also tried to normalize the partial scores to the unigram LM probabilities (ie summing up all potential completion probabilities) but we ended up with slighly worse results and this simpler approach. Best, Georg

Thanks for the answer! So partial words are rescored using a tree-like structure?

yeah, basically a fast check on whether the prefix exists within the vocabulary. The additional parameters unk_score_offset and AVG_TOKEN_LEN allow tuning on how it should be weighed relative to the LM scored fragments. The most important contribution here is to heavily punish a prefix that is already out of vocabulary, but not yet followed by a space and therefore not yet included in the kenlm scoring part.
    def score_partial_token(self, partial_token: str) -> float:
        """Get partial token score."""
        if self._char_trie is None:
            is_oov = 1.0
        else:
            is_oov = int(self._char_trie.has_node(partial_token) == 0)
        unk_score = self.unk_score_offset * is_oov
        # if unk token length exceeds expected length then additionally decrease score
        if len(partial_token) > AVG_TOKEN_LEN:
            unk_score = unk_score * len(partial_token) / AVG_TOKEN_LEN
        return unk_score

closing, please feel free to reopen if more questions


Fix floating base add

This PR fixes a potential problem when adding an additional floating joint to connect the root of the robot to the world.
I was exploiting the fact that the idyntree model reducer is adding/renaming the not actuated joints to {joint}_fixed_joint. TBH I was thinking that the model reducer was adding an additional link and base_link_fixed_joint whatever robot.
for joint in root.findall(".//joint"):
    if joint.attrib.get("name") == "base_link_fixed_joint":
        joint.attrib["type"] = "floating"
        logging.info(f"Modified joint base_link_fixed_joint to type floating.")
        break

This is clearly wrong and can fail when loading different urdfs. For completeness, I was generating the ergocub model retrieved with cub-model, v2.8.0 if I'm not wrong.
The new logic checks what is the root link and adds an additional world link and a new floating_joint with
# Find all the links and joints in the URDF
links = {link.attrib["name"]: link for link in root.findall(".//link")}
joints = root.findall(".//joint")
# Find child and parent links for each joint
child_links = {joint.find("child").attrib["link"] for joint in joints}
parent_links = {joint.find("parent").attrib["link"] for joint in joints}
# The root link is a parent link that is not a child link
root_link = next(link for link in links if link not in child_links)

# Add a floating joint that connects the root link to the world
floating_joint = ET.Element("joint", attrib={
    "name": f"{root_link}_floating_joint",
    "type": "floating"
})
# Populate the floating joint
parent_element = ET.SubElement(floating_joint, "parent", attrib={"link": "world"})
child_element = ET.SubElement(floating_joint, "child", attrib={"link": root_link})
# Add the floating joint to the urdf root
root.insert(0, floating_joint)
# Add a link called "world"
world_link = ET.Element("link", attrib={"name": "world"})
root.insert(0, world_link)

This PR also

updates the default values for the ctrlrange for the torque control mode. Before was set to [-1,1], clearly too small!
allows the user to set the mesh_path from the outside, for a more versatile configuration.

As additional check, I loaded some models from robot_description.py

cassie

anymal_c

atlas_v4

Thanks a lot @giotherobot! :)


Using an external conda environment with run for complex rules

Snakemake version
7.21.0
Describe the bug
Hi,
I have the following rule which contains both Python code and shell commands.
rule run_mags_prodigal:
    input:
        mags_folder=expand("{wdir}/{sample}/{mags_retrieval}", mags_retrieval=config["mags_retrieval"], allow_missing=True),
    output:
        directory("{wdir}/{sample}/mags_prodigal")
    params:
        extra="-p meta",
        quiet="-q"
    threads: 1
    run:
        shell("mkdir -p {output}")

        import pandas as pd
        from geomosaic.parsing_output.prodigal_orf_mapping import parsing_prodigal_orfs

        df_mags = pd.read_csv(str(os.path.join(str(input.mags_folder), "MAGs.tsv")), sep="\t")

        mags_list_file = os.path.join(str(output), "mags_list.txt")
        with open(mags_list_file, "wt") as fd:
            for mag in list(df_mags.MAGs):
                fd.write(f"{mag}\n")
                print(f"Computing ORF prediction for {mag}")
                output_folder_mag=str(os.path.join(str(output), mag))

                shell("mkdir -p {output_folder_mag}")
                shell("prodigal -i {input.mags_folder}/fasta/{mag}.fa \
                        -o {output_folder_mag}/genes.gff \
                        -a {output_folder_mag}/protein_translations.faa \
                        -f gff \
                        {params.extra} \
                        {params.quiet}")

                fasta_input = str(os.path.join(output_folder_mag, "protein_translations.faa"))
                output_mapping = str(os.path.join(output_folder_mag, "orf_contig_mapping.tsv"))
                output_fasta = str(os.path.join(output_folder_mag, "orf_predicted.faa"))
                output_simple_mapping = str(os.path.join(output_folder_mag, "simple_orf_contig_mapping.tsv"))

                parsing_prodigal_orfs(fasta_input, output_mapping, output_fasta, output_simple_mapping)

However, I need to run this rule using an external conda environment which is saved in the config file: conda: config["ENVS"]["prodigal"]
rule run_mags_prodigal:
    ...
    params:
        ...
    threads: 1
    conda: config["ENVS"]["prodigal"]
    run:
        ...

I know that the run is not allowed with an external conda environment, but using shell seems impossible to me to achieve the same execution.
Do you know how to do it? Do you have other suggestions?
Is there another alternative to run complex rules that contain Python code and shell commands together?
I appreciate any help you can provide.
Best regards

Your rule tries to do too much different things in one place, it can be fixed with a bit of separation of concerns :
You need to split this rule in 3 different rules.

First one with the shell content, that will execute prodigal
second one being a python script with the parsing_prodigal_orfs import and execution, that can work in it's own env
third one being a "meta" rule, that will gather the outputs of the second one and basically do the work of your for loop

If I understood correctly your outputs, the input of the third tule should look somwhat like that :
input = expand("{wdir}/{sample}/mags_prodigal/{mag}", mag=mag_list)

For my understanding, what is the content of config["mags_retrieval"] ? a list or a string ? Also, do you need mags_list_file later in the pipeline ? In this context I don't see why you open a file ton only execute a for loop.

Hi @LukaP-BB ,
Thanks for your answer.
config["mags_retrieval"] is a string.
Regarding this question

Also, do you need mags_list_file later in the pipeline ? In this context I don't see why you open a file ton only execute a for loop

Maybe I can remove this open file with open(mags_list_file, "wt") as fd.
However, I didn't understand your three rules correctly. How is it possible that the "prodigal rule" is first given that it should be needed for loop variables?
Could you write a draft of these rules you meant?

I don't have all the context, so you will need to fill in the gaps, but here is an implementation (not tested, cause I don't have snakemake on my personal computer)
rule run_prodigal:
    input:
        fasta="{wdir}/{sample}/{mags_retrieval}/fasta/{mag}.fa"
    output:
        genes_gff="{wdir}/{sample}/{mags_retrieval}/{mag}/genes.gff",
        protein_translations="{wdir}/{sample}/{mags_retrieval}/{mag}/protein_translations.faa",
    params:
        extra="",
        quiet=""
    conda: "..."
    shell:
        """
        # you don't need to do a mkdir anymore, it's handled by snakemake, because it's infered from the output files
        prodigal -i {input.fasta} \\
            -o {output.genes_gff} \\
            -a {output.protein_translations} \\
            -f gff \\
            {params.extra} \\
            {params.quiet}
        """

rule parse_prodigal:
    """
    This function executes a python script that contains the function that you used in your original rule.
    It can be merged with the previous rule if you want. It depends if you want to allow more or less ressources (threads/memory) than run_prodigal
    """
    input:
        fasta_input=rules.run_prodigal.output.protein_translations # I love this snakemake feature, use it as much as possible
    output:
        output_mapping = "{wdir}/{sample}/{mags_retrieval}/{mag}/orf_contig_mapping.tsv",
        output_fasta = "{wdir}/{sample}/{mags_retrieval}/{mag}/orf_predicted.faa",
        output_simple_mapping = "{wdir}/{sample}/{mags_retrieval}/{mag}/simple_orf_contig_mapping.tsv",
    conda:"..."
    shell:
        """
        ### contents of the parse_prodigal.py :

        # import sys
        # from geomosaic.parsing_output.prodigal_orf_mapping import parsing_prodigal_orfs
        # fasta_input, output_mapping, output_fasta, output_simple_mapping = sys.argv[1:]
        # parsing_prodigal_orfs(fasta_input, output_mapping, output_fasta, output_simple_mapping)

        python parse_prodigal.py {input} {output}
        """

def get_parsed_outputs(wildcards) :
    """
    This function reads the MAG dataframe and generates the list of expected outputs out of the rule "parse_prodigal"
    """
    from pathlib import Path # i prefer this instead of os.path.join(...), it's my favorite library (in standard lib) to handle file paths
    import pandas as pd

    mag_folder = Path(f"{wildcards.wdir}/{wildcards.sample}/" + config["mags_retrieval"]) # <-- this is the equivalent of your original input.mags_folder
    mags_file = mag_folder/"MAGs.tsv"

    df_mags = pd.read_csv(mags_file, sep="\t")

    # here I generate only one of the three outputs of parse_prodigal, just so Snakemake can infer the DAG
    inputs = [str(mag_folder / f"{mag}/orf_contig_mapping.tsv") for mag in df_mags.MAGs]
    return inputs

rule gather_parsed_outputs:
    """For this rule, the magic happens in the input function, that will allow snakemake to generate the DAG and know which commands to execute"""
    input: get_parsed_outputs
    output: touch("{wdir}/{sample}/" + config["mags_retrieval"] + "/gather_OK.txt")

rule all:
    expand(rules.gather_parsed_outputs.output, sample=config["samples"])

The big advantage of this approach is that it will allow Snakemake to optimise the execution of each subprocess, and execute in parallel each prodigal call

Thanks for this draft ! I'll try that also to understand how do they work.

I only had to change some parts of the code, but it works now. I also understood how it works. Thank you very much.

This is the final result (tested)

rule all_mags_prodigal:
    input: expand("{wdir}/{sample}/mags_prodigal/gather_OK.txt", wdir=config["WDIR"], sample=config["SAMPLES"])

rule run_mags_prodigal:
    input:
        fasta=expand("{wdir}/{sample}/{mags_retrieval}/fasta/{mag}.fa", mags_retrieval=config["mags_retrieval"], allow_missing=True)
    output:
        genes_gff="{wdir}/{sample}/mags_prodigal/{mag}/genes.gff",
        protein_translations="{wdir}/{sample}/mags_prodigal/{mag}/protein_translations.faa",
    params:
        extra="-p meta",
        quiet="-q"
    conda: config["ENVS"]["prodigal"]
    threads: 1
    shell:
        """
        # you don't need to do a mkdir anymore, it's handled by snakemake, because it's infered from the output files
        prodigal -i {input.fasta} \
            -o {output.genes_gff} \
            -a {output.protein_translations} \
            -f gff \
            {params.extra} \
            {params.quiet}
        """

rule run_parse_mags_prodigal:
    """
    This function executes a python script that contains the function that you used in your original rule.
    It can be merged with the previous rule if you want. It depends if you want to allow more or less ressources (threads/memory) than run_prodigal
    """
    input:
        fasta_input=rules.run_mags_prodigal.output.protein_translations # I love this snakemake feature, use it as much as possible
    output:
        output_mapping = "{wdir}/{sample}/mags_prodigal/{mag}/orf_contig_mapping.tsv",
        output_fasta = "{wdir}/{sample}/mags_prodigal/{mag}/orf_predicted.faa",
        output_simple_mapping = "{wdir}/{sample}/mags_prodigal/{mag}/simple_orf_contig_mapping.tsv",
    threads: 1
    run:
        from geomosaic.parser.prodigal_orf_mapping import parsing_prodigal_orfs
        parsing_prodigal_orfs(input.fasta_input, output.output_mapping, output.output_fasta, output.output_simple_mapping)

def get_parsed_outputs(wildcards) :
    """
    This function reads the MAG dataframe and generates the list of expected outputs out of the rule "parse_prodigal"
    """
    from pathlib import Path # i prefer this instead of os.path.join(...), it's my favorite library (in standard lib) to handle file paths
    import pandas as pd

    mag_folder = Path(f"{wildcards.wdir}/{wildcards.sample}/" + config["mags_retrieval"]) # <-- this is the equivalent of your original input.mags_folder
    mags_file = f"{mag_folder}/MAGs.tsv"

    df_mags = pd.read_csv(mags_file, sep="\t")

    # here I generate only one of the three outputs of parse_prodigal, just so Snakemake can infer the DAG
    folder_mags_prodigal = Path(f"{wildcards.wdir}/{wildcards.sample}/mags_prodigal")
    inputs = [str(f"{folder_mags_prodigal}/{mag}/orf_predicted.faa") for mag in df_mags["MAGs"]]
    return inputs

rule gather_parsed_outputs:
    """For this rule, the magic happens in the input function, that will allow snakemake to generate the DAG and know which commands to execute"""
    input: get_parsed_outputs,
    output: touch("{wdir}/{sample}/mags_prodigal/gather_OK.txt")
    threads: 1

Regarding the working directory

I would suggest using this instead : https://snakemake.readthedocs.io/en/stable/snakefiles/configuration.html#configure-working-directory

I don't think that wildcard is essential, but I saved it in the config file for reference only

Happy to help ! :D
You can still save the workdir in the config, that's what I do, simply :
# config.yml
workdir : "some/path"

# Snakefile
workdir: config["workdir"]

Hi @Hocnonsense ,
thanks for your answer. It worked!
However, I would like to change this line
mags_file = checkpoints.MAGs_from_each_sample.get(**wildcards).output.mags_file

in something related to my config["mags_retrieval"].
Specifically, is it possible to have something like the following code? This would be great as config["mags_retrieval"] stores the filename that contains the rule to use
(This example does not work)
...

def ls_collect_bins(mags_retrieval_path, config_mags_retrieval, f_string):
    def _f(wildcards):
        import pandas as pd
        from pathlib import Path

        mags_file_raw = f"{mags_retrieval_path}/MAGs.tsv".format(mags_retrieval=config_mags_retrieval, **wildcards)
        mags_file = Path(mags_file_raw)

        # mags_file = checkpoints.run_mags.get(**wildcards).output.mags_file
        df_mags = pd.read_csv(mags_file, sep="\t")

        _temp = []
        for m in df_mags.MAGs:
            _temp.append(f_string.format(mag=m, **wildcards) )

        return _temp
    return _f

rule gather_parsed_outputs:
    input: ls_collect_bins("{wdir}/{sample}/{mags_retrieval}", config["mags_retrieval"], "{wdir}/{sample}/mags_prodigal/{mag}/orf_predicted.faa"),
    # input: get_parsed_outputs
    output: touch("{wdir}/{sample}/mags_prodigal/gather_OK.txt")
    threads: 1

This example certainly does not work.
Here is the document of checkpoint
Checkpoint is considered when subsequent jobs based on the results of another rule. Your {mags_retrieval_path}/MAGs.tsv is generated from another rule that havn't be execulated yet, right? The rule that generate the file {mags_retrieval_path}/MAGs.tsv should be marked as checkpoint and refered in input function.
Otherwise, snakemake CANNOT understand that {mags_retrieval_path}/MAGs.tsv should be generated first, and that input bins should be re-evaluate hereafter.

if you want to change input path, you should change it in the checkpoint
checkpoint MAGs_from_each_sample:
    input: ...
    output:
        mags_file = "{wdir}/{sample}/{mags_retrieval}/" + config["mags_retrieval"] + "/MAGs.tsv",
    shell: ...

or you can pointout the value in path
rule gather_parsed_outputs:
    input: ls_collect_bins("{wdir}/{sample}/mags_prodigal/" + config["mags_retrieval"] + "/{mag}/orf_predicted.faa"),
    output: touch("{wdir}/{sample}/mags_prodigal/gather_OK.txt")
    threads: 1

or you can just refer the checkpoint, anyway
def ls_collect_bins(mags_retrieval_path, config_mags_retrieval, f_string):
    def _f(wildcards):
        import pandas as pd
        from pathlib import Path

        checkpoints.run_mags.get(**wildcards).output.mags_file

        mags_file_raw = f"{mags_retrieval_path}/{config_mags_retrieval}/MAGs.tsv".format(
            mags_retrieval=mags_retrieval, config_mags_retrieval=config_mags_retrieval, **wildcards
        )
        mags_file = Path(mags_file_raw)
        df_mags = pd.read_csv(mags_file, sep="\t")

        _temp = []
        for m in df_mags.MAGs:
            _temp.append(f_string.format(mag=m, **wildcards) )

        return _temp
    return _f


Example page https://deeplearning4j.org/word2vec.html doesn't match 0.9.1 APIs

Issue Description
I'm following https://deeplearning4j.org/word2vec.html page example, the only difference is that I'm loading sentences from an SQL DB.
Version Information
I'm using version 0.9.1 here is my pom extract
        <dependency>
            <groupId>org.deeplearning4j</groupId>
            <artifactId>deeplearning4j-core</artifactId>
            <version>0.9.1</version>
        </dependency>
        <dependency>
            <groupId>org.nd4j</groupId>
            <artifactId>nd4j-native-platform</artifactId>
            <version>0.9.1</version>
            <scope>test</scope>
        </dependency>
        <dependency>
            <groupId>org.datavec</groupId>
            <artifactId>datavec-api</artifactId>
            <version>0.9.1</version>
        </dependency>
        <dependency>
            <groupId>org.deeplearning4j</groupId>
            <artifactId>deeplearning4j-nlp</artifactId>
            <version>0.9.1</version>
        </dependency>
        <dependency>
            <groupId>org.deeplearning4j</groupId>
            <artifactId>deeplearning4j-ui-components</artifactId>
            <version>0.9.1</version>
        </dependency>
        <dependency>
            <groupId>org.deeplearning4j</groupId>
            <artifactId>deeplearning4j-ui_2.11</artifactId>
            <version>0.9.1</version>
        </dependency>
        <dependency>
            <groupId>org.deeplearning4j</groupId>
            <artifactId>deeplearning4j-ui-model</artifactId>
            <version>0.9.1</version>
        </dependency>

Contributing
Few samples don't compile with those versions:

UiServer is now UIServer
BarnesHutTsne does not have .usePca(false)
WordVectorSerializer.writeWordVectors(vec, "pathToWriteto.txt"); is deprecated

Also the UIServer part does not seem to do anything beside starting the UI.

@ShamsUlAzeem @tomthetrainer Can either of you update the example?

Out of date issue.


Optimize for freedraw on iPad: Added extra strokeWidth and enable pressure mode

I was having trouble writing on my ipad, because (1) the thinnest stroke width was too thick, and (2) the stroke would automatically change thickness based on force.
I wanted the option to disable these, so i have made these changes.
This is my first commit into this repo, if you see anything I should change, please let me know!

Hi, this PR could solve issue: #7467. Please check and add a tag perhaps.


Is it possible to take screenshot of the whole page which contains video with static divs?

Please make sure you are testing with the latest release of html2canvas.
Old versions are not supported and issues reported for them will be closed.
Please follow the general troubleshooting steps first:

[ ] You are using the latest version
[ ] You are testing using the non-minified version of html2canvas and checked any potential issues reported in the console

Bug reports:
Please replace this line with a brief summary of your issue AND if possible an example on jsfiddle.
Specifications:

html2canvas version tested with: 1.0.0-rc.7
Browser & version: chrome Version 90.0.4430.212
Operating system: windows 7

I have a requirement to display the host video and subscribe videos can be taken as a screenshot with a static header and sidebar.
So Is it possible to achieve this with this library?
Please help me out!! Any help will be appreciated.
Thank you!

Have a look at these two links, maybe they are helpful:
https://stackoverflow.com/questions/36213275/html2canvas-does-not-render-full-div-only-what-is-visible-on-screen
https://github.com/niklasvh/html2canvas/issues/117


Component/Unit Testing for the Settings Page

How to test
Prerequisites:
Run the docker containers + UInnovate App
Unit Testing
npm run test:unit

Component Testing
2 ways to test between (1) or (2)
(1)

Open Cypress

npx cypress open

Choose Component Testing
Choose your browser, and click on "Start Component Testing in ..."
Under the section "Component Specs", select the Settings.cy.tsx file and see if the tests pass.

(2)

Run the component tests directly on the terminal

npm run cy:run-component

Related to US #15 and PR #45

this is pretty good, but just remove the package-lock.json before merging pls


axis-nesting: approach via recoding, new class Nest()

Nesting will be re-introduced using a recoding-based approach that crossed all relevant axis level categories in a new variable. Meta will be catered for. The class will provide methods to restructure the variable into multindexed representations, slice sections, instruct the recode, create the meta, etc.

Resolved by #367.


Decoded Frame Event

Hi everybody,
I was wondering if Clappr provides any event triggered when a new frame is decoded.
As far as I know the actual decoding is performed by the Browser (according to what it supports) which passes it to the Clappr framework, is that correct ?
I would like to trap this event in order to get the decoded frame data, coming from a live stream, and show it directly into a canvas, possibly with a certain delay (hence implementing an internal buffering)
Thanks

@NicolaBernini unfortunately Clappr doesn't have any event about that :( and if you go to the playback themselves you'll see some level of control but usually not DECODED_FRAME. For instance hls.js has some Hls.Events.FRAG_* events that might help you.

I see, so in order to have this in Clappr, considering it uses HLS.JS internally, I should patch the code at some point (btw any suggestion where it would fit best?) in order to get events like HLSJS.Events.FRAG_LOADED right ?

One way you could do it is player.core.getCurrentPlayback()._hls.on('hlsFragParsingMetadata', function(event, ...


daprd doc

Thank you for helping make the Dapr documentation better!
Please follow this checklist before submitting:

[ ] Read the contribution guide
[ ] Commands include options for Linux, MacOS, and Windows within codetabs
[ ] New file and folder names are globally unique
[ ] Page references use shortcodes instead of markdown or URL links
[ ] Images use HTML style and have alternative text
[ ] Places where multiple code/command options are given have codetabs

In addition, please fill out the following to help reviewers understand this pull request:
Description
Adding doc to explain daprd usage and options
Issue reference

There is some conflicting feedback that needs to be addressed to complete this. Do one of you guys want to take it from here?

This PR is replaces by #1737


Support for input attachments in vulkan

Here i am again, thanks again for the help with tangent space. Anyways, this time I'm doing a simple forward renderpass with a Z-Prepass. For now i just want to render the depth in the prepass, then use it as an input in the main renderpass and just do a grayscale of the scene.
Now my depth buffer is used as an input attachment for the main pass, but there is no such concept in Direct X, and thus also not in HLSL. Now would it be possible to make some kind of tag of sorts to directly pass it to glslang, or is there already something that i have overlooked?

If would certainly be possible, and consistent with the design of Slang, to introduce a type InputAttachment or similar that can be used to declare a shader input of the correct type for Vulkan, and which isn’t allowed/valid for D3D targets.
Unfortunately, the current contributors to Slang are unlikely to have time to prioritize adding that type. Most of our current users/customers are writing code that they want to use on both Vulkan and D3D so Vulkan-only features are the highest priority.
That said, pull requests are always welcome and I’d be happy to give guidance to somebody on where to look if they wanted to try adding this feature to the compiler.

Ok thanks for clarifying, maybe i will look into it later.


Make work with 1.20

Some changes were needed to keep compatibility with the latest Minecraft internals
Additionally, I made it automatically allocate more memory to the heap when it generates the gradle.properties as it was running out of memory computing the mappings.
I also made it work with GitPod and the latest SDKMAN to automatically install Java 17 (which was failing previously due to the "-y"  being used as the Java version and removed the redundant automatic run of "gradle build" as it couldn't build due to npm run start not being used yet.

1.16 test will fail since APIs have changed

@PondWader can you update the test?

@PondWader can you update the test?

I'm not sure it's worth maintaining this since https://github.com/PrismarineJS/minecraft-data-generator-server exists which I didn't know at the time I was originally working on updating mc data.


Fix cleanout server

The old command does not work:
luigi@luigi-workstation:~$ curl <IP_ADDRESS>:10329/_admin/cluster/cleanOutServer -d '{"is":"DBServer0004"}'
{"error":true,"code":400,"errorNum":400,"errorMessage":"body must be an object with a string attribute 'server'"}

New one:
curl <IP_ADDRESS>:10329/_admin/cluster/cleanOutServer -d '{"server":"DBServer0004"}'
{"error":false,"id":"6511016","code":202}

thanks for this PR
this PR could be a chance to solve https://github.com/arangodb/planning/issues/3668 adding the cleanout call in the related http doc
also, when we document cleanout we should document how to monitor the status of the cleanout job, using the GET /_admin/cluster/queryAgencyJob?id=38029195 api, as described in this page https://docs.arangodb.com/3.4/Manual/Deployment/Kubernetes/Drain.html#clean-out-a-dbserver-manually
and then link this new cleanout http page into the relevant sections (e.g. administation and kubernetes drain node procedure)
thanks,

Was the command wrong all the time, or did the API change?

Guess it was wrong, APIs don't change as far as I know

cleanOutServer endpoint and others to be documented in new docs project as separate project


feat: new config parameter / CLI flag to prefixing seed filename with a timestamp

I've created the new timestampFilenamePrefix seeder config parameter and --timestamp-filename-prefix CLI flag to prefixing seed filenames with a timestamp, like migration files.
Documentation PR: https://github.com/knex/documentation/pull/271
Close #3623.

@christianodejesus Sorry for the delay in merging this. If you could resolve conflicts, I'll merge.

@christianodejesus Sorry for the delay in merging this. If you could resolve conflicts, I'll merge.
@kibertoad I did a merge from knex/master and conflicts are resolved. Ok!?

Thanks a lot!


Fix resolving specs when run against a dev ruby snapshot

What was the end-user or developer problem that led to this PR?
The problem is that in some dev ruby builds, RUBY_PATCHLEVEL is -1, so the spec crashes because of an ill-formed requirement.
See for example https://github.com/rubygems/rubygems/pull/3077/checks?check_run_id=457988784.

What is your fix for the problem, implemented in this PR?

My fix is to change the spec to respect a RUBY_PATCHLEVEL equal to -1, by reusing code that handles that case.

@bundlerbot merge


⚠ SceneTime has degraded performance

In 56e52b5, SceneTime ($ST) experienced degraded performance:

HTTP code: 200
Response time: 5533 ms

Resolved: SceneTime performance has improved in fd80651 after 8 minutes.


std.bitmanip.bitfields doesn't respect native endianness

ibuclaw (@ibuclaw) reported this on 2022-12-21T10:16:56Z
Transfered from https://issues.dlang.org/show_bug.cgi?id=23573
CC List

elpenguino+D
ibuclaw (@ibuclaw)
johanengelen

Description
Given the following definition (-preview=bitfields)
```
union realbits
{
    real value;
    struct
    {
        version (LittleEndian)
        {
            private ubyte[6] padding;
            ulong significand;
            uint exp : 15;
            bool sign : 1;
        }
        else
        {
            bool sign : 1;
            uint exp : 15;
            ulong significand;
            private ubyte[6] padding;
        }
    }
}
```

You'd have thought that the equivalent std.bitmanip.bitfields would be identical to the above, but no! You declare the bitfields in the same order, regardless of the native endian in effect on the target.

```
import std.bitmanip : bitfields;
version (LittleEndian)
{
    // ...
    mixin(bitfields!(
        uint, "exponent", 15,
        bool, "sign"    , 1));
}
else
{
  version (THIS_GENERATES_WRONG_LAYOUT)
  {
    mixin(bitfields!(
        bool, "sign"    , 1,
        uint, "exponent", 15));
  }
  else
  {
    mixin(bitfields!(
        uint, "exponent", 15,
        bool, "sign"    , 1));
  }
    // ...
}
```

There could be a valid reason for this behaviour, and if so it should be explicitly documented.

Otherwise, if this is indeed a bug, then it looks like the fix would be something along the lines of foreach vs. foreach_reverse all bitfields depending on little vs big endian respectively.

elpenguino+D commented on 2022-12-21T18:12:59Z
(In reply to johanengelen from comment #1)
> I thought that `std.bitmanip.bitfields` does not give any guarantees on
> layout, just that it tries to pack bits in minimal storage space.
> For example also no guarantees when sending std.bitmanip.bitfields as
> ubyte[] over network connection to a PC with different OS/arch.
> Removal of guarantees (like no guarantees of class layout) enables
> reordering of fields if it is beneficial to prevent accessing multiple
> bytes/words for multibyte fields:
>     mixin(bitfields!(
>         bool, "flag1" , 1,
>         ubyte, "flag2", 8,  // spans 2 bytes or one byte?
>         bool, "sign"  , 1));
>
> Because D bitfields are meant to mimic C bitfields, I think it will be very
> hard to guarantee that the layout of std.bitmanip.bitfields is the same...

D doesn't need two undefined flavours of bitfields. Some people find it useful to be able to read bitfields from files or the network regardless of cpu architecture.

johanengelen commented on 2022-12-21T23:46:01Z
(In reply to elpenguino+D from comment #2)
>
> D doesn't need two undefined flavours of bitfields. Some people find it
> useful to be able to read bitfields from files or the network regardless of
> cpu architecture.

OK, fair point.
But then the bugreport should be rewritten without comparing it to C bitfields, and instead specify exactly the bit layout as desired in bytes. It's not clear to me what is meant, because (I think) the OP says that the order of bits _within_ a byte is reversed depending on endianness, which does not give the architecture independent behavior that you want.

johanengelen commented on 2022-12-21T13:31:39Z
I thought that `std.bitmanip.bitfields` does not give any guarantees on layout, just that it tries to pack bits in minimal storage space.
For example also no guarantees when sending std.bitmanip.bitfields as ubyte[] over network connection to a PC with different OS/arch.
Removal of guarantees (like no guarantees of class layout) enables reordering of fields if it is beneficial to prevent accessing multiple bytes/words for multibyte fields:
    mixin(bitfields!(
        bool, "flag1" , 1,
        ubyte, "flag2", 8,  // spans 2 bytes or one byte?
        bool, "sign"  , 1));

Because D bitfields are meant to mimic C bitfields, I think it will be very hard to guarantee that the layout of std.bitmanip.bitfields is the same...

johanengelen commented on 2022-12-22T18:17:43Z
(In reply to Iain Buclaw from comment #5)
> (In reply to Iain Buclaw from comment #4)
> > It is not obvious to the observer that the mixin will generate code to match
> > the layout for both big and little endian (depending on which is in effect).
> Or more specifically - it's not obvious in the documentation that BigEndian
> targets actually layout all fields in reverse.
>
> https://dlang.org/library/std/bitmanip/bitfields.html
>
> """
> The bits are filled in the order given by the parameters, starting with the
> lowest significant bit.
> """
>
> Strictly, both parts of this sentence contradict each other.  Because the
> lowest significant bit on BigEndian is the "reverse order given".

This depends on the interpretation of "BigEndian". I interpret it as byte endianness, where BigEndian means: each byte is little endian (`value & 0x1` giving the value of the LSB) and bytes are packed big endian (`array[0]` giving the most significant byte). Like wikipedia's interpretation: https://en.wikipedia.org/wiki/Endianness#Overview

I agree that clarification in the bitfields documentation is needed on the matter.

johanengelen commented on 2022-12-22T20:51:41Z
(In reply to elpenguino+D from comment #7)
> I think the problem is that 'least significant bit' is undefined here, since
> the term is defined according to the data, not endianness.

That's why I wrote this to define what LSB means:  `value & 0x1` giving the value of the LSB

ibuclaw (@ibuclaw) commented on 2022-12-22T11:55:17Z
(In reply to johanengelen from comment #3)
> (In reply to elpenguino+D from comment #2)
> >
> > D doesn't need two undefined flavours of bitfields. Some people find it
> > useful to be able to read bitfields from files or the network regardless of
> > cpu architecture.
>
> OK, fair point.
> But then the bugreport should be rewritten without comparing it to C
> bitfields, and instead specify exactly the bit layout as desired in bytes.
> It's not clear to me what is meant, because (I think) the OP says that the
> order of bits _within_ a byte is reversed depending on endianness, which
> does not give the architecture independent behavior that you want.
Well, the bug is that it *nearly* ended up in Phobos without checking whether it actually worked.

https://github.com/dlang/phobos/pull/8478/files#diff-0f4bb61407d729d1f6d76e25e15eb84b89ceae014ccc887149c53fb2290a29ccR377-R392

std.numeric also uses bitfields to extract the sign, exponent, and significand out of a float and double too.

    mixin(bitfields!(
        T_sig, "significand", precision,
        T_exp, "exponent"   , exponentWidth,
        bool , "sign"       , flags & flags.signed ));

It is not obvious to the observer that the mixin will generate code to match the layout for both big and little endian (depending on which is in effect).

elpenguino+D commented on 2022-12-22T19:02:15Z
I think the problem is that 'least significant bit' is undefined here, since the term is defined according to the data, not endianness.

ibuclaw (@ibuclaw) commented on 2022-12-22T12:02:54Z
(In reply to Iain Buclaw from comment #4)
> It is not obvious to the observer that the mixin will generate code to match
> the layout for both big and little endian (depending on which is in effect).
Or more specifically - it's not obvious in the documentation that BigEndian targets actually layout all fields in reverse.

https://dlang.org/library/std/bitmanip/bitfields.html

"""
The bits are filled in the order given by the parameters, starting with the lowest significant bit.
"""

Strictly, both parts of this sentence contradict each other.  Because the lowest significant bit on BigEndian is the "reverse order given".

"""
Create a bitfield pack of eight bits, which fit in one ubyte. The bitfields are allocated starting from the least significant bit, i.e. x occupies the two least significant bits of the bitfields storage.
"""

This should be clarified that `x` occupies the two least significant bits on LittleEndian only.


Build issues for ppc64le architecture

I would like to bring to your kind attention that it is impossible to build gx for ppc64le architecture right now due to following error:
# github.com/whyrusleeping/gx/vendor/github.com/minio/sha256-simd
vendor/github.com/minio/sha256-simd/sha256block_other.go:26:6: block redeclared in this block
	previous declaration at vendor/github.com/minio/sha256-simd/sha256block_noasm.go:21:29

Are your deps up to date (and it looks like you're vendoring). GOARCH=ppc64le go build works fine on my machine.

 Updating the deps (just one of them) solved the issue. Thank you!


Implement hideControlBar feature

Implement #53

Can we name the variable showControls and set it to true by default. that sounds better semantically.

@erluxman I have tested the changes and everything looks good.


how do use the SAP BTP connectivity service to call an SMTP server within a CAP application?

Hi Everyone,
I have created a destination service and a connectivity service for my CAP application and bound them in BAS through the "env" file. but when I call the sendmail function from the SDK I get an error that says "read ECONNRESET" " So I kindly ask your help on how to test the destination and the connectivity service from a CAP application
best regards

Hi @eliugonzalez86 ,
What version of the sap-cloud-sdk are you currently using? I am assuming you have a MAIL On-prem destination, can you also share what the destination object looks like?
We have a troubleshooting guide that you can refer to for debugging the destination service/connectivity issues. Let us know if that helps.

Hi @deekshas8 ,
thank you very much for your response, I followed the troubleshooting guide and as you can see in the image below the CAP application does find the destination even with the connectivity proxy values

I have the following destination:

and this cloud connector is configured as follows:

These are the cloud SDK versions I'm using and declare in my package.json:
"@sap-cloud-sdk/connectivity": "^3.8.1",
"@sap-cloud-sdk/http-client": "^3.8.1",
"@sap-cloud-sdk/mail-client": "^3.6.0",

The problem is when I try to send an email using mail-client along with the destination :(
if you something else please let me know.
I hope to hear from you soon
best regards

Hi @eliugonzalez86 ,
Can you upgrade your @sap-cloud-sdk/mail-client version to v3.8.0. We recently added support for Location ID starting this version.

Hi @deekshas8,
I updated the @sap-cloud-sdk/mail-client version and the error is still the same :(

any other tip would be appreciated
best regards

Hi @eliugonzalez86 ,
We double-checked our code again, and it turns out you cannot use Mail destinations with authType NoAuthentication. In other words you need to change the authentication type to e.g. BasicAuthentication and provide credentials. This should have been checked before the request is sent and a corresponding error should have been logged. Not sure why this worked as intended here.
Best regards,
Dennis

Hi again @eliugonzalez86,
@deekshas8 made me aware that you're running in BAS. As far as we're aware, the connectivity service is not reachable from BAS. Could you please try deploying your application and see if that makes a difference?

Hi @mr-flannery and @deekshas8 ,
yes, after deploying the application in btp and adjusting the destination adding user and password it worked :), then the problem is in the BAS proxy to use the destinations created in BTP. specially the email type, because the http type works.
best regards

Happy to hear it worked!

Hi, Can you share the properties used in destination with type MAIL?

Hi, Can you share the properties used in destination with type MAIL?

Hi @aartsingh  yes, here's how I created the destination type MAIL for my CAP proyect


[question] nested swipers?

Hey there,
I was wondering if you could update the demos to provide a demo of nested swipers, similar to in the swiper demos: http://idangero.us/swiper/demos/11-nested.html  source: https://github.com/nolimits4web/Swiper/blob/master/demos/11-nested.html
Is that behavior doable with this wrapper, currently? also, is it possible to combine the above nested sliders + a scrollable container slide ( https://github.com/nolimits4web/Swiper/blob/master/demos/32-scroll-container.html )?
I tried something like:
const vProps = {
  direction: 'vertical'
}
<Swiper>

horizontal slide one

horizontal slide two

    <Swiper {vProps}>

vertical slide one

vertical slide two

    </Swiper>

</Swiper>

which allowed me to swipe horizontally to the nested stack, and swipe vertically in the nested stack, but I could not swipe back to the horizontal slides ( ie I could go from horizontal slide two to vertical slide one, but not the reverse).

Figured it out, all good. :)


Add support for callstats from callstats.io

Looks like an interesting service. Need to see what the privacy policy is, but we should try playing with this on a test instance of AppRTC (i.e. x-dot-apprtc)

Directions from callstats.io:
1 Include callstats.js.
script src="https://api.callstats.io/callstats.min.js"
2 Add the app keys to your WebRTC application.
3 Dive into the API documentation.
4 Make the first call.
5 View the live statistics of an ongoing call.

What can we do to help?

@vr000m, how much work would it be to get basic call stats wired up? Step #3 above is somewhat open-ended :)
We still need to address the privacy policy question, but would be good to have a handle on the engineering effort here as well.

The very basic requires mainly wiring up 2 APIs after initialising the SDK:

AddNewFabric() when peerconnection is created, because it needs access to the PC object to basically attach itself to onNN, onSSC, getStats().
sendFabricEvent(): fabricTerminated, audioMute/unmute, videoPause/unpause.

The callstats.js tries to catch if a PC is explicitly closed or a tab is closed (onbeforeunload), but this is not always perfect. However, in the worst case, the backend removes the call state automatically after 30s of inactivity.
If there are user events like  audioMute, videoPause, wiring up the corresponding fabricEvents helps, these  show up on the event timeline on the conference details page, helps correlate with the corresponding stats, for example.

Optional extra step is wiring up reportError(), this is needed for disambiguating where the call setup failed before negotiation was complete. Since callstats.js cannot access the errorcallbacks of gUM, createOffer, createAnswer, setLD, setRD, calling reportError with the error reason helps narrow down issues related to new version of chrome/ff, munging, etc.
Links to the privacy policy and terms are:

http://www.callstats.io/terms/
http://www.callstats.io/privacy/

Additionally, there are the cases where

@vr000m do you want to make a pull request to add calls to these APIs?

The latest we can get to this is in week 7. @karthikbr82 could you prioritise this within the current iteration? i.e., make a feature complete PR.

Not sure I understand - does that mean you can look at this after Feb 15, or before Feb 15?

In week 7, before 19 Feb.

OK - sounds good.

The kapten has started working on this.


Store grpclb LB token and stats object in a per-address attribute.

This uses the new per-address attribute API to attach the LB token and stats object to the address and then have the picker read it back from the resulting subchannel, which is much cleaner than the hacky channel args approach we were using before.  It also fixes a bug that prevented us from switching to a new LB token for a given backend (although no one has actually reported running into that problem).

I couldn't get to this fully today but plan to review on monday. Looks like clang format is complaining though.

Known issue: #24204


Integrate llvm-project and bump dependencies

llvm-project: 5a64bc207ee0
mlir-hlo: e351c6b710c389341c00e8e584cf0f8249e97a44
tensorflow: c5bf7644569732e58ec83154927ba98acf752ecd

The failing commit got reverted from llvm-project, so the reverting commit is cherry-picked.


set current ayah, experimental

@mmahalwy checkout this experimental branch, it just links the verse dropdown with the player which in my opinion feels a lot more useful and natural but it does something which you said we didn't want to do, which is set a general current ayah in state

So this looks good minus the console.logs you have. Have you tried to see what happens when you click further in the surah that's either 1. in the next 10 ayahs (should just do a lazy load call for next 10 ayahs) or 2. further in the surah (ayah 280 for example). What happens there?

yeah I fixed everything up; if you want to checkout my PR follow instructions here http://blog.scottlowe.org/2015/09/04/checking-out-github-pull-requests-locally/
can I merge?

this PR now includes code to fix audio preloading @mmahalwy (only the next 3 ayahs get preloaded at a time)


[update-checkout] Remove some old configs that are no longer used.

The checkout configs included some old dated branches that are no longer
used. They are unlikely to work well anyway because the corresponding
Clang/LLVM branches moved forward independently. Remove those config entries.
Also re-order the 4.0 and 4.1 configs to be consistent.

@swift-ci please smoke test


use your extension libreoffice-ical-importer in libre calc?

Dear Mr. Wichmann,
How can I use your extension libreoffice-ical-importer in libre calc?
Kind regards
Peter

Download LibreOffice extension: https://github.com/prometheus42/libreoffice-ical-importer/releases/tag/v0.2
Install extension in LibreOffice
Open LibreOffice Calc
Click on the tools ("Werkzeuge") menu and start the import function
Choose iCal file

The fields of the iCal file should be stored as columns in the table.

Download LibreOffice extension: https://github.com/prometheus42/libreoffice-ical-importer/releases/tag/v0.2
Install extension in LibreOffice
Open LibreOffice Calc
Click on the tools ("Werkzeuge") menu and start the import function
Choose iCal file

The fields of the iCal file should be stored as columns in the table.

@pe4000 Don't forget to install the dependencies also, otherwise it won't work.


format coordinates according to current locale

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Details

9 of 9 (100.0%)  changed or added relevant lines in 2 files are covered.
1 unchanged line in 1 file lost coverage.
Overall coverage decreased (-0.01%) to 99.652%

Files with Coverage Reduction
New Missed Lines
%

src/modules/olMap/handler/draw/OlDrawHandler.js
1
98.25%

Totals

Change from base Build<PHONE_NUMBER>:
-0.01%

Covered Lines:
12445

Relevant Lines:
12447

💛  - Coveralls


remove double underscore from cte prefix ephemeral

resolves #2660
Descriptione-->
Basically just removed double underscore from ephemeral CTE prefix in order to support dbt-exasol adapter.
Checklist

[x] I have signed the CLA
[x] I have run this code in development and it appears to resolve the stated issue
[ ] This PR includes tests, or tests are not required/relevant for this PR
[ ] I have updated the CHANGELOG.md and added information about my change to the "dbt next" section.

@tglunde We'd like to resolve #2660 differently, by moving add_ephemeral_model_prefix into an adapter method, and ensuring that we always use that adapter method instead of hard-coding __dbt__CTE__ephemeral. I'm hoping to include that change in v0.18.0.

Closed by #2712


mail archive search URL (sometimes?) wrong

Describe the issue
While doing a SECDIR review, the URL for "search the mail archives" is this:
No results found ('No results: https://mailarchive.ietf.org/arch/export/mbox/?qdr=c&start_date=2023-08-02&email_list=secdir&q=subject%3A%28draft-ietf-lamps-rfc8398bis%29&as=1 -> No results found') (searched for ["draft-ietf-lamps-rfc8398bis"](https://mailarchive.ietf.org/arch/search/?qdr=c&start_date=2023-08-02&email_list=secdir&q=subject%3A%28draft-ietf-lamps-rfc8398bis%29&as=1), corresponding [export](https://mailarchive.ietf.org/arch/export/mbox/?qdr=c&start_date=2023-08-02&email_list=secdir&q=subject%3A%28draft-ietf-lamps-rfc8398bis%29&as=1)). You have to fill in link and content yourself.

It shouldn't be secdir it should be the WG where the document is, in this case SPASM.
It also wasn't clear to me that what I would get would be a TGZ file of mbox archives.
Code of Conduct

[X] I agree to follow the IETF's Code of Conduct

Rich - what did you do to get that URL?
The string mbox does not appear in view-source:https://datatracker.ietf.org/doc/draft-ietf-lamps-rfc8398bis/
(and that lamps draft is the only URL I see in the link you provided, so I'm having trouble connecting this to SPASM?)

I clicked on this link: https://datatracker.ietf.org/doc/draft-ietf-lamps-rfc8398bis/reviewrequest/15278/complete/ and then I clicked on "search mail archives and got the message posted above.

So the workflow is that you've sent a review to the list already, and now you're wanting to tell the datatracker to go find the review you sent and the form is not populating the field based on the search response? (I'm trying to duplicate and have not yet gotten to something that results in an mbox download).

But, one note - it is intentional that the link is into the review team's archive and not the group's archive.

Aha.  Light dawns on Marblehead, as they say.  Perhaps the message could be tweaked.  Change
Search mail archive subjects for:

To
Search directorate mail archive subjects for:

The part of this issue that talks about the un-intuitive link displayed when the search fails has been moved to the mailarchive for the creation of a purposed API for the datatracker to use.
The remaining part of this issue is to accept the small text change Rich proposes.

@richsalz Would it be clearer to say Search<EMAIL_ADDRESS>mail archive subjects for:?

@pselkirk sure that's fine.


Convert Client Secret Input Fields to password

fixes #4445

Codecov Report

Merging #4455 into master will decrease coverage by 0.02%.
The diff coverage is 85.71%.

@@            Coverage Diff             @@
##           master    #4455      +/-   ##
==========================================
- Coverage   58.91%   58.89%   -0.03%
==========================================
  Files         891      895       +4
  Lines       29085    29203     +118
  Branches     4201     4219      +18
==========================================
+ Hits        17136    17199      +63
- Misses      11949    12004      +55


Haobai24 to README.md

docs: fix grammar
Fix unnecessary wording and make it more clear

Thank you for the copy edits, they are much appreciated! I definitely needed a copy editor :)
Given that this has been entirely changed, closing the PR. Thanks again!


Handling phoenix default heroicons dependecy

The phoenix new project code generator is adding a dependency to mix that point to the github repo containing the heroicons icon set.
As you can see this dependency has the app: false and compile: false option set, but a deps_nix goes a head an generates a derivation in the deps.nix file for it, which in turn failes to build.
  {:heroicons,
   github: "tailwindlabs/heroicons",
   tag: "v2.1.3",
   sparse: "optimized",
   app: false,
   compile: false,
   depth: 1},

error: builder for '/nix/store/1q9mnyzsqqfshmgm7csvsa9pvclvwk2w-heroicons-01c786b0353c7e51b86bc903a329e81d7578333d.drv' failed with exit code 1;
       last 14 log lines:
       > bash: warning: setlocale: LC_ALL: cannot change locale (C.UTF-8): No such file or directory
       > Running phase: unpackPhase
       > unpacking source archive /nix/store/hcp3cys9mbqax2df6l02n9kbrpmhndyx-source
       > source root is source
       > Running phase: patchPhase
       > Running phase: updateAutotoolsGnuConfigScriptsPhase
       > Running phase: configurePhase
       > bash: warning: setlocale: LC_ALL: cannot change locale (C.UTF-8): No such file or directory
       > Running phase: buildPhase
       > /nix/store/mg966h6cir056vnva84lw86wxp1f2z2m-bash-5.2p26/bin/bash: warning: setlocale: LC_ALL: cannot change locale (C.UTF-8): No such file or directory
       > /nix/store/mg966h6cir056vnva84lw86wxp1f2z2m-bash-5.2p26/bin/sh: warning: setlocale: LC_ALL: cannot change locale (C.UTF-8): No such file or directory
       > /nix/store/mg966h6cir056vnva84lw86wxp1f2z2m-bash-5.2p26/bin/bash: warning: setlocale: LC_ALL: cannot change locale (C.UTF-8): No such file or directory
       > /nix/store/mg966h6cir056vnva84lw86wxp1f2z2m-bash-5.2p26/bin/sh: warning: setlocale: LC_ALL: cannot change locale (C.UTF-8): No such file or directory
       > ** (Mix) Could not find a Mix.Project, please ensure you are running Mix in a directory with a mix.exs file
       For full logs, run 'nix log /nix/store/1q9mnyzsqqfshmgm7csvsa9pvclvwk2w-heroicons-01c786b0353c7e51b86bc903a329e81d7578333d.drv'.

Thanks for the report! If you get a chance - please give v0.5.1 a go.


Errors after upgrade from 2.1.0 => 2.2.2

Hello,
Upgraded recently the gem and started getting these weird errors:
Slack::Notifier::APIError: The slack API returned an error: missing_text_or_fallback_or_attachments (HTTP Code 500)Check the "Handling Errors" section on https://api.slack.com/incoming-webhooks for more information

When testing in cli, everything seems to be normal, I get the message in the channel. What could be an issue?
Thank you

Ok, apparently, this exception was added to notify if something is wrong and in my case I am missing some content.


Fix date in codemeta.json

coverage: 87.935% (-0.3%) from 88.264%
when pulling 695fb30d95b58add9df03dd291cf86c9d57807cb on patch-codemeta
into a4e601e1b70d8b7eef5dd555da4af20acc20ec01 on master.


Add erf function

I believe it is implemented:
http://fredrikj.net/blog/2016/03/taking-the-error-out-of-the-error-function/

It is -- one of the complex funcs.
I am rewriting the package in part to support the Complex algorithms (which are used to get Real results sometimes), and to update the overall approach.
I will let you know when that is useable.

[also I will see what I can do for this particular case with ArbFloats]


On Windows, the app shows wails.localhost refused to connect momentarily

On Windows, the app shows wails.localhost refused to connect momentarily, and then displays the app.
Not sure if it is a wails issue or slashbase code issue.

This was wails related issue and was fixed with wails version update in 4ef11dc9bfefd0c0785c6b190dc04df3e130ffeb.


leafletjs.com doesn't display correctly in Firefox

[x] I'm reporting a bug, not asking for help
[x] I've looked at the documentation to make sure the behaviour is documented and expected
[x] I'm sure this is a Leaflet code issue, not an issue with my own code nor with the framework I'm using (Cordova, Ionic, Angular, React…)
[x] I've searched through the issues to make sure it's not yet reported

How to reproduce

Leaflet version I'm using: n/a
Browser (with version) I'm using: Firefox 49.0.2
OS/Platform (with version) I'm using: Windows 7
Navigate to leafletjs.com

What behaviour I'm expecting and which behaviour I'm seeing
Site loads and scrolls immediately to the bottom of the page, and the demo Leaflet map returns the error ReferenceError: L is not defined (leafletjs.com, line 300, col 3).
Minimal example reproducing the issue

[x] this example is as simple as possible
[x] this example does not rely on any third party code

Sorry - realised this was related to the JS being blocked due to some weird proxy stuff. Ignore me, I'll probably go away...


Guide for custom form controls causes a TS2611 when implemented with Angular11 / TS4

Documentation Feedback
The current Material documentation (https://material.angular.io/guide/creating-a-custom-form-field-control) proposes that when creating a custom form field control, one can use computed properties to implement required fields. However since Angular 11 & Typescript 4, this causes a TS2611 error when building.
So either the interfaces need to be updated or the documentation needs to change.
Affected documentation page: https://material.angular.io/guide/creating-a-custom-form-field-control

Is there any workaround for this? After upgrade, my project no longer builds.
Error: ../../../node_modules/@angular/material/radio/radio.d.ts:183:9 - error TS2611: 'disabled' is defined as a property in class 'CanDisableRipple & HasTabIndex & MatRadioButtonBase', but is overridden here in 'MatRadioButton' as an accessor.
Angular 11.0.5
Material 9.1.1
Typescript 4.0.5

Is there any workaround for this? After upgrade, my project no longer builds.
Error: ../../../node_modules/@angular/material/radio/radio.d.ts:183:9 - error TS2611: 'disabled' is defined as a property in class 'CanDisableRipple & HasTabIndex & MatRadioButtonBase', but is overridden here in 'MatRadioButton' as an accessor.
Angular 11.0.5
Material 9.1.1
Typescript 4.0.5

Same here, any solution?

Same here, any solution?

Closing since it sounds like this was resolved eventually.


Closes #221 | Add Dataloader NUS SMS Corpus

Closes #221
I implemented one config per language/subset. Thus, configs will look like this: nus_sms_corpus_eng_source, nus_sms_corpus_cmn_seacrowd_ssp, etc. When testing, pass nus_sms_corpus_<subset> to the --subset_id parameter.
Checkbox

[x] Confirm that this PR is linked to the dataset issue.
[x] Create the dataloader script seacrowd/sea_datasets/my_dataset/my_dataset.py (please use only lowercase and underscore for dataset naming).
[x] Provide values for the _CITATION, _DATASETNAME, _DESCRIPTION, _HOMEPAGE, _LICENSE, _URLs, _SUPPORTED_TASKS, _SOURCE_VERSION, and _SEACROWD_VERSION variables.
[x] Implement _info(), _split_generators() and _generate_examples() in dataloader script.
[x] Make sure that the BUILDER_CONFIGS class attribute is a list with at least one SEACrowdConfig for the source schema and one for a seacrowd schema.
[x] Confirm dataloader script works with datasets.load_dataset function.
[x] Confirm that your dataloader script passes the test suite run with python -m tests.test_seacrowd seacrowd/sea_datasets/<my_dataset>/<my_dataset>.py.
[ ] If my dataset is local, I have provided an output of the unit-tests in the PR (please copy paste). This is OPTIONAL for public datasets, as we can test these without access to the data files.

I've run the make check_file, please double-check.

I am getting the error message KeyError: '$' when trying to load the dataset. Please advise.

@raileymontalan could you give your test result?

I've run the make check_file, please double-check.

I am getting the error message KeyError: '$' when trying to load the dataset. Please advise.

@raileymontalan could you give your test result?

Hi @akhdanfadh, I am using a MacBook, so the issue could be related to this. Please see the error message here:
(env-seacrowd) raileymontalan@Raileys-MacBook-Pro-2023 seacrowd-datahub % python -m tests.test_seacrowd seacrowd/sea_datasets/nus_sms_corpus/nus_sms_corpus.py --subset_id="nus_sms_corpus_eng"
INFO:__main__:args: Namespace(path='seacrowd/sea_datasets/nus_sms_corpus/nus_sms_corpus.py', schema=None, subset_id='nus_sms_corpus_eng', data_dir=None, use_auth_token=None)
INFO:__main__:self.PATH: seacrowd/sea_datasets/nus_sms_corpus/nus_sms_corpus.py
INFO:__main__:self.SUBSET_ID: nus_sms_corpus_eng
INFO:__main__:self.SCHEMA: None
INFO:__main__:self.DATA_DIR: None
INFO:__main__:Checking for _SUPPORTED_TASKS ...
module seacrowd.sea_datasets.nus_sms_corpus.nus_sms_corpus
INFO:__main__:Found _SUPPORTED_TASKS=[<Tasks.SELF_SUPERVISED_PRETRAINING: 'SSP'>]
INFO:__main__:_SUPPORTED_TASKS implies _MAPPED_SCHEMAS={'SSP'}
INFO:__main__:schemas_to_check: {'SSP'}
INFO:__main__:Checking load_dataset with config name nus_sms_corpus_eng_source
/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/load.py:2483: FutureWarning: 'use_auth_token' was deprecated in favor of 'token' in version 2.14.0 and will be removed in 3.0.0.
You can remove this warning by passing 'token=<use_auth_token>' instead.
  warnings.warn(
/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/load.py:922: FutureWarning: The repository for nus_sms_corpus contains custom code which must be executed to correctly load the dataset. You can inspect the repository content at seacrowd/sea_datasets/nus_sms_corpus/nus_sms_corpus.py
You can avoid this message in future by passing the argument `trust_remote_code=True`.
Passing `trust_remote_code=True` will be mandatory to load this dataset from the next major release of `datasets`.
  warnings.warn(
Generating train split: 0 examples [00:01, ? examples/s]
E
======================================================================
ERROR: runTest (__main__.TestDataLoader)
Run all tests that check:
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/builder.py", line 1743, in _prepare_split_single
    example = self.info.features.encode_example(record) if self.info.features is not None else record
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/features/features.py", line 1878, in encode_example
    return encode_nested_example(self, example)
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/features/features.py", line 1243, in encode_nested_example
    {
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/features/features.py", line 1244, in <dictcomp>
    k: encode_nested_example(sub_schema, sub_obj, level=level + 1)
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/features/features.py", line 1243, in encode_nested_example
    {
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/features/features.py", line 1244, in <dictcomp>
    k: encode_nested_example(sub_schema, sub_obj, level=level + 1)
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/features/features.py", line 1243, in encode_nested_example
    {
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/features/features.py", line 1243, in <dictcomp>
    {
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/utils/py_utils.py", line 326, in zip_dict
    yield key, tuple(d[key] for d in dicts)
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/utils/py_utils.py", line 326, in <genexpr>
    yield key, tuple(d[key] for d in dicts)
KeyError: '$'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/raileymontalan/Documents/seacrowd-datahub/tests/test_seacrowd.py", line 134, in setUp
    self.dataset_source = datasets.load_dataset(
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/load.py", line 2549, in load_dataset
    builder_instance.download_and_prepare(
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/builder.py", line 1005, in download_and_prepare
    self._download_and_prepare(
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/builder.py", line 1767, in _download_and_prepare
    super()._download_and_prepare(
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/builder.py", line 1100, in _download_and_prepare
    self._prepare_split(split_generator, **prepare_split_kwargs)
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/builder.py", line 1605, in _prepare_split
    for job_id, done, content in self._prepare_split_single(
  File "/Users/raileymontalan/miniconda3/envs/env-seacrowd/lib/python3.10/site-packages/datasets/builder.py", line 1762, in _prepare_split_single
    raise DatasetGenerationError("An error occurred while generating the dataset") from e
datasets.exceptions.DatasetGenerationError: An error occurred while generating the dataset

----------------------------------------------------------------------
Ran 1 test in 3.052s

FAILED (errors=1)

@raileymontalan I'm not sure about the macbook issue since I able to test the code in both Ubuntu and MacOS as well (see image below). Since the error is KeyError, I'm guessing it is about the python itself(?), or something in your environment.

Hi @raileymontalan, can you try running it on Linux-based OS? When I tried on Mac, it gave the same error as yours, but I managed to run it without any issues on the server.

Hi @raileymontalan, a friendly reminder to review once you have the time. 👍

Hi @raileymontalan, I would like to let you know that we plan to finalize the calculation of the open contributions (e.g., dataloader implementations) in 31 hours, so it'd be great if we could wrap up the reviewing and merge this PR before then.
cc: @akhdanfadh

Hi @raileymontalan, can you try running it on Linux-based OS? When I tried on Mac, it gave the same error as yours, but I managed to run it without any issues on the server.
Do you have a different versions of datasets on the Mac vs Server? prob that was the case

in my end, the data generated has the key of $ generated from the root.

Prob adding additional kwargs of root identifier will help and when called recursively within the elements, we can disable the root flag so that the text info can be extracted

update: works for eng subset, but still looking the cause for cmn subset

@sabilmakbar How about, as a simple but ugly workaround, we just add $ attribute to each key?

Hi @raileymontalan, can you try running it on Linux-based OS? When I tried on Mac, it gave the same error as yours, but I managed to run it without any issues on the server.
Do you have a different versions of datasets on the Mac vs Server? prob that was the case

in my end, the data generated has the key of $ generated iteratively, which is a bit unexpected to the feature list.
Prob adding additional conditions of creating $ cols only if the element.text is available (not None) is a best workaround for now

Still getting the same issues as before when testing on Mac. My datasets version is 2.16.1

Hi @akhdanfadh, thank you for contributing to SEACrowd! I would like to let you know that we are still looking forward to completing this PR (and dataloader issues) and maintaining SEACrowd Data Hub. We hope to enable access to as many standardized dataloaders as possible for SEA datasets. ☺
Feel free to continue the PR whenever you're available, and if you would like to re-assign this dataloader to someone else, just let us know and we can help. 💪
Thanks again!
PS: If the issue still persists on MacOS and we cannot find a workaround, should we just wrap it up and add a note that it's only usable for Linux in the _DESCRIPTION?
cc: @raileymontalan @sabilmakbar


Enable people to easily get the specific info they need out of rack

Returning info in a machine readable format is a great start but typically people need to get some very specific piece of information out of a result return by rack.
For example, I need to get the ID of 2 servers that are named the same ("rum").
$ rack --json servers instance list
[
  {
    "Flavor": "general1-1",
    "ID": "2f9657df-68aa-4b26-b779-fb6e3c1fbe52",
    "Image": "055143e8-2da9-439a-a52d-8063f845dec6",
    "Name": "rum",
    "Private IPv4": "<IP_ADDRESS>",
    "Public IPv4": "<IP_ADDRESS>",
    "Status": "ACTIVE"
  },
  {
    "Flavor": "performance1-8",
    "ID": "c2e791b2-2e1d-4df8-b66c-bcf8c7e8bc96",
    "Image": "c11e2d37-bd93-44f0-b17e-bb87d1022975",
    "Name": "devstack-juno",
    "Private IPv4": "<IP_ADDRESS>",
    "Public IPv4": "<IP_ADDRESS>",
    "Status": "ACTIVE"
  },
  {
    "Flavor": "general1-2",
    "ID": "3b0c83f9-5cb3-4891-805c-30007a213db3",
    "Image": "6f29d6a6-9972-4ae0-aa80-040fa2d6a9cf",
    "Name": "rum",
    "Private IPv4": "<IP_ADDRESS>",
    "Public IPv4": "<IP_ADDRESS>",
    "Status": "ACTIVE"
  }
]

One option is to provide the ability to do this within rack itself. It could be done using go templates (ala docker inspect) or some other mechanism.
Another option is to simply document the solution using a favoured third party tool. My preference is jq.
For example.
$ rack --json servers instance list | jq -r '.[] | select(.Name == "rum").ID'
2f9657df-68aa-4b26-b779-fb6e3c1fbe52
3b0c83f9-5cb3-4891-805c-30007a213db3

Yeah, I think using a third-party tool is the way to go here. They already exist tools like the one you mentioned that do that stuff so well. In addition, rack already has the ability to pick out pieces of data to a degree. For your example, something like this:
rack servers instance list --fields id --name rum
You'd just have to cut off the header with tail or the like.

For some fields, you can use regex for selection:
$ rack servers instance list --name='nature.*'
ID					Name				Status	Public IPv4	Private IPv4	Image					Flavor
3e97f1a7-5831-4ac3-83f2-2d72d2171282	nature-iad-012-user.tmpnb.org	ACTIVE	<IP_ADDRESS>	<IP_ADDRESS>	06bb130b-7607-46f9-85ae-124bae4d0f5b	onmetal-compute1
1a7ba589-a388-4ff6-9b5d-c05912d6f6ac	nature-iad-012.tmpnb.org	ACTIVE	<IP_ADDRESS>	<IP_ADDRESS>	598a4282-f14b-4e50-af4c-b3e52749d9f9	performance2-15
62b2438f-b786-4a7a-a47f-0af1a2f7f847	nature.tmpnb.org		ACTIVE	<IP_ADDRESS>	<IP_ADDRESS>	06bb130b-7607-46f9-85ae-124bae4d0f5b	onmetal-compute1

Sounds good. I'm fine with leaving this open as a reminder to document one solution or close this and open another issue explicitly for doing the doc.

I think right now this is mostly documenting common use cases like @everett-toews has explained above. No code changes for now.

This should be addressed outside of the core docs, but rather as a how-to with more example use cases.


Table variable

[Enter feedback here]
Hello
Regarding the action "Write to Excel worksheet" it is mentioned "If the variable contains a table..." but I didn't find any documentation about how to create a variable that would contain a table. How can we create a table variable?
We can create new lists and add new items to lists but what about creating a table?
Thanks
David

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 08dbb236-dbdd-af9e-118a-db2ba29f6733
Version Independent ID: c9922ccc-6d8b-7f3c-65db-6f3fdc23743e
Content: Excel - Power Automate
Content Source: articles/desktop-flows/actions-reference/excel.md
Service: power-automate
GitHub Login: @mariosleon
Microsoft Alias: marleon

@mariosleon - Hi, Marios. Can you please take a look? Thank you.

Hello @Geradav, thank you for your interest Power Automate Desktop. You can find information on Datatables and how to create them under the "Advanced data types".


Onnx compilation

This PR attempts to build ONNXRT in the ava-cuda-10.1 container

Currently failing with a linker error, missing dependency in the makefile?
[ 47%] Linking CXX executable worker
CMakeFiles/worker.dir/onnx_opt_nw_worker.c.o: In function `__helper_guestlib_init_prologue':
onnx_opt_nw_worker.c:(.text+0x320f): undefined reference to `guestlib_tf_opt_init'
CMakeFiles/worker.dir/onnx_opt_nw_worker.c.o: In function `__helper_guestlib_fini_prologue':
onnx_opt_nw_worker.c:(.text+0x3234): undefined reference to `guestlib_tf_opt_fini'
collect2: error: ld returned 1 exit status

steps to reproduce on this branch
pushd tools/docker
make ava-cuda-10.1
popd
mkdir build
./tools/docker/run_docker.sh ava-cuda-10.1
# now running commands in docker container
pushd build
cmake .. -DAVA_GEN_ONNXRT_SPEC=On -DAVA_MANAGER_LEGACY=On
make

at runtime there's a undefined symbol
/data/NVIDIA_CUDA-10.1_Samples/0_Simple/vectorAdd/vectorAdd: symbol lookup error: /home/vance/Documents/workspace/a100-bench/build/ava/install/onnx_opt/lib/libcudart.so: undefined symbol: fatbin_handle_list
Looks like this is defined in worker/extensions/tf_optimization.c, should this be part of the guestlib compilation too?
Hangchen — Today at 2:17 PM
Yea we have to define it in guestlib too. It's referenced in an utility function but only used by worker. The utility functions are compiled into both guestlib and worker
Ultimately we should avoid such dirty fix by distinguishing worker's and guestlib's utilities

How do we define this in the guestlib? What source file should this go in?

Check ed73665b

Should the results of compiling onnx_dump be available on the client?
open /cuda_dumps/fatbin-info.ava [errno=2, errstr=No such file or directory] at /home/vance/Documents/workspace/a100-bench/third_party/ava/cava/samples/onnxruntime/onnx_opt.c:24701

got past it temporarily by disabling the preloaded cubins:
diff --git a/cava/samples/onnxruntime/onnx_opt.c b/cava/samples/onnxruntime/onnx_opt.c
index fa37310..943ec45 100644
--- a/cava/samples/onnxruntime/onnx_opt.c
+++ b/cava/samples/onnxruntime/onnx_opt.c
@@ -2,7 +2,7 @@ ava_name("CUDA Runtime for ONNX");
 ava_version("10.1.0");
 ava_identifier(ONNX_OPT);
 ava_number(10);
-ava_cflags(-I/usr/local/cuda-10.1/include -I../headers -DAVA_PRELOAD_CUBIN);
+ava_cflags(-I/usr/local/cuda-10.1/include -I../headers);
 ava_libs(-L/usr/local/cuda-10.1/lib64 -lcudart -lcuda -lcublas -lcudnn -lcufft -lcurand -lcusparse -lcusolver);
 ava_guestlib_srcs(extensions/tf_optimization.c extensions/cmd_batching.c);
 ava_worker_srcs(extensions/tf_optimization.c extensions/cmd_batching.c);

Now failing at runtime with no useful information
During startup program terminated with signal SIGSEGV, Segmentation fault.

Should the results of compiling onnx_dump be available on the client?
open /cuda_dumps/fatbin-info.ava [errno=2, errstr=No such file or directory] at /home/vance/Documents/workspace/a100-bench/third_party/ava/cava/samples/onnxruntime/onnx_opt.c:24701

Dumps must be present on both sides.
I can't really remember whether the opt specs work with AVA_PRELOAD_CUBIN disabled (I think it doesn't).

Should the results of compiling onnx_dump be available on the client?
open /cuda_dumps/fatbin-info.ava [errno=2, errstr=No such file or directory] at /home/vance/Documents/workspace/a100-bench/third_party/ava/cava/samples/onnxruntime/onnx_opt.c:24701

Dumps must be present on both sides.
I can't really remember whether the opt specs work with AVA_PRELOAD_CUBIN disabled (I think it doesn't).

so there's some part of the build that is missing or not documented? What generates fatbin-info.ava and what installs it onto the client?

Connect target API server (<IP_ADDRESS>:4005) at <IP_ADDRESS>:4005
Registering API command handler for API id 0: handler at 0x7f536532cee9

(process:1774893): GLib-CRITICAL **: 13:37:19.137: g_hash_table_lookup: assertion 'hash_table != NULL' failed
deviceName is _Z9vectorAddPKfS0_Pfi
vectorAdd: /home/vance/Documents/workspace/a100-bench/third_party/ava/cava/samples/onnxruntime/onnx_opt.c:976: __helper_assosiate_function: Assertion `0 && "func_id should not be null"' failed.

Maybe this is working as intended? I want to run kernels that aren't precompiled in this test but if I had an ONNX runtime benchmark this might work as is.

It seems like even if the hash table were available the code would still crash at onnx_opt.c:976 when running an arbitrary application because that func_id would not be found in the hash table generated from the fatbin-info.ava file. Does the hash table include other kernels besides the precompiled ones? Can I run arbitrary Cuda applications with this spec?

so there's some part of the build that is missing or not documented? What generates fatbin-info.ava and what installs it onto the client?

It's documented here cava/samples/tensorflow/README.md. I can send you a more detailed version if this is still unclear.

It seems like even if the hash table were available the code would still crash at onnx_opt.c:976 when running an arbitrary application because that func_id would not be found in the hash table generated from the fatbin-info.ava file. Does the hash table include other kernels besides the precompiled ones?

Do you have all *.ava files copied to /cuda_dumps?

Can I run arbitrary Cuda applications with this spec?

Arbitrary CUDA applications can be run with the dump spec (you can remove the code that dumps CUDA binaries). Opt spec must use the dumps generated by the dump spec.

I can't run an application with the onnx_dump spec either as in the tensorflow README.  The application crashes after executing  onnx_dump.c:285 when trying to open a dumped fatbinary on the client. The code seems to only dump fatbins on the worker. Is this a bug or am I doing something wrong?
    /*  Open the command pipe for reading */
    char pip_command[80];
    sprintf(pip_command, "/usr/local/cuda-10.1/bin/cuobjdump -elf /tmp/fatbin-%d.ava",
            ava_metadata(NULL)->num_fatbins);
    fp_pipe = popen(pip_command, "r");
    assert(fp_pipe);

Whoops, I remembered it wrong. For the dump spec, guestlib and worker must be run on the same host (because only worker is dumping fatbins, but both need to read the fatbins).
At the beginning both guestlib and worker are dumping fatbins and they can run on different hosts. But there were some race conditions in writing to the same file, so I made the above change.

Tested with TF benchmarks. Both Release and Debug mode look good.


problem with documents and populating listview

Greetings, I am a populating a listview with documents from couchdb in a descending order, but whenever a document is updated it immediately moves to the top of the listview and when a new document is included it is added below the old document instead of on top of it. What could be the problem.   Here is a code snippet of querying the view:
private void startLiveQuery() throws Exception {
        query = applicationz.getDatabase5().getView(String.format("%s/%s", designDocName, byDateViewName)).createQuery();
        query.setDescending(true);
        query.setLimit(30);

        liveQuery = query.toLiveQuery();
        liveQuery.setDescending(true);
        liveQuery.setLimit(30);
        liveQuery.addChangeListener(new LiveQuery.ChangeListener() {
            public void changed(final LiveQuery.ChangeEvent event) {

                getActivity().runOnUiThread(new Runnable() {
                    public void run() {
                        grocerySyncArrayAdapter.clear();
                        for (Iterator<QueryRow> it = event.getRows(); it.hasNext(); ) {
                            grocerySyncArrayAdapter.add(it.next());
                        }
                        grocerySyncArrayAdapter.notifyDataSetChanged();
                    }
                });
            }
        });
        liveQuery.start();

}

Hi @mikekaraa,
About sort order: What is your map function? Sort order is based on key which is emitted from map function.
Why moved to top: When ever changeEven is fired,  code re-create data in Adapter. I believe it re-populate list view.
FYI: For question, I recommend to post on https://forums.couchbase.com/c/mobile. You might get answer quickly.
Thanks!
Hideki

ok thanks for the reply @hideki, let me post the full question there.


Adjust naming to match ML best practices

I received a code review from @jbmuir:

I'm not sure the laplace smoothing equation is totally correct (missing smoothing parameter in the numerator). As a style note, you should be .gettingLogPriorProbability (rather than PriorProbability)

I was able to fix the laplace smoothing issue within https://github.com/itsmontoya/bag/pull/4. Will fix the naming recommendation soon!

Fixed final requests within https://github.com/GopherML/bag/pull/6