Generalize header parsing

Let ParseableHeader return errors if parsing fails so that more interesting header parsers can be written and parsing can fail early if headers are not as expected. Also make CsvRow a case class to allow for pattern matching.
Use case example: CSV with translations, first column being the key, the other columns being the languages identified by the headers. As it doesn't make sense to parse the file when the languages are invalid, it's nice to be able to fail on header parsing already instead of having to revalidate the headers on every row.

Thinking again about the use case and others where headers play a significant role, I decided to change header parsing from being always by column to the more general way of parsing the whole header row at once. That allows for more validation (for example, check that all expected columns are present, no duplicate column names) and for more interesting types (like pre-building a parse function based on the header). To keep the impact small and still support the previous by column approach, I added type aliases and extension methods which keep many use cases source compatible.
It's definitely a debatable change (which might even pave the way to further changes which for example, could make the Option[Header] in CsvRow easier to deal with), so discussion is very welcome :)

Codacy only complains about the null literal as parent exception for HeaderError, can be safely ignored.

Globally speaking I still miss to see the use case for a non-list header type. It adds some complexity to the types and operation resolution. And I can't seem to come up with a use case for it right now that would convince me totally. If you have such a use case, I would be really happy to hear about it :) Maybe even put it in the README, so that it's clear why we add this complexity.

Globally speaking I still miss to see the use case for a non-list header type. It adds some complexity to the types and operation resolution. And I can't seem to come up with a use case for it right now that would convince me totally. If you have such a use case, I would be really happy to hear about it :) Maybe even put it in the README, so that it's clear why we add this complexity.

As I wrote above, it is debatable change as it comes with some overhead/complexity. The following is a simplified version of an example I encountered at work:
sealed trait Language
// instances...
case class I18nValue(translate: Language => String)

implicit val i18nRowDecoder: CsvRowDecoder[(String, I18nValue), String] = (row: CsvRow[String]) => {
    for {
      headers <- row.headers.toRight(new DecoderError(s"CSV file must have headers"))
      langs <- headers.tail
        .traverse { lang =>
          Language
            .withNameInsensitiveOption(lang)
            .toRight(new DecoderError(s"""Unknown supported language "$lang""""))
        }
      i18n <- I18nValue.buildFromAllLanguages(langs zip row.values.tail) // fails if not all languages are present
    } yield row.values.head -> i18n
  }

The code would be way cleaner if it was possible to fail processing when parsing the headers already (not all languages present, invalid languages present) and not while handling the rows themselves (which implies the overhead of checking language exhaustivity for each row again).
Similar early validation use cases I could see when importing CSV files into a RDBMS, by the table structure you can reject CSV files when parsing the headers, but you don't want to check again on every row you insert.
Of course, in case of an error, the stream fails on the first row, but for correct files (which should be the dominant case) it adds overhead not be able to fail header parsing. Plus the necessary workaround makes it harder to deal with bad rows as attemptDecode will alway return a Left if the headers aren't valid.
Happy to fix all the comments you left in case this convinces you.


Checklist in place of Bullet Points

I think using a checklist to display all the weekly problems would be more helpful. The user can mark the problems which he/she already knows.

I don't have the bandwidth to build a progress checklist feature into the website although it's possible to add it. Would you like to try? 😄
Anyhow, I think users can copy and paste the list to GitHub gists where checkboxes have been implemented.

I think just a frontend checklist would also suffice. If the tab is closed, the data is lost. May sound stupid, but most of them just keep the tab open.

Would require more work than just editing the markdown. I can render the checklist by using the markdown syntax but it won't be interactive.

baoshijienews.com  老哥换个友链吗？
联系QQ：1297532431

This is better as a LeetCode list. I've created it here - https://leetcode.com/list/xi4ci4ig/


[DOC] fmriprep-docker documentation

Changes proposed in this pull request
This PR will address https://github.com/poldracklab/fmriprep/issues/1488 and https://github.com/poldracklab/fmriprep/issues/1129. This PR provides additional documentation to fmriprep-docker

Documentation that should be reviewed

Provided documentation to fmriprep-docker

I'm not sure why the ds tests failed, I am only changing the documentation

Oh, looks like I reviewed at exactly the wrong moment... Let me know if you want me to go through again.

It was at the same time! I'll apply your edits right now and then ping you for your review

@effigies - recent commit should have applied both Oscar's and your's comments and suggestions

adjustments applied - thank you for reviewing!


Not a KIVY bug, homepage search function not working

Software Versions

Python:
OS:
Kivy:
Kivy installation method:

Describe the bug
When I use the search function on your website. I search for something exampel "Label" I get a lot of hits. Regardsless of which search hit i click i get "404 file not Found".
The issue tracker is a tool to address bugs only (search known bugs: https://git.io/vM1iE).
Please use the #support Discord channel at https://chat.kivy.org/ or Stack Overflow for
support questions, more information at https://git.io/vM1yQ.
Expected behavior
I expect to find a webpage that is a helpfile of course
Thank your for a great framework.
Best regards
Per Löfqvist

Duplicated of #7697


OpTestBMC: like SSH don't use public key authentication for rsync

Fixes: https://github.com/open-power/op-test-framework/issues/250
Signed-off-by: Pridhiviraj Paidipeddi<EMAIL_ADDRESS>

Tested-by: Andrew Donnellan<EMAIL_ADDRESS>

Thanks!


⚠ Cioos National CKAN has degraded performance

In 65b88e0, Cioos National CKAN (https://catalogue.cioos.ca/) experienced degraded performance:

HTTP code: 200
Response time: 6807 ms

Resolved: Cioos National CKAN performance has improved in e4e85a3 after 7 minutes.


Add sequence new

I needed this function as I'm porting my JSON parser from luajit+libmarpa+pcre to Kollos and Lua patterns to start prototyping the LUIF -- it has a table-based grammar, which I'm planning to convert to D2L.
If you don't mind, I'd look into adding other functions, which I need to continue porting.

Thanks for the spacing changes -- I'm often late to add my vim line and wind up with bad spacing from my first edits.  Per the following, perhaps you submit them as a separate pull request.

Neither the KLOL or Libmarpa will understand sequences in Kollos -- the KHIL will be expected to rewrite them.  I wrote up pseudo-code to show how the KHIL should do this.
If you need to experiment in this direction, perhaps you can fork.  Since it mixes in code that goes in a direction different from the one I am taking, I prefer not to merge this one.

No problem -- I can have it in a separate branch.


Add a method to get download url of a File

@cenkalti better that way ? ;)
This time, token is directly provided to the download link, nothing to do on customer side.

Seems great to have this feature because this link is provided on website, should be normal to have it on python lib too.

@jlejeune
I have uploaded the latest version to PyPI.
https://pypi.org/project/putio.py/8.2.0

Thanks !
--
Julien
Le mer. 16 mai 2018 à 10:04, Cenk Altı<EMAIL_ADDRESS>a écrit :

@jlejeune https://github.com/jlejeune
I have uploaded the latest version to PyPI.
https://pypi.org/project/putio.py/8.2.0
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/cenkalti/putio.py/pull/42#issuecomment-389431836, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABbH0lekX285jTP93C8Dj1gKjUlrwL_gks5ty92ngaJpZM4T-iOW
.


ifcopenshell build is broken

Describe the bug
The build of ifcopenshell is broken, see https://hydra.nixos.org/job/nixpkgs/trunk/ifcopenshell.aarch64-linux
Steps To Reproduce
Steps to reproduce the behavior:

nix-env -iA ifcopenshell

fails.
The current error (but I have already fixed this one):
CMake Error at /build/source/src/svgfill/CMakeLists.txt:53 (message):
  Unable to find GMP library files, aborting

Expected behavior
The build is downloaded from cache.nixos.org OR it compiles successfully
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
Add any other context about the problem here.
Notify maintainers

@fehnomenal
Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
- system: `"x86_64-linux"`
 - host os: `Linux 6.1.87, NixOS, 23.11 (Tapir), 23.11.20240424.dd37924`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.18.1`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

Add a :+1: reaction to issues you find important.

(note: I've already made some progress, so I'm opening a draft MR right away)

To give a bit of context, I need ifc support in freecad and that needs ifcopenshell. I see that ifcopenshell is more or less considered as a python package (the derivation is wrapped in a buildPythonPackage. As I actually want the .so at the end, will this be a problem for me later?
But first, I need to fix the build. I've made progress, adding some missing deps:

libgmp
libmpfr
cgal (I need to check why I needed this one)

I might have a problem with the linker needing -libstdc++ flag, but I see this error only when the number of jobs is > 1. I'll see this later.
The error I'm currently facing with make -j1 is with libhdf5:

build with hdf5 disabled is currently broken upstream. I'm considering opening a PR with the suggested change and adding a patch in the build process for this
that being said, it'd be nice to be able to build it with hdf5 support! I'm currently working on this (more exactly, trying to work around ifcopenshell assumptions about lib structure)

At the end, what is the best practice considering build options? Should I create withFoo boolean args for the derivation? Or should we activate all that we can by default?
Thanks!

For reference:  https://github.com/IfcOpenShell/IfcOpenShell/issues/1759 (it's not the only issue about this hdf5 problem, just the one I found most relevant apart from the one above).


feat(nav): add breadcrumbs

This PR introduces a simple breadcrumb navigation. For now, it's only for Local. wdyt?

This is a great idea. I had been thinking about it too. What I was thinking though is that it would be good to move it to the header, to the right of the logo.

Let me know if are interested in doing that. If not, I can use your PR as the base for that.

Yeah! I'm interesting in implementing header breadcrumbs. I'll update this PR later

@kitsonk
Sorry for the delay! I've moved the UI to the header. I think you're working on other UI development, so for now, I'm keeping it local only to avoid conflicts

@hashrock I have added a couple features. I tried to rebase your PR with main, but I don't have permission to push an update.

Hmm, I have "Allow edits and access to secrets by maintainers" turned on, but it's strange.
If there are any issues, feel free to close this PR and copy the changes to your branch.

Maybe because I tried a rebase with a --force. 🤔


[feature request] Ability to use unmasked value

Current plugin have no feature to extract unmasked value. Will be perfect if here will be able to extract it. Like:

We made masked input(like +d (ddd) ddd-dddd ).
We using 'exctractRaw' function.
We getting ddddddddddd value.

👍 to this. I would love to be able to grab the raw value since we tend to store raw values in the database.

We don't do this on purpose because we don't know what the "raw value" technically is. There are too many use cases to deal with this which is why we require the user to do something like you've done to extract the value.

@vadimzham @epogue This request is usually made by Angular 2 users (since this is an expected behavior in Angular apps), so in the Angular 2 README, we mention that this feature is not supported along with a link that explains why we can't support it.
@vadimzham @epogue are you using Angular 2 or another framework?

@msafi I use Ember and became accustomed to this when using jquery.inputmask. It's not a necessary feature since sanitization is fairly simple. Thank you for the README link! 👍

@epogue Oh, I see. I'll also add the same note to the Ember README. Thanks!


find_package() unable to locate FindJuce.cmake due to filename capitalization

Just started using this project and it's a huge time saver! However, it seems the capitalization in "FindJuce.cmake" is not what cmake expects. It instead looks for a FindJUCE.cmake file since the find_package() call is made with the name "JUCE".
Environment: Debian 9, cmake 3.7.2
Repro steps:

In CMakeLists.txt, add the relative path to FindJuce.cmake to CMAKE_MODULE_PATH:
list(APPEND CMAKE_MODULE_PATH ${PROJECT_SOURCE_DIR}/../juce-cmake/cmake)

Call find_package as shown in examples:
find_package(JUCE REQUIRED   COMPONENTS   	juce_audio_basics  	juce_audio_devices              ... )

Run cmake

Results:
cmake returns an error about not being able to find the FindJUCE.cmake file (because the file is actually named FindJuce.cmake):

By not providing "FindJUCE.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "JUCE", but
CMake did not find one.
Could not find a package configuration file provided by "JUCE" with any of
the following names:
JUCEConfig.cmake
juce-config.cmake

Add the installation prefix of "JUCE" to CMAKE_PREFIX_PATH or set
"JUCE_DIR" to a directory containing one of the above files.  If "JUCE"
provides a separate development package or SDK, be sure it has been
installed.

Simply renaming the file to FindJUCE.cmake resolves the issue for me. Am I missing something? It seems this would be a real fundamental issue for everyone, so maybe there's some case-sensitive configuration on cmake I can change? Still, it seems being named FindJUCE.cmake would be more correct since this is the default expectation and what's described in the cmake documentation.

Thanks for addressing!


New GitHub Workflow Doesn't Support API

The workflow doesn't support @rishiosaur's API :/
Temporary fix is in place
View: https://github.com/rishiosaur/webring-api

cc: @KhushrajRathod

cc: @KhushrajRathod

Hmm... I'm not sure how I'd go about implementing this, since its completely done by JavaScript. It's also not very obvious how the webring works on rishi's site. Since a redesign is coming up (next.rishi.cx), maybe just stick to the webring code? I can recognise the webring controls by the hack club logo and the two arrows, but not so much in custom designs

Hmm... I'm not sure how I'd go about implementing this, since its completely done by JavaScript. It's also not very obvious how the webring works on rishi's site. Since a redesign is coming up (next.rishi.cx), maybe just stick to the webring code? I can recognise the webring controls by the hack club logo and the two arrows, but not so much in custom designs


Add support for fetching multireddit data

Reddit API Documentation:
https://www.reddit.com/dev/api/#GET_api_multi_{multipath}
"Fetch a multi's data and subreddit list by name."
Example endpoint:
https://www.reddit.com/api/multi/user/myroon5/m/nhl/

Thanks for logging this. I think this project is past its prime. I'm archiving this project. Feel free to fork though :)


update qemu to 8.1.5

cc @dgageot

There is an issue with alpine patch https://github.com/alpinelinux/aports/blob/3.19-stable/community/qemu/cpuinfo-ppc.patch:
6.411 apply ../patches/alpine-patches/cpuinfo-ppc.patch
6.412 + patch -p1
6.412 patching file util/cpuinfo-ppc.c
6.412 Reversed (or previously applied) patch detected!  Assume -R? [n]
6.412 Apply anyway? [n]
6.412 Skipping patch.
6.413 3 out of 3 hunks ignored -- saving rejects to file util/cpuinfo-ppc.c.rej

Needs to wait for aports to be updated

aports updated https://github.com/alpinelinux/aports/commit/e9d411e67e815ab0fcf1d00885cb55dd0f99e810


Split UiPlugin into UiRenderingPlugin and UiPlugin

What problem does this solve or what need does it fill?
Headless testing of UI is very important for the reliability of real world Bevy apps.
However, headless construction of UIs in Bevy is currently very painful, as bevy_ui's only plugin is fully interwoven with rendering code.
What solution would you like?

Split rendering and non-rendering code into two separate plugins for bevy_ui.
Add an example demonstrating headless UI and run it in CI to ensure no hidden runtime panics are introduced.

What alternative(s) have you considered?
Split the crates entirely. This might improve compile times, but it's not clear if it would be useful to contributors or users?

This design is also quite interesting as it enables the possibility of drop-in replacements for Bevy's UI rendering, to e.g. explore SDF rendering or be specialized for standard boxy desktop apps.

I started exploring 2D graphics rendering via primitive buffers and if I'm reading this issue correctly this is going to block my exploration too, if I'm not able to replace the Sprite-based built-in rendering with something else like conserving the other UI functionalities.


Add about 1045 script verification tests from Bitcoin Core

BitcoinJ is added as test dependency for an easier handling of scripts and transactions.
For data driven script verification tests, test cases are provided as JSON with the following format:
[
  [scriptSig, scriptPubKey, flags, comments],
  [scriptSig, scriptPubKey, flags, comments],
  ...
]

The tests are adopted from Bitcoin Core and added as resource:

https://github.com/bitcoin/bitcoin/blob/0.11/src/test/data/script_valid.json
https://github.com/bitcoin/bitcoin/blob/0.11/src/test/data/script_invalid.json

Optionally the newly added data driven tests can also be used to test the verification via BitcoinJ, however, this is currently disabled, because BitcoinJ understands only a subset of the scripts properly. In particular the support for certain (not consensus critical) verification flags is mostly missing.
To test BitcoinJ, DataDrivenBitcoinJSpec may be unignored manually.

There is some room for refactors, and I'm not really satisfied with the current structure.
Most notably, it's a bit ugly that elements from two projects are mixed (BitcoinJ.Script, BitcoinJ.Transaction and BitcoinConsensus.VerifyFlag), but given that this currently only touches the tests, I'm fine with it for now.


docs(radio): Delete example for two-way binding

Delete the [(value)] example because we don't support it. There's another example for [(ngModel)]
Closes #1790

R: @jelbourn

LGTM


Identifiers validation failed for dataset FUEL - Herbário da Universidade Estadual de Londrina

Identifier validation failed for the dataset FUEL - Herbário da Universidade Estadual de Londrina:

Crawler attempt: 442
Publishing organization: Universidade Estadual de Londrina
Publishing country: BRAZIL
Installation: speciesLink Network / INCT-HVFF IPT
Number of occurrences indexed for this dataset at the time of the issue: 55556
Cause: GBIF ID problems exceed 50% threshold: 100% duplicates; 55558 total records; 55558 absent records
Pipelines execution steps: http://api.gbif.org/v1/pipelines/history/execution/4165337/step

New IDs sample:

Old IDs sample:

BRA:UEL:FUEL:59188
BRA:UEL:FUEL:59189
BRA:UEL:FUEL:59190
BRA:UEL:FUEL:59191
BRA:UEL:FUEL:59192
BRA:UEL:FUEL:59193
BRA:UEL:FUEL:59194
BRA:UEL:FUEL:59195
BRA:UEL:FUEL:59196
BRA:UEL:FUEL:59197

Publisher email
Hello,
I am contacting you from the GBIF Secretariat about a dataset published by the FUEL - Herbário da Universidade Estadual de Londrina : https://doi.org/10.15468/6b6axv.
We noticed that the occurrenceIDs were changed. We have temporarily paused the ingestions of this dataset.
As you might already know, when an occurrence record has a new occurrenceID for a given dataset, our system considers it to be a new occurrence.
This means that it will be given a new gbifid and a new occurrence URL (like this one: https://www.gbif.org/occurrence/1252968762) and the old gbifid and URL will be deprecated.
In this case, this means that the occurrence URLs would be deprecated when ingesting the newest versions of these datasets.
We would like to check with you if those changes were intentional. Do you know if this is the case?
Please let us know, thanks! We are happy to resume the dataset ingestion.
Note that some users rely on those occurrence URLs and gbifids (like https://bionomia.net for example). In an attempt to improve
the stability of the occurrence URLs and gbifids, we have implemented a warning system to detect these type of changes in datasets (see this news item).
If the data publisher can provide us with a list of old and new occurrenceIDs per record, we can avoid the identifier and URL changes. Could that be an option?
Please let us know if you have any question. Thanks!
All the best,

You can skip/fix identifier validation using the registry UI.

Identifier validation still  failing for the dataset FUEL - Herbário da Universidade Estadual de Londrina:

Crawler attempt: 444
Publishing organization: Universidade Estadual de Londrina
Publishing country: BRAZIL
Installation: speciesLink Network / INCT-HVFF IPT
Number of occurrences indexed for this dataset at the time of the issue: 55556
Cause: GBIF ID problems exceed 50% threshold: 100% duplicates; 55558 total records; 55558 absent records
Pipelines execution steps: http://api.gbif.org/v1/pipelines/history/execution/4202399/step

New IDs sample:

Old IDs sample:

BRA:UEL:FUEL:59188
BRA:UEL:FUEL:59189
BRA:UEL:FUEL:59190
BRA:UEL:FUEL:59191
BRA:UEL:FUEL:59192
BRA:UEL:FUEL:59193
BRA:UEL:FUEL:59194
BRA:UEL:FUEL:59195
BRA:UEL:FUEL:59196
BRA:UEL:FUEL:59197

Publisher email
Hello,
I am contacting you from the GBIF Secretariat about a dataset published by the FUEL - Herbário da Universidade Estadual de Londrina : https://doi.org/10.15468/6b6axv.
We noticed that the occurrenceIDs were changed. We have temporarily paused the ingestions of this dataset.
As you might already know, when an occurrence record has a new occurrenceID for a given dataset, our system considers it to be a new occurrence.
This means that it will be given a new gbifid and a new occurrence URL (like this one: https://www.gbif.org/occurrence/1252968762) and the old gbifid and URL will be deprecated.
In this case, this means that the occurrence URLs would be deprecated when ingesting the newest versions of these datasets.
We would like to check with you if those changes were intentional. Do you know if this is the case?
Please let us know, thanks! We are happy to resume the dataset ingestion.
Note that some users rely on those occurrence URLs and gbifids (like https://bionomia.net for example). In an attempt to improve
the stability of the occurrence URLs and gbifids, we have implemented a warning system to detect these type of changes in datasets (see this news item).
If the data publisher can provide us with a list of old and new occurrenceIDs per record, we can avoid the identifier and URL changes. Could that be an option?
Please let us know if you have any question. Thanks!
All the best,

You can skip/fix identifier validation using the registry UI.


Added "feature" for desktop(advanced) and jupyter

Added "feature" for desktop(advanced) and jupyter.

Tested both the apps and they work correctly with multiple constraints.


Gulp tasks finish but the process never exits.

device        : Mac Book Pro 2015
OS            :  iOS
email client  : NA
node version  : 8.0
npm version   :  5.0
error message : NA

The gulp build process finishes but never gets exited
PFA below screenshot

It states in the README:

$ gulp # By default, HTML & CSS files in './src' will be watched for changes

In other words the process is watching for changes and if it spots one, it will re-run the build process for your convenience.
If you just want to build without watching, run gulp build


[MultiTag] Store an array of refs to currently selected tag divs

Currently
In several places in the code above we loop over refs.multiTagWrapper.childNodes to get the currently selected tags.
Problem
This is slightly messy because since #122 the multiTagWrapper div also contains the searchbox (refs.search), meaning we always need to exclude the last child.
Wanted
It might be a better idea to maintain an array of references to the currently selected tag divs: flounder.refs.tags. This would be similar to the array of option divs in flounder.refs.data or sections divs in flounder.refs.sections.

Related:

keeping an array of option divs hidden by search filter would be useful for https://github.com/sociomantic-tsunami/flounder/issues/165
likewise, an array of selected <option>’s and corresponding divs would be useful for https://github.com/sociomantic-tsunami/flounder/issues/162


Incorporate use of datasets-cli into genome prepare pipeline

Aim::
Make use of container with datasets-cli tool to pull both metadata and data file from NCBI.
Changes:

Addition of bespoke nextflow module (download_asm_with_datasets) process to work with datasets-cli, retained old module process (download_asm_data) for now.
Update nextflow config to make use of container in process with use of withlabel: 'datasets_cli'
Various updates to genome_metadata/extend and seq_region/prepare modules to align with change in assembly report meta keys
Added the latest (ok it was, now is semi latest 16.17.1) definition file for datasets-cli SIF creation
Update the test suite of genome_prepare pipeline, including data differences and MD5 checksums

@MatBarba I have tested this over, if you can think of anything else let me know thanks

inputs with and without annotation
with and without brc_mode enabled
using '-stub'

Another general comment: we're generating an assembly report file derived from the jsonl file, but it has different attributes than the usual one that we get from ftp. Then would it not make more sense to parse the json file directly (and leave the current seq_region/extend.py as deprecated/legacy to parse assembly report from ftp)?

Another general comment: we're generating an assembly report file derived from the jsonl file, but it has different attributes than the usual one that we get from ftp. Then would it not make more sense to parse the json file directly (and leave the current seq_region/extend.py as deprecated/legacy to parse assembly report from ftp)?

This would make more sense Indeed ! Basically remove the extra step of converting to TSV from seq_region.jsonl. However it does work albeit slightly extra processing overhead, the issue is loss of INSDC_submitted_name in the datasets world. If Im not mistake, this is incoming soonish is that right @JAlvarezJarreta ?


command line arguments passed via --env do not work

Operating System: Ubuntu 18.04
Node Version: 8
webpack Version: 4.16.2
webpack-serve Version: 2.0.2

Expected Behavior
env parameters should be respected and passed to webpack config.
Actual Behavior
webpack-serve ./conf.js --env.apiUrl=example.com throws:
Error: Flags were specified that were not recognized:

  --env  Not sure what you mean there

Hello jacek213,
Did you find any workaround?
Thanks

Hi,
I had a similar issue last month: if you are using webpack-command in your dependencies you will get this error because the new CLI is lightweight and doesn't contain all features of the "old" webpack-cli.
You will get more informations on the official repository: https://github.com/webpack-contrib/webpack-command#differences-with-webpack-cli.
In my case, I have splitted my configuration into multiple files and I am using npm scripts to target the file I need, like: "build:dev": "webpack --config webpack.dev.js". This is a good choice since the webpack-command allow you to extend any webpack configuration.
Hope this help. :wink:

Please don't use webpack-command (it is prof of concept) and will be deprecated and archived in near future in favor webpack-cli.

This is a very interesting and useful information, I didn't know that...
Why ? The webpack-cli don't do the job properly?
Thanks for sharing :+1:

@ppluchon as a workaround, I'm using regular ENV variables in conjunction with DefinePlugin.
// webpack config
function readENV(key) {
  const val = process.env[key]
  return val && val.length ? val : undefined
}

const API_URL = readENV("API_URL") || SOME_DEFAULT_API_URL

return new webpack.DefinePlugin({
  __API_URL__: JSON.stringify(API_URL),
})

// package.json
"start:local": "API_URL=http://localhost:3000 yarn start"

@evilebottnawi Thanks for the clarification. I totally agree with you. When I started to learn webpack, some developers of the community told me to work with webpack-command instead of webpack-cli. If the finality is to have one CLI and merge all webpack-command features into webpack-cli, I will use it for future developments. Thanks again +1

DEPRECATED. Please use webpack-dev-server (he is in support and update mode again). Feel free to create a issue if some features are not implemented in webpack-dev-server.
Why deprecated webpack-serve ?

The author stopped developing the package.
Two development servers are misleading for developers.
Hard to maintain two packages with same purpose.
Some dependencies are not available to fixes/implement new features/etc (https://www.npmjs.com/package/webpack-hot-client and https://github.com/shellscape/koa-static) and there's nothing we can do here.
webpack-dev-server is stable.

Thanks for using webpack! We apologize for the inconvenience. In the future, we will avoid such situations.


ionic android gets hang on passing options

When we pass outputType : 1 - it gets hang and sometime app restarted.
var options = { 			maximumImagesCount : 6, outputType : 1 		} 		this.imagePicker.getPictures(options).then((results) => { 		  for (var i = 0; i < results.length; i++) { 		      console.log('Image URI: ' + results[i]); 		      alert('Image URI: ' + results[i]); 		  } 		  self.uploadProductSetImages(results); 		}, (err) => { 			alert("Error in upload : " + err); 		});

I have the same issue, any advice to solve this? I am currently using cordova 8.0.0
Thanks!

me too

Btw if using outputType: 0 seems we need to clean up the temporary generated files?


all-packages: only use buildFHSEnvBubblewrap on x86

It does not support other platforms. Fixes
https://github.com/NixOS/nixpkgs/issues/227462
Description of changes

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

cc @ak2k

Sorry, obvious mistake from my side. Please test again.


Configurable scene skybox

Allow ability to change time/dark mode/background for a scene.
This could be done off of the scene tab menu; e.g. E -> scene properties

The best way to do this might be to make the skybox a prefab, and then expose its controls in edit mode.
That would work with multiplayer, be ultimately configurable, and (I think) accomplish this user feature.

Include support for equirectangular skybox images.
Skybox could be set per parcel - and/or update when within neighborhood.

Include support for equirectangular skybox images.
Skybox could be set per parcel - and/or update when within neighborhood.


Add custom path to .env file

Problem

I have a dev env file and a prod env file and I want to run Prisma cli with one of the files.
thank you Prisma team 🙌

https://github.com/motdotla/dotenv/issues/437
https://github.com/motdotla/dotenv#should-i-have-multiple-env-files

A possible workaround is the .env to be a symbolic link pointing to the .env.watever you need.


Keybinding for command notebook.selectKernel results in 'notebook.selectKernel not found' for interactive window and .ipynb files

Issue Type: Bug
(Edited the issue - I originally thought it was only for the interactive window but it appears to fail for notebooks as well)
Extension version: 2021.10.1101450599
VS Code version: Code 1.62.2 (3a6960b964327f0e3882ce18fcebd07ed191b316, 2021-11-11T20:56:38.428Z)
OS version: Windows_NT x64 10.0.19042
Restricted Mode: No
Remote OS version: Linux x64 5.4.0-74-generic
Remote OS version: Linux x64 5.4.0-74-generic

System Info

Item
Value

CPUs
Intel(R) Core(TM) i5-8350U CPU @ 1.70GHz (8 x 1896)

GPU Status
2d_canvas: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onoop_rasterization: enabledopengl: enabled_onrasterization: enabledskia_renderer: enabled_onvideo_decode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabled

Load (avg)
undefined

Memory (System)
15.88GB (6.50GB free)

Process Argv
--crash-reporter-id 89aeed25-8dc2-46ce-b17c-1f93ab95c565

Screen Reader
no

VM
0%

Item
Value

Remote
SSH: xxx.sdma.nzcorp.net

OS
Linux x64 5.4.0-74-generic

CPUs
Intel(R) Xeon(R) CPU E5-2687W v3 @ 3.10GHz (12 x 3092)

Memory (System)
58.88GB (0.53GB free)

VM
0%

Item
Value

Remote
SSH: xxx.nzcorp.net

OS
Linux x64 5.4.0-74-generic

CPUs
Intel(R) Xeon(R) CPU E5-2687W v3 @ 3.10GHz (12 x 3092)

Memory (System)
58.88GB (0.53GB free)

VM
0%

Are you trying to add a keybinding that brings up the kernel picker?

Hi, yes - the command appears in the keybindings window:

I'm pretty sure it used to work in previous versions?

We make notebook.selectKernel an API command which exists in the extension host, for the UI side, please use _notebook.selectKernel


Allowing access to tftp server.

We need to have port 69 open for reaching tftp
server during pxebooting. It's not always open.
Signed-off-by: Alexander Chuzhoy<EMAIL_ADDRESS>

Looks good, thanks - can you confirm if this is only needed when testing with real baremetal nodes?
If so we can perhaps look at adding a conditional, since we probably don't want this (or the other pxe related ports) open on a box that's dedicated to VM testing (only open on the bridge from Ironic to the VMs)

It solely depends on the OS where we run the scripts on, so we can't predict.
I didn't see it on VM based setup - simply because the port was initially open (either by kickstart or initial automated configuration).
On a manually installed BM setup this port was closed and caused issues.

Build FAILURE, see build http://<IP_ADDRESS>:8080/job/dev-tools/132/

My point is this unconditionally opens the port, including from outside the host, which is not needed in the VM case, we can just open it for the bridge device and not allow external access.
Anyway, I guess we can fix that in a follow-up, as this isn't the only place to do that.

Build SUCCESS, see build http://<IP_ADDRESS>:8080/job/dev-tools/134/


Doesn't work on Blender 2.82

Doesn't work on blender 2.82. Will be extremely appreciated if you could fixed it. Thanks!

Well, it seems this addon became useless since we created blender-xray (which is much much powerful).
So, I see the only right way to work with OGF - https://github.com/PavelBlend/blender-xray/issues/181#issuecomment-369566351
Also, I'd better archive this repo and set a link from the README to Pavel's blender-xray repo.


print timecode for each line

This adds the timecode for a give line to the output.
PS: @purdy Thanks for the initial work... VERY useful!

Thanks, @brandonjp ! :)


Add extended example of treeview

Doesn't fix some bugs, just shows another one =D
Add example of treeview with Add and Remove buttons.
Which also shows that multiactionbutton doesn't adjust PopupBox position
in case of changing it's placement.

Good movie selection! :movie_camera:


javascript_include_tag override is also needed for Rails 5

We're testing a Rails 5 app using the rails 5 branch. The only thing that we need to adjust is the Rails version comparison used to check if the javascript_include_tag method should be overridden.

Cheers!


fix: Dask was raising for scalar vs Series binary operations

closes #1685
We may need to update the PySpark returns_scalar bits based on this refactor

What type of PR is this? (check all applicable)

[ ] 💾 Refactor
[ ] ✨ Feature
[ ] 🐛 Bug Fix
[ ] 🔧 Optimization
[ ] 📝 Documentation
[ ] ✅ Test
[ ] 🐳 Other

Related issues

Related issue #<issue number>
Closes #<issue number>

Checklist

[ ] Code follows style guide (ruff)
[ ] Tests added
[ ] Documented the changes

If you have comments or can explain your changes, please do so below

thanks for your review!


[Q] How to use wandb/sweep on a computer without internet connection？

I've tried using offline mode, but it doesn't work：
(torch) wandb offline
W&B offline. Running your script from this directory will only write metadata locally. Use wandb disabled to completely turn off W&B.
(torch) wandb sweep --controller ./config.yaml
wandb: Creating sweep from: ./config.yaml
wandb: Network error (ConnectionError), entering retry loop.

controller:
  type: local
method: bayes
metric:
  goal: minimize
  name: val_loss_avg
parameters:
  batch_size:
    distribution: int_uniform
    max: 20
    min: 4
  learning_rate:
    distribution: uniform
    max: 0.01
    min: 0.0001
  lr_patience:
    distribution: int_uniform
    max: 10
    min: 3
program: train.py

2022-12-07 23:10:03 ERROR Retry attempt failed:
Traceback (most recent call last):
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/urllib3/util/connection.py", line 95, in create_connection
    raise err
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/urllib3/util/connection.py", line 85, in create_connection
    sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._validate_conn(conn)
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/urllib3/connectionpool.py", line 1042, in _validate_conn
    conn.connect()
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/urllib3/connection.py", line 358, in connect
    self.sock = conn = self._new_conn()
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7fcc03fa59d0>: Failed to establish a new connection: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/urllib3/connectionpool.py", line 787, in urlopen
    retries = retries.increment(
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.wandb.ai', port=443): Max retries exceeded with url: /graphql (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fcc03fa59d0>: Failed to establish a new connection: [Errno 111] Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/wandb/sdk/lib/retry.py", line 113, in __call__
    result = self._call_fn(*args, **kwargs)
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/wandb/sdk/internal/internal_api.py", line 210, in execute
    return self.client.execute(*args, **kwargs)  # type: ignore
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/wandb/vendor/gql-0.2.0/wandb_gql/client.py", line 52, in execute
    result = self._get_result(document, *args, **kwargs)
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/wandb/vendor/gql-0.2.0/wandb_gql/client.py", line 60, in _get_result
    return self.transport.execute(document, *args, **kwargs)
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/wandb/vendor/gql-0.2.0/wandb_gql/transport/requests.py", line 38, in execute
    request = requests.post(self.url, **post_args)
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/requests/api.py", line 115, in post
    return request("post", url, data=data, json=json, **kwargs)
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/requests/api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/dssg/home/caicandong/anaconda3/envs/torch/lib/python3.8/site-packages/requests/adapters.py", line 565, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='api.wandb.ai', port=443): Max retries exceeded with url: /graphql (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fcc03fa59d0>: Failed to establish a new connection: [Errno 111] Connection refused'))

Hi @CaiCandong thank you for writing in! You can only run experiments in offline mode, which means that it will write in your local disk and you will then be able to sync anytime you want with W&B UI. However, for sweeps this isn't possible as you can see more detailed from the diagram below, as you will need to communicate with sweep server to create the sweep_id and then the agents will need to know which hyperparameter set to use.

May I please ask what's the use case for this, and why you would like to run the sweep experiments offline? a workaround would be if you were self-hosting the W&B instance, let me know if you would need further assistance with this option.

Thanks for your answer, our lab has a deep learning cluster running in an intranet environment, so I want to use sweep offline.

@thanos-wandb is your example supposed to work on a computer without internet access?


Ballerina.lock file changes after every build

Related Issues:

Relates to: https://github.com/ballerina-platform/ballerina-lang/issues/18257

Fixed with https://github.com/ballerina-platform/ballerina-lang/pull/18401


sbt 1.4.9

@nicktelford

@nicktelford  can you merge this?

@nicktelford  can you merge this?

can you merge this? @nicktelford

can you merge this? @nicktelford

@nicktelford  can you merge this?


Changing behaviour on unsupported OS

I think the default behaviour needs changing. Please let me know what you think.

@saadrahim Is this ready to merge?

Please merge, @amdkila tested it.

HI @pfultz2,
Can you please merge this?
Saad


provide a non-decoded :path-info to ring

https://issues.jboss.org/browse/IMMUTANT-610
Adds path-info-from-req to provide a non-URL-decoded :path-info value in the Ring request map. [IMMUTANT-610]

Thanks for this! I have a few comments, but I'll add them as line comments on the diff.

@tobias  Word.  I'll adjust the code and update the PR.

Thanks!

@tobias Okay, that should do it--tests pass for both environments.
Let me know if anything else needs to be tweaked!

Oh whoops, left some unnecessary references in the immutant.web.internal.ring namespace--removing now.

Thanks. Would you be willing to also squash this down to one commit?

And rebase against master?


Subsequent runs with --diff give no result

I tried the new --diff functionality from #1430 / #1431 and found that it works nicely on the first run, but subsequent runs give no result.
To reproduce:
$ echo "import os" > main.py
$ ruff main.py --diff

gives this output
--- main.py
+++ main.py
@@ -1 +0,0 @@
-import os

Would fix 1 error(s).

as expected.
But this second call produces no output:
$ ruff main.py --diff

When I manually remove .ruff-cache it works again on the next run. I am not familiar with ruff's internals but it might be some interaction with caching.

Ah yeah, this makes sense. Will fix.

For now you can run with -n to disable the cache. (It shouldn’t be noticeably slower unless you have an enormous codebase.)

Going out in v0.0.200.


⚠ SpeakUpConference.com has degraded performance

In 1a3fec9, SpeakUpConference.com (https://www.speakupconference.com) experienced degraded performance:

HTTP code: 200
Response time: 7765 ms

Resolved: SpeakUpConference.com performance has improved in 6355c3c after 24 minutes.


TypeError: 'type' object is not subscriptable

Description
After installing toolformer with "$ pip install toolformer-pytorch", I tried to run the example.
When I call "from toolformer_pytorch import Toolformer, PaLM", I have got a type error.
Screenshots

import torch
from toolformer_pytorch import Toolformer, PaLM
Traceback (most recent call last):
File "", line 1, in
File "/home/memect/ck/workspace/toolformer-pytorch/toolformer_pytorch/init.py", line 3, in
from toolformer_pytorch.toolformer_pytorch import (
File "/home/memect/ck/workspace/toolformer-pytorch/toolformer_pytorch/toolformer_pytorch.py", line 110, in
registry: dict[str, Callable],
TypeError: 'type' object is not subscriptable

Which version of python interpreter are you using? I resolved the problem by updating from 3.8 to 3.9.  https://stackoverflow.com/questions/59101121/type-hint-for-a-dict-gives-typeerror-type-object-is-not-subscriptable

Which version of python interpreter are you using? I resolved the problem by updating from 3.8 to 3.9. https://stackoverflow.com/questions/59101121/type-hint-for-a-dict-gives-typeerror-type-object-is-not-subscriptable

Thanks. The version of python was 3.8.


[BUG] rapids4spark-version-info.properties file getting corrupted during nightly builds

A few times now we've seen corrupted rapids4spark-version-info.properties files in various artifacts.  First it was the spark313 integration tests artifact where the file was present in the jar but empty, then recently it was the spark350 aggregator artifact where the file was only 4 bytes of 0x00.

Let me re-assign to @GaryShen2008 for now. Please let me know if I could help with anything, thanks


Client Offline Analytics

What happens if the client is offline (no connection to the internet) for a short period of time? What happens to the events and collected data from within that period?
Can the data somehow pushed later, once the client is back online?
Thanks for any hints, best regards

Keep in mind that this package is a wrap of Segment.io's analytics.js package.
As far as I have testes we lose track of the user when they go offline until they come back online.
However you can manually trigger any of the events that you want by using analytics.track or analytics.page.

I'll close if you have no further questions. 😄

@arrygoo - thank you for the answer. I also thought about this, it would probably require another wrapper around this package to store all analytic events in a local storage first and push them only if the client is online, then remove them from the local storage. That way nothing would be lost.
Since you pointed me to the origins of this package I actually found an issue talking about this: https://github.com/segmentio/analytics.js/issues/358
Thanks

@preexo - Interesting. I think you're proposed solution sounds like a step in the right direction. We welcome PRs, however it might make more sense to have this feature on Segment.io's package.


Does Tag :mode really support minor mode?

(ryo-modal-keys
 ("l" left-char :mode 'hl-todo-mode)
 )
(ryo-modal-keys
 ("l" right-char)
 )

if i understand correctly, the key "l" should move cursor to the right when hl-todo-mode is disabled and to the left if hl-todo-mode is enabled. But actually it move cursor always to the right even if the hl-todo-mode is enabled.
(hl-todo-mode is just an example, other minor modes should be the same.)

Ah i figured it out, so every time i enable or disable hl-todo-mode(or another minor mode), i must eval ryo-modal-mode again, so that the keybindings can be reloaded.


[BUG] - audio buttons not showing up

I appear to have the same issue as #362, but for different reasons. The play button is clickable, but the symbol is missing and does not play audio. The volume icon is also missing. I will start by addressing the questions you asked the other user with a similar issue.

Do you see the button on this site? It's built when merged from main https://sample-castanet.netlify.app/

Yes, I do see the button on that site.

If you switch to the blue theme do you have the same issue? I can try building on my computer later to see if grey isn't working (I'm fairly certain I tested it on grey but not sure) but that would be later tonight.

I switched from grey to blue and I still have the issue.

For the record, this is how I "upgrade" the theme
(snippet of bash - full script for reference) wget https://github.com/mattstratton/castanet/releases/download/$version/castanet-$version.zip
rm -rf themes/castanet
unzip castanet-$version.zip -d themes/

I followed these instructions and updated my theme to the latest release which is 1.17.1
Despite all this, both locally and when deployed, I don't see the play buttons. I wonder if you have any ideas about what's going on. Here you can see the most recent deployment.
Any insight appreciated! Thanks
Desktop:

OS: OS X
Browser: Firefox
Hugo version: ‘0.92.2’

Okay. If I inspect my site served locally, I get an 404 not found error in response to the following request:

GET
http://localhost:4321/img/mejs-controls.svg

But the file is where it should be in themes/castanet/static/img/mejs-controls.svg

I apologize that I'm just seeing this now! I'll try to take a look tomorrow and see if I can figure out anything that looks squirrelly.

I noticed in your config file for Hugo that your baseUrl does not end in a "/"...That can cause some issues with this theme (to be honest I don't know if this is one of them, but it might affect how some assets get loaded?)

Closing this issue. Please re-open it if needed.


docs: migrator for KeptnEvaluationProvider -> KeptnMetricsProvider

Fixes: #845

can't find this file

Hello @Nitishupkr, I am not sure I understand. Which file are you having problems to find?


Restructuring and Redocumenting

I am extremely interested in this project. I have spent the last year and a half or so running into and trying to solve the exact issues that Starfish is built for. Unfortunately, it seems like the overall maintenance of the project has diminished in the past years. The documentation ends abruptly and the scripts, in my opinion, are not clear to follow or a necessarily pythonic solution.
I was wondering who would be currently interested in some active maintenance. With python 3.7 we can use data classes, there is also an emcee 3.x version that I've messed around with a bit and quite enjoy, and I'm sure there are other small tweaks that can be made to improve usability/performance. I think some large-scale restructuring could greatly improve the usability of this project. It seems like most people stop at using grid_tools and don't use the rest of the project, which is really where the methods shine. In parallel with this restructuring, the documentation needs to be written so that any user can come along and read through the documentation start to finish and be able to analyze some data, whereas currently it cuts short and skips to the cookbook, which isn't a strict working example. In addition, there are some files hanging around, like the attic folder and the notebooks that seem extremely out of data and more part of the personal project rather than part of the code as a package.
As I said, I'm extremely interested in this project and could easily put 10+ hours a week into some open-source development including planning and possibly phone meetings, but I have very little experience with this project and would definitely benefit from some more senior open-source devs. I propose we find some people who can work together and try organizing and polishing off this project, and putting it in a much more accessible state for future astronomers. This would also help close a bunch of open issues that are people just trying to get off the ground but running into issues, which would be another great benefit.

I'm really excited to hear that you are interested in this project! You are right that maintenance of the core package is perhaps not as regular as we might like it to be. That's both from lack of time, but also the fact that there are many possible problems in spectroscopic inference and it's somewhat daunting to choose a target case to specialize towards. Perhaps this it is for this reason why the grid_tools.py component of the package has been one of the more popular---it's just a set of functions that users can adapt as they need, rather than an end-to-end solution. As a future roadmap, perhaps bringing more elements of the package into this "set of tools" functionality rather than an end-to-end solution will make the package more robust for prospective users. I think an under-appreciated element of the codebase that could use this same treatment is the spectral emulator.
We would be more than happy (extremely grateful) to accept pull requests bringing the code up to date (or we can add you as a collaborator to the repo, if that's easier). If you're interested in future directions/explanations of why things are coded the wacky way they are :), we can set up a more lengthy chat (via email/skype etc, my email's in my profile). The issues list probably gives a pretty good summary of potential ideas that we've been discussing, so it might be worth using this as a meta-issue to discuss potential directions, to keep everyone who may be interested (@gully @jason-neal) in the loop.

Thanks for the response, I guess I'll go ahead and write out what kind of changes I think would be beneficial.
Overall I think the usability needs to be taken from the scripts and put into the code. I've worked a little bit on one such implementation where I take the optimization code for the PCA weights and actually put them into the PCAGrid class. This means somebody can follow along in the documentation and when its time to optimize, instead of using
$ python pca.py --optimize=fmin

it would be more like
[1]: from Starfish.emulator import PCAGrid
[2]: pca = PCAGrid.open()
[3]: pca.optimize(method='fmin')

This way users can make their own scripts instead of relying on the ones in the repository, although we can easily take this functionality and have scripts for people if they want to use them. The scripts in pca.py would then look like
if args.optimize == 'fmin':
    pca = PCAGrid.open()
    pca.optimize(method='fmin')

if args.optimize == 'emcee':
    pca = PCAGrid.open()
    pca.optimize(method='emcee')

You can see an example of this reimplementation of the optimize methods into the PCAGrid class on one  of my branches here. Do you think this is a good way of restructuring the code? I basically just want to move functionality from the scripts into the core package, which may also require some small refactoring in the core package to better encapsulate the code.

Moving functionality from the scripts into the codebase sounds like a great improvement to the organizational structure, and I'm a big fan of your suggested changes. If you'd like to put this into a pull request, that would be great. Feel free to change aspects of core internals as needed to make it work, as well.
In general, it might be nice for us to copy some of the organizational structure of Dan Foreman-Mackey's new exoplanet code. No scripts, just API's and plenty of tutorials to orient users. This seems like a more sustainable approach moving forward and actually exposes more of the package for people to use.
One side note about the emulator: the main reason why training takes so long is that the current, more sophisticated implementation is set up to infer the covariances between the eigenspectra weights. This results in more accurate reconstructed spectra, but I'm not really sure it's a significant improvement in the end, given the shortcomings of most synthetic spectra. Previous implementations of the emulator, which used a completely independent Gaussian process for each eigenspectra weight, were much faster to train. If this is something that users would find helpful, we could try to provide two versions of the emulator, though it might take some effort to dig it out of the github history.

The exoplanet code looks really good. I see that it is contingent on PyMC3 rather than emcee. I'm curious if you know what kind of differences there would be in performance for this code from those two packages. I'm familiar enough with both of them and PyMC3 has really nice auto-diagnostics and model creation, but I'm curious if the samplers would be much slower than the emcee sampler. It's also worth noting that I believe PyMC4 is under development and is switching from the Theano backend to TensorFlow, I believe. Do you have any ideas if you want to stick with emcee or would rather use PyMC3?

For the purposes of Starfish, we really only extend the base Metropolis-Hastings emcee class into a Gibbs sampler. We used emcee because it has a nice object oriented class interface, but there really isn't a strong reason why Starfish needs to depend on emcee (it doesn't used the Ensemble Sampler). I should note that @gully has extended a version of Starfish which does use the Ensemble Sampler to sample each order of an echelle spectrum independently. It's not possible to use the Ensemble Sampler within a Gibbs framework (as far as I know), and so there is a tradeoff of keeping the number of parameters small and doing each order independently, or sampling multiple orders at a time and tuning the mass matrix for the MH sampler.
It may be worthwhile thinking about whether it makes sense to adopt PyMC3 and/or PyMC4 when it's available. I haven't thought too much about how to calculate gradients of our likelihood, but I imagine it is possible. If we are able to do that, then switching to something like PyMC3 probably makes a lot of sense. This may ended up being a lot of work to implement, however.

On a different note, @iancze would you be able to look through the code and see what stuff can be removed? I'm thinking the attic directory, data, notebooks, plots, and any old code from scripts and tests. There's also ez_setup.py that looks unused. If we can take all that and copy it to a server somewhere and then clean out the repo I think that would help a lot.

Lots of good stuff here, I am jazzed to welcome new developers!
Let's consider tagging the existing repo with a release so that extant users can come back to the pre-overhaul days easily.

Re: samplers and emcee--- indeed, the spectral inference part of Starfish uses Metropolis Hastings with a Gibbs Sampler, as described in the paper.  I modified the framework to fit all stellar and nuisance parameters simultaneously with emcee, chunking by spectral order, and discarding the blocked Gibbs sampler part.  The main motivation for this change was to avoid the manual tuning of the Metropolis-Hastings, and gain some resilience to model imperfections for high resolution, high-bandwidth spectra.
I think Ian's point about exoplanet was to bring in some best practices for API design architecture and documentation rather than mimic its sampling strategy (which is a great sampling strategy though).  Other samplers and performance improvements have been considered--- I've thought about PyTorch to accelerate the Gaussian Process matrix solves with GPUs, for example.  Similar benefits from gradients with TensorFlow or PyMC3/4 would be great too.
We could use a compass to help guide which directions to go in-- Performance, documentation, testing, infrastructure, usability, and scientific extensions could all stand to be improved.  I've made some poorly documented scientific extension in my fork.  At some level, any improvements are good and welcomed, and we aspire to remove any barriers to experimentation and contributions.  The proposed changes are large enough and backwards incompatible enough that it may be worth considering a bifurcation---either a new version, or new branch, perhaps---to encourage experimentation.  For example, we still want to maintain reproducibility of the Czekala et al. 2015 results as they existed in the paper.  Should we move that content to a "legacy" branch, so that master can be overwritten with the new fancy changes?

I think the easiest method is to mark the state as a release and prepare a
version 3 as a release candidate. That would allow pypi upload and we can
develop on feature branches off of develop and merge tested features from
develop into master. Also that keeps the documentation in logical
increments with master and the releases
On Mon, Dec 10, 2018 at 3:49 PM gully<EMAIL_ADDRESS>wrote:

Re: samplers and emcee--- indeed, the spectral inference part of Starfish
uses Metropolis Hastings with a Gibbs Sampler, as described in the paper. I
modified the framework to fit all stellar and nuisance parameters
simultaneously with emcee, chunking by spectral order, and discarding the
blocked Gibbs sampler part. The main motivation for this change was to
avoid the manual tuning of the Metropolis-Hastings, and gain some
resilience to model imperfections for high resolution, high-bandwidth
spectra.
I think Ian's point about exoplanet was to bring in some best practices
for API design architecture and documentation rather than mimic its
sampling strategy (which is a great sampling strategy though). Other
samplers and performance improvements have been considered--- I've thought
about PyTorch to accelerate the Gaussian Process matrix solves with GPUs,
for example. Similar benefits from gradients with TensorFlow or PyMC3/4
would be great too.
We could use a compass to help guide which directions to go in--
Performance, documentation, testing, infrastructure, usability, and
scientific extensions could all stand to be improved. I've made some poorly
documented scientific extension in my fork. At some level, any improvements
are good and welcomed, and we aspire to remove any barriers to
experimentation and contributions. The proposed changes are large enough
and backwards incompatible enough that it may be worth considering a
bifurcation---either a new version, or new branch, perhaps---to encourage
experimentation. For example, we still want to maintain reproducibility of
the Czekala et al. 2015 results as they existed in the paper. Should we
move that content to a "legacy" branch, so that master can be overwritten
with the new fancy changes?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/iancze/Starfish/issues/103#issuecomment-445987153,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ANckA1HZK1lVWSvksj7eMR4LbfFLOyxHks5u3tcAgaJpZM4ZJgPO
.

--
Iowa State University Class of 2019
B.S. Physics; Astronomy, Computer Science
Theta Delta Chi

Thanks for all the good ideas. How about this for a plan of action (@gully @mileslucas )?

Tag the current repo master branch as v0.2.1 and make a release. Upload this to Zenodo and maintain a link to it somewhere on the docs as representing the code circa Czekala et al. 2015
Create a new develop branch, which can serve as the v0.3.0 release candidate (we can call it something else if you prefer)
I'll start merging @mileslucas 's pull requests on that branch (so far the changes look excellent to me, thanks)

Regarding deleting some of the cruft from the repo (once I've archived it elsewhere)

I agree attic/ can go. This does hold some useful code snippet ideas from things that didn't make it into the paper (for example, marginalizing over the Chebyshev coefficients), but it can live elsewhere.
notebooks/ contains the code for generating the figures in the paper. I think there is an argument to be made for reproducibility's sake to keep these in the repo next to the code, however, even the current version of the repo has diverged enough from when the plots were made that these scripts likely wouldn't run without a few hangups. If we can keep these in that same Zenodo repository as the v0.2.1 branch, then maybe this is a good compromise for cleaning up the repo.
data/ can go, but I do think it would be nice to continue to the WASP-14 and Gl51 datasets with the code, somehow. If this means uploading them to Zenodo and linking back, then that's also a solution.
scripts/ can eventually go, provided we migrate the good parts of this material into the core package, as you've done with emulator. At the same time we're tearing down scripts/ we'll also want to be building up/editing the tutorials.
tests/ I think this directory should remain, but we can remove all of the tests that are extraneous (and hopefully write new tests for the new API).
ez_setup.py it seems to me like this is an outdated way of installing packages these days, eh? In that case it can go too.

See my pull request for the config and setup, this cleans up

:+1: Ian's proposed scheme for updating.
Zenodo is a good destination-- a long-lived storage solution that could house all of these paper-related and heritage documents in one place.  I seem to recall they do not support directory structure, so a tarball could suffice, except for the data that would have to be programmatically accessed if it's removed from the repo as Ian described.  A main virtue of putting things on Zenodo is they are citeable through a DOI.


netbox: 3.5.8 -> 3.5.9

Description of changes
https://github.com/netbox-community/netbox/releases/tag/v3.5.9
Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

LGTM 👍🏽

Did you test it on your production?

I didn't test it in production but I ran it in staging, and worked well

Result of nixpkgs-review pr 252852 run on x86_64-linux 1

1 package built:

netbox

Result of nixpkgs-review pr 252852 run on x86_64-linux 1

1 package built:

netbox


Update Travis CI schema

Mimic the .travis.yml laid out in this PR to pysal/pysal for updated and streamlined procedure.

Addressing via #308


Update ChromeDriver from 91.0.4472.19 to 91.0.4472.101

Description
Chromium introduced a significant regression in 91.0.4472.19:
https://bugs.chromium.org/p/chromium/issues/detail?id=1205107
This was fixed with 91.0.4472.101
Question, Bug, or Feature?:
Bug
Virtual environments affected
All
Image version
20210607.1 (depending on plattform)
Expected behavior
Please update ChromeDriver to 91.0.4472.101

Hello, @christophs78
ChromeDriver will be updated at the next image rollout in a week or two.

@christophs78 the new images were deployed.
I'm going to close the issue, please feel free to contact us if you have any concerns.
Thank you!


Add new testcases to increase code coverage

Hey, I am new to this testing field, can you elaborate a little . I can work on this if you permit.

Hey, I am new to this testing field, can you elaborate a little . I can work on this if you permit.

you should check the file inside tests, As you can see we are validating only one API response get_videoinfo
https://github.com/Agent-Hellboy/pyytdata/blob/master/tests/test_util.py#L16
we should validate all other API responses
you can check this article to know more about python unit test
https://www.digitalocean.com/community/tutorials/how-to-use-unittest-to-write-a-test-case-for-a-function-in-python

yes , I got to the source file . So the API responses are the get_links(), get_description() , and others. Am I right? I have to validate that in the tests_utils.py . But I dont know how exactly to do this.

yes , I got to the source file . So the API responses are the get_links(), get_description() , and others. Am I right?

Yes get_links(), get_description() these are the APIs you have to validate responses of these APIs
I have to validate that in the tests_utils.py. But I don't know how exactly to do this.
Yes, read the article I share with you.

def test_get_description(self):
not sure bout the body of the function and on what basis I can validate. In the article , they had a list to validate upon. (Sorry for all this query , I am pretty new to this.)

not sure bout the body of the function and on what basis I can validate. In the article , they had a list to validate upon. (Sorry for all this query , I am pretty new to this.)

Yes, that's the trickiest part, take some time, and play around with the package you will get some idea if not I will share some pointers with you tomorrow.

Can you assign it to me , I will work around it at evening or midnight. I have exam tomarrow so need to prepare for that as well. I will surely solve this issue.

@Agent-Hellboy I got some idea about unnitest . And some assert methods as well. The responses will be mostly a type of string. for example if we take  get_description()  ,it should be a kind of string ,checking if the description is null or not will be enough?
or should we check assertIn() to compare with some sample data.
  def test_get_videoinfo(self):
        self.assertTrue(len(self.rslt) == 1)
``` I do not understand this part though .

class TestPyYtData(unittest.TestCase):
    def test_check_env(self):
        self.assertTrue(os.environ.get("API_KEY") != None)

    def setUp(self):
        self.data = PyYtData("flask", 1)
        self.rslt = self.data.get_videoinfo()

    def test_get_videoinfo(self):
        self.assertTrue(len(self.rslt) == 1)

Here you can see we are querying Youtube data v3 API with flask keyword which is just like searching on youtube and parameter 1 means we want only one result, self.data is VidInfo object you can add a print statement and check these things. As self.data is Video Info it has some methods like get_videoinfo and several other https://github.com/Agent-Hellboy/pyytdata/blob/3e70e427d7c3c8bf0c799819bc4e8ab12be78840/pyytdata/util/vidinfo.py#L46
Like Video Info we have other classes like Channel Info you need to add test cases for methods of these classes
I will suggest you read the article I have shared, and watch some videos also.
self.assertTrue(len(self.rslt) == 1) here we are validating whether we get one videoinfo object which we have requested in setup method.


new hooks for bulk handling

When using dns-01 challenge and several certificates in a single DNS zone are to be created/renewed there are more serial bumps involved than theoretically needed. Consider certs for A.example.org and B.example.org are to be created/renewed. Then
the deploy_challenge handler is invoked twice -- once for each domain. In the first invocation it's not known to the hook if another one follows, so the DNS update for the first domain needs to bump the zone's serial and trigger a notify to the slaves. This is also an issue if the serial is based on the current time (seconds since epoch is a usual scheme used here) and the two updates are triggered in the same second. Also the first invocation has to block until all secondaries are updated, just to wait a second time in the second invocation.
However in a bulk_deploy_challenge hook all challenges could be passed together and then only a single serial bump + notify (per domain) + wait would be needed.
Symmetrically for clean_challenge.

This sounds a lot like what HOOK_CHAIN already does, which for deploy/clean challenge hooks, supplies a list of all host names and they tokens, one hook call per cert, instead of per challenge.
See docs/hook_chain.md for more information.

Just to be clear: HOOK_CHAIN sounds nice and goes in the right direction, but it's less than I suggested. Default behaviour is one call per challenge, HOOK_CHAIN reduces that to one call per certificate, ideally I'd want one call overall.


Send custom token-id in header for all trace & log getting send

please help!! How we can send custom token id in header whenever there is traces and logs getting sent to collector. like we are setting endpoint.

@tech-ind-02, you can add a custom header like this in the span/log exporter -

Thanks @ddas09 that's totally the intended API. @tech-ind-02 I'm going to close this for now, please reopen if that answer doesn't work for you or if you would like to continue discussing.


Extend with geocoder

Hi! 👋🏽
First, thank you for this input. I've been using and enjoying it a lot.
I was wondering if you'd be open to extending this plugin, adding support to a geocoder plugin.
In this video you can see what the result would be like.

@rexxars, ping.

@rexxars, ping.

Hi!
I'd love a geocoder, but I'm not sure I have time to follow up very thoroughly right now - if you're able to make it work mostly on your own, I'd be happy to take a look at a PR!

Hi!
I'd love a geocoder, but I'm not sure I have time to follow up very thoroughly right now - if you're able to make it work mostly on your own, I'd be happy to take a look at a PR!

@rexxars, PR submitted 😉

@rexxars, PR submitted 😉


Add support for Fulcio to rekor-monitor identity workflow

Summary

Per this doc, this PR refactors the identity monitor portion of rekor-monitor to support monitoring a Fulcio CT log instance for any monitored identities, notifying via any of various notification platforms.
This PR depends on #526 and #527.
Release Note

Rekor-monitor is now capable of monitoring certificate transparency log instances
Documentation

#TODO: Update readme

changes in #526 render this PR more convenient to close- another PR will add these changes via a separate ct_monitor.go file


[HOLD for payment 2024-03-19] [$500] Approving a report causes the workspace chat to “flash” in the LHN before disappearing

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: 1.4.32-2
Reproducible in staging?: y
Reproducible in production?: y
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Expensify/Expensify Issue URL:
Issue reported by: @JmillsExpensify
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1706304456007449
Action Performed:
Make sure user A (submitter) and user B (approver) on a workspace with scheduled submit (e.g. delayed submission)
Have user A create a request via Request money
Have user A submit the report
As user B, user A’s workspace chat will show unread in the LHN
As user B, tap into user A’s report, approve it
Expected Result:
The workspace chat will flash unread, with GBR in the LHN, before disappearing shortly thereafter.
Actual Result:
The workspace chat shouldn’t flash unread in the LHN, with GBR applied
Workaround:
unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android: Native
[ ] Android: mWeb Chrome
[ ] iOS: Native
[ ] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos
Add any screenshot/video evidence
https://github.com/Expensify/App/assets/38435837/05f89d40-6d3a-4ad7-8896-79c366c3d6f9

View all open jobs on GitHub
Upwork Automation - Do Not Edit

Upwork Job URL: https://www.upwork.com/jobs/~0175776c123c4a6522
Upwork Job ID:<PHONE_NUMBER>555020800
Last Price Increase: 2024-01-29
Automatic offers:

situchan | Reviewer | 28142958
tienifr | Contributor | 28142959

@tienifr's proposal looks good to me.
🎀 👀 🎀 C+ reviewed

Proposal looks good

PR is in review

@situchan @tienifr can you recommend a regression test

Both are paid up

Regression Test Proposal
Prerequisites: Make sure user A (submitter) and user B (approver) on a workspace with scheduled submit (e.g. delayed submission)

Have user A create a request via Request money
Have user A submit the report
As user B, user A’s workspace chat will show unread in the LHN
As user B, tap into user A’s report, approve it
Verify that the green dot disappears immediately if there's no more IOU to approve/pay and that row doesn't flash in LHN

Done


Key Vault name too big when resource prefix uses 10 characters

The name when using the max length of each naming component uses 28 characters. Key vault names may only be 24 characters long. Using a 1 letter abbreviation for the "resourceSuffix" can reduce that value to 25 characters. Using a 1 letter abbreviation for the "name_token" can reduce that value from 25 to 22 characters. We could also consider dropping the hyphens if having the full value for one of the previously mentioned components is desired.

Another option is dropping the max length on the resource prefix from 10 to 6 characters.


Case of use: variables

i am using this extension to enable user insert variables in the following format: {variable}. So thats why i have to use a CustomMentionComponent to be able to render the brackets '{}' before/after.
However whenever I save or copy the value in the clipboard, the value that is being saved is still __trigger+__value, which would result {mentionItem .... can this be replaced?

Hi @tecoad, I think you need to implement your own CustomMentionsNode and override the getTextContent method: https://lexical.dev/docs/api/classes/lexical.LexicalNode#gettextcontent. Follow the first example in the README to create your own CustomMentionsNode class.

After some digging, I found out that it makes a difference if I select the whole text in the editor including the mentions and copy it to the clipboard or if I select a single mention and try to copy it to the clipboard. Selecting and copying a single mention does not work at the moment. I will try to fix this in the next release.

I have just impleented the CustommentionNode, i was using the helper class previously.
In my case both selected whole text and one mention node is working.
Thanks for this great plugin.
Closing this issue for now.


[Ingress nginx-third-party] Allow using Ingress resources without host specified

it's can be useful for acme request of lets encrypt :) :+1:

@codablock where are you setting paths = config["_"]?
If no host is found in the configuration it will return the default page 404 configured behind the mandatory flag --default-backend-service

@codablock please check the latest version gcr.io/google_containers/nginx-ingress-controller:0.61. It allows Ingress rules without hosts.

@aledbf Not sure when I'll get some time to test, but if you believe my PR is obsolete with the new version, I'm happy to close it :)


UUID parsing in batches

https://github.com/Nugine/simd/issues/24#issuecomment-2249247581

@pickfire What is the format of a uuid column? Do you need another SIMD api in uuid-simd?

I have yet to need this myself. I guess something that could be integrated into https://github.com/pola-rs/polars/issues/7175? Maybe can communicate with the developers in polars?


Number format and data sorting (e.g. years) in the xls download

Currently the data downloaded in xls

are not sorted as in the graph (e.g. the years are not sorted chronologically)
have a "standard" format. The user has to reformat them if he wants to make a graph in excel.

When downloading, the order of data and Data Format must be kept. In particular, numbers must be exported as number.

Tested with this chart: https://test.visualize.admin.ch/v/eaJr-s6bZOv6?dataSource=Int

CSV sorted by date
Excel Sorted by date
In Excel the values appear with a green notification indicating the number is stored as text

This issue can be solved by double clicking in the cell or selecting all values and using the excel prompt to convert values to numbers

Hi @sosiology, thanks for testing!
The current approach is to keep dates as strings, even when their resolution equals Year. We can change this to convert dates to strings only when they're not yearly dates – let me know what you think about this.
For the Hierarchie dimension, we can't really do a lot, as it's marked as NominalDimension, without a numerical data type (it's simply marked as string dimension in Cube Creator) – so it appears as number in the export, but technically shouldn't be treated like one, at least according to the metadata 👀

@bprusinowski tested by BAFU and approved 🎉

Nice! 🎉


Provide filename customization api

Provide filename customization API.
name: 'posts',
path: 'content/posts',
ui: {
     filename: {
        slugify: (values) => mySlugifyFunc(values),
        disabled: true
        // other field props like `label`, `component`, `parse` can still be used too
      }
},

If one is using isTitle a default slugify function is added that slugifys the title.

@kldavis4 Just pushed up a changeset. Mind approving again?

@kldavis4 Sorry had to resolve conflicts going to need a ✅ One more time.