Add scaffolding to enable snap build of commento

Thanks for making commento! It's a great compliment to other free software tools that I already use like Nikola for static site generation. I look forward to being able to migrate away from disqus! :)
This prototype PR adds the configuration and support files to generate a snap of commento. Snaps can be installed on multiple Linux distributions, are secure, and can be updated by the developer on their own cadence. Once landed, you can go to http://build.snapcraft.io/ and have it build and publish commento automatically to the edge channel in the store on every commit to master. Once published, users can install the latest build with snap install commento --edge. When you're ready to release, you can can release to the stable channel, where users can easily install in the same way, omitting the --edge parameter. You can find out more about snaps at http://snapcraft.io/
To test this PR on an Ubuntu 16.04 machine:-
$ sudo apt install git snapcraft
$ git clone https://github.com/popey/commento
$ cd commento
$ git checkout add-snapcraft
$ snapcraft
$ sudo snap install *.snap --dangerous

(the --dangerous part is just because it's an unsigned package built locally rather than from the store).
I had to wrap commento in a little script so that it could find the web assets and put the sqlite3 db in the right location.

Hey @popey - thanks for the PR! I'm just finishing up for today (it's pretty late where I'm at), so I'll look into this tomorrow :)

Hi @adtac. Any luck with this? I can confirm locally that this builds, installs, and runs without issue. It'd be great to see commento available in the Snap Store.

@gitmate-bot rebase

@evandandrea hey there! I tried out snap on a Ubuntu 16.04 VPS and this is pretty neat. However, is there any way to install npm and build the frontend minified files? That is, currently, with this snap config, the server can only serve commento.js and commento.css files. However if you install npm and do a npm install followed by a npm build, two minified files will be generated. Commento will automatically serve these files.
I was just wondering if it's possible to build this into the snapcraft. You can see the Dockerfile for hints.
CC @popey

It's just that the project has changed a lot since the time this PR was made (with how the frontend is built and stuff).

Yes. This works for me:
name: commento
version: git
summary: A lightweight, open source, tracking-free comment engine alternative to Disqus
description: |
  An open source, lightweight, and tracking-free comment engine.

grade: stable
confinement: strict

apps:
  commento:
    command: launch_commento
    plugs:
      - network
      - network-bind

parts:
  scripts:
    plugin: dump
    source: snap/scripts
    organize:
      'launch': bin/
  assets:
    plugin: nodejs
    source: .
    npm-run:
      - build
    build:
      cp -r assets $SNAPCRAFT_PART_INSTALL
  commento:
    plugin: go
    source: .
    go-importpath: github.com/adtac/commento
    build-packages:
      - build-essential

Cherry-picked with a few modifications and rebases here: https://github.com/adtac/commento/pull/123
(Commit author information is intact.)


Use Spree Starter to run e2e tests

Is your feature request related to a problem? Please describe.
The latest version of Spree, 4.2.1, removes the Docker configuration from its repository in favour of https://github.com/spree/spree_starter. The e2e tests in the Spree SDK rely on the old Docker configuration included with Spree. In order to test the Spree SDK reliably, we should switch to Spree Starter as well.
Describe the solution you'd like.
Integrate Spree Starter with the Docker Compose configuration used to run e2e tests in the Spree SDK.
Describe alternatives you've considered.
Copy the old Docker configuration from old Spree versions and run the newest Spree version using it. Would require more maintenance than relying on Spree Starter which already contains what's needed. Also, switching to PostgreSQL from SQLite, which Spree Starter does, creates a more production-like environment during testing. SQLite doesn't have the exact same features as PostgreSQL and is less reliable.
Additional context
-

https://github.com/spree/spree-storefront-api-v2-js-sdk/pull/235

The temporary sparksolutionstom/spree-storefront-api-v2-js-sdk is no longer used and will be removed from Docker Hub Sept Fri 10th 2021.

https://github.com/spree/spree-storefront-api-v2-js-sdk/pull/256/files


Using swarm template with 3 managers / 2 workers

When running a swarm with this template, I only get 2 instances in the list on the left.
Running  docker node ls shows the 5 nodes though.

I was to quick to submit the issue, a refresh fixed the thing.


Fixes AverageTrueRange indicator

Description
Since the first value of AverageTrueRange is the mean of TrueRange of the warm up period, we have introduced a SimpleMovingAverage that handles that calculation. Its value (Current.Value) is used to set the smoothing function value
Related Issue
Fixes #1722
Motivation and Context
Review indicators that do not obey its definition.
Requires Documentation Change
No.
How Has This Been Tested?
Unit tests.
We have added a new unit test for the case where AverageTrueRange is smoothed by Wilder's moving average.
Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Non-functional change (xml comments/documentation/etc)

Checklist:

[x] My code follows the code style of this project.
[x] I have read the CONTRIBUTING document.
[x] I have added tests to cover my changes.
[x] All new and existing tests passed.
[x] My branch follows the naming convention bug-<issue#>-<description or feature-<issue#>-<description>

Replaced by #1730.


keychain or other secret store access when run in docker?

Expected Behavior
when run in a docker container, gimme-aws-creds keeps asking for the okta password. naturally it has no access to the keychain store of the host OS (MacOS in my case), but Docker Desktop has a secrets store built into it. Is this an interface that needs to be written or a missing setup stage?
Possible Solution
add support for the Docker Secrets Management and setup steps.
Steps to Reproduce (for bugs)

set up native gimme
login and store pass in keychain
setup gimme in docker
note running gimme asks for the password again on ever run, offers no store option

Your Environment

App Version used: 2.4.4
Environment name and version: MacOS (via Brew) vs dockerfile (built from latest source)
Operating System and version: MacOS 12.3.1, Docker engine v20.10.8

I solved this problem by using keyrings.alt. Just be careful not to build/push a public container with your keyring. You can also use docker/docker-credential-helpers which I am told works well.


Fixes compile error caused by Flag without serde

If the serde feature isn't enabled then Flag doesn't exist and the crate doesn't compile successfully. This PR fixes it by applying the same feature requirement on the public reexport of Flag in the mod.rs

@meh wondering if this could be looked at in the near future


Payment API

Hi
This would be a feature request, but perhaps it's out of scope but maybe you can recommend one that would play nicely?
Thanks,
Jorge.

Hi,
Sorry, been a while since I have looked deeply into payment APIs. There always was Stripe, which played pretty nicely with APIs, Square, PayPal, even Amazon and Google.


Support testing ClusterFlow

The same logic used to test Flows should be used to test ClusterFlow.  Considerations will need to be made when selecting a namespace.
resourceVersion

version: a6b2fa1
observed crd accepted with clusterflow configured.


it doesn't start

Confirmation

[ ] I have tested the bug without Sodium and Indium.
[X] I have kept all my mods up to date.

Bug Description
I don't know what it depends on but as soon as I start Minecraft the game doesn't open and I get this warning

log.txt
Steps to Reproduce
No response
Mod Version
No response
Minecraft Version
MC 1.21
Attach latest.log
No response
Attach Crash Report
No response
Additional Information
No response

Yes same issue with indium... :D

Duplicate of #324, i think

Duplicate of #324


col_types missing from read_csv() but present in docs

col_types appears to be missing from read_csv() but present in the docs: https://tidierorg.github.io/TidierFiles.jl/latest/reference/#TidierFiles.read_csv-Tuple{Any}
Tangential: it would be awesome if we can pass through some of the other options present in CSV.read like normalizenames, etc.

Hmm idk what happened there but we can def add support for both.
Just wondering when using r, what for your ideal col_types use look like? It's not one I frequently have used

I've actually never used Tidier in R, only Tidier.jl because it's awesome. But I frequently use col_types when dealing with data with leading zeros: it gets interpreted as Int which strips the leading zeros so you can't fix it after reading it in. Should be able to pass to CSV.File: https://csv.juliadata.org/stable/examples.html#types_example
Would it be easier to have a helper function to interpret passing through the various extra arguments CSV.File can take?

Oh wow, I love that.
So basically, if I'm understanding correctly, there are times when you need to specify the column type you are reading for a select couple columns?
It might be easier to have a helper function.
I'm open to any approach really.
If you have a plan in mind, feel free to give it a spin, if not i can piece something together

Alright, with v.1.6 all the features you requested should be available.
I'm going to close this issue for now but plz reopen / open a new issue if there's anything not working / something else you need.


Insecure (or at least very unusual) key generation

Just having a dig around this project, after reading your interesting blog post.
I noticed this code in main.py:
  def generate_random_key(self):
    password = b"<USE_A_SECURE_RANDOM_PASSWORD_HERE>"
    salt = os.urandom(16)
    iterations = 20000
    key_len = 16
    raw_key = hashlib.pbkdf2_hmac('sha1', password, salt, iterations, key_len)
    ascii_key = self.line_ending_stripper.sub("", base64.b64encode(raw_key).decode('ascii'))
    return ascii_key

PBKDF2 should be used when turning a user-supplied password into a key of a suitable length.
If you want to generate a random key, just use os.urandom(16) (or whatever length you need). It is more secure.

Thank you for this. I'm sure you are quite right. Fixed in 84ed040b1827392c853fa4d1f70c3410d76f7eaf


Revert "improvement Switch meta serialization to gson 2 (#36311)"

Proposed changes
This reverts #36311
This reverts commit e32d69f07fa57b4aebeb3b57f40f60fa9afa5538.

run buildall

run p0


C# Wrapper (no issue)

Just an information
I've just started a little experiment which uses gmusicapi in IronPython and makes the functionality available in C#. Its called gmusicapiCSharp.
Maybe someone is interested in it

Nice! I'll add it to the ports page when I have a chance.


Problem encountered in step3

Problem encountered on https://dotnet.microsoft.com/en-us/learn/dotnet/hello-world-tutorial/install
Operating System: windows
Provide details about the problem you're experiencing. Include your operating system version, exact error message, code sample, and anything else that is relevant.

@ninjxa what's the problem?


Docs: We should include generated docs from dbt on the docs site

What is the improvement or update you wish to see?
Not entirely sure if we can make this match our docs website but it would be great to have the DBT docs automatically published on the docs website
Is there any context that might help us understand?
dbt can generate docs for the models (this is only useful if we actually have the schemas listed)
Does the docs page already exist? Please link to it.
No response

@ravenac95 to setup the initial scaffolding, but please hand off to Carl ASAP for polish / refining

Let's setup a Cloudflare pages at
https://models.opensource.observer
Setup a gitHub actions workflow to publish/deploy

build command here
https://github.com/opensource-observer/oso/pull/1507

Deploy job here
https://github.com/opensource-observer/oso/pull/1519

Fix: using BQ credentials here
https://github.com/opensource-observer/oso/pull/1520

Using indexer environment here
https://github.com/opensource-observer/oso/pull/1523
Fixing workspace error here
https://github.com/opensource-observer/oso/pull/1524


x11rb-async async functions should have #[must_use] attributes

It is easy to forget to .await an async fn, and without a #[must_use] attribute, you won't get a warning for forgetting to do so.

This should probably go for cookies too actually.

My first thought is "this is not x11rb-async specific, but should rather be a rust ecosystem thing", but I cannot find much compiler or clippy lints that would warn about this. The closest I found are https://rust-lang.github.io/rust-clippy/master/index.html#/let_underscore_future and https://rust-lang.github.io/rust-clippy/master/index.html#/unused_async but neither would exactly hit this case.
Actually... the Future trait is marked must_use, so shouldn't that already be enough for a warning? I'm not sure.
But I just tried this and I couldn't get a warning. conn.query_tree(window); doesn't do anything. At least conn.query_tree(window).await; generates a warning due to the Result. conn.query_tree(window).await?; then again doesn't warn. With conn.query_tree(window).await?.reply(); I finally get warning: unused implementer of Future that must be used. conn.query_tree(window).await?.reply().await; again warns due to the unused Result.
Ahh, query_tree does not return a Future, but a Pin<Box<dyn Future<....>>>. That's why there is no warning here. x11rb_async::protocol::xproto::query_tree(conn, window); also causes a warning due to the naked future.

This should probably go for cookies too actually.

I'm not quite sure. The cookie by itself doesn't do much. The request was already sent and there are valid cases for ignoring a cookie. I guess must VoidCookies are immediately dropped and I bet I could even come up with a case where dropping a Cookie would be the right thing to do.

Actually... the Future trait is marked must_use, so shouldn't that already be enough for a warning? I'm not sure.

At least for async it should be. Like you mentioned it's a footgun that should be fixed on the Rust level.


automate the release process

Is your feature request related to a problem? Please describe.
Create a way to TAG and release automatically
Describe the solution you'd like
Create a way to TAG and release automatically, to avoid these problems https://github.com/rabbitmq/rabbitmq-stream-go-client/issues/327
Describe alternatives you've considered
No response
Additional context
No response

Per conversation with @hiimjako
FYI: https://github.com/rabbitmq/rabbitmq-amqp-dotnet-client/blob/main/create_tag.sh


test: extend XDP coverage for Maglev

See commit, goal is to have Maglev coverage also in XDP tests.

test-me-please

test-me-please

test-focus K8sService*

test-me-please

test-focus K8sService*

retest-net-next

(VM provision error on net-next)


Modulesync: use voxpupuli-acceptance 1.3

Also does some more spec cleanups

merged, bedankt @ekohl!


syscall, x/sys/unix: Select returns (int, error) on linux, but just error elsewhere

Is this inconsistency intentional?  Select is a POSIX function and has the same 'int' return value on all supported platforms where it's available, so it seems odd to only expose it on Linux.
(Motivation: I was trying to use github.com/jaracil/poll on OpenBSD, but ironically its Select-based fallback for non-Linux OSes is written assuming the Linux Select API.)

This does seem like a bug.  We can't change the existing function in the syscall package.  I don't know how we feel about changing it in x/sys/unix.
Maybe we need to add a new function to x/sys/unix.  Perhaps SelectN.  Then we can provide a consistent interface across all Unix OS's.  But since syscall is frozen, I don't think we want to change it for this.


bower install ends in unable to access 'https://github.com/jquery/jquery-dist.git/': SSL: CA certificate set, but certificate verification is disabled

I am not able to install (anything?) with bower. I am trying to use the public GitHub and a popular library but I get error: git ls-remote --tags --heads https://github.com/jquery/jquery-dist.git", exit code of #128 fatal: unable to access 'https://github.com/jquery/jquery-dist.git/': SSL: CA certificate set, but certificate verification is disabled
#Details:
Additional error details:
Output of bower -v && npm -v && node -v:
1.7.9
3.10.3
v6.5.0

Additional environment details (proxy, private registry, etc.):
I have disabled everything I know.
Steps to reproduce the issue:

bower install jquery

Describe the results you received:
bower install jquery
bower jquery#*              not-cached https://github.com/jquery/jquery-dist.git#*
bower jquery#*                 resolve https://github.com/jquery/jquery-dist.git#*
bower jquery#*                 ECMDERR Failed to execute "git ls-remote --tags --heads https://github.com/jquery/jquery-dist.git", exit code of #128 fatal: unable to access 'https://github.com/jquery/jquery-dist.git/': SSL: CA certificate set, but certificate verification is disabled

Describe the results you expected:
I expected Bower to finish the without errors.
Additional information:

I have tried this in the command without and no errors. It shows Content-Type: application/x-git-upload-pack-advertisement

GIT_CURL_VERBOSE=2 git ls-remote --heads https://github.com/jquery/jquery-dist.git

I was sneaking in the source code and the error comes from cmd.js#L102 called by GitRemoteResolver.js#L253 I wonder why the command succeeds in my terminal but fails when done by bower?

If it matters here is my bower.json:

{
  "name": "webcomp",
  "authors": [
    "me<EMAIL_ADDRESS>  ],
  "description": "",
  "main": "",
  "license": "MIT",
  "homepage": "",
  "private": true,
  "ignore": [
    "**/.*",
    "node_modules",
    "bower_components",
    "test",
    "tests"
  ]
}

I have realized this is the origin of my problems https://github.com/bower/bower/pull/2137/commits/f0a54d0018927f8f1cf85cb6c7e12a37cea49333
My configuration is:
$ npm config get strict-ssl
true

So process.env has "GIT_SSL_NO_VERIFY":"false" however http.c seems to check only if GIT_SSL_NO_VERIFY exists. It does not check it is "true" or "false".
I have changed:
process.env.GIT_SSL_NO_VERIFY = (!config.strictSsl).toString();

to
if (!config.strictSsl) {
    process.env.GIT_SSL_NO_VERIFY = 'true';
}

And now I am able to grab jquery normally: bower install jquery
I wonder if this is a configuration miss from my side? This seems to be a quite common case so I wonder how people is not having the same issue as me? cc @sheerun @pwielgolaski

I think we should fix it as you suggest.
It was unification code review suggestion.
I think the main scenario was to enable this flag, but in your case it is opposite case.
I would suggest making pull request for it.

@pwielgolaski I think trying to unify code was a good idea providing GIT_SSL_NO_VERIFY=true and GIT_SSL_NO_VERIFY=false where opposites. They are not.
IMO guys at git could have been written a more strict check like:
char *gitSslNoVerify = getenv("GIT_SSL_NO_VERIFY");
if (gitSslNoVerify != NULL && strcmp(gitSslNoVerify, "true") == 0) {
    curl_ssl_verify = 0;
}

instead of their approach
if (getenv("GIT_SSL_NO_VERIFY"))
	curl_ssl_verify = 0;

But they didn't and everybody has to live with it.
I will make the PR :)


Add Python environment installation instructions in README

Following the workflow we're using for the CI, we should explain how to first install the environment.yml file using conda or micromamba, and then how to configure PyCall (which is already done).

Added in #116


Fixes for two minor issues

Fixes the orbit altitude starting and final altitudes getting swapped when changing bodies, and fixes NullReferenceExceptions occurring when using TWP from the KSC.

I cherry picked https://github.com/TriggerAu/TransferWindowPlanner/pull/50/commits/a9dabbaf44e16dbebfe1167f38e66e606615fd34 to develop for that fix
The other buts re render angles I had fixed in some KAC stuff and copied over, then added some extras in this PR and a few more so didnt use the NRE commit here. Will close this PR, but you shoudl see the usage of the invesrion fix in the develop branch and master when its done


Creating new apply section

Trello card
https://trello.com/c/0200YyKZ/5010-build-the-new-how-to-apply-section-for-the-navigation
Context
We want to create a new section on the website to house our application content.
Changes proposed in this pull request
Guidance to review

Do we want to remove or update the sub heading on /train-to-be-a-teacher/ too? It doesn't feel quite right being called 'Your teacher training application' now. Could change it to 'Experience school life' for the time being?

good point - forgot about that! will tweak

@EllieNodder Just a thought - do we want to add a link to the new section on the home page directory?


Use the official conversion script, YOLO

Some steps require the new scripts on master, going to push then do a bit of cleanup on the scripts after.


bug: Dismounting a player leaves visual hitbox in place, different from actual one

🔍 What happened?

If I get off of someone my game freezes for a moment and outputs error attached.
If someone gets off of me (both if they do or I throw them off), a ghost version of them stays on my head, the actual location of the player is invisible and can hit me, I see only particles and such. This is fixed by relogging or leaving the area they are actually in (outputting the error).
If someone riding me disconnects, a ghost version of them will stay in place in air (which stays even if they come back)

The minecraft version exactly is 1.20.4
Fabric loader 0.15.6
🤔 What did you expect to happen?
For the feature to be usable without desyncing of player's visual hitbox location and their actual one
📦 Version
1.5.1
⛏ Minecraft Version
1.20.3
📃 Relevant log output
[18:16:19] [Render thread/ERROR]: Error executing task on Client
net.minecraft.class_148: Main thread packet handler
	at net.minecraft.class_2600.method_11072(class_2600.java:33) ~[client-intermediary.jar:?]
	at net.minecraft.class_1255.method_18859(class_1255.java:156) ~[client-intermediary.jar:?]
	at net.minecraft.class_4093.method_18859(class_4093.java:23) ~[client-intermediary.jar:?]
	at net.minecraft.class_1255.method_16075(class_1255.java:130) ~[client-intermediary.jar:?]
	at net.minecraft.class_1255.method_5383(class_1255.java:115) ~[client-intermediary.jar:?]
	at net.minecraft.class_310.method_1523(class_310.java:1283) ~[client-intermediary.jar:?]
	at net.minecraft.class_310.method_1514(class_310.java:888) ~[client-intermediary.jar:?]
	at net.minecraft.client.main.Main.main(Main.java:265) ~[minecraft-1.20.4-client.jar:?]
	at net.fabricmc.loader.impl.game.minecraft.MinecraftGameProvider.launch(MinecraftGameProvider.java:470) ~[fabric-loader-0.15.6.jar:?]
	at net.fabricmc.loader.impl.launch.knot.Knot.launch(Knot.java:74) ~[fabric-loader-0.15.6.jar:?]
	at net.fabricmc.loader.impl.launch.knot.KnotClient.main(KnotClient.java:23) ~[fabric-loader-0.15.6.jar:?]
	at org.prismlauncher.launcher.impl.StandardLauncher.launch(StandardLauncher.java:88) ~[NewLaunch.jar:?]
	at org.prismlauncher.EntryPoint.listen(EntryPoint.java:126) ~[NewLaunch.jar:?]
	at org.prismlauncher.EntryPoint.main(EntryPoint.java:71) ~[NewLaunch.jar:?]
Caused by: java.lang.ClassCastException: class net.minecraft.class_746 cannot be cast to class net.minecraft.class_3222 (net.minecraft.class_746 and net.minecraft.class_3222 are in unnamed module of loader net.fabricmc.loader.impl.launch.knot.KnotClassLoader @64bf3bbf)
	at net.minecraft.class_1297.handler$bhl000$fsit$removePassenger$removeRider(class_1297.java:6382) ~[client-intermediary.jar:?]
	at net.minecraft.class_1297.method_5793(class_1297.java:2192) ~[client-intermediary.jar:?]
	at net.minecraft.class_1297.method_29239(class_1297.java:2153) ~[client-intermediary.jar:?]
	at net.minecraft.class_1657.method_29239(class_1657.java:1120) ~[client-intermediary.jar:?]
	at net.minecraft.class_1297.method_5848(class_1297.java:2158) ~[client-intermediary.jar:?]
	at net.minecraft.class_1309.method_5848(class_1309.java:2880) ~[client-intermediary.jar:?]
	at net.minecraft.class_1297.method_31745(class_1297.java:3658) ~[client-intermediary.jar:?]
	at net.minecraft.class_638.method_2945(class_638.java:338) ~[client-intermediary.jar:?]
	at net.minecraft.class_634.method_37472(class_634.java:621) ~[client-intermediary.jar:?]
	at it.unimi.dsi.fastutil.ints.IntArrayList.forEach(IntArrayList.java:702) ~[fastutil-8.5.12.jar:?]
	at it.unimi.dsi.fastutil.ints.IntIterable.forEach(IntIterable.java:146) ~[fastutil-8.5.12.jar:?]
	at it.unimi.dsi.fastutil.ints.AbstractIntCollection.forEach(AbstractIntCollection.java:153) ~[fastutil-8.5.12.jar:?]
	at net.minecraft.class_634.method_11095(class_634.java:620) ~[client-intermediary.jar:?]
	at net.minecraft.class_2716.method_11764(class_2716.java:31) ~[client-intermediary.jar:?]
	at net.minecraft.class_2716.method_11054(class_2716.java:9) ~[client-intermediary.jar:?]
	at net.minecraft.class_2600.method_11072(class_2600.java:24) ~[client-intermediary.jar:?]
	... 13 more

Interesting...
I'm currently in the process of refactoring where this issue might be fixed, so I'll keep this issue open until the next release

Fixed in the v2.0.0, messed up with mixins. Thank you for the opening this issue!


Persist the filter for model admins, and pages list view

Fix: Append the 'q' get variable to the GridField ItemEditForm action, and back link to persist the filter for the model admin, and pages list view.
Found the issue here: https://github.com/silverstripe/silverstripe-cms/issues/503

Now that we have 3.2, is this an appropriate solution? The HTML ID of forms have all changed anyway.
I think that this is a bug as it standards, as user expectations are not met with the action on the back button.

We've just released a module which does this: https://github.com/Little-Giant/silverstripe-persistentgridfield

This definitely needs some attention in the core - thanks for the module in the mean-time

We'd be happy to port this across to core but its a large change and the way we've had to do it in the end is really hack. It definitely requires a bit more thinking about how GridField works internally rather than adding stuff on top.

Created an alternative module to enable some form of states in grid views. Instead of using php+memory/hashes (see @stevie-mayhew) I've tried to get by just using JS utilising sessionStorage. Stateful per tab, state resets when navigating across "modules". See: https://github.com/novatio/silverstripe-statefulgridfield (WIP, developed in SS 3.2).
Any thoughts on this approach? The main issue is that sessionStorage is a client side thing, so the gridviews always fetch the initial listing and right after that the reload (with the previous state) is triggered.

Why is using the built in GridState not suitable for this?

I wanted to keep track of the state per browser tab and at the same time keep track of "module states" per tab (e.g.: when you navigate from assets/* to settings/* and back again: you'd want the state for any GridViews in assets/* to have been reset and not retain any previously used states... the user is expecting a 'clean slate').
I thought that this would not be possible with GridState and sessionStorage seemed like the way to go. Perhaps I'm mistaken or are you not referring to the JSON encoded data stored in the form itself (in hidden field xxx[GridState]?

@gavro I'm talking about GridState
You might right that this state will leak across tabs... but I'm not certain - worth a check?
I think implementing sessionStorage would be quite tricky and lead to a lot of overhead about when to clean it up and making sure you don't go over the browsers undefined limits in this area...


Stuck at "Auth Menu: Select how to retrive auth information"

Brand new install of ofscraper, but constantly stuck at entering Auth details. Tried the firefox extension and manually input. But after input, it shows the same menu again, with every input filled-in already.
log:
ofscraper_main_profile_2024-06-06.log
config:
config.json
Steps to reproduce the behavior:

Install ofscraper with pipx
run ofscraper
try to start scraping
input auth manually

Expected behavior:
Auth menu shows up again, with all the input filled-in with previous inputs.
System Info

OS: Windows
Browser: Chrome
Version: v3.10
Python v3.12.3

I'm seeing this same behaviour as well with a previously working install.

I've updated my auth.json, both using the M-rcus' OnlyFans-Cookie-Helper and manually
I'm running a download action:ofscraper \
    --action download \
    --posts all \
    --sort subscribed --desc \
    --username ALL

My logs almost immediately show a Client error '400 Bad Request' for url 'https://onlyfans.com/api2/v2/users/me'.

I've also noticed that if I refresh of.com immediately after running the scraper, that I've been logged out.

I can second that issue with current 3.10 on Python 3.11 on Mac, stuck in a loophole and repeated auto-sign-offs

Same behaviour on ofscraper 3.10, python 3.12.2.
I do not encounter the logout behaviour that @DynamoPrime has noticed, though.
Here is a log excerpt:
error.txt

update to new commit
https://github.com/datawhores/OF-Scraper/commit/51c48a2b001f9d17c3e2fa20b91b3e9a0c2c12db
or
https://of-scraper.gitbook.io/of-scraper/getting-started/config-options/advanced-config-options/changing-const#where-are-they
the value to change is
{"SNEAKY":"https://raw.githubusercontent.com/Growik/onlyfans-dynamic-rules/main/rules.json"}

https://gist.github.com/datawhores/8e8be131fb1b190b50c5324ab2ca5f89

That works great, thanks!

Updated to 3.10.2
Updated config.json to use "dynamic-mode-default": "growik"
Success!


Icons for different platforms.

I am wondering whether we are going to add any icons for different platforms. For example: icon-ui-apple, icon-ui-android, icon-ui-windows-8, icon-windows-classic etc.

@sanjibpanda we actually did this in an older CSS framework and we had to stop using them. Most of those are registered trademarks and there was some legal limitations to distributing/using them.

Ahh. Got it. Makes sense!
Thanks @paulcpederson! We will convey the message to authors if they will look for similar icons while authoring content for Calcite specific sites.

:+1:


Feature/sar 230 drre cql

Steps to run:

Pull down the ncqa-cql repo. It's at https://github.com/amida-tech/ncqa-cql
From the develop branch of ncqa-cql, copy the contents of the /private folder into your local /private folder. (I've made changes to the structure of the where the libraries and measurements are found).
Run with `yarn start1.
Change something in drre-patient.json to see the results.

@anthem123 done. I think we can just merge this in.


Deprecated warning when iOS Deployment Target is iOS 8.0

IDMPhotoBrowser.m:
'setCompletionHandler:' is deprecated: first deprecated in iOS 8.0 - Use 'completionWithItemsHandler' instead.

In IDMPhotoBrowser.m, replace
 __typeof__(self) __weak selfBlock = self;
            [self.activityViewController setCompletionHandler:^(NSString *activityType, BOOL completed) {
                [selfBlock hideControlsAfterDelay];
                selfBlock.activityViewController = nil;
            }];

with
__typeof__(self) __weak selfBlock = self;
            [self.activityViewController setCompletionWithItemsHandler:^(NSString *activityType, BOOL completed, NSArray *returnedItems, NSError *activityError) {
                [selfBlock hideControlsAfterDelay];
                selfBlock.activityViewController = nil;
            }];

This should silence the compiler.

Deprecated calling removed.


deleteIncomepleteScan not working

deleteIncomepleteScan won't accept "2" as a value. Console log shows deleteIncomepleteScan value is 0.

deleteIncompleteScanLevel: '2' fixed the issue


Is there a way to prioritise jobs?

I may have many jobs that can kick off at the start of a run, but one of these is essential that it runs early, as that unlocks more jobs
I'll generally have 3 agents available to me, so its possible Job A, B, C will be picked up to run first, but not Core which is where my greater dependencies are?
Core -> Job1
-> Job2
-> Job3
-> Job4
JobA
JobB
JobC
Is there a way to prioritise a single job over others, when there are multiple that it could run?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 67504b34-d64b-02a4-2e10-ab99f3b8cfe4
Version Independent ID: 2cf63b2e-184b-7726-3b8a-d8baffd6fcce
Content: Jobs in Azure Pipelines and TFS - Azure Pipelines
Content Source: docs/pipelines/process/phases.md
Product: devops
Technology: devops-cicd-process
GitHub Login: @juliakm
Microsoft Alias: jukullam

@BlairMcc -- Blair, thank you for your question.  You may find answers here:

Azure DevOps Support Bot
Azure DevOps on Stack Overflow

@juliakm -- Julia, please look into this issue.

Hey @juliakm
I know I could use dependencies, they're already in place where they are needed, but I don't want these other shorter standalone jobs tied to and delayed by an earlier running process.
ie green is current state, with black showing genuine build dependencies. In green build it is possible my three agents are consumed on run start by the small standalone jobs, delaying the top group of chained jobs. In red build, as you are suggesting, chains those standalone jobs to my higher priority job, delaying builds needlessly
I'm not sure this ultimately has a massive impact on our build times, just want to throw it out there in case there is some hidden support for it

I get the same requirement to prioritize some standalone jobs in a yaml pipeline.  Any suggestions or plan to support this?

I would like to do this too
I have a distributed task execution pattern in my build where I have a "main" job that feeds work to the "agent" jobs
The problem is that if the "agent" jobs begin but the "main" job is queued, no work will be sent to the agent jobs and they will just spin until the main job starts and begins feeding them work
it would be great if I could set some sort of priority so that "main" always took the first available agent

+1, would like to have this in the Classic Editor as well.

@juliakm would you mind re-opening this issue? I don't think the request has been addressed.
I believe the request is "Given some number of jobs which satisfy their dependencies at the same time, what mechanism should be used to determine the order in which they run?" This is a question of overall throughput.
For instance, imagine I have jobs A, B, C, D, E, and F
Job A is a dependency of jobs B, C, and D.
Job D is a dependency of jobs E and F.

Once A is completed, B, C, and D are free to begin.
However, you would obviously want D to start first as it is the only gate on E and F.
Is there a way to ensure that job D has a "higher priority" than jobs B and C so that in a situation with limited machine capacity, D will start before B and C in order to unblock E and F?

This feels like a feature gap. Other build orchestration systems have this feature; jenkins calls this priority, team city priority class, and build tracker also priority.

@all -- thank you for your interest and follow-up.  Please see Julia's message above, and raise this issue as a feature request in the Developer Community.
cc @juliakm for awareness

For anyone wanting to add pressure to this feature request, please see https://developercommunity.visualstudio.com/t/Add-a-way-to-prioritize-jobs/10085575
@WilliamAntonRohm, @juliakm  since I am internal, please feel free to reach out to me as a customer over email or teams if you want to discuss further

Closing since this is a feature request.

This is not a feature request, the feature already exist. It is a bug as the feature doesn't work:  https://learn.microsoft.com/en-us/rest/api/azure/devops/build/builds/get?view=azure-devops-rest-6.1#queuepriority

@juliakm As @Turbofroggy pointed out, this is a bug. Please reopen.

@Turbofroggy, @thisisthekap -- thank you for your follow-up.  If you feel this is a product bug, please add it here:

Developer Community

I've checked with the product team and Azure DevOps does not support job priority for YAML build pipelines. There are no plans to add this feature.
I'm looking into updating the REST API docs and will make this clearer in the jobs article.
@WilliamAntonRohm for reference.

@juliakm Can you provide a workaround to achieve build priorization other than clicking "Run next" manually for each pipeline run?
Can you furthermore give us some insights on why there are no plans to implement this feature?


Confusing installation?

I'm not too experienced with compiling, have you thought of making installation executables?

Or maybe Dockerfile would be nice to have.

Or maybe Dockerfile would be nice to have.

Is dockerfile a simplified compiler?

Is dockerfile a simplified compiler?

Kind of, image can be built using Dockerfile and then run in a simple manner. https://docs.docker.com/engine/reference/builder/

Kind of, image can be built using Dockerfile and then run in a simple manner. https://docs.docker.com/engine/reference/builder/

Cool, I'll check it out

Cool, I'll check it out

@jadasse I did make an AUR package for this to automate the install. Unfortunately, this only works on Arch and derivatives. The pkgbuild file is here: https://aur.archlinux.org/cgit/aur.git/tree/PKGBUILD?h=browservice

@jadasse I did make an AUR package for this to automate the install. Unfortunately, this only works on Arch and derivatives. The pkgbuild file is here: https://aur.archlinux.org/cgit/aur.git/tree/PKGBUILD?h=browservice

Having prebuilt binaries would be nice indeed, however, setting up and maintaining builds for four architectures and many Linux distributions that are most likely binary incompatible takes some effort which I haven't had time to put in. Ideally, someone would package Browservice into the package managers of the Linux distributions; the AUR package by @Dylan1496 is a good start in this direction.
Meanwhile, we could try to make the manual setup easier. @jadasse, which part of the current setup procedure is the most confusing one? The idea was that you wouldn't need any experience with compiling, as you should simply copy the required commands from the README.

Having prebuilt binaries would be nice indeed, however, setting up and maintaining builds for four architectures and many Linux distributions that are most likely binary incompatible takes some effort which I haven't had time to put in. Ideally, someone would package Browservice into the package managers of the Linux distributions; the AUR package by @Dylan1496 is a good start in this direction.
Meanwhile, we could try to make the manual setup easier. @jadasse, which part of the current setup procedure is the most confusing one? The idea was that you wouldn't need any experience with compiling, as you should simply copy the required commands from the README.

Oh, I meant for Windows 95 internet explorer 5.5

Oh, I meant for Windows 95 internet explorer 5.5

@Dylan1496 thank you for creating the AUR package. One issue some people have had with it is that it seems to compile all the modules in parallel, which uses too much memory on some systems. This is because make is invoked with the flag -j without a limit; you probably should limit the number of parallel jobs to the number of cores by using make -j$(nproc) instead.

@Dylan1496 thank you for creating the AUR package. One issue some people have had with it is that it seems to compile all the modules in parallel, which uses too much memory on some systems. This is because make is invoked with the flag -j without a limit; you probably should limit the number of parallel jobs to the number of cores by using make -j$(nproc) instead.

Where should I put the commands?

Where should I put the commands?

@jadasse you don't compile or run Browservice on the Windows 95 machine; it must run on a separate modern Linux machine. The Windows 95 machine accesses the Browservice instance running on the Linux machine over a local area network. The YouTube video on Browservice by Michael MJD does a good job of explaining the setup.

@jadasse you don't compile or run Browservice on the Windows 95 machine; it must run on a separate modern Linux machine. The Windows 95 machine accesses the Browservice instance running on the Linux machine over a local area network. The YouTube video on Browservice by Michael MJD does a good job of explaining the setup.

I wasnt going to compile it on a windows 95 virtual machine, i was trying to compile it on my windows 10 so i can put it in an iso and insert it in the vm to test it out on ie 5.5

I wasnt going to compile it on a windows 95 virtual machine, i was trying to compile it on my windows 10 so i can put it in an iso and insert it in the vm to test it out on ie 5.5

I wasnt going to compile it on a windows 95 virtual machine, i was trying to compile it on my windows 10 so i can put it in an iso and insert it in the vm to test it out on ie 5.5

Make sure that you read the README (and watch the video) carefully to understand the structure of the Browservice setup. No part of the compiled Browservice is directly installed on the Windows 95 machine; the Windows 95 machine only needs IE5.5 and a network connection to the Linux machine running Browservice. Browservice does not run on Windows 10, so you need either a Linux VM or Windows Subsystem for Linux.

I wasnt going to compile it on a windows 95 virtual machine, i was trying to compile it on my windows 10 so i can put it in an iso and insert it in the vm to test it out on ie 5.5

Make sure that you read the README (and watch the video) carefully to understand the structure of the Browservice setup. No part of the compiled Browservice is directly installed on the Windows 95 machine; the Windows 95 machine only needs IE5.5 and a network connection to the Linux machine running Browservice. Browservice does not run on Windows 10, so you need either a Linux VM or Windows Subsystem for Linux.

Oh. I'll have to close this because this isn't windows compatible, I'm trying to find a way to browse modern internet (e.g. watch YouTube on Windows 9x) on old oses with windows compatibility.

Oh. I'll have to close this because this isn't windows compatible, I'm trying to find a way to browse modern internet (e.g. watch YouTube on Windows 9x) on old oses with windows compatibility.


enable chained config repo

Previously, the repositories worked only when created as Spring beans due to the injection of the ConfigurationParser. This was at odds with their constructors being accessible. In particular, this broke usage of the ChainedConfigurationRepository if the repositories passed to it were not created as beans themselves.
This is solved in this commit by adding a RepositoryFactory bean through which all repositories are created.
Also, the class ConfigTypeProvider is removed as it was an unnecessary layer just wrapping BaiganConfigClasses.

Closing this PR. I created PR https://github.com/zalando-stups/baigan-config/pull/84 instead that will be merged before the introduction of structured configs. The remaining changes of the present PR will be added to https://github.com/zalando-stups/baigan-config/pull/77 directly instead.


Potential feature - command line options support

I wasn't sure if this is a feature that you'd be interested in, but I've got a stable branch (called "options-support") in my fork here:
https://github.com/mgiljum/AtoMiC-ToolKit/tree/options-support
Details are in the README of that branch. It adds command line options like --install sonarr for example. I use this script all the time and having these makes doing things a lot faster than using the GUI every time.
I didn't add a pull request as I wasn't sure if you would want this. If not, I won't be offended at all. If it sounds good, I will do a full writeup in the pull request.

Sure thing, I'll get that pull request written up sometime today, to the dev branch.

This has now been pushed up to the master branch. For instructions on how to use this please see the readme.


Add a way to sign a message without a transaction

Hi,
We are creating a d-app using AlgoSigner. We want to ask the user to sign a message with their address to check that it is really theirs. This will be used to authenticate users by their algo address only.
For now, we are using AlgoSigner.sign with a transaction of 0 algos with a random note. However, it is displaying a transaction to sign to users, with fees. Thus, users might be afraid that they need to pay something. Would it be possible to add a new UI to sign a short message without displaying anything about transactions, prices or fees?
Thanks.

Currently this is not available without the fee presentation, as any signed returned transaction could potentially be submitted resulting in the fee charge. Direct signature verification can be accomplished through a smart contract, but this would also have fees associated.

This has been selected for development - details on how it will work still tdb

+1 on this, I am also looking for the method like metamask's web3.personal.sign method to "sign a message", this will make it easy for dApps/web to add a "Sign in with AlgoSigner" function

1 on this. I think the end goal would be to allow users to go through the authentication process described here, i.e. using an Algorand equivalent of web3.personal.sign used in conjunction with an equivalent of web3-token.


Add conformance profile for NGINX Gateway Fabric

What type of PR is this?
/area conformance

What this PR does / why we need it:
Updates conformance profile for NGINX Gateway Fabric.
Does this PR introduce a user-facing change?:

NONE

Thanks @sjberman!
/lgtm
/hold cancel


dnSpy download URL returns 404

dnSpy has released a new version i.e. v6.1.7 and my installation breaks with that because the older version/release seems to be deleted.
Downloading dnspy
  from 'https://github.com/0xd4d/dnSpy/releases/download/v6.1.6/dnSpy-net472.zip'
ERROR: The remote file either doesn't exist, is unauthorized, or is forbidden for url 'https://github.com/0xd4d/dnSpy/releases/download/v6.1.6/dnSpy-net472.zip'. Exception calling "GetResponse" with "0" argument(s): "The remote server returned an error: (404) Not Found."
The upgrade of dnspy.flare was NOT successful.
Error while running 'C:\ProgramData\chocolatey\lib\dnspy.flare\tools\chocolateyInstall.ps1'.
 See log for details.

Chocolatey upgraded 0/1 packages. 1 packages failed.
 See the log for details (C:\ProgramData\chocolatey\logs\chocolatey.log).

Failures
 - dnspy.flare (exited 404) - Error while running 'C:\ProgramData\chocolatey\lib\dnspy.flare\tools\chocolateyInstall.ps1'.
 See log for details.
Chocolatey reported an unsuccessful exit code of 404. See C:\Users\Umar_0x01\AppData\Local\Boxstarter\boxstarter.log for details.
+ Boxstarter finished Calling Chocolatey to install dnspy.flare. This may take several minutes to complete... 00:00:12.8886755
+ Boxstarter finished Calling Chocolatey to install dnspy.flare. This may take several minutes to complete... 00:00:12.8886755

ExitCode: 404
ExitCode: 404
2020/08/23 13:01:39 [dnspy.flare] chocolateyinstall.ps1 [+] ERROR : Failed to install dnspy.flare

upgraded to newest version, please install with cinst -y dnspy.flare

Thanks, resolved.


Guidance on using FAIRseq for seq2seq tasks

Hi, I want to use FairSeq for a custom seq2seq task but had a few doubts using it:-

What is the format required for the dataset? I have a .csv file which has input corresponding to outputs. However, I found no mention in the docs that explicitly specify on what format data is going to be (I have never trained a model from command-line so am more used to customization). My plan was to split it into 2 separate files - one will have the inputs and the other will have the corresponding output w.r.t to the lines, but I don't see any parameters that allow training/preprocessing in such way. Can anyone clarify how exactly can I accomplish this? [BTW I have 500Mb file of data which has 10 million lines/data points].  Does it require tokenization on the fly?

Seeing the fairseq-preprocess docs, It seems that fairseq requires no tokenization. Now the HuggingFace tokenization library does not use GPU and thus takes a lot of time along with a LOT of memory. So does the --tokenizer or --bpe flag in the preprocessing step use GPU resources OR does it still utilize the standard CPU+RAM combination? I did try to train using the HF lib but would prefer GPU/TPU for the task.

Lastly, in the TPU training section the --tpu flag has this doc:- "use TPU instead of CUDA". Is there any way to set which TPU strategy to use? the Distributed Training section only offers options for GPU training and not a way to set TPU  strategy.

Lastly, I would be extremely pleased if someone can specify what GPU time it took to train the FairSeq model. Please keep such refs. in the docs themselves so that people can at least have an idea of how much resources it would take to train it to a significant level. I am planning at using 10 hours of TPU v2 (180 TFLOP's) OR 3x v3 TPU's (480 TFLOPS) for 6 total TPUs hours. How much training I can accomplish with that?

Yes, it's fine to put any arbitrary suffixes, e.g., .input and .output.

Thanx a ton for your help. Just one last thing- I am starting my training phase, but from this link (https://fairseq.readthedocs.io/en/latest/command_line_tools.html#Model configuration) seems that there are plenty of model architectures.
Can you advise me which ones I should try first If I want to do 'seq2seq' for ciphers (Like an architecture particularly good for finding the relations between the sequences)? My model is basically one that extracts the plaintext out of ciphertext/encrypted text....

@myleott Hi, I am training my model on TPU device but am encountering this error:-

2020-08-25 13:00:20 | WARNING | root | TPU has started up successfully with version pytorch-1.6
WARNING:root:TPU has started up successfully with version pytorch-1.6
Exception in device=TPU:0:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/dist-packages/torch_xla/distributed/xla_multiprocessing.py", line 231, in _start_fn
fn(gindex, *args)
File "/content/fairseq/fairseq/distributed_utils.py", line 150, in distributed_main
args.distributed_rank = distributed_init(args)
File "/content/fairseq/fairseq/distributed_utils.py", line 112, in distributed_init
assert xm.xrt_world_size() == args.distributed_world_size
AssertionError
Traceback (most recent call last):
File "/usr/local/bin/fairseq-train", line 33, in
sys.exit(load_entry_point('fairseq', 'console_scripts', 'fairseq-train')())
File "/content/fairseq/fairseq_cli/train.py", line 333, in cli_main
distributed_utils.call_main(args, main)
File "/content/fairseq/fairseq/distributed_utils.py", line 185, in call_main
nprocs=8,  # use all 8 TPU cores
File "/usr/local/lib/python3.6/dist-packages/torch_xla/distributed/xla_multiprocessing.py", line 296, in spawn
start_method=start_method)
File "/usr/local/lib/python3.6/dist-packages/torch/multiprocessing/spawn.py", line 158, in start_processes
while not context.join():
File "/usr/local/lib/python3.6/dist-packages/torch/multiprocessing/spawn.py", line 113, in join
(error_index, exitcode)
Exception: process 0 terminated with exit code 17

I am trying to do a seq2seq problem and am using preprocessed data using the commands provided in FAIRseq docs. the data was preprocessed successfully, I am presumably running my code on a TPUv2 and have PyTorch along with XLA installed. In both the Tracebacks, the error does not clearly specify what exactly went wrong. This is the training code:-
%%bash
fairseq-train /content/drive/'My Drive'/HashPro/preprocessed/ \
   --lr 0.02 --clip-norm 0.1 --optimizer sgd --bpe characters --dropout 0.2 --tpu --bf16\
    --arch bart_large --save-dir /content/drive/'My Drive'/HashPro/Checkpoints/
Any ideas on what the problem might be?

Hi @neel04 ,
I also have the similar type of sequence to sequence task in which I have a CSV file consisting of two columns Input & Output. Can you please share your code or guide me how I can pre-process the data, fine-tune the fairseq model and what other steps need to be done to get the results. Also explain what models you have tried for your tasks and if possible the results too.

I ditched fairseq in the end - it's too heavy and buggy for my needs. I would recommend using some repo for the model and writing your own wrapper since it would be faster and easier than this. FAIR really needs to put a lot of work in this; nor is this library easy-to-use nor do heavy professionals have an actual use for this.

Thanks for your suggestion @neel04. I also feel its buggy & erroneous. So, I will explore other libraries.


Query for 'NOT evaluated by'

Hi,
I have two models: User and Question. Users can evaluate Questions (:rating). I'd like to find Mathematics Questions that have NOT been evaluated by a specific user. Something like:
Question.where(area: "Mathematics).not_evaluated_by(:rating, current_user)

How can I do this?
Thanks.

evaluated_questions = ReputationSystem::Evaluation.where(target_type: 'Question', source_id: current_user.id, reputation_name: 'rating')

Question.where.not(id: evaluated_questions.pluck(:id))


Fix code scanning alert - Implicit narrowing conversion in compound assignment

Tracking issue for:

[ ] https://github.com/otto-de/jlineup/security/code-scanning/1

Fixed


added AddMovie(), RentMovie(), and ReturnMovie() functions. refactored Movie IDs for better manipulation.

FEATURE: added AddMovie(), RentMovie(), and ReturnMovie() functions.
Name of Branch: add
Pull Request Checklist

[x] Is it working?
[x] Are there no conflicts in the merge request?
[x] Did the code follow the Coding Conventions?
[x] Did your local tests pass without any errors?

Features and Additions
Added AddMovie() function
Added RentMovie() function
Added ReturnMovie() function
Feature: AddMovie()
Description:
AddMovie() function adds a new movie into the linked list. The movie that can be added can either be a movie of the same genre as those previously available (Sci-Fi, Horror, Romance, Action, Comedy) or a new genre altogether (i.e., Anime).
To add a new movie, simply indicate the genre you are trying to add (1 for Sci-Fi, 2 for Horror, 3 for Romance, 4 for Action, 5 for Comedy,  6 for a new genre (i.e. Anime)). After indicating indicate the following movie details: Movie ID, Title, Production Company, # of copies. If you are adding a new genre (i.e. Anime) use the following movie details: Movie ID, Title, Genre, Production Company, # of copies.
After doing so, the new movie is inserted to the linked list depending on the last movie of a genre. If you add a new sci-fi movie, by default, it would be numbered 106 and be inserted right after movie 105 and before movie 201. If you were to insert a movie with a new genre, by default, it would be numbered 601 right after movie 505.
NOTE: WHEN ADDING A NEW MOVIE PLEASE INSERT THE CORRESPONDING MOVIE POSTER WITH FILE EXTENSION OF JPG AND CORRESPONDING MOVIE ID. In this example, I have already provided movie 601's poster inside the Posters folder, so all you need to do is to enter the details of the movie.
Feature: RentMovie()
Description:
RentMovie() rents a movie by getting a "copy" of it from the linked list. When renting a movie the user must first indicate to which customer, by entering the Customer ID, this rented movie should be attributed. Since the Customer ADT does not have any functions yet, I have left a single-line comment to insert the function wherein you would enter the Customer ID. After entering the Customer ID, you would then enter the Movie ID of the movie you would like to rent. If the movie has enough copies, the movie would then be attributed to the customer and the # of its copies would be subtracted by 1. If there are no available copies of the movie, it would print a prompt that says there are no available copies as of this moment. If the movie being rented is not in the database or the linked list, it would print a prompt saying that the movie you are trying to rent is not in our database/linked list.
Feature: ReturnMovie()
Description:
ReturnMovie() returns a movie by disassociating the movie to be returned from the customer then increasing the # of copies that the movie currently has. When returning a movie, the user must first indicate to which customer, by entering the Customer ID, this movie being returned should be attributed. Since the Customer ADT does not have any functions yet, I have left a single-line comment to insert the function wherein you would enter the Customer ID. After entering the Customer ID, you would then enter the Movie ID of the movie you would like to return. By doing so, the # of copies attributed to the movie you are returning would add by 1. If there is no such existing movie that you are trying to return, it would print a prompt saying that the movie you are trying to return does not exist in our database/linked list.
Feature: refactored Movie IDs for better manipulation.
Description:
I have refactored the Movie IDs so that the movies could be manipulated easier. The legend is now as follows: the first digit indicates the genre (1 for Sci-Fi, 2 for Horror, 3 for Romance, 4 for Action, 5 for Comedy, 6 for the new genre if you added a movie of a new genre), the last 2 digits then indicate what order the movie is based on its genre. For example, a movie with ID of 101 is a Sci-Fi movie that is first among the Sci-Fi movies. A movie with an ID of 204 on the other hand is a Horror movie that is the fourth among the Horror movies.
Issues
(add or delete as many as necessary)\
Issue:
Description:

Merge request approved. POG.
Proceed with writing into documentation.
Main potential issue I currently see is linking rentmovie and returnmovie with the customer ADT. Hopefully we can immediately resolve linking the two ADTs together.


ML-391 NeuralNetworks.ecl cannot learn the XOR problem

Fix back-propagation to re-weight after each datapoint rather than once per pass
across all datapoints (there was an error in the Stanford tutorial that was followed
in the original code).
Fix the logic in the NNClassify function to return the proper class label.
Recode back-propagation to run acceptably on a Thor cluster. Not paralellizable in the current form,
so only uses a single cluster node.  Recode LOOPs as local ITERATEs.
Add validation tests.
Add user documentation via ECLDoc comments.
Fix unprotected typedef in PBblas_v0/MakeR8Set that prevented running in my environment.

Signed-off-by: Roger Dev<EMAIL_ADDRESS>

@RogerDev

Removed the typedef and re-tested

@johnholt Please re-review


customise popup?

Hey,
Is there a way to customise the popup?

I'd like to change the font-family, the font-size, for instance.

I don't know which plugin installed it, maybe yours, but it's all in https://facelessuser.github.io/sublime-markdown-popups/styling/ :)
Packages/User/mdpopups.css

Indeed, this plugin has mdpopups as a dependency.

Okay! I'll add it to the readme. :)

Thanks for the contribution by the way!

Thanks to you! This plugin helps me a lot everyday. Makes my ST a bit more IDE but not too much (performance).


fix typo (Externals instead of Exernals)

if docs/SUMMARY.md is generated, it should be fixed on the generation part.

Thanks for the proposition, I'll let @cloudvenger validate the PR.

if docs/SUMMARY.md is generated, it should be fixed on the generation part.

It is not, so the fix suits it well :+1:


Improve testing

Hello @nir0s,
I believe that it would be nice to have tests for actual and upcoming Python versions.
These changes also:

declare support for Python 3.7 at setup.py
remove Python 3.3 from tox's envlist
remove deprecated sudo option from .travis.yml
fix typos

Best regards!

@Jamim LGTM. Please rebase on top of master.

Hello @nir0s,

Please rebase on top of master.

It's done.

It looks like Codecov checks got stuck for some reason.

ping @nir0s


feat(live preview): caches relationships

Description
Implements a simple relationship cache within Live Preview.

[x] I have read and understand the CONTRIBUTING.md document in this repository.

Type of change

[x] New feature (non-breaking change which adds functionality)

Checklist:

[x] I have added tests that prove my fix is effective or that my feature works
[x] Existing test suite passes locally with my changes

Yes awesome we hit the rate limit constant...

Hey @jacobsfletch nice fix!!! We already implemented it into a site where the live preview was very slow.
One thing is that it did not work right away for us the way you build it.
I had to move the cache object in the outer scope of the handleMessage function for it to function.
I saw that the cache object was not the same after everything resolved when I used:
setInterval(() => {
    console.log( cache)
}, 1000)

We use a lot of richtext (slate) media, maybe the issue is here, I don't know exactly.
I can provide more details if you want to, got not a lot of time at the moment :)
(etc)
let payloadLivePreviewFieldSchema // TODO: type this from `fieldSchemaToJSON` return type

const cache = new Map()

export const handleMessage = async <T>(args: {
(etc)

Yes awesome we hit the rate limit constant...

This likely another issue. API requests shouldn't be hit that much. Are you up to date with the latest versions? I've made some recent optimizations to how this all works. More to come.

API requests shouldn't be hit that much

Yes before using this fix we used version 0.1.6. But we have a sophisticated navigation structure characterized by numerous relationships with other pages.
Additionally, when a character is entered in the title field, the traverseFields function is activated. Without caching, this results in fetching each relation every time, leading to a significant performance impact, especially when typing 10 characters with 30 relations on the page

BUT this will likely end up being closed

I say let's push for releasing this feature as a temporary fix. It does the job of tackling performance problems on larger pages, especially when you've got 10 or more relations going on. It's a practical and much-needed improvement for the current situation.

batch requests instead of cache them

Yeah, going with that plan sounds like the way to go! Just loop through all the data, toss those IDs into a queue, hit a single call to fetch them, and boom, fill up that cache.
Also an idea: Why not consider a new live preview endpoint? It's like when you fetch a collection item with depth in the regular frontend.
Orrr throw in a web sockets into payload to subscribe to all the changes, you can have a shared editing experience and the live preview can connect over the web socket.

Their IDs would never change, and so the cache would return stale data unless purged in some way.

Totally get your point but fetching every time a user types a character does seem a bit much. Another option to consider could be setting a timeout to invalidate the cache after, say, x seconds. That way, you strike a balance between keeping things updated and not bombarding the server with requests every time someone makes a small edit.

I really appreciate your response @matthijs166. Cache is not off the table yet, but I'd like to see how far we can go without implementing any sort of cache. I think we can get 99% of the way there for the majority of use cases.

Yeah, going with that plan sounds like the way to go! Just loop through all the data, toss those IDs into a queue, hit a single call to fetch them, and boom, fill up that cache.

Yeeaaaaa you got it

Totally get your point but fetching every time a user types a character does seem a bit much.

Well this is definitely not the intended behavior and has since been fixed. Are you on the latest versions of payload and live preview? I also just opened #4306 which will take it a step further. The only time relationships should ever be fetched if when you add new ones (or move them around, which batching and/or caching will help alleviate).

Also an idea: Why not consider a new live preview endpoint? It's like when you fetch a collection item with depth in the regular frontend.

Interesting you mention this. I have played around with this, and even had it implemented at one time. But this only added complexity, and after batching, will probably only save on a negligible number of requests. It also almost feels like we're recreating the Payload API at that point too. Besides, this is precisely how the admin dashboard itself works. If you dropdown a relationship selector, for instance, you'll see the requests made in the network panel that populate the values beyond their IDs. They are not re-fetched when you drop the selector open again, bc the results are stored in state.

I think the way to go here is to actually batch requests instead of cache them. This way, even if you have 30+ relationships, only one or two requests might ever be needed to populate every single one of them (the exact number would depend on the number of collections you are referencing, etc.).

I just opened #4315 which demonstrates this, check it out!

Awesome job!! 💪  I will look at it tonight

Interesting you mention this. I have played around with this, and even had it implemented at one time. But this only added complexity,

Ahhh, I can imagine..  Who knows, a topic to revisit if we got proper web sockets and shared editing in Payload
I will also check with the newest version if typing a new character will trigger a refetch or not. Sounds like it should all work smooth now!

@jacobsfletch Everything works like a charm! 💪 💪  💪  💪

That is such a relief, thank you for spinning this up so quickly 🙏


[Event Request] Codeunit 28000 "Post Code Check"

Describe the request
In the procedure VerifyCity can a new subscription be created at the end:
OnAfterValidateCity(Rec, CityTxt, PostCode, CountyTxt, CountryCode, UseDialog);
Similar to the Post Code table ValidateCity procedure
In the procedure VerifyPostCode can a subscription be created at the end:
OnAfterVerifyPostCode(Rec, CityTxt, PostCode, CountyTxt, CountryCode, UseDialog);
Similar to the Post Code table ValidatePostCode procedure
Additional context
These two procedures are run by the OnBeforeValidatePostCode and BeforeValidateCity and return handled, so they are run as a substitute to the W1 Post Code table validation, so should provide the same options for subscription in post code handling.
OnBeforeValidatePostCode(Rec, PostCode, CurrFieldNo, IsHandled);
if not IsHandled then
PostCode.ValidatePostCode(City, "Post Code", County, "Country/Region Code", (CurrFieldNo <> 0) and GuiAllowed);
            OnBeforeValidateCity(Rec, PostCode, CurrFieldNo, IsHandled);
            if not IsHandled then
                PostCode.ValidateCity(City, "Post Code", County, "Country/Region Code", (CurrFieldNo <> 0) and GuiAllowed);

Internal work item: AB#550427

Hi @RobynGee ,
Please specify exact variables that are needed for these two events.

local procedure OnAfterValidateCity(var PostCodeRec: Record "Post Code"; var CityTxt: Text[30]; var PostCode: Code[20]; var CountyTxt: Text[30]; var CountryCode: Code[10]; UseDialog: Boolean)
local procedure OnAfterValidatePostCode(var PostCodeRec: Record "Post Code"; var CityTxt: Text[30]; var PostCode: Code[20]; var CountyTxt: Text[30]; var CountryCode: Code[10]; UseDialog: Boolean)

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. Please do not reply to this, as we do not monitor closed issues. If you have follow-up questions or requests, please create a new issue where you reference this one.
Build ID: 27687.


[BUG] Large concat task time in GpuShuffleCoalesce with pinned memory pool

Describe the bug
We had a case reported where the GpuShuffleCoalesce had a very large task time (51 seconds) in the concat batch phase.  This was a weird case where we had a huge number of input batches due to the number of partitions being specified but then AQE kicking in to change the number of reducers to be much less.  In this case we had like 4000ish map task and num partitions was set at 2001.  This results in the roughly 8 million columnar batches and AQE decided it only needed 167 reduce tasks instead of 2001.
GpuShuffleCoalesce

concat batch time total (min, med, max (stageId: taskId))
14.8 m (63 ms, 3.1 s, 51.0 s (stage 4.0: task 4336))
number of output columnar batches: 167
number of input rows: 88,213,700
number of input columnar batches: 8,211,445

I've only been able to reproduce it on DataProc for some reason and requires pinned memory to be enabled.
I ran some jstacks during this time and the tasks were in the pinned memory pool allocate and free.
to reproduce:
configs:
-executor-cores=2 --conf spark.rapids.sql.concurrentGpuTasks=2 --conf spark.sql.shuffle.partitions=2001 --conf spark.sql.adaptive.enabled=true --conf spark.rapids.memory.pinnedPool.size=2G
val df = sc.makeRDD((1 to 8000000).map(x => s"bad$x"), 4102).toDF
df.filter("value != 'foo'").groupBy("value").sum().write.mode("overwrite").parquet("sumout1")

Fixed by #1909


Slug option containing multiple consequent dashes not working as expected

Describe the bug

When using multiple dashes in slug template of folder collections like this:
slug: "{{year}}_{{month}}_{{day}}_{{hour}}_{{minute}}_{{second}}---{{slug}}"

newly created articles have one dash instead of three (as one would hope).
To Reproduce

Just use the slug template provided above
Expected behavior

I expect slug to be
2019_01_15_08_20_12---sample-article.md
but I'm getting
2019_01_15_08_20_12-sample-article.md
Screenshots

Applicable Versions:

Netlify CMS version: netlify-cms 2.3.3

Additional context

This is crucial for me, as I do some string manipulations to generate prettier filenames in Gatsby.

First time contributor - hope I did ok!

I mentioned this on @adamwatters' (awesome) PR, but I missed that this will be a breaking change, as folks' build systems will be configured to handle slugs in the current way. I happened to run into this issue in the deploy preview links PR (#2028), which introduces preview_path, a field that works exactly the same as slug. It was critical for static parts of preview_path to be completely untouched - turned out that addressing this was nowhere near as simple as I thought.
I introduced the path forward in the PR mentioned above, and we'll transition slug to work the same way in 3.0, which is not too far off.
@selrond happy to help you find a workaround - maybe instead of --- as a separator you can use something like -_-?

@erquhart well, that's unfortunate... I've settled on ___ (three underscores) but this definitely needs to get addressed or at least clearly documented - it's doing something unexpected with no obvious explanation

Agreed, documenting would help until 3.0, would accept a PR if anyone is up for adding.


Community: Broken link

Hi.
The main page of the project points to a support community at a web site which seems to have its domain expired and doesn't work anymore. Is there an alternative recommended way where I could reach the community of users of Shapely to ask a question ?
Thanks

There is a fairly active community on GIS.SE: https://gis.stackexchange.com/questions/tagged/shapely

I'll second this. If you tag your question with "shapely" on GIS-SE it will
be seen by a bunch of knowledgeable folks.
If you have questions or concerns about development of the software itself,
don't hesitate to open a new issue here.
On Nov 18, 2016 12:03 PM, "Joshua Arnott"<EMAIL_ADDRESS>wrote:
There is a fairly active community on GIS.SE: https://gis.stackexchange.com/
questions/tagged/shapely
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/Toblerity/Shapely/issues/430#issuecomment-261506095,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AACDoYpgHbF_VKoMZ6ojCSae8iUOYjixks5q_YYOgaJpZM4K2VqA
.


intel(0): [drm] failed to set drm interface version: Permission denied [13].

I am using a trusty chroot, if I try to run startxfce4 before accessing with a ChromeOS session, then it fails:
[    46.582] (EE) intel(0): [drm] failed to set drm interface version: Permission denied [13].
[    46.582] (EE) intel(0): Failed to claim DRM device.
[    46.582] (II) UnloadModule: "intel"
[    46.582] (EE) Screen(s) found, but none have a usable configuration.

If instead I try the same command after logging in & logging out, it works correctly.
See full Xorg.1.log here
I have checked the permissions of /dev/dri but they don't change with a login/logout, so obviously it's not that.
Is this is a known issue?
For the records: yes, I updated crouton after last ChromeOS update.

Possibly related? https://github.com/Bumblebee-Project/Bumblebee/issues/580

Don't launch graphical chroots from VT2.  Launch them from crosh shells (ctrl+alt+t).

@dnschneid that means I need to login first, it's something I wanted to avoid.

You can go into guest mode as well.


⚠ Processors has degraded performance

In a5e02ab, Processors ($STATUS_URL) experienced degraded performance:

HTTP code: 200
Response time: 45 ms

Resolved: Processors performance has improved in 274304f.


Set jpeg quality from 0 to 100

Is there any way to set the jpeg quality from 0 to 100?

Hello,
You can set the quality using jpeg.Encode function directly, e.g.:
err := jpeg.Encode(w, img, &jpeg.Options{Quality: 70})

See http://godoc.org/image/jpeg#Encode
As for imaging.Save function, it doesn't support any additional options.


Adapt content to style guide

This PR adapts existing content (except for vintage and changes) to our style guide, so that we get a consistent starting point with minimal linter warnings.
There is one error remaining which I don't know how to get rid of:
 src/content/reference/fleet-management/clusters/migration_to_cluster_api.md
 56:35  error  Avoid using 'k8s'.  Vale.Avoid

This comes from the app name k8s-initiator-app. We still have to find out how to make exclusions for a term. I could add an exclusion comment above the paragraph. But that would mean that for the entire paragraph, all Vale.Avoid rules would become inactive. I don't want that.
This PR also shows me that despite that error, the Vale check for this PR appears as successful. This has to be fixed separately, too.

LGTM maybe closing the app name between quotes will solve it (though it means we need to do it for all)

Indeed, backtick comments would work, but I think it's the wrong thing to do, in terms of style/formatting.


Edge this.userId set to null

While using Edge 38.14393.0.0 we are facing an issue where context of options "protect" and "downloadCallback" has this.userId === null and this.user() === null.
Demo code
We have created a small demo app showing an issue: https://bitbucket.org/CallMeMB/files-test
Demo will return false from downloadCallback if userId is not set
How to reproduce:

Start demo app
Load application in Edge
Login into user account
Download file (it will be successfull)
Reload the page (ctrl+r)
Download file (it will fail)

Expected result:
File will always be downloaded
Versions:
Meteor: <IP_ADDRESS>
Packages:

<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>
Npm packages:

gridfs-stream 1.1.1

Server OS:
Windows 10 Professional (development machine, localhost)
Linux (docker container, test/production env)

Hello @Kaczkazniszczenia ,

What happens between steps 5 and 6, why user is not logged-in?
Could you obtain request headers (including cookies) on steps 4 and 6, and compare (diff) it? What the difference?

Meanwhile you should take a look at this code, may be authorization via cookies isn't suitable for you and you would like to use gwt query.

Hello @dr-dimitru ,
There is nothing between 4 and 5. Reload the page and click the download link.
Meteor see user as logged in all time.
Headers looks exactly the same (on success and failure).
   Accept: */*
   Accept-Encoding: gzip, deflate
   Connection: Keep-Alive
   Cookie: x_mtok=FoYb3fehJZyGFGEfo
   Host: localhost:3000
   Referer: http://localhost:3000/
   User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.79 Safari/537.36 Edge/14.14393

Hack with get parameter (shown in link) is working but I don't see it as a proper solution, more like temporary workaround since this.userId work correctly on other browsers.
BTW. no issues on other browsers.

Value of x_mtok is new on every login. Is there a chance this cookie remains the same between page refresh? Also life-time of this cookie is session since v1.7.7
What meteor and package version you're on?

I've set up testing server under http://files.test.oknonews.com/
How to use:

You can login using account displayed in top left corner
context of last (on server) file request is displayed under login ui
context is refreshing in protect() option
each file is downloadable using two interfaces 'Param send ...' and 'Redirect ...' (more below)
to use redirect ui you need to be logged in

Request context:

User context id: userId got from cookie (default Meteor-files behavior)
User x-mtok id: userId got using Meteor.server.sessions[ Client param x-mtok ]
Client param x-mtok: session token got from "Meteor.connection._lastSessionId" and send by url param
Server sessions: list of active sessions

Download interface:

Param send ... : solution used from https://github.com/thomasspiesser/ostrio-files-bug/pull/1/files
Redirect ... : similar to "Param send" but appends x-mtok differently. File download url is showing on link were user is redirected to file.link() with x-mtok glued. (again, blocked for not logged in users)

Observations:

after page refresh User context id is lost
if using Redirect interface, there is strong possibility  Server sessions wont contain Client param x-mtok

Meteor-files show same tendensy as Redirect interface described before.
file files.coffe, line 1177, function _getUser
After refreshing page, value mtok from cookie tends to not match any of Meteor.server.sessions values, so in line 1194 if statment returns false.

I have found root of a problem.
Accounts.onLogin event does not trigger on page reload (only on Misscossoft Edge)
I fixed it using Meteor.startup.
I would like you to review this pull request, if there is something wrong please notify me about it.

PR is merged and package is published as v1.7.12, thank you for contribution


Lockstep enabled prevents trade

DF & AI will just wait at the trade window until ai disable lockstep is preformed

Just so I'm sure I'm checking the right version, what does ai version say?

Dwarf Fortress 0.43.05
Windows 64-bit
df-ai 0.43.05-r2-54-ged61dab4
code ed61dab468ef93c174a9bc3131c5fcf6bc5aa15e
DFHack 0.43.05-r2-48-g0ee421a9
library 0ee421a9d40881a05aa5b382637148bdbe66ecb9
structures 3322beb2e7f4b28ff8e573e9bec738c77026b8e9

Hmm, do you have any tweak commands in your dfhack.init? If possible, could you post your dfhack.init here?

dfhack.init - https://gist.github.com/mattregul/3db77f1d815496bafc675abb788d7113#file-dfhack-init
my launcher - https://gist.github.com/mattregul/3db77f1d815496bafc675abb788d7113#gistcomment-2240134

I do have this in my onMapLoad_PeridexisErrant.init
repeat -time 1 -timeUnits months -command [ quicksave ] -name autosave
Quicksaving every season to help recover from crashes

I wasn't able to reproduce a freeze when trading with lockstep enabled, but I did notice that the default onLoad.init-example that comes with DFHack causes some dialogue boxes to appear when dwarves are thirsty or stuck in trees. Are there any messages in the DFHack console related to an unexpected viewscreen or a pause of some kind?

Two items:

I updated to the latest version of df-ai, now I don't seem to be hanging on trade now.  Either its fixed, or its intermittent.   Maybe move the bug to a "monitoring" state?
Unsure, as I found the "thirsty" dialog annoying, so I removed the command for onLoad after the first time seeing it.

All works fine on latest builds with enabled lockstep


Some questions about the paper

Dear authors, thanks for sharing your nice work! I have some minor questions about the paper:

For the divide and conquer algorithm: You have 2D tracking and depth priors, why don't you just lift the 2D trajectories to 3D?
In Tab. 5, the ablations show that the rendering performance does not drop when you remove the segmentation and tracking part. Does it mean that segmentation and tracking prior is not a must?

Hello, thanks for the questions!

We originally found 2D trajectories from CoTracker to be unreliable, especially for longer term tracking (say more than 30 frames). Because of this, we opted for our divide and conquer to build trajectories, which uses CoTracker as one part of its supervision, but does not rely on it as much as initializing with lifted 3D trajectories. However, it seems that concurrent works such as MoSca and Shape of Motion do this lifting. I haven't had the time to evaluate which is better, but my intuition is that lifting 2D trajectories to 3D is faster to optimize, but is also more likely to fail in the presence tracking and depth errors.

I intend to do a more thorough ablation because I've found that importance of the different losses can vary greatly depending on the scene. On the Nvidia scenes used in the ablation, respectively removing the segmentation and tracking losses did not have much of an effect (which I found surprising) -- my best intuition is that these scenes are exhibit fairly "easy" motion, so other losses can compensate when one is removed. However, I personally don't think this is typical, and I hope to have numbers to support this soon.

Thank you for your fast and informative reply, wish you a nice day!


Add Viewer Type : Ellipsoid

Hi, thank you for good feature for viewing 3DGS.
Have you plan to add feature view type : ellipsoids like 3dgs SIBF viewers

I share the same opinion. Do you have any plans to add the Splats feature? I'd like to visualize points in 3D space.


ERROR: No video formats found;

Checklist

[x] I'm reporting a broken site support issue
[x] I've verified that I'm running youtube-dl version 2021.04.26
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar bug reports including closed ones
[x] I've read bugs section in FAQ

Verbose log

[debug] System config: []
[debug] User config: ['--abort-on-error', '--no-warnings', '--console-title', '--batch-file=batch-file.txt', '--user-agent', 'Mozilla/5.0 (X11; Linux i686; rv:21.0) Gecko/20100101 Firefox/21.0', '--cookies', 'cookies.txt', '--socket-timeout', '10', '--retries', '10', '--continue', '--fragment-retries', '10', '--min-sleep-interval', '60', '--max-sleep-interval', '300', '--max-downloads', '150', '-f', 'best[height<=720]/worst[height>720]', '-o', '%(playlist_title)s/%(chapter_number)s - %(chapter)s/%(playlist_index)d-%(title)s.%(ext)s']
[debug] Custom config: []
[debug] Command-line args: ['--verbose']
[debug] Batch file urls: ['https://app.pluralsight.com/library/courses/google-cloud-platform-fundamentals-core-infrastructure/table-of-contents']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2021.04.26
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.19041
[debug] exe versions: none
[debug] Proxy map: {}
[pluralsight:course] google-cloud-platform-fundamentals-core-infrastructure: Downloading JSON metadata
[download] Downloading playlist: Google Cloud Platform Fundamentals - Core Infrastructure
[pluralsight:course] playlist Google Cloud Platform Fundamentals - Core Infrastructure: Collected 66 video ids (downloading 66 of them)
[download] Downloading video 1 of 66
[pluralsight] bb96b36c-3f87-4530-bf35-6cedcdfa9866-0: Downloading JSON metadata
[pluralsight] bb96b36c-3f87-4530-bf35-6cedcdfa9866-0: Downloading mp4-high-widescreen viewclip graphql
[pluralsight] bb96b36c-3f87-4530-bf35-6cedcdfa9866-0: Downloading mp4-high-widescreen viewclip JSON
[pluralsight] bb96b36c-3f87-4530-bf35-6cedcdfa9866-0: Waiting for 10 seconds to avoid throttling
ERROR: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpeav8wi2f\build\youtube_dl\YoutubeDL.py", line 806, in wrapper
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpeav8wi2f\build\youtube_dl\YoutubeDL.py", line 827, in __extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpeav8wi2f\build\youtube_dl\extractor\common.py", line 534, in extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpeav8wi2f\build\youtube_dl\extractor\pluralsight.py", line 421, in _real_extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpeav8wi2f\build\youtube_dl\extractor\common.py", line 1374, in _sort_formats
youtube_dl.utils.ExtractorError: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Description

It said No video formats found

I just ran into the same issue, but the issue is limited to youtube playlists for me (for me, my watch later playlist). When I downloaded the individual files using "-a" and removing the playlist "&list=" portion of the URL, they all download fine.

@tuannv1104 I just had this issue, and tested this quite a bit. The bug is with using --cookies along with an expired cookie file. Delete your cookies.txt and recreate, then try again; that worked for me. Or, remove --cookies from your config file and that also works.
I've never had this happen before, but it also bugged out youtube-dlc for me as well, using the same cookies.txt file.

@cameronetchart thanks for your help. I tried to remove --cookies from youtube-dl.conf and the error still happen.
My config file is:
--abort-on-error  --no-warnings  --console-title  --batch-file='batch-file.txt'  --user-agent "Mozilla/5.0 (X11; Linux i686; rv:21.0) Gecko/20100101 Firefox/21.0"  --socket-timeout 10  --retries 10  --continue  --fragment-retries 10  --min-sleep-interval 60  --max-sleep-interval 300  --max-downloads 150  -f 'best[height<=720]/worst[height>720]'  -o '%(playlist_title)s/%(chapter_number)s - %(chapter)s/%(playlist_index)d-%(title)s.%(ext)s'

I have the very same error when I try to only get JSON info from video, I have "-s" option to skip downloading. My command looks like this:
youtube-dl --verbose --skip-download -j YOUTUBE_URL
I run it for every URL saved in archive file (around 30 movies). In consecutive 10 runs I got this error 1 or 2 times.
I will check if it could be a YT counteraction by making random sleeps between downloads and will report here.

@tuannv1104 what I would try next is removing your config file entirely,
see if it works. If it does, start adding back your config entries until
you find the one that causes the error. That's what I had to do to find the
--cookies error. But if the downloads fail entirely even without any config
entries in youtube-dl.conf, then I'm out of ideas unfortunately.
I did this testing with the -F flag to make testing quicker.
On Thu, May 13, 2021 at 3:23 AM bitounu @.***> wrote:

I have the very same error when I try to only get JSON info from video, I
have "-s" option to skip downloading. My command looks like this:
youtube-dl --verbose --skip-download -j YOUTUBE_URL
I run it for every URL saved in archive file (around 30 movies). In
consecutive 10 runs I got this error 1 or 2 times.
I will check if it could be a YT counteraction by making random sleeps
between downloads and will report here.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/ytdl-org/youtube-dl/issues/29017#issuecomment-840374166,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABPVSSXNEDVGRFRA37D4CJDTNN5AZANCNFSM44QV5XGQ
.


One square next to each other

Should final mesh be symmetric ?

Example_1.para.txt

I will attach correct input file this evening

Hey there,
thank you so much for pointing out this error and sorry for my late response - unfortunately I don't have much spare time at the moment for this project - hopefully this will change in some weeks...
I looked at your example file and found out, that it is possible to achieve a symmetry, if the vertices of the second mesh are slightly arranged (see the updated file attached to this message). In your given parameter file, the first edge of the second mesh was attached to the other mesh and that probably led to this bug. I will try to fix it in for a future release.
Thanks again for pointing this out! :-)
Greetings
Flo

Example_1_updated.para.txt

Hi Florian,
I have been using TQMesh for a week. It's a very useful tool for creating 2D meshes with quality! I had a similar problem to the above one but with refinements. I have been looking into the source code trying to solve it but had no clue. Luckily I found this discussion and this trick solved my issue. Many thanks!
But why this works and which part of the code relates to this? could you shed some light here.
Regards,
Fei

Hello Fei,
sorry for my late response and thank you so much for your kind words!
I just finished a new release (v1.3) where this problem is partly resolved - this is the output from the initial input file without using the re-arrangement trick (bug_issue12_commit76a4813.txt).

The reason for the asymmetry is the following: When we start a the generation of a mesh, we typically choose the largest boundary edge for the first advancing front triangle. Since all edges in this example are of equal length, that one is chosen which has been defined first.
In the provided input file, the first defined edge of the right mesh is located at the bottom side, whereas the first defined edge of the left mesh is located on its right side (the interface where both meshes touch).
I hope I could help you with this explanation.
Greetings
Flo

Hi Florian,
Many thanks for your detailed reply! Congratulations on your new release!
Recently I found the 'develop' branch and I see you have made a lot of
improvements there and of course the new release.
The mesh quality especially the quad-layer generation is much higher than
the previous release! 👍
Recently, I have been using TQMesh for meshing a semiconductor device that
needs lots of quad layers.
Sometimes, I encounter a problem that happens when the height of the quad
layer approaches the mesh size. Here I enclose an example .para file and
the mesh figure (generated from v1.3).
I am new to C++, I am struggling to read the source code. Can you help me
solve this problem?
I would be grateful if you give me a hand at your convenience.
Regards,
Fei
Florian Setzwein @.***> 于2023年8月27日周日 23:35写道：

Hello Fei,
sorry for my late response and thank you so much for your kind words!
I just finished a new release (v1.3) where this problem is partly resolved

this is the output from the initial input file without using the
re-arrangement trick (bug_issue12_commit76a4813.txt
https://github.com/FloSewn/TQMesh/files/12448304/bug_issue12_commit76a4813.txt
).

[image: bug_issue12_commit76a4813]
https://user-images.githubusercontent.com/69447532/263538585-4593eb15-68f7-4da2-8f57-7ee2ca8f11f9.png
The reason for the asymmetry is the following: When we start a the
generation of a mesh, we typically choose the largest boundary edge for the
first advancing front triangle. Since all edges in this example are of
equal length, that one is chosen which has been defined first.
In the provided input file, the first defined edge of the right mesh is
located at the bottom side, whereas the first defined edge of the left mesh
is located on its right side (the interface where both meshes touch).
I hope I could help you with this explanation.
Greetings
Flo
—
Reply to this email directly, view it on GitHub
https://github.com/FloSewn/TQMesh/issues/12#issuecomment-1694697637, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ANVRALJI6EGQNUWGZZUDV5DXXNSLVANCNFSM6AAAAAAVIDAJ4Q
.
You are receiving this because you commented.Message ID:
@.***>

It seems the attachments from the email are not showing up. I put them here.

Example_quadlayer.txt

Hey Fei,
that is an interesting bug! Thank you so much for pointing it out :-)
I will try to take a look at this problem in the coming days.
But if you need an ad-hoc solution, you can try to change the variable "range_factor_" (in the file "src/algorithm/QuadLayerStrategy.h", line 972) from a value of 1.1 to a value of 0.9 - this solved the problem for your example.
Unfortunately, a smaller value leads to problems during the quad layer generation when dealing with sharp edges, so it is not a general solution...
Anyways, thanks again for your help!
By the way: I'm curious what you're working on (just in case you want to write about it).
What kind of semiconductor application are you simulating and what software do you use? I wasn't aware that these kind of meshes are also of interest for such problems - very cool!
Kind regards,
Flo

Hi Florian,
Thanks for your interest : )
I tried the value 0.9 for the "range_factor_", the mesh is perfect for a rectangular area. Many thanks for pointing it out!
Btw, I am not sure if it's a bug, since this kind of mesh is quite different from a typical CFD mesh. I hope the fix will not take you much time.
Now I am trying to improve the quad-layer quality for a wedge-shaped area. The quad-layer front curls gradually at the end when the height is approaching local mesh size. I guess this relates to the functions "place_start_vertex()" and "place_end_vertex()" in the QuadLayerStrategy.h. Is it a good guess? 😊
Btw, I am not sure if it's a bug, since this kind of mesh is quite different from a typical CFD mesh. I hope the fix will not take you much time.
For your curious questions 😊, I am a CFDer, I used to use Ansys Fluent and OpenFOAM for simulating blood flows. Now I am looking for a position in the semiconductor industry. Currently, I started learning C++, the physics, and numerics for semiconductor devices (not on a specific application). So basically I am learning the solver algorithms and of course the mesh generation algorithms 😊 for a better understanding of simulation software. I am not about to write something currently but if I do and it relates to TQMesh, your work will definitely be cited.
Let's keep in touch.😉
Regards,
Fei

Hey Fei,
that is an interesting bug! Thank you so much for pointing it out :-)
I will try to take a look at this problem in the coming days. But if you need an ad-hoc solution, you can try to change the variable "range_factor_" (in the file "src/algorithm/QuadLayerStrategy.h", line 972) from a value of 1.1 to a value of 0.9 - this solved the problem for your example.
Unfortunately, a smaller value leads to problems during the quad layer generation when dealing with sharp edges, so it is not a general solution...
Anyways, thanks again for your help!
By the way: I'm curious what you're working on (just in case you want to write about it). What kind of semiconductor application are you simulating and what software do you use? I wasn't aware that these kind of meshes are also of interest for such problems - very cool!
Kind regards, Flo

Hi Florian,
Thanks for your interest : )
I tried the value 0.9 for the "range_factor_", the mesh is perfect for a rectangular area. Many thanks for pointing it out!
Btw, I am not sure if it's a bug, since this kind of mesh is quite different from a typical CFD mesh. I hope the fix will not take you much time.
Now I am trying to improve the quad-layer quality for a wedge-shaped area. The quad-layer front curls gradually at the end when the height is approaching local mesh size. I guess this relates to the functions "place_start_vertex()" and "place_end_vertex()" in the QuadLayerStrategy.h. Is it a good guess? 😊
Btw, I am not sure if it's a bug, since this kind of mesh is quite different from a typical CFD mesh. I hope the fix will not take you much time.
For your curious questions 😊, I am a CFDer, I used to use Ansys Fluent and OpenFOAM for simulating blood flows. Now I am looking for a position in the semiconductor industry. Currently, I started learning C++, the physics, and numerics for semiconductor devices (not on a specific application). So basically I am learning the solver algorithms and of course the mesh generation algorithms 😊 for a better understanding of simulation software. I am not about to write something currently but if I do and it relates to TQMesh, your work will definitely be cited.
Let's keep in touch.😉
Regards,
Fei


helpers.getNumberOfLines() allocates quite a bit of memory

Filing this as a tracker for https://github.com/nodejs/node/issues/17362

(Note: in the image, it doesn't report the intermediary getNumberOfLines())

see answers on https://github.com/nodejs/node/issues/17362
It's basically due to the internal structure of strings in V8 (concat strings are represented as trees or arrays and are flattened out before certain operations).


Can't get transactions for address

0xe2FAc00709FfBDB0b804A1a551eE3e1fDD0FB4E5

Can't reproduce, more likely RPC related issue.


maxlength validator does not work is field value is NULL

It produces this error:
"Lenth assert must be instanciated with a { min: x, max: y } object"

length, or maxlength?
"field value is null" means?
Please read this

When the value of an input is === NULL

Please read this


Better description

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 99.72%. Comparing base (e4daff8) to head (7a9ec75).

Additional details and impacted files
@@           Coverage Diff           @@
##           master      #73   +/-   ##
=======================================
  Coverage   99.72%   99.72%
=======================================
  Files           6        6
  Lines         718      718
  Branches      164      164
=======================================
  Hits          716      716
  Misses          1        1
  Partials        1        1

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.