bep(catalog): Propose adding support for metadata on relations.

Hey, I just made a Pull Request!
I had my BEP ID taken not once but twice working on this :shaking_fist:
This BEP builds on commentary on https://github.com/backstage/backstage/pull/21560 and https://github.com/backstage/backstage/pull/22130. It should answer the questions I raised in https://github.com/backstage/backstage/pull/22130 about design concern.
cc: @freben @backstage/catalog-maintainers
:heavy_check_mark: Checklist

[ ] A changeset describing the change and affected packages. (more info)
[ ] Added or updated documentation
[ ] Tests for new functionality and regression tests for bug fixes
[ ] Screenshots attached (for UI changes)
[x] All your commits have a Signed-off-by line in the message. (more info)

@freben Appreciate you reading through it! I'm with you. Looking back at the text, most of the use of annotations was my brain mixing up "annotations" and "relations". I thought I'd updated them all, but quite a few slipped through. I definitely wasn't proposing multivariate annotations with this 😅 . I've since updated them to be relation which should clear up any issues there. I've also updated the doc to remove any mention of clientside access, it muddies the argument and doesn't need a defined path forward as part of this work.
When you reference "entity mutations", was that part of the multivariate annotations or a separate piece of the doc?
That just leaves the stitching loop changes, storage, de-duplication and the input format which IMO are much easier to align on/focus discussion on.

@freben Appreciate you reading through it! I'm with you. Looking back at the text, most of the use of annotations was my brain mixing up "annotations" and "relations". I thought I'd updated them all, but quite a few slipped through. I definitely wasn't proposing multivariate annotations with this 😅 . I've since updated them to be relation which should clear up any issues there. I've also updated the doc to remove any mention of clientside access, it muddies the argument and doesn't need a defined path forward as part of this work.

Nice! I'll give it a read-through again when I get the time.

When you reference "entity mutations", was that part of the multivariate annotations or a separate piece of the doc?

Yeah maybe I just read things wrong, but the text seemed to imply processors or something else actually changing the entity on the fly. Either in the catalog or on the reading end, like mutating annotations. Let's ignore that, I was probably confusing things.

That just leaves the stitching loop changes, storage, de-duplication and the input format which IMO are much easier to align on/focus discussion on.

Agreed. Possibly the input format is the most complex of those, but we can deal with that during the lifetime of the BEP I'm sure

Hey
I had a look over, I think this is promising but I've sent this to our PM and will let you know when I have feedback from him.

@Edje-C Any updates from your PM on this?


make error

nanzhi-MBP:hound nanzhi$ make
mkdir -p build/ui
rsync -r --exclude '.js' src/github.com/etsy/hound/ui/assets/ build/ui
jsx --no-cache-dir src/github.com/etsy/hound/ui/assets/js build/ui/js
unknown option: --no-cache-dir
make: *** [src/github.com/etsy/hound/ui/bindata.go] Error 1

Thanks. I really need to update the tools associated with react.

@deer-hope What version of react-tools are you using?
$ jsx --version
0.13.3

Actually, I suspect you installed JSX and not react-tools npm install react-tools (not npm install jsx)

Actually, I suspect you installed JSX and not react-tools npm install react-tools (not npm install jsx)


Etam issue on image not building in their particular AWS architecture

GSK-350
Check if we can support this architecture
Project: Giskard
Reporter: jmjm
Created: 2022-11-10

@jmsquare this one is fixed now isn't it? Did they manage to install Giskard on their ARM server?

fixed in v1.3.0


Remove ruamel.yaml dependency

ruamel.yaml is not supported by Pyodide, therefor we use PyYAML instead.
problem: PyYAML currently only supports yaml 1.1, whereas ruamel.yaml (what we used until now) defaults to yaml 1.2.
Differences: https://yaml.readthedocs.io/en/latest/pyyaml.html#defaulting-to-yaml-1-2-support
The one difference that might be most relevant for us: "correct parsing of floating point scalars with exponentials" is added manually to the current ruamel.yaml replacement.
see https://github.com/yaml/pyyaml/issues/173 and https://stackoverflow.com/questions/30458977/yaml-loads-5e-6-as-string-and-not-a-number.
Also note that not all valid json is compatible with yaml 1.1 (but with yaml 1.2).
With this yaml 1.1/1.2 hybrid we should be good for now and can hopefully switch easily to the full yaml 1.2 in the future.

fixes #209

@FynnBe Great! Could you make a new release so we can try it with pyodide?

sure, let's wait for https://github.com/bioimage-io/spec-bioimage-io/pull/214 to be merged and then go ahead with a little new release


python312Packages.trimesh: 4.4.6 -> 4.4.7

Changelog: https://github.com/mikedh/trimesh/releases/tag/4.4.7
Description of changes

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

cura is broken on hydra https://hydra.nixos.org/build/269974918


bug: instructions box appears below the time-frame selection box

Prerequisites

[X] I am an Open Source Contributor
[X] I checked to make sure that this issue has not already been filed

Description
When player is in the time-frame selection window, and wants to see the instructions, the instruction box appears below the time-frame selection box.
Screenshots

Code of Conduct

[X] I follow Contributing Guidelines of this project.

Made the PR fixing the issue @Rakesh9100


Editor is blank

this may be just in preprod, but as an example,
https://mdx.airview.preprod.airwalkconsulting.io/docs/edit/feature%2FAI-Project-Documentation/services/aws_dynamodb/_index.md
I edited this page, pressed save. then the editor goes blank. refreshing the page, it's still blank, even though the correct content is returned from the API (it must have saved properly)
maybe something to do with the websockets collaboration? I dont think we have that in prepared yet, so maybe a failure of that causes the editor to misbehave a bit

looks to be the websockets yeah, not sure if the new command is included in the pipeline? Was struggling to see where all of that takes place


Any plans on releasing the code?

Any plans on releasing the code?

Any plans on releasing the code?

We will release the code next month, probably after the CVPR deadline, thanks for your patience.


Arctan2 gradient explosion for small inputs

Description
Arctan2 seems to have a large gradient when the inputs are small. If training a neural network, this blows up the weights, destroying the network. I believe the gradient of arctan2 should be clamped to 1.0.
This behavior does not seem to be present in arctan
import jax
import jax.numpy as jnp
print(jax.grad(jnp.arctan2)(1e-10, 1e-10))
# Array(5.e+09, dtype=float32, weak_type=True)

print(jax.grad(jnp.arctan)(1e-10 / 1e-10))
# Array(0.5 dtype=float32, weak_type=True)

Related to https://github.com/google/jax/issues/15407
What jax/jaxlib version are you using?
0.4.19
Which accelerator(s) are you using?
GPU
Additional system info
No response
NVIDIA GPU info
GeForce RTX 2080 Ti
cuda==12.2.140

Hi - thanks for the report. It looks to me like the gradient is returning the expected result – analytically, the gradient is
$$
\frac{\partial}{\partial y}{\rm atan2}(y, x) = \frac{-y}{x^2 + y^2} \
\frac{\partial}{\partial x}{\rm atan2}(y, x) = \frac{x}{x^2 + y^2}
$$
It's clear here that as x and y approach zero, both partial derivatives diverge.
On the other hand, the derivative of arctan is:
$$
\frac{\rm d}{{\rm d}x} {\rm arctan}(x) = \frac{1}{1 + x^2}
$$
so as x approaches zero, the derivative approaches 1.
Both seem consistent with the output you're seeing from JAX. What do you think?

Whoops, good point. Even though arctan is well-behaved, I suppose the division in a neural network is really the issue (we explicitly divide when calling arctan(y / x), where as arctan2(y, x) divides implicitly).
I am not sure how good of an idea it is, but I can clamp the gradient from arctan to be in [-1, 1] to prevent these explosions (at the cost of slower convergence). Is this the correct way to do so?

import jax
import jax.numpy as jnp

@jax.custom_vjp
def clamped_atan2(y, x):
    return jnp.arctan2(y, x)

def clamped_atan2_f(y, x):
    return clamped_atan2(y, x), (y, x)

def clamped_atan2_b(res, g):
    y, x = res
    # Compute the gradients with respect to y and x
    dy = jax.grad(jnp.arctan2, argnums=0)(y, x)
    dx = jax.grad(jnp.arctan2, argnums=1)(y, x)

    # Clip the gradients
    dy_clipped = jnp.clip(dy, a_min=-1.0, a_max=1.0)
    dx_clipped = jnp.clip(dx, a_min=-1.0, a_max=1.0)

    # Return the product of the clipped gradients and the upstream gradient
    return g * dy_clipped, g * dx_clipped

clamped_atan2.defvjp(clamped_atan2_f, clamped_atan2_b)

standard_fn = lambda y, x: jnp.arctan2(y, x**2)
clamped_fn = lambda y, x: clamped_atan2(y, x**2)

# Test it does the right thing when the grad is small
y = jnp.array(2.0)
x = jnp.array(1.0)
standard = standard_fn(y, x)
clamped = clamped_fn(y, x)
standard_g = jax.grad(standard_fn)(y, x)
clamped_g = jax.grad(clamped_fn)(y, x)

print(standard, clamped) # 1.1071488 1.1071488
print(standard_g, clamped_g) # 0.2 0.2

# Test it does the right thing when the grad is big
y = jnp.array(2e-15)
x = jnp.array(1e-10)
standard = standard_fn(y, x)
clamped = clamped_fn(y, x)
standard_g = jax.grad(standard_fn)(y, x)
clamped_g = jax.grad(clamped_fn)(y, x)

print(standard, clamped) # 0.0 0.0
print(standard_g, clamped_g) #<PHONE_NUMBER>.0 1.0

You haven't said much about where you're using this function, but I would be hesitant to create custom autodiff rules that are deliberately producing incorrect derivatives for the function you're evaluating. I wonder if you might have better luck choosing an alternative function which has better-behaved derivatives in the domains you're interested in?


Add return to active view button

Add the same "view" button to return to the active view (from the historical view) to the roles-assignments view (there is no button). Let me close this one and add a new one for this.

It's not the same thing here
For role assignment we are talking about archived proposals
while for assignment it's active but expired assignment object


StateMachine client on PAB needs a lookup in order to mint ThreadToken

Describe the feature you'd like
I've been trying to run a simple state machine on PAB over Cardano Testnet as follows:
tt <- getThreadToken
logInfo @String $ "tt to be mint: " <> show tt   -- Show an UTXO owned by me (all my local components in sync with Testnet)
void $ runInitialise client (GameDatum x) v      -- Fail here with TxOutRefNotFound error.

However when I run it, fails with a TxOutRefNotFound error. I've checked that the UTXO obtained from getThreadToken really exists and keeps unspent. However, for some reason, at the time of minting fails because PAB can't find it.
As far I understand this should work.
On the other hand, if I run previous code on EmulatorTrace works as expected.
I don't know whether this is the expected behaviour.
This has been tested using tag:6e3f6a59d64f6d4cd9d38bf263972adaf4f7b244  ( https://github.com/input-output-hk/plutus-apps.git )
Describe alternatives you've considered
I could workaround the issue by adding a lookup with the UTXO ref as follows:
tt <- getThreadToken
logInfo @String $ "tt to be mint: " <> show tt   -- Show an UTXO owned by me (all my local components in sync with Testnet)
let ttUtxoRef = ttOutRef tt
ttUtxoMap <- txOutFromRef ttUtxoRef >>= maybe (throwError "utxo not found") (return . Map.singleton ttUtxoRef)
void $ runInitialiseWith (Constraints.unspentOutputs ttUtxoMap) mempty client (GameDatum x) v

Did you include tt in the client variable? Ex. client = machineClient inst tt params? As a reference point, look at the Auction example in plutus-use-cases.
Also, it is normal that the tt is not a utxo yet. When you use getThreadToken, it does not actually submit a transaction in the blockchain for creating the thread token.


CI/CD - automated event creation without manual input

To enable simple easy automated event creation without manual input
Right now, we have GitHub actions which will deploy the website on a new commit to master.
There is a lot missing from the rest of the process. But we are in a good place to start the way we want to go on
https://twitter.com/mipsytipsy/status/1340958240184516611?s=20
I'll start a list, please add to it.

Automated Testing

Are you planning to use the PR mechanism for "approving" new events?  This would fit in with #4 , assuming Jekyll, Hugo, or similar, so a requester could preview the site with their changes locally, then create a PR to add their event to the public site.

OK, I wasn't paying attention, there's already a Jekyll site!

@gavincampbell  I think that is still a good (open-ish) question. So far it looks like we're semi-manually or manually generating individual pages, which is going to start adding some tech debt to cleanup once we standardize and need to go back and change things.
I think one of the first things to decide on is Jekyll, Hugo, Vuepress, etc. so that we can start building out stuff The Right Way ™ .
@SQLDBAWithABeard can you convert this to a discussion also?

I think we need something. I added events 2, 3, (and 4, 5 today), but I'm manually editing things. Some of that is fine, but over time, we need a better solution.

assign number somehow
automated test - check date against event brite
automated test - validate links do not return 404
automated test - if no link for speakers, include coming soon
automated test - if no link for registration, coming soon
check an email contact is listed.

I don't care what type of site. Static is likely completely fine for now, so we need a platform. I have no opinion here, as I haven't used any. I am going to try a Jekyll site and experiment, but it's something we need to have a proposal from someone as to why to pick a particular platform (pros/cons, example of new page) and then call a vote.

First iteration completed with #149


feat: Temporarily add logto auth [DEV-2586]

Task linked: DEV-2584 Credential Service: Setup LogTo flows for client authentication

Logto should not be part of credential-service


fix(FEEL): show syntax errors

try it out using
npx @bpmn-io/sr bpmn-io/bpmn-js-properties-panel -l bpmn-io/properties-panel#feel-editor-syntax-error

requires https://github.com/bpmn-io/feel-editor/pull/10

I'm reviewing this. 👀

When there's an error, and I start typing, the error will only disappear after denounced linting has finished. I would expect the error to disappear when I start typing.

On the other hand, in the Camunda Modeler, linting errors coming from the BPMN linter will behave the same. 🤔

I would keep it consistent with what is shown in the editor. As CodeMirror still shows error markers after we started typing, we should keep the error message in the properties panel as well.
VSCode seems to do the same, but with a much smaller delay. We could think about lowering the delay until linting is executed (default is 750ms), but that would be done on the @bpmn-io/feel-editor part

@philippfromme , should we merge and include this one in the next modeler release? The improvements mentioned in my previous comment have to be done as a follow-up in the feel-editor repo anyway.


[WIP] Inline all decorations

https://github.com/Microsoft/vscode/issues/19749
CC: @jrieken

Hi @Krzysztof-Cieslak, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!
You've already signed the contribution license agreement. Thanks!
The agreement was validated by Microsoft and real humans are currently evaluating your PR.
TTYL, MSBOT;

Yeah, this how I said not to do it ;-) There is basically two issue with it and one makes not being able to reuse the goto error controller/widget. So problem 1 is that the widget reveals the line, therefore always scrolling to the last error which is unwanted and problem 2 is that errors that are on the same line are not sharing the widget.

Yeah, this how I said not to do it ;-)

That just the version I have done earlier, just created this PR to discuss it here ;)
I'll try to fix it soon.

OK, I think I've fixed 1 - I've added optional parameter to ZoneWidget.show which controls if showing widget should also scroll to it and reveal it. It defaults to true [old behavior], so all other places using this method are not changed
To the 2 - I actually like that each error is in its own widget, not sure if we should change it. But your call in the end.

Sorry for delay and for me making this more complicated now. I am prepending I didn't see the scrollTip hack and proposing a different solution which doesn't use the ZoneWidget anymore. That is because the ZoneWidget is quite dated and needs a bigger overhaul. So, if you feel a little adventurous and if you want to make a long lasting contribution bear with me ;-)
Let me explain two concepts the editor supports and how the ZoneWidget fits into this:

on the one side there are editor widgets that overlay the text, like the suggestion or find widgets
then there are view zones which can be used make room in between two lines. Originally this was added for the diff editor and the green/red stocked areas that show additions/removals.

The ZoneWidget is a combination of the two above. There is a view zone in it that "makes space" and then there a widget which is "manually" positioned on top of that view zone. Because for the editor it's two different things the widget itself needs to self-manage it, like manually setting style.top on the widget when the zone scrolls etc. Nothing that runs fast and nothing we are particularly proud of 🙈
The good news is that for showing all diagnostics, it's enough to just use view zones. The bad news is that it makes this PR a little more involving. The abstract of this feature would then be

label the existing bits toxic and start fresh'ish
have a new controller, like the MarkerController that knows an editor and the services
in the controller use the changeViewZones-api and reuse/get inspired by the MessageWidget. Because view zones are fast, simply create new zones for all markers when they change while active.
have some actions that drive the above controller

I hope I didn't scare you with this - I know it's a little work but it will result an implementation which is better then what we have today and that's what we want. I also happily assist you with getting this done. Happy Coding.

Thanks for all explanations, I'll come back to this PR on the weekend / next week.


Adjust Pets stats to whats in game

Some pets attack/health is outdated

Thanks for the PR and apologies for a late response 👍
Changes look good to me, but would it be possible to also run npm run prod:build and include the output in the PR? Then I'm happy to merge 👍


Page wont Load with error

Hi Norm
We can't get this page to load in our local dev environment:
https://arcproject.knack.com/arc-beta#admissions-new/qs--review/queries/6669bd250cca5c0029409611/
Its coming with this error:
KTL.js:12720 Uncaught (in promise) TypeError: Cannot read properties of undefined (reading 'key')
at KTL.js:12720:80
at Array.forEach ()
at Object.getAllFieldsWithKeywordsInView (KTL.js:12717:46)
at Object.hideFields (KTL.js:3298:49)
at HTMLDocument. (KTL.js:14716:28)
at HTMLDocument.dispatch (k_84cd16df86db786830325e06f7be8b9bee298cd7.js:2:199939)
at HTMLDocument.s (k_84cd16df86db786830325e06f7be8b9bee298cd7.js:2:195974)
at Object.trigger (k_84cd16df86db786830325e06f7be8b9bee298cd7.js:2:198508)
at HTMLDocument. (k_84cd16df86db786830325e06f7be8b9bee298cd7.js:2:206283)
at Function.each (k_84cd16df86db786830325e06f7be8b9bee298cd7.js:2:176249)
I have narrowed it down to this commit: 876f0670ac08aeb161d7fc3a7e4c0ad98d013307
The page loads if I go back to the commit before : b81aff129001f133661e3370c3bbdbc19a21bd8f
Craig

I've fixed that bug and some more in the next commit.  Please pull Dev and give it a try.
ND

Great Thanks


Remove SingleAssign

Remove SingleAssign this class was introduced before kotlin 1.2 because lateinit didn't exist but now it is not needed anymore.
This is an effort to reduce the code inside detekt-api.

Warnings

:warning:
It looks like this PR contains functional changes without a corresponding test.

  Generated by :no_entry_sign: dangerJS against 1af274fc1eb678d28104fe24a6b574e8c00c33aa

I am not sure about this one because SingelAssign also guarantees that the value is written exactly once. I don't know that that feature is particularly useful or necessary within detekt though. I am not against removing it, but wanted to point out that the semantics are different.

Yes, they aren't exactly the same but nearly all the usages are in Extensions and the properties are set on the init. And we are the ones that call that method and we know that we call it just once.
The exception is detekt-formatting/src/main/kotlin/io/gitlab/arturbosch/detekt/formatting/FormattingRule.kt. That uses it on a visit(KtFile) that also should be only called once.
Anyway, I agree that this function is safer than lateinit var. I thought it wasn't worth the effort to maintain it. But if we want to keep it I would vote to move it outside our public api. But, where? detekt-utils?


Improve docs on how to enable developer mode

From this thread: https://discourse.osc.edu/t/enabling-app-development/322/1

Itemize the three steps needed to  enable the app development as subsections, and detail what needs to be  done and what the options are under each subsection (e.g. for the app  paths, either the 1.3 or 1.4 way).
especially for the paths, make another  sub-itemization separately for the 1.3 and 1.4 behavior, so one does  not confuse the 1.3 behavior with the 1.4.
Then have a separate subsection wrapped around the description of Table 7 = the global enablement of the apps development
it is not clear if one needs to set  OOD_DEV_APPS_ROOT (and where this variable goes - presumably in the  /etc/ood/config/apps/dashboard/env) AND also modify the nginx_stage.yml  appropriately). This needs some clarification too.
it is not clear OOD_DEV_SSH_HOST needs  to be set if I set up the apps on the same OOD server itself. It sounds  like in that case OOD_DEV_SSH_HOST is not needed, but, then it should  be listed as an “optional” step.

https://osc.github.io/ood-documentation/master/app-development/enabling-development-mode.html

In the section of restricting app development mode to group membership, the code should be:
Configuration.app_development_enabled = OodSupport::Process.groups.include?(
  OodSupport::Group.new("devgrp")
)

@diedpigs fixed in 1159749. Thanks for pointing that out.

Be sure to include the changes from: https://github.com/OSC/ood-dashboard/pull/478


compiling from source gets Permission denied

🐛 Describe the bug
error: can't create or remove files in install directory

The following error occurred while trying to add or remove files in the
installation directory:

    [Errno 13] Permission denied: '/usr/local/lib/python3.8/dist-packages/test-easy-install-455594.write-test'

Hey, I'm trying to compile from source the latest version in nightly (doesn't matter if i checkout too a different tag)
I always get the same error
I'm using an ARM based edge device
Versions
branch nightly
cloning the repo and then
python3 setup.py install

I had recently installed from source (not on ARM though) but didn't face this issue.
This seems some access issue. Maybe you can try
Are you running in usr folder?
Do you need sudo? Can you try with sudo?
Or can you do chmod +x to allow permissions?
Can you try in some other folder?

Hi @eladpar , have you tried @oke-aditya suggestions?

Closing due to inactivity. @eladpar if the issues persists, feel free to re-open.


Rendering result is gong after switching between 'stereo' and 'fullscreen'

I basically only changed the dataset from the example code, and here is what happened after toggle between view modes:

Here is my Jupyter Notebook info:
The version of the notebook server is 4.4.1 and is running on:
Python 2.7.12 |Continuum Analytics, Inc.| (default, Jul  2 2016, 17:43:17)
[GCC 4.2.1 (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)]

Any ideas? Thanks!

Hi Penny,
Judging from the black background you are using the 0.2 version, could you try upgrading to 0.3, and see if you still get the same? It was a bug, although I didn't fully understand it, I managed to get rid of it in 0.3 I believe.
cheers,
Maarten

@maartenbreddels Thanks for reply! The bug is still there after I upgraded to 0.3 using conda install -c conda-forge ipyvolume
And, I found the volume which was shown in nbviewer before is also gone, as seen on http://nbviewer.jupyter.org/github/PennyQ/ipython_scripts/blob/master/ipyvolume_l1448co.ipynb
I suspected these two issues are related?

That is odd, so you now have black background? Can you describe exactly when it happens? Only when you switch to fullscreen, or also stereo, or only when you go fullscreen while stereo mode?
Btw, I can see the volume on nbviewer,

Yes I have white background now, and the problem happened when running ipython notebook locally, after switching from stereo -> fullscreen -> quit fullscreen(press ESC), then the volume is gone as below (such problem doesn't happen on nbviewer for me), unless rerun the code:
(I am using quickvolshow btw)

Yes the volume in nbviewer is back now, after I updated the ipnb file with ipyvolume 3.0! Thanks for this!

Thanks for reporting this, I'll try to fix this for the next release!

Hi Penny, this is fixed now in version 0.3.2.


Replace avroghugger with skeuomorph in code generation

Dependent on this PR: https://github.com/higherkindness/skeuomorph/pull/340

I did some force pushing and now github UI is all wonky... re-starting this one here https://github.com/higherkindness/sbt-mu-srcgen/pull/105


WeightedFairQueueByteDistributor may not write all pending bytes when testing HTTP/2 with Chrome.

Expected behavior
WeightedFairQueueByteDistributor write all pending bytes when testing HTTP/2 with Chrome.
Actual behavior
WeightedFairQueueByteDistributor does not respond to all images when testing with Chrome, finally Chrome can not display for some images.
On the contrary, All images were displayed when testing Firefox.
Steps to reproduce

Run the HTTP / 2 Tiles example(io.netty.example.http2.tiles).
Connect to https://localhost:8443 using the Chrome browser.
Press Ctrl+F5

Netty version
netty-4.1.9.Final
JVM version (e.g. java -version)
java version "1.8.0_121"
Java(TM) SE Runtime Environment (build 1.8.0_121-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.121-b13, mixed mode)
OS version (e.g. uname -a)
#uname -a
Linux 2.6.32-642.15.1.el6.x86_64 #1 SMP Fri Feb 24 14:31:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
#cat /etc/redhat-release
CentOS release 6.8 (Final)

If you change WeightedFairQueueByteDistributor to UniformStreamByteDistributor, UniformStreamByteDistributor writes all pending bytes when testing HTTP/2 with Chrome.

@nmittler @ejona86 can you check ?

@normanmaurer, I reproduced the hang on master. And it does appear UniformStreamByteDistributor doesn't have the same failure. I can't reproduce the problem on v4.1.8, but I can on v4.1.9, which is interesting because nothing really changed in either the weighted distributor or the remote flow controller.

I'm mistaken. Commit 3482651 happened between the two and have verified it introduced the bug. That should help in figuring out what's broken.

@ejona86 so you will take a look ?

Also @Scottmitch ....

@normanmaurer, yeah, I'll still investigate more. I don't get much work done on Tuesdays, so tomorrow is when I'll probably be able to get back to it.

I tracked the problem down to an interaction with maxStateOnlySize. A high value (~195) does not trigger the bug. A medium value seems to trigger it less. And 1 triggers it very quickly. 0 doesn't have any issue.
I also know that the streamableBytes on many streams is incorrectly 0. I think this was caused by child/pseudoTimeQueue tree corruption, because it seems there were large trees that weren't descendant from the connection.
It seems the problem is due to a bug in updateDependencyTree, where if it doesn't find the parent it creates new State for it, but it doesn't give that State a parent. This seems to fix it (more testing needed):
@@ -229,6 +229,10 @@ public final class WeightedFairQueueByteDistributor implements StreamByteDistrib
         State newParent = state(parentStreamId);
         if (newParent == null) {
             // If there is no State object that means there is no Http2Stream object and we would have to keep the
             // State object in the stateOnlyMap and stateOnlyRemovalQueue. However if maxStateOnlySize is 0 this means
             // stateOnlyMap and stateOnlyRemovalQueue are empty collections and cannot be modified so we drop the State.
             if (maxStateOnlySize == 0) {
                 return;
             }
             newParent = new State(parentStreamId);
             stateOnlyRemovalQueue.add(newParent);
             stateOnlyMap.put(parentStreamId, newParent);
+            // Only the stream which was just added will change parents. So we only need an array of size 1.
+            List<ParentChangedEvent> events = new ArrayList<ParentChangedEvent>(1);
+            connectionState.takeChild(newParent, false, events);
+            notifyParentChanged(events);
         }

Although I'm becoming more familiar with the code, I am not fully up-to-speed. I'll see if I can turn this into a PR.

thanks for looking into this @ejona86 ... this does seem like a bug but maybe in other areas too ... I can take a stab at a PR

good find ... after looking a bit more it seems to be the only place where this bug occurs. We should be able to share code with [1] too. Also I need to review when we prematurely exit if the parent's state object cannot be found ... I'm concerned we may not write to the child stream if it is in the active state ... I need to investigate more.
[1] https://github.com/netty/netty/blob/4.1/codec-http2/src/main/java/io/netty/handler/codec/http2/WeightedFairQueueByteDistributor.java#L125

Also I need to review when we prematurely exit if the parent's state object cannot be found ... I'm concerned we may not write to the child stream if it is in the active state ... I need to investigate more.

Just to close the loop ... we are OK here. The state only map is just used when there is no stream object. If there is a stream object we keep track of the priority in the stream and so it is OK to bail out early if no state exists for the parent stream and we don't track any "priority only state" ... because it will not impact the priority. I will add a unit test to demonstrate the behavior is correct.


cargo-edit: 0.10.2 -> 0.10.3

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/cargo-edit/versions.
meta.description for cargo-edit is: "A utility for managing cargo dependencies from the command line"
meta.homepage for cargo-edit is: "https://github.com/killercup/cargo-edit"
meta.changelog for cargo-edit is: "https://github.com/killercup/cargo-edit/blob/v0.10.3/CHANGELOG.md"
Updates performed

Rust version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.10.3 with grep in /nix/store/77gpdfvspxaygkv9992nf9kbmmbnggdk-cargo-edit-0.10.3
found 0.10.3 in filename of file in /nix/store/77gpdfvspxaygkv9992nf9kbmmbnggdk-cargo-edit-0.10.3

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
cargo-edit

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/77gpdfvspxaygkv9992nf9kbmmbnggdk-cargo-edit-0.10.3 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A cargo-edit https://github.com/r-ryantm/nixpkgs/archive/5f31e53e5287a1851e87a7510db92a639ef6eef1.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/77gpdfvspxaygkv9992nf9kbmmbnggdk-cargo-edit-0.10.3
ls -la /nix/store/77gpdfvspxaygkv9992nf9kbmmbnggdk-cargo-edit-0.10.3/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

cargo-edit

Maintainer pings
cc @Br1ght0ne @figsoda @Gerschtli @jb55 @killercup for testing.

@ofborg eval


Page not being generating

Have you read the Contributing Guidelines on issues?

[X] I have read the Contributing Guidelines on issues.

Prerequisites

[X] I'm using the latest version of Docusaurus.
[X] I have tried the npm run clear or yarn clear command.
[X] I have tried rm -rf node_modules yarn.lock package-lock.json and re-installing packages.
[X] I have tried creating a repro with https://new.docusaurus.io.
[ ] I have read the console error message carefully (if applicable).

Description
I used "npm i docusaurus-plugin-openapi-docs" to generate API references in my docusaurus project I even after using valid yaml file it's not being generating with proper config
plugins: [     [       'docusaurus-plugin-openapi-docs',       {         id: 'on-demand',         docsPluginId: 'classic',         config: {           on_demand: {             specPath: 'static/public/live-stream.yaml',             outputDir: 'docs/on-demand',             baseUrl: '/on-demand',             sidebarOptions: {               groupPathsBy: 'tag',             },           } satisfies OpenApiPlugin.Options,         }       },     ],
`presets: [
[
'classic',
{
docs: {
sidebarPath: './sidebars.ts',
routeBasePath: 'guides',
sidebarCollapsible: false,
sidebarCollapsed: false,
docItemComponent: "@theme/ApiItem",
},
blog: {
showReadingTime: true,
feedOptions: {
type: ['rss', 'atom'],
xslt: true,
},
      onInlineTags: 'warn',
      onInlineAuthors: 'warn',
      onUntruncatedBlogPosts: 'warn',
    },
    theme: {
      customCss: './src/css/custom.css',
    },
  } satisfies Preset.Options,
],

],
]`
themes: [
'docusaurus-theme-openapi-docs',
],

I'm not getting any type of errors in my console so please help me out on this
Reproducible demo
No response
Steps to reproduce
I used "npm i docusaurus-plugin-openapi-docs" to generate API references in my docusaurus project I even after using valid yaml file it's not being generating with proper config
plugins: [     [       'docusaurus-plugin-openapi-docs',       {         id: 'on-demand',         docsPluginId: 'classic',         config: {           on_demand: {             specPath: 'static/public/live-stream.yaml',             outputDir: 'docs/on-demand',             baseUrl: '/on-demand',             sidebarOptions: {               groupPathsBy: 'tag',             },           } satisfies OpenApiPlugin.Options,         }       },     ],
`presets: [
[
'classic',
{
docs: {
sidebarPath: './sidebars.ts',
routeBasePath: 'guides',
sidebarCollapsible: false,
sidebarCollapsed: false,
docItemComponent: "@theme/ApiItem",
},
blog: {
showReadingTime: true,
feedOptions: {
type: ['rss', 'atom'],
xslt: true,
},
      onInlineTags: 'warn',
      onInlineAuthors: 'warn',
      onUntruncatedBlogPosts: 'warn',
    },
    theme: {
      customCss: './src/css/custom.css',
    },
  } satisfies Preset.Options,
],

],
]`
themes: [
'docusaurus-theme-openapi-docs',
],

I'm not getting any type of errors in my console so please help me out on this
Expected behavior
Suppose to generated on specific outdir but it's not
Actual behavior
Suppose to generated on specific outdir but it's not
Your environment

Public source code:
Public site URL: I didn't publish yet
Docusaurus version used: latest one
Environment name and version (e.g. Chrome 89, Node.js 16.4): v20.17.0
Operating system and version (e.g. Ubuntu 20.04.2 LTS): mac

Self-service

[X] I'd be willing to fix this bug myself.

We don't maintain the open API plugin, and also only handle bugs that are reported properly, including a repro


about pre-trained models

Excuse me, where is the weight file?

Hi, you can train it on your own.

okk，thank u


Bug: 500 Error after finishing archive request.

Using docker and ArchiveBox v0.4.9 web server interface. I'm getting a Server Error (500) when the post completes after I submit a new archive request in the web.
This is a fresh install and newly initialized instance. Can I increase the verbosity to see what's making it mad?
REPOSITORY                TAG                 IMAGE ID            CREATED             SIZE
nikisweeting/archivebox   latest              3e02bd28e479        5 hours ago         1.07GB

Attaching to archivebox_1
archivebox_1  | [i] [2020-07-30 22:44:34] ArchiveBox v0.4.9: archivebox server <IP_ADDRESS>:8000
archivebox_1  |     > /data
archivebox_1  |
archivebox_1  | [+] Starting ArchiveBox webserver...
archivebox_1  | [i] The admin username is: archivebox
archivebox_1  | Performing system checks...
archivebox_1  |
archivebox_1  | System check identified no issues (0 silenced).
archivebox_1  | July 30, 2020 - 22:44:35
archivebox_1  | Django version 3.0.8, using settings 'core.settings'
archivebox_1  | Starting development server at http://<IP_ADDRESS>:8000/
archivebox_1  | Quit the server with CONTROL-C.
archivebox_1  | [30/Jul/2020 22:45:01] "POST /admin/login/?next=/admin/core/snapshot/add/ HTTP/1.1" 302 0
archivebox_1  | [30/Jul/2020 22:45:01] "GET /admin/core/snapshot/add/ HTTP/1.1" 200 8756
archivebox_1  | [30/Jul/2020 22:45:01] "GET /static/admin/css/dashboard.css HTTP/1.1" 200 412
archivebox_1  | [+] Adding URL: https://medium.com/@nielssj/docker-volumes-and-file-system-permissions-772c1aee23ca
archivebox_1  | [30/Jul/2020 22:45:19] "GET /static/admin/fonts/Roboto-Bold-webfont.woff HTTP/1.1" 200 86184
archivebox_1  | [+] [2020-07-30 22:45:19] Adding 1 links to index (crawl depth=0)...
archivebox_1  |     > Saved verbatim input to sources/1596149119-import.txt
archivebox_1  |     > Parsed 1 URLs from input (Plain Text)
archivebox_1  |     > Found 1 new URLs not already in index
archivebox_1  |
archivebox_1  | [*] [2020-07-30 22:45:19] Writing 1 links to main index...
    √ /data/index.sqlite3ta/index.sqlite3
    √ /data/index.json/data/index.json
    √ /data/index.html/data/index.html
archivebox_1  |
archivebox_1  | [▶] [2020-07-30 22:45:19] Collecting content for 1 Snapshots in archive...
archivebox_1  |
archivebox_1  | [+] [2020-07-30 22:45:19] "medium.com/@nielssj/docker-volumes-and-file-system-permissions-772c1aee23ca"
archivebox_1  |     https://medium.com/@nielssj/docker-volumes-and-file-system-permissions-772c1aee23ca
archivebox_1  |     > ./archive/1596149119
archivebox_1  |       > title
archivebox_1  |       > favicon
archivebox_1  |       > wget
archivebox_1  |       > pdf
archivebox_1  |       > screenshot
archivebox_1  |       > dom
archivebox_1  |       > media
archivebox_1  |       > archive_org
archivebox_1  |         Failed:
archivebox_1  |             TimeoutExpired Command '['curl', '--silent', '--location', '--head', '--compressed', '--max-time', '60', '--user-agent', 'ArchiveBox/0.4.9 (+https://github.com/pirate/ArchiveBox/) curl/curl 7.64.0 (x86_64-pc-linux-gnu)', 'https://web.archive.org/save/https://medium.com/@nielssj/docker-volumes-and-file-system-permissions-772c1aee23ca']' timed out after 60 seconds
archivebox_1  |         Run to see full output:
archivebox_1  |             cd /data/archive/1596149119;
archivebox_1  |             curl --silent --location --head --compressed --max-time 60 --user-agent "ArchiveBox/0.4.9 (+https://github.com/pirate/ArchiveBox/) curl/curl 7.64.0 (x86_64-pc-linux-gnu)" https://web.archive.org/save/https://medium.com/@nielssj/docker-volumes-and-file-system-permissions-772c1aee23ca
archivebox_1  |
archivebox_1  |
archivebox_1  | [√] [2020-07-30 22:46:48] Update of 1 pages complete (1.48 min)
archivebox_1  |     - 0 links skipped
archivebox_1  |     - 0 links updated
archivebox_1  |     - 1 links had errors
archivebox_1  |
archivebox_1  |     Hint: To view your archive index, open:
archivebox_1  |         /data/index.html
archivebox_1  |     Or run the built-in webserver:
archivebox_1  |         archivebox server
archivebox_1  |
archivebox_1  | [*] [2020-07-30 22:46:48] Writing 1 links to main index...
    √ /data/index.sqlite3ta/index.sqlite3
    √ /data/index.json/data/index.json
    √ /data/index.html/data/index.html
archivebox_1  |
archivebox_1  | [30/Jul/2020 22:46:48] "POST /admin/core/snapshot/add/? HTTP/1.1" 500 145

Ok I found the --debug flag for the server command. This is the cause of my issue.
Environment:

Request Method: POST
Request URL: http://localhost:8000/admin/core/snapshot/add/

Django Version: 3.0.8
Python Version: 3.8.5
Installed Applications:
['django.contrib.auth',
 'django.contrib.contenttypes',
 'django.contrib.sessions',
 'django.contrib.messages',
 'django.contrib.staticfiles',
 'django.contrib.admin',
 'core',
 'django_extensions']
Installed Middleware:
['django.middleware.security.SecurityMiddleware',
 'django.contrib.sessions.middleware.SessionMiddleware',
 'django.middleware.common.CommonMiddleware',
 'django.middleware.csrf.CsrfViewMiddleware',
 'django.contrib.auth.middleware.AuthenticationMiddleware',
 'django.contrib.messages.middleware.MessageMiddleware']

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/django/core/handlers/exception.py", line 34, in inner
    response = get_response(request)
  File "/usr/local/lib/python3.8/site-packages/django/core/handlers/base.py", line 115, in _get_response
    response = self.process_exception_by_middleware(e, request)
  File "/usr/local/lib/python3.8/site-packages/django/core/handlers/base.py", line 113, in _get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/app/archivebox/core/admin.py", line 188, in add_view
    "stdout": ansi_to_html(add_stdout.getvalue().strip()),
  File "/app/archivebox/util.py", line 220, in ansi_to_html
    from .config import COLOR_DICT

Exception Type: ImportError at /admin/core/snapshot/add/
Exception Value: attempted relative import with no known parent package

Request Method: | POST
-- | --
http://localhost:8000/admin/core/snapshot/add/
3.0.8
ImportError
attempted relative import with no known parent package
/app/archivebox/util.py in ansi_to_html, line 220
/usr/local/bin/python
3.8.5
['/usr/local/bin',  '/usr/local/lib/python38.zip',  '/usr/local/lib/python3.8',  '/usr/local/lib/python3.8/lib-dynload',  '/usr/local/lib/python3.8/site-packages',  '/app',  '/app/archivebox',  '/app/archivebox',  '/app/archivebox',  '/app/archivebox',  '/app/archivebox',  '/app/archivebox',  '/app/archivebox',  '/app/archivebox',  '/app/archivebox',  '/app/archivebox']
Fri, 31 Jul 2020 03:49:54 +0000

This should be fixed by #409. If you still encounter any problems with the latest version comment back here and I'll reopen the ticket.
git checkout master
git pull
docker build . -t archivebox
...
docker run -v /archive:/data archivebox server <IP_ADDRESS>:8000 --debug

@pirate I got the following error when I ran docker build . -t archivebox. Could I get some help.
Step 22/29 : RUN pip install -e .
---> Running in da38b7bcd4b0
Obtaining file:///app
ERROR: Command errored out with exit status 1:
command: /usr/local/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/app/setup.py'"'"'; file='"'"'/app/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-saghmanw
cwd: /app/
Complete output (11 lines):
Traceback (most recent call last):
File "", line 1, in
File "/app/setup.py", line 16, in
README = (PYTHON_DIR / "README.md").read_text()
File "/usr/local/lib/python3.8/pathlib.py", line 1232, in read_text
with self.open(mode='r', encoding=encoding, errors=errors) as f:
File "/usr/local/lib/python3.8/pathlib.py", line 1218, in open
return io.open(self, mode, buffering, encoding, errors, newline,
File "/usr/local/lib/python3.8/pathlib.py", line 1074, in _opener
return self._accessor.open(self, flags, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/app/archivebox/README.md'
----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

@mobedoor Possibly something up with your build/git environment, can you try deleting the repo dir and re-cloning it?
Alternatively try pulling the v0.4.21 tag instead of the master branch and building that. https://github.com/pirate/ArchiveBox/releases/tag/v0.4.21

@pirate Thanks. That fixed it.


Unable to start with SileroVad

Similiar to the other open issue I have a RPI 4 running the Pi OS Lite 64 bit 2023-05-03)
I am getting a similar error when starting with script/run --vad silero:

script/run --vad silero
usage: main.py [-h] --host HOST (--token TOKEN | --token-file TOKEN_FILE) [--port PORT] [--api-path API_PATH] [--pipeline PIPELINE] [--protocol {http,https}] [--mic-device MIC_DEVICE]
[--snd-device SND_DEVICE] [--mic-command MIC_COMMAND] [--snd-command SND_COMMAND] [--snd-command-sample-rate SND_COMMAND_SAMPLE_RATE] [--awake-sound AWAKE_SOUND]
[--done-sound DONE_SOUND] [--volume VOLUME] [--vad {disabled,webrtcvad,silero}] [--vad-model VAD_MODEL] [--vad-threshold VAD_THRESHOLD]
[--vad-trigger-level VAD_TRIGGER_LEVEL] [--vad-buffer-chunks VAD_BUFFER_CHUNKS] [--wake-buffer-seconds WAKE_BUFFER_SECONDS] [--noise-suppression {0,1,2,3,4}]
[--auto-gain {0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31}] [--volume-multiplier VOLUME_MULTIPLIER]
[--wake-word {disabled,wyoming}] [--wake-word-id WAKE_WORD_ID] [--wyoming-host WYOMING_HOST] [--wyoming-port WYOMING_PORT] [--pulseaudio [PULSEAUDIO]]
[--ducking-volume DUCKING_VOLUME] [--echo-cancel] [--udp-mic UDP_MIC] [--udp-snd UDP_SND] [--udp-snd-sample-rate UDP_SND_SAMPLE_RATE]
[--debug-recording-dir DEBUG_RECORDING_DIR] [--debug]
main.py: error: the following arguments are required: --host
Traceback (most recent call last):
File "/home/hudav/homeassistant-satellite/script/run", line 13, in
subprocess.check_call(
File "/usr/lib/python3.9/subprocess.py", line 373, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/hudav/homeassistant-satellite/.venv/bin/python3', '-m', 'homeassistant_satellite', '--vad', 'silero']' returned non-zero exit status 2.

and for me the installation command went as such:

.venv/bin/pip3 install   --find-links https://synesthesiam.github.io/prebuilt-apps/   .[silerovad]
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Looking in links: https://synesthesiam.github.io/prebuilt-apps/
Processing /home/hudav/homeassistant-satellite
Preparing metadata (setup.py) ... done
Requirement already satisfied: aiohttp==3.8.4 in ./.venv/lib/python3.9/site-packages (3.8.4)
WARNING: Cache entry deserialization failed, entry ignored
Collecting onnxruntime<2,>=1.10.0
Downloading onnxruntime-1.16.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (4.1 kB)
Collecting numpy<1.26
Downloading numpy-1.25.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.metadata (5.6 kB)
Requirement already satisfied: attrs>=17.3.0 in ./.venv/lib/python3.9/site-packages (from aiohttp==3.8.4) (23.1.0)
Requirement already satisfied: charset-normalizer<4.0,>=2.0 in ./.venv/lib/python3.9/site-packages (from aiohttp==3.8.4) (3.3.2)
Requirement already satisfied: multidict<7.0,>=4.5 in ./.venv/lib/python3.9/site-packages (from aiohttp==3.8.4) (6.0.4)
Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in ./.venv/lib/python3.9/site-packages (from aiohttp==3.8.4) (4.0.3)
Requirement already satisfied: yarl<2.0,>=1.0 in ./.venv/lib/python3.9/site-packages (from aiohttp==3.8.4) (1.9.2)
Requirement already satisfied: frozenlist>=1.1.1 in ./.venv/lib/python3.9/site-packages (from aiohttp==3.8.4) (1.4.0)
Requirement already satisfied: aiosignal>=1.1.2 in ./.venv/lib/python3.9/site-packages (from aiohttp==3.8.4) (1.3.1)
Collecting coloredlogs (from onnxruntime<2,>=1.10.0)
Downloading https://www.piwheels.org/simple/coloredlogs/coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46.0/46.0 kB 190.1 kB/s eta 0:00:00
Collecting flatbuffers (from onnxruntime<2,>=1.10.0)
Downloading https://www.piwheels.org/simple/flatbuffers/flatbuffers-20181003210633-py2.py3-none-any.whl (14 kB)
Collecting packaging (from onnxruntime<2,>=1.10.0)
Downloading https://www.piwheels.org/simple/packaging/packaging-23.2-py3-none-any.whl (53 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 53.0/53.0 kB 223.0 kB/s eta 0:00:00
Collecting protobuf (from onnxruntime<2,>=1.10.0)
Downloading protobuf-4.25.0-cp37-abi3-manylinux2014_aarch64.whl.metadata (541 bytes)
Collecting sympy (from onnxruntime<2,>=1.10.0)
Downloading https://www.piwheels.org/simple/sympy/sympy-1.12-py3-none-any.whl (5.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.7/5.7 MB 716.8 kB/s eta 0:00:00
Requirement already satisfied: idna>=2.0 in ./.venv/lib/python3.9/site-packages (from yarl<2.0,>=1.0->aiohttp==3.8.4) (3.4)
Collecting humanfriendly>=9.1 (from coloredlogs->onnxruntime<2,>=1.10.0)
Downloading https://www.piwheels.org/simple/humanfriendly/humanfriendly-10.0-py2.py3-none-any.whl (89 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 89.9/89.9 kB 250.4 kB/s eta 0:00:00
Collecting mpmath>=0.19 (from sympy->onnxruntime<2,>=1.10.0)
Downloading https://www.piwheels.org/simple/mpmath/mpmath-1.3.0-py3-none-any.whl (536 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 536.2/536.2 kB 56.1 kB/s eta 0:00:00
Downloading numpy-1.25.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (14.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.2/14.2 MB 450.9 kB/s eta 0:00:00
Downloading onnxruntime-1.16.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (5.6 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.6/5.6 MB ? eta 0:00:00
Downloading protobuf-4.25.0-cp37-abi3-manylinux2014_aarch64.whl (293 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 293.5/293.5 kB 61.1 kB/s eta 0:00:00
Building wheels for collected packages: homeassistant-satellite
Building wheel for homeassistant-satellite (setup.py) ... done
Created wheel for homeassistant-satellite: filename=homeassistant_satellite-2.3.1-py3-none-any.whl size=1540356 sha256=6267c65dc6c5bd9a2fd222c2d1ea3f1d4320133f6f3bc4f4fec9a09ec1de778a
Stored in directory: /home/hudav/.cache/pip/wheels/a3/d9/28/a95b4564da5747f3022ac784d5d5a3d00908abde74554a2d62
Successfully built homeassistant-satellite
Installing collected packages: mpmath, flatbuffers, sympy, protobuf, packaging, numpy, humanfriendly, coloredlogs, onnxruntime, homeassistant-satellite
Successfully installed coloredlogs-15.0.1 flatbuffers-20181003210633 homeassistant-satellite-2.3.1 humanfriendly-10.0 mpmath-1.3.0 numpy-1.25.2 onnxruntime-1.16.1 packaging-23.2 protobuf-4.25.0 sympy-1.12

I had this running on a version of bullseye (2023-02-21) arm64 but i didn't want the desktop so I was trying to move to a Lite. I have also tried this on the most recent version of Pi-OS that Pi Imager provides (64 bit as well) and same error occurs.

I also see that the issue with the other was that they were using 32 bit and needed a proper build of onnxruntime so i didn't think that was my issue due to being 64 bit

Just tried it in my full startup script and it is working now, so weird...


feat: added tryParseURL

fixes: #481
Todo:

[x] Write unit test

@favna I was just checking if there is any way to add deprecated jsdoc in re-export and found it
https://github.com/microsoft/TypeScript/issues/42684

@favna I was just checking if there is any way to add deprecated jsdoc in re-export and found it
microsoft/TypeScript#42684

Oh can you make a PR for that then? Same for filterNullishOrZero and filterNullishOrEmpty (mind the OR, so not the AND variants)


Conditions: clinicalStatus constraints

On 5/10, we agreed to the following:
Constrain Premenopausal (i.e., dx of premenopausal) to: active, recurrence, relapse
Constrain Dx of Pregnancy to: active
All other diagnosis' will not be constrained
(Of note, although it would be appropriate to constrain Dx of abnormal uterine/vaginal bleeding and Dx of cervical/vaginal lesion to only active, recurrence, and relapse, we opted not to since the tight lookback period of 24 hours lessens the need for this constraint.)

In commit https://github.com/ccsm-cds-tools/ccsm-cds-with-tests/commit/dfafabcc4891107f5927775e55b804a825d5f710,  I:

Restricted Premenopausal Condition to have a clinical status of active, recurrence, or relapse.
Tightened the constraints of Pregnancy to require a clinical status of active.

Note: Pregnancy currently requires a verificationStatus of confirmed, which is tighter than the constraint on the verificationStatuses of the rest of the Conditions. Is this still accurate @ssebast2?

@mickohanlon23  - what you stated above is correct.

@ssebast2 Great, all changes here have been updated in the L3. I'll close out this issue.


Fix UNIXServer example in docs

The example is essentially the same as the TCPServer one. I verified both UNIXServer and UNIXSocket examples, they work.
/cc @bew

Agree @asterite
require "socket"

def handle_client(client)
  message = client.gets
  client.puts message
end

server = UNIXServer.new("/tmp/myapp.sock")
while client = server.accept?
  spawn handle_client(client)
end

More sth like this then?

@bew I think so, yes :-)

@bew you are right, this is a more complete example. I change UNIXServer to it.
@asterite Can I fix TCPServer example in this PR too, or should I create a new/separate?

@petoem Sure! You can fix it in this PR :-)


Is this caused by Xteve, my EPG or Plex

I remember when I first started using Xteve, everything worked great (few years back).  It would show a good description + images for each show/movie.
Now 90% of blank

I tried disabling image caching to see if that helps with no luck, dont see anything obvious in my plex logs.  Been using epg.best since the start and they have usually been pretty good about packing as much info as possible into their epg.
Thoughts?

Figured out the issue, well 2 issues

Channel Icons wont load because plex is rewritting http to https, so if you use image caching plex wont be able to load images
Posters wont load if the url does not start with http/https, I had to create a cron job to rewrite the xml file for both the channels and posters to work.

Do you think you can add SSL support in the next update @mar-mei @xteve-project ?

Posters aren't always included in some xml's (epg) are you sure they are there?

100%, because they were missing the https:// plex was reading it incorrectly and try to load something like this
Photo transcoder: Request for url [/tv.plex.providers.epg.xmltv:4/metadata/2/thumb/1649871029?X-Plex-Token=xxxxxxxxxxxxxxxxxxxx] (is local: 1 upscaled: 1)

After I added the https to all the entries I get this (missing one just haven't been transcoded yet)

Im having the same issue... tried to go down the road of each link provided here and dont really understand what the fix is.  Going back to the earlier thread that said you "created a cron job".... if i have windows 10, would that be a Task?  Id like to be able to keep my current version of xteve but update whatever I need to for the URLs so that they start displaying again in Plex Live TV


avalonia port

pls port to avaloniaui

Maybe in v4 one could implement this. I've never user Avalonia before and thus, would have to read into it. Anyway, it's still in a Beta, so I don't know, if that does already make sense.


"rerun-if-changed" in build script causes causes fingerprint error and extra rebuild

If a dependency contains the following build script:
fn main() { println!("cargo:rerun-if-changed=build.rs"); }

Then running cargo build twice in a row compile the dependency twice, instead of just once:
$ cargo build
   Compiling a v0.1.0 (file:///home/mbrubeck/src/test/cargotest)
   Compiling cargotest v0.1.0 (file:///home/mbrubeck/src/test/cargotest)
$ cargo build
   Compiling a v0.1.0 (file:///home/mbrubeck/src/test/cargotest)
   Compiling cargotest v0.1.0 (file:///home/mbrubeck/src/test/cargotest)
$ cargo build
$

Possibly related: the following message appears in the log output during the second build, but not the first or third build:
INFO:cargo::ops::cargo_rustc::fingerprint: fingerprint error for a v0.1.0 (file:///home/mbrubeck/src/test/cargotest): local fingerprint type has changed

As reported by @cDlm on IRC, this affects the current version of the glutin crate. And here is a minimal test case for this issue: https://github.com/mbrubeck/cargotest

cc #2134

Note that you don't need to depend on the build script's source to re-trigger compiling the build script, Cargo does that automatically. That being said this probably shouldn't happen either way, so there may still be a bug.

This happens for any value of rerun-if-changed. For example, cargo:rerun-if-changed=src/lib.rs triggers the same issue.

Fixed by https://github.com/rust-lang/cargo/pull/2279


Swarmkit should wait for a leader instead of erroring

Run 3 managers
Kill the leader and do swarmctl node ls on another manager right after that. (combine commands)
Manager will respond Error: grpc: the client connection is closing.
Instead manager should block and wait for the new leader to be elected. It is valid to return an error if quorum has been lost or if leader can't be elected in a meaningful time.

This changed recently and makes https://github.com/docker/docker/pull/25546#issuecomment-238672866 fail very often.
@aaronlehmann @LK4D4

Instead manager should block and wait for the new leader to be elected. It is valid to return an error if quorum has been lost or if leader can't be elected in a meaningful time.

It's a bit harder than that. When you first open attempt this RPC, the follower you connected to won't realize the leader is down yet. So it will send an RPC to the former leader. This will time out and the client will get an error.
We used to have retries in the proxy through the use of a picker, but this caused a lot of problems. The retries need to happen on the client side, otherwise a worker can't differentiate between an unresponsive manager and one that's retrying while waiting for a leader.
I'm not convinced reliable RPC during leader failover is something we should try to provide in 1.12.x. It's a really tricky problem with lots of side effects.

@aaronlehmann I think if we don't fix it, it would be a big regression for 1.12.1 . Having a retry mechanism in docker is worse because docker has way less knowledge to figure out if the error is real or not.

The raft proxy generally doesn't know either. As I said, unless you time the request exactly right, it will be routed to the old leader before we know the leader is down, and it will time out.
I hacked up code to hold the request until a leader is elected, but it doesn't solve the problem, because these requests generally arrive before we know the leader is down. The proxy would need actual retries. Maybe that's okay as long as the worker has a short enough timeout that it doesn't let these retries happen (@LK4D4 WDYT?). It would make things pretty complicated, though.

@LK4D4: Tonis suggested having different behavior for proxying the dispatcher API and the control API. As a temporary workaround, would it be possible to use the old raftpicker code with the control API, and the new code with the dispatcher API? Thinking this would be relatively low-risk, and wouldn't require writing a bunch of new code that could cause regressions.
For 1.13 we could find a better solution.

@aaronlehmann I suppose we can do it.

Note that we have restored the old behavior for controlapi, but this is a temporary fix since we will want to unify the old proxy we reintroduced with the new one.

I don't think this is an issue anymore. The code this was filed against and the code that replaced it have long since been removed. The current raft proxy waits for a leader to be elected, up to a time limit, and returns a loss of quorum error after that.


Support other Linux besides Debian

Currently it does not seem to work with my non-Debian Linux. I believe my runner is a RHEL or CentOS, I can't be really sure, but either way I run into this error:

Or am I doing something wrong?
This is the action step:
      - name: Debug
        uses: lhotari/action-upterm@v1

Problem addressed by 0a4cf57e995047afc0ad514400ae76fcf63a43fd . The pre-condition is that tmux must be installed. I'll close this issue. Please re-open if the solution doesn't work for you.


Are there any sample for language grammar injection ?

I cannot fine any sample utilizing injectTo grammar. If there aren't exist yet then could we also have that too?

See https://github.com/mjbvz/vscode-fenced-code-block-grammar-injection-example for an example of this for markdown

See https://github.com/mjbvz/vscode-fenced-code-block-grammar-injection-example for an example of this for markdown

Thank you. However could you put that into this repo too?


Custom moons weather is not synced

For some reason, when you try to load a custom moon with LethalLevelLoader the weather of each individual moon becomes desyced between the clients and the server. (It's not just a graphical bug!!!)
The server sees this:

Instead the Clients see this:

Bump, had the same issue, seems to also cause the ship to be unable to land. I'm sticking to 1.0.7, at least that version works consistently.. :T

Bump, had the same issue, seems to also cause the ship to be unable to land. I'm sticking to 1.0.7, at least that version works consistently.. :T

During my testing I was unable to replicate the ship's inability to land

I have the same issue with weather using LLL. As of right now, to solve the Weather Desync Issue, the mod "WeatherTweaks" seems to fix this issue after countless attempts at finding the answer to this issue. Until the dev updates the mod to hopefully improve the sync errors, i'd suggest using this to sync the weather.


UI Design Implementation

Implemented designs from @chantelle-campbell, with feedback from @codergrl.
Added a Search feature to filter pages. Auto-changes on text change, and if there is only one match, hitting "Return" will navigate to that page.
Cleaned up layout of ProjectionTool.razor for mobile.

@Chantelle Campbell just FYI, this task should still be open, but we had an issue with branch names that caused the syncing from GitHub to move it.

layer list widget corresponds to gissue #40 .

When merging in the #40 changes, we discovered a few things that needed to be updated here. @seahro and I pair-reviewed and implemented the following changes:

Updated LayerLists.razor for mobile screens.
Corrected the event handlers to be ListItemCreated instead of ListItemSelected.
Corrected a few bugs in the hookup system for ListItemCreated.
Implemented a basic example of setting visibility and titles in LayerLists.razor.
Added documentation (some sample xml docs for future reference to expand later, and some explaining unfinished advanced features).


Translated selenium function to playwright

First pass at changing selenium to playwright
Got it to "work" with a simple carbon command carbon -s 'print("Hi World")'

commented out selenium functions for now
headless=False, so it's easy to confirm it was opening chrome and opening url page
"carbon_image.png" should save in the set destination folder

Currently fails following pytests:

test_create_image_for_one_liner
test_create_image_for_larger_snippet
test_storing_image_in_different_folder


Avoid duplicated compaction during restart recover.

When unistore-server restart, the compaction in raft log may be already applied in the engine, we need to detect the duplication and avoid apply compaction again.

fixed by checking ShardMeta's existing table during recover.


libraries for graph representation to evaluate

http://graphalchemist.github.io/Alchemy/#/
https://github.com/openwisp/netjsongraph.js
https://g6.antv.antgroup.com/examples
https://github.com/Nhogs/popoto-examples
https://github.com/jacomyal/sigma.js
http://arborjs.org/
https://graphology.github.io/
https://github.com/frewsxcv/graphosaurus?tab=readme-ov-file
http://philogb.github.io/jit/demos.html
https://js-graph-it.sourceforge.net/

For the first POC i chosen reagraph for the graph visualization for it's simplicity, responsiveness and the full compatibility with react native.


generic-tile-format suddenly stopped working on Chrome and Edge

Hi, having issues with the generic-tile-format json. It used to work fine up until yesterday.
What should happen when you paste the json into the view is that you have some pretty tiles view to work with.
Now what happens, is that the tiles view is still pretty, but no longer changes colour when hovering your cursor over it, and has an about:blank#blocked on the URL. When loading the console, it says that the browser refused to run the Tiles.aspx?..... Javascript URL due to Content-Security-Policy issues.

Weirdly enough, it still works on the "list" view but we want tiles so that they form multiple columns to save space.
Any ideas how to resolve?

We noticed the same. If you set the hideSelection property of the tileProps object to false, the link will work. However you will get the radio button selection control in the top right of the tile.
I have posted this issue to stackexchange

Thanks so much! At least we can make it work in the meantime while others have a look at it.

I have the same problem since today, but the workaround does not work either in my case. I have prepared this simple case that can be tested in any list:
{ 	"schema": "https://developer.microsoft.com/json-schemas/sp/view-formatting.schema.json", 	"tileProps": { 		"hideSelection": true, 		"width": "150", 		"height": "150", 		"formatter": { 			"elmType": "div", 			"style": { 				"padding": "8px", 				"border": "1px solid #ababab" 			}, 			"children": [{ 				"elmType": "a", 				"attributes": { 					"href": "https://www.google.es", 					"target": "_blank" 				}, 				"txtContent": "[$Title]" 			}] 		} 	} }
And I see the same error in console "Refused to run the JavaScript URL because it violates the following Content Security Policy directive: "script-src 'self'...."

I am keen to see the root issue fixed. @AsunSanLo, I have not tried your code, but I can see that you still have hideSelection set to true. The workaround requires it set to false. Hope it helps, I have not checked the other parts of your code.

@tjonkim I have tried both true and false values in hideSelection and it still doesn't work for me. With hideSelection set to false it opens the display item panel at right.

It looks like this change has been rolled back. We've also noticed that the "launch in dialog" option opens in a new tab rather than a dialog.

Yes, I can confirm that changing back to the original hideselection: false works for me now too. Thanks for keeping tabs on this

Hello Guys,
is it possible that this Issue is back?
I have similar Problems with the "HideSelection" Option right now..

The custom JSON formatting was dropped from our views last week. We had to re-apply it to switch back to the tile view. Very odd behaviour.


Implement Issue Reminder Workflow🚀

Description: Create a GitHub Actions workflow that sends reminders on open issues without updates for 7 days. The workflow should post a comment prompting assignees to take action.
Expected Benefits:
Improved responsiveness and prioritization of tasks.
Increased overall productivity.
please @ANSHIKA-26  assign me with level3 label

not needed at all , there are just 2 days left for gssoc-ext program to end :)


ERROR: 0:7: 'uniform' : syntax error - When Using Minified File

If I include the minified file like so:
<body>
    <canvas id="game"/>
    <script src='./gl-matrix-min.js'/></script>
    <script src='./bundle.js'/></script>
</body>

My vertexShaderText:
const vertexShaderText = [
    `precision mediump float;

    attribute vec2 vertPosition;
    attribute vec3 vertColor;
    varying vec3 fragColor;
    uniform mat4 mWorld;
    uniform mat4 mView;
    uniform mat4 mProj;

    void main()
    {
        fragColor = vertColor;
        gl_Position = mProj * mView * mWorld * vec4(vertPosition, 0.0, 1.0);
    }`
];

will throw an error: ERROR: 0:7: 'uniform' : syntax error
However, if I use the non-minified file, it works fine.
Not sure if this is a bug and expected behaviour, or maybe I'm doing something wrong? I doubt it though as it works with the normal file.

Uh, oh. Looks like the minified file is messed up or something. I'll check it out within the next few days.

@stefnotch I do apologise for the nooby question as I'm new to this kind of thing, but is there a way I can test it? Once I test it, if I can, I'll get back to you if it's fixed.

@TFKED Just download the latest gl-matrix-min.js and try it out. 😃


Parse names for Macintosh platform ID + Roman

The idea is that language names are parsed by the caller.
Your code is incorrect. MacRoman is not UTF-16. You can check how fontdb handles this.

The idea is that language names are parsed by the caller.

Your code is incorrect. MacRoman is not UTF-16. You can check how fontdb handles this.

Thanks for your reply, it really helps! Checked fontdb, and I think it fits my needs.


Added ISourceText - Implemented using Roslyn's SourceText in FSharp.Editor

We were doing .ToString() on Roslyn's SourceText type in FSharp.Editor. This is very bad as we are making full copies of the source text and for larges files making large allocations on the LOH. To solve this, we added an ISourceText interface that looks similar to Roslyn's SourceText type. It is then implemented in FSharp.Editor with Roslyn's SourceText as the implementation detail.
This also eradicates adding a new line at the end of every source file in FCS.
This should resolve these issues:
https://github.com/Microsoft/visualfsharp/issues/5935
https://github.com/Microsoft/visualfsharp/issues/5936
https://github.com/Microsoft/visualfsharp/issues/5937

(@TIHan just found a couple of review comments I hadn't submitted)

getXmlDocablesImpl requires that we have all lines in the source file. After looking at it, I think it is possible that we do not have to.

One test is failing "ShouldGiveSignatureHelpAtCorrectMarkers"

https://www.youtube.com/watch?v=P3ALwKeSEYs

This is now ready.

There are some APIs that still take source as a string parameter here. Since we're changing the API, we might as well go through those and also have them take an ISourceText

This may not matter for Roslyn's SourceText, but using the string implementation of ISourceText is slower than passing the string before. I will get the Roslyn benchmark one soon.
Before

After

Using 'SourceTextfrom Roslyn, it's the same perf as just using theISourceText` string implementation. This slightly regresses perf than using the string directly while reducing massive allocations.

20ms increase (with 5ms error) due to introducing interface method dispatch seems like a perfectly reasonable tradeoff for the large number of allocations (and LOH allocations) this removes. In an ideal world, all F# editors would have the same data type so that we wouldn't need this, but that's likely never going to be the case

Fair enough, though interface method dispatch does have a nonzero cost and the introduction of that interface + calling members on it is the primary change made here. It's not surprising to me that the ISourceText version of a benchmark (be it backed by a string or Roslyn SourceText) is a bit slower than the previous string implementation due to this.

Before

After

It doesn't have a nonzero cost, but you only start to see the overhead in ms in the millions of calls: https://stackoverflow.com/questions/890687/overhead-of-implementing-an-interface

I'm not sure what it could have been, but after merging dev16.0 in properly that includes @brettfo's changes in master for sdk style projects, the numbers definitely show now (it's faster).
So, this is before these changes, but with 32-bit which shows a big difference:

Much slower than the 64-bit which is interesting (250ms).

Awesome!

I'm ready to merge this. Any objections?

This PR doesn't seem to have been merged to master. I wonder if there any others too.

Lots. It will be in master once dev16 ships and we merge into master.

I think it's bad for OSS FCS development in this repo.
We now have diverged code for FCS and VS integration solutions and FCS clients cannot update their code until dev16.0 is merged back to master.

@auduchinok for FCS we could integrate to the FCS from from a branch other than master, I just chose master because it seemed convenient. If we want features faster we could just as easily pick a non-master branch. 🤷♂

I think it's bad for OSS FCS development in this repo. We now have diverged code for FCS and VS integration solutions and FCS clients cannot update their code until dev16.0 is merged back to master.

I think it might be ok. What's the divergence between FCS master and visualfsharp master?

The fact there are pending unshipped changes in dev16.0  is a slight divergence but it is on a path back to convergence when dev16.0 ships.  That's normal?

What's the divergence between FCS master and visualfsharp master?

My point is about not having some PRs merged in master, assuming one builds FCS from source in this repo. Due to all the development is currently happening here I doubt there's a reason to build it from the other repo unless all the FCS development and stuff moved from there as well.

@auduchinok for FCS we could integrate to the FCS from from a branch other than master, I just chose master because it seemed convenient. If we want features faster we could just as easily pick a non-master branch. 🤷♂

And other branches may not contain some of PRs merged that are already in master in the same way. I'd expect master to have all changes that FCS clients will have to deal with.
Taking a branch that is tied to some future VS release doesn't feel right for FCS development that is not a part of VS integration plugin.

The fact there are pending unshipped changes in dev16.0 is a slight divergence but it is on a path back to convergence when dev16.0 ships.

From a glance there're PRs that are really important like https://github.com/Microsoft/visualfsharp/pull/6191 and this one or general improvements that'd be great to see in action like https://github.com/Microsoft/visualfsharp/pull/6048 and https://github.com/Microsoft/visualfsharp/pull/6058.

That's normal?

It'd probably be better to try to have it diverged for less time, e.g. until the first public VS preview and not the actual release. Other tools have to be updated for changes like this PR as well.
And changes like https://github.com/Microsoft/visualfsharp/pull/6191 don't depend on VS-specific changes at all so they would seem better to go to master first.

@auduchinok Yes, things should really go into master unless they specifically need to go into dev16.0
However we have to cut some slack here: @tihan and others at Microsoft are doing us a great favor by always sitting on the latest VS preview and checking that things are good and performant there.
If you're doing regular work there it's kind of hard to switch back and do serious dev work on VS2017 (which is master).  So it's better to just live with a bit of divergence and reconcile later.

The important thing is that the automatic flows are set up to integrate and flow correctly.

I'm building Fantomas against FCS built from dev16.1 and getting these errors. They're expected for me and, despite they are relatively easy to fix by either using SourceText.ofString or changing Fantomas API, it can be quite unexpected for other FCS clients to have to change their public APIs this way.
I wonder if preserving existing APIs (with an obsolete attribute?) and adding new overloads could be a better approach?


CAMEL-13215 and CAMEL-16981: consolidate consumerStreams and consumersCount

This path consolidates consumerStreams into consumersCount. Previously
consumerStreams was used to adjust the size of the thread pool used for
the consumer threads.
With this change the size of the thread pool is always the same size of
the number of consumers, preventing situations where consumers were
created unnecessarily and unused due to improperly sized thread pool.
It also clarifies the documentation (CAMEL-16981) and consumer behavior.

I believe we could remove the consumerStreams parameter in 3.13, but thought it would be better to deprecated for now to give time for users to adjust.

@orpiske its fine to remove and add a note in the upgrade guide.
We want these non LTS release to go fast. And its an option that is hardly in use.

@orpiske its fine to remove and add a note in the upgrade guide.
We want these non LTS release to go fast. And its an option that is hardly in use.

Cool, thanks for the heads up. In this case, I'll go ahead and remove it right away.


image_type_ota: add btrfs support as an alternative to ota-ext4

Add btrfs support as an alternative to ext4.

@pattivacek I can't remember using BTRFS on target devices. We tried it on our build machines (PC, x64) shortly, and the stability was below expectations (and below that of ext4 specifically). Can't see a reason why it can't be supported as one of the alternatives though.

Yeah, I never really tested / validated ostree with btrfs, but the change itself is quite isolated so LGTM

Were you thinking of F2FS?  I remember using that one for a bit, and we had problems because it seemed to be very aggressively avoiding writeback.

This is what I was thinking of:
https://github.com/advancedtelematic/meta-updater/issues/334
Sorry, misremembered who was involved in that! At any rate it looks like this should be fine.

@pattivacek looking at https://github.com/advancedtelematic/meta-updater/issues/334 , the btrfs-progs and u-boot issues mentioned have been fixed a long time ago in June 2018. I tested btrfs successfully on qemu and imx platforms.
That said, a bit out of scope for this PR, but I don't use the wic otaimage plugin. I use the rootfs plugin shipped by default with wic:
part / --source rootfs --rootfs-dir=${OTA_SYSROOT} --fstype=ext4 --label otaroot --align 4 --use-label ${WKS_ROOTFS_PART_EXTRA_ARGS}
Nowadays, it's just a matter to pass the --rootfs-dir argument, making the otaimage plugin obsolete.


Add deno_websocket

This PR introduces WebSocket support by integrating the deno_websocket package.

Looks great!
My only question would be weather we could feed it the options in web, since they are the same ones

I guess it makes more sense for them to use the same config. Now WebSocketOptions struct kinda looses sense though, maybe I should remove that too and only use WebOptions

I guess it makes more sense for them to use the same config. Now WebSocketOptions struct kinda looses sense though, maybe I should remove that too and only use WebOptions

Good idea, in practice having split configs might cause issues
Pretty sure deno itself uses the same options for both

Can you add the new example to the examples workflow in .gitHub?
After that looks great to me!
I appreciate the contribution, adding the extensions is very time consuming so I appreciate any help

LGTM, thanks!

I like to help and also appreciate the work you put into implementing this. It's perfect for my use-case. I wrote the implementation of the extension because I needed a way to bridge JS and rust in an event-driven application. So the easiest solution was to WebSockets since I already run a server for it locally.
Off-topic, but I also experimented with implementing the BroadcastChannel extension, works great with one runtime with multiple handlers, however the deno implementation InMemoryBroadcastChannel can't be used with 2 runtimes at the sime time. I think this could be solved by creating a custom BroadcastChannel trait implementation utilizing crossbeam-channel crate.
So in the future I'll be working on implementing the BroadcastChannels properly and after that maybe I could make them be shared across runtimes optionally. I'll create the PR once I'm done with my experiments.


ld: library not found for -lgomp

I thought this problem occurred because wrong setting on gcc or opencv, probably. Is there anyone having the same problem? I have reinstall all dependencies and Xcode itself. It doesn't work.
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/ranlib: file: lib/libmxnet.a(mxrtc.o) has no symbols
clang: warning: argument unused during compilation: '-pthread'
ld: library not found for -lgomp
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make: *** [lib/libmxnet.so] Error 1
make: *** Waiting for unfinished jobs....
In file included from tools/im2rec.cc:21:
In file included from /usr/local/Cellar/opencv/2.4.12/include/opencv2/opencv.hpp:56:
/usr/local/Cellar/opencv/2.4.12/include/opencv2/ml/ml.hpp:961:18: warning:
'CvForestTree::train' hides overloaded virtual functions
[-Woverloaded-virtual]
virtual bool train( CvDTreeTrainData* trainData, const CvMat* _subsa...
^
/usr/local/Cellar/opencv/2.4.12/include/opencv2/ml/ml.hpp:867:18: note: hidden
overloaded virtual function 'CvDTree::train' declared here: different
number of parameters (2 vs 3)
virtual bool train( CvMLData* trainData, CvDTreeParams params=CvDTre...
^
/usr/local/Cellar/opencv/2.4.12/include/opencv2/ml/ml.hpp:877:26: note: hidden
overloaded virtual function 'CvDTree::train' declared here: different
number of parameters (8 vs 3)
CV_WRAP virtual bool train( const cv::Mat& trainData, int tflag,
^
/usr/local/Cellar/opencv/2.4.12/include/opencv2/ml/ml.hpp:1149:18: warning:
'CvBoostTree::train' hides overloaded virtual functions
[-Woverloaded-virtual]
virtual bool train( CvDTreeTrainData* trainData,
^
/usr/local/Cellar/opencv/2.4.12/include/opencv2/ml/ml.hpp:867:18: note: hidden
overloaded virtual function 'CvDTree::train' declared here: different
number of parameters (2 vs 3)
virtual bool train( CvMLData* trainData, CvDTreeParams params=CvDTre...
^
/usr/local/Cellar/opencv/2.4.12/include/opencv2/ml/ml.hpp:877:26: note: hidden
overloaded virtual function 'CvDTree::train' declared here: different
number of parameters (8 vs 3)
CV_WRAP virtual bool train( const cv::Mat& trainData, int tflag,
^
2 warnings generated.
ld: library not found for -lgomp
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make: *** [bin/im2rec] Error 1

mac?

yes
Sent from my iPhone

On Nov 29, 2015, at 8:47 PM, qiaohaijun<EMAIL_ADDRESS>wrote:
mac?
—
Reply to this email directly or view it on GitHub.

You may follow the solutions used in #728 to at least successfully compile a CPU version using openblas on Mac OS X 10.11.

I think this is because your compiler doesn't have OpenMP support.

if the machine has only one CUDA GPU, OpenMP is not really needed. BLAS can handle multi-CPU, either Apple's blas or openblas. I suggest USE_OPENMP=0 in config.mk. It solved my installation problem on mac.

Try
brew install clang-omp
make CXX=clang-omp++
It worked for me.

Thanks for your share.
It works for me. Just realize that gcc always makes things messy and costs long time to compile.

On Nov 30, 2015, at 1:00 PM, caprice<EMAIL_ADDRESS>wrote:
Try
brew install clang-omp
make CXX=clang-omp++
It worked for me.
—
Reply to this email directly or view it on GitHub https://github.com/dmlc/mxnet/issues/749#issuecomment-160760072.

appletekiMacBook-Air-3:bin apple$ brew install clang-omp
Warning: clang-omp-2015-04-01 already installed
appletekiMacBook-Air-3:bin apple$ make CXX=clang-omp++
make: *** No targets specified and no makefile found.  Stop.
why。。。

Try
brew install clang-omp
make CXX=clang-omp++
It worked for me.

I try your following cmd but I got
==> Searching for similarly named formulae...
Error: No similarly named formulae found.
Error: No available formula or cask with the name "clang-omp".
==> Searching for a previously deleted formula (in the last month)...
Error: No previously deleted formula found.
==> Searching taps on GitHub...
Error: No formulae found in taps.

@nam-nguyen17 omp ships as part of the llvm in homebrew now. See https://stackoverflow.com/a/48746939


Support custom PK algo types

Same as internal version

Also it would be nice to have one more PR before doing a release that just updates everything for 2018 edition and resolves deprecation warnings

Oh it looks like there are some conflicts

@Goirad I will create a PR updating edition

bors r+


small change in update_nested_dict_value using copy

@yael-malwa
Think it is better to use copy() rather than creating a tmp vars in update_nested_dict_value method.
Also I runed black formatter on the file (advising you to use it robustly).
Also advising to use flake8.
To add you as a reviewer I need you to add me as a collaborator

LGTM

btw, @DavidMeu notice we do use pylint in the CI which is "better" than flake8 in the sense of catching more issues. It's slower as well of course but for this small code base it's great.


 I try to follow your dnscrypt-proxy guide untill the download of the file. Even the file is bigger than 2 MB my Pi only loads a couple of kb:
`@orangepizero:~/dnsproxy$ sudo wget https://github.com/jedisct1/dnscrypt-proxy/releases/tag/2.0.0/dnscrypt-proxy-linux_arm-2.0.0.tar.gz
...
dnscrypt-proxy-linu     [  <=>               ]  45.59K   169KB/s    in 0.3s
2018-02-17 21:49:20 (169 KB/s) - ‘dnscrypt-proxy-linux_arm-2.0.0.tar.gz’ saved [                                      46683]`
I have the file in my folder but can`t proceed. Getting a error:
`@orangepizero:~/dnsproxy$ sudo tar -xf dnscrypt-proxy-linux_arm-2.0.0.tar.gz
gzip: stdin: not in gzip format
tar: Child returned status 1
tar: Error is not recoverable: exiting now
`
What am I doing wrong? Thanks for the help
Phil

You downloaded a web page: https://github.com/jedisct1/dnscrypt-proxy/releases/tag/2.0.0/dnscrypt-proxy-linux_arm-2.0.0.tar.gz
The link to the actual file appears to be https://github.com/jedisct1/dnscrypt-proxy/releases/download/2.0.0/dnscrypt-proxy-linux_arm-2.0.0.tar.gz


num-traits and -complex to 0.1.35 to support serde 0.8

Upgraded num-traits and num-complex to 0.1.35 so that all of (?) ndarray supports serde 0.8.

This bump isn't strictly needed, you can just use cargo upgrade and it will work.

Yeah, you are right. Sorry for the panic. I just rechecked how to specify crate dependencies, and there it's noted that 0.1.32 is equivalent to ^0.1.32 := >=0.1.32 <1.0.0.


3d6+1 rolls 4 dice

3d6+1 rolls 4 dice.  I don't like that the +1 dice is a slightly different color and font, but is rather misleading.  I think we should remove the +1 from Dice So Nice.

Never mind the "5" is for the stun multiplier.


Quantization Aware Training

Is there any instructions on how to do QAT in mmdetection ?

Not an mmdet developer, but I've looked into this recently. As far as I can tell there's no support for QAT (or PTQ) in mmdetection. You can try using mmrazor, which is their model compression library, but it doesn't seem to be maintained and I was unable to get it to work with mmdetection for my use case.
I ultimately got QAT to work by using Nvidia's quantization library for pytorch and manually inserting quantization ops in my mmdet model definition. You could also consider using pytorch's quantization library.
Unfortunately I can't share any of my custom code as it's proprietary, but good luck to you.

Not an mmdet developer, but I've looked into this recently. As far as I can tell there's no support for QAT (or PTQ) in mmdetection. You can try using mmrazor, which is their model compression library, but it doesn't seem to be maintained and I was unable to get it to work with mmdetection for my use case.
I ultimately got QAT to work by using Nvidia's quantization library for pytorch and manually inserting quantization ops in my mmdet model definition. You could also consider using pytorch's quantization library.
Unfortunately I can't share any of my custom code as it's proprietary, but good luck to you.

Thanks for your reply.
I also inserted QuantStub and DeQuantStub in to my model, well I don't know if they are effective. I also noticed that in the Pytorch documents, quant config is set before the training loop, which means I need to insert this part of code in the runner of mmengine, but I don't want to do that.


Cheat command error, line 44

I have a issue with Cheat. I am running Solus 4.0 and I installed Cheat and I get this CL error..
Traceback (most recent call last):   File "/usr/bin/cheat", line 44, in <module>     from docopt import docopt ImportError: No module named docopt
at the prompt after entering cheat ls and any other sheet command too... :(
I installed with the [sudo] python setup.py install as per the main page here.
I installed it on Mint cinnamon 18.3 and the new Manjro Cinnamon that just came out and they both worked fine installing the same way.
Any help would be great. I am somewhat new to linux so I do not know how to "uninstall" Cheat with Python...
Thanks

Oh! even the command cheat -dgives the same error...

Hello, Apparently Solus 4.0 does not have docopt installed by default.
I found this on GitHub, "https://github.com/docopt/docopt" and reading the post it gave instruction on installing docopt like this, pip install docopt==0.6.2...I thought why not! :D
Seeing how it was a "docopt error" I took a guess that it was not installed in Solus.
So I issued the PIP command to install the file "sudo pip install docopt==0.6.2" , it
installed and Cheat not works from the command line as it should.
Like I said I took a guess and it fixed the issue....
Please set this issue as closed....