[Bug] Music does not play via Youtube.

Whenever I try to play music, it searches and plays YouTube by default. However, probably due to an API change, it now does not play anything.
Instead returns with a Failed to Play Song: Sign In to confirm you are not a bot
https://i.imgur.com/0wZkh3m.png

I just released v0.2.0 of this mod which updated the YouTube source which has fixed a few other YouTube-related issues. Can you give it a try and report back?
https://github.com/ItzDerock/simplevoicechat-music/releases/tag/0.2.0
I'm unable to reproduce this bug, but I did find an open issue at https://github.com/lavalink-devs/youtube-source/issues/14 related to this.

After updating, I tried again, and it seems to be not fixed.

There's unfortunately not much I can do from my side. According to the issue I linked in my previous comment, YouTube have a list of IP ranges and ASNs (ie OVH, GalaxyGate, etc) that they flag as suspicious, and it seems that your hosting provider may fall under one of those ranges.
Lavaplayer removed authentication support previously too, so I can't add an option to log into a YouTube account to get past the sign in screen. They're not very adamant with adding authentication support back since its complex and I think they've blocked accounts that tried to do this in the past too.

There's unfortunately not much I can do from my side. According to the issue I linked in my previous comment, YouTube have a list of IP ranges and ASNs (ie OVH, GalaxyGate, etc) that they flag as suspicious, and it seems that your hosting provider may fall under one of those ranges.
Lavaplayer removed authentication support previously too, so I can't add an option to log into a YouTube account to get past the sign in screen. They're not very adamant with adding authentication support back since its complex and I think YouTube have blocked accounts that tried to do this in the past too.

Ah, that's unfortunate. Maybe Pebble Hosting might be using one of those services.

Hey I'm getting the same issue with my discord bot Anytime I try to play specifically music with YouTube for example like a results or search results it returns this   Failed to Play Song: Sign In to confirm you are not a bot This is how I have my plugins and everything In my Application config
lavalink:
plugins:
- dependency: "dev.lavalink.youtube:youtube-plugin:1.4.0" #
repository: "https://maven.lavalink.dev/releases"
snapshot: false
pluginsDir: "./plugins"
defaultPluginRepository: "https://maven.lavalink.dev/releases"
defaultPluginSnapshotRepository: "https://maven.lavalink.dev/snapshots"
server:
password: "autocreativeco"
sources:
youtube: false

@lolcat-y If you're having issues with your Discord Bot, leave a comment in https://github.com/lavalink-devs/youtube-source/issues/14 instead of here. This repo is for a Minecraft plugin that uses lavaplayer.

Quick update on this, looks like some progress is being made upstream in https://github.com/lavalink-devs/youtube-source/pull/33
tldr of the implications:
A server administrator (someone with console access) will have to do a one-time setup by running something along the lines of  /music authenticate. The plugin will display a code and a URL. The admin will have to go to that URL, and enter the code. This logs the plugin into that google account. If you've ever set up YouTube on a TV, this is exactly like that.
I'd also strongly suggest using a burner google account for this, since I don't want to have to deal with people losing their main account due to this plugin.

Quick update on this, looks like some progress is being made upstream in lavalink-devs/youtube-source#33
tldr of the implications:
A server administrator (someone with console access) will have to do a one-time setup by running something along the lines of /music authenticate. The plugin will display a code and a URL. The admin will have to go to that URL, and enter the code. This logs the plugin into that google account. If you've ever set up YouTube on a TV, this is exactly like that.
I'd also strongly suggest using a burner google account for this, since I don't want to have to deal with people losing their main account due to this plugin.

I think this would be fine. My only concern is the ads. But I guess that's up the person who's making the pr.

Hey, so how exactly do I play videos from YouTube again? There is no such command as /music authenticate in Minecraft after the mod is added (using mod v0.2.0).

Hi @Omersaeed02, the authentication feature hasn't been implemented yet -- we were waiting for the upstream YouTube library to implement authentication.
Just checked, and it seems they merged in the changes two days ago, so sometime in the near future I'll have a look at that and add the required changes on the mod side and will publish a hopefully working version again.


Automated cherry pick of #5151: fix: 1. adjust default response header timer to 30 seconds 2. set default paging limit to 20

Cherry pick of #5151 on release/2.12.
#5151: fix: 1. adjust default response header timer to 30 seconds 2. set default paging limit to 20

Codecov Report

:exclamation: No coverage uploaded for pull request base (release/2.12@e2e456f). Click here to learn what that means.
The diff coverage is 50%.

@@              Coverage Diff               @@
##             release/2.12   #5152   +/-   ##
==============================================
  Coverage                ?   6.83%
==============================================
  Files                   ?     504
  Lines                   ?   85833
  Branches                ?       0
==============================================
  Hits                    ?    5869
  Misses                  ?   79470
  Partials                ?     494

Flag
Coverage Δ

#aFlag
6.83% <50%> (?)

Impacted Files
Coverage Δ

pkg/cloudcommon/db/db_dispatcher.go
0% <0%> (ø)

pkg/util/httputils/httputils.go
43.49% <100%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e2e456f...f3e172f. Read the comment docs.


Add missing permissions for group role

Feature or Bugfix

Bugfix

Detail
Environment group role is missing permissions for interaction with worksheet when no permission is given for creating datasets in the environment.
Relates
Solves issue https://github.com/awslabs/aws-dataall/issues/115
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Hi @degoldner, thanks for the PR. There are some Lint/formatting issues. The rest lgtm
 python -m flake8 --exclude cdk.out,blueprints --ignore E402,E501,F841,W503,F405,F403,F401,E712,E203 backend/ backend/dataall/cdkproxy/stacks/policies/service_policy.py:52:1: W293 blank line contains whitespace backend/dataall/cdkproxy/stacks/policies/service_policy.py:53:74: W291 trailing whitespace backend/dataall/cdkproxy/stacks/policies/service_policy.py:55:60: W291 trailing whitespace backend/dataall/cdkproxy/stacks/policies/service_policy.py:56:69: W291 trailing whitespace make: *** [Makefile:38: lint] Error 1

Hi @degoldner, thanks for the PR. There are some Lint/formatting issues. The rest lgtm python -m flake8 --exclude cdk.out,blueprints --ignore E402,E501,F841,W503,F405,F403,F401,E712,E203 backend/ backend/dataall/cdkproxy/stacks/policies/service_policy.py:52:1: W293 blank line contains whitespace backend/dataall/cdkproxy/stacks/policies/service_policy.py:53:74: W291 trailing whitespace backend/dataall/cdkproxy/stacks/policies/service_policy.py:55:60: W291 trailing whitespace backend/dataall/cdkproxy/stacks/policies/service_policy.py:56:69: W291 trailing whitespace make: *** [Makefile:38: lint] Error 1

@dlpzx I fixed all linting issues, should be ready for review now :)


VE Modifications for Adjusting Non-Work Parking Costs

The parking cost model assumes that non-work travel to a Bzone pays for parking if a parking cost has been assigned to a Bzone. This approach does not allow modeling of a scenario where workers pay for their parking but shoppers (i.e. non-work) do not.
Details are posted on the following link:
https://github.com/gregorbj/OregonDOT-VisionEval/blob/master/documents/drafts/Non-Work_Parking_Mods.md

This has been addressed. See response to pull  request.


SplitView autosaveName has no effect

Is this the way I should use that? I was expecting the panes to be restored to their saved positions when running this, but they go back to their 50% default. I'm on 10.10 if that matters.
from vanilla import *

leftPane = List((0, 0, 0, 0), range(10))
rightPane = List((0, 0, 0, 0), range(10, 30))

paneDescriptors = [
    dict(view=leftPane, identifier="pane1"),
    dict(view=rightPane, identifier="pane2"),
]

w = Window((500, 300), "SplitViewTest")
w.splitView = SplitView((0, 0, -0, -0), paneDescriptors, autosaveName="myautosavename")

w.open()

I see that the pane setting end up in the prefs file, but somehow they're being ignored when setting up the NSSplitView.

I found a workaround at https://stackoverflow.com/questions/16587058/nssplitview-auto-saving-divider-positions-doesnt-work-with-auto-layout-enable
But it still doesn't work. By printing the frame info that is being fetched from the defaults I see that even though the correct frames are initially being stored, we're getting the default values anyway. Something in the way vanilla sets up the NSSplitView causes the defaults to be rewritten to their default values.
work-with-auto-layout-enable

from AppKit import NSUserDefaults
from vanilla import *

def restoreAutosavedPositions(self):
    # Yes, I know my Autosave Name; but I won't necessarily restore myself automatically.
    key = "NSSplitView Subview Frames %s" % self.autosaveName()
    subviewFrames = NSUserDefaults.standardUserDefaults().valueForKey_(key)
    print(subviewFrames)
    # the last frame is skipped because I have one less divider than I have frames
    for i in range(len(subviewFrames) - 1):
        # this is the saved frame data - it's an NSString
        frameString = subviewFrames[i]
        components = frameString.split(", ")

        # only one component from the string is needed to set the position
        # if I'm vertical the third component is the frame width
        if self.isVertical():
            position = components[2]
        # if I'm horizontal the fourth component is the frame height
        else:
            position = components[3]

        self.setPosition_ofDividerAtIndex_(float(position), i)

leftPane = List((0, 0, 0, 0), range(10))
rightPane = List((0, 0, 0, 0), range(10, 30))

paneDescriptors = [
    dict(view=leftPane, identifier="pane1"),
    dict(view=rightPane, identifier="pane2"),
]

w = Window((500, 300), "SplitViewTest")
w.splitView = SplitView((0, 0, -0, -0), paneDescriptors, autosaveName="myautosavename")
restoreAutosavedPositions(w.splitView._nsObject)
w.open()

It is still an issue. hmm… Any idea where to find the solution?
Are you sure that it is a vanilla wrapping problem?


getWebCookies() cancel refreshToken

Describe the bug
Sometimes calling getWebCookies() causes "AccessDenied" error and the refreshToken is canceled immediately after that.
"Canceled token" means that use of this token causes an "AccessDenied" error for the token platform and for getWebCookies().
For example, if I create a refreshToken for EAuthTokenPlatformType.SteamClient and then try to collect the cookies and get an error, then if I use the refreshToken in node-steam-user I get the same "AccessDenied" error.
This behavior happens about 40% of the time for different accounts (not for the same account). Some accounts are comfortable using getWebCookies() anytime, some accounts lose their refreshToken.
Note: refresh tokens are not expired yet (checked via jwt.io) and was created for EAuthTokenPlatformType.SteamClient.
I tried to use a proxy, but the problem persists.
Versions
steam-session: 1.2.3
node: v18.16.0
Code
const getCookies = async (refreshToken: string) => {
	let loginSession: LoginSession;
	try {
		loginSession = new LoginSession(EAuthTokenPlatformType.WebBrowser);
		loginSession.loginTimeout = 10000;
		loginSession.refreshToken = refreshToken;

		const cookies = await loginSession.getWebCookies();

		return cookies;
	} catch (error) {
		throw new Error('Failed to get cookies');
	} finally {
		loginSession?.cancelLoginAttempt();
	}
};

Screenshots and Error Logs
Error: AccessDenied
    at eresultError (/Users/user/Progects/project/node_modules/steam-session/src/helpers.ts:16:12)
    at LoginSession.getWebCookies (/Users/user/Progects/project/node_modules/steam-session/src/LoginSession.ts:525:22)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async getCookiesForSession (/Users/user/Progects/project/src/main.ts:51:19)
    at async promise.retries (/Users/user/Progects/project/src/main.ts:147:21)
    at async RetryOperation._fn (/Users/user/Progects/project/node_modules/p-retry/index.js:50:12) {
  eresult: 15
}

I can't really speak toward why the Steam backend would invalidate a token. Maybe they invalidate if your IP changes or something.
It's also possible that calling getWebCookies() with a SteamClient platform token will cause problems like this. The official client doesn't get cookies this way.

I can't really speak toward why the Steam backend would invalidate a token. Maybe they invalidate if your IP changes or something.
It's also possible that calling getWebCookies() with a SteamClient platform token will cause problems like this. The official client doesn't get cookies this way.

This behavior seems to be happen when we use EAuthTokenPlatformType.SteamClient tokens.
I tested the same code with EAuthTokenPlatformType.MobileApp and didn't see errors like AccessDenied.
As a temporary workaround, we should create another refresh token to interact with the web.

As a temporary workaround, we should create another refresh token to interact with the web.

That would work. You could also use steam-user's webSession event.


Optional by default

Relates to #14
This PR implements the change mentioned in #14 related to making fields optional by default and adding support for default values in the Parse type.
Implementing optional by-default and default values for compileSchema will be done in a separate PR.

It's worth noting that this is a breaking change. However, we can easily make it since this package has not been deployed to a package registry yet.


Updates to Dapr for .Net Developers

This PR updates the following pages :

Index
Updates toc.yml for dotnet-architecture specific navigations.
Removed displayname in dapr-for-net-developers/toc.yml
updated references section on 'The Dapr bindings building block' Chapter
removed references section on the-world-is-distributed chapter

Hi @nishanil , Could you please review.


I don't see any difference between prod build and aot build

I'm submitting a ...
[ ] bug report
[ ] feature request
[x] question about the decisions made in the repository

What is the expected behavior?
After updating to the latest version of angular-starter and building it once using "npm build:prod" and once using "npm build:aot" I do not see any difference in the resulting dist-folders. Is this as designed?

Yes, it is designed.
When you run build:prod, it builds static assets with JIT compilation. When you run build:aot, it builds static assets with AOT compilation.
In simple words: project with AOT compilation for programmer builds longer, but for user it works faster.

Thank you for the answer. But I can not imagine, that both buildresults are 100% identically.

have u compared the result files line by line?

I did a binary compare with a tool.

I made some changes. can you check again. the difference is AoT vs JIT


Got compile error while build the app

Severity	Code	Description	Project	File	Line	Suppression State
Error	MSB3644	The reference assemblies for framework ".NETFramework,Version=v5.0" were not found. To resolve this, install the SDK or Targeting Pack for this framework version or retarget your application to a version of the framework for which you have the SDK or Targeting Pack installed. Note that assemblies will be resolved from the Global Assembly Cache (GAC) and will be used in place of reference assemblies. Therefore your assembly may not be correctly targeted for the framework you intend.	myApp	C:\Program Files (x86)\Microsoft Visual Studio\2017\Enterprise\MSBuild\15.0\Bin\Microsoft.Common.CurrentVersion.targets	1179

So NetFramework version 5 does not exist. You were probably meaning just .NET5 instead. Is this for a tutorial? Or what?
In your project file, you should switch the TargetFramework tag to look like this:
<TargetFramework>net5.0</TargetFramework>

Sometimes you also get this error if you don't have the .NET 5 SDK installed on the machine. Are you trying to build via CLI or VS? If VS, what version of VS are you on?


Error creating Python env. on TreuNAS CORE 13.0

When running the install script on TrueNAS CORE 13.0-U3.1, I get the following:

root@TrueNAS[/mnt/data/scripts/zfs-autobackup]# ./trigger.sh --install
Creating Python virtual environment...
Error: [Errno 1] Operation not permitted: '/mnt/data/scripts/zfs-autobackup/venv/bin/Activate.ps1'
root@TrueNAS[/mnt/data/scripts/zfs-autobackup]#

Could you try once with set -euox pipefail instead of set -euo pipefail on line 3 of trigger.sh for a bit more logging.
Have any files or directories been created? If so, can you run ls -la inside the venv folder? Also please run ls -la inside the folder where you put trigger.sh and post the output.
Looks like it somehow doesn't have write permissions...

ls -la from the dir where trigger.sh is:

total 134
drwxrwx---+  3 root  wheel    10 Jan  4 14:54 .
drwxrwx--x+ 13 root  wheel    15 Jan  4 13:38 ..
-rwxrwx---+  1 root  wheel  4062 Jan  4 13:38 backup.sh
-rwxrwx---+  1 root  wheel  1315 Jan  4 13:42 config
-rwxrwx---+  1 root  wheel   700 Jan  4 13:38 monitor.py
-rwxrwx---+  1 root  wheel  7796 Jan  4 13:38 README.md
-rwxrwx---+  1 root  wheel    36 Jan  4 13:38 requirements.txt
-rwxrwx---+  1 root  wheel  2697 Jan  4 13:38 trigger.sh
drwxrwx---+  5 root  wheel     7 Jan  4 13:39 venv

ls -la from venv dir:

total 30
drwxrwx---+ 5 root  wheel   8 Jan  4 14:56 .
drwxrwx---+ 3 root  wheel  10 Jan  4 14:54 ..
drwxrwx---+ 2 root  wheel   6 Jan  4 13:39 bin
drwxrwx---+ 2 root  wheel   2 Jan  4 13:39 include
drwxrwx---+ 3 root  wheel   3 Jan  4 13:39 lib
lrwxr-xr-x  1 root  wheel   3 Jan  4 13:39 lib64 -> lib
-rwxrwx---+ 1 root  wheel  76 Jan  4 13:47 pyvenv.cfg

Will modify trigger.sh and report back in a moment.  Thank you for your help!  I'm logged in as root from the UI console, if that helps.

And maybe once an ls -la from /mnt/data/scripts/zfs-autobackup/venv/bin/?

Logging in as a non-root user, since the UI won't let me copy & paste easily.  I'm doing this from a non-root account using Terminal on macOS.  It looks like GitHub is replacing the plus signs with bullets:

geoffrey@TrueNAS:/mnt/data/scripts/zfs-autobackup $ ./trigger.sh --install
++ basename ./trigger.sh

SCRIPT_NAME=trigger.sh
+++ dirname ./trigger.sh
++ cd .
++ pwd
SCRIPT_DIR=/mnt/data/scripts/zfs-autobackup
cd /mnt/data/scripts/zfs-autobackup
++ cat
STEPS='1. Manually create (encrypted) ZFS pool(s) on removable disk(s).

Manually edit config to specify the names of your backup pool(s) and the encryption passphrase.
Manually schedule trigger.sh to run at system startup. On TrueNAS SCALE: System Settings -> Advanced -> Init/Shutdown Scripts -> Add -> Description: trigger-zfs-autobackup; Type: Script; Script: /path/to/trigger.sh; When: Post Init -> Save
Manually insert backup disk whenever you want to make a backup.
Automatic backup is triggered and sends email on completion.'

VENV=/mnt/data/scripts/zfs-autobackup/venv
INSTALL=false
parse_params --install
:
case "${1-}" in
INSTALL=true
shift
:
case "${1-}" in
break
args=("$@")
return 0
'[' true = true ']'
echo 'Creating Python virtual environment...'
Creating Python virtual environment...
python3 -m venv /mnt/data/scripts/zfs-autobackup/venv --without-pip
Error: [Errno 1] Operation not permitted: '/mnt/data/scripts/zfs-autobackup/venv/bin/Activate.ps1'
geoffrey@TrueNAS:/mnt/data/scripts/zfs-autobackup $

And maybe once an ls -la from /mnt/data/scripts/zfs-autobackup/venv/bin/?

geoffrey@TrueNAS:/mnt/data/scripts/zfs-autobackup/venv/bin $ ls -la
total 29
drwxrwx---+ 2 root  wheel     6 Jan  4 13:39 .
drwxrwx---+ 5 root  wheel     8 Jan  4 14:56 ..
-rwxrwx---+ 1 root  wheel  8834 Jan  4 15:06 Activate.ps1
lrwxr-xr-x  1 root  wheel     7 Jan  4 13:39 python -> python3
lrwxr-xr-x  1 root  wheel    22 Jan  4 13:39 python3 -> /usr/local/bin/python3
lrwxr-xr-x  1 root  wheel     7 Jan  4 13:39 python3.9 -> python3
geoffrey@TrueNAS:/mnt/data/scripts/zfs-autobackup/venv/bin $

I don't know why it's not working. It's failing at this command: python3 -m venv /mnt/data/scripts/zfs-autobackup/venv --without-pip. Try to see if you can get that command working with a different path (make a new folder somewhere first). Try as root user.

OK, I made a new dir, /mnt/data/zfs-backup, and copied the files into there.  The install seems to be working now.  It's just a folder created using mkdir, and not a Dataset, if that may be the issue.  I'll work from here and see if I run into any more issues - thank you for your help!

Nice! Good luck :)

I'm running into issues with the commands to create the disk - would you like me to open more issues here, or would you like to set up a discussion some time?  I know this is for CORE and not SCALE, and I'm a few hours behind you (New York area, USA) - I'm flexible on how to approach getting this working on CORE.  Thank you!

Please make a new issue if the documentation doesn't work for you and post which commands fail and their output, what you've tried etc. Also I recommend searching the TrueNAS forum and FreeBSD documentation on how to format a disk for ZFS. I found these:


structs not supported for jitclass

Reporting a bug

[X] I am using the latest released version of Numba (most recent is visible in
the change log (https://github.com/numba/numba/blob/master/CHANGE_LOG).
[X] I have included below a minimal working reproducer (if you are unsure how
to write one see http://matthewrocklin.com/blog/work/2018/02/28/minimal-bug-reports).

I tried to use jitclass with struct types, as imported from numpy. However, it yields a long error message. Here is some demo code to reproduce:
import numpy as np

from numba import jitclass, types
from numba.numpy_support import from_dtype

names_and_offsets_dtype = np.dtype([ \
    ('field1', np.uint64), \
    ('field2', np.uint64)])

spec = [
    ('attr1', types.unicode_type),
    ('attr2', from_dtype(np.uint64)),
    ('attr3', from_dtype(names_and_offsets_dtype))
]

@jitclass(spec)
class demo():
    def __init__(self):
        print("yay")

tmp = demo()

When the line with attr3 is removed, the code does not yield an error.

@xor2k thanks for submitting this issue to the Numba issue tracker. For reference, here is the error message the example yields:
💥 zsh» python foo/foo62.py
Traceback (most recent call last):
  File "/Users/vhaenel/git/numba/numba/errors.py", line 717, in new_error_context
    yield
  File "/Users/vhaenel/git/numba/numba/lowering.py", line 260, in lower_block
    self.lower_inst(inst)
  File "/Users/vhaenel/git/numba/numba/lowering.py", line 303, in lower_inst
    val = self.lower_assign(ty, inst)
  File "/Users/vhaenel/git/numba/numba/lowering.py", line 467, in lower_assign
    return self.lower_expr(ty, value)
  File "/Users/vhaenel/git/numba/numba/lowering.py", line 1030, in lower_expr
    res = impl(self.context, self.builder, ty, val, expr.attr)
  File "/Users/vhaenel/git/numba/numba/targets/imputils.py", line 149, in res
    return real_impl(context, builder, typ, value, attr)
  File "/Users/vhaenel/git/numba/numba/jitclass/base.py", line 405, in get_attr_impl
    getattr(data, _mangle_attr(attr)))
  File "/Users/vhaenel/git/numba/numba/cgutils.py", line 155, in __getattr__
    return self[self._datamodel.get_field_position(field)]
  File "/Users/vhaenel/git/numba/numba/cgutils.py", line 172, in __getitem__
    return self._cast_member_to_value(index, member_val)
  File "/Users/vhaenel/git/numba/numba/cgutils.py", line 248, in _cast_member_to_value
    return model.from_data(self._builder, val)
  File "/Users/vhaenel/git/numba/numba/datamodel/models.py", line 936, in from_data
    raise NotImplementedError("use load_from_data_pointer() instead")
NotImplementedError: use load_from_data_pointer() instead

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "foo/foo62.py", line 21, in <module>
    tmp = demo()
  File "/Users/vhaenel/git/numba/numba/jitclass/base.py", line 126, in __call__
    return cls._ctor(*bind.args[1:], **bind.kwargs)
  File "/Users/vhaenel/git/numba/numba/dispatcher.py", line 420, in _compile_for_args
    raise e
  File "/Users/vhaenel/git/numba/numba/dispatcher.py", line 353, in _compile_for_args
    return self.compile(tuple(argtypes))
  File "/Users/vhaenel/git/numba/numba/compiler_lock.py", line 32, in _acquire_compile_lock
    return func(*args, **kwargs)
  File "/Users/vhaenel/git/numba/numba/dispatcher.py", line 768, in compile
    cres = self._compiler.compile(args, return_type)
  File "/Users/vhaenel/git/numba/numba/dispatcher.py", line 77, in compile
    status, retval = self._compile_cached(args, return_type)
  File "/Users/vhaenel/git/numba/numba/dispatcher.py", line 91, in _compile_cached
    retval = self._compile_core(args, return_type)
  File "/Users/vhaenel/git/numba/numba/dispatcher.py", line 109, in _compile_core
    pipeline_class=self.pipeline_class)
  File "/Users/vhaenel/git/numba/numba/compiler.py", line 535, in compile_extra
    return pipeline.compile_extra(func)
  File "/Users/vhaenel/git/numba/numba/compiler.py", line 328, in compile_extra
    return self._compile_bytecode()
  File "/Users/vhaenel/git/numba/numba/compiler.py", line 387, in _compile_bytecode
    return self._compile_core()
  File "/Users/vhaenel/git/numba/numba/compiler.py", line 367, in _compile_core
    raise e
  File "/Users/vhaenel/git/numba/numba/compiler.py", line 358, in _compile_core
    pm.run(self.state)
  File "/Users/vhaenel/git/numba/numba/compiler_machinery.py", line 328, in run
    raise patched_exception
  File "/Users/vhaenel/git/numba/numba/compiler_machinery.py", line 319, in run
    self._runPass(idx, pass_inst, state)
  File "/Users/vhaenel/git/numba/numba/compiler_lock.py", line 32, in _acquire_compile_lock
    return func(*args, **kwargs)
  File "/Users/vhaenel/git/numba/numba/compiler_machinery.py", line 281, in _runPass
    mutated |= check(pss.run_pass, internal_state)
  File "/Users/vhaenel/git/numba/numba/compiler_machinery.py", line 268, in check
    mangled = func(compiler_state)
  File "/Users/vhaenel/git/numba/numba/typed_passes.py", line 390, in run_pass
    NativeLowering().run_pass(state) # TODO: Pull this out into the pipeline
  File "/Users/vhaenel/git/numba/numba/typed_passes.py", line 335, in run_pass
    lower.create_cpython_wrapper(flags.release_gil)
  File "/Users/vhaenel/git/numba/numba/lowering.py", line 273, in create_cpython_wrapper
    release_gil=release_gil)
  File "/Users/vhaenel/git/numba/numba/targets/cpu.py", line 162, in create_cpython_wrapper
    builder.build()
  File "/Users/vhaenel/git/numba/numba/callwrapper.py", line 124, in build
    self.build_wrapper(api, builder, closure, args, kws)
  File "/Users/vhaenel/git/numba/numba/callwrapper.py", line 178, in build_wrapper
    obj = api.from_native_return(retty, retval, env_manager)
  File "/Users/vhaenel/git/numba/numba/pythonapi.py", line 1431, in from_native_return
    out = self.from_native_value(typ, val, env_manager)
  File "/Users/vhaenel/git/numba/numba/pythonapi.py", line 1445, in from_native_value
    return impl(typ, val, c)
  File "/Users/vhaenel/git/numba/numba/jitclass/boxing.py", line 136, in _box_class_instance
    box_subclassed = _specialize_box(typ)
  File "/Users/vhaenel/git/numba/numba/jitclass/boxing.py", line 119, in _specialize_box
    fast_fget = fget.compile((typ,))
  File "/Users/vhaenel/git/numba/numba/compiler_lock.py", line 32, in _acquire_compile_lock
    return func(*args, **kwargs)
  File "/Users/vhaenel/git/numba/numba/dispatcher.py", line 768, in compile
    cres = self._compiler.compile(args, return_type)
  File "/Users/vhaenel/git/numba/numba/dispatcher.py", line 77, in compile
    status, retval = self._compile_cached(args, return_type)
  File "/Users/vhaenel/git/numba/numba/dispatcher.py", line 91, in _compile_cached
    retval = self._compile_core(args, return_type)
  File "/Users/vhaenel/git/numba/numba/dispatcher.py", line 109, in _compile_core
    pipeline_class=self.pipeline_class)
  File "/Users/vhaenel/git/numba/numba/compiler.py", line 535, in compile_extra
    return pipeline.compile_extra(func)
  File "/Users/vhaenel/git/numba/numba/compiler.py", line 328, in compile_extra
    return self._compile_bytecode()
  File "/Users/vhaenel/git/numba/numba/compiler.py", line 387, in _compile_bytecode
    return self._compile_core()
  File "/Users/vhaenel/git/numba/numba/compiler.py", line 367, in _compile_core
    raise e
  File "/Users/vhaenel/git/numba/numba/compiler.py", line 358, in _compile_core
    pm.run(self.state)
  File "/Users/vhaenel/git/numba/numba/compiler_machinery.py", line 328, in run
    raise patched_exception
  File "/Users/vhaenel/git/numba/numba/compiler_machinery.py", line 319, in run
    self._runPass(idx, pass_inst, state)
  File "/Users/vhaenel/git/numba/numba/compiler_lock.py", line 32, in _acquire_compile_lock
    return func(*args, **kwargs)
  File "/Users/vhaenel/git/numba/numba/compiler_machinery.py", line 281, in _runPass
    mutated |= check(pss.run_pass, internal_state)
  File "/Users/vhaenel/git/numba/numba/compiler_machinery.py", line 268, in check
    mangled = func(compiler_state)
  File "/Users/vhaenel/git/numba/numba/typed_passes.py", line 390, in run_pass
    NativeLowering().run_pass(state) # TODO: Pull this out into the pipeline
  File "/Users/vhaenel/git/numba/numba/typed_passes.py", line 333, in run_pass
    lower.lower()
  File "/Users/vhaenel/git/numba/numba/lowering.py", line 179, in lower
    self.lower_normal_function(self.fndesc)
  File "/Users/vhaenel/git/numba/numba/lowering.py", line 220, in lower_normal_function
    entry_block_tail = self.lower_function_body()
  File "/Users/vhaenel/git/numba/numba/lowering.py", line 245, in lower_function_body
    self.lower_block(block)
  File "/Users/vhaenel/git/numba/numba/lowering.py", line 260, in lower_block
    self.lower_inst(inst)
  File "/Users/vhaenel/miniconda3/envs/new-numba/lib/python3.7/contextlib.py", line 130, in __exit__
    self.gen.throw(type, value, traceback)
  File "/Users/vhaenel/git/numba/numba/errors.py", line 725, in new_error_context
    six.reraise(type(newerr), newerr, tb)
  File "/Users/vhaenel/git/numba/numba/six.py", line 668, in reraise
    raise value.with_traceback(tb)
  File "/Users/vhaenel/git/numba/numba/errors.py", line 717, in new_error_context
    yield
  File "/Users/vhaenel/git/numba/numba/lowering.py", line 260, in lower_block
    self.lower_inst(inst)
  File "/Users/vhaenel/git/numba/numba/lowering.py", line 303, in lower_inst
    val = self.lower_assign(ty, inst)
  File "/Users/vhaenel/git/numba/numba/lowering.py", line 467, in lower_assign
    return self.lower_expr(ty, value)
  File "/Users/vhaenel/git/numba/numba/lowering.py", line 1030, in lower_expr
    res = impl(self.context, self.builder, ty, val, expr.attr)
  File "/Users/vhaenel/git/numba/numba/targets/imputils.py", line 149, in res
    return real_impl(context, builder, typ, value, attr)
  File "/Users/vhaenel/git/numba/numba/jitclass/base.py", line 405, in get_attr_impl
    getattr(data, _mangle_attr(attr)))
  File "/Users/vhaenel/git/numba/numba/cgutils.py", line 155, in __getattr__
    return self[self._datamodel.get_field_position(field)]
  File "/Users/vhaenel/git/numba/numba/cgutils.py", line 172, in __getitem__
    return self._cast_member_to_value(index, member_val)
  File "/Users/vhaenel/git/numba/numba/cgutils.py", line 248, in _cast_member_to_value
    return model.from_data(self._builder, val)
  File "/Users/vhaenel/git/numba/numba/datamodel/models.py", line 936, in from_data
    raise NotImplementedError("use load_from_data_pointer() instead")
numba.errors.LoweringError: Failed in nopython mode pipeline (step: nopython mode backend)
Failed in nopython mode pipeline (step: nopython mode backend)
use load_from_data_pointer() instead

File "<string>", line 3:
<source missing, REPL/exec in use?>

[1] During: lowering "$0.2 = getattr(value=__numba_self_, attr=attr3)" at <string> (3)

Thanks for the report. This is a bug/not implemented yet.

I am running into the same issue. Does there happen to be a timeline for when this bug will be resolved?
Thanks! :)

Hi this appears to have been solved: see #5798

@marnixhoh The reported MWE still reproduces for me, does it not for you?

Yes the MWE does, but in #5798 a solution was provided. Now, I am not sure whether this classifies as "solved" or "workaround". Here is a working example of the above:
import numpy as np

from numba import jitclass, types
from numba.numpy_support import from_dtype

names_and_offsets_dtype = np.dtype([ \
    ('field1', np.uint64), \
    ('field2', np.uint64)])

spec = [
    ('attr1', types.unicode_type),
    ('attr2', from_dtype(np.uint64)),
    ('attr3', from_dtype(names_and_offsets_dtype)[:])
]

@jitclass(spec)
class demo():
    def __init__(self):
        print("yay")

tmp = demo()

The only difference is the [:] on the 'attr3' line in the spec list

@marnixhoh I think the [:] fundamentally changes the type from a Record to a record array?
In [1]: from numba.np.numpy_support import from_dtype

In [2]: import numpy as np

In [3]: names_and_offsets_dtype = np.dtype([ \
   ...:     ('field1', np.uint64), \
   ...:         ('field2', np.uint64)])

In [4]: from_dtype(names_and_offsets_dtype)
Out[4]: Record(field1[type=uint64;offset=0],field2[type=uint64;offset=8];16;False)

In [5]: from_dtype(names_and_offsets_dtype)[:]
Out[5]: unaligned array(Record(field1[type=uint64;offset=0],field2[type=uint64;offset=8];16;False), 1d, A)

@stuartarchibald Ah I see. It does "solve" the problem though...

@marnixhoh errr, I'm not sure it does solve it? It seems like it demonstrates a similar case is working ok, this case being something that could potentially be used as a work around.

@stuartarchibald Yes you are absolutely right. My earlier comment was indeed not very clear. With "solve" I meant a workaround


Bring codebase up to date with recent PRs

Several tests are failing, we have merged in various PRs including some involving requirements.txt which may fix the fails.

This doesn’t make sense to me, maybe I’m missing something. This is just my fork from the main repo, why do we need to PR here? it’s out of date because I haven’t bothered to pull/push changes here. ??

Why does any of the CI care about this? Nothing should be running from my personal fork, it should all be runnng the CI from the main repo? Something isn’t right with the CI if it’s pulling from here… can you say more about why/how it looks like this repo is getting used in the CI?

You have a pull request from this branch that is failing the automated tests.  If you update this branch it will automatically update the PR with the changes.

Right, got it, sorry, I’m triple multitasking right now while helping run a conference. Will try to update this PR sometime this week. It’ll probably be cleaner if I do it with a rebase rather than a merge.

No need to apologize for the complexities of Git!  Enjoy the conference


Data Files

This epic contains issues related to working with files which contain the movie lists.

The app will be completely rewritten as a web app, thus all opened issues are being closed.


Doc bug? Wrong command in the examples

This page (published here) describes the %experimental.simulate_noise magic command, but the examples on that page use the %simulate command instead.
Consider replacing %simulate with the %experimental.simulate_noise in the examples.
See also https://github.com/microsoft/qsharp-runtime/issues/922

Thanks for reporting this! Going to go on and transfer to the IQ# repo where the source for this reference doc is located. Thanks!


fdkaac: 1.0.0 → v1.0.1

Motivation for this change
Update to latest
1.0.0 didn't have a v in the version name but 1.0.1 does ¯\_(ツ)_/¯
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

np, thanks for the pointer!


ModuleNotFoundError(str(_TRANSFORMER_ENGINE_AVAILABLE))

🐛 Bug
With newer transformer-engine version in our container, fp8 TE benchmarking for benchmark_litgpt.py script is not possible.
Version where the script works:
transformer_engine @ file:///dist/transformer_engine-1.9.0.dev0%2B7326af9-cp310-cp310-linux_x86_64.whl#sha256=74ed8c251b8304bc9dbc77f2746b0df8652204001edaf57706c720acfa944ced

Version where the script does not work:
transformer_engine @ file:///dist/transformer_engine-1.10.0.dev0%2Bc57a81f-cp310-cp310-linux_x86_64.whl#sha256=b53e4719a09a6726668dd658b74705fa3d8e62a10b87dfc6c5132be96b72dac1

With this in mind, I would like to suggest some workarounds, or even changes in the benchmark_litgpt.py script. We could get rid of the from lightning.fabric.plugins.precision.transformer_engine import TransformerEnginePrecision dependency entirely, and instead use a simple function (we used it in our internal benchmarks and it did just fine):
def swap_linear_layers_for_te(model: nn.Module) -> None:
    def _resursively_swap_linear_layers_for_te(module: nn.Module) -> None:
        for n, m in module.named_children():
            if len(list(m.children())) > 0:
                _resursively_swap_linear_layers_for_te(m)

            if isinstance(m, nn.Linear):
                bias_flag = m.bias is not None
                new_linear = te.Linear(
                    m.in_features, m.out_features, bias=bias_flag
                )
                setattr(module, n, new_linear)

    initial_params_cnt = parameters_cnt(model)
    _resursively_swap_linear_layers_for_te(model)
    assert initial_params_cnt == parameters_cnt(model)
    for m in model.modules():
        assert not isinstance(m, nn.Linear)
    logging.info(f"--> Now model has linear layers from transformer_engine!")

We could have similar function for nn.LayerNorm, or even add it to the above snippet as a flag to swap LayerNorm as well. or even swap both layers by default.
And while we are in the topic of layer swapping, I think it would make sense to re-visit the scope of swapping layers, which we discussed with @tfogal. Actually, when swapping only Linear without LayerNorm we receive much more successful benchmarks altogether as we get less OOM errors. I would say it is worth considering creating something like a fallback mechanism (cc: @tfogal) that works:

Try to swap both Linear and LayerNorm
If we get OOM, then try swapping Linear only and see if works.

I understand this might not be ideal, but at this point fp8 functionality is nothing like a switch. It is still a matter of different configurations and approaches to run fp8. I am happy to learn what others think about this.
If the decision is to stay with the current wrapper class TransformerEnginePrecision, please let me know, and I will try to fix it and release a PR in the respective pytorch-lightning repository.
To Reproduce
Steps to reproduce the behavior:

Run the command:

python thunder/benchmarks/benchmark_litgpt.py \
    --model_name phi-2 \
    --compile eager \
    --low_precision_mode fp8-delayed-te

Observe the error:

Time to instantiate model: 0.13 seconds.
Traceback (most recent call last):
  File "/mnt/nvdl/usr/wprazuch/Projects/lightning_ai/lightning-thunder/thunder/benchmarks/benchmark_litgpt.py", line 628, in <module>
    CLI(benchmark_main)
  File "/usr/local/lib/python3.10/dist-packages/jsonargparse/_cli.py", line 96, in CLI
    return _run_component(components, init)
  File "/usr/local/lib/python3.10/dist-packages/jsonargparse/_cli.py", line 204, in _run_component
    return component(**cfg)
  File "/mnt/nvdl/usr/wprazuch/Projects/lightning_ai/lightning-thunder/thunder/benchmarks/benchmark_litgpt.py", line 582, in benchmark_main
    benchmark = Benchmark_litGPT(**kwargs)
  File "/mnt/nvdl/usr/wprazuch/Projects/lightning_ai/lightning-thunder/thunder/benchmarks/benchmark_litgpt.py", line 240, in __init__
    te_precision = TransformerEnginePrecision(weights_dtype=torch.bfloat16, replace_layers=True)
  File "/usr/local/lib/python3.10/dist-packages/lightning/fabric/plugins/precision/transformer_engine.py", line 75, in __init__
    raise ModuleNotFoundError(str(_TRANSFORMER_ENGINE_AVAILABLE))
ModuleNotFoundError: Requirement 'transformer_engine>=0.11.0' not met. HINT: Try running `pip install -U 'transformer_engine>=0.11.0'`

Code sample
As in:
thunder/benchmarks/benchmark_litgpt.py
Expected behavior
The code should run because the requirement is met.
Environment
As in the 20240719 container
Additional context
None

Given that TE is installed, I think it is a bug in the lightning.fabric plugin as to how it is checking the installation of TE (using RequirementCache).
https://github.com/Lightning-AI/pytorch-lightning/blob/e6c26d2d22fc4678b2cf47d57697ebae68b09529/src/lightning/fabric/plugins/precision/transformer_engine.py#L35
https://github.com/Lightning-AI/pytorch-lightning/blob/e6c26d2d22fc4678b2cf47d57697ebae68b09529/src/lightning/fabric/plugins/precision/transformer_engine.py#L74-L75

@t-vi @lantiga can you get the appropriate pair[s] of eyes to take a look (based on Kshiteej's comment that this is in lightning fabric)?

@wprazuch Can you show the command you used to install your version of TE so I can replicate?

I sent a fix here https://github.com/Lightning-AI/utilities/pull/292 such that the utility can parse dev/pre-release versions like the one from transformer engine (e.g., 1.10.0.dev0+931b44f).

This should solve the requirement check. Whether the TE plugin in Lightning is compatible with recent versions of TE remains to be seen. It hasn't been touched/used in a while.

Is this resolved? @wprazuch

@tfogal resolved 👍


Newbee question :)

Tnxs for a super project.
I am just starting playing around with it but i have 1 question.
My start screen in the admin project is not the same as in the readme section.
Am i missing something ?

Hi @gwinnem
Please - try to Set Startup projects in Visual Studio:

Skoruba.IdentityServer4.Admin
Skoruba.IdentityServer4.STS.Identity

And then run it and try to access Admin UI on http://localhost:9000 - you should be redirected to IdentityServer4 instance - it is the screenshot as you have posted above.
And there you will be ask for putting the username and password. :)
Please take a look at Readme - Access Layer and EF Core section - migrations etc.
If you will have any issues, let me know.
Thanks.

Thank you for the quick reply.

Another question, sorry for this
I am logged in but getting this error msg. I have not done anything to the database exept running the seed.

As far as i managed to see, both of the values are http://localhost:9000/signin-oidc

Thas is correct. ClientId for Admin is set as a default? skoruba_identity_admin? If I remember correctly :))
Maybe please try run STS in console app and check the console log for this error.
Thanks!

Found the issue, the IdentityAdminRedirectUri in appsettings was wrong. :) Pointing to port 5000 instead of 9000

Great catch! :)

Another tip, if someone do not want to see the identityserver page, set
"launchBrowser": false,
In the Skoruba.IdentityServer4.STS.Identity launchSettings.json

Good tip, I didn’t know it :)

Then the server launches without launching the browser :)

Is there a easy way to use email instead of username as login ?

hi, whats the default user name and password after uncommenting the seed function in startup. I did not find that in the docs.

I guess you could fill in the email as the username in the username-field. That should work.


Fix issue w. bloom int8 when changing tp size

When trying to load https://huggingface.co/microsoft/bloom-deepspeed-inference-int8 on 8 x A100-40GB this triggers a crash during checkpoint loading:

After bisecting it appears to be introduced in https://github.com/microsoft/DeepSpeed/pull/2547, which refactored the way num_groups is used during quantization. After peer-debugging w. @cmikeh2 we determined that num_groups in this case should be set to 32. We've tested both 176B and 7.1B versions of Bloom where we change from TP 4->8 and TP 2->4 respectively.
Also reported by @JingfengYang and confirmed fixes their issue in https://github.com/microsoft/DeepSpeed/pull/2217#issuecomment-1362681481

Thanks for your quick fix. It works as well on my side.

@jeffra When I'm trying to run BLOOM 175B (microsoft/bloom-deepspeed-inference-fp16) with 2 server (each with 8 x 40GB A100), I first ran into this problem https://github.com/microsoft/DeepSpeed/issues/1687 and solve it according to suggestions in that thread. But there is still another problem:
(deepspeed/module_inject/load_checkpoint.py", line 78, in load_parameters  scale = scale.view(  AttributeError: 'NoneType' object has no attribute 'view')

Could you please help fix this? Thanks!

The command of running to this issue is:
deepspeed --hostfile=hostfile bloom-inference-scripts/bloom-ds-inference.py --name microsoft/bloom-deepspeed-inference-fp16
by using https://github.com/huggingface/transformers-bloom-inference/tree/main/bloom-inference-scripts
I think the reason is that in deepspeed/module_inject/load_checkpoint.py, you set scale = None in line 48, but you directly call scale.view in line 77.

any updates on this issue? thanks!

Another kind reminder on this issue. Thanks!

@jeffra , any updates on this issue? thanks!


adds Oregon Trail school district

https://sites.google.com/a/ortrail.k12.or.us/mrs-doss/
https://www.oregontrailschools.com/cms/lib/OR50000501/Centricity/Domain/184/CRMS Planner -FULL 2019-20.docx.pdf

@spinnelein Pull request merged. Thank you!


App doesn't load on web

Has your project web-support? I assumed it as it is a "web" project on pub.dev but I didn't get it to work 😞 The app doesn't seem to start and stays white in Chrome. I've even reproduced it with your example project:
flutter channel dev
flutter upgrade
flutter config --enable-web
cd example
flutter create .
flutter run -d chrome

Cheers, Dennis

@wottpal - Sorry but it doesn't work for web, only mobile for now.
Duplicate of #24


Modify the condition of MOWGLICPLD_DEVICE_ACCESS

Changed the condition to be more intuitive, defining
MOWGLICPLD_DEVICE_ACCESS="yes" only when using the mowgli platform to
avoid contamination to other platforms, and fixed some syntax.
Signed-off-by: LuluTHSu<EMAIL_ADDRESS>

Hello @spinler,
Could you please review this commit?
The previous condition will cause the config.h of other platforms to be defined as MOWGLICPLD_DEVICE_ACCESS="yes" and misuse the mowgli CPLD condition.
I know I can change the append to this:
EXTRA_OECONF_append_otherPlatroms = "--enable-turn-off-mowglicpld-access"

But it's not intuitive to set this for platforms that don't need to use mowgli cpld, so I'm submitting this commit.
If this commit can be merged, I will change this author's append to the following: (he made an invalid addition)
EXTRA_OECONF_append_mowgli = "--enable-turn-on-mowglicpld-access"

Thank you for your review!


Create itsmotul.txt

@hcauich First stage of verification passed, official domain is itsmotul.edu.mx as far as I verified. This is just an informational note. Pull request is still in the review. I appreciate your patience while waiting for the final decision.

@hcauich Thank you for your patience while waiting for a review and processing your request. Pull request merged.


Convert tests from Minitest to RSpec

Issue

We are currently implementing Pact tests between Collections and gds-api-adapters in order to meet the criteria for CD of collections.
The pact gem brings in RSpec as a dependency. This will mean Collections runs two test suites, Minitest and RSpec.
This is not necessarily bad, eg Smart Answers also has both suites. However in the case of collections it adds a little bit of complexity. Collections uses cucumber for its feature tests, and they fail without patching the Minitest assertions methods.
RSpec is the GDS testing frame work of choice, so it is probably worth taking the plunge and converting to Minitest.

TO DO
Regular tests
There is a rake task that can be used to do some of the syntax conversion.
bundle exec rake convert:to_rspec\["test/components","spec/views/components"\]

Convert the following

[x] test/components
[x] test/controllers
[x] test/integration
[x] test/lib
[x] test/models
[x] test/models/schemas
[x] test/models/topic
[x] test/presenters
[x] test/presenters/organisations
[x] test/presenters/supergroups
[x] test/services
[x] test/services/search
[x] test/services/supergroup_sections
[x] test/unit

Once all tests requiring a specific helper have been ported over to RSpec, move the helpers from test/support ==> spec/support

[x] analytics_helper
[x] coronavirus_helper
[x] coronavirus_landing_page_steps
[x] custom_assertions
[x] dit_landing_page_helper
[x] gds_api_rummager_test_helpers
[x] helpers
[x] organisation_feed_helpers
[x] organisation_helper
[x] organisations_helpers
[x] rummager_helpers
[x] services_and_information_helpers
[x] supergroups_helpers
[x] taxon_helpers
[x] transition_landing_page_steps

Feature tests
Convert features/step_definitions

[x] browsing_topics_steps
[x] curated_list_steps
[x] latest_changes_steps
[x] viewing_browse_steps
[x] viewing_services_and_information_steps

Convert or remove files in features/support as required
Tidy up

remove Dir[Rails.root.join("test/support/**/*.rb")].sort.each { |f| require f } from spec_helper.
Remove test_helper

It looks like this is all done now, @hannako, what do you think?


Problem parsing numbers from json input using the metrics processor and function interpolation

I try to achieve the following:

Read JSON from an API (once)
create custom metrics with the metric processor using values from the JSON by bloblang function interpolations
end the benthos process (which sends the data to a push_gateway for scraping asynchronously by prometheus)

I always get 0 values instead of the real integers and float values from the json on the push_gateway and benthos tells me:
{"@timestamp":"2020-11-14T14:32:46+01:00","@service":"benthos","level":"ERROR","component":"benthos.input.processor.2","message":"Handler error: strconv.ParseInt: parsing \"null\": invalid syntax"}       "inside_temp": 23.6,       "outside_temp": 15.5
Benthos version (on MacOS):
benthos -v
Version: 3.32.0
Date: 2020-10-29T20:22:48Z

I created a small example configuration for reproduction:
config.yml:
metrics:
  prometheus:
    push_url: localhost:9091  # docker run -p 9091:9091 prom/pushgateway

input:
  stdin: {}
  processors:
    - metric:
        name: inside_temperature
        type: gauge
        value: ${! json("response.climate_state.inside_temp") }
    - metric:
        name: outside_temperature
        type: gauge
        value: ${! json("response.climate_state.outside_temp") }
    - metric:
        name: battery_level
        type: gauge
        value: ${! json("response.charge_state.battery_level") }

and incoming json example.json:
{
  "response": {
    "charge_state": {
      "battery_level": 50
    },
    "climate_state": {
      "inside_temp": 23.6,
      "outside_temp": 15.5
    }
  }
}

Testing is done via:
cat example.json | benthos -c config.yml

while the push_gateway test instance is running as docker run -p 9091:9091 prom/pushgateway
Any idea what i'm doing wrong?
Note: I tried to add .number() to the bloblang function interpolation, but that didn't change anything.

Hey @kekscode,
There's a couple of things going on here, the first is that the stdin input processes the data line by line, so in your example the null results are because it's trying to JSON parse segments like   "response": { and separately     "charge_state": {, etc. If you compress your JSON doc to one line like {"response":{"charge_state":{"battery_level":50},"climate_state":{"inside_temp":24,"outside_temp":16}}} then it should work.
Another thing is that metric values must be integers. I can potentially expand the internal APIs for some metrics targets that support float values but it'd take a little while to get that done. A short term work around would be to either multiply your values beyond the decimal precision or I can add functionality to bloblang to round the values, but neither of those are ideal.

Ah alright. The multiline issue is an issue with the test setup i created (in the original config i'm using input from http_client which creates proper message batches internally of course). I'll try to implement the workaround and post it here for reference.
In general it would be great to have float values in the future. I use a lot of prometheus metrics based observability tooling at home and at work and benthos is starting to become a good foundation for arbitrary data curation and integration between systems. Having good support for metrics (like benthos already has) is a big bonus for us :)

I've opened https://github.com/Jeffail/benthos/issues/555 for looking into allowing floats, but in the meantime I've also added two methods round and floor to bloblang as they're generally useful: https://github.com/Jeffail/benthos/commit/17dc53e9622115888c73b3b6c87c8a33de439baa
I'm closing this since we have the new issue for floats, but if you have any more follow up questions then please reopen.


PyAF 5.0 Final Touch 1 : discard some non-significant components

Some cycles/ARs are almost zero. Detect this earlier and decrease the number of candidates accordingly. This is a small optimization.
Can discard all cycles if the trend residue is small (max - min < 0.001).
Can discard all ARs if the cycle residue is small (max - min < 0.001).
the criterion (max - min < 0.001) has to be kept as simple as possible for robustness. Do not take into account outliers etc (this is a different task and needs some real work).
The threshold 0.001 is reasonable as the signal is re-scaled (to be in [0, 1]) based on min/max before each transformation.

PyAF 6 :
Outliers in Time Series : https://github.com/antoinecarme/pyaf/blob/master/TODO.md


Move m.* thumbnail_url to be inside info to match m.video

I've moved the thumbnail_{url,info} inside an "info" key for all types to be consistent with m.room.message#m.video.
I've added the thumbnail_{url,info} keys to the ImageInfo shared between m.room.mesage#image and m.room.avatar.
I've created a new ThumbnailInfo schema to avoid recursion within the ImageInfo schema.

would be nice to update the example for m.image to include a thumbnail

Maybe, I'd prefer it if we could include multiple examples to make it clear that clients should cope with the thumbnail being absent.

@richvdh I think I've responded to everything PTAL.

lgtm


Updated the HoloLens 2 Emulator docs with a link to new build 10.0.18362.1019

Docs Build status updates of commit 622a96c:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

mixed-reality-docs/hololens-emulator-archive.md
:white_check_mark:Succeeded
View

mixed-reality-docs/images/emulator2-900px.png
:white_check_mark:Succeeded
View

mixed-reality-docs/install-the-tools.md
:white_check_mark:Succeeded
View

mixed-reality-docs/using-the-hololens-emulator.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Docs Build status updates of commit 4cceb41:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

mixed-reality-docs/hololens-emulator-archive.md
:white_check_mark:Succeeded
View

mixed-reality-docs/images/emulator2-900px.png
:white_check_mark:Succeeded
View

mixed-reality-docs/install-the-tools.md
:white_check_mark:Succeeded
View

mixed-reality-docs/using-the-hololens-emulator.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


R2T plot suggestions from Carmen

Thanks Justin! looks good to me.

Just looking at the R2T plot and wondering what those "recombinants" are (a bit of jump at the top)? if they aren't XBBs (which have their own category) what are they? since recombinants have various different parents, I'm not convinced we should group them like this. I'm wondering if might want to have a second plot (of the same R2T) where we visualize the recombinants based on their "main parent", i.e. the parent that contributes the most genetic material, e.g. the BA.2.75 recombinants would different shades of blue, and the BA.2 recombinants are shades of red, etc. e.g. XBC would be a delta colour as it's mostly delta than omicron. Or alternatively could be if you click on a recombinant then only it and it's parents show up. Just thinking out loud here
I've been watching that the jump to BA.1 has been shrinking to the point now that it isn't there. However, there is a really big jump to BA.2. Is there something weird happening with our trees now that is stretching the BA.2 branch? e.g. long-branch attraction? Point I'm making is that the jump from pre-BA.1 is signficantly larger mutationally than between BA.1 to BA.2, yet in the R2T we have no jump for BA.1 any more. Any ideas what's going on here?

Slack Message

The group of grey dots on top right are XBB sublineages. i.e. EG.5. they just arent classified as XBB lineages.


hydrus: 501 -> 502

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for hydrus is: "Danbooru-like image tagging and searching system for the desktop"
meta.homepage for hydrus is: "https://hydrusnetwork.github.io/hydrus/"
meta.changelog for hydrus is: ""
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes
Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 502 with grep in /nix/store/zsmmx8zf3iqw87vahrg95rhz6y0ydvxh-python3.10-hydrus-502
found 502 in filename of file in /nix/store/zsmmx8zf3iqw87vahrg95rhz6y0ydvxh-python3.10-hydrus-502

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
hydrus

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/zsmmx8zf3iqw87vahrg95rhz6y0ydvxh-python3.10-hydrus-502 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A hydrus https://github.com/r-ryantm/nixpkgs/archive/6176bf99b7580195e30250b1b226471c3ed4248f.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/zsmmx8zf3iqw87vahrg95rhz6y0ydvxh-python3.10-hydrus-502
ls -la /nix/store/zsmmx8zf3iqw87vahrg95rhz6y0ydvxh-python3.10-hydrus-502/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

hydrus

Maintainer pings
cc @dali99 @evanjs for testing.

@GrahamcOfBorg eval

This broke hydrus completely (does not even launch). See #196212 for fix


Run IDE with Project Manager endpoint instead of Language Server endpoints, when on local backend

Pull Request Description
This is a fix for a couple of recent regressions:

Fixes #6756: Projects couldn't be renamed anymore from within the project view.
Fixes #6804: One could no longer switch between projects from within the project view.
It also unblocks the issue with the spinner (that got reverted), but that probably needs some extra attention.

It might be the long-term goal to have different UX solutions to these cases, but this should fix those regressions in the short term at least.
Thanks to @somebody1234 for the in-depth conversation (and the actual code!).
Checklist
Please ensure that the following checklist has been satisfied before submitting the PR:

[ ] The documentation has been updated, if necessary.
[ ] Screenshots/screencasts have been attached, if there are any visual changes. For interactive or animated visual changes, a screencast is preferred.
[x] All code follows the Scala, Java, and Rust
style guides. In case you are using a language not listed above, follow the Rust style guide.
All code has been tested:

[ ] Unit tests have been written where possible.
[x] If GUI codebase was changed, the GUI was tested when built using ./run ide build.

crosspost:
It has been brought up that the dashboard does project/open, and then the IDE does project/open again.
It's possible to work around this on the dashboard side, but I'm not sure whether the added complexity is worth the performance improvements in avoiding opening the same project twice.
I guess it depends on how long this workaround will stick around

QA Status: 🟡
I can create, open and rename projects. I am also able to switch between projects using ctrl+o. The remaining issue is that after changing the project name in project view and going back to the dashboard, the old name is still displayed on the list until I refresh/reopen the application. I don't think that this has been introduced with this changeset though.

@Frizi the latest commit should fix that


Problems  and suggestions

1 Needs a classic tool bar at the top
2 Takes for ever to open
3  Opens multiples when you click on icon when you click only one or twice
see  task manager  right now I have  8 chrome exes running in processes in task manager
4 Have a All book marks folder in book mark tool bar can not get out
5, When you import the book marks they go into a imported folder that you have to click on the sittings to be able to get to  I want  a tool bar at the top of the page where I can just click on and scroll down
6 You  can not click on the edit in the sitting
7 When you right click there is no select all and copy
8 Does not work on torrent sites like  pirate bay very good can not click on any thing and get bombarded by popups
9 Book mark manger needs to have a select all so you can move multiple books marks to new folder having to how down on control button and select one at a time is a pain in the ass
when you have a lot of book marks can also do with some better sort option a sort by date would be very nice in trying to find book marks especially when you have thousands

1- Depends on people's perspective, was it ever available on the original Chrome?
2- This was discussed on some issue before, it must do something with dll's sizes
3- I don't have this happening on my side
6- ????
7- This isn't available in original Chrome either
8- This isn't programmer's job, Chrome doesn't have a pop-up blocker, you were supposed to install an extension for that

I don't know, I've seen multiple times, that it takes forever to open, but it opens instantly for me on ssd.. use modern hardware for modern browsers..?

2 - is it present on the taskbar? does browser window eventually appear? if yes and no, taskbar preview is blank or window not shown on clicking and CPU usage already low - in task manager find chrome.exe that have --type=gpu-process argument(View>Select columns>find and check Command line) and kill it(End Process).
It happens sometimes on my machine, with Supermium 119+ once or twice, but with 110 version it happened very often.(can be reported/investigated if needed)
3 - 8? not so much :innocent: fyi - chromium is multiprocess application so in regular mode it creates root process, that manage other, and a bunch of service processes. For each active extension or tab separate process will be create. As i know Win8+ Task manager able to show processes tree on application tab, but in processes, as i remember, no. On Win7- you can you something like ProcessExplorer, that availables on MS site
9 - it already here, use standard Windows shortcuts
Ctrl+A - select all
Click on first item, then Shift+Click on last item - select all betweens or change selected range
Ctrl+Click on item - select or deselect clicked item
Drag one of selected item to desired location
Keyboard only
Tab - switch focus/selection to next item
Arrows - move focus/selection to arrow direction in lists
Ctrl+Arrow - move cursor(outline) to arrow direction
Space - in items lists - select/unselect item, highlighted by cursor, on controls(buttont, checkbox, etc.) - see Enter
Enter - perform standard action
App (usually left from right Ctrl) - open contex menu
Moving is cutting and pasting, that is available in context menu

2 Yes it shows on task bar and browser eventually opens
4 is just what I said  see screen screen shot

6  simply cant click edit button

Oh forgot something in face book messenger it will not let you attach pictures like jpg when you try it shows nothing

6 - did you mean this one?

if so - it's not a button, it's group title, like "Zoom" above, just design

@XakerTwo
How did you remove these buttons?

chrome://flags
#disable-sharing-hub - Enabled
#chrome-labs - Disabled
#hide-sidepanel-button - Enabled
#show-avatar-button - Never

Thanks!

don't remeber exactly but probably one more flag needs to be set

Yeah. Tried that one before and it didn't help. 1 button is left.

Thanks! All removed.

1- Depends on people's perspective, was it ever available on the original Chrome?

No, it always had the blue theme or the Aero Glass-based theme. And as such, adding the classic titlebar is not a priority.
The browser start times do vary based on the speed of the disk. It starts relatively quickly on an SSD but slower HDDs seem to be problematic especially on XP. There are ways to speed it up which I will implement in progwrp in future.
And with various other structural issues affecting the browser, I will not be able to prioritize any changes or enhancements to the bookmark UI.

Use a bookmark extension.

4. 9. Use a bookmark extension.

The browser start times do vary based on the speed of the disk. It starts relatively quickly on an SSD but slower HDDs seem to be problematic especially on XP. There are ways to speed it up which I will implement in progwrp in future.

This feature is my know-how, because it implemented in my alternate dll. If you will do this, I will open all sources in such case. And it will be open-source, As it was intended initially. Its ok for you ?

No I want it to open fast and I do not use ssd
----- Original Message -----
From: IDA-RE-things
To: win32ss/supermium
Cc: Methen ; Author
Sent: Monday, May 27, 2024 8:55 AM
Subject: Re: [win32ss/supermium] Problems and suggestions (Issue #622)
The browser start times do vary based on the speed of the disk. It starts relatively quickly on an SSD but slower HDDs seem to be problematic especially on XP. There are ways to speed it up which I will implement in progwrp in future.

This feature is my know-how, because it implemented in my alternate dll. If you will do this, I will open all sources in such case. And it will be open-source, As it was intended initially. Its ok for you ?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: @.***>

This email has been checked for viruses by Avast antivirus software.
https://www.avast.com/antivirus

The questuion was to win32ss. about stealing ideas.

No I want it to open fast and I do not use ssd

Read this topic in such case: #527.
https://github.com/win32ss/supermium/issues/527#issuecomment-2094654192


React native 0.72.0 + metro.config.js + unstable_enablePackageExports - true makes app warning raise

Describe the bug
I am getting a warning "TypeError: Cannot read property '__awaiter' of undefined" with the latest react native version 0.72.0 and under metro.config.js file unstable_enablePackageExports = true.
Your minimal, reproducible example
https://codesandbox.io/s/happy-goldstine-qymrrm?file=/src/App.js:166-174
Steps to reproduce

Switch to react native 0.72.0
Under metro.config.js file:
const config = {
resolver: {
unstable_enableSymlinks: true,
unstable_enablePackageExports: true,
}
};

Expected behavior
Facing above mentioned warning.
How often does this bug happen?
Every time
Screenshots or Videos
No response
Platform

OS: Macos

Tanstack Query adapter
react-query
TanStack Query version
3.39.3
TypeScript version
4.9.5
Additional context
No response

Switch to react native 0.72.0
Under metro.config.js file:
const config = {
resolver: {
unstable_enableSymlinks: true,
unstable_enablePackageExports: true,
}
};

sorry, this is no reproduction. Your sandbox doesn't even have a metro.config.js file, I don't even know what that is. Also: You're using v3, which is over a year old. And I'm not sure what you'd expect react-query to do if you use a feature that's prefixed with unstable_...


Add preflight checks to OpenSearch reindexing

This is the process that is run to adopt OpenSearch schema changes within search-api.
People are meant to clean up old indices once they're content that their change worked, but this has a habit of slipping through the net.
This process is eminently automatable, but writing it down helps, as does the instructions for finding out the state of the search cluster.

Thanks!


Get-WinGetConfiguration can't open a valid WinGet config file

Brief description of your issue

Microsoft.WinGet.Configuration v1.8.1911-alpha: https://www.powershellgallery.com/packages/Microsoft.WinGet.Configuration/1.8.1911-alpha
Used winget config to find path to the config file.
Get-WinGetConfiguration -File 'C:\Users\olavb\AppData\Local\Packages\Microsoft.DesktopAppInstaller_8wekyb3d8bbwe\LocalState\settings.json' fails with:

Get-WinGetConfiguration: Failed to open configuration set at C:\Users\olavb\AppData\Local\Packages\Microsoft.DesktopAppInstaller_8wekyb3d8bbwe\LocalState\settings.json with error 0x8A15C002 The configuration file is invalid. See line 5, column 16 in the file.

Steps to reproduce
See description
Expected behavior
Should be able to read a default WinGet config file. Could it be due to JSON with comments?
Actual behavior
Fails.
Environment
Windows Package Manager v1.8.1911
Copyright (c) Microsoft Corporation. All rights reserved.

Windows: Windows.Desktop v10.0.22631.3880
System Architecture: X64
Package: Microsoft.DesktopAppInstaller v1.23.1911.0

Winget Directories
-----------------------------------------------------------------------------------------------------------------------
Logs                               %LOCALAPPDATA%\Packages\Microsoft.DesktopAppInstaller_8wekyb3d8bbwe\LocalState\DiagÔÇª
User Settings                      %LOCALAPPDATA%\Packages\Microsoft.DesktopAppInstaller_8wekyb3d8bbwe\LocalState\settÔÇª
Portable Links Directory (User)    %LOCALAPPDATA%\Microsoft\WinGet\Links
Portable Links Directory (Machine) C:\Program Files\WinGet\Links
Portable Package Root (User)       %LOCALAPPDATA%\Microsoft\WinGet\Packages
Portable Package Root              C:\Program Files\WinGet\Packages
Portable Package Root (x86)        C:\Program Files (x86)\WinGet\Packages
Installer Downloads                %USERPROFILE%\Downloads

Links
---------------------------------------------------------------------------
Privacy Statement   https://aka.ms/winget-privacy
License Agreement   https://aka.ms/winget-license
Third Party Notices https://aka.ms/winget-3rdPartyNotice
Homepage            https://aka.ms/winget
Windows Store Terms https://www.microsoft.com/en-us/storedocs/terms-of-sale

Admin Setting                             State
--------------------------------------------------
LocalManifestFiles                        Disabled
BypassCertificatePinningForMicrosoftStore Disabled
InstallerHashOverride                     Disabled
LocalArchiveMalwareScanOverride           Disabled
ProxyCommandLineOptions                   Disabled
DefaultProxy                              Disabled

In the context of winget configure command, the winget settings file is not a valid WinGet Configuration file. You can find WinGet configuration samples over at https://aka.ms/dsc.yaml.
An example configuration file to set WinGet user settings would be:
# yaml-language-server: $schema=https://aka.ms/configuration-dsc-schema/0.2
properties:
  resources:
    - resource: Microsoft.WinGet.DSC/WinGetUserSettings
      directives:
        description: Set WinGet user settings
        allowPrerelease: true
      settings:
        Settings:
          network:
            downloader: do
          visual:
            progressBar: rainbow
          $schema: https://aka.ms/winget-settings.schema.json
  configurationVersion: 0.2.0

Thanks for the info @mdanish-kh. I was looking for info regarding whether the PowerShell module Microsoft.WinGet.Client also requires --accept-source-agreements and --accept-package-agreements on a fresh system, but found no such info or input parameters for Install-WinGetPackage. Which lead me to *-WinGetConfiguration cmdlets.
Found this now:

https://github.com/search?q=repo%3Amicrosoft%2Fwinget-cli+path%3A%2F^src\%2FPowerShell\%2FMicrosoft\.WinGet\.Client\%2F%2F+accept&type=code

Maybe it's not dealt with yet. This is alpha/beta after all?

There is a -Confirm parameter for Install-WinGetPackage but I am not sure if its usage is the same as what you're looking for.

This is alpha/beta after all?

Yes, for now the PowerShell module is intended to be treated as pre-release as written in its description, which is probably why there aren't solid docs for it yet. You would be better off installing the latest version of the module and then running Get-Help <cmdlet> to see all supported options


[REQUEST] Add binary_units argument to all relevant progress columns (TransferSpeedColumn, FileSizeColumn and TotalFileSizeColumn)

How would you improve Rich?
Hello,
In 630ed8bd7f1f5bbe81b2ded4c9fa8bf25e6b7db0 and 5ef33ae7bfa5f0458effbbe2a9add8aaa4ee0bf5, DownloadColumn got support for using multiples of 1024. However, other columns do not have a binary_units argument.
This was already mentioned in https://github.com/Textualize/rich/discussions/2034 and I feel like it would be useful to be consistent with other software.
What problem does it solve for you?
When I'm watching a transfer, I expect sizes to be displayed as multiples of 1024 bytes. This is what rsync --info=progress2, curl, wget and lsblk do. Even ls also does this unless --si is passed.

I would like to contribute to this feature. Would it be a good idea to start with FileSizeColumn, TotalFileSizeColumn and TransferSpeedColumn?


arm64: syscall SYS_switch_context and SYS_restore_context use 0 para

Summary
arm64: syscall SYS_switch_context and SYS_restore_context use 0 para
reason:
simplify context switch
sys_call0(SYS_switch_context)
sys_call0(SYS_restore_context)
Impact
arm64
after
text    data     bss     dec     hex filename
504360   54968   81085  640413   9c59d nuttx
before
text    data     bss     dec     hex filename
504644   54968   81085  640697   9c6b9 nuttx
size reduce 284
Testing
ostest
qemu-armv8a:nsh_smp

[Experimental Bot, please feedback here]
Yes, this PR appears to meet the basic NuttX requirements, although some sections could be improved.  Here's a breakdown:
Strengths:

Clear Summary of "What" and "Why": The summary explains the change (using zero-parameter syscalls for context switching) and the rationale (simplification).
Quantifiable Impact:  The impact section shows a reduction in binary size, which is a concrete benefit.
Testing Evidence: Testing logs are included (although the content is just "ostest" and "qemu-armv8a:nsh_smp," which needs more detail).  The mention of the target architecture (arm64/qemu-armv8a) is good.

Weaknesses & Areas for Improvement:

Missing Issue References: If this relates to a specific issue in the NuttX or NuttX Apps repositories, those should be linked.
Incomplete "How" in Summary: The summary mentions what syscalls are changed but lacks detail on how the change is implemented.  More details on the mechanism of switching to zero-parameter syscalls would be beneficial.
Impact Section Needs More "YES/NO" Clarity: The impact section is mostly just "arm64" and size reduction.  Explicitly stating "YES" or "NO" for each impact category (user, build, hardware, documentation, security, compatibility) with explanations would make the impact clearer.  For example:

Impact on user: NO
Impact on build: NO
Impact on hardware: YES (affects arm64 architecture)
...and so on.

Insufficient Testing Logs:  "ostest" and "qemu-armv8a:nsh_smp" are not detailed enough.  The logs should show the relevant parts of the test output demonstrating correct functionality both before and after the change.  Ideally, there should be tests specifically targeting the context switching functionality.
Missing Build Host Information: The testing section should specify the build host OS, CPU, and compiler used.
"Anything else to consider?" is unanswered:  This section is meant to capture any unusual edge cases or potential issues that reviewers should be aware of.

Recommendation:  Revise the PR to address the weaknesses listed above. Providing more detail and explicit answers to all sections of the template will greatly improve clarity and make it easier for reviewers to assess the change.


vSphere - anti affinity rules

When using the vSphere node driver, users should be able to specify vSphere anti-affinity scheduling rules per node group. This needs to work for all supported versions of vSphere in Rancher.
Users should be able to set the rules via the UI and when provisioning through the Terraform provider.
See also:
rancher/rancher#25892
SURE-5089
gz#8892

Note: Test on all vSphere versions

Related UI ticket: https://github.com/rancher/dashboard/issues/7181
Other tickets of note: #32191 & #25892
Internal reference: SURE-5089


Visual Error on Neo 1.4.0

Getting this crazy CSS error on my content admin pages with Neo 1.4

What browser are you using? I think I know what's going on.

Safari 10

Haha gotta love Safari. It really is the IE of modern web development. Was a simple fix though.


recall precision output reversed

https://github.com/yfpeng/object_detection_metrics/blob/db51d7d43480e282349e80fa6b8141a74f3fc7bc/src/podm/metrics.py#L161
the output of recall and precision are reversed generating the wrong results (for visualizations later on)
mpre and mrec should be swapped

Fixed. Thank you!


Cleanup code coverage reporting

Code coverage should be targeted to the product code only.

@pensivebrian what are some examples of non-product code?


Bounds Extension uses world space incorrectly

Describe the bug
the bounds extension to get bound corners returns incorrect world space values.
this function is meant to return the world positions of the corners of a given bounds. However, it uses the Bounds.center which is a world space position, making corner calculation operate in local space in relation to the world position. the wording is confusing but it should be operating off of the zero position which is the local center.
To reproduce

create bounds with center other than the world's origin.
attempt to get the position of the corners by calling the function GetCornerPositions in the script BoundsExtensions.cs
create empty gameobjects at the output positions, and see that they do not relate to the object's corner positions

Expected behavior
get correct corners in world space
Your Setup (please complete the following information)
MRTK 2<IP_ADDRESS>, but it seems like it is in the current repo branch as well.
Additional context
Fix: the fix is fairly simple, but will have to be applied to other relevant functions. for this particular function, do the following:

Change line 106 to:
Vector3 center = transform.position - bounds.center;

this will set the center to the offset of the bounds center from the transform center in local space, which is the space this expects to be working in.

There is a secondary bug here as well where the bounds is initialized to the default center=(0,0,0), size=(0,0,0), and using Extend on this will always include the world origin. The fix to this is initialize with the first valid bounds instead of using Extend on the default value.

This also does not account for scale. If an object is at 0.01 scale to start off, for example, the bounding box will be at 0.0001 scale.

It might be the same cause as for this #4151

Reading the bounding box code, it turns out bounding box extensions are not actually used by the bounding box ux control. Removing bounding box label and urgency-soon tag, since I believe Urgency-Soon was added because this was related to bounding box.

However, it uses the Bounds.center which is a world space position,

I see where you are coming from since getting BoxCollider.Bounds does give bounds in world space. However, reading the code more, I think that bounds in GetCornerPositions(this Bounds bounds, Transform transform, ref Vector3[] positions) is intended to be passed in using local space bounds, not world space bounds.
For example, the following code, which grabs the corners using Mesh.bounds which is in local space, puts the corners correctly in space, both for a cube that is not at the origin, and a cube that is scaled to size 0.01
using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using Microsoft.MixedReality.Toolkit.Utilities;
using Microsoft.MixedReality.Toolkit;
public class BoundsWorldSpaceTest : MonoBehaviour
{
    // Update is called once per frame
    void Update()
    {
        Bounds bounds = GetComponent<MeshFilter>().mesh.bounds;
        Vector3[] corners = new Vector3[8];
        bounds.GetCornerPositions(transform, ref corners);
        for (int i = 0; i < corners.Length; i++)
        {
            DebugUtilities.DrawPoint(corners[i], Color.cyan);
        }
    }
}

You can also see on Line 369 that the method is using local space bounds by calling using Bounds.center and bounds.extents.
I'm going to close this as By Design for now, and will clarify the intended method usage in comments in a PR.

Added comment clarifying GetCornerPositions usage in #4592


NET::ERR_CERT_COMMON_NAME_INVALID  for domain vsassetscdn.azure.cn

Hi @valord577
Thanks for reaching VS Marketplace Support Team, we will get back to you with a response as quickly as possible.
-Regards,
VS Marketplace Team

Hi @valord577
Could you please provide more details about your concern, along with reproducible steps to investigate better?
Regards,
VS Marketplace Team

Hello @madhurivadaligithub

Open https://marketplace.visualstudio.com/items?itemName=ms-vscode.cpptools
Some elements on the page don't load, such as https://vsassetscdn.azure.cn/v/M233_20240105.6/_content/Header/vs-logo.png

BTW, maybe it's the CDN's strategy to assign to the domain vsassetscdn.azure.cn.
Unfortunately, this domain is not available.

Hello @madhurivadaligithub
If I use a network proxy to access the page, then the resource redirects to cdn.vsassets.io. Everything is ok.

If I use the local network, static resources redirect to vsassetscdn.azure.cn.

Did I make it clearly? @madhurivadaligithub
Maybe it's the CDN's strategy to cause static resources to redirect to vsassetscdn.azure.cn.

I have the same problem.
Maybe it only happens in China?

Hello--we did indeed experience a network outage in China at this time, but it was resolved within 12 hours. If there is an ongoing problem here, please re-open this issue. For now, I'll go ahead and close it and consider it resolved. If you disagree, please let us know and we'll treat your concern with high priority.

Oops...
Is the problem because of my network?

I'm reviewing this again, @Mr-Python-in-China --thank you for your quick response. This is clearly an ongoing issue.

https://www.itdog.cn/dns/vsassetscdn.azure.cn
https://ping.sx/dig?t=vsassetscdn.azure.cn
You can find a website that performs nslookup or dig online, in China the ip returned by dns is empty. There is no A record in the dns result.

@Mr-Python-in-China your Content Security Policy directive may be worth investigating with your network administratot --the problem may well be in your network.
@fantasyroot are you experiencing an outage at this time?
@valord577 did this resolve for you?

Sadly, it's a long-term and intermittent issue. Until just now, I also faced the same issue. :(
My ping result is Ping 请求找不到主机 vsassetscdn.azure.cn。请检查该名称，然后重试。
In English is Ping request could not find vsassetscdn.azure.cn. Please check the name and try again.
As mentioned earlier, see this webpage, vsassetscdn.azure.cn has no A record in the dns result in most regions of the world: https://www.itdog.cn/dns/vsassetscdn.azure.cn

I still have the problem. Is it ready to solve the problem?

Same problem, please fix it.


Script import using --watch appears to be broken

Frodo CLI version
cli: v3.0.0
lib: v3.0.1-0
node: v20.5.1
Describe the issue
When modifying watched scripts, frodo reports errors and the updated scripts are not imported:
% frodo script export -A --extract volker-dev
% frodo script import -A --watch volker-dev
Connected to https://openam-volker-dev.forgeblocks.com/am [alpha] as service account Frodo-SA-1712175401543 [eb108b7a-e039-40bc-9764-84bed891fee1]
Watching for changes...
temp.script.js
The "path" argument must be of type string or an instance of Buffer or URL. Received undefined
temp.script.js
The "path" argument must be of type string or an instance of Buffer or URL. Received undefined

@phalestrivir @hfranklin could the last big PR have caused this, too? It will take me a while until I get to looking into this.

This wasn't from the last big PR, but rather it's an edge case I must not have tested for when I updated the --watch functionality to work with extracted scripts a while back. I just figured out a fix for it, so I'll go ahead and make a PR for that shortly.


[IOTDB-4126] Optimize cache implementation using HashMap to find Node instead of traversal with a for loop

Description
Optimize cache implementation using HashMap to find Node instead of traversal with a for loop

This PR has:

[x] been self-reviewed.

[ ] concurrent read
[ ] concurrent write
[ ] concurrent read and write

[ ] added documentation for new or modified features or behaviors.
[ ] added Javadocs for most classes and all non-trivial methods.
[ ] added or updated version, license, or notice information
[ ] added comments explaining the "why" and the intent of the code wherever would not be obvious
for an unfamiliar reader.
[ ] added unit tests or modified existing tests to cover new code paths, ensuring the threshold
for code coverage.
[ ] added integration tests.
[ ] been tested in a test IoTDB cluster.

Key changed/added classes (or packages if there are too many classes) in this PR

Performance Statistics

NewLRUCache is implemented by LinkedHashMap.
LRUCache is implemented by original doubly linked list and HashMap.
OldLRUCacheis implemented by original doubly linked list.

Method
Cache Size / Data Size
NewLRUCache Time
LRUCache Time
OldLRUCache Time

Random
0.07
0.412s
0.819s
1.440s

Random
0.1
0.389s
0.765s
1.449s

Random
0.2
0.356s
0.721s
1.361s

Random
0.3
0.365s
0.601s
1.303s

Random
0.4
0.361s
0.622s
1.268s

Random
0.5
0.339s
0.490s
1.154s

Random
0.6
0.318s
0.422s
1.170s

Random
0.7
0.191s
0.320s
1.115s

Random
0.8
0.193s
0.323s
1.142s

Random
0.9
0.194s
0.319s
0.924s

Method
Cache Size / Data Size
NewLRUCache Time
LRUCache Time
OldLRUCache Time

Scan
0.07
0.338s
0.979s
1.384s

Scan
0.1
0.330s
0.950s
1.383s

Scan
0.2
0.325s
0.822s
1.708s

Scan
0.3
0.307s
0.685s
1.720s

Scan
0.4
0.308s
0.547s
1.713s

Scan
0.5
0.285s
0.445s
1.724s

Scan
0.6
0.292s
0.443s
1.713s

Scan
0.7
0.289s
0.441s
1.714s

Scan
0.8
0.288s
0.442s
1.721s

Scan
0.9
0.293s
0.442s
1.722s


Updated "X" icon Issue #6 is solved now !

Twitter Icon is now updated to the new "X" icon.
Update twitter.js  #6  is solved now !

Can you add the hacktoberfest tag to this PR ?

Done


FreeRTOS+TCP : STM32Fxx network interface Updated

Network Interface for STM32F2x, F4x, and F7x

Description
Source file networkInterface.c :

ipconfigZERO_COPY_TX_DRIVER : The driver was supposed to work for both the zero-copy and the copy-implementation. However, the copy-version was never fully implemented. In this version, both copy and zero-copy can be used..

ipconfigDRIVER_INCLUDED_RX_IP_CHECKSUM / ipconfigDRIVER_INCLUDED_TX_IP_CHECKSUM : both enabled and disabled can be used int the new release.
Normally one will enable the automatic offloading of checksums because it helps the performance. Only for testing purposes, it can be handy to change this.

PHY handling: the handling of the connected PHY is now done in a separate module: Common/phyHandler.c. It recognises the attached PHY automatically and starts auto negotiation. Also it can poll for the PHY Link Status.

Stopped referring to the global variable:

    extern const uint8_t ucMACAddress[ 6 ];

Now using FreeRTOS_GetMACAddress() in stead.

Introduction of a new macro ipconfigUSE_RMII. Shall be defined as 1 if a RMII interface is being used. Please check your board.

Introduction of a new macro NETWORK_BUFFERS_CACHED: true if the memory is being cached ( STM32F7xx only ). I am sorry to tell that this option is not yet fully implemented. On a STM32F7xx, the driver works well if memory caching is not enabled ( SCB_DisableDCache() ).

Implementation of linked messages ( ipconfigUSE_LINKED_RX_MESSAGES ). Especially on a LAN, it may enhance the performance. Both options can be used: with and without linked RX messages.

The following files have been added ( compare to the current version in AWS/FreeRTOS:
stm32fxx_hal_eth.c
stm32fxx_hal_eth.h
stm32f2xx_hal_eth.h
stm32f4xx_hal_eth.h
stm32f7xx_hal_eth.h

Source file stm32fxx_hal_eth.c :

Removed code that is never used, like configuring the PHY, DMA buffers and their handling, HAL_ETH_TransmitFrame(), HAL_ETH_GetReceivedFrame()
PHY-read and PHY-write are kept.

Added support for stm32f2xx

After changing a register in the ETH peripheral, the register must be read-back, and set again after a short delay:

    MACFCR = ulValue;    /* Set it */
    ( void ) MACFCR;    /* Read it back. */
    vRegisterDelay();    /* Short delay. */
    MACFCR = ulValue;    /* Set it again. */

vRegisterDelay() was introduced to get a more precise and shorter delay than calling HAL_Delay(1).
Source file stm32fxx_hal_eth.h :

Avoid conflicts with stm32_hal_legacy.h. There is some overlap between the 2 header files that can cause conflicts for the compiler. This was solved ( avoided ) by adding:

#ifndef ETH_MAC_TXFIFO_FULL
    #define ETH_MAC_TXFIFO_FULL          ((uint32_t)0x02000000)  /* Tx FIFO full */
    ...
#endif

The FreeRTOS+TCP driver is not used in any of the demo or testing projects on AWS/FreeRTOS. The is one demo project for a STM32L475. That is a project using Wi-Fi and it doesn't make use of FreeRTOS+TCP.
Checklist:

[x] I have tested my changes. No regression in existing tests.
[x] My code is Linted.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/bot run checks

/bot run checks

/bot run checks

/bot run checks

/bot run checks

/bot run checks


Customizing dashboard

Any idea how to customize dashboard, not the columns in the sections, I am talking about the sections which are showing at the dashboard. how to customize there look and feel.

Just register a css stylesheet. Please ask the active admin mailing list for support.


artifact examine trigger can be done by ghosts

Description
on one hand, obvious bug
on the other, spooky
if it is intended to be spooky a dedicated boo trigger for our otherworldly friends would be cooler

#27249


Allow the user to pass in a pre-existing Auth0Client

Describe the problem you'd like to have solved
I'd like to be able to easily integrate Auth0 into a client defined statically in my app (such as ApolloClient) without sacrificing the convenience and features of auth0-react.
Describe the ideal solution
The Auth0Provider component would accept a single client prop, as an alternative to the current props which act as configuration options to be passed to an internally created client instance. This client would be an Auth0Client instance created with auth0-spa-js.
I could then create my own Auth0Client, plug it into my ApolloClient instance using a link, and then provide it to the rest of my app, and I still get the nice convenience of cached authentication state and user data from auth0-react.
Alternatives and current work-arounds

Re-implement features of auth0-react in my own custom React context, like the caching behavior for important information.
Expose or otherwise "steal" the client which auth0-react creates using some terrible magic.

Additional context
For an analogous example of how this is done, see Okta's React library.
This is, in my opinion, the most robust and seamless way to provide higher levels of user customization to a library like this one without complicating the usage for beginners or exposing some kind of static access pattern through a ref or similar confusing method.
Ideally you could just take the client prop and toss it straight into your useState which already exists in the Auth0Provider if it's provided instead of creating your own.

Hi @a-type - thanks for your suggestion.
We've decided not to support this feature because adding a client option would unnecessarily expose the internals of the SDK and would introduce a bunch of complexity around initialising the SDK differently depending on the state of the client.
Have a look at this https://github.com/auth0/auth0-react/issues/97#issuecomment-677918755 for a solution to using the SDK with an Apollo Client.

I've seen similar approaches before. I'm a bit concerned about the re-rendering implications of instantiating a new Apollo Client within the render function of a React component. This only seems to work if you are completely confident your top-level component will never be re-rendered; otherwise your GraphQL cache would disappear. At least that's how I understand it currently.
In simple cases that might be reliable, but I don't tend to hang my hat on React doing what I think it should do - they're free to change or optimize how they re-render components at any time internally, and what's going on behind the scenes can often be more complicated than it seems, like Concurrent Mode.
If that's the verdict though, I suppose I'll implement my own version of Auth0 React bindings designed around this use case.

Ideally i dont want to jump on an old closed issue, but this is causing big issues in app development locally for me. Essentially using useAuth0 along with depending on its isLoading and isAuthenticated props breaks HMR. It is causes a full app re-render whenever I make changes to a react component as my page rendering is waiting for conformation on being authenticated. Allowing what @a-type suggested would allow me and others to fix this issue.
It seems like a common pattern, for example when using redux or simillar libraries it is usual to create and hold a reference to the store outside app render, and pass it in at render time, thus allowing HMR to do its thing and use existing page state. I'm not sure what you mean by 'exposing the internals of the SDK'. All information already in JS is available for anyone to see, along with all SDK internals.
This is of course unless there is another already accepted way of doing this, and i have simply not found the docs.


feat: Introduced new graph algorithms

PR for a few graph algorithms.
Deployment can be accessed from graphalgo.vercel.app

Reviewers: Please uses conventional comments
What is this PR about?

[x] Refactor
[x] Feature
[x] Bug Fix
[x] Optimisation

Features

Introduced algorithms

Dijkstra's
A* Star
Depth First Search
Breath First Search

Coloured the edges according to Client's specifications
Added buttons to change start and end nodes

Concerns?

Graph visualisation Improvements might come along and we will need to adjust it accordingly.

Testing Methodology?

[x] Have you tested this on Vercel ?
[x] Have you tested this on a Mac?
[x] Have you tested this on a Windows?
[x] Have you tested this on a Linux?

Checklist:

[x] Have we followed conventional commits?

We have some conventional commits used but was not well implemented within the team

Merged all code bases. Still needs to fix to use the new graph display