Summarize archiver run and send notification via GH Action

With the move to automated archiving, there's a need to easily and visibly summarize the outcome of the automated archival run. Communication should summarize the status of each archiver's run, and any critical warnings or errors. We could also use this as a chance to create a public record of what's new in each deposition.
Who/Where to notify?
The hope is that these archives will be a public resource, so producing a persistent public record of the data updates and/or allowing the general public to get access to this information would be good. Some options:

Send a Slack message to a publicly accessible channel.
Send an email to a list that outside folks can sign up to.
Create an issue on GitHub containing the summary and requiring that it be reviewed by someone on our team e.g. “Review new data snapshots for 2023-03-14.”
Automatically tweet a link to the GitHub issue.

Notification / Summary contents?

Have a section dedicated to each dataset being archived.
For each dataset, indicate whether the archiving run was labeled a success or a failure.
If there was no change from the previous version, resulting in no new archive being created, say so explicitly, and indicate how long it has been since the archive was updated (we should eventually get suspicious if archives that we expect to change don't).
List any change in the set of data partitions that were archived relative to the previous version.
List any existing data partitions that were updated and indicate the change in file size.
Summarize how many partitions were updated (number and % changed)
Summarize the change in archive size (absolute MB and % change)
If the archiving run was a failure, indicate what criteria failed and provide context. E.g.

List any expected but missing data partitions
List any unexpected new data partitions
List any files that have an unexpected internal filetype, and the type that was expected
List any files that shrank so much that they triggered the failure

If the archiving run failed for reasons unrelated to the data being archived, indicate that as well. E.g.

Unable to connect to the data provider
Unable to connect to Zenodo
GitHub runner ran out of disk space
Archiving run took too long and timed out

List any change in the set of data partitions that were archived relative to the previous version.

In #70 this is flagged as a condition for failure, so would this not be redundant? Or do you mean if we change the script to include different partitions between archive runs this should be explicitly noted by our archiver?
Otherwise I think this covers all our bases. This seems a bit lengthy for a slack message so presumably one of the other communication options will make more sense here.

I'm thinking that the archiver summary report (Maybe it's a JSON object?) will be the thing that's evaluated to decide whether the run failed.  Some changes in the set of data partitions are fine and expected -- e.g. a new month of eia860m data -- but we'd still want to see that change reflected in the summary.  Most kinds of changes would be unexpected and bad though -- say the 1995 California EPA CEMS data disappears, or the name of the PHMSA underground natural gas storage partition changes from underground_natural_gas_storage to undergasstore or something. Then it would be useful to see what the change was for debugging.
I think automatically posting the summary of the run as an issue, assigning someone to review it, and then posting links to the issue on Slack / Twitter / Wherever makes sense. It'll be persistent and public and someone will be explicitly tasked with reviewing it, and it'll show up in a place where we can have some discussion and easily spin off new issues if there's something that needs to be fixed.

I think we need to summarize and communicate the status of the run regardless of whether a new version is published. If the run fails, we need to know that and whatever useful error information was collected. Under some circumstances even "no change" is suspicious. E.g. if the monthly EPA CEMS hasn't updated in 60 days, it should get flagged for review.

That makes sense to me. If I'm understanding correctly your proposal, @zaneselvans, we publish an issue weekly with the information listed above. Most weeks this should look good and we just close it immediately. I think if that's our plan then ideally we'd name the issue to reflect the status of the run, or at least reflect the success status in the slack message. If key failures are occurring it'd be useful to know to prioritize fixing them.


[Proposal] Use ZoneInfo instead of dateutil for time zone specification

Since python 3.9 zoneinfo has been accepted as the standard way of handling time zones and has been included in the standard library:
https://docs.python.org/3/library/zoneinfo.html
However, in the gallery and in some conversions were are still using dateutil for this (example):
https://neuroconv.readthedocs.io/en/main/conversion_examples_gallery/recording/openephys.html
We still are supporting python 3.8 so we can not just use ZoneInfo as it is. Fortunately, there is a backport for this specific purpose:|
https://pypi.org/project/backports.zoneinfo/
Which we can use that right now to start using the standard solution and avoid the installation of an extra dependency for users that use python 3.9.

This would be an easier kind of thing to fix if we had a helper/util function for adding timezone info to a datetime; something that would also reduce the number of top level imports and raw number of lines across each gallery snippet

Maybe the easier thing is to wait till we can drop support for python 3.8 which will be in a year (2024-10-01).
https://devguide.python.org/versions/
But point in favor to  @CodyCBakerPhD previous proposal to have util functions for setting timing information. This  would avoid this problem.


WinUI templates should not show up in Blend

Describe the bug
VS and Blend do not have a designer for WinUI, so the WinUI templates should not be available in Blend, which is primarily for design experiences.
Steps to reproduce the bug

Install Visual Studio and add the .NET Desktop and UWP workloads (make sure the Windows App SDK C# templates are selected in the optional components for the .NET Desktop workload)
Launch Blend from the Start menu
Click Create new project

WinUI templates show up with unfriendly titles and descriptions.
Expected behavior
WinUI templates should not even be available in Blend, since there is no designer for WinUI.
Screenshots

NuGet package version
None
Packaging type
No response
Windows version
Windows 11 version 21H2 (22000)
IDE
Visual Studio 2022-preview
Additional context
No response

The likely fix is to just remove this line from the .vstemplate files:
<AppIdFilter>blend</AppIdFilter>

@evelynwu-msft This change seems to have made it into the latest 1.4 templates, as I no longer see these templates in Blend.  So, this issue can probably be closed.


feat(p2)  Support hessian2 dubbo enumeration

You should modify the import part in hessian2-register-x.go file. Pls refer to registerHessian template in tool/internal_pkg/pluginmode/thriftgo/register_tpl.go

Please explain in details


Duplicate Code

https://github.com/mtniehaus/AutopilotBranding/blob/51f11b5eba6b5f17835e08b244086a0ba4829ddf/AutopilotBranding/AutopilotBranding.ps1#L174C1-L179C2

Opps .. Nevermind, I think I see what your doing now. Disabling WSUS , add or removing the Features and then re-enabling it.
I suggest adding another quick  comment block perhaps.


NEED HELP controlling RAM from session crashes

Trying to process 2.0GB of csv data that has only two columns
I am generating session crashes in colab
from ludwig import LudwigModel
Session is running fine until this code:
import yaml

model_definition = {}
model_definition['input_features'] = [{'name': i, 'type': 'category'} for i in 'A']
model_definition['output_features'] = [{'name': j, 'type': 'numerical'} for j in 'B']
model_definition['training'] = {}

ludwig_model = LudwigModel(model_definition)
train_stats = ludwig_model.train(data_csv='train.csv')

Current available RAM: 12.72GB
Some way to allow process to proceed at cost of processing time
I would rather it take longer to process than not process at all at this point. Is there a way to do this??

@TimusLetap could you please provide both exactly what error are you getting and something we can reproduce (code + data + yaml)?

Closing due to inactivity, feel free to reopen if the issue persists.


ImageService prefix with site in a virtual directory

I am trying to deploy my webapp to IIS, where the site is run within a virtual directory, rather then in the root of site and use the remote image service and a custom ImageService that I have written
However, it appears that the HttpModule is either not run, or more likely the prefix does not match as I expected when the site is not in the root (which caused me some confusion as to why it worked in VS but not when in IIS!):
http://domain.com/myapp/remote.axd/url-to-image?width=200
rather than:
http://domain.com/remote.axd/url-to-image?wdth=200
To make this work, it appears that the prefix in the service config must also include the virtual directory eg:  'myapp/remote.axd', as I think it does a StartsWith on the URL.
Am I missing a configuration item that will make this work without hardcoding the virtual directory path into the prefix config?
Thanks,
Richard

Hi Richard,
There's no additional config values so yeah, you would.
Have you been able to replicate the issue using IIS rather than IISExpress on your development machine? I'd like to see exactly what would be causing the url to be parsed incorrectly if that is the case so adding a debugger would be really useful.
Cheers
James

Hi James,
Thanks for you quick reply!
I don't think there is a problem parsing the URL; I had VS setup to use IIS Express, but the site was not set to run in a virtual directory (the url was something like http://localhost:16000/remote.axd), so the normal prefix worked as expected.
The problem is that I misunderstood how the prefix works, and the fact that the HttpModule just looks at the start of the path and, if it matches, it handles the request.
As the site is in a sub-directory, the path will never start with the prefix but have the folder name first (/myapp/remote.axd/...).  You can't use the normal root-relative url /remote.axd/..., as it will never be handled as IIS will look in the root for a file called remote.axd instead as the module isn't registered there (if you see what I mean!).
I may look to see if its possible to edit the HttpModule so when it looks at matching the prefix it takes into account the path of the site, however this isn't a show-stopper for me at the moment.
Expect a couple of beers from me, as you have made my latest project much easier :)   It's a rewrite of an app I developed a few years ago, and the image manipulation was always a bit dodgy, and the caching ability of the library is a huge bonus!
Cheers
Richard

Hi Richard,
I'm really happy to hear that it's made working on your project much easier. It exactly why I've continued to work on the solution over the last few years :smile:
I think it should be possible to augment the way the IImageService is identified using the prefix to allow for virtual paths. I originally used StartsWith as that reduced the chance of collision with site urls. I'm wondering whether we could turn it into a regular expression? That would allow much greater flexibility and backwards compatibility. I'll need to experiment by copying your setup to see what the best plan is.
Cheers
James
Oh and thanks for the beer money! :beers:

Hi,
I realised yesterday, that I could implement this in my custom IImageService by adding the virtual path to the prefix from the config file in the Prefix property setter (I'm using VB)..
Public Property Prefix As String Implements IImageService.Prefix
    Get
        Return _prefix
    End Get
    Set(value As String)
        Dim request = HttpContext.Current.Request
        Dim path = request.ApplicationPath

        _prefix = (path.TrimEnd("/") & "/" & value).TrimStart("/")
    End Set
End Property

This seems to work for me in both IIS Express (in the root of the site) and when deployed to a virtual directory in full IIS.   I no longer have to edit the security.config to update the prefix attribute when I deploy.
Thanks,
Richard


Wechaty is imported as a type in typescript.

1. Versions

What is your wechaty version?

Answer: 1.20.2

Which puppet are you using for wechaty? (puppeteer/padlocal/service...)

Answer: _

What is your wechaty-puppet-XXX（padchat/puppeteer/） version?

 Describe the bug

as above, after import { Wechaty } from 'wechaty', the Wechaty is imported as a type and I can't instantiate it. But the package source code shows that it is indeed exported as a type. or did I use it uncorrectly?

The building the bot section of the beginner-friendly tutorial needs updates.
The recommended way to instantiate Wechaty is by using WechatyBuilder.build().
import { WechatyBuilder } from 'wechaty'

// Initializing bot
const bot = WechatyBuilder.build();

// Handle events of bot
bot.on('scan', onScan);
bot.on('login', onLogin);
bot.on('logout', onLogout);
bot.on('message', onMessage);

// Start bot
bot.start();

I’d love to accept a PR for fixing that.

The building the bot section of the beginner-friendly tutorial needs updates.
The recommended way to instantiate Wechaty is by using WechatyBuilder.build().
import { WechatyBuilder } from 'wechaty'

// Initializing bot
const bot = WechatyBuilder.build();

// Handle events of bot
bot.on('scan', onScan);
bot.on('login', onLogin);
bot.on('logout', onLogout);
bot.on('message', onMessage);

// Start bot
bot.start();

Tkx! It works fine.

BTW: this kind of problems could be very easy to be solved by talking with our Friday BOT @ GPTs - https://chat.openai.com/g/g-s4mx1ODQy-friday-bot
Please check it out if you have a ChatGPT Plus subscription.
Or, welcome to join our Discord community https://discord.gg/7q8NBZbQzt and you can talk with Friday BOT over there as well.


Add Callback logic for Singleton

PR of #1213

Potential conflicts with #1208

I'm not a fan of this change.  @eluchsinger have you read back through the other Singleton discussions?


I can't deobfuscate this file

Hi @0x1Avram
i tried your tool and i loved it .. thank you so much
can you see this file .. i think it's not fully deobfuscate:
https://pastebin.com/W3jcffpb

Hi @TTMTT !
Thank you for the feedback and the sample.
You are right, the sample was not deobfuscated correctly. I found a few bugs, fixed them and created a new release - 1.0.4 . I tested it on the file you provided and it seems to be deobfuscated properly with this new release. Please test it yourself and let me know if you encounter any other issues.


fix: some inbound beans are created unnecessarily

Description
Added @ConditionalOnProperty("camunda.connector.polling.enabled") annotation to ProcessDefinitionInspector, ProcessDefinitionInspector, and InboundConnectorRestController classes.
Related issues
closes https://github.com/camunda-community-hub/spring-zeebe/issues/392

Exactly ❤ it!


Update for Tone Analyzer API v4

https://github.com/watson-developer-cloud/tone-analyzer-nodejs/issues/108
Updated demo has been deployed to https://tone-analyzer-demo-r-v4.mybluemix.net/ for testing purposes.

Here is a screenshot of the two proposed changes in the following situation:
When there are no dominant tones to be displayed at sentence level, then should the legend block (which depends on tone score) be displayed?

Displayed

Not Displayed

Also, wanted to confirm if we can continue using the existing color scheme in the demo? Or do we need to switch to some other color scheme?

@richieverma up to you, if you think there's a need to update it.

Added test cases and completed cross-browser testing.


YoloObjectDetector.cpp  failed

I am trying to make but everytime i am getting following error
[ 46%] Building NVCC (Device) object darknet_ros/darknet_ros/CMakeFiles/darknet_ros_lib.dir/__/darknet/src/darknet_ros_lib_generated_convolutional_kernels.cu.o
Scanning dependencies of target darknet_ros_lib
[ 47%] Building CXX object darknet_ros/darknet_ros/CMakeFiles/darknet_ros_lib.dir/src/YoloObjectDetector.cpp.o
c++: error: unrecognized command line option ‘-std=gnu++14’
darknet_ros/darknet_ros/CMakeFiles/darknet_ros_lib.dir/build.make:1796: recipe for target 'darknet_ros/darknet_ros/CMakeFiles/darknet_ros_lib.dir/src/YoloObjectDetector.cpp.o' failed
make[2]: *** [darknet_ros/darknet_ros/CMakeFiles/darknet_ros_lib.dir/src/YoloObjectDetector.cpp.o] Error 1
CMakeFiles/Makefile2:2708: recipe for target 'darknet_ros/darknet_ros/CMakeFiles/darknet_ros_lib.dir/all' failed
make[1]: *** [darknet_ros/darknet_ros/CMakeFiles/darknet_ros_lib.dir/all] Error 2
Makefile:140: recipe for target 'all' failed
make: *** [all] Error 2

The package has been modified significantly over time so hopefully, this issue is resolved.


Invariant Violation: new NativeEventEmitter() requires a non-null argument., js engine: hermes Getting this issue in iOS

import BackgroundService from 'react-native-background-actions';
const sleep = time =>
new Promise(resolve => setTimeout(() => resolve(), time));
// You can do anything in your task such as network requests, timers and so on,
// as long as it doesn't touch UI. Once your task completes (i.e. the promise is resolved),
// React Native will go into "paused" mode (unless there are other tasks running,
// or there is a foreground app).
const veryIntensiveTask = async taskDataArguments => {
// Example of an infinite loop task
const {delay} = taskDataArguments;
await new Promise(async resolve => {
for (let i = 0; BackgroundService.isRunning(); i++) {
console.log(i);
await sleep(delay);
}
});
};
const backgroundTask = async () => {
const options = {
taskName: 'Example',
taskTitle: 'ExampleTask title',
taskDesc: 'ExampleTask description',
taskIcon: {
name: 'ic_launcher',
type: 'mipmap',
},
color: '#ff00ff',
linkingURI: 'yourSchemeHere://chat/jane', // See Deep Linking for more info
parameters: {
delay: 1000,
},
};
await BackgroundService.start(veryIntensiveTask, {});

BackgroundService.on('expiration', () => {
  console.log('I am being closed :(');
});

};
backgroundTask();
"react-native-background-actions": "^3.0.1",
"react-native": "0.72.4",
Need urgent solution

Did you get a solution?

Commenting again for visibility.

I found a solution by deleting pods and podfile.lock and then running pod install Strangely enough part of the solution was to close, the terminal running your simulator and closing xcode then reopening everything and rebuilding.
So the process I followed was
cd ios && rm -rf Pods && rm -rf podfile.lock && pod install
Close xcode, simulator and terminal and reopen and rebuild.


pinpoint-mysql  databases looks like some tables are missing

Prerequisites
Please check the FAQ, and search existing issues for similar questions before creating a new issue.YOU MAY DELETE THIS PREREQUISITES SECTION.

[y] I have checked the FAQ, and issues and found no answer.

pinpoint-mysql  databases looks like some tables are missing
like  systemMetricTag  and  uriStat

Hi @xudingjun3131
url statistics should store data in pinot and not mysql.
To use URL statistics, you must additionally install kafka and pinot.
Please refer to the link below for related guides.
https://pinpoint-apm.gitbook.io/pinpoint/documents/uri_statistics

Hi @xudingjun3131 url statistics should store data in pinot and not mysql. To use URL statistics, you must additionally install kafka and pinot. Please refer to the link below for related guides. https://pinpoint-apm.gitbook.io/pinpoint/documents/uri_statistics

I have solved it。
The docker-compose-metric.yml has some online resource like  github,I check it out offline ,it's ok。

I have solved it。
The docker-compose-metric.yml has some online resource like github,I check it out offline ,it's ok.
Get the github online resource first and modify Dockerfile ，it will be ok。


Unused argument in updateWith?

I think the argument of type "Model" is unused here:
https://github.com/rtfeldman/elm-spa-example/blob/master/src/Main.elm#L276
Sorry if this is a mistake on my part, just started learning Elm a couple days ago.

Opps, sorry, this is a duplicate of a previous issue.


Apache Kafka: add 2.7.1 and 2.8.0

Motivation for this change
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
21.11 Release Notes (or backporting 21.05 Relase notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 128043 at 5bb0c682 run on aarch64-linux 1

2 packages built successfully:

apacheKafka (apacheKafka_2_8)
apacheKafka_2_7


CORS error

CORS Error Debugging and Fix for Signup Endpoint
Issue
While testing the signup functionality from the frontend, I'm encountering a CORS error. The specific error message is:
Cross-Origin Resource Sharing (CORS) error: preflightMissingAllowOriginHeader
It seems that the browser is sending a preflight OPTIONS request, but the server is not responding with the required CORS headers like Access-Control-Allow-Origin.
Potential Fix
1. CORS Headers
Please ensure that the backend API is configured to handle CORS properly. The server should respond with the following headers:

Access-Control-Allow-Origin: * (or specify the origin)
Access-Control-Allow-Methods: POST, OPTIONS
Access-Control-Allow-Headers: Content-Type, Authorization

2. Handle Preflight Requests
The server should handle OPTIONS preflight requests by returning a 200 OK status and the necessary headers. Here's an example of what can be added to the top of the PHP script:
header("Access-Control-Allow-Origin: *");
header("Access-Control-Allow-Methods: POST, OPTIONS");
header("Access-Control-Allow-Headers: Content-Type, Authorization");

if ($_SERVER['REQUEST_METHOD'] === 'OPTIONS') {
    http_response_code(200);
    exit();
}

Author's Response
Thank you, @TonyFred-code, for pointing out this issue and providing a detailed analysis!
Issue Resolution
I have implemented the necessary CORS headers across the backend endpoints to ensure that the server properly handles preflight OPTIONS requests. The following headers are now included in each endpoint:
header("Access-Control-Allow-Origin: *");
header("Access-Control-Allow-Methods: POST, GET, OPTIONS, PUT, DELETE");
header("Access-Control-Allow-Headers: Content-Type, Authorization");

if ($_SERVER['REQUEST_METHOD'] === 'OPTIONS') {
    http_response_code(200);
    exit();
}

If you continue to encounter any issues, please clear your browser cache and retest. Let me know if the error persists, and we can further investigate.


How to read queued ORB topics?

Hi all,
I'm trying to understand how to work with queued topics (that is advertised with orb_advertise_queue or orb_advertise_multi_queue) - how can I copy out several messages from queue?
For example, let say gps driver publishes to topic gps_dump data of NMEA messages from 10Hz gps receiver. gps_dump.msg data array is limited by 79 bytes, so in fact messages are published in topic with higher then 10Hz rate (the nmea strings for every measurement is about 200 bytes). The size of queue of gps_dump topic is 8.
Now my module subscribes on gps_dump topic and limit polling rate to 10Hz. On every update I would like to read out all messages that are currently in the queue, something like this:
if (fds[0].revents & POLLIN) {
	struct gps_dump_s report;
	uint8_t buf[79*4];			//up to 4 reports
	ammountR = 0;
	bool updated = true;

	//accumulate several reports in one message
	do {
		orb_copy(ORB_ID(gps_dump), gps_dump_sub_fd, &report);
		memcpy(buf+ammountR, (uint8_t*)report.data, (uint8_t)report.len);
		ammountR += (uint8_t)report.len;
		orb_check(gps_dump_sub_fd, &updated);
	} while ((updated) && (ammountR < 79*3));
	...

but every time I read out only one 79 bytes long last message. This leads to loss messages (according to uorb top -a).
And according to documentation of orb_check it works correctly, cause:

[orb_check] check whether a topic has been published to since the last orb_copy.

and, yes, it hasn't, it has been published several times before last orb_copy.
Of course, I can uprate polling rate of my module and it works, but I didn't understand why orb topics can be queued [at least more than 2] at all then if there is no way to read all messages in stock?
I think that I missed something.
Thanks in advance for help!

From what I see your understanding is correct and it should work the way you wrote it. Can you show the full code? Do you use orb_set_interval?

Do you use orb_set_interval?

Yes, I do.
Here is extended code:
/* subscribe to gps dump topic */
int gps_dump_sub_fd = orb_subscribe_multi(ORB_ID(gps_dump),0);
/* limit the update rate to 100 ms */
orb_set_interval(gps_dump_sub_fd, 100);

/* wakeup source(s) */
px4_pollfd_struct_t fds[1];

fds[0].fd = gps_dump_sub_fd;
fds[0].events = POLLIN;

int error_counter = 0;

do {
	/* wait for update for up to 1000 ms */
	int poll_ret = px4_poll(fds, (sizeof(fds) / sizeof(fds[0])), 1000);

	/* handle the poll result */
	if (poll_ret == 0) {
		/* this means none of our providers is giving us data */
	} else if (poll_ret < 0) {
		/* this is seriously bad - should be an emergency */
		if (error_counter < 10 || error_counter % 50 == 0) {
			/* use a counter to prevent flooding (and slowing us down) */
			PX4_ERR("ERROR return value from poll(): %d", poll_ret);
		}
		error_counter++;
	} else {
		if (fds[0].revents & POLLIN) {
			struct gps_dump_s report;
			uint8_t buf[79*4];			//up to 4 reports
			ammountR = 0;
			bool updated = true;

			//accumulate several reports in one message
			do {
				orb_copy(ORB_ID(gps_dump), gps_dump_sub_fd, &report);
				memcpy(buf+ammountR, (uint8_t*)report.data, (uint8_t)report.len);
				ammountR += (uint8_t)report.len;
				orb_check(gps_dump_sub_fd, &updated);
			} while ((updated) && (ammountR < 79*3));
			...
	}
} while (!_thread_should_exit);

ammountR is always 79.
If I set orb interval to 5 ms it works (doesn't loose messages)

Just remove the orb_set_interval call completely, you don't need it for your use case. The rate limiting works on top of the queue, working against for what you're actually trying to achieve.

The rate limiting works on top of the queue, working against for what you're actually trying to achieve.

Ok, I see. I'm not doubt it will work similar to 5 ms interval.
Just in case, so if I want to limit my module activity to ~10Hz, it should just sleep for 100ms (or as alternative polling on another topics with 100ms timeout) and accumulate several gps_dump reports from orb queue with loop I wrote, right?

Just in case, so if I want to limit my module activity to ~10Hz, it should just sleep for 100ms (or as alternative polling on another topics with 100ms timeout) and accumulate several gps_dump reports from orb queue with loop I wrote, right?

Yes. Just make sure that the queue size is large enough then.

Thanks for help!


Implement Swipe Refresh Listener in main events page

working on it :+1:

Check with @nikit19 to confirm that it is not needed

@nikit19 Are we going to use this ? If so you can go ahead :+1:

Yeah this is not needed right now but after this PR https://github.com/fossasia/open-event-android/pull/141
is merged and some other changes are made. This can be taken up. So don't close this issue I can work on it when everything is properly implemented

Great :+1:


Improve layout of the "Property Information" page

The "Property Information" page has a lot of data. The layout and look of the page can be improved.

Hey there, I made a first pass at formatting improvements to the property information page.  Please take a look at #37 and let me know what you think.

@dhevi - looks great, I incorporated the changes. Thanks!


Fix enable breakpoint short description

It said "Disable" instead of "Enable".

@fphilipe Thanks for this and sorry it took me so long to review such a simple patch. I didn't even look at it because since Travis was failing I thought it needed more work. It was a spurious failure though, so this is ready to go.
Could you rebase the PR on top of current master so I can merge it?

No worries. Rebased!


Templates: add new templates from batch 1

Summary
Adds 9 new story templates.

Almodo’s Films
Pizzas in NYC
12 Hours in Barcelona
Ultimate Comparison
Fitness Apps Ranked
Street Style On The Go
Plant Based Dyes DIY
Indoor Garden Oasis DIY
Belly Fat Workout

Meta data for the templates were provided along with the designs in the Figma file itself, this includes sticker names, title, tags, description and colour palette.
Relevant Technical Choices

Adds stickers and story template JSON
Uses title/alt texts for videos and images from the original source i.e. getty / unsplash / pexels.
Updates colorList component, shown on the template details modal, to include new lighter shades to add border around.

Testing Instructions
New templates should be available under 'Explore Templates' page.
/wp-admin/edit.php?post_type=web-story&page=stories-dashboard#/templates-gallery

Checklist

[x] This PR addresses an existing issue and I have linked this PR to it in ZenHub
[x] I have tested this code to the best of my abilities
[x] I have verified accessibility to the best of my abilities (docs)
[x] I have verified i18n and l10n (translation, right-to-left layout) to the best of my abilities
[x] This PR contains automated tests (unit, integration, and/or e2e) to verify the code works as intended (docs)
[x] I have added documentation where necessary
[x] I have added a matching Type: XYZ label to the PR

Fixes #7234
Companion PR: #8265

@googlebot I consent

Wen through all the new templates and they look good to me so far. Just pushed some minor, slightly unrelated string changes, but that's it.
I'll make sure #7885 covers these new templates as well.


Increase ESMValTool version to 2.8.0 and update release schedule

Description

This PR increases the version number to v2.8.0 and updates release schedule 🥳

Link to documentation: https://esmvaltool--3136.org.readthedocs.build/en/3136/community/release_strategy/release_strategy.html#release-schedule

Before you get started

[ ] ☝ Create an issue to discuss what you are going to do

Checklist
It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.

[x] 🛠 This pull request has a descriptive title
[x] 🛠 Code is written according to the code quality guidelines
[x] 🛠 Documentation is available
[x] 🛠 Tests run successfully
[x] 🛠 All checks below this pull request were successful

To help with the number of pull requests:

🙏 We kindly ask you to review two other open pull requests in this repository

I don't think it is a good idea to already move v2.8.0 as a past release (with links to tag and changelog) before the release has actually happened. Here I simply updated the dates to reflect what was done. I've opened another PR for post-release times to update our schedule of releases, see #3138


Fixed #24215 -- Refactor of lazy model operations

See #3984 for history – this is a new pull request based on master instead of stable/1.8.x.
I've bumped the deprecation warning for add_lazy_relation to RemovedInDjango21, and documented the deprecation.
I've also consolidated the commits into a smaller number of logical chunks.
CC @timgraham @carljm @charettes @akaariai

Updated with feedback from @aaugustin and @MarkusH. Notably:

make_model_label is gone (we shouldn't need to go back to an "app_label.ModelName" string often)
Apps.lazy_model_operation now only takes ("app_label", "ModelName") tuples, not model instances or string labels. lazy_related_operation still works with all forms.

buildbot, add to whitelist.

See #4122 for details of the failing test.

So this should be ready to go once #4122 is resolved to fix the failing test?

@carljm yes, provided everyone's happy with the latest API changes.

I like the latest API changes, and am happy with the state of this whenever the tests are passing.

I'm done commenting the changes to the app registry. The final implementation looks clean and consistent which is extremely important in this area. I read the rest of the patch and didn't spot anything suspicious but I'm a bit out of my depth there.

I realised the tests Markus wrote no longer test the right thing after all my changes, so I've rewritten them and added a test to AppsTests to verify Apps.lazy_model_operation.

Ok, this is now just waiting for #4122 to be approved. Thanks for your help everyone!

I've just rebased against current master to fix some merge conflicts, and rewritten the commit history to get rid of the junk: https://github.com/AlexHill/django/tree/lazy_ops_rebase
I'm keen to get this in so it doesn't stagnate further – if there's anything more I can do to help the process along please let me know!

Jenkins says that the tests fail on SQLite. Can you have a look?

@aaugustin the failures under SQLite are fixed by #4122, which I think is good to go as well.

The squashed and rebased changes can be viewed in my lazy_ops_rebase branch, up-to-date as of today. Should I squash the commits in this pull request or open a new one?
Secondly, for all tests to pass this depends on #4122, which has been approved in theory but needs final review.
Paging @akaariai and @carljm having expressed some interest in getting this committed :)

Let's wait for https://github.com/django/django/pull/4241 to merge first as that is a large patch and has some conflicts with this. I think that will happen in a few days.

Thanks for your feedback Tim. I've followed your suggestions.
Don't mind waiting. Anssi mentioned that merging this patch could make his work on the rel stuff easier – is that still the case @akaariai?

This will likely make composite fields and related.py refactor easier later on.

Alright, no need to merge this before #4241 then.

Jenkins really doesn't seem to like some of these push --forced commits. The build is failing on most configurations. I'll try closing and re-opening to re-trigger a build.

OK @timgraham, I've rebased on top of master now that #4241 is in. There are a couple of those git errors in Jenkins but all tests are passing – I think this is good to go.

This seems like it's broken into more commits than needed. Also, none of them reference the ticket.

Ok, I've put the bulk of this into a single commit referring to the ticket.

merged in 720ff740e70e649a97fcf0232fec132569a52c7e and 7a75ed1a4fdf043064f0cce393bb93b698794978, thanks.

Great! Thanks Tim and everyone else who took to the time to review this and offer feedback: @charettes, @MarkusH, @akaariai and particularly @carljm and @aaugustin. The patch that got committed is much, much nicer than what I initially proposed thanks to all of you.


ng2-uploader causing "Duplicate Identifiers" error messages

I'm submitting a ...
[x] bug report
[ ] feature request
[ ] question about the decisions made in the repository

Do you want to request a feature or report a bug?

I would like to report that one of the plugins we are using ng2-uploader was causing "Duplicate Identifiers" error messages for me.

What is the current behavior?

When running npm start or npm run prebuild:prod && npm run build:prod && npm run server:prod (which are the running commands as per documentation), I get many error messages saying Duplicate Identifiers

If the current behavior is a bug, please provide the steps to reproduce and if possible a minimal demo of the problem via
https://plnkr.co or similar (you can use this template as a starting point: http://plnkr.co/edit/tpl:AvJOMERrnz94ekVua0u5).

What is the expected behavior?

The app running as expected

What is the motivation / use case for changing the behavior?

Please tell us about your environment:

Angular version: 2.0.0-rc.4
ng2-admin version: 0.4.0
Browser: [all | Chrome XX | Firefox XX | IE XX | Safari XX | Mobile Chrome XX | Android X.X Web Browser | iOS XX Safari | iOS XX UIWebView | iOS XX WKWebView ]

Other information (e.g. detailed explanation, stacktraces, related issues, suggestions how to fix, links for us to have context, eg. stackoverflow, gitter, etc)

This problem was already identified on THIS ISSUE

Hey guys, this is fixed in the https://github.com/akveo/ng2-admin/tree/v0.4.2 release, check out the changelog on how to update https://github.com/akveo/ng2-admin/blob/master/CHANGELOG.md#042-2016-07-28.


Added example to store large streaming uploads directly to filesystem using async server.

Added example to store large streaming uploads directly to filesystem using async server.
This PR is the same as GH-468 which I was not able to finish off in time.
Please let me know if the patch looks fine.

LGTM
Since this is only an example, I don't think we need to review too much of this. I suspect we can iterate further later if we care about performance of the examples. :)


speeding up sdxl and fixes

Summary: removing epilogue fusion significantly speeds up dynamic
quantization, we get ~10% speedup. Also converted conv_1x1 to linear
which added a small boost and coordinate descent tuning in all
directions. See collated_results_peft.csv for details on each technique.
since weight-only int8 quantization is the only type of
quantization that accumulates in the native dtype, when you do the
initial matmul before the rescale, you can easily overflow. Using bf16
or fp32 fixes it. scripts altered to use bf16 instead of fp16, I don't
see a significant speed difference between them.
also added tags and enabled other types of quantization.
Test Plan: sh run.sh
Reviewers:
Subscribers:
Tasks:
Tags:
Tasks:
Tags:

nit: Don't commit the .pyc files :)

Thanks for your PR, @HDCharles. I am away and will be back tomorrow.
Let me know when it's ready for a review.

Thanks for your PR, @HDCharles. I am away and will be back tomorrow.
Let me know when it's ready for a review.

its ready, though not necessarily for merge, let me know your thoughts

results of my experiments, i started at the bottom, largely ignored the other techniques due to lack of kernels for these shapes and gradually altered settings based on the tags. Final result is around 10% speedup.

pipeline_cls
ckpt_id
bf16
sdpa
fused_qkv_projections
upcast_vae
batch_size
num_inference_steps
compile_unet
compile_vae
compile_mode
change_comp_config
do_quant
time (secs)
memory (gbs)
actual_gpu_memory (gbs)
tag

StableDiffusionXLPipeline
stabilityai/stable-diffusion-xl-base-1.0
True
True
True
False
1
30
True
True
max-autotune
True

2.775
9.779
79.154
conv->linear

StableDiffusionXLPipeline
stabilityai/stable-diffusion-xl-base-1.0
True
True
True
False
1
30
True
True
max-autotune
True

2.751
9.540
79.154
noepi

StableDiffusionXLPipeline
stabilityai/stable-diffusion-xl-base-1.0
True
True
True
False
1
30
True
True
max-autotune
True

2.794
10.530
79.154
epi

StableDiffusionXLPipeline
stabilityai/stable-diffusion-xl-base-1.0
True
True
True
False
1
30
True
True
max-autotune
True

2.756
10.529
79.154
all_dir_fullgraph_new_api

StableDiffusionXLPipeline
stabilityai/stable-diffusion-xl-base-1.0
True
True
True
False
1
30
True
True
max-autotune
True
int8dynamic
2.489
7.839
79.154
conv->linear select

StableDiffusionXLPipeline
stabilityai/stable-diffusion-xl-base-1.0
True
True
True
False
1
30
True
True
max-autotune
True
int8dynamic
2.542
7.842
79.154
conv->linear

StableDiffusionXLPipeline
stabilityai/stable-diffusion-xl-base-1.0
True
True
True
False
1
30
True
True
max-autotune
True
int8dynamic
2.512
7.887
79.154
all_dir_fullgraph_new_api

StableDiffusionXLPipeline
stabilityai/stable-diffusion-xl-base-1.0
True
True
True
False
1
30
True
True
max-autotune
True
int8dynamic
2.513
7.879
79.154
noepi

StableDiffusionXLPipeline
stabilityai/stable-diffusion-xl-base-1.0
True
True
True
False
1
30
True
True
max-autotune
True
int8dynamic
2.639
7.879
79.154
epi

StableDiffusionXLPipeline
stabilityai/stable-diffusion-xl-base-1.0
True
True
True
False
1
30
True
True
max-autotune
True
int8weightonly
3.084
7.838
79.154
noepi

StableDiffusionXLPipeline
stabilityai/stable-diffusion-xl-base-1.0
True
True
True
False
1
30
True
True
max-autotune
True
int4weightonly
22.832
7.907
79.154
noepi

Looks pretty good to me. I am happy to merge it without the CSV file. I will also run a benchmark on our 400W A100 (with clock set). Let me know.


Impossible to pin version (and install afterwards) via "tools.go trick"

We'd like to pin all our development tooling via the standard tools.go trick.
Unfortunately cmd/atlas seems to be deliberately set up to disallow pinning its
version via go get<EMAIL_ADDRESS>installing it afterwards
via go install ariga.io/atlas/cmd/atlas. This is a major inconvenience for us
without any obvious underlying technical reason.
Could you just allow this normal and standard way of installing a tagged and
thus released version? We understand that you would like to have us download
your prepacked release via https://atlasgo.sh but this requires extra tooling and
extra network connectivity.

Hey @vdobler 👋
Thank you for your feedback. However, we no longer maintain the cmd/atlas package as an executable - mainly for technical and time reasons. Atlas is used by various programming languages, like Python and Java, and the binary we distribute includes additional capabilities.

This is a major inconvenience for us without any obvious underlying technical reason.

Our cmd/atlas package uses replace to avoid adding all cmd/atlas dependencies for projects that use the root package - ariga.io/atlas (e.g., entgo.io). There's no way to go get such packages - we previously used go.work for this purpose, but it introduced different pains, and I decided to remove it.


Cannot search for Debug Console when using ctrl+p

Here are the suggestions given when you press ctrl+p

Here are the suggestions once you start typing Debug

As you can the suggestion for the Debug Console goes away once you start typing for it.

Right, I think in the editor history once you type we ignore anything that does not seem to be a file.

Closing, you can search for these editors in the new "Show All Editors" picker.


Selectable components rtl issue

all selectable components like listview, select, treeview ... have rtl issue
but Treeview does not show any bullet

version : 2.2.2
dotnet : 8

I'm working on the TreeView issue. For the Select/Listbox/Combobox, this is an issue in the underlying Web Components. I raised an issue in the FAST repo to track that (https://github.com/microsoft/fast/issues/6727)

FluentTreeView/RTL is fixed in the demo environment. There is no change to the FluentTreeView component itself needed. 2 things need to be done to make this work correctly:

You need to use and call the Direction design token. See SwitchDirection() in DemoMainLayout.razor.cs)
You need to set the style on the container the components are in through JS interop. Could be <body> tag or any other <div>. In case of the demo site the is a <div> with an id="container". See switchDirection() in DemoMainLayout.razor.js


Chunking option for converter from netCDF to tileDB

Adding the option to do the converting operation chunk-wise to avoid a MemoryError. Something like creating the tdb array and then doing the writing of the data piece-wise.

Hi @eggio, this feature has come up a few times now,and will be implemented soon. The current design plan is to add a parameter directly into the converter (just like the tile size, compression filters, etc.) for the chunk size and/or maximum TileDB fragment size when copying NetCDF data.

Hi @eggio this feature is being implemented in PR #96 and will be included in the next release.


SVGOverlay does not respect className option

Steps to reproduce
Steps to reproduce the behavior:
Modify the SVGOverlay example in the docs to specify a class:
L.svgOverlay(svgElement, svgElementBounds, {className: 'myClass'}).addTo(map);
Expected behavior
SVG element will include the class myClass
Current behavior
SVG element class attribute is only class="leaflet-image-layer leaflet-zoom-animated"
Environment

Leaflet version: 1.5.1
Browser (with version): Safari 12.1.1, Chrome 74.0.3729.157
OS/Platform (with version): macOS 10.13.6

Minimal example reproducing the issue
I'm new to Plunker, but perhaps this link works? https://embed.plnkr.co/XhNXdVoUypvgXHieGi56/

Nice catch, this seems like an overlook from when VideoOverlay was added.


Spring Boot warning for com.ulisesbocchio.jasyptspringboot.configuration.EncryptablePropertyResolverConfiguration

Spring Boot version: 1.5.1.RELEASE
jasypt-spring-boot-starter version: 1.11
We see this warning every-time we run the application, although it does not affect the functionality. May be you can investigate the cause and fix it.
WARN  o.s.c.a.ConfigurationClassPostProcessor - Cannot enhance @Configuration bean definition 'beanNamePlaceholderRegistryPostProcessor' since its singleton instance has been created too early. The typical cause is a non-static @Bean method with a BeanDefinitionRegistryPostProcessor return type: Consider declaring such methods as 'static'.

It's been around for a while. If you look at EncryptablePropertyResolverConfiguration.beanNamePlaceholderRegistryPostProcessor it is a static @Bean declaration, so it seems like the warning is incorrectly logged. The warning states that be bean definition should be static and in fact it is since it needs to be static because it's a BeanDefinitionRegistryPostProcessor that needs to be picked up as early as possible in the bootstrap process.
You can turn off the warning by adding this to your configuration:
logging.level:
  org.springframework.context.annotation.ConfigurationClassPostProcessor: off

@ulisesbocchio
Thanks for clarification.


HALON-225: Store vector of failed devices to preserve failure order.

Created by: qnikst

Closing as an obsolete


Is it possible to run postal from a console app?

i'm trying to use Postal from within NServiceBus console app but i'm getting an httpCapabilities cannot be null error.
does anyone know why?

Have you followed the example here: http://aboutcode.net/postal/outside-aspnet.html ?

Yep, got the same problem, allthough it is only when you use dynamic Email.
If you use the stronly typed model, and call SendEmail(model) then it works.
Unfortunatly I really needed the dynamic method:-(
So great if it could be fixed!
BT Peter


[1.5.0] add foreach docs

Signed-off-by: Jim Bugwadia<EMAIL_ADDRESS>Fixes: https://github.com/kyverno/website/issues/313

I created a PR: https://github.com/kyverno/website/pull/341.


docs: 📚 fix overlap parameter description in dataset classes

修复描述

Many thanks!

@all-contributors please add @Reborn14 for doc.


 Do you have any example? thanks

At the moment we don't support this feature, unfortunately there aren't any plans to add it in the near future.


Implement SIOPv2 Support

Description
Implement the SIOPv2 protocol into the Agent. Similarly to the OpenID4VCI implementation, the agent must have a method to generating an auth_request that can be displayed by the "Front-end" (of the implementer) as a QR-code. Further SIOPv2 interactions must be exposed via proxies. Lastly, the SIOPv2 flow must notify the results as an "event" towards the "Back-end" (of the implementer). This result must at least include the identity of the user that logged in.
Feel free to add missing information or ideas to this issue.
Motivation
Add to SSI capabilities by supporting decentralized login with DIDs.
Resources
No response
To-do List

[ ] Implement SIOPv2
[ ] Implement result Event
[ ] Test

Some additional context based on internal discussions:


vuex model bound checkboxes not validated by validateAll in webpack

Versions

vee-validate: 2.0.8
vue: 2.9.3
vuetify: 1.0.4
vue-cli: 2.x webpack

Describe the bug
I use the following markup (vuetify checkbox) to make my checkboxes required.
If mycomputed would be part of data everything would work, but since I use vuex
mycomputed is part of computed.
The bug only happens when using webpack vue-cli 2.
<v-checkbox v-validate="'required'"
                      v-model="mycomputed"
                      :error-messages="errors.collect('mycomputed')
                      data-vv-name="mycomputed"
                      name="mycomputed"
                      type="checkbox"
                      label="Yes"
                      value="Y" />
<v-checkbox v-validate="'required'"
                      v-model="mycomputed"
                      :error-messages="errors.collect('mycomputed')
                      data-vv-name="mycomputed"
                      name="mycomputed"
                      type="checkbox"
                      label="No"
                      value="N" />

Bug 1: check Yes, uncheck Yes -> validation errors occur, check No - validation errors don't go away.
Bug 2: Reload page, nothing is checked, call validateAll -> validation succeeds (this happens because the Value="Y/N" is validated instead of the v-model)
** HotFix **
The following function is used inside vee-validate to check if the supplied v-model path is valid,
var hasPath = function (path, target) {
    var obj = target;
    return path.split('.').every(function (prop) {
        if (!Object.prototype.hasOwnProperty.call(obj, prop)) {
            return false;
        }
        obj = obj[prop];
        return true;
    });
};

but .hasOwnProperty returns false for all computed properties.
when replacing the questionable line of code with
if (!(obj[prop] || obj[prop] === null || obj[prop] == 0 || obj[prop] == ""  )) {

everything works fine. Also this codereplacement worked:
if (!(prop in obj)) {
I don't know if this has any sideeffects?
To Reproduce (edited)
Setting up an minimal project   and replace two files
> vue init vuetifyjs/webpack vue-testcomputed
> cd vue-testcomputed
> npm install --save-dev vee-validate

App.vue
<template>
  <v-app>
    <form>
      <v-checkbox v-validate="'required'"
                  v-model="mycomputed"
                  :error-messages="errors.collect('mycomputed')"
                  value="Y"
                  label="Yes"
                  data-vv-name="mycomputed"
                  type="checkbox"
                  required></v-checkbox>
      <v-checkbox v-validate="'required'"
                  v-model="mycomputed"
                  :error-messages="errors.collect('mycomputed')"
                  value="N"
                  label="No"
                  data-vv-name="mycomputed"
                  type="checkbox"
                  required></v-checkbox>

         <v-checkbox v-validate="'required'"
                  v-model="mylocaldata"
                  :error-messages="errors.collect('mylocaldata')"
                  value="1"
                  label="I like working validation :)"
                  data-vv-name="mylocaldata"
                  type="checkbox"
                  required></v-checkbox>

      <v-btn @click="submit">submit</v-btn>
      <v-btn @click="clear">clear</v-btn>
    </form>
  </v-app>
</template>

<script>
export default {
  computed: {
    mycomputed: {get(){return this.mycomputeddata}, set(val){this.mycomputeddata = val}}
  },

  data: () => ({
    mycomputeddata: '',
    mylocaldata: ''  }),

  methods: {
    submit () {
      this.$validator.validateAll()
    },
    clear () {

      this.mycomputed = null
      this.$validator.reset()
    }
  },
  name: "App"
};
</script>

main.js
import Vue from 'vue'
import App from './App'
import Vuetify from 'vuetify'
import 'vuetify/dist/vuetify.min.css'
import VeeValidate from 'vee-validate';

Vue.use(VeeValidate)
Vue.use(Vuetify)

new Vue({
  el: '#app',
  components: { App },
  template: '<App/>'
})

Expected behavior
using computed properties in v-model should behave the same way as using data
Demo Link
This demo shows, that the bug does not apear outside webpack
https://codepen.io/lindwurm/pen/qYYMpa?editors=1010
Reasoning
(as far as I understand ):in the codepen scenario template compilition will occur in the browser, while in the webpack scenario template compilation happens inside webpack. But data() is a function and will always be called in the browser, while computed: is an object (containing functions) and will be prepared by webpack and inherited down to the component in the browser.

duplicate of #1310

fixed by https://github.com/baianat/vee-validate/commit/1c28c012b048814e549bb6efc0262565cc3ea820


Replace the current use of requests with something that is faster and more modern...

I vote for httpx, since it supports async but was also intentionally designed to be similar to requests. It should make swapping it in much more straightforward, while also allowing us to begin implementing async http operations using the same library.


fix: Add AddNewKnowledgeBaseCompleted telemetry event to create KB from scratch

Description
When the user creates a new Knowledge Base from scratch, we should log a AddNewKnowledgeBaseCompleted event.
Task Item
#minor

Coverage increased (+0.01%) to 55.156% when pulling b4007d518bd4035d1575b2e4d7e660e22dd82491 on tdurnford:fix/kb-telemetry into ea04f990e0b675b8ce35f315d5a6c1d6264ae525 on microsoft:main.


升级accelerate后运行demo报错

尝试运行hugging face上的demo，提示需要升级accelerate>=0.26.0，但升级后再次运行demo会报错：
Traceback (most recent call last):
File "/usr/local/app/.local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1659, in _get_module
return importlib.import_module("." + module_name, self.name)
File "/usr/lib64/python3.10/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1050, in _gcd_import
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "/usr/local/app/.local/lib/python3.10/site-packages/transformers/generation/utils.py", line 42, in
from ..integrations.deepspeed import is_deepspeed_zero3_enabled
File "/usr/local/app/.local/lib/python3.10/site-packages/transformers/integrations/deepspeed.py", line 52, in
from accelerate.utils.deepspeed import HfDeepSpeedConfig as DeepSpeedConfig
File "/usr/local/app/.local/lib/python3.10/site-packages/accelerate/init.py", line 3, in
from .accelerator import Accelerator
File "/usr/local/app/.local/lib/python3.10/site-packages/accelerate/accelerator.py", line 35, in
from .checkpointing import load_accelerator_state, load_custom_state, save_accelerator_state, save_custom_state
File "/usr/local/app/.local/lib/python3.10/site-packages/accelerate/checkpointing.py", line 24, in
from .utils import (
File "/usr/local/app/.local/lib/python3.10/site-packages/accelerate/utils/init.py", line 153, in
from .launch import (
File "/usr/local/app/.local/lib/python3.10/site-packages/accelerate/utils/launch.py", line 33, in
from ..utils.other import is_port_in_use, merge_dicts
File "/usr/local/app/.local/lib/python3.10/site-packages/accelerate/utils/other.py", line 36, in
from .transformer_engine import convert_model
File "/usr/local/app/.local/lib/python3.10/site-packages/accelerate/utils/transformer_engine.py", line 21, in
import transformer_engine.pytorch as te
File "/usr/local/lib64/python3.10/site-packages/transformer_engine/pytorch/init.py", line 6, in
from .module import LayerNormLinear
File "/usr/local/lib64/python3.10/site-packages/transformer_engine/pytorch/module/init.py", line 6, in
from .layernorm_linear import LayerNormLinear
File "/usr/local/lib64/python3.10/site-packages/transformer_engine/pytorch/module/layernorm_linear.py", line 15, in
from .. import cpp_extensions as tex
File "/usr/local/lib64/python3.10/site-packages/transformer_engine/pytorch/cpp_extensions/init.py", line 6, in
from transformer_engine_extensions import *
ImportError: /usr/local/lib64/python3.10/site-packages/transformer_engine_extensions.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN2at4_ops5zeros4callEN3c108ArrayRefINS2_6SymIntEEENS2_8optionalINS2_10ScalarTypeEEENS6_INS2_6LayoutEEENS6_INS2_6DeviceEEENS6_IbEE
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/app/.local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1659, in _get_module
return importlib.import_module("." + module_name, self.name)
File "/usr/lib64/python3.10/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1050, in _gcd_import
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "/usr/local/app/.local/lib/python3.10/site-packages/transformers/models/qwen2_vl/modeling_qwen2_vl.py", line 41, in
from ...modeling_utils import PreTrainedModel
File "/usr/local/app/.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 46, in
from .generation import GenerationConfig, GenerationMixin
File "", line 1075, in _handle_fromlist
File "/usr/local/app/.local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1649, in getattr
module = self._get_module(self._class_to_module[name])
File "/usr/local/app/.local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1661, in _get_module
raise RuntimeError(
RuntimeError: Failed to import transformers.generation.utils because of the following error (look up to see its traceback):
/usr/local/lib64/python3.10/site-packages/transformer_engine_extensions.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN2at4_ops5zeros4callEN3c108ArrayRefINS2_6SymIntEEENS2_8optionalINS2_10ScalarTypeEEENS6_INS2_6LayoutEEENS6_INS2_6DeviceEEENS6_IbEE
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/app/aigc/model_repo/test.py", line 2, in
from transformers import AutoProcessor, Qwen2VLForConditionalGeneration
File "", line 1075, in _handle_fromlist
File "/usr/local/app/.local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1650, in getattr
value = getattr(module, name)
File "/usr/local/app/.local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1649, in getattr
module = self._get_module(self._class_to_module[name])
File "/usr/local/app/.local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1661, in _get_module
raise RuntimeError(
RuntimeError: Failed to import transformers.models.qwen2_vl.modeling_qwen2_vl because of the following error (look up to see its traceback):
Failed to import transformers.generation.utils because of the following error (look up to see its traceback):
/usr/local/lib64/python3.10/site-packages/transformer_engine_extensions.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN2at4_ops5zeros4callEN3c108ArrayRefINS2_6SymIntEEENS2_8optionalINS2_10ScalarTypeEEENS6_INS2_6LayoutEEENS6_INS2_6DeviceEEENS6_IbEE

pip uninstall flash-attn，或者更新flash-attn

pip uninstall flash-attn，或者更新flash-attn

上述报错的时候，已按照requirements将flash-attn更新至2.6.1。
我尝试将flash-attn升级至最新版的2.6.3或者pip uninstall flash-attn都没有效果，还是会出现上述报错。
将accelerate降级至0.25.0之后，就不会出现上述的报错了，但是在加载模型的时候没法使用device_map等参数


Try to parse text/plain with N3Parser.

Unfortunately, the Internet media type of N-Triples is text/plain. My suggestion is to let the N3Parser try to parse the file, and fail if it is not an RDF file.

Project is dead.


[2.0.0-beta1] setState{} is invoked multiple times in unit tests executed with MvRxTestRule

MvRx: 2.0.0-beta1
Kotlin: 1.4.10
When running unit tests for a MavericksViewModel I noticed that setState{} is called multiple times due to MvRxTestRule initializing MockableMavericks which in turn means the MockableMavericksStateStore is used, which in turn invokes the stateReducer() immediately and then passes it to two other StateStores that then also invoke the reducer.
Given a method like the following in the ViewModel:
   fun login() = withState {state ->
        if (state.loginAsync is Loading) {
            return@withState
        }

        suspend { authRepository.loginUser(email = state.email!!, password = state.password!!) }
            .execute(ioDispatcher) { loginAsync ->
                if (loginAsync is Success) {
                    viewModelScope.launch {
                        sideEffect.onLogin(loginAsync())
                    }
                }

                copy(loginAsync = loginAsync)
            }
    }

it is impossible to verify the sideEffect function was called one time, because it will be called three times due to the reducer being invoked three times.

yes, this is an undocumented change in how reducers work in tests. However, there is a core mvrx principle that reducer functions should not have any side effects. While we could maybe redesign the testing/mocking infra to avoid invoking the reducer multiple times I don't think it is good to encourage reducers with side effects.
Instead the general recommendation would be to subscribe to the loginAsync property, or you could have your test verify at least one or more interactions instead of just one

I agree, for some reason it never occured to me, that you can also subscribe to properties within the ViewModel itself and not just from fragments 🤦 . Thanks for your help!

if someone needs to have code that only is called once...for example we had analytics that got called too many times in tests run this after your test rule init
Mavericks.initialize(
                false,
                MyMavericksViewModelConfigFactory())

class MyMavericksViewModelConfigFactory: MavericksViewModelConfigFactory(debugMode = false){

    override fun <S : MavericksState> buildConfig(
            viewModel: MavericksViewModel<S>,
            initialState: S
    ): MavericksViewModelConfig<S> {
        val scope = coroutineScope()
        return object: MavericksViewModelConfig<S>(debugMode, SynchronousMavericksStateStore(initialState, scope), scope) {
            override fun <S : MavericksState> onExecute(viewModel: MavericksViewModel<S>): BlockExecutions {
                return BlockExecutions.Completely
            }
        }
    }
}```


Change groupId to com.azure and artifactId to azure-spring-cloud-starter-xxx

Change groupId to com.azure and artifactId to azure-spring-cloud-starter-xxx  #13523

@saragluna thanks,I have modified it according to your suggestion

Update the above comments

/azp run java - spring - tests

/check-enforcer override


widen range of miragejs to allow the 0.2 alpha

this library works with 0.2, but we get a peer error.
working with 0.2 is important, because it support MSW via https://github.com/miragejs/mirage-msw/tree/main
and MSW is a far superior debugging and logging experience than pretender.

Currently it is "miragejs": "^0.1.47".  Should it be "miragejs": "^0.1.47 || ^0.2.0" or does alpha need to be in there somewhere?

we could try >= for 0.1.47?

Figured there had to be an online checker
https://jubianchi.github.io/semver-check/#/>%3D 0.1.47/0.2.0-alpha.3

yay

Released in 0.3.2

oh something interesting -- npm is more strict than expected
npm error node_modules/miragejs
npm error   dev<EMAIL_ADDRESS>from the root project
npm error
npm error Could not resolve dependency:
npm error peer miragejs@">= 0.1.47" from<EMAIL_ADDRESS>npm error node_modules/ember-mirage
npm error   dev<EMAIL_ADDRESS>from the root project
npm error

it doesn't consider  alphas to satisfy >=, contrary to that test link

Did it pick up the change as the error is peer miragejs@">= 0.1.47" from<EMAIL_ADDRESS>I would have expected it to say peer miragejs@">= 0.1.47 || >= 0.2.0-alpha.3" from<EMAIL_ADDRESS>or it it ignoring the OR altogether?

it's now fixed with ember-mirage 0.3.3, where the peer is specified as >= 0.1 || >= 0.2.0-alpha.3


ES Module support

Hi there, first of all, thanks for this package! Really helpful.
The import fails when using the ES Module imports:
TypeError [ERR_UNKNOWN_FILE_EXTENSION]: Unknown file extension ".json" for /node_modules/top-user-agents/index.json

Would you consider switching the file to JavaScript until JSON + ESM stabilizes in Node?
Workarounds
Use createRequire:
import { createRequire } from "module";
const require = createRequire(import.meta.url);
const testers_developers = require("path/to/json/your-json-file.json")

Or use the --experimental-json-modules flag for Node.
Source: https://stackoverflow.com/questions/60205891/import-json-extension-in-es6-node-js-throws-an-error

Would you consider switching the file to JavaScript until ESM stabilizes in Node?

just module.exports = require('./my.json') could be enought to fix the issue?
BTW, PR are welcome 🙂

just module.exports = require('./my.json') could be enought to fix the issue?

Yep, seems to work! Opened #6 for this (also added TS types and a Prettier config)

Thanks! shipped at v1.0.21


Update zio-logging to 2.2.4

About this PR
📦 Updates dev.zio:zio-logging from 2.1.17 to 2.2.4
📜 GitHub Release Notes - Version Diff
Usage
✅ Please merge!
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

⚙ Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "dev.zio", artifactId = "zio-logging" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "30 days" },
  dependency = { groupId = "dev.zio", artifactId = "zio-logging" }
}]

labels: library-update, early-semver-minor, semver-spec-minor, commit-count:1

Superseded by #552.


Allow backend builds without emitting types

The backend:build command by default, sets Output.types when calling buildPackage.
For backend Node JS builds, especially when building for production, types are superfluous as the
code is transpiled to Javascript and types are erased.
Despite types being not used, this lack of flexibility makes it necessary to emit types, that adds
a lot of accidental complexity.
Optionally disable emitting types if a --no-types flag is passed (false by default)
Hey, I just made a Pull Request!

:heavy_check_mark: Checklist

[ ] A changeset describing the change and affected packages. (more info)
[ ] Added or updated documentation
[ ] Tests for new functionality and regression tests for bug fixes
[ ] Screenshots attached (for UI changes)
[ ] All your commits have a Signed-off-by line in the message. (more info)

I created this Pull request with a corresponding issue, as the changes seemed trivial.
If this change needs additional documentation and you think this will be a useful addition, please let me know, I shall update the documentation and also add in a changeset.

Types are there by default for backend packages that are published, and don't hurt much for packages that aren't. Is there some specific reason you want to build without the types?
There's also the backstage-cli build command, which you can use to build a package with custom outputs, which I'd otherwise recommend that you use instead.

Our backend packages are not published and we do the type-checking in a separate step across the entire codebase. We therefore do not feel the need to couple them (emitting types + emitting code).
But yes, I guess I can use backstage-cli build to emit only code without the types.
Closing this issue therefore.


#138 Added basic handling of proposal operation

General
Closes #138
Added correct handling of fee calculation for Proposal create in SendModal
General
Please make sure the following is done:

Pull request is onto develop
If you haven't already, have a look at

https://github.com/bitshares/bitshares-ui/blob/develop/CODE_OF_CONDUCT.md
https://github.com/bitshares/bitshares-ui/blob/develop/CONTRIBUTING.md

Code Preparation
Please review all your changes one last time before committing

[x] Check for unused code
[x] No unrelated changes are included
[x] None of the changed files are reformatting only
[x] Code is self explanatory or documented
[x] All written text is properly translated (english language)

Testing
The branch has been tested on the following browsers (desktop and mobile view)

[x] Chrome
[ ] Opera
[x] Firefox
[ ] Safari

User interface changes
Delete this section if there weren't any UI changes. Please make sure you tested your changes in all themes

[ ] Dark
[ ] Light
[ ] Midnight

Please provide screenshots/licecap of your changes below

Not working as intended. Switching does not update fee

Will check myself because SendModal is being refactored a bit as we speak

Solution not appropriate, closing.


ASync Gem Instrumentation Spike

At Rubyconf, it was discussed that the Async gem has been invited to ruby core, and will likely be included in 3.1 or 3.2. We should investigate this gem and how we may instrument it in the future.
Some questions to consider as part of the spike:

How many customers are using async?
How similar or different do things seem to be to the concurrent_ruby gem?
What parts of async could be hooked into by the agent?
What seems like the most valuable information to gather?
What work would likely need to be completed in the agent design (for multithreaded) to support instrumentation for this gem?

To share state between fibers, would it help to use thread-local instead of fiber-local variables (thread_variable_get, thread_variable_set)? That would mean fibers have access to the same state.

Thanks, @bhasto, that's a great idea. We use that strategy in some key places of the agent where atomicity is important and it could very well help out here as well.
We're super interested in better instrumentation of Fiber itself and the idea could help there as well.
As for async as a topic in general, we've looked at version 2 of the Async gem, Ruby 3's fiber scheduler interface, and the concurrent-ruby gem as good candidates for instrumentation. If you have any preferences there, we welcome all community members to speak up and share what they'd like to see the agent handle. It really helps us prioritize our roadmap.

Hi @fallwith. Our current use case is using the Async gem for concurrent I/O (as an alternative to threads). We’re running into similar problems with the agent that multi-threaded code usually suffers from – not seeing the correct segments in APM, method tracers don’t work etc. Solving these would be the biggest improvement for us (having some data about fiber scheduler internals and similar would be nice too but not that important for us currently).

Thank you, @bhasto. I have relayed this information to our leadership team. Also, if you happen to have a support contract with New Relic, you can optionally use that as an avenue for putting forward any preferences for what we go after next - either by filing the not seeing of the correct segments as a bug, or the development of better Async specific or multi-threaded generic support as a feature request.

Spike completed
milestone doc


Error while running train.py from speech commands in tensorflow examples. AttributeError: type object 'NDFrame' has no attribute 'groupby'

Have the following error:
  File "train.py", line 27, in <module>     from callbacks import ConfusionMatrixCallback   File "/home/tesseract/ayush_workspace/NLP/WakeWord/tensorflow_trainer/ml/callbacks.py", line 21, in <module>     from pandas_ml import ConfusionMatrix   File "/home/tesseract/anaconda3/envs/ciao/lib/python3.6/site-packages/pandas_ml/__init__.py", line 3, in <module>     from pandas_ml.core import ModelFrame, ModelSeries       # noqa   File "/home/tesseract/anaconda3/envs/ciao/lib/python3.6/site-packages/pandas_ml/core/__init__.py", line 3, in <module>     from pandas_ml.core.frame import ModelFrame       # noqa   File "/home/tesseract/anaconda3/envs/ciao/lib/python3.6/site-packages/pandas_ml/core/frame.py", line 18, in <module>     from pandas_ml.core.series import ModelSeries   File "/home/tesseract/anaconda3/envs/ciao/lib/python3.6/site-packages/pandas_ml/core/series.py", line 11, in <module>     class ModelSeries(ModelTransformer, pd.Series):   File "/home/tesseract/anaconda3/envs/ciao/lib/python3.6/site-packages/pandas_ml/core/series.py", line 80, in ModelSeries     @Appender(pd.core.generic.NDFrame.groupby.__doc__) AttributeError: type object 'NDFrame' has no attribute 'groupby'
Happening with both version  5 and 6.1

I am having same problem

reinstall pandas version to 0.24.2 solves the problem

In File "C:\Users\Ben\python-code\test\venv\lib\site-packages\pandas_ml\core\series.py", line 80, in ModelSeries
Could it help to change : @Appender(pd.core.generic.NDFrame.groupby.doc)
to : @Appender(pd.core.groupby.groupby.doc)


[Regression] ListBoxItems and children no longer reliably generate Tapped events from Touch input.

Describe the bug
ListBoxItems or their children (with the exception of Buttons at least) no longer generate Tapped events or trigger Tapped event handlers when the input comes from a touch device.  Mouse clicks still generate Tapped events as expected.  Both generate DoubleTapped events.
To Reproduce
Steps to reproduce the behavior:

Clone https://github.com/IanRawley/ListBoxItemTappedInteractions.git and build as is.
Run on a touch enabled device, and see that tapping either the Buttons or Border/Textblocks increment the appropriate counter.
Update solution to Avalonia 11.0.5 and rebuild.
Tapping the Border/Textblocks no longer increments the appropriate counter.  Buttons are unaffected.  Using a mouse to click the Border/Textblocks will increment the counter though.

Expected behavior
Both mouse input and touch input generate Tapped events.
Environment

OS: Windows 11 / Android.
Avalonia-Version: 11.0.4 - OK / 11.0.5 - Broken.

Additional context
Looking through the list of commits from Avalonia 11.0.4 to 11.0.5 the only one that seems potentially relevant is  #12666,
although I don't know nearly enough about the whole GestureRecognizer system to comment with any certainty.
Using a Surface Go 4 to check has been a boon, as the use of DevTools has allowed me to confirm that nowhere within the bounds of a ListBoxItem is generating Tapped events from touch input, with the exception of the bounds of the Button.

Looking at it some more after the weekend, the problem seems to be that while PointerPressed events have their source set to the appropriate Textblock/Border/etc control, corresponding PointerReleased events have their source set to the ListBox.  As they don't match, no Tapped events are generated.  DoubleTapped is generated on PointerPressed, so there's no issue.    I'm going to try and figure out why Touch pointers are creating PointerReleased events with unexpected sources.

The PointerReleasedEventArgs are initially getting created with the correct source, but ListBoxItem is doing the following in its own OnPointerReleased():
// As we only update selection from touch/pen on pointer release, we need to raise
// the pointer event on the owner to trigger a commit.
if (e.Pointer.Type != PointerType.Mouse)
       owner.RaiseEvent(e);

Calling owner.RaiseEvent(e) causes the source of the event to be overwritten with owner, in this case the ListBox, which results in Tapped event generation breaking because the PointerPressed and PointerReleased events now have different sources.

So I'm looking into this more and trying to prep a PR, because this is a pretty big problem I feel, and I'm a bit confused about some of the Unit Test helpers.  Specifically the TouchTestHelper.  The TouchTestHelper raises the various pointer events with no mouse button, which makes sense given we're taking about touch, but in the wild the real events are LeftMouseButton related.  TouchDevice seems to, by default, make Pointer event args with LeftMouseButton pressed.  Tapped events are also only generated if there is a Left or Right mouse button pressed.
Does this mean I shouldn't be using the TouchTestHelper, because it doesn't reflect real life use cases, or that TouchTestHelper should be changed to assume a Left mouse button touch unless otherwise specified?

@emmauss do you have any hints?

My proposed fix is essentially rolling back the change made to ListBoxItem as part of the AutoCompleteBox focus fixes.  Looking into every bit I can think of I'm still not sure why the event needs to be raised again, rather than simply bubbling up to the ListBox.  I'd appreciate any insight on that suggestion as well.


russian translation

fixes https://github.com/COVID-19-electronic-health-system/Corona-tracker/issues/308

I had a caching issue where it would sometimes randomly not display the disclaimer text. Curious if you ran into this issue and if so how were you able to solve it? @liadove

@akilhylton I didn't run into this issue. When does it happen? Could you write an issue for it?

Need rebase

Merging for now, can edit and undo any high-ranking changes later


fix(sqllab): per-tab hide left bar

SUMMARY

Currently the state of whether we should show the left bar in SQL Lab is global, not per tab. Since this is configured separately in each tab menu, it makes sense to track the state individually.
This PR moves the state of the left bar to the query editor, using the redux store to toggle its display. If the SQLLAB_BACKEND_PERSISTENCE is enabled the visibility is stored on the backend as well.
BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF

N/A
TEST PLAN

SQLLAB_BACKEND_PERSISTENCE set to off.
Created a few tabs, changed their visibility, verified that visibility is defined per tabs and persists on page refresh.
Turn SQLLAB_BACKEND_PERSISTENCE on, reload SQL Lab, verified that tabs' state was migrated to the backend.
Toggle visibility, verified state is persisted in the backend and loaded correctly on page refresh and tab switch.

ADDITIONAL INFORMATION

[ ] Has associated issue:
[ ] Changes UI
[ ] Requires DB Migration.
[ ] Confirm DB Migration upgrade and downgrade tested.
[ ] Introduces new feature or API
[ ] Removes existing feature or API

Codecov Report

Merging #13288 (79085a8) into master (e8d5035) will increase coverage by 10.43%.
The diff coverage is 72.72%.

@@             Coverage Diff             @@
##           master   #13288       +/-   ##
===========================================
+ Coverage   69.48%   79.91%   +10.43%
===========================================
  Files        1050      298      -752
  Lines       49755    24257    -25498
  Branches     5322        0     -5322
===========================================
- Hits        34571    19386    -15185
+ Misses      15059     4871    -10188
+ Partials      125        0      -125

Flag
Coverage Δ

cypress
?

javascript
?

python
79.91% <72.72%> (+12.54%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

superset/app.py
81.36% <ø> (ø)

superset/views/sql_lab.py
60.68% <ø> (ø)

superset/viz.py
56.32% <0.00%> (-0.16%)
:arrow_down:

superset/db_engine_specs/base.py
79.95% <100.00%> (-6.15%)
:arrow_down:

superset/db_engine_specs/hive.py
90.76% <100.00%> (ø)

superset/db_engine_specs/presto.py
82.47% <100.00%> (-5.41%)
:arrow_down:

superset/models/core.py
85.01% <100.00%> (-3.88%)
:arrow_down:

superset/models/sql_lab.py
91.21% <100.00%> (+0.05%)
:arrow_up:

superset/views/core.py
71.80% <100.00%> (-3.58%)
:arrow_down:

superset/sql_validators/postgres.py
50.00% <0.00%> (-50.00%)
:arrow_down:

... and 760 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a646914...79085a8. Read the comment docs.

@betodealmeida @hughhhh There seems to be a merge conflict in db-migration: https://github.com/apache/superset/runs/2042369464


chore(wmg+compare): return name as ID when no label is found in ontology

Reason for change

We want invalid IDs to not be null and just return the ID instead

Thanks for fixing this!


Documentation on expectsJson lacking

What expects JSON? The client or the server? Since there is a sendsJson, I guess it is the server. Still, the documentation does not explain.

Also, if the JSON could not be parsed, how can one diagnose the problem. Is it possible to get the raw response body in the exception?

Closing since I stopped using this project.


Add qdirstat

adds qdirstat icons from their repo

The PNG version is a bit small. Can you make a new one using the SVG that is 512x512?

The PNG version is a bit small. Can you make a new one using the SVG that is 512x512?

done - didn't notice the size, sorry!


Replace 'ctx' args in driver.go with pachClient

Also, create a new pachrpc library that initializes the pachyderm GRPC
connection, and remove that code from all of our API server
implementations

Closing for staleness.

Closing this for age. Reopen if we can get this to a mergeable state. I think we've done some stuff that supercedes this though.

I agree—once the 1.8 refactor is in (which touched a ton of stuff in PFS) I could take another look, but it's not worth messing with that.


handle  null observabilityaddonspec

also fix the error when listing deprecated roles
https://github.com/open-cluster-management/backlog/issues/10460

Just let you know. the observabilityAddonSpec is required in v1beta2.

/lgtm


Weights of "step0" and "step1" checkpoints are identical for all pythia models

Dear EleutherAI team,
I've noticed that the weights associated with the recently added "step0" and "step1" checkpoints are identical for all pythia models:
def main():
    print(f"========== {sys.argv[1]} ==========")
    model_step0 = GPTNeoXForCausalLM.from_pretrained(sys.argv[1], revision="step0", cache_dir=f"./test")
    model_step1 = GPTNeoXForCausalLM.from_pretrained(sys.argv[1], revision="step1", cache_dir=f"./test")

    for (name0, param0), (name1, param1) in zip(model_step0.named_parameters(), model_step1.named_parameters()):
        print(name0, name1, name0 == name1, torch.all(param0==param1))

This yields something like the following for all eight pythia models:
========== EleutherAI/pythia-70m ==========
gpt_neox.embed_in.weight gpt_neox.embed_in.weight True tensor(True)
gpt_neox.layers.0.input_layernorm.weight gpt_neox.layers.0.input_layernorm.weight True tensor(True)
...
gpt_neox.final_layer_norm.weight gpt_neox.final_layer_norm.weight True tensor(True)
gpt_neox.final_layer_norm.bias gpt_neox.final_layer_norm.bias True tensor(True)
embed_out.weight embed_out.weight True tensor(True)

Would it be possible for you to clarify whether these identical weights correspond to those from "step0" or "step1?" I've noticed that the conditional probabilities calculated using these weights aren't perfectly uniform, which leads me to believe these are actually weights from "step1."
Thanks!
Byung-Doh

@haileyschoelkopf did you end up looking into this?

I have not yet unfortunately, I'll look at this tomorrow and report back!

Looking around the checkpointing code, it looks to me like we should be saving the 0th checkpoint before we do any weight updates. That's the obvious failure mode that could be causing this.

Continuing to investigate, but upon digging in I'm finding that the info reported by Deepspeed's checkpoint metadata for the NeoX-library checkpoints reports that all is ok! For the EleutherAI/pythia-160m model, the step0 checkpoint reports global_samples: 0 and global_steps: 0 while the step1 checkpoint reports global_samples: 1024 and global_steps: 1.
I therefore suspect that this is an artifact of LR warmup starting from 0, causing weights to not yet update on the first step, but am looking into this further. On a scan of a couple parameters in a layer of the 160M model, many (but not all) of the individual floating point parameters printed as the same for step as for step 0, indicating that some parameters will show up as equal to the step 0 checkpoint even after multiple train steps for these super early warmup steps.
I'm therefore pretty confident I did in fact save and upload the correct early checkpoints.
Hope this answers your question @byungdoh !
(Aside:
Note that there was an issue in which "step0" checkpoints in NeoX would be overwritten if a job was resumed by the step being resumed from, but that issue was patched before these models were trained.)


analytics link is broken

analytics link is broken

Closing this as we've moved this content to botframework-sdk repo.