Texture3D import not working when texture has fully opaque and (partly or fully) transparent slices

Tested versions
Reproducible in: 4.2.2 (stable), 4.3 dev6, 4.0, (maybe?) 3.5.3 (stable)
System information
Windows 10 - Godot Engine v4.3.dev6.official.89850d553 - https://godotengine.org OpenGL API 3.3.0 NVIDIA 551.76 - Compatibility - Using Device: NVIDIA - NVIDIA GeForce RTX 3070 Laptop GPU (tested with Forward+, Compatibility and Mobile) - Also tested on a Surface Pro 10
Issue description
Under certain conditions one cannot import Texture3Ds. One suspicion i have is, that on import Godot removes the alpha channel of textures that are fully opaque (which is quite annoying to begin with). Maybe it removes the alpha channel of the slices that are fully opaque and keeps them on the slices that have some transparency, leading to a mismatch in the format of the slices (RGB8 vs RGBA8). I made a few test textures attached to this with several different (but not all thinkable) cases. They are 512 * 512px with 8 * 8 slices. To be sure the files are not corrupted by the graphic software i made the same textures with different programs and the results were the same.
1.png: import as Texture3D working
2.png: import as Texture3D working
3.png: import as Texture3D NOT working
4.png: import as Texture3D working
5.png: import as Texture3D NOT working
6.png: import as Texture3D NOT working
7.png: import as Texture3D working
error message:
Image format mismatch
Attempting to use an uninitialized RID
servers/rendering/renderer_rd/storage_rd/texture_storage.cpp:1416 - Parameter "tex" is null.
Attempting to use an uninitialized RID
servers/rendering/renderer_rd/storage_rd/texture_storage.cpp:1416 - Parameter "tex" is null.
Attempting to use an uninitialized RID
servers/rendering/renderer_rd/storage_rd/texture_storage.cpp:767 - Parameter "t" is null.
Godot 3.5.3 error message before forced restart:
ERROR: Condition "header[0] != 'G' || header[1] != 'D' || header[2] != 'S' || header[3] != 'T'" is true. Returned: ERR_FILE_CORRUPT
at: _load_data (scene/resources/texture.cpp:476)
No error message after forced restart (but not sure if Texture3D was imported correctly.
Steps to reproduce
Start a new project, drag and drop texture into it. Go to import tab, choose Texture3D with 8 by 8 tiles, hit import button.
Minimal reproduction project (MRP)
No minimal reproduction project needed (can be done in new project). Here are the textures:

Hi! I was wondering what do you expect Godot Engine to do here. Can you amend the issue with that?
Like a table of current vs expected results. Saying only "working" is hard for me to interpret.

? ... I expect the engine to be able to import  PNGs as Texture3D even when some slices are fully opaque and others are not scratches his head. Not sure what else i could say about it other then what i already did (including the likely cause for that bug).
Not sure why a table would be needed... current result: on import it throws the already described error messages and i get no Texture3D (only some unusable corrupted texture), expected result: no error message and a useable Texture3D

Thanks.

File Name
Import Status

1.png
Working Texture3D

2.png
Working Texture3D

3.png
Corrupted Texture3D

4.png
Working Texture3D

5.png
Corrupted Texture3D

6.png
Corrupted Texture3D

7.png
Working Texture3D

Can you help me with a better description of each png? I'll try to fill out the table.
Snipped
Currently the output is random in relation to transparency...
Archive.zip
Edited:

Case
Texture Condition
Import Status
Suspected Format

1
All slices are fully opaque (alpha = 1.0)
Successful
RGB8 (Godot removes alpha channel)

2
At least 1 pixel in each slice has alpha < 1.0
Successful
RGBA8

3
Mix of fully opaque and partly/fully transparent slices
Unsuccessful (Error: Image format mismatch)
Opaque slices: RGB8, Transparent slices: RGBA8

The code for this is here. I suspect the error will be in this file. https://github.com/godotengine/godot/blob/b7feebefabc2d48b0d4794cd31fc141f1caecc5c/editor/import/resource_importer_layered_texture.cpp#L164

Here's some untested code.
	bool has_transparency = false;

	for (int i = 0; i < r_texture_import->slices->size(); i++) {
		Ref<Image> slice = r_texture_import->slices->write[i];
		if (slice->detect_alpha() != Image::AlphaMode::ALPHA_NONE) {
			has_transparency = true;
			break;
		}
	}

	if (has_transparency) {
		for (int i = 0; i < r_texture_import->slices->size(); i++) {
			Image::Format current_format = r_texture_import->slices->write[i]->get_format();
			Image::Format new_format;

			switch (current_format) {
				case Image::FORMAT_RGBF:
					new_format = Image::FORMAT_RGBAF;
					break;
				case Image::FORMAT_RGBH:
					new_format = Image::FORMAT_RGBAH;
					break;
				default:
					new_format = current_format;
					break;
			}

			r_texture_import->slices->write[i]->convert(new_format);
		}
	}

Edit:
I have to go for some food, feel free to test or make this into a pr. I'll be back soon.
Edit:
Haven't compiled this yet.
https://github.com/V-Sekai/godot/tree/vsk-3d-texture-alpha-4.3

The failing case I have is USED_CHANNELS_LA which is like two channels should converted to rgba8, rgbaf, or rgbah.

I never worked with the engine code (or compiled the engine myself or made a PR. Would need to read into how to do all that first and not sure when i will have time to do that.) Not even sure what the LA stand for scratches his head am more artist than coder.

I'll post this for review https://github.com/godotengine/godot/pull/92344 but think this fixes it.

Thanks for the help! I appreciate the test cases.

Thank you for the help finding a fix.


Bump version to 0.14.2

I forgot to bump up the version before merging #86, sorry!

Once you've linked to the issue, to better help people (especially those unfamiliar with JS) understand the context of the bug, 💃


Relax CMake directory expectations for elf2cfetbl

Is your feature request related to a problem? Please describe.
See conversation in https://github.com/nasa/cFS/discussions/319

From a dependency / scope standpoint, the cfe_add_tables() function really wants to be defined along with the table tool sources themselves. Then, after finding the table source directory, the cFE CMake infrastructure could import implementations of those cmake functions which are tool-specific. Then cFE and table generation can be decoupled via the cfe_add_tables() interface. In that way, different implementations for cfe_add_tables() can be used depending on the mission config.

Describe the solution you'd like
Create a modifiable CMAKE parameter for the location of elf2cfetbl so users can design custom directory structures
Describe alternatives you've considered
Long-term, let users define custom toolchain compositions using tools other than elf2cfetbl
Additional context
See above

@jphickey here's the issue I wrote

@astrogeco I'm down with having a deeper conversation around how to address this in a scalable way.
What do you think about making the add_cfe_tables() function pluggable? It could be defined by whichever project implements the table tool (e.g. elf2cfetbl or eds2cfetbl), and then the CMake function definition could be include()ed in arch_build.cmake.


Add shadows for characters

Can be implemented by drawing characters in imgg in raycasting.hpp.

#76


Is there a specific reason why die in Relude returns an m () instead of m a like die from System.Exit, which is actually used in the implementation?

@ilyakooo0 There is no particular reason.  I agree that m a is better because it's more consistent with base and more convenient. Would you like to open a PR with the fix?

Sure


Move workflow samples to ../samples/incident-response-app

This is for https://github.com/mattermost/docs/pull/3047


[Merge] Implements payloadId on-the-fly retrieval for post-merge blocks

PR Description

implements payloadId on-the-fly retrieval for post-merge blocks

more precisely set lastForkChoiceStateCorrectlyBuildsOnTop, so we will resolve payloadIdFuture only when we expect non-empty payloadId.

Fixed Issue(s)
#4668
Documentation

[x] I thought about documentation and added the documentation label to this PR if updates are required.

Changelog

[x] I thought about adding a changelog entry, and added one if I deemed necessary.

I'm still relying on lastForkChoiceState if present. I don't know if makes sense.


[missing] Expose Window.createImageBitmap

This popped up in the last Blink IDL roll with 12 overloads.  I hid it for now.  We need to determine what names to expose the different variants under.

I'm not sure what this issue is hoping to achieve, but if it adds support for self.createImageBitmap() - Web APIs | MDN, 👍

This API is still not exposed as of current dev. Is it because it's unsupported in Edge?

CC @teresy @vsmenon – we have a big backlog here. We'd like to do work to cleanup our JS-interop work then we plan to come back to all of the web APIs.
Thanks for your patience.

Will the JS-interop cleanup somehow improve this situation? Or are they orthogonal?

Our current setup for generating Dart APIs over the browser's JS APIs has a number of issues – and it's different than how we let external folks do interop.
We'd like to create a single, better model for both before we spend more time doing one-off fixes to the existing dart:web libraries.

Can you point me toward more info on the planned model?

@jmesserly may have some details to share

https://github.com/dart-lang/sdk/issues/35084 is tracking JS interop improvements, that would allow an interop-based approach to the DOM.

Is it something I can maybe pitch in with?

Any update on this, seems to still be missing.

The kicker here is, I can work around it with package:js's callMethod and promiseToFuture to get an ImageBitmap. But I can't set it as a CanvasImageSource, because ImageBitmap isn't an implementer, even though it certainly should be:
https://api.dart.dev/stable/2.7.0/dart-html/CanvasImageSource-class.html
Right now, I get Expected a value of type 'CanvasImageSource', but got one of type 'ImageBitmap'
Any workarounds?


ModuleWithProviders GenericType

Hi guys,
I run into following issue while updating to angular 10:
ERROR: node_modules/ngx-popper/src/popper.module.d.ts:5:63 - error TS2314: Generic type 'ModuleWithProviders' requires 1 type argument(s).
More info can be found here.
Please let me know if there is something I missed.

@MrFrankel can you merge this?

Can you please merge this PR?.  We ran into this problem while we are upgrading the angular

@zlajson and @prabhakerb I fixed this in my version of the lib...
I upgraded to angular 8 and 9 and also use<EMAIL_ADDRESS>Please checkout https://github.com/tonysamperi/ngx-popperjs


Disable zero initialization of commands by default

For https://github.com/tenstorrent/tt-metal/issues/6428
We've enabled zero initialization of commands by default, with an user opt-out of TT_METAL_ZERO_INIT_DISABLE=1. That makes bringup and debug easier for FD2.
Once it's stable and ready for production, we should flip the switch to default uninitialized for performance and more stress testing
The right way to flip the switch should be turning the following in device_command.cpp into a compile time flag:
bool DeviceCommand::zero_init_disable = tt::parse_env<bool>("TT_METAL_ZERO_INIT_DISABLE", false);

something like the following so at the place of use we can do if constexpr (!zero_init_disable) and it'll have no runtime cost
`ifdef DEBUG
constexpr bool DeviceCommand::zero_init_disable = false;
`else
constexpr bool DeviceCommand::zero_init_disable = true;
`endif

We moved away from using TT_METAL_ZERO_INIT_DISABLE. This doesn't seem relevant anymore


codeunit 8617 "Config. Validate Management" EvaluateTextToFieldRefCodeText procedure limited to 1024 Characters

🕮 Describe the issue
There are 2 text var declared in this procedure. Both of them are set to Text[1024].
I believe, this was not updated after the April 2019 release of Business Central and should be upgrade to Text[2048].
🔧 To Reproduce
Steps to reproduce the behavior:
Using the Configuration Packages, try to import more than 1024 characters into a text field that supports more than 1024 characters.
📣 Expected behavior
A clear and concise description of what you expected to happen.
Screenshots

Additional context
none

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. Please do not reply to this, as we do not monitor closed issues. If you have follow-up questions or requests, please create a new issue where you reference this one.
Build ID: 13658.

Availability update: We will publish a fix for this issue in the next update for release 23.
Build ID to track: 13708.


3D Matrix Support

Hey there, I'm fairly new to Breeze, so this might be implemented already, but I can't find a way to have a 3+ dimensional matrix. For instance, you might be able to create a new DenseMatrix by calling DenseMatrix(((1, 1, 1), (1, 1, 1), (1, 1, 1)), ((2, 2, 2), (2, 2, 2), (2, 2, 2))). If you could implement this, I'm sure many users would benefit from it.

this is probably the single most requested feature in Breeze. I want a
general N-D solution, but don't have the bandwidth
That said, I'd take a PR for DenseTensor3 or whatever.
On Fri, Mar 4, 2016 at 12:42 PM, dschulz72<EMAIL_ADDRESS>wrote:

Hey there, I'm fairly new to Breeze, so this might be implemented already,
but I can't find a way to have a 3+ dimensional matrix. For instance, you
might be able to create a new DenseMatrix by calling DenseMatrix(((1, 1,
1), (1, 1, 1), (1, 1, 1)), ((2, 2, 2), (2, 2, 2), (2, 2, 2))). If you could
implement this, I'm sure many users would benefit from it.
—
Reply to this email directly or view it on GitHub
https://github.com/scalanlp/breeze/issues/505.

duplicate of #244


added proper error handling within evaluate and bootstrap

-permits up to 5 errors during 1) evaluation and 2) bootstrapping and then raises actual error, halting program for user to fix the error

This is really good, I'm glad you did it in bootstrap too!


Huge impact of Flyway GCP BigQuery on application launch time

Which version and edition of Flyway are you using?
Flyway version: 8.2.2
Flyway GCP BigQuery version: 8.2.2-beta
Which client are you using? (Command-line, Java API, Maven plugin, Gradle plugin)
Java API
Which database are you using? (Type & version)
Database: GCP BigQuery
Driver: SimbaJDBCDriverforGoogleBigQuery42_<IP_ADDRESS>5
Which operating system are you using?
Ubuntu 18.04
What did you do? (Please include the content causing the issue, any relevant configuration settings, the SQL statement(s) that failed (if any), and the command you ran)
Configured Flyway GCP BigQuery with Maven and started Spring Boot application.
What did you expect to see?
Successful connection to GCP BigQuery. Application launch time increased not more than a few seconds.
What did you see instead?
Connection was successful but the application started in 45 seconds (even though there was no migration executed because the schema was up to date) while it starts in 7 seconds without Flyway GCP BigQuery configured. Is it supposed to have such a huge impact on the launch time?

BigQuery is known to be in general slower, and this is likely due to queries we execute on startup, so this is expected


Change order of includes to allow grid-settings to work

Unsure if we should change the comment on line 8 of _base.scss?
I like keeping it as the original one, so users will have a hint if they mess things up.

I'm in favor of turning this on by default, good idea. I don't think we should leave the comment as it is though, some people may not be as familiar with the default Neat setup.
Thanks @cllns!

That makes sense. Just changed the wording of that comment.
Thanks for open sourcing this! Using it for the first time right now. Makes it so quick to set-up a static site!

Looks good. :+1:
I'll get the other kits updated to do the same.


Run Tflite model on server

Please make sure that this is a bug. As per our GitHub Policy, we only address code/doc bugs, performance issues, feature requests and build/installation issues on GitHub. tag:bug_template
System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): No
OS Platform and Distribution (e.g., Linux Ubuntu 16.04):Linux Ubuntu 16.04
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device: all android phones
TensorFlow installed from (source or binary): source
TensorFlow version (use command below): 1.14
Python version:python3
Bazel version (if compiling from source):4
GCC/Compiler version (if compiling from source):na
CUDA/cuDNN version:na
GPU model and memory:na

I have a custom trained model and exported it on Tensorflow Lite. It run well on android phones. I would like to run the same model on a Ubuntu server. How can I do that? I am choosing tflite for its small file size but I could not find any way to take inference from *.tflite model directly on a Ubuntu server.

@ajinkya933 Did you get a chance look official Tensorflow website for tensorflow tite Inference. Thanks!

@gadagashwini yes, but there they are more focused on exploring the internal structure of tflite graph which can easily be done through softwares like Netron. What I am interested in getting bounding box output on ubuntu server provided I have *.tflite file as an input

?

This is possible to do by installing the standard tensorflow pip and using the Python tflite interpreter
https://www.tensorflow.org/api_docs/python/tf/lite/Interpreter
That's the easiest way, it is also possible to use the C++ API, but you'll need to compile tflite yourself.


TABU: Update entries with same key but different component values

Closes #6379

is it possible to add a unit test for this change?

is it possible to add a unit test for this change?

Hi @larshp, do you prefer one test for each of insert, update and delete function or all in one?

one test for each
more smaller tests is better IMHO

one test for each
more smaller tests is better IMHO

Ok, and would it be enough to only test method preview_database_changes?
Also why does abapLint says "Forbidden void type: cl_aunit_assert"? We would have to use it to be able to run the tests?

CL_AUNIT_ASSERT is obsolete

https://help.sap.com/docs/SAP_NETWEAVER_740/c238d694b825421f940829321ffa326a/4ec2efe26e391014adc9fffe4e204223.html?version=7.4.23
I think its been obsolete since somewhere around 7.02 or 7.00

unit test issue reproduced in https://github.com/abapGit/abapGit/pull/6383

unit test running in open-abap


Latest Fabric API breaks this mod

With the newest Fabric API implementation of there own resource loader this is broken to the point where vanilla resources are the only things that can be overwritten while modded assets stay the same regardless in a resourcepack or in the resources folder

Took me few days but finally found out that this mod is the culprit behind all of these crashes whenever i tried to do anything with datapacks while also having the newest Fabric API, pls fix

Will this be fixed?


chore(gridsome): Reconcile css formatting diffs from main to gridsome-main

Some of our formatting on gridsome-main is a bit off, specifically some fonts and font sizes.
This effort would reconcile differences and try to pull in the best from both. Header sizes and monospace formatting, for instance.
From main:

From gridsome-main:
TODO

@alexmarple - In researching and looking into this, it appears the Jekkyl site's css was leveraging "sassy" CSS, scss or sass. This is used for declaring variables such as $meltano-blue defined here. It also adds support for single-line comments such as those preceeded by //.
It appears that our current Gridsome installation has sass support, but we could add it. Any objections to us adding in support for sass so we can better reuse more of the existing css when helpful?

Closing in favor of #783 . From that issue:

Also, FWIW I think sass already works in our current configuration, no work necessary. Tried it out earlier today and renaming main.css to main.scss had no issues, and we already are writing scss inside the Vue components.


Redux store assets not used for preloader

Currently the generator creates a script that builds raw-assets/preload.json which gets directly required in and used in preloading. However, there are redux files set up for asset management (which I think is suppose to be used for preloading?) as well that is not being used.

@wongbsn lol, very true. I'll get this swapped out asap. Thanks for the heads up.


swagger editor - Not as full featured as swagger.io editor???

I'm working through a QuickStart example in swagger-tools, and after creating the simple project to get the API up and running (swagger project create simple), I opened the editor (swagger project edit) and then tried to import the "Simple Weather API" listing that was listed (which is in JSON format) into the editor but can't. There's no options to open or import any file.
I finally managed to get the JSON example as a YAML file (I went to the online editor http://editor.swagger.io/#/ and imported the Weather API JSON file I'd manually created and exported that as a YAML file).
After which the normal swagger project edit brought up the "Simple Weather API" file just fine.
So, is there a simpler way to open (or import) an existing JSON file into a project? Or can the project editor convert to/from JSON/YAML?
Thanks
P.S. I originally opened this issue in the swagger-tools repo and was told the issue was a "swagger-node design feature"

Thank you for the issue, I will take a look

I still don't find a "file" option on the top menu as we find at editor.swagger.io. Am i missing some config?

@DiegoZoracKy , it's not just you, i don't see it too.

I have the same issue.

I have the same issue here, it looks like they just added a portion of the editor, anyway I just added a new npm script and a new dependency to my package.json file:
"devDependencies": {     "yamljs": "^0.2.8"   },   "scripts": {     "start": "node app.js",     "test": "swagger project test",     "json": "node ./node_modules/yamljs/cli/yaml2json.js ./api/swagger/swagger.yaml > ./public/swagger.json"   }
Then you can run npm run json and you'll have your .json file generated

@yarax - Any further progress on this issue?


Farm page doesn't show all of my farms

Description
New Dashboard, Devnet.
It only shows that I have 10 farms, while I do have a lot more.

And if I change the item to 15, it shows that I only have 15, and so on.

And also, the next page button is disabled, so I can't get to my other farms.

Verified,

Devnet
e2580a5
TC2246 - List farms

verified:

Devnet
ebf75a3


My take on this

Even mobile devices have absolutely no problem to load, unload and cache large amounts of assemblies for various applications. Saying that there's a noticable impact on performance for D365 feels very outdated to me, even for instances on premise with limited hardware. Please do correct me if I'm wrong.
I have taken care of many different organizations, and for each one I have created an assembly for each purpose it's supposed to serve. I had up to 20 different plugin and CWA assemblies on a single organization. Then I was confronted with an organization which was handled by a third party who followed the single assembly guideline, their assembly took about 12MB in size. To this day we're having trouble with this single assembly. Never before have I encountered performance issues like this. Every action that triggers logic from this monster of an assembly takes a couple seconds longer than it has any right to. So from my experience, having a single large assembly makes performances worse.
If we really REALLY wanted to improve performance we'd take a look at .NET Native. That has been around since VS2015 yet we still have to compile all our plugins to IL.

More complex ALM? Isn't this article supposed to talk about D365 related things? If I don't know how to handle ALM with a ton of business logic now I won't know any better after reading this.
Here's a better approach: create assemblies as you see fit, but have them reuse code. This can be achieved by sticking every class library project into the same Visual Studio solution, and reusing code between them by using Shared Projects. Keep an eye on maintainability right from the start. Separation of concerns is where it's at.
When I develop a plugin the business logic and domain model are always in separate Shared Projects which do not even have to know that they're being called by a plugin. The plugin projects then contain code that's only related to the plugin side of things, like deciding where to get values from (image/input parameters/...) and deciding how to save values (execute an update/write to input parameters/...). All of this depends on the plugin registration like the message, the entity, the stage, whether it's sync/async, the images that are registered, the filtered attributes if any, etc. All these class library projects have to do with business logic is call it, but other than that their focus is on handling the plugin side of things.
Here's a bonus: sticking all class library projects in the same VS solution may create huge VS solutions, but thanks to filtered solutions introduced in VS2019 it's a breeze to work with it. https://docs.microsoft.com/en-us/visualstudio/ide/filtered-solutions?view=vs-2019

In terms of deployment it's also better to use multiple assemblies packaged in their own CRM solution, one for each purpose. That way you have a single solution for a single purpose, as opposed to a single solution for all purposes. This allows you to reuse your functionality for other organizations and your deployments will take shorter (solutions with large assemblies and lots of items like plugin steps take longer to import). It's also easier to see which functionality is present in an organization.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 534be660-d37a-3142-f2ba-1ecfd6fb5c46
Version Independent ID: 8097fd31-f16e-d156-45e9-cb3d2817dedf
Content: Optimize custom assembly development - PowerApps
Content Source: powerapps-docs/developer/common-data-service/best-practices/business-logic/optimize-assembly-development.md
Service: powerapps
GitHub Login: @jowells
Microsoft Alias: jowells

@YoYoFreakCJ Thanks for your feedback. We are closing this issue because we are either unable to find relevant information or reproduce this. If you're still experiencing the issue described here, please reopen or create a new issue


fix: can't install go1.21.0 because of parse latest version failed

https://go.dev/VERSION?m=text now return with timestamp:
go1.21.0
time 2023-08-04T20:14:06Z

so, executing goup install will failed.
this PR  fixed it~

Thanks for PR. Did you forget to push the changes?

I'm sorry, commit added


feature support map&struct type in parquet&orc reader

Proposed changes
Support parsing map&struct type in parquet&orc reader.
Remaining Problems

Doris use array type to build the key and value column of a map, but doesn't fill the offsets in value column, so the offsets in value column is wasted.
Parquet support reading only key or value column in map, this PR hasn't supported yet.
Parquet support reading partial columns in struct, this PR hasn't supported yet.

Fix bugs of nested array
Wrong number of ancestor nulls. Change the number of ancestor nulls from ancestor_nulls++ to ancestor_nulls += loop_read
Checklist(Required)

[ ] Does it affect the original behavior
[ ] Has unit tests been added
[ ] Has document been added or modified
[ ] Does it need to update dependencies
[ ] Is this PR support rollback (If NO, please explain WHY)

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall

run buildall

TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 33.58 seconds
stream load tsv:          463 seconds loaded<PHONE_NUMBER>9 Bytes, about 154 MB/s
stream load json:         38 seconds loaded<PHONE_NUMBER> Bytes, about 59 MB/s
stream load orc:          67 seconds loaded<PHONE_NUMBER> Bytes, about 15 MB/s
stream load parquet:          28 seconds loaded 861443392 Bytes, about 29 MB/s
https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230224061000_clickbench_pr_103823.html

run buildall


Numbers do not validate as enum values

Good find! CC @stephenmichaelf for thinking about this in task schema generation.

fixed in language-service, will close the bug after the fix makes it way up to the extension

Fixed in 1.152.0.


MathML discussion

link pending for 103 but I need chrome 106!!1! for… math reasons ;)

Hrm.
Turns out Chrome 106 ships MathML Core and not MathML (3) - not a small feat either obviously. But that leads to the question, what to do with https://caniuse.com/mathml?
Define that as MathML 3 and give Chrome partial because it's "only" Core? Give all partial because it seems there are (small?) interop issues across the board?
Should I open another issue to discuss this further? Also with regard to versions 1, 2 and the upcoming 4...
Links:

https://groups.google.com/a/chromium.org/g/blink-dev/c/n4zf_3FWmAA/m/oait3tsMAQAJ
https://chromestatus.com/feature/5240822173794304
https://groups.google.com/a/chromium.org/g/blink-dev/c/n4zf_3FWmAA/m/ELYOLCQtAQAJ
v4: https://w3c.github.io/mathml/
MathML Core issue: #6068
https://wpt.fyi/results/?label=master&label=experimental&aligned&q=mathml

Have done the Chrome version update, as for MathML, not sure yet... one option may be to repurpose the current feature for "Basic support", if "core" could be considered basic support that may work but I haven't looked into it enough yet. But in general folks like to know what parts now have cross-browser support so I'd like to find out what that is.

if "core" could be considered basic support that may work but I haven't looked into it enough yet

To me, it's really a mess - from here:

They ship MathML, but could you speak to the conformance level with the Core spec? In cases where there are gaps, are they going to cause significant web compat issues that will need to be addressed with implementation improvements to other browser implementations?

Chromium implements MathML Core which is smaller than what WebKit & Gecko have today. If authors stick to formulas based on the core subset (which we believe should the case for the majority of existing content), the interoperability is quite good as can be see visually with https://people.igalia.com/fwang/2022-06-igalia-week-shipping-mathml-in-chromium/#/5 VS https://people.igalia.com/fwang/2022-06-igalia-week-shipping-mathml-in-chromium/#/6
In practice interop gaps are more likely to come with existing MathML3 content that rely on more features. Our proposal is to rely on polyfills so they work in Chromium too and to try to carefully deprecate & unship these legacy features from WebKit/Gecko.
Additionally, if/when web authors & developers start to make use of them, then we foresee some interop gaps will happen with the new math-related CSS properties proposed to expose the internal magic (display: math, font-family: math, math-style, etc) as well as interaction with existing CSS properties (e.g. padding/margin/borders to tweak spacing).
So the short answer is that yes there is likely to be interop gaps and yes some work will be needed on the WebKit/Gecko side. Igalia actually already started to unship legacy features from WebKit (under a flag) and Gecko and did a few improvements regarding the CSS part. We've been focusing mostly on Chromium since that's where the biggest & most serious interop gap exist for users (no MathML support at all!) but it's very possible we'll put more effort on Gecko/WebKit after that (that's my personal preference but work sponsors may have a different opinion).

with the TL;DR being

So the short answer is that yes there is likely to be interop gaps and yes some work will be needed on the WebKit/Gecko side. Igalia actually already started to unship legacy features from WebKit (under a flag) and Gecko and did a few improvements regarding the CSS part.

unshipping stuff and Core doesn't seem to be just basic features but doing some stuff different/simpler (i.e. Firefox & Safari don't match that yet)…
I'll change the title to something MathML.

Thinking about it again: Since interest in the context of caniuse seems on the low side (few issues, no vote on the Core issue yet) and the description on https://caniuse.com/mathml is broad

Special tags that allow mathematical formulas and notations to be written on web pages.

maybe we just wing it, as in postpone this discussion to the future if/when interest in the distinction arises?
And for now more as a signal paint Chrome 106 green? As the (coming) support definitely matches the description… 😎

Thanks, I agree. I've added support with a note for now, we'll probably want to tweak that further in the future. Let me know what you think.

LGTM to me for now, I'm sure we'll be wiser in the future!
Looking at the entry I noticed two minor things unrelated to this issue, will create a PR.
Closing this one, cheers! :)


Dattell partner information

**NOTE: This is an issue template for new partner pages we are building. Existing partners can use them to submit information needed as we build out enhanced pages. New partners, please continue to use the process outlined here for the time being: https://opensearch.org/new-partner.html
Organization name
Dattell
Brief description of your business and what it does (50 words or less)
Dattell offers consulting support and managed services for OpenSearch, Elasticsearch, Kafka, and Pulsar.  We support implementations in our clients’ environments, on-prem or cloud (AWS, GCP, Azure).
All of our team members are senior level DevOps, IT, or programming professionals with 10+ years experience running data infrastructure for complex use cases.
Name of your relevant product(s) or service for the OpenSearch audience
Managed Opensearch - We provide enterprise level managed OpenSearch in your environment.  You will work with a consistent OpenSearch expert who gets to know your team, use case, and implementation.  This OpenSearch engineer will be available to you like an extension of your team on Slack/Teams/etc., in meetings, by phone, and email.  They will focus on preventative maintenance, optimization, monitoring, training, and any other technical assistance needed.  Your dedicated engineer will also be the first to respond 24x7 to production-level issues.  And we have our larger team of OpenSearch engineers available for additional support. We guarantee a response time of 15 minutes for production level issues, 24x7x365.
Consulting Services for OpenSearch - We provide you with a consistent OpenSearch expert who gets to know your team, use case, and implementation.  This OpenSearch engineer will be available to you during work hours like an extension of your team on Slack/Teams/etc., in meetings, by phone, and email.  They will focus on preventative maintenance, optimization, monitoring, training, and any other technical assistance needed.  We guarantee a response time of 3 business hours for all issues/inquiries, and we have an average response time of 20 minutes.
What OpenSearch technologies do you specialize in
We specialize in support of open source, free license software.  That includes OpenSearch in all of its various implementations including: search, logging and monitoring, analytics, observability, security, e-commerce, machine learning, vector search, and content management.
In addition, we support ancillary open source, free license software such as Apache Kafka, and Apache Pulsar.
Type of business
MSP and services organization
Home/main office location or address
12636 High Bluff Dr, San Diego, CA 92130
How can people contact you (email and phone)
<EMAIL_ADDRESS>(619) 786-0813
Regions you serve
North America, South America, Europe, Middle East, Africa, Asia Pacific, Australia
Industry specialization
Financial Services, Healthcare, Software & Technology, Media, Public Sector, Consumer Services, Business Services, Energy & Utilities, Internet of Things, Fintech, Healthtech, Saas, Defense, Biotech, Medtech, High Tech, Energy & Utilities
Logo
Please upload a company logo

Additional image
Attach any additional image you would like to provide that showcase your business (product, technology, offices)

Links
https://dattell.com/data-architecture-blog/enterprise-managed-opensearch/
https://dattell.com/data-architecture-blog/planning-a-successful-migration-to-opensearch/
https://dattell.com/data-architecture-blog/how-to-query-opensearch-with-boolean-queries/

@barryhatfield - Thank you for providing the info for the new page.


Supress "UNUSED_ANONYMOUS_PARAMETER" to prevent warnings in generated Kotlin code

We treat warnings as errors, so this warning prevents our project from compiling successfully.  This change suppresses the warning in the generated code.

For what it's worth it looks like this warning popped up between 1.0.1 and 1.0.2.  Here are some snippets from one of our generated files:
1.0.1:
      operator fun invoke(reader: ResponseReader): Student {
        val __typename = reader.readString(RESPONSE_FIELDS[0])
        val fragments = reader.readConditional(RESPONSE_FIELDS[1]) { conditionalType, reader ->
          val studentData = if (StudentData.POSSIBLE_TYPES.contains(conditionalType))
              StudentData(reader) else null
          Fragments(
            studentData = studentData!!
          )
        }

        return Student(
          __typename = __typename,
          fragments = fragments
        )
      }

1.0.2:
      operator fun invoke(reader: ResponseReader): Student {
        val __typename = reader.readString(RESPONSE_FIELDS[0])
        val fragments = reader.readConditional(RESPONSE_FIELDS[1]) { conditionalType, reader ->
          val studentData = StudentData(reader)
          Fragments(
            studentData = studentData
          )
        }

        return Student(
          __typename = __typename,
          fragments = fragments
        )
      }

The problem is the conditionalType parameter.  It looks like it was used in 1.0.1, but is no longer used in 1.0.2 and onward.  I'm not sure if it would make more sense to remove the unused variable or just take this suppression change.

Thx for the PR, I guess we can merge it as a temp fix for now. Proper fix is coming.


Do we have dbatools for powershell on linux?

Do we have dbatools for powershell on linux? If yes,

can you please provide instructions on how to install.
Sample scripts for powershell on linux using DBATOOLS

At this time it would not work on Linux the last I heard because SMO has not been completely ported to Linux.

Which actually once SMO and .NET are fully ported over to PowerShell Core will begin fully testing dbatools for Linux OS. Until that time though we have not begun to fully support Linux and PowerShell Core.

Thanks for the reply.
Recently I found .net being moved, but not sure if all nationality is moved.
Thanks for looking into this.

.NET core is available but not in fully supported (last time I checked). You have to have that installed before you can utilize PS Core on Linux. The main missing piece is SMO which once the sqltoolsservice has this working for all the libraries we can start working on dbatools support for Linux full steam.


Left Sidebar: Automatic folding of DM section creates a gap.

Background
If you manually fold the DM section and scroll down the channel list, it works as expected.
If the DM section is open and you scroll down, the DM section folds automatically.
Problem
During the automatic fold case, a gap is created between the DM section head and the channels head where the channel names are visible while scrolling through this gap which is unpleasant..

Video Demonstration
https://github.com/user-attachments/assets/7682c83d-d4a9-4ece-81cf-f0511131dcdb

CZO thread

Hey, I feel like I can fix this one. Lemme try?

@zulipbot claim


Infer browser information when the user cannot find something on a page

I find we've got many "I could not find what I was looking for" issues and users don't necesseraly edit the title. It brings confusion because we don't know what page they come from. It's also harder to find an issue after some time.
I propose we infer a few information for them and improve the message template.
Example
https://github.com/algolia/instantsearch.js/issues/new?title=I%20need%20information%20on%20"Designing%20the%20no-result%20page"&body=Hi!%20I%20have%20a%20documentation%20issue%20on%20InstantSearch.js.%20I%20could%20not%20find%20what%20I%20was%20looking%20for%20on%20the%20page%20[_Designing%20the%20no-result%20page_](https://community.algolia.com/instantsearch.js/v2/guides/no-result.html).%0A%0A%3C!--%20Describe%20what%20you're%20looking%20for%20here.%20--%3E%0A&labels=question
(the label doesn't work like this because we added an emoji in the label name)
Preview

I need information on "Designing the no-result page"
Hi! I have a documentation issue on InstantSearch.js. I could not find what I was looking for on the page Designing the no-result page.
<!-- Describe what you're looking for here. -->

How
The current file is https://github.com/algolia/instantsearch.js/blob/3f040463989a754461d4237a83df35a824426ae9/docgen/layouts/archetypes/content-with-menu.pug.
We'd need to change the link's href property in JavaScript.
To create the appropriate URL for each page:

Page title: document.title.split(' | ')[1] or document.querySelector('h1.text-heading .text-normal').innerText
Page link: location.href
Space in a URL: %20
New line in a URL: %0A

Do you think it would facilitate this kind of support in the long run?

Actually the label is usually not necessary because the title is the same, however I wonder if it would work if url encoded?


Show date when the artwork entered / will enter in the public domain in the result

I would love this too, to be able to calculate the impact of extending copyright terms.


chore(ui): upgrade dependencies

closes #218

Have to fork JsonSchemaFormModule and JsonSchemaFormComponent because of this issue :
https://github.com/dschnelldavis/angular2-json-schema-form/issues/189


Google does not return refresh token and the token does not refresh automatically

Environment details

OS: Centos 8
PHP version: 8.1
Package name and version: "google/apiclient": "2.16"

Steps to reproduce

Generate the auth link:

            $client->setAccessType('offline');
            $client->addScope(\Google\Service\Calendar::CALENDAR_EVENTS);
            $client->addScope(\Google\Service\Calendar::CALENDAR);
            $client->setRedirectUri($redirectUri);
            $client->setIncludeGrantedScopes(true);

            $client->createAuthUrl();

Fetch the token:

            $client->setAccessType('offline');
            $tokens = $client->fetchAccessTokenWithAuthCode($code);

This is the generated link https://accounts.google.com/o/oauth2/v2/auth/oauthchooseaccount?response_type=code&access_type=offline&client_id=
But, In the json there is no refresh_token. It only returns access_token. And the access token expires 1 hour later and I have to go and repeat the auth process again. Wich is not the case of my app. Because the token is being used in API.
Thanks!

I have the same problem

No one?

I had the same problem. You have to put :
$client->setAccessType('offline');
Before generating the authorisation url
`$client = new Client();
$client->setClientId($this->parameterBag->get('app.google_client_id'));
$client->setClientSecret($this->parameterBag->get('app.google_client_secret'));
$client->addScope("https://mail.google.com");
$client->setRedirectUri("https://localhost/api/gmail/connect");
$client->setAccessType('offline');
$service = new Gmail($client);
    if ($request->query->get('code')) {
        $token = $client->fetchAccessTokenWithAuthCode($request->query->get('code'));
        $client->setAccessToken($token);
        ........
    }

    $authUrl = $client->createAuthUrl();

    return $this->redirect($authUrl);`

I have the same problem and I also did put the setAccessType before createAuthUrl() but still do not work.
I have 2 functions, one to generate the Auth Url
public function createAuthUrl()
{
        $client = new Client();
        $client->setAuthConfig(ADMIN . '/config/google_api_credentials.json');
        $client->addScope('https://www.googleapis.com/auth/adwords');
        $client->setAccessType("offline");
        $client->setApprovalPrompt('force');
        $client->setRedirectUri($this->admin_site_url . $this->app['url_generator']->generate('google.oauth2.authorization-callback'));
        return $client->createAuthUrl();
}

And another as callback:
public function getTokensFromAuthCode($auth_code)
    {
        $client = new Client();
        $client->setAuthConfig(ADMIN . '/config/google_api_credentials.json');

        $client->addScope('https://www.googleapis.com/auth/adwords');
        $client->setAccessType("offline");
        $client->setApprovalPrompt('force');
        $client->setRedirectUri($this->admin_site_url . $this->app['url_generator']->generate('google.oauth2.authorization-callback'));
        $tokens = $client->fetchAccessTokenWithAuthCode($auth_code);
        $client->setAccessToken($tokens);

        return $tokens;
    }

Ok, i was able to get the refresh token, by some reason, google only sends you the refresh token for the first time you consent/allow the permission.
So you already give the consent/allow you need to revoke the access token, you can do that by going to your google account and removing the permission or with the access token you can revoke that:
$client->revokeToken($client->getAccessToken());

The time you request the token the google will send you the refresh token.
There is also some claims that this behaviour only happens with some language libs
Check More:
https://stackoverflow.com/questions/10827920/not-receiving-google-oauth-refresh-token

Thanks for clarifying the solution.
Doing some research it seems that revoking the access token is the correct way:
https://stackoverflow.com/questions/67016594/how-to-get-refresh-token-for-login-with-google-api


Enhance Node Monitoring - Track Kernel Health

Is your feature request related to a problem? Please describe.
Monitor kernel health, track anomaly, and act based on node health.
Describe the solution you'd like

Create KernelHealthService that tracks kernel log files for patterns, and act if node is detected as unhealthy.
Create ParentNodeHealthService to which granular health services will register.
Add KernelHealthService and FsHealthService to ParentNodeHealthService

This is something that would be pretty helpful to me as well, Ideally it could provide metrics that are comparable to elasticsearch's xpack monitoring


issue to write data on PI server

I tried the  plugin PI to wirte data on PI server from Dataiku
it does not work totally : the Value « column value » is well pasted but the time (timestamp "date" column) of the value is not considered. By default the plugin use the timestamp of the job date.
TESTDATAWRITEPI.zip

Hi @julienDuhart ! Sorry for the delay as I missed the notification...
Could you provide a screenshot of the input dataset, showing the column header (name, storage and meaning) as well as the parsed date entry that is not accepted ? Something like this:

This would help us reproduce the issue on our side...

Thanks


Add better support for Lily tracking

[ ] Track when Cure 2 or Medica is used while an Afflatus heal is available and ding it.
[ ] Track when Cure 3 is used while an Afflatus heal is available and warn (Cure 3 might be okay in some situations).

Ensure every lily does at least two of the following three things:

Provide needed effective healing
Provide a window for weaving or double weaving oGCDs
Provide something to do during movement windows

First half looks great!
Second half is a general recommendation for players but not an "absolutely must do" so it could just be a wording adjustment? For example, ones that do effective healing only, I would think aren't something to flag as "done wrong" if that makes sense? But more of a "maybe you could've done these things with it, but maybe you couldn't have?"
I know that's super wishy-washy sounding, this one is pretty subjective tbh, i'm just wary of players taking away advice that makes them want to sit on the heals.
Other question, how would you handle what qualifies as effective healing? Just if the skill did like no more than 25% overheal?

I haven't really thought through the idea of effective healing, yet.  Really, though, if used as a weaving window for Asylum when Dia isn't available, you can actually get a free Afflatus Misery every 3m, and it's a DPS gain over clipping with Asylum, or clipping the Dia, so I'm really at a loss for how to track this most effectively.  Trying to figure that out still.  The first half is the most important part, tI think.  Maybe I should break the second half out into a separate task?

Can you elaborate a bit on what you mean? I'm a bit confused how you're getting that it's a dps gain/free misery. I know it's a different example, but the usual one I use to show if/when afflatus is a gain to weave with over clipping is assize:
In a dummy fight, using one afflatus for the alternating assizes that don't line up with dia, it's a DPS gain to hard clip them UNTIL you get to the 5min15s mark where you can use your first misery to weave assize, then you come out +100 ahead.
So in a more practical fight sense, similar logic applies: you need to have saved yourself more than 3 hard clips with afflatus for it to be a DPS gain - and that assumes you didn't use one to weave and then had to GCD heal sometime later as a result of not having a lily. And if you're only doing one per afflatus, that means you need to weave with Misery. But you might be saving Misery to move, or even for raid buffs that would be more portent than a clip.
(I sound like i'm regurgitating the stuff i've been writing all weekend, sorry for being so verbose!)

@SaltedyLevity I'm going to restate all the obvious things which you should know, just for complete clarity.  Please don't take this as me patronizing; I just want to make sure I'm not making any assumptions or incorrect assertions.  Feel free to correct me where you see something wrong.
So, Assize, at a 400 potency oGCD, is a vital part of our DPS rotation. As such, it should be woven with Dia whenever possible. However, because Assize is on a 45s cooldown, and Dia lasts 30s, Dia can only be used to weave every other Assize.
Glare has 300 potency, Afflatus Misery has 900 potency.  Therefore, casting an Afflatus Rapture or Solace can be said to cost us 300 potency, but casting three of them only costs us 100 potency (since it presents the opportunity for the Misery).
Thus, going by Assize windows, if we cast:

Dia > Assize
Rapture > Assize
Dia > Assize
Rapture > Assize
Dia > Assize
Rapture > Assize
Dia > Assize
Misery > Assize

oh, I guess that's every 6 minutes, not every 5 minutes. My bad.  How did you get to 5m 15s? You're actually ahead of me.

You're fine! I appreciate the extra clarity so we both know we're on the same page (when approaching feedback from players I generally shy away from the 100p per solace/rapture thing since it's kind of a full picture mechanic, but I digress!
But you have the list right! Just the time wrong! Same order as you have, but I stuck the times for assize in:

0s Assize (Dia)
45s Assize (Rapture)
90s Assize (Dia)
135s Assize (Rapture)
180s Assize (Dia)
225s Assize (Rapture)
270s Assize (dia)
315s Assize (Misery)

315s = 5 minutes and 15s, I think maybe you just had time off somewhere because the theory is right!


Add WEBGPU tests to CI

Hmm, why are the high lr ADAM tests failing? Those are pretty good bellwethers for other issues

failing due to accuracy, trying a different threshold


Jpetoptions

problems with JPetCmdParser.cpp. I tried to include options from json before generating options->it is last 'if' in parseandgenerateoptions but can not find solution to problem with type variable_value from boost

Just to redo it


Handling nullable reference types

As I'm currently unsure as to which JSON responses may or may not contain null values, I'm treating all DTO class properties as nullable, and Nullable reference types are enabled project-wide as specified in the BaseballSharp .csproj file.
Treating all DTO properties as nullable means that there is a significant amount of ? (nullable) annotation throughout the code base. So far, I've only ever experienced the pitching report notes endpoint return null for a certain date.
Some proposed alternatives to this style would be:

Skip marking the fields nullable. However, nullable reference type annotations are a feature for the code author; and even if you mark a reference field as non-nullable, this does not mean it is not null on the write.

Alternatively, we can just accept NullReferenceExceptions if some data is unusual.

If we want to avoid NullReferenceExceptions then we could validate all the deserialized DTOs to ensure that non-nullable fields do not actually contain null values.

I feel the cleanest option is likely option 3, to validate the DTOs after deserialization and throw when some mystery null values appear, only marking as nullable the "I expect this to sometimes be null" fields.

This has been partially resolved by using property initializers. The next step is to implement error handling as per this issue:
https://github.com/markjamesm/Baseball-Sharp/issues/16
Once the error handling is finished I will close this issue.

This has been partially resolved by using property initializers. The next step is to implement error handling as per this issue:
https://github.com/markjamesm/Baseball-Sharp/issues/16
Once the error handling is finished I will close this issue.


Support light size and soft shadows

OmniLight3D and SpotLight3D have a "size" parameer, when >0, the light size grows and soft shadows are enabled.
DirectionalLight3D has an angular size (for reference, the Sun's angular size as see from earth is 0.5). When >0, soft shadows are enable for it too (you may want to enable blend splits if the value is too large, as they stop transitioning properly).

Thanks!


Add IBEX plotting callback

https://github.com/ISISComputingGroup/ibex_bluesky_core/issues/8
Docs

[ ] Ensure docs give enough information/pointers to documentation elsewhere for users to find out how to configure plots.
[ ] Ensure all the points in the ticket's acceptance criteria have been met.

To test this in a standalone session:

Ensure you are in the ibex_bluesky_core venv as per dev setup notes.
Ensure you have recently re-run python -m pip install -e .[dev] to pick up matplotlib and qt dependencies
Run python src\ibex_bluesky_core\demo_plan.py
[x] A matplotlib Qt window should appear and be updated live during the plan.
[x] A long running plan like bps.sleep(999) should be interruptible via ctrl-c.

To test this within the IBEX gui:

Rebuild your genie_python using the branch linked from https://github.com/ISISComputingGroup/IBEX/issues/8453
Run c:\instrument\apps\python3\python.exe -m pip install -e c:\instrument\dev\ibex_bluesky_core\

This installs ibex_bluesky_core into your genie_python environment (not a .venv)

Ensure IBEX is set up with blocks and DAE as per existing dev setup notes.
In the IBEX pydev scripting console run:

from ibex_bluesky_core.demo_plan import run_demo_plan
run_demo_plan()

[x] A matplotlib window should appear and be updated live during the plan.
[ ] A long running plan like bps.sleep(999) should be interruptible via ctrl-c.

Looks good to me, plotting works as expected. One thing I have noticed though is that when you pause (Ctrl + C) a plan for the second time, in the pydev console, this causes an exception and I can't resume the plan again. Not sure if this is intentional or just on my machine? Also not sure how relevant this is to this ticket but think its worth saying.
Exception in thread Thread-6 (maybe_prompt_pause): Traceback (most recent call last):   File "C:\Instrument\Apps\Python3\Lib\threading.py", line 1045, in _bootstrap_inner     self.run()   File "C:\Instrument\Apps\Python3\Lib\threading.py", line 982, in run     self._target(*self._args, **self._kwargs)   File "C:\Instrument\Apps\Python3\Lib\site-packages\bluesky\utils\__init__.py", line 291, in maybe_prompt_pause     self.RE.request_pause(False)   File "C:\Instrument\Apps\Python3\Lib\site-packages\bluesky\run_engine.py", line 817, in request_pause     return future.result()            ^^^^^^^^^^^^^^^   File "C:\Instrument\Apps\Python3\Lib\concurrent\futures\_base.py", line 456, in result     return self.__get_result()            ^^^^^^^^^^^^^^^^^^^   File "C:\Instrument\Apps\Python3\Lib\concurrent\futures\_base.py", line 401, in __get_result     raise self._exception   File "C:\Instrument\Apps\Python3\Lib\site-packages\bluesky\run_engine.py", line 835, in _request_pause_coro     current_run.record_interruption("pause")   File "C:\Instrument\Apps\Python3\Lib\site-packages\bluesky\bundlers.py", line 449, in record_interruption     doc = self._interruptions_compose_event(           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^   File "C:\Instrument\Apps\Python3\Lib\site-packages\event_model\__init__.py", line 2312, in __call__     seq_num = self.event_counters[self.descriptor["name"]]               ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^ KeyError: 'interruptions'

@jackbdoughty can you check you have a recent GUI build? Pull main and run build.bat or update target platform in eclipse...

It also might just be worth making it clearer to the user to do from ibex_bluesky_core.run_engine import get_run_engine RE = get_run_engine() to be able to call RE.resume(). As right now the message received after doing a ctrl + c is `Your RunEngine is entering a paused state. These are your options for changing
the state of the RunEngine:
RE.resume()    Resume the plan.
 Mark exit_stats='aborted'.
 Mark exit_status='success'.
RE.halt()      Emergency Stop: Do not perform cleanup --- just stop.`

Yeah that's a difference between run_demo_plan and demo_plan really.
I think the direction of travel is that IBEX will automatically create a RunEngine (by calling RE = get_run_engine()) as one of the standard GUI initialization commands - like we already have for setting matplotlib backends etc.
So then at the user level they would have access to the RE, and would be executing plans with something like:
RE(my_plan())

at the command-line.
Let's chat after lunch...


Flex user cannot log in on Windows

I create two users, with same password and permissions:

regular-user (with disabled flex-users)
flex-user (with enabled flex-users)

Then i try to login:
regular-user

Authorization passes without problems.
flex-user

Authorization does not pass.
Info:
Windows 10 x64
PHP v7.4.0 (on built in server)
Grav v1.7.0-rc.2
Admin v1.10.0-rc.2
All tests were performed on a clean installation.

I believe this is related to #2773

Unfortunately, in Grav v1.7.0-rc.3 this problem is not fixed.

I don't think it's a Windows-specific issue as we had it tested in Windows.
Make sure you didn't change the storage type to folders as it would require different structure of files.

Configuration -> Experimental:

User Accounts -> flex-user:

User Groups -> super:

Settings look good. Not sure why the login fails, though...

This bug is the same as #2785, and my old https://github.com/getgrav/grav/issues/2444#issuecomment-527158445 and this commit https://github.com/getgrav/grav/commit/a8ff0e389241d99b6d81d7c3e4d5d62b988287d3 fix it.


feat(language-service): JSDoc display support when typing props on component template

resolve #4663

@ferferga PR is here. But I don't know how to write a test script to test it, It may need the help of more experienced developers.

Great work, thanks!


Add not_starts_with condition.

(Thank you for contributing to Caddy! Please fill this out to help us make the most of your pull request.)
1. What does this change do, exactly?
Adds a not_starts_with condition. The inverse of starts_with.
2. Please link to the relevant issues.
3. Which documentation changes (if any) need to be made because of this PR?
The rewrite "if" conditions list should be updated: https://caddyserver.com/docs/rewrite#if
4. Checklist

[X] I have written tests and verified that they fail without my change
[ ] I have squashed any insignificant commits
[ ] This change has comments for package types, values, functions, and non-obvious lines of code
[X] I am willing to help maintain this change if there are issues with it later

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Thanks @taylorotwell! A useful change to have, and we really appreciate your contribution. :+1:


[e2e]: go push main config-noldflags slsa3

Repo: https://github.com/slsa-framework/example-package/tree/main
Run: https://github.com/slsa-framework/example-package/actions/runs/7649320923
Workflow file: https://github.com/slsa-framework/example-package/tree/main/.github/workflows/e2e.go.push.main.config-noldflags.slsa3.yml
Workflow runs: https://github.com/slsa-framework/example-package/actions/workflows/e2e.go.push.main.config-noldflags.slsa3.yml
Trigger: push
Branch: main
Date: Thu Jan 25 03:09:42 UTC 2024

Repo: https://github.com/slsa-framework/example-package/tree/main
Run: https://github.com/slsa-framework/example-package/actions/runs/7663453512
Workflow file: https://github.com/slsa-framework/example-package/tree/main/.github/workflows/e2e.go.push.main.config-noldflags.slsa3.yml
Workflow runs: https://github.com/slsa-framework/example-package/actions/workflows/e2e.go.push.main.config-noldflags.slsa3.yml
Trigger: push
Branch: main
Date: Fri Jan 26 03:11:17 UTC 2024
Tests are passing now. Closing this issue.


ROX-12746: Fix curl retries, related improvements.

Description
Improve retries around curl which is a subtle topic:

replace --retry-connrefused with --retry-all-errors which retries "all transfer errors"
use --fail which is necessary for 4xx and 5xx to be retried, since it turns out these are not transfer errors 🤦🏻♂
do our own retry loop on top to prevent further unexpected corner cases popping up
don't retry in wait_for_central which has its own retry logic
in launch_sensor do a custom retry loop with different name every time when fetching init bundle, to cover rare situations where bundle would be created on central but curl failed to read response for whatever reason - previously we'd insist on the same bundle name on retries which would never succeed.

Also a few improvements in nearby code while at it:

drop duplicate -s (same as --silent) flags
in wait_for_central replace "pod lookup + k exec pod" with simpler direct "k exec deployment" which is supported by kubectl for almost 5 years now, and drop set +e thanks to this simplification
in launch_sensor fix a permissions race between touch and chmod by using a umask when touching

Checklist

[ ] Investigated and inspected CI test results
[ ] Manual tests
[ ] Before merge shout out on slack to make sure folks have a recent enough curl and kubectl/oc
[x] ~Unit test and regression tests added~
[x] ~Evaluated and added CHANGELOG entry if required~
[x] ~Determined and documented upgrade steps~
[x] ~Documented user facing changes (create PR based on openshift/openshift-docs and merge into rhacs-docs)~

If any of these don't apply, please comment below.
Testing Performed
Here I tell how I validated my change

[ ] check every affected function is actually invoked in some CI test
[ ] if not, manually run them

Reminder for reviewers
In addition to reviewing code here, reviewers must also review testing and request further testing in case the
performed one does not seem sufficient. As a reviewer, you must not approve the change until you understand the
performed testing and you are satisfied with it.

/test all

/test all

/test all

/retest

/retest

FTR, ocp-4-15-qa-e2e-tests failure was unrelated, and now a retry fails due to the go version bump that went in in the meantime. I think this PR is still good to go from CI standpoint...


Format columns to cat indices api

Thanks for watching. Seems I've forgotten in all Cat APIs.

When you can merge it?

It will be part of 6.2.8. I will probably push something over the weekend.

Okay, thank you)


Filter sensitive terms from Plausible events

Problem

Identified by @zackkrida

Now that analytics are live and defaulted on Openverse.org, we’re able to view raw user search queries in the Plausible UI. These are not being filtered against our sensitive terms list or able to be blocked in Plausible’s UI.

Description

We already proxy Plausible requests through the Nuxt server. We can enhance this functionality by adding filtering of sensitive terms to payload items in a custom handler.
We use https://github.com/nuxt-community/proxy-module to configure the proxy in nuxt.config.ts. This module is implemented using https://github.com/chimurai/http-proxy-middleware, which includes the ability to add event handlers for proxyReq, where we can re-write sensitive terms in any payload property. The configuration would need to be updated something like this:
  proxy: {
    // The key is appended to the address in the value.
    "/api/event": {
      target: process.env.PLAUSIBLE_ORIGIN ??
        (isProdNotPlaywright ? "https://plausible.io" : "http://localhost:50288"),
      on: {
        proxyReq: (proxyReq, req, res) => {
          // find/replace proxyReq.body sensitive terms
        }
      }
    }
  },

Please reference express Request API documentation for details of how to read the request body. Plausible's frontend library sends the request as text/plain, so proxyReq.body may just be text rather than parsed JSON.
Add a new variable in types/analytics.ts like so:
const FILTERED_PAYLOAD_PROPERTIES: { [K in keyof Events]: (keyof Events[K])[] } = {
  SUBMIT_SEARCH: ["query"],
  CLICK_HOME_GALLERY_IMAGE: [],
  RIGHT_CLICK_IMAGE: [],
  BACK_TO_SEARCH: [],
  GET_MEDIA: [],
  COPY_ATTRIBUTION: [],
  REPORT_MEDIA: [],
  SELECT_EXTERNAL_SOURCE: ["query"],
  CHANGE_CONTENT_TYPE: [],
}

Note
The type declaration on the constant ensures two things:

That all new events are explicitly screened for payload properties that may need filtering
That only real payload keys are present in the array of filtered payload properties

In the proxy configuration, reference this to avoid needing to search all payload properties.
Retrieve the list of filtered terms from URL configured via an environment variable, similar to the ingestion server: https://github.com//WordPress/openverse/blob/a982d8a2d2a6857e3bccb75b1611460cae2650b1/ingestion_server/ingestion_server/utils/sensitive_terms.py#L1-L15
The URL should be expected to return a new-line delimited list of sensitive terms. We will replace the sensitive terms in payload items with UUIDs. These UUIDs must be cached and shared between all Nuxt instances. There are two approaches we can take for this:

The frontend can generate the UUIDs for us and try to cache them in Redis and share them between instances. During startup, the frontend tasks would need to generate or retrieve the list of UUIDs from Redis. To prevent multiple frontend tasks from attempting to generate the UUIDs for new terms on startup, we would need to use a lock present in Redis. Frontend task startup would need to block on this operation until the UUIDs are available.
We can pre-generate the list of UUIDs and add them to the sensitive terms repository. This would probably need to be done in a separate file to prevent complicating the existing list and needing to coordinate changes to the ingestion server's usage of the list. Doing it in a separate file would also allow us flexibility to implement more complex approaches to term definition as discussed in issue 4 of WordPress/openverse-sensitive-terms (not linking directly per our policy with the repository).

I have a strong preference towards the second approach as it is much simpler for everyone involved, both existing and future users of the sensitive terms list in our project.
The frontend should retrieve the sensitive terms list and UUIDs and cache it in memory during startup and re-retrieve it periodically when proxying requests every 24 hours.
When filtering the proxy request, check that the event has any filtered payload items. If not, send the request as normal. If it does, retrieve the payload property into a new variable, then iterate through the sensitive terms list and execute payloadProperty.indexOf to check if the substring is present, saving the result to a new variable. If it is not present, continue the iteration. If it is present, replace it with the UUID.
Potential optimisations:

Save the original value length and skip sensitive terms that wouldn't fit. Sort the sensitive terms list by length or reverse index it by length to avoid needing to do length checks on the sensitive terms at request time.

I suspect this one is a high value optimisation we could implement at the start

When a sensitive term matchs, check if payloadValue === sensitiveTerm and skip all other sensitive term checks after replacing the payload value with the UUID for the term. This proactively catches cases where the entire query is a single sensitive term (potentially common?).

This may be a premature optimisation and we could probably easily do an analysis after the initial implementation to see how many payload values that get filtered result in value that is just a single UUID.

This is extremely thoughtful and comprehensive. Particularly the typecheck to avoid searching all event payloads and only those which need to be filtered (i.e, those which contain direct user input).

I have a strong preference towards the second approach as it is much simpler for everyone involved, both existing and future users of the sensitive terms list in our project.

👍
The first optimisation is also really clever and could definitely be implemented from the start.
One minor thought, we might want to take action to make this filtering clearer when viewing the Plausible UI. It might not be immediately clear to folks viewing the analytics data that a UUID was actually a string replaced via sensitive content filtering. We could consider:

Adding a sensitive: true value to the payload for matching events
Prefixing the UUIDS with sensitive-{x} or some other label

we might want to take action to make this filtering clearer when viewing the Plausible UI. It might not be immediately clear to folks viewing the analytics data that a UUID was actually a string replaced via sensitive content filtering

Oh yes, I thought of this too and forgot to include it in the issue. We absolutely need to be able to disambiguate. Adding a boolean payload property sounds fine, filteredPayload might be more accurate/broad without semantically overlapping with our other features around result filtering and sensitivity. A boolean would be easier to query/exclude than needing to match on the payload values themselves, though adding something to the payload value to mark a filtered term could also be helpful.


Decrease iOS Deployment Target

The deployment targets of new dylibs that were added are iOS 11.3, which is higher than OpenTerm's. There is no need for them to be so high, and it's causing warnings.

Fixed.


ayugram-desktop: init at 4.16.8

Description of changes

This PR adds ayugram-desktop, a Telegram Desktop fork with extended functionality.
To avoid code duplication where is telegram-desktop: refactor commit that refactors a bit so mainProgram was an argument instead of variable.
Fixes #307398.
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[x] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

cc @NickCao

And please make sure you are allowed to use the official telegram-desktop API key for this thirdparty client, or you should provide your own.

Official prebuilt AyuGram uses these API keys, would it be okay to use them? I used my own for now.

Would be better to ask them.

Seems like OP has deleted their account...?

Yes, i had to delete the account. I can reopen PR if someones want.

Yes reopen it please @duvetfall

Owner deleted account
@dvtfl Please reopen PR


Default macOS-latest image has changes

Azure is now using macOS-latest image as macOS-12

Can someone help me double check? But this is what seems to be happening now

@steved0x

Can you review this PR?
IMPORTANT: When this content is ready to merge, you must add #sign-off in a comment or the approval may get overlooked.

#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

@ArthurBrum It looks like it has rolled out for some people, let me confirm and I will get this merged. Thank you.

#sign-off


TSStringPercentDecode null-termination clipping on overflow.

Actually fixed by @petar last summer, but forgot to get it pushed to up.
Long URL's would cause buffer overflow write.

FreeBSD build successful! See https://ci.trafficserver.apache.org/job/Github-FreeBSD/1394/ for details.

Linux build successful! See https://ci.trafficserver.apache.org/job/Github-Linux/1288/ for details.


Babel ES6 + ESLint

I'm teaching courses on ES6, and I'd love to have interactive, embeddable examples and exercises using plunker.
Is there a way to configure it to use ES6, Babel, and ESLint (I need special lint rules)?

Not sure why you hadn't an answer (busy devs?), but while I was asking myself the same question, I did a simple search, and your question was on top of the list...
And, just below, I saw this tweet posted 5 days later: https://twitter.com/plnkrco/status/621326054020521984
It works: http://plnkr.co/edit/TU9fA4?p=preview
To repeat the information here, the content of the tweet is:

ES6 user? Just add "use babel"; or "use traceur"; to the top of your .js files. Configure the compilers with .babelrc and .traceurrc.
Perhaps it supports ESLint configuration this way? I haven't tried yet.

Hi @PhiLhoSoft @ericelliott yes, this is a case of busy developer syndrome.
I created a detailed explanation of using different compilers in plunker here: http://embed.plnkr.co/suu7Yg/preview

Do you a similar page about linters? I want to suppress some spurious warnings, like "no adjacent classes" in CSS (I don't target old browsers).

Alas no. I have not done anything to customize the behaviour of the default
jsHint included in the ace editor.
On Fri, Sep 18, 2015 at 10:03 AM Philippe Lhoste<EMAIL_ADDRESS>wrote:

Do you a similar page about linters? I want to suppress some spurious
warnings, like "no adjacent classes" in CSS (I don't target old browsers).
—
Reply to this email directly or view it on GitHub
https://github.com/filearts/plunker/issues/91#issuecomment-141459716.


apolo.json

Hello，
question 1：
My apolo.json file doesn't have an emotion column.

question 2：

I wanted to ask where the train.csv file was, I didn't find it.

Hi, please follow the instructions for dataset preparation.
You will find them after the process.


Updated lsl-viewer and minor updates to lab7

When preparing to use this course for our BrainBrowse event at NeuroTechTO, I made some small changes.
Notably, I updated the lsl-viewer code (same as in muse-lsl) to avoid some filter artifacts from the Ganglion.
Second, I moved the correlation analysis to a python script that could be run in terminal rather than Jupyter notebook.
Third, I added a couple new videos that I thought might work well, including a chicken sneeze.

This is great, thank you!


FAIL: TestThrottleChan on some machines (i.e. in virtualbox)

When i try make deb package over

git checkout
git submodules init
git submodules update
make clean && make && make deb

i have following error on some machines

 --- FAIL: TestThrottleChan (8.00 seconds)
     assertions.go:156:
     Location:       throttle_test.go:38
     Error:          Should be true
     Messages:       perSecond: 1000, bw: 822

possible reason it happening when machine have too small CPU resources
do you have .deb PPA ? or maybe i can skip test? or maybe need increase minimum for throttling?

Hi. Thanks for fix. But I think better add the ability to skip throttling test.

https://github.com/lomik/go-carbon/commit/48b183760ff658145e1013e037428f5b03ce5652
go test disabled for build deb. Long wanted

thanks a lot ;)


nanoc requires Ruby version ~> 2.4

Steps to reproduce

Read the installation instructions that indicate that nanoc works on Ruby 2.3
Try to install nanoc with Ruby 2.3

Expected behavior
The installation works as indicated in the documentation (i.e., nanoc works on Ruby 2.3).
Actual behavior
C:> gem install nanoc --version 4.10
Fetching: parallel-1.19.1.gem (100%)
Successfully installed parallel-1.19.1
Fetching: nanoc-4.10.0.gem (100%)
ERROR:  Error installing nanoc:
nanoc requires Ruby version ~> 2.4.
Details
See above
Crash log
See above.
Suggested fix
Update the documentation to indicate that nanoc requires Ruby >= 2.4
i.e., change the part that says "Nanoc supports the official Ruby interpreter from version 2.3 up."  at https://nanoc.ws/doc/installation/#compatibility-guarantees

Thank you for reporting! This is fixed in nanoc/nanoc.ws@33958cd now.


svchax always attempted when running from 3dsx

FBI always attempts to gain kernel with svchax when running from .3dsx, even though all the required services are already there (Luma allows this with the "svc/service/archive/arm9 exheader checks" patch), thus making it unusable on 11.0/1 as the exploit fails.
The exploit should only be attempted if not having the required access.

Should be fixed.


vim-airline + NERDtree missing char

environment

vim: neovim 0.4.4-1~ubuntu20.04.1~ppa1
vim-airline:
call dein#add('vim-airline/vim-airline')
call dein#add('vim-airline/vim-airline-themes')
OS:  Ubuntu 20.04 64bit on rpi4
Have you reproduced with a minimal vimrc: no
What is your airline configuration:
this is my .config/nvim/init.vim

scriptencoding utf-8
"dein Scripts-----------------------------
if &compatible
  set nocompatible               " Be iMproved
endif
" Required:
set runtimepath+=/home/leonardo/.local/share/dein/repos/github.com/Shougo/dein.vim

" Required:
if dein#load_state('/home/leonardo/.local/share/dein')
  call dein#begin('/home/leonardo/.local/share/dein')

  " Let dein manage dein
  " Required:
  call dein#add('/home/leonardo/.local/share/dein/repos/github.com/Shougo/dein.vim')
  call dein#add('Shougo/deoplete.nvim')

  " Add or remove your plugins here like this:
  "call dein#add('Shougo/neosnippet.vim')
  "call dein#add('Shougo/neosnippet-snippets')

  source /home/leonardo/.config/nvim/loaded-plugins.vim

  " Required:
  call dein#end()
  call dein#save_state()
endif

" Required:
filetype plugin indent on
syntax enable

" If you want to install not installed plugins on startup.
"if dein#check_install()
"  call dein#install()
"endif

"End dein Scripts-------------------------

"-------------------Load files-----------------
source ~/.config/nvim/base.vim
source ~/.config/nvim/plugins.vim
source ~/.config/nvim/ui.vim
source ~/.config/nvim/mappings.vim
source ~/.config/nvim/misc.vim

This is from my ~/.config/nvim/plugins.vim

" === NERDTree === "
"
" Show hidden files/directories
let g:NERDTreeShowHidden = 1

" Remove bookmarks and help text from NERDTree
let g:NERDTreeMinimalUI = 1

" Custom icons for expandable/expanded directories
let g:NERDTreeDirArrowExpandable = '⬏'
let g:NERDTreeDirArrowCollapsible = '⬎'

" Hide certain files and directories from NERDTree
let g:NERDTreeIgnore = ['^\.DS_Store$', '^tags$', '\.git$[[dir]]', '\.idea$[[dir]]', '\.sass-cache$']

" Wrap in try/catch to avoid errors on initial install before plugin is available
try

" === Vim airline ==== "
" Enable extensions
let g:airline_extensions= ['branch', 'hunks', 'coc']

" Update section z to just have line number
let g:airline_section_z = airline#section#create(['linenr'])

" Do not draw separators for empty sections (only for the active window) >
let g:airline_skip_empty_sections = 1

" Smartly uniquify buffers names with similar filename, suppressing common parts of paths.
let g:airline#extensions#tabline#formatter = 'unique_tail'

" Custom setup that removes filetype/whitespace from default vim airline bar
let g:airline#extensions#default#layout = [['a', 'b', 'c'], ['x', 'z', 'warning', 'error']]

" Customize vim airline per filetype
" 'nerdtree'  - Hide nerdtree status line
" 'list'      - Only show file type plus current line number out of total
let g:airline_filetype_overrides = {
  \ 'nerdtree': [ get(g:, 'NERDTreeStatusline', ''), '' ],
  \ 'list': [ '%y', '%l/%L'],
  \ }

" Enable powerline fonts
let g:airline_powerline_fonts = 1

" Enable caching of syntax highlighting groups
let g:airline_highlighting_cache = 1

" Define custom airline symbols
if !exists('g:airline_symbols')
  let g:airline_symbols = {}
endif

" Don't show git changes to current file in airline
let g:airline#extensions#hunks#enabled=0
" Vim airline theme
let g:airline_theme='onedark'

catch
  echo 'Airline not installed. It should work after running :PlugInstall'
endtry

if you are using terminal:

terminal: gnome terminal 3.36.2
$TERM variable: screen-256color
color configuration (:set t_Co?): Key code unset
if you are using Neovim:
does it happen in Vim: not try: do not wont to mess vim configuration

actual behavior
$ nvim .
display NERDtree and there is bad chars: E612 E613 E608 E609  ....
see screen shot.
expected behavior
see beatufull display.
normal utf8 char
screen shot (if possible)

best regard,
Leonardo
P.S. I have read and try integrating-with-powerline-fonts
but the instruction do not work for me and seems a little outdated do Ubuntu 20.04 system

How does this issue relate to vim-airline?
Isn't this a nerdtree issue?

Sorry, forgive my delay I have had same problem: low back pain.
I think that the problem is an integration problem on NERDTree and powerline-fonts but it can be my wrong assumption.
I will post this on NerdTree too.
best regards,
Leonardo

this is most likely a problem with your terminal emulator and some unicode settings and not in the scope of vim-airline.

Solved. I found instruction a little hard to understand for my brain.
I have search to find this:
Ubuntu
UbuntuMono
downloaded into ~/.local/share/fonts/
the folder is not existing on ubuntu you have to create it.
then do fc-cache -vf ~/.local/share/fonts
this make the char display
to me is a bit insane ... not the command itself but the path to find it


WIP support for getting interface status

This PR is still a WIP, but it demonstrates a large part of reading interface statuses.  The biggest API change is the addition of ifconfig_foreach_iface and ifconfig_foreach_ifaddr, which iterate over all interfaces and addresses, respectively, and call a user-provided callback.  This PR also demonstrates the need for issue #45 .  The functions isnd6defif, ifconfig_get_nd6, ifconfig_get_groups, ifconfig_get_ifstatus, and ifconfig_get_media all call ioctl with a third argument that isn't a struct ifreq

So I got kind of carried away on this PR and did a whole lot of things.  But now I've finished adding all of the functionality that I need for my project, so I'm going to cool off for awhile.  Please do review these commits and I'll make any required changes, but I suggest that after you close this PR we permanently move libifconfig into FreeBSD head's subversion repo.  That will attract more attention to it, and it will also let libifconfig use FreeBSD's testing infrastructure.  I can get some tests going pretty quickly once we do that.

I'll look through this once my dev environment is back up and running. I'm not sure about moving libifconfig development to FreeBSD's SVN, however, as it'd be very impractical considering I don't have any commit bit there.

Well that is an obstacle.  But I have access, and I can push your stuff through.  Another option is to push libifconfig into svn, then fork FreeBSD's git mirror at https://github.com/freebsd/freebsd for your own work.  Would that work for you?

There's already a first version in the repo. I'd like to start picking up patches and push them in, but I have a similar issue with life getting in the way. I certainly won't object to other people doing this for me!

Whenever you're ready to push to SVN, just let me know and I'll take care of it.

@Savagedlight have you had a chance to review this diff yet?  There are only a few days left to get it into FreeBSD 11.1.

@asomers Thank you for your awesome work. I've looked over some of it, but not really had a chance to review this yet, and won't be able to before 11.1 code slush. IRL just got a whole lot less busy though, so I'll catch up once I've had some much needed rest. :)

@Savagedlight ping? :)

I was pointed at this today and this code solves a problem we are facing.
Anything I can do to help get this moved along?

I would like make one more change to my copy (don't cache ifaddrs longer than necessary) and put it through a test cycle here at $WORK.  If that succeeds, then I think we should commit this to subversion and make that the canonical repo.
I also have Ruby bindings, if anybody cares.

If we do that we'll have to sponsor @Savagedlight for a commit bit. :)

Rebased onto master

I've merged it into a new branch (asomers-fib) as this PR is huge, and requires a staging area outside of master for further review/fixes.

I see that you added back the braces around single-line if statements.  I can live with that.  What else would you like to see changed?  I'd like to get this into SVN within the next two weeks.

Opened a review for integrating back into FreeBSD.  https://reviews.freebsd.org/D14463 .  Due to time constraints on my end, I intend to commit this within 24 hours unless  major objections are raised.

@Savagedlight I'd be happy to help transfer this repository to sit under the FreeBSD Github organisation with an appropriate administrator role for you (and contributor roles for others), if that's something you'd like and would find helpful. We have other externally developed but otherwise official/authoritative projects (some of which push to SVN).

Closing this PR, because it's been committed upstream to FreeBSD.
https://svnweb.freebsd.org/base/head/lib/libifconfig/libifconfig.c?revision=329853&view=markup


ios example chat app

should consume the released package and show how a basic ios app can use Topics to send and receive messages

Package.swift file needs to specify swift-tools-version: 5.6 to use an exact package version


TP2000 401 - Improve our test coverage of the importer to identify problems and plan next steps

TP2000-401 - Improve our test coverage of the importer to identify problems and plan next steps
Why

Improve test coverage for the importer
Increate team familiarity and awareness of this part of the codebase
precursor to resolving and improving the importer

What

test as much of the importer as possible
Understand the separate functions, rename if needed, refactor and improve readability and testability

Notes

If the unit tests pass on CI and coverage for the importer has improved, this should be the main indication of success.
Function API should not change unless necessary
Existing tests should pass without change
All import functions should continue to work

Checklist

no migrations or dependency updates required

Good work adding all this new test coverage.
A couple of things might be more pyest-ified to reduce the amount of code.

Codecov Report

Merging #646 (02f49c0) into master (519bb70) will increase coverage by 0.21%.
The diff coverage is 95.44%.

 Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Void Cells fail to give items.

After fully charging a Void Cell it fails to give any items.

Do you have SivsItems installed? People reported this exact bug with that mod.

Haven't had this issue with "MysticItems" specifically.
"SivsItems" was pointed out, this is also an issue with the current "TILER2", a dependency for certain item mods.

Oh, alright, so it is a bug caused by other mods. Thanks for the info! I'll close this then as it's not something I can fix.

Do you have SivsItems installed? People reported this exact bug with that mod.

I do not have that mod installed. I have Tiller2 for Classic Items, however, while I was testing I disabled Mythic Items (and only that mod) and it fixed the issue.
Not sure if that helps, I tested it in 1.16, so I'm not sure if 1.17 fixed it, but I'll test later tonight. I'll also try and see if disabling tiller and classic items fixes it also.


Perplexity (ppl) Calculation of Local Sparse Model: NaN issue

👋 Hello Neural Magic community developers,
I encountered an issue while calculating the perplexity for a locally converted Llama3-8B sparse model using the llm-compress library. I'm refer the sparse conversion example script and change model to meta-llama/Meta-Llama-3-8B-Instruct by my self, the sparse conversion need ~ 1.2 hours to finish.
Here’s a detailed breakdown:
Describe the bug
While trying to compute the WikiText2 Perplexity for a Llama3-8B model that has been sparsified (load local model from disk), the resulting perplexity values always turn out to be NaN. I suspect that some configurations might not be properly set when using the custom SparseAutoModelForCausalLM class in combination with the compressed-tensors library.
Expected behavior
I expected the perplexity values to be reasonable and comparable to the official Hugging Face models. For example, when testing with the standard Llama-3.2-3B model from Hugging Face (without sparsification), I got a perplexity of around ~8.8 with the following parameters:
•	max_length=16K
•	stride=1, 2, 4, 8, 16K

I expected similar results for the sparse model, not NaN values.
Environment
I use RunPod online env with A100-80GB-SXM *2
To Reproduce
Steps to reproduce the behavior:
1.	Convert the Llama3-8B model using llm-compress to a sparse version.
2.	Load the sparse model using **_SparseAutoModelForCausalLM_** (same process [here](https://github.com/vllm-project/llm-compressor/tree/main/examples/quantization_24_sparse_w4a16) ) and set up the environment to calculate perplexity.
3.	Run perplexity calculation on WikiText2 dataset following Hugging Face’s [official perplexity guide](https://huggingface.co/docs/transformers/perplexity), but using the custom sparse model.
4.	Observe the NaN perplexity values in the output.

Errors
Here’s the output I receive when running the perplexity calculation, see the attachment image. The perplexity of local Llama-8B model (load by SparseAutoModelForCausalLM class) always be NaN value. Test with Llama-3B model (load by AutoModelForCausalLM class) can successfully get ppl value.
Sparse Llama 8B (load by SparseAutoModelForCausalLM class) : ppl will be NaN

Load Online Llama 3B (load by AutoModelForCausalLM class) : successfully get ppl value

Additional context
The same perplexity calculation process works perfectly when using the Hugging Face Llama-3.2-3B model without sparsification, which gives a perplexity value of ~8.8. I believe the issue lies in either the custom sparse model class or the integration with compressed-tensors. Maybe I miss some additional configuration/setting of Sparse model ? 🧐
Any guidance on this would be appreciated! 🥰
Additional Question
How to load the final quantization model (i.e the model be saved in stage_quantization folder) correctly ?
I also interest of ppl of final quantization model, but I try load with SparseAutoModelForCausalLM it can't not be work 😢
it shows some message mean : "... ... class not support ..."
So how to load the final quantization model correctly ? any documentation can be refer ? 🙏🏼

Can you share the model?

Hi @robertgshaw2-neuralmagic Robert, you were right to question this. I retested the original llama-7B Sparse conversion example from llm-compressor today, along with a simple model.generate test to check the model's text output. It turns out the model doesn’t seem to generate any correct outputs, and as expected, I couldn’t calculate the model’s perplexity under these circumstances.
Load local Sparse Llama-7B model

Test Model Output (Ref)

Calculating Perplexity

NaN Result

I think the issue is now clearer. I believe the problem lies in how I load the local Sparse Model & Tokenizer. Does llm-compressor have any examples or documentation I can refer to? Any suggestions would be appreciated, thank you! 🥰
Also, I apologize for not providing the exact sparse model I used. After running it in the online RunPod environment, I didn’t download the model. However, this process should be easy to replicate. Here are the steps I followed for testing:
Step 1: Execute the official llama-7B sparse conversion example from llm-compressor :  run python llama7b_sparse_w4a16.py
Step 2: After about an hour, the sparse conversion finishes, and you’ll find the model saved in three stages in the output folder output_llama7b_2:4_w4a16_channel and I rename to output_llama7b_2_4_w4a16_channel for easy use.
Step 3: Load the stage_finetuing sparse model and Tokenizer in output_llama7b_2_4_w4a16_channel/stage_finetuning, and follow the HuggingFace process to calculate perplexity"
##The Success Case with Llama3-3B online model

Test Model Output

Calculating Perplexity

Result

Summary
I want to correctly load the local sparse model and calculate its perplexity as an evaluation metric. However, it seems that I haven’t used the correct method to load the model (through the SparseAutoModelForCausalLM class) or the Tokenizer. If there are any documents or resources I can refer to, please let me know. Thanks! 🥰
And my testing jupyter notebook is in attatchment.
Perplexity of  model.zip


Update build wheel to macos-11

According to this issue, wheels based on macos-10.15 are now deprecated. This updates the Action brought in by #1017 so that macos-11 is now used instead.
Tagging @EiffL in case he has any other suggestions for wheel updates. If not, this is the last planned commit prior to releasing v0.8.

Yeah I think that's fine. But also note that while you're at it, you should update the version of cibuildwheel to the latest release.
So, on line 21:
        uses<EMAIL_ADDRESS>
This will ensure that you build wheels for new versions of python as well, like 3.10 and even 3.11


npm install failed but npm install --legacy-peer-deps works

Hi, my name is Malik Akbar Hashemi Rafsanjani, a final year computer science student from Indonesia (Bandung, Institute of Technology) 👋👋
I am very excited to contribute to this project for Google Summer of Code (GSoC) 2024 and recently I tried to run the project. However, I got errors when I installed the dependencies using npm install. Here I also attach the error log of the command. I also tried to use npm ci but it also failed
Then, I searched in the internet and tried to use the command npm install --legacy-peer-deps. It successfully installs the dependencies and I successfully run the app using npm run dev
is the current intended usage using --legacy-peer-deps? Or do you guys have any feedback / concerns? Thank you in advance!
error.txt

I have several experiences, such as internships and competitions, regarding Web Development and Data Science / Machine Learning. I am particularly interested in the DataLoom project as I have a passion for Web Development and Data-related projects and won several Hackathon and Data Science competitions.
Here is my profile
GitHub: http://github.com/malikrafsan
Personal Website: https://site.malikrafsan.tech/
Email<EMAIL_ADDRESS>Resume: https://drive.google.com/file/d/1Y6hbJb7PhFKJV4yw4BVGk_ZUowybpsZe/view

@birm  I will love to work on a fix for this issue.


Users/tihuang/outputvar

Do you need to change the version number in Constants.cs to "2.119.0"? Perhaps this happens automatically during the build process.

I need when i publish the 2.119.0 agent. :)


Getting EJSONPARSE error on running 'npm install -g @angular/cli'

Please provide us with the following information:

OS?

Ubuntu 16.04 LTS

Versions.
N/A. Unable to install angular-cli itself
Repro steps.

I ran 'npm install -g @angular/cli'

The log given by the failure.

npm WARN optional SKIPPING OPTIONAL DEPENDENCY<EMAIL_ADDRESS>(node_modules/@angular/cli/node_modules/chokidar/node_modules/fsevents):
npm WARN notsup SKIPPING OPTIONAL DEPENDENCY: Unsupported platform for<EMAIL_ADDRESS>wanted {"os":"darwin","arch":"any"} (current: {"os":"linux","arch":"x64"})
npm ERR! Linux 4.4.0-64-generic
npm ERR! argv "/home/mymachine/.nvm/versions/node/v6.9.2/bin/node" "/home/mymachine/.nvm/versions/node/v6.9.2/bin/npm" "install" "-g" "@angular/cli"
npm ERR! node v6.9.2
npm ERR! npm  v3.10.9
npm ERR! file /home/mymachine/.npm/html-entities/1.2.0/package/package.json
npm ERR! code EJSONPARSE

npm ERR! Failed to parse json
npm ERR! No data, empty input at 1:1
npm ERR!
npm ERR! ^
npm ERR! File: /home/mymachine/.npm/html-entities/1.2.0/package/package.json
npm ERR! Failed to parse package.json data.
npm ERR! package.json must be actual JSON, not just JavaScript.
npm ERR!
npm ERR! This is not a bug in npm.
npm ERR! Tell the package author to fix their package.json file. JSON.parse
npm ERR! Please include the following file with any support request:
npm ERR!     /home/mymachine/RnD/angular-cli/npm-debug.log
Mention any other details that might be useful.

Thanks! We'll be in touch soon.

Can you please attach your /home/mymachine/.npm/html-entities/1.2.0/package/package.json file? :)

Hi @markfejes sorry for the delayed response, was on a vacation. The file that you asked for '/home/mymachine/.npm/html-entities/1.2.0/package/package.json' exists but in my machine but is completely empty.

You seem to have a broken package, html-entities. Try removing it and then you should be able to install the CLI.

I tried npm remove -g html-entities. But the problem persists.

npm cache clean
Does the job. After that I ran npm install -g @angular/cli again.