Scrutiny (Full Access) - error during startup

Description
I have been using device type sat for previous version 0.7.3.. now error message during startup
Reproduction steps
Error during addon startup

Addon Logs
-----------------------------------------------------------
 Add-on: Scrutiny (Full Access)
 Scrutiny WebUI for smartd S.M.A.R.T monitoring (Full Access)
-----------------------------------------------------------
 Add-on version: v0.8.0-2
 You are running the latest version of this add-on.
 System: Home Assistant OS 12.1  (aarch64 / raspberrypi4-64)
 Home Assistant Core: 2024.3.1
 Home Assistant Supervisor: 2024.03.0
-----------------------------------------------------------
 Please, share the above information when looking for help
 or support in, e.g., GitHub, forums
-----------------------------------------------------------

time="2024-03-17T16:13:16+02:00" level=info msg="Verifying required tools" type=metrics
time="2024-03-17T16:13:16+02:00" level=info msg="Executing command: /usr/sbin/smartctl --scan --json --dev sat" type=metrics
time="2024-03-17T16:13:16+02:00" level=info msg="Executing command: /usr/sbin/smartctl --info --json --dev sat /dev/sda" type=metrics
time="2024-03-17T16:13:16+02:00" level=info msg="Generating WWN" type=metrics
time="2024-03-17T16:13:16+02:00" level=info msg="Sending detected devices to API, for filtering & validation" type=metrics
time="2024-03-17T16:13:16+02:00" level=info msg="<IP_ADDRESS> - db21ed7f-scrutiny-fa [17/Mar/2024:16:13:16 +0200] \"POST /api/devices/register\" 200 637 \"\" \"Go-http-client/1.1\" (3ms)" clientIP=<IP_ADDRESS> hostname=db21ed7f-scrutiny-fa latency=3 method=POST path=/api/devices/register referer= respLength=637 statusCode=200 type=web userAgent=Go-http-client/1.1
time="2024-03-17T16:13:16+02:00" level=info msg="Collecting smartctl results for sda\n" type=metrics
time="2024-03-17T16:13:16+02:00" level=info msg="Executing command: /usr/sbin/smartctl --xall --json --dev sat --device sat /dev/sda" type=metrics
time="2024-03-17T16:13:16+02:00" level=error msg="smartctl returned an error code (1) while processing sda\n" type=metrics
time="2024-03-17T16:13:16+02:00" level=error msg="smartctl could not parse commandline" type=metrics
time="2024-03-17T16:13:16+02:00" level=info msg="Publishing smartctl results for 0x5002538e30823ba8\n" type=metrics
time="2024-03-17T16:13:16+02:00" level=error msg="An error occurred while saving smartctl metrics unprocessable entity: failure writing points to database: partial write: points beyond retention policy dropped=1" type=web

Architecture
No response
OS
HAos

Hi, sorry about that... I don't see anything wrong with the addon code from the log I think you'll have better support from the app repo : https://github.com/AnalogJ/scrutiny

Okay, thanks

Hey @alexbelgium
I think this is related to the addon overriding the smartctl command:
https://github.com/alexbelgium/hassio-addons/blob/22ed7169a18844f6b85f8dc9210d48d05fca7bec/scrutiny/rootfs/etc/cont-init.d/01-configuration.sh#L71-L76
The default commands don't include the --device flag - https://github.com/AnalogJ/scrutiny/blob/master/collector/pkg/config/config.go#L46-L49
However it's conditionally added depending on the device type - https://github.com/AnalogJ/scrutiny/blob/master/collector/pkg/collector/metrics.go#L128

the end result is 2 sets of device flags --dev and --device

https://github.com/AnalogJ/scrutiny/issues/607#issuecomment-2002730925

Thanks very much @AnalogJ !
I've removed the problematic code, could you please confirm @pxFIN if it works?
It was added a long time ago to solve some devices not being recognized and I suppose it is not needed anymore

I will when i see new release

Just refresh your repo manually or wait a bit and it will appear

Btw, did you update only scrutiny but not full access version ?

ah - good point! Thanks I'll update FA

New version installed, tested and it's still the same problem during startup

Did more experimenting.. uninstalled Scrutiny FA addon.. installed again
Here's relevant logs
starting scrutiny
2024/03/19 13:17:53 No configuration file found at /opt/scrutiny/config/scrutiny.yaml. Using Defaults.

 ___   ___  ____  __  __  ____  ____  _  _  _  _
/ __) / __)(  _ \(  )(  )(_  _)(_  _)( \( )( \/ )
\__ \( (__  )   / )(__)(   )(   _)(_  )  (  \  /
(___/ \___)(_)\_)(______) (__) (____)(_)\_) (__)
github.com/AnalogJ/scrutiny                             dev-0.8.0

Start the scrutiny server
time="2024-03-19T13:17:53+02:00" level=info msg="Trying to connect to scrutiny sqlite db: /opt/scrutiny/config/scrutiny.db\n" type=web
time="2024-03-19T13:17:53+02:00" level=info msg="Successfully connected to scrutiny sqlite db: /opt/scrutiny/config/scrutiny.db\n" type=web
time="2024-03-19T13:17:53+02:00" level=info msg="InfluxDB certificate verification: true\n" type=web
scrutiny api not ready
time="2024-03-19T13:17:53+02:00" level=info msg="Database migration starting. Please wait, this process may take a long time...." type=web
time="2024-03-19T13:17:53+02:00" level=info msg="Database migration completed successfully" type=web
time="2024-03-19T13:17:53+02:00" level=info msg="SQLite global configuration migrations starting. Please wait...." type=web
time="2024-03-19T13:17:53+02:00" level=info msg="SQLite global configuration migrations completed successfully" type=web
[13:17:54] INFO: Starting NGinx...
time="2024-03-19T13:17:58+02:00" level=info msg="Checking Influxdb & Sqlite health" type=web
time="2024-03-19T13:17:58+02:00" level=info msg="<IP_ADDRESS> - db21ed7f-scrutiny-fa [19/Mar/2024:13:17:58 +0200] \"GET /api/health\" 200 16 \"\" \"curl/7.88.1\" (3ms)" clientIP=<IP_ADDRESS> hostname=db21ed7f-scrutiny-fa latency=3 method=GET path=/api/health referer= respLength=16 statusCode=200 type=web userAgent=curl/7.88.1
time="2024-03-19T13:17:58+02:00" level=info msg="<IP_ADDRESS> - db21ed7f-scrutiny-fa [19/Mar/2024:13:17:58 +0200] \"HEAD /api/health\" 200 0 \"\" \"curl/7.88.1\" (17ms)" clientIP=<IP_ADDRESS> hostname=db21ed7f-scrutiny-fa latency=17 method=HEAD path=/api/health referer= respLength=0 statusCode=200 type=web userAgent=curl/7.88.1
starting scrutiny collector (run-once mode. subsequent calls will be triggered via cron service)
2024/03/19 13:17:58 No configuration file found at /opt/scrutiny/config/collector.yaml. Using Defaults.

 ___   ___  ____  __  __  ____  ____  _  _  _  _
/ __) / __)(  _ \(  )(  )(_  _)(_  _)( \( )( \/ )
\__ \( (__  )   / )(__)(   )(   _)(_  )  (  \  /
(___/ \___)(_)\_)(______) (__) (____)(_)\_) (__)
AnalogJ/scrutiny/metrics                                dev-0.8.0

time="2024-03-19T13:17:58+02:00" level=info msg="Verifying required tools" type=metrics
time="2024-03-19T13:17:58+02:00" level=info msg="Executing command: smartctl --scan --json" type=metrics
time="2024-03-19T13:17:58+02:00" level=info msg="Sending detected devices to API, for filtering & validation" type=metrics
time="2024-03-19T13:17:58+02:00" level=info msg="<IP_ADDRESS> - db21ed7f-scrutiny-fa [19/Mar/2024:13:17:58 +0200] \"POST /api/devices/register\" 200 40 \"\" \"Go-http-client/1.1\" (1ms)" clientIP=<IP_ADDRESS> hostname=db21ed7f-scrutiny-fa latency=1 method=POST path=/api/devices/register referer= respLength=40 statusCode=200 type=web userAgent=Go-http-client/1.1
time="2024-03-19T13:17:58+02:00" level=info msg="Main: Completed" type=metrics
time="2024-03-19T13:18:03+02:00" level=info msg="Checking Influxdb & Sqlite health" type=web
time="2024-03-19T13:18:03+02:00" level=info msg="<IP_ADDRESS> - db21ed7f-scrutiny-fa [19/Mar/2024:13:18:03 +0200] \"GET /api/health\" 200 16 \"\" \"curl/7.88.1\" (2ms)" clientIP=<IP_ADDRESS> hostname=db21ed7f-scrutiny-fa latency=2 method=GET path=/api/health referer= respLength=16 statusCode=200 type=web userAgent=curl/7.88.1

smartctl command (smartctl --scan --json) is missing device type..  no scrutiny.yaml so defaults are used..

I switched from backups back to 0.7.2 which works.. 0.7.3 finds SSD but always shows failed
smartctl gives checksum error but still can see all the smart parameters

Thanks ; given none of my code change in that time frame I don't see how to support you


RFE: Introduce a general object for data that can be reused in the specification

I noticed at
https://github.com/coreos/fcct/blob/master/docs/configuration-v1_1.md
that systemd -> contents does not have variant for including the contents from a local file. For me it would have been convenient to have that feature.
Why not generalize the data input, so that strings and bytearrays always can be included from URLs, local files or inline?
Something like two new "datatypes":
general_text_data and general_binary_data
Just a sketch:

general_text_data (object): the config that will replace the current.

source (string): the URL of the config. Supported schemes are http, https, s3, tftp, and [data][rfc2397]. Note: When using http, it is advisable to use the verification option to ensure the contents haven't been modified. Mutually exclusive with inline and local.
inline (string): the contents of the config. Mutually exclusive with source and local.
local (string): a local path to the contents of the config, relative to the directory specified by the --files-dir command-line argument. Mutually exclusive with source and inline.
http_headers (list of objects): a list of HTTP headers to be added to the request. Available for http and https source schemes only.

name (string): the header name.
value (string): the header contents.

verification (object): options related to the verification of the config.

hash (string): the hash of the config, in the form <type>-<value> where type is either sha512 or sha256.

If it would be possible to reference the string contents of one of
passwd -> users -> ssh_authorized_keys
with a general_text_data, you could start referencing your public ssh key from Github, as they are downloadable like this
wget https://github.com/eriksjolund.keys

I think this is reasonable. Something similar was already done for the Ignition types: https://github.com/coreos/ignition/pull/953

I suspect that allowing arbitrary fields to come from URLs or local files would introduce more complexity to the spec than the feature is worth.
For your original use case, see https://github.com/coreos/ignition/pull/986.

At first I thought the URL:s were downloaded by fcct (at "transpile-time" so to say) but now I see the URL:s
are given to the Ignition file.
So this Github issue should have been placed here
https://github.com/coreos/ignition
instead.
Regarding introducing more complexity:
The change would be like changing a datatype,
i.e. from string to general_text_data. In the source code,
shouldn't that just be a small change?
I understand that this RFE would introduce more challenges
in how to easily present the file format standard.
The major advantage with this


Fixed pre-release workflow

[x] I have read the contributing guidelines, and I agree with the Code of Conduct.
[x] Have you checked that there aren't other open pull requests for the same changes?
[x] Have you tested that the committed code can be executed without errors?
[x] This PR is not composed of garbage changes used to farm GitHub activity to enter potential Crypto AirDrops.
Any user suspected of farming GitHub activity with crypto purposes will get banned. Submitting broken code wastes the contributors' time, who have to spend their free time reviewing, fixing, and testing code that does not even compile breaks other features, or does not introduce any useful changes. Thank you for your understanding.

I found that the GitHub action did not run with your latest pre-release. After some more digging I found the the prereleased type is a bit misleading. Following this PR change it should actually work now.

Thanks for catching it, I was wondering why it wasn't running the workflow!


feat: using MicahParks/keyfunc for JWKs stuff

Hi there, thanks for reaching out. There's never a clear answer if one should add a dependency or implement the functionality they need.
In this case, I'm going to stick with the code we have, instead of adding a dependency.


Update to Design System 66

What and why?
This updates to the latest Design System
How to test?
Smoke test
Jira
RAS-927

/deploy crockerm

/deploy robinm3


Update 6_creating-a-block.md

mentioned file mistake

Description

Related Issues

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Pester issue #1650 - xplatform path separator for additional module path

What problem does this PR address?
Can't test PS module (additional module path) on a Linux build box.
Is there a related Issue?
https://github.com/pester/Pester/issues/1650

Thanks for this. Looks good so I'll get it deployed now and should be available in 15 minutes or so.

I can confirm that the latest version deployed to the Azure DevOps Marketplace (Aug 15 2020) has resolved the issue. Thanks.


ToolBox/ Scripts to extract annotations from CVAT XML files

Looks like the CVAT XML converter (to Pascal VOC) script works only on data collected in the annotation mode and not on interpolation mode. It will be very useful to have a matlab or python scripts/ toolbox available to extract bounding box coordinates files takes in interpolation mode (with track id). This will help us convert BB  to whatever format we want (Eg.YOLO format)

Hi @nmanovic ,
I am trying to add tracks for

[ ]  Support TF Record format

regarding

Sample scripts can be found here: https://github.com/opencv/cvat/tree/develop/utils

For the case of interpolation, will it be good to create the image frames for the user in a .tmp directory rather than asking the user to convert with ffmpeg?
if yes, should I reference the extraction class _FrameExtractor or duplicate it in the conversion section?
For :

[ ]  Prepare a python library which can parse CVAT XML annotations into some python structures (you can call it cvat/utils/cvat/parser or something like that). The library should support both interpolation and annotation CVAT XML formats.

will it be good for the unified structure to look like :
[
  {
    'name': <img_file_name>,
    'height': <number>,
    'width': <number>,
    'boxes':[
                  'xbr': <number>,
                   ...
                   'attributes': [
                                         <attribute>: <value>,
                                         ...
                                 ]
             ]
  },
  ...
]

?

I'm going to close the issue. Now CVAT supports downloading annotations in Pascal VOC directly from UI. Soon (in a week) it will support YOLO and TF records.

Hi,
I am also facing a similar problem. I have annotations on the image level. I have labeled some images as invalid during the annotation.

But when I export the "Pascal VOC XML" format, I don't get the information, related to these image-level labels i.e. "unvalid" or "invalid"
Any idea?

@tanmayGIT , how should information about image-level labels be present in Pascal VOC XML format?

Thanks for your response. Then how could I obtain the image level label information from the exported annotations? Should I use some other annotation formation to get such information ?
I really appreciate any help you can provide.

Hello again,
In fact, I got the answer. If we export in "CVAT for Images 1.1"  format then we will have the information at the image level as well as the annotation level.  Then, we just need to parse the XML and convert it into the desired format. For example in my case,  I needed it in the YOLO format.

Here is the code, I wrote to parse the CVAT formatted XML file, it may help others :
`    def parse_cvat_xml(xml_file):
"""
Function to read the XML file and extract the information in dictionary format:
Args:
xml_file: The path of the XML file
Returns:
"""
root = EleTree.parse(xml_file).getroot()
    keep_all_valid_imag_info_together = []
    get_meta_data = root.findall("image")

    # Parse the XML Tree
    for elem in get_meta_data:

        image_whole_info = {}

        image_id = int(elem.attrib["id"])
        image_full_path = elem.attrib["name"]
        image_width = int(elem.attrib["width"])
        image_height = int(elem.attrib["height"])

        image_whole_info["image_id"] = image_id
        image_whole_info["full_path"] = image_full_path
        image_whole_info["image_width"] = image_width
        image_whole_info["image_height"] = image_height

        imag_id_valid_flag = AnalyzeAnnotationFiles.verify_annotation_image_ids_range(image_id)
        if not imag_id_valid_flag:  # if the image id flag is not valid i.e. the image is out of required range
            continue

        image_tag_meta = elem.findall("tag")

        unvalid_flag = False
        if any(True for _ in image_tag_meta):

            for get_tag in image_tag_meta:
                obtain_tag = get_tag.attrib["label"]
                if obtain_tag == "unvalid":
                    unvalid_flag = True
                    break

        if unvalid_flag:
            continue

        image_level_all_bbox_yolo_coords = {'yolo_coords': []}
        image_level_all_bbox_attrib = {'boox_attrib': []}

        object_metas = elem.findall("box")
        for bbox in object_metas:

            box_label = bbox.attrib["label"]
            xtl = float(bbox.attrib["xtl"])
            ytl = float(bbox.attrib["ytl"])
            xbr = float(bbox.attrib["xbr"])
            ybr = float(bbox.attrib["ybr"])

            # CVAT to yolo
            yolo_x = round(((xtl + xbr) / 2) / image_width, 6)
            yolo_y = round(((ytl + ybr) / 2) / image_height, 6)
            yolo_w = round((xbr - xtl) / image_width, 6)
            yolo_h = round((ybr - ytl) / image_height, 6)

            # Keeping all the yolo coords
            image_level_all_bbox_yolo_coords['yolo_coords'].append([box_label, yolo_x, yolo_y, yolo_w, yolo_h])

            bbox_metas = bbox.findall("attribute")

            keep_each_attribute = {}
            for attr in bbox_metas:
                attribute_name = attr.attrib["name"]
                attribute_value = attr.text

                keep_each_attribute[attribute_name] = attribute_value

            image_level_all_bbox_attrib['boox_attrib'].append(keep_each_attribute)

        # keeping all the bbox yolo coordinates info of the image
        image_whole_info["all_bbox_yolo_coords"] = image_level_all_bbox_yolo_coords

        # keeping all the bbox attribute info of the image
        image_whole_info["all_bbox_attributes_info"] = image_level_all_bbox_attrib

        keep_all_valid_imag_info_together.append(image_whole_info)

    return keep_all_valid_imag_info_together`


Made the whole website

added all the content in the website plus made style.css and styled it :)

Thanks hope you will like it!


Geometry limit

I wonder how many AABBs I can use max in the Acceleration Structure.
I set the AS as one geometry with 512 AABBs in a bottom-level AS and 64,640 instances in a top-level AS.
So total number of AABBs is 33,095,680(=512*64,640).
I think this number of AABBs seems to occur wrong return value of instanceID() or primitiveID() in *.hlsl.
As the result of some experiments, I think that the number of AABBs under about 2^24(16,777,216) is working fine when I call instanceID() or primitiveID().
I read the spec in here.
https://microsoft.github.io/DirectX-Specs/d3d/Raytracing.html#geometry-limits
There is not about AABBs limit in detail, and if it is right that one AABB has 12 triangles primitives, in my case of 33,095,680 AABBs have 397,148,160(33,095,680*12) primitives, which is below 2^29(536,870,912) that is written in the spec and it is the proper number.
But there seem to show the wrong behavior.
So I'd like to know the maximum number of AABBs in the AS.

An AABB is a primitive in itself.  It is not comprised of 12 triangles. There is no need to multiply the number of instances with the number of primitives in the BLAS, as that does not contribute to any limit.  There is a 29-bit limit on the number of total primitives in a single BLAS with a 24-bit limit within a single geometry. And the maximum instance count in a TLAS is 24-bit.
If you are getting incorrect values for instance or primitive ID beyond a certain size of BVH, it could either be a bug in the runtime or the driver, or it could be user error. You are welcome to join our Discord channel to extend your questions to a variety of experts.  https://discord.com/invite/directx


SAK-31379 Error Message Cutoff / Awkward Spacing in Assessment Type

This also fixes SAM-2932 Display issues in Assessment types list

LGTM


Problem in changing the optimizer

I tried different optimizer during the training period: SGD and Adam. However, after I modified trainer.py as: self.optimizer = optim.Adam(self.model.parameters(), lr=learning_rate) and run python train.py --policy sarl in terminal, it appears:
Traceback (most recent call last):
File "train.py", line 177, in
main()
File "train.py", line 159, in main
explorer.run_k_episodes(env.case_size['val'], 'val', episode=episode)
File "/home/jackeywang/CrowdNav/crowd_nav/utils/explorer.py", line 42, in run_k_episodes
action = self.robot.act(ob)
File "/home/jackeywang/CrowdNav/crowd_sim/envs/utils/robot.py", line 13, in act
action = self.policy.predict(state)
File "/home/jackeywang/CrowdNav/crowd_nav/policy/multi_human_rl.py", line 58, in predict
raise ValueError('Value network is not well trained. ')
ValueError: Value network is not well trained.
I can't figure out why different optimizer can cause error like that, hope for your help.

@westbrook123 did you print the values of the action? Looks like the network might have produced NaN, which led to no action being chosen.
I don't know why just changing the optimizer makes such a difference, but in my experience, at least in this repo, SGD works better than Adam.

@westbrook123 did you print the values of the action? Looks like the network might have produced NaN, which led to no action being chosen.
I don't know why just changing the optimizer makes such a difference, but in my experience, at least in this repo, SGD works better than Adam.

Thanks for your reply, I won't modify the optimizer any more. By the way, I have also read your work RGL, may I ask how the heatmap in your paper is drawn? Thank you so much!

The code for plotting the heatmap is here: https://github.com/ChanganVR/RelationalGraphLearning/blob/8e87aa5ed8221efd688f8e6857ba4c38637bf6e1/crowd_sim/envs/crowd_sim.py#L591-L615

The code for plotting the heatmap is here: https://github.com/ChanganVR/RelationalGraphLearning/blob/8e87aa5ed8221efd688f8e6857ba4c38637bf6e1/crowd_sim/envs/crowd_sim.py#L591-L615

Thankyou so much, I'll try it.


Add Mobile Menu Icon Animation

Related Issue
As a web user/visitor, I need a different menu icon when navigation is opened or closed. Therefore, I would like to add the "mobile-menu-icon animation" feature, can I work on this?
Screenshot (GIF)

Go for it @febriadj
Show your love by stargazing the repo 🌟


Making a recipe using two fluids in a mixer beraks things very badly

I attempted to make this recipe
<recipeType:create:mixing>.addRecipe("icing_mixing", "heated", <fluid:contenttweaker:icing> * 20, [<tag:items:forge:crops/vanillabean> * 2], [<fluid:contenttweaker:molten_sugar> * 20, <fluid:minecraft:milk> * 20], 20);
Using a cusotm fluid and milk and vanilla beans to make a custom fluid called icing. this does not work no mixing occurs despite a recipe appearing in JEI
I changed the recipe to only use the molten sugar custom fluid, then proceeded with the following tests.
I added the recipe
<recipeType:create:mixing>.addRecipe("test_one", "none", <item:minecraft:diamond>, [<item:minecraft:air>], [<fluid:minecraft:lava>, <fluid:minecraft:water>]);
to test if it was an issue with two fluid recipes, which it wasn't as this made 1mb lava and 1mb water into 1 diamond.
next I attempted
<recipeType:create:mixing>.addRecipe("test_one", "none", <item:minecraft:diamond>, [<item:minecraft:dirt>], [<fluid:minecraft:lava>, <fluid:minecraft:water>]);
and this too worked, and made lava, water, and dirt into a diamond.
so then I re-added the second fluid to the original recipe and it instantly broke itself  resulting in no mixing occurring.

Please upload your crafttweaker.log file to pastebin. (/ct log)

https://pastebin.com/4HDkgAPP

like this?

So I'm unable to reproduce,
I used the following script as I don't have those items / fluids in my game:
<recipeType:create:mixing>.addRecipe("icing_mixing", "heated", <fluid:minecraft:lava>, [<item:minecraft:white_wool> * 2], [<fluid:create:honey> * 20, <fluid:minecraft:water> * 20], 20);

Something to keep in mind, you set the recipe to "heated" meaning that it needs to have a blaze burner beneath it and that blaze burner needs to have fuel (that confused me for a while).

i have the heating set up properly, and  in this case maybe ist an issue with content tweaker fluids?

It shouldn't be an issue with the contenttweaker fluid, is your script (the one adding the recipe).
Did you try my script to see if that one works?

i did not try your specific script no, but when i used my script using water and lava it worked normally

Yes but if you look, my script outputs a fluid, like your original one does, your other scripts don't. That is why I am saying try my script sin e it could be treating things differently

oh good point, i'll try that when i get home

And replacing the water in my script with a contenttweaker fluid? Does that work?

that breaks it again

Then report it to Content Tweaker, since something with those fluids must be messed

done


Remove ContentFormatter from Document

This came from the early days of the project and was inspired by llamaindex.  In practice, the formatting of the prompt for different use cases, to include metadata or not, seems to be best handled outside the Document class.
If you have a good use case for keeping this functionality in Document, please comment.

need to review the impact in textpslitter impls


week2_project files

Project Self Assessment

Do you understand the steps involved in creating and deploying an LTR model? Name them and describe what each step does in your own words.

Index the products and queries
Create a LTR store and a feature set in Opensearch
Create a dataset and assign a judgement label either explicitly or implicitly through click data
Log the feature score and join the features with the judgements
Downsample data to produce balanced training and testing sets
Perform training with XGBoost on training set and test against the test set and compare against the base LTR model
Continue to perform feature engineering and iterate on featureset and XGBoost parameters with more experimentation.

What is a feature and featureset?

A feature is an attribute that is a measurable piece of data or characterizes the target and act as input to the system.
Feature set is a set of all attributes (features) that we are interested for a problem

What is the difference between precision and recall?

Precision means the percentage of results which are relevant
Recall refers to the percentage of total relevant results. It cares about the correct samples but the not the relevant correct samples.

What are some of the traps associated with using click data in your model?

Users click on top n results and low rank results will go with 0 clicks
Users can click just for viewing -- out of curiosity.
Having bot and other malicious clicks
Users can skip clicking on the results and just scroll leading to not correct click data

What are some of the ways we are faking our data and how would you prevent that in your application?

We are faking data by faking impressions.  In real world, we would be having the log impression data.

What is target leakage and why is it a bad thing?

Target leakage or data leakage is when we train our algorithm with data that would not be available at the time of prediction. This leads to bad prediction and having less accuracy metrics.

When can using prior history cause problems in search and LTR?

When new items are added/introduced, a cold start and also when there is a complete change in consumers behavior

Submit your project along with your best MRR scoresSimple MRR is 0.294
LTR Simple MRR is 0.305
Hand tuned MRR is 0.648
LTR Hand Tuned MRR is 0.648


Jobber randomly stops working after some time

system:
Debian 10.8
4gb ram
jobber 1.4.4
Issue
I've set up jobber installed with .deb package and everything works fine, if I test the jobs they are working (one daily job and one weekly job).
The issue is that after some time when the job run (couple of days) when i log back in the server jobber has stopped working and every jobber command shows the following error.
dial unix /var/jobber/1000/cmd.sock: connect: connection refused
$ systemctl status jobber
● jobber.service - Replacement for cron, with sophisticated status-reporting and error-handling
Loaded: loaded (/lib/systemd/system/jobber.service; enabled; vendor preset: enabled)
Active: active (running) since Fri 2021-04-23 11:25:45 CEST; 2 days ago
Main PID: 8987 (jobbermaster)
Tasks: 10 (limit: 4580)
Memory: 9.3M
CGroup: /system.slice/jobber.service
└─8987 /usr/lib/x86_64-linux-gnu/jobbermaster
jobber file has the correct permissions
-rw------- 1 cla cla 2560 Apr 23 11:27 .jobber
if I do a systemctl restart jobber it start working again for the next day or two.

Apr 27 02:01:24 debian-4gb-nbg1-2 jobbermaster[16866]:         /opt/hostedtoolcache/go/1.14.3/x64/src/runtime/mem_linux.go:169
Apr 27 02:01:24 debian-4gb-nbg1-2 jobbermaster[16866]: runtime.(*mheap).sysAlloc(0xc66f00, 0x400000, 0x0, 0x0)
Apr 27 02:01:24 debian-4gb-nbg1-2 jobbermaster[16866]:         /opt/hostedtoolcache/go/1.14.3/x64/src/runtime/malloc.go:715 +0
Apr 27 02:01:24 debian-4gb-nbg1-2 jobbermaster[16866]: runtime.(*mheap).grow(0xc66f00, 0x1, 0x0)
Apr 27 02:01:24 debian-4gb-nbg1-2 jobbermaster[16866]:         /opt/hostedtoolcache/go/1.14.3/x64/src/runtime/mheap.go:1286 +0
Apr 27 02:01:24 debian-4gb-nbg1-2 jobbermaster[16866]: runtime.(*mheap).allocSpan(0xc66f00, 0x1, 0xd352a00, 0xc7b588, 0x1)
Apr 27 02:01:24 debian-4gb-nbg1-2 jobbermaster[16866]:         /opt/hostedtoolcache/go/1.14.3/x64/src/runtime/mheap.go:1124 +0
Apr 27 02:01:24 debian-4gb-nbg1-2 jobbermaster[16866]: runtime.(*mheap).alloc.func1()
Apr 27 02:01:24 debian-4gb-nbg1-2 jobbermaster[16866]:         /opt/hostedtoolcache/go/1.14.3/x64/src/runtime/mheap.go:871 +0x
Apr 27 02:01:24 debian-4gb-nbg1-2 jobbermaster[16866]: Failed to launch runner for cla: jobberrunner for cla


Password expiration does not return to previous URL after login

If password expires, it won't return to the previous page after login. Two issues:

It will ask you to relogin (it should automatically login)
It won't set the return_to session value to get back

Suggested patch (did a quick hack for an onprem):
password_change.patch.txt
We need to add tests to it and make sure it works in all circumstances.

Same problem in the view:
password_incorrect.patch.txt


"Failed to Load"

I am getting (consistently) "Failed to Load" errors, any thoughts / suggestions / insight?
Matt

Hello???

I had similar error, after a bit of closer look I found out that my .obsidian/community-plugins.json contained plugins that I removed some time ago (probably were somehow added back by Obsidian Sync). The problematic one was "dataview" plugin that I had in .obsidian/community-plugins.json but it was uninstalled long ago. After removing the obsolete line from the file everything works.

Hey Matt, what version of obsidian and supercharged links are you using?

I am running Obsidian v1.6.3 and plugin 0.12.1

I removed all add-ons and reinstalled...  Seems to be "unbroken".


Radom data at every update

Hello!
And thanks for the nice piece of code!
I am confused, however, on how it works even with standard example
http://codepen.io/fleeting/pen/skbqf
Each time I refresh page, I see random current weather and random days in forecast... In my own code I see also random update time (city is Helsinki)...

I am also seeing this issue, sometimes when the page loads the correct data is there, but if you reload the page you will see information from a previous date, and every time the page is refreshed a different date from the past week is displayed.

I was having the same issue also. I changed the "town, state" to the actual WOEID identifier number and it seems to be refreshing properly each time. Not sure why the difference, but I'll take it. :)

Good that you manage to solve this problem, but unfortunately WOEID doesn't help in my case.

Ok, here is the line generated by yahoo
https://query.yahooapis.com/v1/public/yql?q=select * from weather.forecast where woeid in (select woeid from geo.places(1) where text%3D"greenland")&format=json&env=store%3A%2F%2Fdatatables.org%2Falltableswithkeys
I put this code to the address bar and started refreshing the page. It looks like yahoo generates strange code.
Or do I miss something?

I am only using the WOEID, and always have been, but it seems that from Friday of last week it has stopped working properly and now just gives me data for a random day in the past week instead of today. I haven't changed anything in the setup and it was previously working for the past few months.

I'm using location search, and the same is happening - random weather each time.

I am only using the location parameter and have the same issue. Looking at the "update" result, yahoo seems to return outdated information ...

The random/stale data can also be seen on Yahoo Developer Networks "Sample Weather API Response" page, https://developer.yahoo.com/weather/
Repeatedly test the same YQL query and it will return conditions from a random day in the past week or more.

Anyone else lose the icons as well? I seem to be getting a random/stale set of data (using WOEID) as and random character in place of the weather icons themselves.

I am using AJAX and update weather in background. So, my temporary fix was to increase frequency of the background updates and to reject wrong updates as follows (rough, but I hope there will be a fix in plugin soon):
var firstday_date = weather.forecast[0].date.split(" ");
if (now.getDate() == parseInt(firstday_date[0])) {
$("#weather").html(html);
};
This will not help if you just reload page, something like while(now.getDate() != parseInt(firstday_date[0])) {...} might be implemented?
Then I noticed that weather icons are wrong. I fixed it like that (seems to be working, but I am not 100% sure)
html += ' ';

I have done a similar thing to vushe above, check the date being returned in the forecast, if it is correct display the data, if not request the data again, this so far is working.

I am experiencing same issue. The weather data is different on each hard refresh or background refresh.

Yahoo seems to be having problems with their weather feed and no clue if/when they plan to fix it. If you view the feed directly and refresh you see the data changes each time. The same goes if you just refresh the Yahoo API example a few times the values change. Unfortunately there isn't anything I can do on my side as that's the data Yahoo is returning. A few people have tried to contact Yahoo support over the past week but no response yet.
@propergent As for the missing icon, if you are hotlinking the icons directly from my demo this will happen anytime I move the icons, upload a new set, or change the url. It's advised that you download and host the web font yourself vs hotlinking from the demo as I don't guarantee that link to work forever (and it's not advised to hotlink files).

Thanks for explanations! Sure problem is on Yahoo's side. Hopefully they'll fix it soon.

Just a quick update. I've heard from several people including the uservoice topic that everything seems to be working again as expected. As far as I know nobody, including myself, got word back from Yahoo but I've tested a few times and looks like they fixed whatever the problem was.
Hopefully it's working again for all of you and continues to work.

It works! :D


Remove cli_utils from allow-list

Remove cli_utils from the SDK package allowlist.
Fixes https://github.com/flutter/flutter/issues/99036
Pre-launch Checklist

[x] I read the Contributor Guide and followed the process outlined there for submitting PRs.
[x] I read the Tree Hygiene wiki page, which explains my responsibilities.
[x] I read and followed the Flutter Style Guide, including Features we expect every widget to implement.
[x] I signed the CLA.
[x] I listed at least one issue that this PR fixes in the description above.
[x] I updated/added relevant documentation (doc comments with ///).
[ ] I added new tests to check the change I am making, or this PR is test-exempt.
[x] All existing and new tests are passing.

If you need help, consider asking for advice on the #hackers-new channel on Discord.

Does this also need to be removed?
https://github.com/flutter/flutter/blob/533a5dde96b35798c501811f3ba378b53bc4b7e4/dev/tools/dartdoc.dart#L176

The interesting tests have passed, we don't need to wait for Google testing and gold for this fix.  Merging to reopen the tree.


super-slicer: <IP_ADDRESS> -> <IP_ADDRESS>

Motivation for this change
Package update
Things done

Built on platform(s)

[X] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[X] Fits CONTRIBUTING.md.

Please also update sha256 :-)

Please also update sha256 :-)

My nix prefetch acted really strange, and threw me the same hash back D:
Gotta check on the other machine

1f2phsalxfx615nxlp6mkl7s0k9w75l2ngxnnvd81nc0dcscg2x9 and sha256-qYvHNGuA2YDatrY/K2g5PE2gD53VXNptCaa7TpWGV7g= are actually the same hash and just different encoding...

@bobby285271 that's something really strange. Can you please prefetch it? I guess that's something with tags on in SS repo

Oooops, seems that https://github.com/supermerill/SuperSlicer/tree/<IP_ADDRESS> and https://github.com/supermerill/SuperSlicer/tree/<IP_ADDRESS> are pointing to the same commit, I guess we should ask upstream to re-tag it...

asked him in discord

He re-tagged it, rebuilding it rn.


no "entries" link in categories/feeds

To reproduce

Click category
Click one of the category, viewing category/entries
Click "feeds", viewing category/feeds

Now we are viewing all feeds in a category.
However there is no link to let us go back to all entries of a category
Expected:
There should be a link let us switch from category/feeds to category/entries.

Another problem:
There is a "category" link in the "category/feeds" page.
That link lets us go to the all category page.
I think that link is redundant. We could remove that link.


Team, kindly update the NPM Registry

Feature requests, bug reports etc. are very welcome as issues. But questions are directed to stackoverflow with the tag jspdf.
Note that bug reports should follow these guidelines:

A bug should be reported as an mcve
Make sure code is properly indented and formatted (Use ``` around code blocks)
Provide a runnable example.
Try to make sure and show in your issue that the issue is actually related to jspdf and not your framework of choice your setup.

Please see #2739 and #2704.


XRI 2.3 Upgrade

This ticket tracks upgrade to XRI 2.3, along with the XR coreutils upgrade

[ ] Evaluate new input simulator, how much of our own input simulator we can remove

[ ] Already works shockingly well, main problem is that they don't have a concept of the "anchor point" so the hand ray/grab flails around wildly (they just anchor on the device position, obviously)

[ ] Evaluate Transformers and how they will influence our constraints/solvers story
[ ] Evaluate the new datum feature in XR Coreutils, possibly use it for config on BC, UX?
[x] Tests pass
[ ] Check in with internal partners before bumping XRI minver
[ ] Possibly refactor our Selectedness to point to their interactionStrength

[ ] This would require us to implement our poke logic as an MRTKPokeFilter
[ ] This would also require us to deprecate our IVariableSelectInteractor and migrate to IXRInteractionStrengthInteractor (phew, what a mouthful)

[ ] Evaluate replacing our GazeInteractor with their XRGazeInteractor
[ ] Evaluate replacing InteractionModeManager with XRI interaction groups

Groups may not support enabling/disabling based on external rules/detectors :(

Notes

Something seems very wrong with our ray interactor/controller execution order, at least in-editor. The default XRI XRGrabInteractable goes crazy when grabbing/rotating. Definitely an execution order issue
They have a hardcoded "Enable gaze interaction" checkbox on their interactable settings, which compares incoming interactors against their concrete impl of XRGazeInteractor, instead of any kind of generic interface like IGazeInteractor

This can/will confuse our users when our gaze interactor does not respond to the XRI options for gaze.

Our line visuals do not respond to XRInteractableSnapVolume
Most things seem to work just fine so far, even with some of the conflicts with gaze, etc
Their new XRPokeInteractor does not do inter-frame collision checks so it may be susceptible to "phasing through" interactables

Confirmed, their poke interactor will not process pokes when the interactor is moving quickly

Their "poking depth" is a property of the poke interactor itself, not the interactable, which is a really strange decision because buttons can be different sizes and depths 🤔🤔🤔
Their new XRPokeInteractor implements IUIInteractor, which means we can do the exact same thing and get touch interactors on vanilla canvas!

Unfortunately, the API for adding this to our own interactors is internal, so currently only official XRI XRPokeInteractors can do UGUI interactions. Huge bummer :(

They now have their own "Selectedness", which is "interaction strength". We can pretty easily adapt to this by implementing our own PokeFilter and just routing the Selectedness API down to their interaction strength value
Their PokeFilter is hardcoded to only work with XRPokeInteractors, not any generic interface like an IXRPokeInteractor :(
Our PokeInteractorVisuals script assumes a PokeInteractor which is a little silly. We should change it to a generic interactor.
New input simulator already works shockingly well, main problem is that they don't have a concept of the "anchor point" so the hand ray/grab flails around wildly (they just anchor on the device position, obviously)

Not sure how feasible it is to alter their simulator to do this
Possibly we can change the joint synthesis subsystem to be smarter about this (i.e., anchor the simulated joints, not necessarily the simulated device pose)

The new XRPokeInteractor and XRPokeFilter API is incredibly strange and I literally cannot make heads nor tails of it

I've tried for like 2 hours at this point to make a simple button that presses at a given distance and I cannot do it
This will require a lot more work to understand and possibly work with the XRI folks to improve things

Looks like the XRInteractionGroups have a lot of limitations and won't support enabling/disabling based on external rules like we do with our modes

2.3 contains some API improvements for key features such as implementing custom reticles for bound handles. So long as our existing implementations don't break, I'd like to move to 2.3 even without completing the other evaluations listed on this task.

@RogPodge I agree mostly, except for the most egregious issues here (i.e., two completely duplicate PokeInteractors., etc) I will be bringing up as many of these as possible in our meeting tomorrow.

See #11298 for draft PR

Need to go through the investigations and recommendations listed above and create feature requests.

Updated to XRI 2.3 with https://github.com/microsoft/MixedRealityToolkit-Unity/pull/11452


Does Devilbox work on Apple Silicon?

there a way to install or run Devilbox on Apple M1 Macs?
Attached is a log of performing docker-compose up on a new installation. Look like dystopia/bind, devilbox/php-fpm, devilbox/apache and devilbox/mysql all use amd64 images. How does one switch to arm64 images?
docker-compose up M1.txt

there a way to install or run Devilbox on Apple M1 Macs?

There are no arm64 images available at the moment.

I'm wondering if you're thinking of supporting arm64 in the future? Or are you dependant on others to test this?
Thanks a lot for your effort and time in this project!

This article may help when you are ready to create the arm64 images.
https://www.docker.com/blog/multi-arch-images/

Got Devilbox to run on my MacBook Air (MBA) M1 (16GB/512GB) (which I received last week, returning it) without any modifications. Executing docker-compose up is all you need to do right now.
However; the performance is horrible. This has nothing to do with Devilbox.
It's the IO operations on mounted volumes on Mac devices. Performance was okay on my 2020 MacBook Pro, nothing compared to linux but, okay. One way to tweak performance of the mounted volumes is leveraging NFS as instructed here. It enhances performance greatly.
I'll look into writing a PR to provide documentation (steps and/ or basic files) on how to set this up.
On the MBA M1 I've received I installed docker, cloned devilbox and started testing with and without NFS mounted volumes. The results of running time composer install --no-cache inside devilbox below:

Without NFS setup
real
user
sys

1
1m25.686s
0m42.663s
0m13.287s

2
1m19.531s
0m41.323s
0m13.141s

3
1m23.592s
0m42.235s
0m13.373s

With NFS setup
real
user
sys

1
0m43.027s
0m31.816s
0m10.757s

2
0m45.518s
0m30.987s
0m10.458s

3
0m41.481s
0m30.906s
0m10.508s

With these results (using NFS setup) the performance on the MBA M1 is slightly worse compared to my "old" MacBook Pro 2020 Intel (16GB/512GB). Also, I like to make use of Remote Development - Containers in VS Code, it enables me to do everything from within my VS Code window (running commands in the integrated terminal directly in devilbox and editing source files). Also, some extensions require PHP, which I want to keep off my host system, they are able to run because they are being installed inside of the development container by VS Code. It is great.
This forces me to return it, because I was looking for a upgrade in contrast to a downgrade.
I have to admit, running commands like npm install run unbelievably fast on the host, just not inside of devilbox (docker). People are able to workaround the problem by running certain commands on the host machine but that's not the preferred workflow. The M1 is great. It does not get warm, the fans won't turn on (because it doesn't have them :)) and the battery is great (docker does drain it so shut that down when not using it).

I was looking into building ARM images. This however seems to be rather problematic. I have currently tested it with a base image (PHP 8.2) in this PR: https://github.com/devilbox/docker-php-fpm-8.2/pull/2

AMD64 image builds in about 9 minutes (as it did in single run before)
ARM64 image builds in about 100 minutes (more than factor 11 longer)

Timewise it would all be do-able for the used Docker images for Devilbox, however, when looking at the actual PHP images, the fastest pipeline was 1 hours. When doing ARM64 images the pipeline will most likely also be (more than) 11 times slower, which would result into something like at least 11 hours per build.
As far as I've read, GitHub actions allows a maximum of 6 hours per job, so that would be currently impossible.
Additionally, as this is only a non-commercial project I'm doing in my spare-time and migrating, testing and fixing tens of docker images would take months and lots of energey, it is something which I'm unable take. I will leave this to the community.
If somebody wants to step in and take action and is also able to solve the long-running pipelines, then let me know and we can work something out.

Closing in favour of this: https://github.com/cytopia/devilbox/issues/855


How to remove tile border and highlight on mouse over?

I have an application that is using an old version of MA.M, which used to have the Panorama view with tiles. My application is a version control for our main software, and my groups are separated by versions.
As you can see the image below, the first item of each group has a border (gray-ish), and when I put the mouse over an item, the border gets blue. (second tile of the image)

Can someone help me to remove these borders? For me, there is no problem to change the downloaded MA.M source code that I have here.

The border arount the tile is still appearing for me. Can someone help me to remove? I have tried many ways to remove the "blue-ish" border, but nothing worked as expected. :(

@warffen i think this is outdated. we removed the panorama a long time ago (too many bugs or so).
but i have now updated the Tile to get some similar usage.


Update OAS API version to 1.2.1

Signed-off-by: Cherry Wang<EMAIL_ADDRESS>PR Checklist
Please check if your PR fulfills the following requirements:

[ ] The commit subject follows the Conventional Commits spec
[ ] The commit message follows the EdgeX Contributor Guide
[ ] Tests for the changes have been added (for bug fixes / features)
[x] Docs have been added / updated (for bug fixes / features)
[ ] make test has completed successfully

PR Type
What kind of change does this PR introduce?

[ ] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build related changes
[ ] CI related changes
[X] Documentation content changes
[ ] Other... Please describe:

What is the current behavior?

Issue Number:
Fix #2561
What is the new behavior?
Does this PR introduce a breaking change?

[ ] Yes
[x] No

Are there any specific instructions or things that should be known prior to reviewing?
Other information

recheck

Codecov Report

Merging #2562 into master will decrease coverage by 0.22%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #2562      +/-   ##
==========================================
- Coverage   39.11%   38.89%   -0.23%
==========================================
  Files         145      145
  Lines       12794    12728      -66
==========================================
- Hits         5005     4951      -54
+ Misses       7515     7504      -11
+ Partials      274      273       -1

Impacted Files
Coverage Δ

internal/support/scheduler/router.go
0.00% <0.00%> (ø)

...nal/support/scheduler/operators/interval/delete.go
100.00% <0.00%> (+1.23%)
:arrow_up:

internal/support/scheduler/rest_interval.go
100.00% <0.00%> (+4.00%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 077fc95...0fab574. Read the comment docs.

@AnthonyMBonafide There are some new improvement you made in Geneva, and we want to publish them, for example
https://github.com/edgexfoundry/edgex-go/pull/2533
https://github.com/edgexfoundry/edgex-go/pull/2541
Could you please merge this PR?  Then, we can publish v1.2 API documents onto SwaggerHub, or it will always be override by Jenkins to private.
Thanks.

Would it be better to update the version of the documents from 1.2.0 to 1.2.1 rather than 1.3 to avoid a version override? My thought is that it would be better if the versions of EdgeX and the public Swagger documentation are more inline so that users can easily identify the correct version. For Geneva we are calling it version 1.2, to keep the minor versions in sync we can simply increase the patch version. This would signal to users that the contents are still valid for version 1.2, but only contain minor corrections. Looking at this from the point of view of a "power user" of the system, if I wanted to look at the Swagger documentation for the Geneva release which is 1.2, I would naturally look for that matching version in the Swagger docs and look for the latest 1.2.x version of the documentation.

actually, this is my original intention to set up the Jenkins pipeline to automatically update the Swagger files.  @ernestojeda @jamesrgregg May we set the Swagger file upload as public?  I can't see any advantage to keep uploading Swagger file as private.  If you feel fine, we can create the PR to modify it.
@cherrycl please help rebase this PR and modify the version to 1.2.1
thanks for the feedback, @AnthonyMBonafide

Changed version to 1.2.1.


Automatically correct username capitalization

Extension of #45
Since we are currently formatting all usernames "To Be Like This", a lot of people with custom usernames aren't happy.
A suggestion that has been discussed before on discord is to use the hiscores leaderboard pages to check the correct capitlization for any given name. (Because names are correctly capitalized in those pages for some reason).
The only way that we're currently aware of to do this, is to fetch the contents of this page:
https://secure.runescape.com/m=hiscore_oldschool/overall?table=0&user=lynx%A0titan
Find the correct table row by checking a name match:
formattedTableUserame === formattedCurrentUsername
Or by checking the row's color (it seems to be red)
The question now is:
Would this be another endpoint in the players module, or an automatic check onPlayerUpdate?(maybe with a time limit, like once every 24h)
PS: With this, some other endpoints on the API have to be changed to support unstandardized usernames.

Edit: changed to a much easier approach (using a more direct URL) thanks to @Knutakir 's suggestion on discord

It seems easiest to grab the correct name with something like this
name="lynx titan" && curl -s "https://secure.runescape.com/m=hiscore_oldschool/overall?table=0&user=$name" | sed 's/\xa0/ /g' | grep -ioP "user1=\K$name"

I think that this should be handled exactly like ironman type checking, so if we check this on name change we should probably also check ironman status on name change


Fixed a crash when rotating the screen due to an empty pattern string.

The stringToPattern method attempts to convert the empty string to an integer which caused the exception.

Thanks,
I will upload it to maven today.

From version 1.0.3


Hide all characters in a TextField, when obscureText is true in web

Problem
In Flutter Web the last character of a TextField is visible, when obscureText = true. This should not be the case. Specially when your screen is shared with a beamer, etc. everybody can see your password.
Example:

How it should be
Every website hides all characters in a password field.

@HansMuller @goderbauer I removed the web flag because this is a general desktop problem. On desktop password fields generally do not show letters.

This feature is now available ✌

This feature is now available ✌

So how you achieve it?

@MertDuman You can have a look at my PR: https://github.com/flutter/flutter/pull/56794 :)


Update Joomla app to the latest version

This issue is a:

[ ] Bug Report
[x] Enhancement suggestion
[ ] Feature request

If the issue concerns an existing Marketplace application, please tag the maintainer of the application (found in manifest.yaml) below:
Enhancement suggestions / feature requests
Currently, we have Joomla version 3.9.24 installed by Civo marketplace as a newer version 4.3.3 is available, so it needs to be updated to the newer version. We kindly request an update to the latest version of Joomla on the Civo marketplace to ensure that we have access to the most recent features and improvements.
@keithhubner and @DoNnMyTh are the maintainers for this app, so I request you to please take a look into this.

Sure @aakashnagpal4567 I'll update it.

Hello! 👋🏼 The available version is now newer than the requested version in the issue, we should be good to close this. cc: @kunal-kushwaha
https://github.com/civo/kubernetes-marketplace/blob/42eb55a95ab8c7283451b0ddc07fa16666a0f8ab/joomla/manifest.yaml#L4


Update demo.md

@seshenoy : Thanks for your contribution! The author, @ v-caxian, has been notified to review your proposed change.

#sign-off

@seshenoy: I'm sorry - only the author of this article, @v-caxian, can sign off on your changes. But we do have an exception process - if you are on the Microsoft content or product team for this product area, you can ask the PR review team to review and merge it by sending mail to the techdocprs alias.


Preview TeX Maths breaks with a cross reference

When I hover an equation, if there is a cross reference of the form:
$$\frac{d}{dx}\left( \int_{a}^{x} f(u)\,du\right)=f(x).$$ {#eq-marginalia}

Then the preview fails to render:

Adding a newline betwee $$ and {#... and the preview works as expected (but a newline will then break the cross reference when rendering):

Thanks for reporting this! Fix is here: https://github.com/quarto-dev/quarto-vscode/commit/8cc0a42132579c28a498bbc6556a08508f176180
Available in the latest release (v1.43.0)

Hi @jjallaire thank you. However I still don't see this working. Here is V1.43.0 with a space between the equation and label:

Notice the grey background highlighting block extends down to the closing :::. If I add a newline before for the label then the grey background disappears and the equation renders:

There is some greedy regex or something eating up the block, here is an example without a surrounding div:

Here is the text for that example:
See both @eq-one and @eq-two for more details:

$$t' = \frac{t - \dfrac{v}{c^{2}}x}{\sqrt{1 - \dfrac{v^{2}}{c^{2}}}}$$ {#eq-one}

Sint meis quo et, vis ad fæcete dolorem!

$$\nabla \times \mathbf {H} ={\frac {1}{c}}\left(4\pi \mathbf {J} _{\text{f}}+{\frac {\partial \mathbf {D} }{\partial t}}\right)$$ {#eq-two}

Tritani posidonium suscipiantur ex duo, meæ essent mentitum ad.

Yeah, we aren't fully in control of those regexes unfortunately. If you try this it will work:
$$
t' = \frac{t - \dfrac{v}{c^{2}}x}{\sqrt{1 - \dfrac{v^{2}}{c^{2}}}}
$$ {#eq-one}

Ok, understood, and cheers!


ERROR: 'str' object has no attribute 'get'

Hi Team,
Looks like a code issue to me. I get the following error when trying to deploy my DataFactory ARM Template.
Validating template...
Warning: ERROR: 'str' object has no attribute 'get'

Warning: Template validation failed.
Creating deployment...
Error: ERROR: 'str' object has no attribute 'get'

Error: Deployment failed.

I validated the ARMTemplate also, just to check, But all seems to be good.
Im using the azure-data-factory-utilities npm package method to create the ARMTemplate

Hi @ashishmg-gds Is the template working fine if deployed using azure cli?
If yes, will it be possible to share the template for us to replicate the issue?

@t-dedah  I wont be able to share the template but, Im getting the same issue when trying via azure cli.
I added --debug to the deployment creation command and got following stacktrace:
DEBUG: cli.azure.cli.core.util: attempting to read file ./ArmTemplate/ArmTemplate/ARMTemplateForFactory.json as utf-8-sig
DEBUG: cli.azure.cli.core.util: invalid syntax (<unknown>, line 1)
DEBUG: cli.azure.cli.core.util: azure.cli.core.util.handle_exception is called with an exception:
DEBUG: cli.azure.cli.core.util: Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 691, in _run_job
    result = cmd_copy(params)
  File "/usr/local/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 328, in __call__
    return self.handler(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
    return op(**command_args)
  File "/usr/local/lib/python3.9/site-packages/azure/cli/command_modules/resource/custom.py", line 538, in deploy_arm_template_at_resource_group
    return _deploy_arm_template_at_resource_group(cmd=cmd,
  File "/usr/local/lib/python3.9/site-packages/azure/cli/command_modules/resource/custom.py", line 567, in _deploy_arm_template_at_resource_group
    deployment_properties = _prepare_deployment_properties_unmodified(cmd, 'resourceGroup', template_file=template_file,
  File "/usr/local/lib/python3.9/site-packages/azure/cli/command_modules/resource/custom.py", line 1000, in _prepare_deployment_properties_unmodified
    parameters = _get_missing_parameters(parameters, template_obj, _prompt_for_parameters, no_prompt)
  File "/usr/local/lib/python3.9/site-packages/azure/cli/command_modules/resource/custom.py", line 263, in _get_missing_parameters
    prompt_parameters = prompt_fn(missing)
  File "/usr/local/lib/python3.9/site-packages/azure/cli/command_modules/resource/custom.py", line 189, in _prompt_for_parameters
    description = metadata.get('description', description)
AttributeError: 'str' object has no attribute 'get'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/azure/cli/core/commands/arm.py", line 109, in handle_template_based_exception
    raise CLIError(ex.inner_exception.error.message)
AttributeError: 'AttributeError' object has no attribute 'inner_exception'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/knack/cli.py", line 231, in invoke
    cmd_result = self.invocation.execute(args)
  File "/usr/local/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 657, in execute
    raise ex
  File "/usr/local/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 720, in _run_jobs_serially
    results.append(self._run_job(expanded_arg, cmd_copy))
  File "/usr/local/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 712, in _run_job
    return cmd_copy.exception_handler(ex)
  File "/usr/local/lib/python3.9/site-packages/azure/cli/core/commands/arm.py", line 114, in handle_template_based_exception
    raise CLIError(ex)
knack.util.CLIError: 'str' object has no attribute 'get'

I also exported the ARM template from my Data Factory and compared with the generated one. Seems to be Identical

@ashishmg-gds I was facing this same issue and I got past the error by taking the parameters with empty values in the 'ARMTemplateParametersForFactory.json' file, and adding those to the 'parameters:' attribute in the GitHub Action declaration.

@ashishmg-gds As you are getting the same error with azure cli that means the issue is with azure cli and not this action specifically. So which version of azure-cli are you using ?

@t-dedah  I used both latest and 2.30.0 version as well

Hi @ashishmg-gds Are you still facing this issue?
Did you try the solutions suggested here https://github.com/Azure/arm-deploy/issues/93#issuecomment-1016861114 or https://github.com/Azure/arm-deploy/issues/68#issuecomment-1000896837

Hi @ashishmg-gds Please reopen the issue if you are still facing this issue

I am facing the same issue

i am facing same issue


Reset experiments

See point 2 in https://github.com/assaf/vanity/pull/121:

Tests can be "reset", which removes participant/conversion data (same as destroy) but also re-initializes the experiment (setting its created_at again). The dashboard shows a "reset" button for each experiment.

Closed by #244


Define whether path prefix matches are element-wise or byte-wise

Gateway defines a prefix match  like this:

Prefix and Exact paths must be syntactically valid:

Must begin with the ‘/’ character
Must not contain consecutive ‘/’ characters (e.g. /foo///, //).
For prefix paths, a trailing ‘/’ character in the Path is ignored, e.g. /abc and /abc/ specify the same match.

But Ingress V1 says:

Prefix: Matches based on a URL path prefix split by /. Matching is case sensitive and done on a path element by element basis. A path element refers to the list of labels in the path split by the / separator. A request is a match for path p if every p is an element-wise prefix of p of the request path.

I don't recall a discussion about this, but we should discuss whether to align the Gateway prefix semantics with Ingress.

 It makes the migration easier for users, and for Contour, we've already implemented these, so we can easily reuse code.

+1 to sticking to element-wise.
Any use-cases we know of that won't be satisfied with that approach?


Simple installation instructions for Win10

While assisting a Ringing Master installing Wheatley, I wrote a simple install guide for Windows 10 and thought this might be useful to others who wanted to use it but needed guidance installing Python and help with the command line.
Refs #126

This looks super nice!  My long-term plan for stuff like this is to have a central website (compiled from code in the main repo and hosted using github pages), where good help info can be stored and kept up to date.  But for the time being, this is very nice so thanks!
Merging now...


Include PyQt{4, 5} and Matplotlib as pip dependencies

Dear developers,
I installed Spyder via pip and I noticed that PyQt5 and Matplotlib don't get installed automatically with the pip install spyder command.
You probably don't want to include to much pip-dependencies into the spyder package but could you include at least one of the PyQts (either 4 or 5)? That would be helpful as Spyder needs one of those to work.
Also I think that matplotlib seems as a pretty useful tool for spyder users, so could you include this as a dependency as well?
Regards,
Jakob
Version and main components

Spyder Version: 3.2.4
Python Version: 3.6.2
Qt Versions: 5.9.1, PyQt5 5.9 on Linux

Dependencies
pyflakes >=0.6.0 :  1.6.0 (OK)
pycodestyle >=2.3:  2.3.1 (OK)
pygments >=2.0   :  2.2.0 (OK)
pandas >=0.13.1  :  None (NOK)
numpy >=1.7      :  1.13.3 (OK)
sphinx >=0.6.6   :  1.6.5 (OK)
rope >=0.9.4     :  0.10.7 (OK)
jedi >=0.9.0     :  0.11.0 (OK)
psutil >=0.3     :  5.4.1 (OK)
nbconvert >=4.0  :  5.3.1 (OK)
sympy >=0.7.3    :  None (NOK)
cython >=0.21    :  None (NOK)
qtconsole >=4.2.0:  4.3.1 (OK)
IPython >=4.0    :  6.2.1 (OK)
pylint >=0.25    :  1.7.4 (OK)

We can pyqt5 to our dependencies, but matplotlib is really optional, so we can't force it to our users.

This is a duplicate of issue #3242.


axum 0.7 support

We wrap the now-gone Server in our Servient::serve, so migrating to axum::serve could stay hidden to the user
The difference with the number of generics should not impact much, given we will have to overhaul the builder soon.

Done in c93637205902507916755f1dd0f46c80e9c09857


Generate classes for common request bodies

If request bodies are references to shared components we still need to treat them separately, rather than sharing a single instance across all operations that reference the request body. This allows the child media types to track up to their operation parent and generate a separate class for each operation/mediatype combination.
Relates to #239

/merge


Add text.Stream:Paste

Codecov Report

Merging #100 into master will decrease coverage by 0.7%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #100      +/-   ##
==========================================
- Coverage    98.7%   97.99%   -0.71%
==========================================
  Files          65       33      -32
  Lines        3470     2048    -1422
==========================================
- Hits         3425     2007    -1418
+ Misses         38       36       -2
+ Partials        7        5       -2

Flag
Coverage Δ

#dot
97.99% <ø> (-0.71%)
:arrow_down:

#dot_changes
100% <ø> (ø)
:arrow_up:

#dot_conv
100% <ø> (ø)
:arrow_up:

#dot_encoding
90.05% <ø> (ø)
:arrow_up:

#dot_encoding_counter
74.41% <ø> (ø)
:arrow_up:

#dot_encoding_richtext
100% <ø> (ø)
:arrow_up:

#dot_encoding_set
?

#dot_encoding_sparse
?

#dot_ops
?

#dot_refs
?

#dot_streams
?

#dot_streams_text
?

#dot_test_seqtest
?

#dot_x_fold
?

#dot_x_idgen
?

#dot_x_nw
?

#dot_x_rle
?

#dot_x_rt
?

#dot_x_types
?

#dot_x_undo
?

Impacted Files
Coverage Δ

streams/scheduler.go

x/types/array.go

streams/path.go

x/rle/rle.go

x/nw/server.go

x/nw/store.go

x/undo/stream.go

x/nw/client.go

refs/caret.go

ops/cache.go

... and 21 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5872a4d...5af1203. Read the comment docs.


Support "csx"

Support C# script files.
Would be pretty great if csx is supported by OmniSharp.
Aside: VS 2015 Update 1 has bundled csi.

I would like to bump this and :+1: this.
There is CSX support already in OmniSharp (via scriptcs) and Atom uses it, and you can "fake-force" it in VS Code by adding an empty project.json next to your CSX. You will get CSX intellisense, including cross-CSX file navigation and it will respect #r directives and even recognize scriptcs-style NuGet references (by convention).
That said, this whole experience should be normalized (after all, scriptcs is a bit opinionated about some things). As I mentioned in a call a while ago I'd like to see "basic" CSX support as first class citizen in OmniSharp and then scriptcs (with its custom host and what have you), being the superset of regular CSX, could be an opt in plugin.
I have lots of PoCs going on including one that I am working on right now so hopefully we can bring this in soonest.
@DustinCampbell - hopefully it makes sense? we can even start small, single file only and grow from there

I've installed the 'csharp' extension for Visual Studio Code. It would be neat if it fully supported .csx files from C# Interactive csi.exe. Syntax highlighting works fine, but there's no autocomplete or debugging.

I think this can be closed now that https://github.com/OmniSharp/omnisharp-roslyn/issues/659 has been merged.
There are still some issues and ongoing work (see https://github.com/OmniSharp/omnisharp-roslyn/issues?q=is%3Aissue+is%3Aopen+csx+label%3Acsx) but those can be tracked separately in the omnisharp-roslyn repo.

Yeah, I agree. The latest beta should be much better.

There is CSX support already in OmniSharp (via scriptcs) and Atom uses it, and you can "fake-force" it in VS Code by adding an empty project.json next to your CSX. You will get CSX intellisense, including cross-CSX file navigation and it will respect #r directives and even recognize scriptcs-style NuGet references (by convention).

I know I'm lazily posting on a closed issue, but I can't for the life of me find details on this convention. Can someone point me to this reference material or share it here for posterity's sake?

@peder Since last year OmniSharp has no support for scriptcs-style scripting (i.e. nuget packages via packages.config). Instead, we only support standard CSI.exe scripting. This is the official script runner that is built as part of the Roslyn repo and ships with MSBuild tools.
At the moment the only supported way to provide references to external assemblies in CSI is to use #r references, and that is what OmniSharp supports.
Aside from CSI, OmniSharp also supports Azure-Functions like references via project.json (have a look at the .NET Core script runner here https://github.com/filipw/dotnet-script) and soon it will support #r "nuget package" references (PR here - https://github.com/OmniSharp/omnisharp-roslyn/pull/813).
I hope this helps - and apologies for the confusion. Updating the documentation to put all of this information together is on my list 📚

Awesome update--thanks. I was giving C# Scripting a whirl last night and started hitting some walls. Despite those issues, I have to think the *.csx is bound to grow, especially when/if Node.js developers dabble in .NET.
I'll check out the Azure Functions approach. Thanks again.

I think the confusion comes from the fact that - due to the popularity of scriptcs project - folks equate C# scripting / CSX with what scriptcs offers.
In reality, scriptcs is a de facto dialect on top of standard CSX scripting and offers some extra features over CSI.exe (it's a superset of standard scripting), mainly packages.config integration and custom # directives. This was partially supported in OmniSharp a while ago, but due to various problems, it was removed. What we decided to have in OmniSharp instead, was full support for standard Roslyn (CSI) scripting, and to do it well.
So if you stick to CSI-only scripting, you will have excellent language support in OmniSharp - on par with "full" C# - refactoring, go to definition, go to metadata, find references, intellisense and so on.

It's unfortunate there's confusion between scriptcs and csi.exe "C# Interactive". Ideally both would clarify the (non)relation in their documentation:

https://github.com/scriptcs/scriptcs/issues/1162
https://github.com/dotnet/roslyn/wiki/Interactive-Window#command-line-repl

Here's a feature request for .csx C# script support in Visual Studio https://visualstudio.uservoice.com/forums/121579-visual-studio-ide/suggestions/7848117-add-scriptcs-csx-intellisense-and-debugging-in-v

You can run .csx scripts with C# Interactive (csi.exe). It would be neat if you could debug them in Visual Studio.


Update README.md

Believe the haskell:7.8 docker image needs to be pulled before the given commands will work, at least in 1.9.1.

Thanks for the addition. I haven't tried the docker image myself actually. Does it all work smoothly?

Yeah, so long as the haskell:7.8 image is locally present it builds fine.


Pypi Label Studio 1.7.1 regular crashes on CentOS with more than 5k tasks.

Describe the bug
Crash when using label studio with a lot of data.
To Reproduce
Steps to reproduce the behavior:

Import more than 5000 tasks spread on different projects
It crashes at some point
There is no error in the logs

Expected behavior
The process is getting killed. I'm using the pip package.
Screenshots
No screenshot
Environment (please complete the following information):

Label Studio 1.7.1 pypi package
CentOS

Additional context
Nop.
Questions

Do you have any optimization to make on the django server to allocate maybe more memory?
What would be the best configuration and how to make it?

I see here https://github.com/heartexlabs/label-studio/issues/3916 that we can maybe set a global variable to optimize the number of processes. Is it a good guideline to change this UWSGI_PROCESSES variable?

Yes it was indeed the reason thank you so much!


Update to version 0.0.5

Functional refactor of page files
Follow best practices for Prismic configuration
Update dependencies
Use RichText render as element
Client method for fetching data

Everything looks good to me. Just merged the changes.


[Support] jq is Required Globally and not Installed

Hi!
I have installed CMD 4 Advantage air on Homebridge but it is not working.
It is stating that I need JQ, yet JQ is installed.
Hoping for some guidance as I need this to get my air con in HomeKit.

Hi Marty, we will definitely get this up and running for you! Looks like you have Homebridge installed on a Mac from the screenshots?
Can I please get you to run the following command from your terminal and please paste the response here?
which jq

Thanks Mitch
/opt/homebrew/bin/jq

Awesome, we will need to move jq over to where it should have been installed (not sure why this happens to some users, so probs not your fault!). But, yep this looks the same as a previous user, just to be 100% sure can you confirm there is this file path?
cd /opt/homebrew/Cellar/jq/1.6/bin/jq

Just slightly changes the next command I was going to give you to fix the issue.

This is what comes up when I run the above
.jq - commandline JSON processor [version 1.6]
Usage:	/opt/homebrew/Cellar/jq/1.6/bin/jq [options]  [file...]
/opt/homebrew/Cellar/jq/1.6/bin/jq [options] --args  [strings...]
/opt/homebrew/Cellar/jq/1.6/bin/jq [options] --jsonargs  [JSON_TEXTS...]
jq is a tool for processing JSON inputs, applying the given filter to
its JSON text inputs and producing the filter's results as JSON on
standard output.
The simplest filter is ., which copies jq's input to its output
unmodified (except for formatting, but note that IEEE754 is used
for number representation internally, with all that that implies).
For more advanced filters see the jq(1) manpage ("man jq")
and/or https://stedolan.github.io/jq
Example:
$ echo '{"foo": 0}' | jq .
{
	"foo": 0
}

For a listing of options, use /opt/homebrew/Cellar/jq/1.6/bin/jq --help.
martylaw@martys-mbp ~ % .
martylaw@martys-mbp ~ %

Sweet, you will just need to run the following command:
sudo cp /opt/homebrew/Cellar/jq/1.6/bin/jq /usr/local/bin/

Please note the space between the two files paths, but if you copy/paste, then there should be no issue. Give it a reboot after this for good measure and run the 'Config Creator' and 'Configuration Check', and hopefully all is up and running! If not, let me know what the next problem is haha...

Thanks Mitch
Really appreciate your help :)
I have run the script, uninstalled and resonated with CMD4 (using command line) and Advantage Air
Just got the below error

Have since restarted it and the CMD 4 Json is empty again.....doesn't seem to "stick" then when that happens I lose the set up in the advantage air plugin too

Thanks Mitch...is now working :)

My fellow dev has pointed out that what you have experienced here with the 'config not sticking' is due to the order of how you did things:

I have run the script, uninstalled and reinstalled with CMD4 (using command line) and Advantage Air (suing HB)

Running the script has created the config you saw, then uninstalling the plugins would have wiped the config and then reinstalling the plugins without running the scripts again would have seen no config for them. Also I do recommend installing both plugins via the Homebridge web UI and not via command line; just to keep things simple and not set yourself up for something to go wrong :)


sortBy on collections is returning unsorted array

illuminate/container version: v5.7.11
PHP Version: 7.2.11

Standalone Eloquent. Not in a Laravel app. Not sure that would make a difference here.
Description:
When trying to sort a collection created from an Eloquent model, it does not sort.
More specifically, the sortBy function is called on the collection. The $results array is created with the values to be sorted on. It is then sorted with asort().
The sorted array no looks something like...
$results = [
    5 => 'A',
    1 => 'B',
    3 => 'C',
    4 => 'D',
    2 => 'E',
    0 => 'F',
]
Next the rebuild of the sorted collection happens...
foreach (array_keys($results) as $key) {
    $results[] = $this->items[$key];
}
return new static($results);
After the results are returned they look like this... (the original input)
$results = [
    0 => 'F',
    1 => 'B',
    2 => 'E',
    3 => 'C',
    4 => 'D',
    5 => 'A',
]
The simplest fix I have found so far is changing the return statement to...
return new static(array_values($results));
I'd be happy to submit a pull request if this turns out to not be a local issue.
Steps To Reproduce:
$model = \App\Models\User::where('isDeleted', 0);
$collection = $model->get();
$collection = $collection->sortBy('full_name');
echo $collection->toJson();

Please post the JSON result.

After writing for 20 mins and getting a correctly formatted JSON output. It seems you might be on to something. The JSON it ordered correctly. The indexes are out of order as expected, but seem to get reordered when read by just about any JSON interpreter.
This doesn't seem to strictly be toJson() function. It almost seem like observing the array changes it as xdebug only was able to show it was sorted on a past var, but never outputted it as sorted.
I 'think' this would be considered expected behavior (the behavior we aren't expecting) Meaning I believe the behavior needs to change in Laravel. But that is just an opinion based on little knowledge of the inner workings of PHP arrays and JSON parsing.
Assuming associative arrays are never passed into the sortBy() function. Adding array_values() on the $results before output will solve the issue with no backwards incompatibilities. However I don't know if that is the case and also don't know about performance issues it will introduce. Maybe adding array_values() to the toJson() and related functions makes more sense than in the sortBy() ?
{
  "1": {
	"full_name": "Ada***, Jeff & L***"
  },
  "2": {
	"full_name": "Chu***, Jeff & ***her"
  },
  "3": {
	"full_name": "For***, Jeff"
  },
  "5": {
	"full_name": "GAN*** LLC-1"
  },
  "4": {
	"full_name": "Gan*** LLC"
  },
  "6": {
	"full_name": "JEFFREY  WH***"
  },
  "0": {
	"full_name": "Karney, Jeff"
  },
  "10": {
	"full_name": "Karney, Jeff"
  },
  "11": {
	"full_name": "Karney1, Jeff1"
  },
  "8": {
	"full_name": "MO***, JEFFREY"
  },
  "7": {
	"full_name": "Mo***, Jeff"
  },
  "9": {
	"full_name": "Str***, Jeffrey & ***h"
  }
}

The issue here is the undefined order of keys in JSON objects. From http://json.org:

An object is an unordered set of name/value pairs.

We can't use array_values() by default because, as you mentioned, this would break associative arrays.
The "solution" here is that you reset the keys yourself:
$collection->values()->toJson();

That makes it work as desired. Thanks for your help!
Hard to say if this could be considered a bug or not, but at least now the problem is searchable for others ;)

When I want an associative array from the collection it does not provide keys if I use values method. So the problem with collection sorting and converting to array is there.


which node version on ubuntu does it work best on ?

Steps to reproduce
Tell us about your environment:

Puppeteer version:
Platform / OS version:
URLs (if applicable):
Node.js version:

What steps will reproduce the problem?
Please include code that reproduces the issue.

What is the expected result?
What happens instead?

Latest LTS version


Link to webaudio example is 404

Describe the Bug
Link to webaudio example is 404
Steps to Reproduce

Go to https://github.com/rustwasm/wasm-bindgen/tree/master/examples/webaudio
Click on 'View compiled example online'

If applicable, add a link to a test case (as a zip file or link to a repository we can clone).
https://rustwasm.github.io/wasm-bindgen/exbuild/web-audio/
Expected Behavior
Link to example to not be 404
Actual Behavior
Link to example is 404

It's a typo and I made a PR to fix it.


Shutdown LoadTest, PerformanceTest, and Others Category Jenkins jobs

Category of "Other jobs", including publish snapshot jobs

Remaining Load test and performance tests not shutdown in #29092

The remaining jobs are either fixed on GHA or have the same fail status as Jenkins (long time permared)
Please add a meaningful description for your change here

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.
To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md
GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

R: @volatilemolotov @damccorm


Add support for accumulated attributes (className in particular)

This PR adds support for attributes that can be accumulated within the same VNode, in particular for accumulating classNames within a VNode.
I often find this useful when I'm using some component and I want to pass in some additional className modifier to the component without overriding the class(es) that the component already uses.
For example:

def component(modifiers: VDomModifier*): VNode

val disabled = classAccum := "disabled-class"

if (someCondition) component(modifiers: _*) else component( (disabled +: modifiers) : _*)

#23 comes to my mind. What about using the snabbdom class module instead? Or is your use-case different?

I am not totally convinced about the use-case here, which is very specific for class. Do we really need to introduce this new concept of AccumAttr, which would only work for Attr?

#23 comes to my mind. What about using the snabbdom class module instead? Or is your use-case different?

Using snabbdom's class module would work, but it seems to use the classList prop which has worse browser support (https://github.com/snabbdom/snabbdom#using-classes-in-svg-elements). It  would be less flexible, one could for example accumulate multiple Boolean signals into a boolean disabled attribute for example.

I am not totally convinced about the use-case here, which is very specific for class. Do we really need to introduce this new concept of AccumAttr, which would only work for Attr?

Hmm, well I have a use case for it, and apparently others too (#23, Snabbdom's class module).

Using snabbdom's class module would work, but it seems to use the classList prop which has worse browser support (https://github.com/snabbdom/snabbdom#using-classes-in-svg-elements).

Is this really a problem? This looks quite green: https://caniuse.com/#feat=classlist
Another question: how would and should classAccum behave with class?
div(classAccum := "hans", classAccum := "peter", class := "anders")

Is this really a problem? This looks quite green: https://caniuse.com/#feat=classlist

Yes, it seems to be well supported (except IE 11), but still not as good as className. My comment was related to the suggestion in the Snabbdom's  readme to use the attr module instead of the class module for SVG elements.

Another question: how would and should classAccum behave with class?

div(classAccum := "hans", classAccum := "peter", class := "anders")

classAccum accumulates all attributes before it. In case there is a of a class following like in the example above that would override all classes. This could result in unexpected behaviour for some users (but arguably so is one class modifier being overridden by another class modifier following it).
My preference would be for class to behave like classAccum by default, so there's no need for classAccum (this is also how the class modifier in the scalajs-react VDom behaves and I "discovered" the need for classAccum while porting some code from scalajs-react to outwatch).

Ok, I am convinced and let's make classAccum, the default for class.

Rebased on top of #123, made classAccum the default behaviour for className and removed classAccum.


Correction for raw affiliation Faculty of Education and Teacher Education Aeres University of Applied Sciences, Wageningen, The Netherlands

Correction needed for raw affiliation Faculty of Education and Teacher Education Aeres University of Applied Sciences, Wageningen, The Netherlands
raw_affiliation_name: Faculty of Education and Teacher Education Aeres University of Applied Sciences, Wageningen, The Netherlands
new_rors: 03jnx2c74
previous_rors: 015d5s513
works_examples: W4282828442
contact: f109d28ee995c57967e99babb73ea496:660531ec740c130db734 @ hotmail.com

This issue was accepted and ingested by the OpenAlex team on 2024-10-10. The new affiliations should be visible within the next 7 days.


Error connecting to the service protocol

Error connecting to the service protocol: failed to connect to http://<IP_ADDRESS>:52996/PQoiCD3IloA=/
the above  error is showed when I was trying to run flutter app on my android device over wifi, and I searched I did not get any answer like it's new error , any help appreciated.

Hi @EngAddow
Please see https://flutter.dev/community for resources and asking questions like this, you may also get some help if you post it on Stack Overflow. Closing, as this isn't an issue with Flutter itself,
if you disagree please write in the comments and I will reopen it
Thank you


Add test to check that bscript.DecodeParts does not overflow.

This test will current fail until the PR that fixes this overflow error is merged. (https://github.com/libsv/go-bt/pull/22)

closing as PR #22 has been merged and included tests in it already


Composer errors ignored

When Composer fails on deploying, the deployment isn't aborted but continues.
Because composer fails, the vendor files are missing so the website will crash.
Rocketeer does detect the error, but proceeds anyway. This happens for example by a missing requirement (like Boris requiring extra extensions in 1.0.10 vs 1.0.8) or older composer version (not understanding ^ sign).
Example error:
[user@host] (production) Your requirements could not be resolved to an installable set of packages.
[user@host] (production) Problem 1 [..]
production/0/dev        |=====> An error occured: "Composer could not install dependencies"
[..]
production/0/dev        |=> Successfully deployed release<PHONE_NUMBER>4046

I thought that was fixed, or maybe it's only fixed on 3.0-dev, what version is that?

2.0.6

Is this a custom task, Polyglot dependencies strategy or Php strategy?

THis is just a regular deploy.
// Which strategy to use to install your application's dependencies
'dependencies' => 'Polyglot',

Much better :)
Should the after task still run though?
|=====> An error occured: "Composer could not install dependencies"
|-- Closure (php artisan assetic:build) fired by deploy.after [~4,55s]
$ cd /home/user/domains/mydomain.com/application/releases/20150310093616
$ php artisan assetic:build
The tasks queue was canceled by task "Deploy"

It's bound to Dependencies or Deploy?

// Tasks to execute after the core Rocketeer Tasks
'after'  => array(
	'setup'   => array(),
	'deploy'  => array('php artisan assetic:build'),
	'cleanup' => array(),
),

welp nope dats weird. Can you open a separate issue for it so I don't forget?

Anahkiasen, have you included this correction to the rocketeer.phar file? I tried to reinstall rocketeer.phar file with command: wget http://rocketeer.autopergamene.eu/versions/rocketeer.phar,  but this problem appeared again.


Bug: CodeNode over-deletion after <backspace>

The <backspace> key over-deletes newlines inside CodeNode. In my testing it deletes 2 at a time instead of 1. This results in unexpected content changes and cursor positions.
Lexical version: v0.12.0
Steps To Reproduce

Create a CodeNode with the text one\n\ntwo
Place your cursor on the empty line separating "one" and "two"
Hit <backspace>

https://github.com/facebook/lexical/assets/739390/7485432c-cbc5-4cc4-969c-2e8e3dd3c384
The current behavior
Both newlines are deleted which produces the text onetwo
The expected behavior
Only the first newline should be deleted producing the text one\ntwo

https://github.com/facebook/lexical/assets/739390/cc6df226-fa31-428c-a116-dc2c3474967c
It turns out that this applies to ParagraphNode as well.

What browser was that? Safari/Chrome work fine for me

The video is from Chrome 116.0.5845.187. Are you using shift + enter to create LineBreakNodes and not ParagraphNodes?

@fantactuka could you repro using shift + enter to create LineBreakNodes?

I'm not able to reproduce with either Shift+Enter or Enter, unless someone can confirm they can repro, I'm going to close it.


Can golang use seata?

seata is awesome, if it only supports java?

Seata provides a Golang based server implementation that contributed by community user,you can find it here .In addition,Seata has not yet provided a golang-based client implementation.

got it


Unique IDs for SG roads from xodr

The error here was Road IDs need to be unique, but we create multiple SG roads for each XODR road as we create one per lane section. Since the Road hash method uses the id, this resulted in "disappearing roads" during a set union operation downstream.
This was a pretty tricky bug to diagnose. @hamishs thoughts on adding a warning / error to add_new_road_object if a user tries to add roads to the same network with duplicated IDs?

Could you change this to merge into v0.4 please?


Bundler Issue | Polyfill not supported

(update!) Forgot to mention the function will work only during development
Seems like React files can't read other files because of polyfills since we are using Webpack 5 for browser usage when we are trying to use fs.
Still thinking of a solution...
For now, maybe consider changing Webpack 5to Vite or Rollup.
Rollup seems like a better choice! Since we are building a library.
transformUtils.tsx
import { optimize } from 'svgo';
import fs from 'fs/promises';

// optimize the svg file by reading the file and then using optimize from svgo that will use the config.mjs file
async function optimizeSvgFile(filePath: string) {
  const svgData = await fs.readFile(filePath, 'utf8');
  const result = optimize(svgData, { path: filePath, multipass: true });
  return result.data;
}

export default optimizeSvgFile;

Function used in another file SvgBaseTemplate.tsx
import React from "react";
import { BasicSvgInterface } from "../Interfaces/StaticProps";
// utilize function from utils to optimize the svg
import optimizeSvgFile from "../../utils/transformUtils";

const ItemGmailSvg: React.FC<BasicSvgInterface> = ({ fill, width, height }) => {
  //define the state for the svg path
  const [svgPath, setSvgPath] = React.useState<string>("");

  // fetch svg and call getOptimizedSvg
  React.useEffect(() => {
    const fetchSvg = async () => {
      const optimizedSvg = await getOptimizedSvg("public/SvgIcon/gmail.svg");
      setSvgPath(optimizedSvg);
    };
    fetchSvg();
  }, []);

  // get optimized svg will call the optimizeSvgFile function
  async function getOptimizedSvg(path: string): Promise<string> {
    const optimizedSvg = await optimizeSvgFile(path);
    return optimizedSvg;
  }

  return (
    <svg
      xmlns="http://www.w3.org/2000/svg"
      width={width}
      height={height}
      viewBox="0 0 32 32"
    >
      {/* use effect will fetch the svg and set the state for the svg path */}
      <path d={svgPath} fill={fill} />
    </svg>
  );
};

export default ItemGmailSvg;

Terminal error:
Module not found: Error: Can't resolve 'fs/promises' in '/home/learner/repos/svgestor/src/utils'
WARNING in<EMAIL_ADDRESS>18:13-32
Critical dependency: the request of a dependency is an expression

WARNING in<EMAIL_ADDRESS>24:14-47
Critical dependency: the request of a dependency is an expression

ERROR in ./src/utils/transformUtils.tsx 4:0-29
Module not found: Error: Can't resolve 'fs/promises' in '/home/learner/repos/svgestor/src/utils'

ERROR in<EMAIL_ADDRESS>3:11-24
Module not found: Error: Can't resolve 'os' in<EMAIL_ADDRESS>
BREAKING CHANGE: webpack < 5 used to include polyfills for node.js core modules by default.
This is no longer the case. Verify if you need this module and configure a polyfill for it.

If you want to include a polyfill, you need to:
        - add a fallback 'resolve.fallback: { "os": require.resolve("os-browserify/browser") }'
        - install 'os-browserify'
If you don't want to include a polyfill, you can use an empty module like this:
        resolve.fallback: { "os": false }

ERROR in<EMAIL_ADDRESS>4:11-24
Module not found: Error: Can't resolve 'fs' in<EMAIL_ADDRESS>
ERROR in<EMAIL_ADDRESS>7:4-18
Module not found: Error: Can't resolve 'url' in<EMAIL_ADDRESS>
BREAKING CHANGE: webpack < 5 used to include polyfills for node.js core modules by default.
This is no longer the case. Verify if you need this module and configure a polyfill for it.

If you want to include a polyfill, you need to:
        - add a fallback 'resolve.fallback: { "url": require.resolve("url/") }'
        - install 'url'
If you don't want to include a polyfill, you can use an empty module like this:
        resolve.fallback: { "url": false }

ERROR in<EMAIL_ADDRESS>8:13-28
Module not found: Error: Can't resolve 'path' in<EMAIL_ADDRESS>Did you mean './path'?
Requests that should resolve in the current directory need to start with './'.
Requests that start with a name are treated as module requests and resolve within module directories (node_modules, /home/learner/repos/svgestor/node_modules).
If changing the source code is not an option there is also a resolve options called 'preferRelative' which tries to resolve these kind of requests in the current directory too.

BREAKING CHANGE: webpack < 5 used to include polyfills for node.js core modules by default.
This is no longer the case. Verify if you need this module and configure a polyfill for it.

If you want to include a polyfill, you need to:
        - add a fallback 'resolve.fallback: { "path": require.resolve("path-browserify") }'
        - install 'path-browserify'
If you don't want to include a polyfill, you can use an empty module like this:
        resolve.fallback: { "path": false }

webpack compiled with 5 errors and 2 warnings
No issues found.

Update!
Change everything in rollup