audiowaveform: init at 1.4.2

Motivation for this change
Adding the audiowaveform CLI program. Used their homebrew file as a reference.
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[x] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

@SuperSandro2000 thanks for the quick feedback, updated.

Result of nixpkgs-review pr 101947 1 run on x86_64-darwin

1 package built:

audiowaveform

@sikmir Updated, thanks for the feedback.

I think everything is ready here, can this be merged? 😄

Also please squash the review related commits into the init ones.

One test is failing:
[       OK ] SndFileAudioFileReaderTest.shouldNotProcessFileMoreThanOnce (1 ms)
[ RUN      ] SndFileAudioFileReaderTest.shouldReportErrorIfNotAWavFile
/build/source/test/SndFileAudioFileReaderTest.cpp:316: Failure
Value of: error.str()
Expected: is equal to "Failed to read file: ../test/data/test_file_stereo.mp3\nFile contains data in an unknown format.\n"
  Actual: "Failed to read file: ../test/data/test_file_stereo.mp3\nFormat not recognised.\n"
[  FAILED  ] SndFileAudioFileReaderTest.shouldReportErrorIfNotAWavFile (0 ms)
[----------] 10 tests from SndFileAudioFileReaderTest (5 ms total)

@SuperSandro2000 How are you running the tests? When I run nix-build -A audiowaveform it shows as passed to me?
Running tests...
/nix/store/z7qvx6wbvmjvs767g06h03pkzr5aqn6i-cmake-3.18.2/bin/ctest --force-new-ctest-process
Test project /private/var/folders/bh/4nbf2dn14wn3ztnrbrqn11l80000gn/T/nix-build-audiowaveform-1.4.2.drv-0/source/build
    Start 1: audiowaveform_tests
1/1 Test #1: audiowaveform_tests ..............   Passed    6.03 sec

100% tests passed, 0 tests failed out of 1

Result of nixpkgs-review pr 101947 run on x86_64-linux 1

1 package failed to build:

audiowaveform

Failed test

I run nixpkgs-review pr 101947.

Thanks, reproduced locally now. So the failing test is the error message should say "File contains data in an unknown format" but instead says "Format not recognised"...
I'm not sure where that error originates from but I don't see it mentioned in the codebase, so perhaps a dependency. I'm not an original contributor to audiowaveform so I wouldn't know where to start on correcting this test. If the tests can be disabled I can progress, otherwise I think this is as far as I can reasonably get here on my own.

If the tests can be disabled I can progress, otherwise I think this is as far as I can reasonably get here on my own.

Yeah, you can just disable the tests or the entire package on darwin like broken ? stdenv.isDarwin;.

Result of nixpkgs-review pr 101947 run on x86_64-darwin 1

1 package failed to build:

audiowaveform

Result of nixpkgs-review pr 101947 run on x86_64-linux 1

1 package failed to build:

audiowaveform

/build/source/test/SndFileAudioFileReaderTest.cpp:316: Failure
Value of: error.str()
Expected: is equal to "Failed to read file: ../test/data/test_file_stereo.mp3\nFile contains data in an unknown format.\n"
  Actual: "Failed to read file: ../test/data/test_file_stereo.mp3\nFormat not recognised.\n"
  [  FAILED  ] SndFileAudioFileReaderTest.shouldReportErrorIfNotAWavFile (0 ms)

Tests have been disabled (added a comment on why) and I've squashed the commits.


Add field Keywords/Translations to search results list

Make it the 3rd column, following "Annotation ID Gloss: English"
Column header: "Translations"

Consider making the whole site layout some 20% wider. Not sure what screen resolution constrained the present width (1140px), but even on my Macbook air (1440px) there's plenty of white space on the side. Perhaps try out 1300px first for a while, and see how that impacts the rest of the layout?

It works, but I would like to give this some more time, because the way I did it now feels really dirty, and I think I can come up with a cleaner and more elegant solution.

Consider making the whole site layout some 20% wider.

My personal preference would be not do do this, because:

As far as I can see, everything fits in the current layout.
I think that websites that are are too wide are uncomfortable to read. See http://ux.stackexchange.com/questions/53506/why-we-dont-use-wider-interfaces-on-wide-screens . That is, I don't think the current layout has so much of white space on the sides because of screen resolution constraints, but because of usability.

It's only a slight preference, though :)

More time OK :-) -- and while you're at it, could you make the keywords comma separated?

Done. The commas were harder then expected, because there should only be one BETWEEN keywords, not after every keyword.


⚠ AZ-Launcher has degraded performance

In 0e4787e, AZ-Launcher (https://az-launcher.nz/) experienced degraded performance:

HTTP code: 200
Response time: 2013 ms

Resolved: AZ-Launcher performance has improved in 2fc2fdc after 23 minutes.


Update TailCommand.php

Add short version of --lines.

Good idea, but could you use lowercase l.
And could you also update the readme with an example?
Thanks!

Done and done.

Thanks!


Address Generation

Looks good. I don't know if this would help you at all, but ReadOnlySpan allocates a byte on the stack which is a very fast trick over creating a byte array on the heap. Just a little TIL if you ever find it useful


Import CycloneDx request from sFractal

Many build tools create CycloneDx SBOMs. Having import-CycloneDx button (similar to import-spdx and import-excel) would save me typing them into form or making fake SBoM and using hierarchy features.

Hi Duncan,
Thanks for creating this.  I know you had asked for it I had dropped the ball!  Can you provide samples apart from what I generate so I can have a wider corpus to test import of CycloneDx.  CylconeDX JSON and XML if possible for each scenario below will be helpful

Simple SBOM with one product and two sub-components included in a single-tier relationship
SBOM with three or more levels of relationship between sub-components.
SBOM with an external relationship either embedded into one CycloneDX file or as two distinct CycloneDX files

Thanks

https://cyclonedx.org/#example-sbom has an example in both xml and JSON. There is a multilevel example at https://cyclonedx.org/ext/dependency-graph/.  You might also want to look at https://github.com/CycloneDX/gh-node-module-generatebom.
iPhone, iTypo, iApologize

From: Vijay Sarvepalli<EMAIL_ADDRESS>Sent: Sunday, September 20, 2020 12:35:27 PM
To: CERTCC/SBOM<EMAIL_ADDRESS>Cc: duncan sfractal.com<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [CERTCC/SBOM] Import CycloneDx request from sFractal (#3)
Hi Duncan,
Thanks for creating this. I know you had asked for it I had dropped the ball! Can you provide samples apart from what I generate so I can have a wider corpus to test import of CycloneDx. CylconeDX JSON and XML if possible for each scenario below will be helpful

Simple SBOM with one product and two sub-components included in a single-tier relationship
SBOM with three or more levels of relationship between sub-components.
SBOM with an external relationship either embedded into one CycloneDX file or as two distinct CycloneDX files

Thanks
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/CERTCC/SBOM/issues/3#issuecomment-695807381, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AANEXD2GWRUSYSQWVBX7YCLSGYVM7ANCNFSM4RTT5SUQ.

Hi Duncan,
I have been running some sample parsers on CycloneDX.  There are a number of challenges in reliably parsing CycloneDX both XML and JSON.

There are too many options for the same information - like vendor/supplier/manufacture/publisher these are not tags but distinct fields making it sort of difficult to look for both or either or
The XML and JSON parsers with verification to the XML Namespace and JSON Schema require a number of schema information downloaded and then loaded in memory.  This opens so many other issues like performance, cross-site security, unparseable errors.

I am going to put this "on hold" for now, due to all these challenges.
Vijay

Thanks for trying.
So I understand – you can still output CycloneDX xml & json but you can’t accept external input due to parsing issues. Correct?
Duncan Sparrell
sFractal Consulting LLC
iPhone, iTypo, iApologize
I welcome VSRE emails. Learn more at http://vsre.info/
From: GitHub<EMAIL_ADDRESS>Reply-To: CERTCC/SBOM<EMAIL_ADDRESS>Date: Thursday, September 24, 2020 at 11:51 AM
To: CERTCC/SBOM<EMAIL_ADDRESS>Cc<EMAIL_ADDRESS><EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [CERTCC/SBOM] Import CycloneDx request from sFractal (#3)
Hi Duncan,
I have been running some sample parsers on CycloneDX. There are a number of challenges in reliably parsing CycloneDX both XML and JSON.

There are too many options for the same information - like vendor/supplier/manufacture/publisher these are not tags but distinct fields making it sort of difficult to look for both or either or
The XML and JSON parsers with verification to the XML Namespace and JSON Schema require a number of schema information downloaded and then loaded in memory. This opens so many other issues like performance, cross-site security, unparseable errors.

I am going to put this "on hold" for now, due to all these challenges.
Vijay
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/CERTCC/SBOM/issues/3#issuecomment-698431595, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AANEXD2GI4B3323IRGJQF5DSHNTI7ANCNFSM4RTT5SUQ.

Yes,
Correct Duncan.  Parsing CycloneDX is put on hold for now as it involves quite a bit of development and a corpus of documents to test against. I believe these will be both happen eventually, as demand increases, then I can put in time or muster up resources internally to take this up.
Vijay

Cyclone DX JSON is available for output now.


Support OVStableDiffusionPipelineBase to Load Textual Inversion in Runtime

This PR aims to support OVStableDiffusionPipelineBase to load pretrained textual inversion embeddings in runtime to save disk storage while keep flexibility:

Save disk storage: We only need to save a SD baseline model exported to OV IR (e.g.: SD-1.5 ~5GB) and textual embedding((10KB-100KB), instead of multiple SD with textual inversion embeddings merged (~n *5GB), since disk storage is very limited especially for edge/client use case.
Flexibility: We can load (multiple) pre-trained textual inversion embeddings in SD baseline model in runtime quickly, which supports combination of embeddings and avoid to mess up baseline model.

So I implemented OVTextualInversionLoaderMixin based on diffusers.loaders.TextualInversionLoaderMixin as follow:

Support textual embeddings saved as *.bin, *.pt, *.safetensors
Update tokenizer with new token id to expand vocab size
Update text encoder embeddings of OV model with OpenVINO ngraph transformation
Verified with SD-1.5, SD-2.1, SDXL-base-1.0 pipeline

Here is some text inversion examples:

SD 1.5 + sd-concepts-library/cat-toy

model_id = "runwayml/stable-diffusion-v1-5"
prompt = "A <cat-toy> back-pack"
np.random.seed(42)

# Run pipeline without textual inversion
pipe = OVStableDiffusionPipeline.from_pretrained(model_id, compile=False, cache_dir=None)
pipe.compile()
image1 = pipe(prompt, num_inference_steps=50).images[0]
image1.save("sd_v1.5_without_cat_toy_ti.png")

# Run pipeline with textual inversion
pipe.clear_requests()
pipe.load_textual_inversion("sd_concepts/cat-toy", "<cat-toy>")
pipe.compile()
image2 = pipe(prompt, num_inference_steps=50).images[0]
image2.save("sd_v1.5_with_cat_toy_ti.png")

SD 1.5 baseline

SD 1.5 baseline + cat-toy TI

SD 1.5 + sd-concepts-library/cat-toy + charturnerv2 + EasyNegative

model_id = "runwayml/stable-diffusion-v1-5"
prompt = "charturnerv2, multiple views of the same character in the same outfit, a character turnaround of a beautiful woman wearing a black jacket and red shirt, best quality, intricate details."
np.random.seed(42)

# Run pipeline without charturnerv2 textual inversion
pipe = OVStableDiffusionPipeline.from_pretrained(model_id, compile=False, cache_dir=None)
pipe.compile()
image3 = pipe(prompt, num_inference_steps=50).images[0]
image3.save("sd_v1.5_without_charturner_ti.png")

# Run pipeline with charturner textual inversion
pipe.clear_requests()
pipe.load_textual_inversion(["./charturnerv2.pt"], ["charturnerv2"])
pipe.compile()
image4 = pipe(prompt, num_inference_steps=50).images[0]
image4.save("sd_v1.5_with_charturner_ti.png")

# Run pipeline with charturner + EasyNegative textual inversion
pipe.clear_requests()
pipe.load_textual_inversion(["./charturnerv2.pt", "./EasyNegative/EasyNegative.pt"], ["charturnerv2", "EasyNegative"])
pipe.compile()
negative_prompt = "EasyNegative"
image5 = pipe(prompt, num_inference_steps=50, negative_prompt=negative_prompt).images[0]
image5.save("sd_v1.5_with_charturner_easynegative_ti.png")

SD 1.5 baseline

SD 1.5 baseline + charturnerv2 TI

SD 1.5 baseline + charturnerv2 TI + EasyNegative TI

SD 2.1 + midjourney_sd_2_0

from optimum.intel import OVStableDiffusionPipeline
import numpy as np

model_id = "stabilityai/stable-diffusion-2-1"
prompt = "A <midjourney> style photo of an astronaut riding a horse on mars"
np.random.seed(42)

# Run pipeline without midjourney textual inversion
pipe = OVStableDiffusionPipeline.from_pretrained(model_id, compile=False, cache_dir=None)
pipe.compile()
image1 = pipe(prompt, num_inference_steps=50).images[0]
image1.save("sd_v2.1_without_midjourney_ti.png")

# Run pipeline with midjourney textual inversion
pipe.clear_requests()
pipe.load_textual_inversion("midjourney_sd_2_0", "<midjourney>")
pipe.compile()
image2 = pipe(prompt, num_inference_steps=50).images[0]
image2.save("sd_v2.1_with_midjourney_ti.png")

SD 2.1 baseline

SD 2.1 + Midjourney TI

SDXL-1.0-base + charturnerv2

from optimum.intel import OVStableDiffusionXLPipeline
import numpy as np

model_id = "stabilityai/stable-diffusion-xl-base-1.0"
prompt = "charturnerv2, multiple views of the same character in the same outfit, a character turnaround of a beautiful woman wearing a black jacket and red shirt, best quality, intricate details."
np.random.seed(0)

pipe = OVStableDiffusionXLPipeline.from_pretrained(model_id, export=False, compile=False, cache_dir=None)

# Run pipeline without textual inversion
pipe.compile()
image1 = pipe(prompt, num_inference_steps=50).images[0]
image1.save("sdxl_base_1.0_without_charturnerv2_ti.png")

# Run pipeline with textual inversion
pipe.clear_requests()
pipe.load_textual_inversion("./charturnerv2.pt", "charturnerv2")
pipe.compile()
image2 = pipe(prompt, num_inference_steps=50).images[0]
image2.save("sdxl_base_1.0_with_charturnerv2_ti.png")

SDXL-1.0-Base baseline:
![sdxl_base_1 0_with_ti](https://github.com/huggingface/optimum-intel/assets/22404054/c1131dd3-f059-4670-99f7-de3201534aa0)

SDXL-1.0-Base + Charturnerv2
![sdxl_base_1 0_without_ti](https://github.com/huggingface/optimum-intel/assets/22404054/69adb5d7-2381-4778-8bd7-bd5543fb71e1)

@echarlaix, could you please kindly review it?
cc @AlexKoff88, @helena-intel

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

@sammysun0711, please fixe the code quality by running make style

@sammysun0711, please fixe the code quality by running make style

Thanks for your tips. I've fixed format with make style and update PR.

@fxmarty thanks for your advice.  I added textual inversion snippets to documentation.
BTW, I create a PR to add images for textual inversion docs: https://huggingface.co/datasets/optimum/documentation-images/discussions/1
Could you please kindly review it, Thanks!

Failing tests are unrelated, thank you!


fix: enable NEXTAUTH_SECRET by default

NEXTAUTH_SECRET is not enabled by default but Discord provider keys are. Next-auth needs to have NEXTAUTH_SECRET and its also checked on schema.
Closes #
✅ Checklist

[x] I have followed every step in the contributing guide (updated 2022-10-06).
[x] The PR title follows the convention we established conventional-commit
[ ] I performed a functional test on my final commit

Changelog
[Short description of what has changed]

Screenshots
[Screenshots]
💯

This commit would make it more clear that this .env variable needs to be used. Error you get without it:
`[next-auth][error][SIGNIN_OAUTH_ERROR]
https://next-auth.js.org/errors#signin_oauth_error "ikm" must be at least one byte in length {
  error: {
    message: '"ikm" must be at least one byte in length',
    stack: 'TypeError: "ikm" must be at least one byte in length\n' +`

This was recently changed in https://github.com/t3-oss/create-t3-app/pull/719
If I understand correctly, the reason was specifically to make it fail - because including an empty key or the same default key in every t3 app are both bad for security.
I would be open to having my mind changed on this, but if we do something it should imo be a default key like changeme.
What does everyone else think?

I would be open to having my mind changed on this, but if we do something it should imo be a default key like changeme.

IMO, if we set a default value no one will probably bother to change it, since any string works and we will end up with numerous apps using the same secret. Which isn't good since it is used to encrypt the NextAuth.js JWT, and hash email verification tokens.

I thought if you didn't set one at all (which is the case when it's commented out) that NextAuth would generate one for you by hashing your options?

Yeah I like the current implementation as well


Fixed #25620 -- Made URLValidator prohibit URLs with consecutive dots in the domain section.

Initially domain name regex had '*' which was allowing '.' to pass
the regex and making invalid URLs as valid (http://example...com).
Now atleast one unicode character will be required after '.' in
domain name regex

Merged in 96fe90f5356971e0e51a0bc41e045dde600d7521, thanks!


guess method for Convolve operator

We can't guess initial parameter values for a model containing convolution

Impossible to guess if we don't know the parameters of the model. A guess requires a set of equations relating the parameters to data. For instance, parameter center can be equated to the the average X-value of the data. In a convolution of two arbitrary models, we don't know a priori the fitting parameters, so we can't have equations relating parameters to information extracted from experiments. The only guess would be to do a quick fitting.


Actual Price under Pattern Expected Price, Caused -Inf Max

Things to check

Have you forced a refresh in your browser (e.g. ctrl+F5 in Chrome/Firefox)?
Yes.
Have you made sure the first time buyer option is correct? If you're unsure, try it both ways
Yes.
Have you time-travelled this week? Travelling backwards resets the prices, and therefore you must not put prices in from both before & after the time-travel
No.

Describe the bug
My turnip price in game was below the range that all expected patterns had, this resulted in the Guaranteed Min price becoming Infinite and the Possible Max price becoming -Infinite, as well as all day prices to become "999 to 0".
To Reproduce
Reset turnip prophet. Set first time buyer to No. Last week to Small Spike (however have tested with all different last week options and the bug occurs for each).
Sunday Price: 99
Monday AM: 87
Monday PM: 84
Tuesday AM: 80
Tuesday PM: 76
Wednesday AM: 72
Wednesday PM: 52
Permalink to your prices
https://turnipprophet.io?prices=<IP_ADDRESS>.76.72.52......&pattern=3
Expected behavior
The minimum price to be finite and less than the maximum price.
Screenshots
Attached patterns before and after Wednesday PM price is added. Am absolutely certain that the Wednesday PM price is the one that was in game.

Desktop:
OS: Windows 10
Browser: Firefox
Version: 75

I experienced this same bug this week and was able to replicate on multiple devices including:

Mac OS/Firefox
Mac OS/Chrome
Android Mobile OS/Chrome

The Sunday price and previous pattern seem to make no difference. The bug occurs once I start to enter the Tuesday PM prices (graph and table were behaving normally until then). I didn't even need to enter/tab to the next price bucket, the first character I entered in Tuesday PM triggers the graph and table to go haywire.
All Normal

Once First Char Entered in Tues PM Bucket

Permalink to full prices entered

@lanaebk please submit your report as a separate issue.

Ok, let's break this down. Based on your values before Wednesday PM, it appears as though you are on track for one of either Decreasing, Large Spike or Small Spike.
Pattern 1 (Large Spike) is made up of three phases, decreasing, high spike, decreasing. Phase 1 (decreasing) can be anywhere from 1 to 7 price periods, starting with a rate multiplier of 0.85 to 0.9, and decreasing by 0.03 to 0.05 each period.
Turnip Prophet then runs a prediction model against the highest and lowest possible rate, once for every possible permutation of periods you could have in this phase. For example, it would run the highest and lowest rate values for 1 period, 2 periods, and so on through the maximum possible of 7 periods in this phase.
Given your values continually decrease up to the point of failure, we can safely assume your game rolled somewhere between 6 to 7 decreasing periods before your spike. For the sake of simplicity, I'll run a model manually for 7 periods.
Starting from a base price of 99 (your buy price), and the highest possible starting rate of 0.9, followed by the smallest decrease of 0.03 for each subsequent period, we get:
Sun  Mon  Tue  Wed  Thu  Fri  Sat
 99   90   84   78   72    0    0
      87   81   75    0    0    0

And the same number of periods, but with the lowest possible starting rate of 0.85, followed by the largest decrease of 0.05 for each subsequent period, we get:
Sun  Mon  Tue  Wed  Thu  Fri  Sat
 99   85   75   65   55    0    0
      80   70   60    0    0    0

As you can see in the second table, the lowest possible value you could have for a Wednesday PM is 60, suggesting that your price of 52 is not possible for a Large Spike pattern. Keep in mind, this is based on you having the absolute worst possible rate in every period before it, for which the probability is near zero. The ranges cannot get any wider than this, but they certainly do get tighter as your sell prices are revealed through the week; that means in reality the lowest possible value is likely higher than 60.
Take for example your Wednesday AM price of 72; if we do the math backwards on that value, we can observe that your effective rate is somewhere between 0.71718 and 0.72727 in the Wednesday AM period. So, we run the model again with this knowledge, and your possible rate range for Wednesday PM becomes:
Best case:
0.72727 - 0.03 = 0.69727
99 * 0.69727 = 69.02973
69.02973 + 0.99999 = 70.02972
(int) 70.02972 = 70

Worst case:
0.71718 - 0.05 = 0.66718
99 * 0.66718 = 66.05082
66.05082 + 0.99999 = 67.05081
(int) 67.05081 = 67

At this point we can obvervse with a high degree of confidence that the possible ranges for your Wednesday PM price are somewhere between 67 to 70, making your actual value of 52 impossible.
Caveat: The above math is only accurate if we assume that your buy price on Sunday was actually 99, and your sell price on Wednesday AM was actually 72. If either of those values were actually different, the results of the math would differ.
Pattern 2 (Decreasing) is made up of a single phase, with a starting rate somewhere between 0.85 to 0.9 again, which decreases by 0.03 to 0.05 every period. Knowing that, the exact same math applies as above, which indicates for the given inputs, a value of 52 is impossible for Wednesday PM here as well.
Pattern 3 (Small Spike) is made up of three phases, decreasing, spike, decreasing, similar to pattern 1, but with a sharper decline and a lower cap in the spike. Phase 1 (decreasing) consists of anywhere from 0 to 7 periods, with a starting rate of 0.4 to 0.9.
Given the upper bounds here are the same as pattern 1, we don't need to run that model again. But we will need to determine the new lower bounds here.
Sun  Mon  Tue  Wed  Thu  Fri  Sat
 99   40   30   20   10    0    0
      35   25   15    0    0    0

When looking at the results table, at first you might be thinking "Hey, that says the lower bound is 15 for Wednesday PM! 15 is lower than 52!" and you would be correct; however, this model is based on the assumption that you received the lowest possible value in each period, meaning your Monday AM price must have been 40 in order for a 15 to be possible on Wednesday PM. Given your inputs, we know with complete confidence that you did not have the lowest possible value on Monday, you actually had a pretty good value at 87 considering the ceiling is 90.
Using the reversed math I demonstrated earlier, we know with a high degree of confidence that your effective rate on Wednesday AM was between 0.71718 and 0.72727. We also know that each period in the decreasing phase for pattern 3 and pattern 1 use the same math, which means the previously determined worst case value of 67 applies to this pattern as well.

All that is to say, given the input values provided throughout the earlier days in the week, a value of 52 is impossible for Wednesay PM.
From this, we can summize that the input values are wrong in some way, which begs a few questions:

How confident are you in the values for every day in this week?
Are all of the values (buy price, and all sell prices) from the exact same island?

All turnip prices are from the same island. I'm absolutely certain of the Sunday Price and the Wednesday PM price, putting only these into the calculator gives viable patterns.
The others, it is possible that a transcription error occurred! I'm fairly confidant in at least the leading digit of each, since I find a transposition error unlikely. Using the leading digits x 10 (and deleting duplicate 80s i.e. Mon PM and Tues AM) gives a viable fluctuating pattern. My turnip prices today fit into this pattern so it seems possible there was an input error earlier in the week on my end!


Appstudio update test-component-pac-cqkr

Pipelines as Code configuration proposal

Pipelines as Code CI/test-component-pac-cqkr-on-pull-request has successfully validated your commit.

StatusDurationName

✅ Succeeded
8 seconds
init

✅ Succeeded
16 seconds
clone-repository

✅ Succeeded
26 seconds
build-container

✅ Succeeded
10 seconds
inspect-image

✅ Succeeded
9 seconds
deprecated-base-image-check

✅ Succeeded
35 seconds
clamav-scan

✅ Succeeded
9 seconds
clair-scan

✅ Succeeded
11 seconds
sbom-json-check

✅ Succeeded
11 seconds
label-check

✅ Succeeded
11 seconds
optional-label-check

✅ Succeeded
6 seconds
show-sbom

✅ Succeeded
6 seconds
show-summary

Pipelines as Code CI/test-component-pac-cqkr-on-pull-request has successfully validated your commit.

StatusDurationName

✅ Succeeded
6 seconds
init

✅ Succeeded
20 seconds
clone-repository

✅ Succeeded
25 seconds
build-container

✅ Succeeded
19 seconds
deprecated-base-image-check

✅ Succeeded
18 seconds
inspect-image

✅ Succeeded
14 seconds
clair-scan

✅ Succeeded
33 seconds
clamav-scan

✅ Succeeded
7 seconds
sbom-json-check

✅ Succeeded
15 seconds
optional-label-check

✅ Succeeded
15 seconds
label-check

✅ Succeeded
7 seconds
show-summary

✅ Succeeded
6 seconds
show-sbom


fix: get the package build target working

These changes get both the parcel bundling and vsix build targets working together.
A few important changes to note:

Separated the packaging phase to use the dist folder instead of out. This helps keep packaging completely separate from the normal debug/dev builds
As a result of the above change, the vsce package command now runs inside of the dist folder, so we need to copy any other needed files there as well (atm that's package.json, package.nls.json, and LICENSE)
Changed the gulpfile to use the command-line version of vsce instead of the js lib. I found the js version very hard to debug because gulp tends to swallow console.log statements, so the build would fail with zero diagnostic output. Using the command line api solves that problem and makes builds easier to debug.
Moved the tsconfig out of the src dir and into the root. I did this mainly because we are referencing the package.json in some parts of the code now, and if we use require(''), parcel can't resolve it, because we've gone one level deeper (from src to out/src). The solution to this is to use typescript import to import package.json. On compile, ts knows to change the relative path based on the output dir. But in order to let ts actually do this, we have to change the root of the ts project so that package.json is inside of it.

I ran into an issue running the package command--does it work for you?

It is working for me. Hmmm. Did the package script work for you before? I switched it from using the .ts files directly to using the compiled .js in out/ because it would ignore some typscript errors.

The package script didn't work before, but I pushed some changes that I had lying around from a while ago that fixed it for me. I'll look around at what it's doing some more tomorrow, it's odd that it works for only one of us, package-lock'd installations should be identical.

Indeed. Are you on Windows or Mac?

Mac

Ahh, I'll see if I get the same error in WSL

I'm still not sure why it works for you--we used to have vscode as a direct dependency, but no longer do (since it's advised to depend on the separate types file). The docs say that vscode should be marked as external. They don't have built-in support for externals like Webpack does, but someone wrote a plugin that might work. We could do that, or swap over to Webpack for this build. I have a preference to Webpack just because I've lots of experience with it as a user and plugin author, but don't feel strongly.

I'm fine with switching to webpack if it's easier to get working everywhere. I'll try out that config.

Alright, let's give it another shot. I merged in your webpack config and switched from parcel.
Everything is working for me on both Windows and Ubuntu 18.04, hopefully that means it works on Mac too (I don't have a Mac to test on ☹)

Also a note if you install the extension, it will only work when launching with the proposed api flag due to: https://github.com/microsoft/vscode-pwa/issues/80

Cool, thanks! I made a couple tweaks to ensure the bootloader and terminateProcess.sh script can be found, seems to work well now.


Use shared GHA from Shipyard in release job

Use the shared e2e, post-mortem and release-images shared GHA from
Shipyard.
Signed-off-by: Mike Kolesnik<EMAIL_ADDRESS>

I would not backport this, at least for now, unless we really need to


Adding cache mechanism for iteration

Summary
Upon comparing naive Avro file iteration with our b-tree file "sorted-iteration", I found out that we're a few orders of magnitude slower.
Although we designed the file structure with search in mind, I wasn't expecting sorted-iteration to be so slow.
Detailed Description
In order to debug I had to read the file from some slow source, so I used S3.
I found out that the cause of the slowness is seek operation (makes sense).
because we currently seek for every new block, I thought about adding a cache buffer, as we're reading more or less consecutive blocks.
However, after doing that I remembered/understood that we actually save the blocks in reverse order, so caching will not help - every time we hop to the previous block.
so I'm kind of stuck now. @shay1bz - any thoughts will be appreciated!
How was it tested?
added a few tests

I remembered/understood that we actually save the blocks in reverse order

AFAIR we went through a lot of headache to store the blocks in a forward-only direction, exactly for this purpose - to ensure only forward-seeks. I'm pretty sure this is  where we reverse back the order to get forward-only direction. I just checked the generated file from the unit test in #67, and all the pointers are forward only.
I also think block caching is a good idea, and I believe that even a basic LRU cache can give a high cache hit rate.
Can you elaborate on the benchmark you did? I'm not sure I fully understand.

LRU cache is exactly what I had in mind. just got distracted by the backward issue.
So, first great news. I remember that we struggled a lot to get it forward only.
what got me suspicious is the "new" test testCacheIteration. i added logs there to follow the "seeking" operation, and noticed this log:
2022-12-25 18:18:28,103  INFO hadoop.file.AvroBtreeFile - seeking to offset (after header): 0
2022-12-25 18:18:28,105  INFO hadoop.file.AvroBtreeFile - seek time: 2 ms
2022-12-25 18:18:28,163  INFO hadoop.file.AvroBtreeFile - seeking to offset (after header): 895964
2022-12-25 18:18:28,163  INFO hadoop.file.AvroBtreeFile - seek time: 0 ms
2022-12-25 18:18:28,172  INFO hadoop.file.AvroBtreeFile - seeking to offset (after header): 895802
2022-12-25 18:18:28,173  INFO hadoop.file.AvroBtreeFile - seek time: 0 ms
2022-12-25 18:18:28,173  INFO hadoop.file.AvroBtreeFile - seeking to offset (after header): 895645
2022-12-25 18:18:28,173  INFO hadoop.file.AvroBtreeFile - seek time: 0 ms
2022-12-25 18:18:28,174  INFO hadoop.file.AvroBtreeFile - seeking to offset (after header): 895482
2022-12-25 18:18:28,174  INFO hadoop.file.AvroBtreeFile - seek time: 0 ms
2022-12-25 18:18:28,174  INFO hadoop.file.AvroBtreeFile - seeking to offset (after header): 895325
2022-12-25 18:18:28,174  INFO hadoop.file.AvroBtreeFile - seek time: 0 ms
.
.

so it looked like it is backward only. but now I'm afraid that I missed using getRealOffset as this offset is taken from the end of file?

I think I see the issue.
try to run testIterator33. I just print the content and order of the avro file:
{"val1": "001", "val2": "001", "metadata": 155}
{"val1": "014", "val2": "014", "metadata": 310}
{"val1": "027", "val2": "027", "metadata": 467}
.
..
{"val1": "002", "val2": "002", "metadata": 37}
{"val1": "006", "val2": "006", "metadata": 74}
{"val1": "010", "val2": "010", "metadata": 111}
{"val1": "011", "val2": "011", "metadata": null}
{"val1": "012", "val2": "012", "metadata": null}
{"val1": "013", "val2": "013", "metadata": null}
{"val1": "007", "val2": "007", "metadata": null}
{"val1": "008", "val2": "008", "metadata": null}
{"val1": "009", "val2": "009", "metadata": null}
{"val1": "003", "val2": "003", "metadata": null}
{"val1": "004", "val2": "004", "metadata": null}
{"val1": "005", "val2": "005", "metadata": null}

the first block is good - we can see 001 as the first row.
but then key 002 is almost at the end.
and 003,004,005 are the last ones. but if we iterate in the "correct" order we will hop on many blocks in the file.
I would have expected them to be not very far from each other. need to think why that happens.

Summarizing my current understanding - the original block tree is written in post-order (as each block "gets" its sync/size only after it is written, and only then we can update its parent node's metadata). this causes the root block to be written last.
So we reverse the block order and get a "reverse post-order".
Instead, we need to somehow re-order the blocks as pre-order. this way the "sorted iteration" will have minimal hops. I think we once tried it but had to use a block dictionary for that. not sure if there's an elegant trivial solution.

Not sure I understand - what's the issue with the current solution? What does it mean to " somehow re-order the blocks as pre-order"?

referring to tree sort orders.
current solution uses "reverse post-order" - the good thing is that the root block is first, the bad thing is that all the rest of the blocks are "out-of-order". For example, the second/third blocks are at the end.
the proposed solution is to use a "pre-order" sort instead - this way the root block is first and also rest of the blocks are more or less in order.

Oh OK I get it now. I wonder if we really have to flush() every closed block. Looks like the easiest way to control the order is to buffer everything in memory (plain Java objects, not Avro buffer), sort however we want, only then write to the in-memory Avro writer, and then to the actual reversed file (I don't think we can avoid the reversing part). Is that what you mean by  "we once tried it but had to use a block dictionary for that"?

I meant in this PR's context of full sorted iteration with LRU cache.
If the blocks are more-or-less sorted then reading ahead and caching should work nicely.
In the current ordering, we're in the extreme case that we're iterating the blocks from the end of the file backward and it causes many "seek" operations.

You are right. For every single fetch we go forward only, but in a total e2e iteration we go backward, if looking from a high level. Looks like pre-order can even leverage data node OS caching, depending on the configuration.
Assuming we have the entire tree in memory, what prevents us from writing the nodes in reversed pre order (which will be reversed again on disk)? Complexity or some other fundamental issue?

The main challenge is that we have the sync values hard-coded at the written nodes. we can't change them when we rewrite the blocks. so the issue is that if we reorder the blocks all the syncs are getting meaningless by themselves. I think we will need to save the blocks/sub-tree sizes instead of the sync points, and calculate the sync position ourselves.

I don't think this is the case. If we have the entire tree in memory, why does it matter if we start flushing the "first" nodes (like today) or the last nodes?
If we take the tree in your link as an example - lets assume every node is entire block - then we flush node 90 with null pointers (leaf), then 66, then 70 with pointers to 90 and 66, and so on, and we get inverted pre-order. We then apply the reverse logic to get "real" preorder on disk. This is exactly what we do today, just in another order. I don't see why changing the order should impose new challenges.

The main challenge is that we have the sync values hard-coded at the written nodes

We have this challenge today as well, and we solve it with getRealOffset

well.. you got a point there! i will try.

Good luck!

fixed in #71


style : Enhance HelloDjangoApp web page

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: InquiridorTechie sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

Thanks for the PR; give me some time to check out the changes, as I believe they'll necessitate updating docs that work from this sample.


Update silencer-lib_2.13.3 to 1.7.2

Updates com.github.ghik:silencer-lib_2.13.3 from 1.7.1 to 1.7.2.
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "com.github.ghik", artifactId = "silencer-lib_2.13.3" } ]

labels: library-update, semver-patch

Superseded by #397.


Update README.md

Update README.md with new prints of BOT and new features (if have)

have new environments to be added on README, we suggest to add a table with environments and show env by env if its required or not


Fix header date.

Problem introduced in #2009

Problem introduced in #2009

"It's just a docstring change", I thought. What could possibly go wrong? :disappointed:
But just to prove that two wrongs can make a right, I'm also going merge this PR before travis has finished. :stuck_out_tongue_winking_eye:

Sigh. I'll be glad when this isn't part of our tests...
I question the legal need for it anyway. Not for here and now, but one day... :sunrise:

well done AVD, good banter 👍


ImportError: cannot import name 'get_num_classes' from 'torchmetrics.utilities.data'

When I was running the demo, I encountered a problem

Hi, if you can make sure the pytorch-lightning in your environment is 1.3.5, then please check the version of torchmetrics. It seems that this is due to the incomparable problem between pytorch-lightning and torchmetrics. You can try to re-install torchmetrics by:
pip install torchmetrics==0.6.0


feat(core): [LW-9408] create All Set component

Checklist

[x] JIRA - LW-9408
[x] Screenshots added.

Screenshots

Changes unknown
when pulling d1e64a11f467015359da9b8e0bb125ca60279606 on LW-9408-all-set
into ** on lw-9405-shared-wallet**.

@renanvalentin I have one open question. I see you have added a bunch of icons, but I'm missing (or I'm not able to find) a place in our storybook where all available icons are presented. Do we have such screen?
In Figma I see Default icons section which presents all icons in dark and light mode.
I would like to have one global screen with all available icons to be used :)

@renanvalentin I have one open question. I see you have added a bunch of icons, but I'm missing (or I'm not able to find) a place in our storybook where all available icons are presented. Do we have such screen?
In Figma I see Default icons section which presents all icons in dark and light mode.
I would like to have one global screen with all available icons to be used :)

We do not have a page listing all the icons used yet. There has been an ongoing discussion of how to organize the icons.

@renanvalentin i can see that one of the stories is not under the section "Shared Wallets" in Storybook, is that intentional?


Feature Request: Sidecar match blacklist

Is your feature request related to a problem? Please describe.
When we are offering sidecar channels to users, sometimes we run into situations where this is a bad node, which constantly doesnt allow connections, even though the user is getting matched to it. The user will try and cancel their order and fiddle with their settings, but they will consistently get matched to this misbehaving node.
Describe the solution you'd like
POSSIBLE SOLUTION: I would like to be able to add a node blacklist to our backend, which will add these blacklisted nodes into the sidecar request. This way, the pool batching engine will not match our user to the nodes that we have blacklisted.
BEST SOLUTION: In addition, something LL could do would be to more quickly cycle between potential matches. If a match occurs and after 1 hour a channel hasnt reached a batch, please try and match our user to another node, instead of allowing the channel to be unfulfilled for 12+ hours.
Describe alternatives you've considered
We've told our user to try using different lease durations to potentially avoid the misbehaving user. But thats a poor solution.
Additional context

Still having issues with this. Of all the issues we've run into with Pool, this has been the most crippling.
problem peer pubkey:
02c8dd204889bf294bb3ecc00f4893db34224dce67d1fd27f25bc7fd7e709bfceb

looks like this is merged!


Feature/hourly forecast

Added CSS to style.css to create multiple small weather cards under the Today at section.

Everything looks good on the app. Merging the pull request.


lookUp method does not exclude inner hole

Hey, first of all I want to compliment and thank you for the nice work.
I have noticed that the lookUp method will give me a result if coordinates are within outer boundaries but will not exclude the result if coordinates are also within the inner boundaries.
I'll give you an example with coordinates in Berlin
lookUp(52.5131, 13.4213)

The expected result would be Berlin but I am getting Brandenburg as it is surrounding Berlin

I have made a quick fix to the reverseGeolocation-method.
Not sure if it causes any other problems but it works for Berlin and Prag
 const reverseGeolocation = (lat, lng, dataType = null) => {
  if(typeof lat !== 'number' || typeof lng !== 'number') {
      return new Error('Wrong coordinates (lat: ' + lat + ',lng: ' + lng + ')');
  }

  let point = [lng, lat];
  let i = 0;
  let found = false;
  const countries = admin1.features;
  do {
      let country = countries[i];
      if(country.geometry.type === 'Polygon') {
          found = pointInPolygon(country.geometry.coordinates[0], point);
          // --- Fix by DJK: Exclude result when point is in inner hole
          if (found && country.geometry.coordinates.length > 1) {
            let j = 1;
            var exclude = false
            do {
                exclude = pointInPolygon(country.geometry.coordinates[j], point);
                j++;
            } while(j < country.geometry.coordinates.length && !exclude);
            if (exclude)
                found = false
          }
          // ---
      } else if(country.geometry.type === 'MultiPolygon') {
          let j = 0;
          do {
              found = pointInPolygon(country.geometry.coordinates[j][0], point);
              j++;
          } while(j < country.geometry.coordinates.length && !found);
      }
      i++;
  } while(i < countries.length && !found);

  let result = null;
  if(found) {
      if(dataType === 'raw') {
          result = {
              type: 'FeatureCollection',
              features: [ clone(countries[i-1]) ]
          };
      } else {
          let props = countries[i-1].properties;
          let properties = {};
          properties.continent_code = props.cont_code;
          properties.country_a2 = props.iso_a2;
          properties.country_a3 = props.adm0_a3;
          properties.region_code = props.region_code;
          if(props.iso_3166_2 !== '' && !props.iso_3166_2.endsWith('~')) {
              properties.state_code = props.iso_3166_2;
          }
          if(dataType === 'geojson') {
              result = {
                  type: 'FeatureCollection',
                  features: [{
                      type: 'Feature',
                      properties,
                      geometry: clone(countries[i-1].geometry)
                  }]
              };
          } else {
              result = clone(properties);
          }
      }
  }

  return result;
};

Hi, thanks for the report. I'll check it.

It should be fixed with version 1.0.7, can you check it? Thanks.

Hey, yes looks good now :-) thanks.
I guess we can close this issue now.

Ok, thank you!


Special rows type weblink - icon and new tab

0.75.0b0
Special row type weblink raises error if no icon provided.
There should be a default icon i think.
Weblink opens no new Tab, should be optional i think.
EDIT: type call-service also raises error when icon is missing.

Lame. That workaround should have been submitted as a fix to our repo…

@ludeeus


Limit length of type hints

Run on this file here:
https://github.com/facebook/nuclide/blob/e679970e6a20af834e9862fb83e49a4abaf6549c/pkg/nuclide-reprint-js/lib/printers/complex/printBinaryExpression.js
flow type-at-pos printBinaryExpression.js 43 13
Before this change, Flow printed so much text that my tmux session was
overwhelmed for a couple minutes. When Nuclide called it, Atom would crash. Now,
it still takes 15 seconds to run but the output is smaller and Atom doesn't
crash when Nuclide calls type-at-pos. Flow features are unavailable while the
type is being computed, but that's better than the entire editor crashing.

The build is broken. Looks like line numbers changes in https://github.com/facebook/flow/commit/284994aaface54f17f44cb4bc4150617209d6b5b which is causing a test to fail. It's unrelated to this change.

@facebook-github-bot import

Thanks for importing.If you are an FB employee go to Phabricator to review internal test results.

Abandoning in favor of 9ead7390d79d4690463a10581a46578671bffb7d


feat: use config function instead of using env directly

This PR adds the hydra.php config file and uses the config helper function instead of using env directly.

If you are calling env from within your application, it is strongly recommended you add proper configuration values to your configuration files and call env from that location instead, allowing you to convert your env calls to config calls.

Resolve #11
Ref: https://laracasts.com/discuss/channels/laravel/configcache-makes-variables-in-env-null

Thanks - really appreciate this pull request. I've merged it and now updating the readme :)


Update tutorial to set BaseURL for api region

Update tutorial to instruct users to set the BaseURL corresponding to the region associated with their subscription. Remind users to include trailing slash in urls.
BASE_URL = 'https://westus.api.cognitive.microsoft.com/face/v1.0/'
CF.BaseUrl.set(BASE_URL)

This seems like a small (but important) contribution, so no Contribution License Agreement is required at this point. We will now review your pull request.
Thanks,
Microsoft Pull Request Bot

@apumapho : Thanks for your contribution to the Azure documentation! The author, @v-royhar, has been notified to review your proposed change.

@apumapho : Thanks for your contribution to the Azure documentation! The author, @v-royhar, has been notified to review your proposed change.

@apumapho : Thanks for your contribution to the Azure documentation! The author, @v-royhar, has been notified to review your proposed change.

@apumapho : Thanks for your contribution to the Azure documentation! The author, @v-royhar, has been notified to review your proposed change.

@apumapho : Thanks for your contribution to the Azure documentation! The author, @v-royhar, has been notified to review your proposed change.

@apumapho : Thanks for your contribution to the Azure documentation! The author, @v-royhar, has been notified to review your proposed change.

@apumapho : Thanks for your contribution to the Azure documentation! The author, @v-royhar, has been notified to review your proposed change.

@apumapho : Thanks for your contribution to the Azure documentation! The author, @v-royhar, has been notified to review your proposed change.

@apumapho : Thanks for your contribution to the Azure documentation! The author, @v-royhar, has been notified to review your proposed change.

@apumapho : Thanks for your contribution to the Azure documentation! The author, @v-royhar, has been notified to review your proposed change.

@apumapho : Thanks for your contribution to the Azure documentation! The author, @v-royhar, has been notified to review your proposed change.

@apumapho : Thanks for your contribution to the Azure documentation! The author, @v-royhar, has been notified to review your proposed change.

@apumapho : Thanks for your contribution to the Azure documentation! The author, @v-royhar, has been notified to review your proposed change.

@apumapho : Thanks for your contribution to the Azure documentation! The author, @v-royhar, has been notified to review your proposed change.

@apumapho : Thanks for your contribution to the Azure documentation! The author, @v-royhar, has been notified to review your proposed change.

@v-royhar - Please review these proposed changes. Thanks

@Kaiqb

Similar changes have already been merged into master branch.
So I think it should be OK to close this PR.
Anyway, thanks for your interest and contribution.

Closing this PR since similar change has already been merged.

#please-close

#sign-off


"Help: Report Issue" does not use issue templates for extensions

We get users regularly using the "Help: Report Issue" feature to report bugs on the Python extension. Unfortunately that means they are completely ignoring our issue template which asks a lot of key details that always lead to us having to round-trip back on them asking for them to fill out our issue template to get the information back.
I would normally ask to just grab an issue template, but we have 4 different templates, so that's not so straightforward for us. So maybe a way to specify what template to use by default or to allow us to opt-out of "Report Issue" and have it just open the browser to our repo?

I don't use the Python extension, but I have same feeling with this case.
So I have some possible solutions here for reference. You may have better ideas.

 It will be easy to use the templates because it's actually typing in GitHub directly. The issue reporter can print basic information in issues rather than sending via URL and jumping to a browser. This issue #73921 will be avoided as well because users will not be asked to paste anything (as VS Code will already have done in the webview)
Jumping to browsers after selection of issue sources. (This is an alternative by the author)
The issue reporter can be redesigned to be compatible with the GitHub reporter format.

All of the solutions above are independent. You can choose one you like or consider a better one.

Another option is to allow us to provide our own hook or "Report Issue" flow that the "Help: Report Issue" command defers to. (See microsoft/vscode-python#1119). Currently there's https://github.com/microsoft/vscode/issues/46726 which has a specific potential solution while this issue has other ones.


No interface for setting the number of pods on which an integration is to be deployed

Camel K exposes an interface for setting the affinities of multiple integration pods with physical nodes on OpenShift/Kubernetes. However, there is no interface for controlling the number of pods assigned to a specific integration in the first place.
A work-around is to do "oc edit it [integration]" or "kubectl edit it [integration]" and add the section ".spec.replicas" with the desired value. Note that this entry will not exist initially, and must be created.

I've just realized that if I change .spec.replicas using "oc edit it", the integration is no longer visible when I do "kamel get it". I don't know if that is significant or not. I can still use "oc" to manipulate the integration, it's just the kamel utility that doesn't seem to work.

@astefanutti this should be possible now right ?

yes, it is possible, also with kubectl scale.


Add CI job that runs the full load test suite

Please describe what should be documented
This is a sub-issue for #4822
Create a CI job runs the internal OSM load test suite (currently a private project) periodically.
This CI job works as:

Pull osm-perftest repo.
Execute the script that performs the full load test suite. The final result will be saved in a local csv file on the job VM.
Output the results to a certain page. Possible solutions are: a Github wiki page, as comment to the latest merged PR, or cloud file storage.

In order to implement step 1, an access token should be created in osm-perftest and secret should be added to osm repo.
Please suggest where in the repo the document should be located

do you know what scopes you need the token to have?
https://docs.github.com/en/developers/apps/building-oauth-apps/scopes-for-oauth-apps#available-scopes

@steeling since the job only need to read osm-perftest repo, according to the doc, I think (no scope) grants read-only permission which is sufficient for our case.

A PAT will give access to a user's private repo's, so we should figure out another way to do this, including considering open sourcing that repo if we want.


Graph

Codecov Report

Merging #15 into master will increase coverage by 3.73%.
The diff coverage is 95.18%.

@@            Coverage Diff            @@
##           master     #15      +/-   ##
=========================================
+ Coverage   91.66%   95.4%   +3.73%
=========================================
  Files           5       4       -1
  Lines         324     566     +242
=========================================
+ Hits          297     540     +243
+ Misses         27      26       -1

Impacted Files
Coverage Δ

redsky/tests/utils.py
94.44% <ø> (ø)
:arrow_up:

redsky/tests/conftest.py
100% <100%> (ø)
:arrow_up:

redsky/event_streams.py
92.3% <92.3%> (ø)

redsky/tests/test_streams.py
99% <99%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2ba950c...0143345. Read the comment docs.

Was pulled in as part of #13


Correct filenames

Made it so the filenames included in a submission are correct. The Selenium tests now add commented code as the submissions pass through JavaParser. The changes to other tests were done for the same reason.
Since only the challenge id was used in feedback I also changed it so only the id is included in the redirectAttributes. It also fixed an issue with the challenge not being initialized properly due to lazy fetching from the database.

Coverage remained the same at 80.513% when pulling f6badd1855399fdefc8a2bd960003f08013db69a on Heliozoa:correct-filenames into bffd0c1f56b8e6063778cdf397a3582a84d06912 on tdd-pingis:master.


Support authorization deactivation

https://community.letsencrypt.org/t/authorization-deactivation/19860

Could we remove the challenge DNS record after it has been validated?

Yes.


Upload flyway data batch 2

The second batch of flyway data includes 8 radars:
bgvar
bejab
bezav
bewid
plrze
ptfar
ptliz
ptprt

Which have the expected date range of 2016-09-19/2016-10-09 (except pt). The bg and be data are every 5 minutes, the pl and pt data every 10 minutes. I've added the coverage stats to the Spreadsheet. @CeciliaNilsson709 can you have a look?
Important before I upload:

For the pt radars, the date range is 2016-08-01/2016-11-30 (much larger). Do I (cf. the German) data (which had 10 extra days) upload all that data, or just the flyway range (2016-09-19/2016-10-09).
For the Belgian data, minute 55 is missing for every hour. Is that expected?

Hi Peter,

I don't think there is no reason not to upload all the data? :-)
I had a look in the Belgian raw data, minute 55 seems to be missing very often indeed, I don't know why. Belgians! ;-)

Yeah, you can just as well upload it all.

Belgians 🤷♀ indeed.

OK
Hey, you can't just throw your hands in the air and blame 👉 Belgians. 😂 But ok, I'll upload the data as it is.

All data from batch 2 are now uploaded (warts and all)! 👏  Closing issue.


bitbar://refreshPlugin should do the same as clicking "Refresh All"

If a plugin is installed via a way other than using the bitbar://openPlugin way, there's no way for the plugin to come up without clicking the "Refresh All" option. It would make sense to be able to do this buy simply visiting bitbar://refreshPlugin without passing any variables, or at least bitbar://refreshPlugin?name=*? (which currently does refresh all plugins but does not bring up newly installed plugins).
Thanks!

This would be especially handy for the BitBar CLI tool :D

In addition, bitbar://refreshPlugin?name=*? tries to update plugins that have been removed from the plugins folder. This causes Updating... to appear in the menu bar until BitBar is forced to quit and restart.

i run into the same problem and kind of fix it with applescript. Its far from an ideal solution, so if you guys have come up with something better, please share.
set old to (path to frontmost application as text)
ignoring application responses
	tell application "System Events" to tell process "BitBar" to click menu bar item 1 of menu bar 1
end ignoring
--we need this because for unknown reason there is a delay about 5s after the first click
do shell script "killall System\\ Events"
delay 0.1
tell application "System Events" to keystroke "r" using {command down}
activate application old


Update README.md

Fixes #[issue number].
Status
[ ] Under development
[ ] Waiting for code review
[ ] Waiting for merge

Information
[ ] Contains breaking changes
[ ] Contains new API(s)
[ ] Contains documentation
[ ] Contains test
[ ] Contains examples

To-do list
[ ] [Fix this thing]
[ ] [Fix another thing]
[ ] ...

Hi @jdmarlin!
I noticed you haven't signed our Qlik Contributor License Agreement ("CLA") for contributing to Qlik Open Source projects.
Please follow the instructions on https://github.com/qlik-oss/open-source/blob/master/sign-cla.md and once that's approved, you're more than welcome to open a new PR with the changes I just reverted. Thank you!
Kind regards,
Josefine


Fuel cell outputs show up on PV-Battery systems

@cpaulgilman, @brtietz - While going through this issue, I discovered the data tables output for PV-Batt / Res configuration includes Fuel cell outputs

Originally posted by @sjanzou in https://github.com/NREL/SAM/issues/496#issuecomment-767499439

This also exists in pv-battery commercial, and pv-battery singleowner, so it is likely all pv-battery configurations.

This also exists in pv-battery commercial, and pv-battery singleowner, so it is likely all pv-battery configurations.


Cannot get property 'empty' on null object

I'm trying to configure multiple tasks but I got the following error:
Caused by: java.lang.NullPointerException: Cannot get property 'empty' on null object
at org.unbrokendome.gradle.plugins.xjc.XjcGenerate$_closure1.doCall(XjcGenerate.groovy:92)
at org.gradle.api.specs.internal.ClosureSpec.isSatisfiedBy(ClosureSpec.java:32)
This is my task:
task xjc_SPS(type: org.unbrokendome.gradle.plugins.xjc.XjcGenerate) {
source = fileTree('src/main/resources/xxx//') { include 'mySchema.xsd' }
outputDirectory = file('generated-sources/')
targetPackage = 'com.xxx'
}

Strange that it only happens when I have multiple tasks for xjc. I followed the suggested approach on https://github.com/unbroken-dome/gradle-xjc-plugin/issues/5

This should be fixed with 1.4.2, please try with the new version!


Npu example: add --lowbit-path for baichuan2, qwen2, generate.py

Description

1. Why the change?

2. User API changes

3. Summary of the change

4. How to test?

[ ] N/A
[ ] Unit test: Please manually trigger the PR Validation here by inputting the PR number (e.g., 1234). And paste your action link here once it has been successfully finished.
[ ] Application test
[ ] Document test
[ ] ...

5. New dependencies

[ ] New Python dependencies
- Dependency1
- Dependency2
- ...
[ ] New Java/Scala dependencies and their license
- Dependency1 and license1
- Dependency2 and license2
- ...

Please fix llama files conflict first.

Also need to add lowbit-path param here: https://github.com/intel-analytics/ipex-llm/tree/main/python/llm/example/NPU/HF-Transformers-AutoModels/LLM#3-run-models

others LGTM.


Disabled the MRTK build window when the build target != UWP

Left some convenience buttons in the window.

Will need this replicating in Dev

@DDReaper We'll do a merge back from master into the dev branch once the stabilization branch is merged, which will bring back these bug fixes.

@keveleigh I'm not sure it's that simple.  Esp after the namespace refactor.

Yeah @keveleigh Due to the NS refactor, these changes need manually redoing against Dev_Working (where applicable).  in my experience, merging back from the old way caused too many issues.

Untiy [Universal Windows Platform] Platform does not support.
The Socket code is written and the Thread code is written and the FileStream code is written, you know what?
I used the network communication section to find that this part of the code could not be transferred to the [Universal Windows Platform].
After I tested Unity 2017.2.0f3 (64-bit) version,Unity 2017.3.1f1 (64-bit) version,Unity 2017.2.1f1 (64-bit) version.
They don't support it.
Do you have any feedback on untiy?
When I wrote socket and IO and Thread related code in the program, untiy packaging times was wrong,
The socket.Connect function is not supported.
The socket.Receive function is not supported, and the
socket.Send function is not supported.
The filestream.close function is not supported,
New Thread(recv) is not supported,
Does not support Thread. IsBackground,
Does not support Thread. To Start,
But if I just write in the code.
The Socket client = null;
Thread the Thread = null;
FileStream filedata = null;
This way, the Universal Windows Platform is passed.
I think it should be the flaw in the Platform library of untiy [Universal Windows Platform].
Please help me to feedback this question,
------------------ 原始邮件 ------------------
发件人: "Stephen<EMAIL_ADDRESS>发送时间: 2018年3月1日(星期四) 中午12:03
收件人<EMAIL_ADDRESS>抄送<EMAIL_ADDRESS>主题: Re: [Microsoft/MixedRealityToolkit-Unity] Disabled the MRTK buildwindow when the build target != UWP (#1747)
@keveleigh I'm not sure it's that simple.  Esp after the namespace refactor.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.


ERROR: Class NTConfig does not implement IEditorConfig interface, using default configuration instead

I don't know when this started happening. It could have been back in early august - I haven't done much since then.
I have an NTCconfig.cs file in my project beside my .nt files.
I have Version 0.1.11 of the extension installed
The project with the NTConfig.cs file references the NuGet package NTypewriter.Editor.Config version 0.1.10-alpha. That seems to be the latest version.
My NTConfig.cs file is:
using System.Collections.Generic;
using NTypewriter.Editor.Config;

namespace SkyCourt.UI.ui.src.api
{
    [NTEditorFile]
    public class NTConfig : EditorConfig
    {
        public override bool AddGeneratedFilesToVSProject { get => false; }
        public override IEnumerable<string> ProjectsToBeSearched
        {
            get
            {
                yield return "SkyCourt";
                yield return "SkyCourt.App.Api";
                yield return "SkyCourt.App.Models";
                yield return "SkyCourt.App.Utilities";
                yield return "SkyCourt.App.ViewModels";
            }
        }
    }
}

Any thoughts?  Is there suppposed to be a verson 1.11 of the NuGet package?

They were not any changes since May.
Nugets referenced from the project does not matter, they are only for syntax completion, NT Editor is shipped with the latest version of them.
This message may appear when two versions of NTypewriter.Editor.Config dlls are loaded into VS app domain, which is very hard to achive in normal context. I would check if NT Editor is instaled only once, and reinstal it.

Thanks for the suggestion of looking for two versions of NTypewriter.Editor.config being loaded. I was only including the NuGet package in one project, so that wasn't it. But it got me thinking that VS had been running for quite a while (over a week). I figured it was time to restart VS and that fixed it.

It is not exactly what I meant :D. You can have as many projects with references to NTypewriter.Editor.Config nuget as you want. They do not matter at all, and they are not loaded into VS app domain. To VS app domain are loaded only dlls that are part of NT Editor/addin. And apparently after long use of VS, somehow VS loaded NT Editor more than once into VS app domain/memory.


internal/envoy: enable HTTP/1.0 support

Fixes #537
This PR enables Envoy's support for HTTP/1.0 requests, with limitations.
The limitations are:

There is no support for HTTP/1.0 requests which lack a Host: header.
There is no support for backend clusters which only talk HTTP/1.0

Signed-off-by: Dave Cheney<EMAIL_ADDRESS>

thanks!


Update infoblox.py

added  ping functionality  ,  get_next_available_ip only give unpinging ip.

We are seeing one issue while adding  host record to infoblox.

if the dns entry already exit in infoblox and you are adding same entry to by infoblox by calling  create_host_record . The call hangs and never come out.
def create_host_record(self, address, fqdn):

Perhaps something to do with IB code, could be a bug in IB code. It works as expected in my LAB IB version 6.11.5-254787
I'd recommend to open a case with IB support for this.This is what I'm getting from my test IB:
Traceback (most recent call last):
  File "./infoblox_test.py", line 17, in
    iba_api.create_host_record('<IP_ADDRESS>', 'test1.example.com')
  File "build/bdist.linux-x86_64/egg/infoblox.py", line 138, in create_host_record
infoblox.InfobloxGeneralException: The record 'test1.example.com' already exists.
  From: Tapan Jyoti Swain<EMAIL_ADDRESS>
To: Infoblox-Development/Infoblox-API-Python<EMAIL_ADDRESS>Sent: Tuesday, March 24, 2015 9:52 PM
Subject: Re: [Infoblox-API-Python] Update infoblox.py (#4)
We are seeing one issue while adding host record to infoblox.

if the dns entry already exit in infoblox and you are adding same entry to by infoblox by calling create_host_record . The call hangs and never come out.
def create_host_record(self, address, fqdn): —
Reply to this email directly or view it on GitHub.


Support knex 0.14.0 as peer dependency

Knex 0.14.0 was released little over a week ago. Can you get support for this on the peer dependency?

Related PR: #1683.


Update user stories in Developer Guide

The current user stories in the developer guide do not fully reflect the project’s current scope and direction.
These stories need to be updated to accurately represent the needs and goals of the target users and to ensure alignment with the project’s objectives.
Update the user stories in the developer guide to match the selected project direction, refining the use cases and requirements.
This update is done to maintain consistency and ensure the documentation reflects the project’s goals, providing clear guidance for future development.
No other modifications are included in this commit.

LGTM


Tooltips

Operating system or device - Godot version:
Win7/Godot 2.0.3
Issue description (what happened, and what was expected):
Tooltips on buttons blink on some machines.  When tested with another app (MS word) tooltips that app's tooltips did not blink.
Steps to reproduce:
Create a button with a tooltip
run
mouse over the button
tooltip regularly blinks on and off
Link to minimal example project (optional but very welcome):

Not sure if this is button related or all tooltips. However playing around with this on Win10 I see that the tooltip cuts off if the mouse gets any movement at all, even if it stays over the button. IMO the tool tip should only go off if the mouse moves off the button.

Dupe of #3835?

probably.

@captainwasabi ~ For the record, did you reproduce it in the editor or in the running game?

These were users systems so they were running the app.  However on my Win10 dev system I do reproduce that if the mouse moves the tooltip blinks even though it stays over the item with the tooltip.  I tested a bunch of other apps and none of them exhibit that behavior.  I surmise that in godot any mouse message resets the "hover timer" rather than the mouse position exiting the item.

Yeah, this seems to have worked.  How do I build a 64 bit exe on windows? It says the bits argument is not supported.


Removes superfluous creation of processors for SubscriberWhiteboxVerific...

...ation
@smaldini does this address your issue?

We will consider a new issue regarding why the CI passes where it shouldn't it which involves adding processor examples, but I suggest to go with #222 if it passes approval now and complete in the next candidat. I'd very much like to release before holiday a stable version :D That would be an awesome present.

Ok, closing this w/o merging!


Standard host property

This pull request changes the host artifact property to include build system, target OS and architecture.
Specifying the toolchain as one single identifier is meant to make it easier to communicate which combinations are possible.
It also simplifies the implementation as it is just a matter of mapping the identifier to more specific properties. This could even be parsed directly from the identifier.

Coverage decreased (-0.01%) to 97.342% when pulling d890d20302ee9b903bf4d511d528a0e32d7bcb7e on standard-host-property into 1ee2364a4a11b5321e79073692f4cd1bfdad85e6 on master.


handle paired- end reads

Whats the best way to handle paired-read data? Right now we just concat both files into one and feed it to diamond/megan/humannbecause all of those only support single-end reads. But like this we lose the paired-end information, maybe taking pear or something similar would be beneficial for this. Maybe its already in the preprocessing of the big pipeline tho..

According to the PEAR devs, merging of the reads should happen even before QC. I should adjust that when I get access to the rest of the pipeline.

PEAR fails with a seg fault sometimes if the input uses different phred scores: remove parameter -b 64 and try again.


Error when syncing chain: QUEUE_ERROR_QUEUE_MAX_LENGTH

Describe the bug
I got this when syncing Prater:
Apr-07 04:31:01.477 [SYNC]            ^[[31merror^[[39m: Batch processingError startEpoch=3164, status=Processing code=BLOCK_ERROR_BEACON_CHAIN_ERROR, error={"code":"QUEUE_ERROR_QUEUE_MAX_LENGTH"}
Error: QUEUE_ERROR_QUEUE_MAX_LENGTH
    at JobQueue.push (/root/lodestar/packages/lodestar/src/util/queue/index.ts:66:13)
    at QueuedStateRegenerator.getPreState (/root/lodestar/packages/lodestar/src/chain/regen/queued.ts:47:32)
    at processChainSegment (/root/lodestar/packages/lodestar/src/chain/blocks/process.ts:126:34)
    at runMicrotasks (<anonymous>)
    at runNextTicks (internal/process/task_queues.js:58:5)
    at listOnTimeout (internal/timers.js:501:9)
    at processTimers (internal/timers.js:475:7)
    at processChainSegmentJob (/root/lodestar/packages/lodestar/src/chain/blocks/processor.ts:163:3)
    at Object.job (/root/lodestar/packages/lodestar/src/chain/blocks/processor.ts:62:42)
    at wrapError (/root/lodestar/packages/lodestar/src/util/wrapError.ts:18:32)
Error: BLOCK_ERROR_BEACON_CHAIN_ERROR
    at processChainSegment (/root/lodestar/packages/lodestar/src/chain/blocks/process.ts:175:13)
    at runMicrotasks (<anonymous>)
    at runNextTicks (internal/process/task_queues.js:58:5)
    at listOnTimeout (internal/timers.js:501:9)
    at processTimers (internal/timers.js:475:7)
Apr-07 04:31:24.025 []                 ^[[32minfo^[[39m: Syncing - 2.1 hours left - 0.428 slots/s - finalized: 3164 0x0b9b…e6f4 - head: 101312 0xd721…143c - currentSlot: 104557 - peers: 10
Apr-07 04:31:30.026 []                 ^[[32minfo^[[39m: Syncing - 1.6 hours left - 0.546 slots/s - finalized: 3164 0x0b9b…e6f4 - head: 101317 0xf560…182c - currentSlot: 104557 - peers: 10

Expected behavior
No error

the current regen queue size is 256. At initial sync, the only consumer of regen module is the sync itself.
@dapplion is it possible that the Batches get executed with an unpredictable order? i.e Batch 128 - 192 is processed before batch 64 - 127

the current regen queue size is 256. At initial sync, the only consumer of regen module is the sync itself.
@dapplion is it possible that the Batches get executed with an unpredictable order? i.e Batch 128 - 192 is processed before batch 64 - 127

That should never happen, something has gone really wrong there

this is because we're processing attestation job at the time of initial sync and it keeps regen queue busy


After saving with Word, nested list numbering does not properly restart the counter

We ran into an issue recently where after a document constructed by Caracal was opened and saved by Microsoft Word, the number on nested lists is not longer correct.
Given a document created with this script
require 'caracal'

Caracal::Document.save "list.docx" do |docx|
  docx.ol do
    li 'First item' do
      ol do
        li 'SubItem 1'
        li 'SubItem 2' do
          ol do
            li 'SubSubItem 1'
            li 'SubSubItem 2'
          end
        end
      end
    end
    li 'Second item' do
      ol do
        li 'SubItem 1'
        li 'SubItem 2' do
          ol do
            li 'SubSubItem'
          end
        end
      end
    end
    li 'third item' do
      ol do
        li 'SubItem 1'
        li 'SubItem 2' do
          ol do
            li 'SubSubItem'
          end
        end
      end
    end
  end
end

which is basically the text shown in the list examples,
when you first open it with Word, it looks correct.

After a save, the numbering on the second level of items is out of order.  The first sub item the "Second Item" set starts with c not a.

Interestingly, the 3rd tier of numbers is correctly reset.
Any ideas what might be going on here?
Just for completion, i tried adding some more sub-levels and it seems that it's only the second level that is getting screwed up...

We're on Ruby 2.4.1 and Caracal (1.1.2)
# in Gemfile.lock
   ...
    caracal (1.1.2)
      nokogiri (~> 1.6)
      rubyzip (~> 1.1)
      tilt (>= 1.4)
  ...

I tried running back to version 1.0.13 and still see the issue, for what it's worth.

First, thanks for the clear and meaningful examples.  Good bug reports are as rare as they are appreciated. :)
Educated Guesses
The short version is Word is rewriting the underlying OOXML when it opens the document.  (Which is awesome, I know.)  As I'm fond of writing on this forum, "Welcome to the wonderful world of OOMXL."  OOXML standards--at least inside Word--change regularly, so it's pretty common for something to work fine in some versions of Word and not others, to work in Google docs and not Word, to work in LibreOffice but not OpenOffice, etc. etc. etc.  Generally speaking, I strive for 100% compliance in Word and take whatever I can reasonably get in any other program.  But even that is a steep challenge.
I don't know specifically what's going on in this case, but I'd wager one of two things is happening:

The OOXML spec changed between the time I wrote the ol, ul, li renderers and now and we're close but not quite exactly compliant anymore--i.e., Caracal has a subtle bug.  That would track in my mind with Word opening the file and renderering it okay at first, but also with it wanting to rewrite the OOXML to make it more "correct".  In this theoretical case, the rewritten OOXML wouldn't--I suppose--have the right property designation that tells Word to restart the counter on the list items because we hadn't specified the expected thing somewhere in the Caracal OOXML.

  That happens, too, I'm afraid.

Next Steps
If you would, the most helpful thing you could do is to follow the steps in the README for looking at the OOXML directly.  These issues tend to be specific to exact versions of Word on a particular OS, so the bug reporter tends to be in the best position to do the legwork.
Here, you'd want to:

Make a Caracal file;
Duplicate it on your file system;
Open the duplicate in Word to get it to alter the file the way you've observed;
Follow the directions in the README to unzip both files;
Look at the OOXML and see if you can figure out what is different.

I suspect you'll see a lot more OOXML in the Word document, so if you don't see an obvious difference, please post the relevant snippets from both files back to this thread and we can figure it out together.

Thanks for the response.
Word is definitely rewriting the xml.  It looks pretty different when moving from caracal's generated document to the Word saved document.
It's hard for me to figure out where the numbering reset/restart happens, but the primary difference if you look at one of those elements is
<!-- from caracal -->
    <w:p w:rsidP="00000000" w:rsidRDefault="00000000" w:rsidR="00000000" w:rsidRPr="00000000" w:rsidDel="00000000">
      <w:pPr>
        <w:numPr>
          <w:ilvl w:val="1"/>
          <w:numId w:val="1"/>
        </w:numPr>
        <w:ind w:left="1440" w:hanging="359"/>
        <w:contextualSpacing w:val="1"/>
        <w:rPr>
          <w:u w:val="none"/>
        </w:rPr>
      </w:pPr>
      <w:r w:rsidR="00000000" w:rsidRPr="00000000" w:rsidDel="00000000">
        <w:rPr>
          <w:rtl w:val="0"/>
        </w:rPr>
        <w:t xml:space="preserve">two a</w:t>
      </w:r>
    </w:p>

<!-- after saving from word -->
    <w:p w:rsidR="002963A9" w:rsidRDefault="007D5472">
      <w:pPr>
        <w:numPr>
          <w:ilvl w:val="1"/>
          <w:numId w:val="1"/>
        </w:numPr>
        <w:ind w:hanging="359"/>
        <w:contextualSpacing/>
      </w:pPr>
      <w:r>
        <w:t>two a</w:t>
      </w:r>
    </w:p>

Interestingly, there are fewer tags in the word saved version, but there are also more xml files in the document.  That is... the file lists look like:
# from the caracal file
$ unzip ../../caracal.docx
Archive:  ../../caracal.docx
  inflating: _rels/.rels
  inflating: [Content_Types].xml
  inflating: docProps/app.xml
  inflating: docProps/core.xml
  inflating: docProps/custom.xml
  inflating: word/fontTable.xml
  inflating: word/footer1.xml
  inflating: word/settings.xml
  inflating: word/styles.xml
  inflating: word/document.xml
  inflating: word/_rels/document.xml.rels
  inflating: word/numbering.xml

# from the word saved version
$ unzip ../../word.docx
Archive:  ../../word.docx
  inflating: [Content_Types].xml
  inflating: _rels/.rels
  inflating: word/_rels/document.xml.rels
  inflating: word/document.xml
  inflating: word/header3.xml
  inflating: word/footer2.xml
  inflating: word/footer1.xml
  inflating: word/footer3.xml
  inflating: word/header2.xml
  inflating: word/endnotes.xml
  inflating: word/footnotes.xml
  inflating: word/header1.xml
  inflating: word/theme/theme1.xml
  inflating: word/settings.xml
  inflating: word/webSettings.xml
  inflating: word/styles.xml
  inflating: word/numbering.xml
  inflating: docProps/core.xml
  inflating: word/fontTable.xml
  inflating: docProps/app.xml

I see 3 header?.xml files and extra footer?.xml.  Also, the _rels directory is not there and it looks like it's added theme and endnotes and some other stuff.
I'm working with Word v16.10 on a Mac.  And we've seen this also in Word 15.33.
I'm going to dig in some more and try to read the OOXML docs, but if you have any insights, i'd love to hear them.
Here are the actual docs... if you wanted a closer look:
caracal.docx
word.docx
I also noticed that there are several more schema files in the top of document.xml.  Is it possible that those play a role here?
More as it happens.

It looks like I found the root of the issue.  Still not sure what the fix is but maybe there's a clue here.
In the numbering.xml that is generated by Caracal, we have the following
    <w:lvl w:ilvl="1">
      <w:start w:val="1"/>
      <w:numFmt w:val="lowerLetter"/>
      <w:lvlRestart w:val="1"/>
      <w:lvlText w:val="%2."/>
      <w:lvlJc w:val="left"/>
      <w:pPr>
        <w:ind w:left="1440" w:firstLine="1080"/>
      </w:pPr>
      <w:rPr>
        <w:u w:val="none"/>
      </w:rPr>
    </w:lvl>

When Word rewrites it, it writes the following
    <w:lvl w:ilvl="1" w:tplc="627E1A8A">
      <w:start w:val="1"/>
      <w:numFmt w:val="lowerLetter"/>
      <w:lvlRestart w:val="0"/>  <!--         <<<<<<<<<<<<<<<<<<<<< here is the problem -->
      <w:lvlText w:val="%2."/>
      <w:lvlJc w:val="left"/>
      <w:pPr>
        <w:ind w:left="1440" w:firstLine="1080"/>
      </w:pPr>
      <w:rPr>
        <w:u w:val="none"/>
      </w:rPr>
    </w:lvl>

This restart value gets set to 0 after word rewrites things.  If i set that to w:val="1" and repack the file, the file looks good.  Now I just need to figure out if we can tell setup the doc so Word does not do that.

Ha!  You beat me to it.  I was just about to direct you to this file.
If I'm remembering correctly--and I totally may not be--I believe the w:lvlRestart attribute is just a boolean.  1 means restart the counter; 0 means don't.
Yeah, that's infuriating.  I'm not sure why Word is rewriting the file.

I found another possible clue.  The word file has this at the top of numbering:
  <w:abstractNum w:abstractNumId="0" w15:restartNumberingAfterBreak="0">

This tag is listed as a Microsoft extra (described in this PDF).
I tried adding that and the corresponding xmlns:w15 attributes to the Caracal doc but the file constructed with all that in there didn't work.  That is, Word fails with an XML Parsing error.  I suspect this is because I don't have the right schema/ns files.  But if I add the schemas that the word doc has, then it blows up even earlier.  My guess of the XML Parsing error is that it can't find the w15 namespace.  Interestingly, of course, it opens in Pages just fine and looks right.  :(
Yeah - infuriating indeed.

Thanks for all the legwork on this.  I dropped off yesterday in part because I live in Oslo now and it was late but also because you were already doing exactly what I do in these situations.  I didn't have much to add.
Your suggested approach is, I think, the most straight-forward way to ensure compatibility with current versions.  If you feel up for making a PR, I would, of course, appreciate that.
I honestly don't know what the change will do to older versions of Word.  But that's one of the struggles of the library.  I'm not 100% clear on how to semantically version something that can suddenly have breaking changes through no fault of its own.  But so far, no one has complained about my changing the library's output to stay current with Word.  In the long run, I've always sort of assumed Caracal would have to offer more than one set of renderer objects to provide some reasonably sensible way to get the exact OOXML style one's version of Word needs, but that's a bigger ask than I can give my time to, you know?

No problem.  I mean, it was kind of a problem cuz it was annoying that Word was getting in the way of what seemed like a perfectly good .docx file.
We needed this to roll forward and I appreciate all you've done to give us a place to start.
I'll see if I can get something together.  I'd much rather run off your repo than our fork, just to more easily keep up with any other fixes that may come along.
Cheers


ReconnectHost wont' trigger mandatory kvmagent reinstallation

ReconnectHost should reinstall kvmagent, no matter kvmagent is installed or not. But it doesn't current.

It has been fixed.


Incomplete test error since v0.63.0

Issue description
Let's say we have a model defined as follows:
SELECT
  r.range::DATE AS month
FROM
  RANGE(DATE '2023-01-01', DATE '2023-04-01', INTERVAL 1 MONTH) AS r

And a unit test for this model defined as follows:
test_xyz:
  model: xyz
  outputs:
    query:
      rows:
        - month: 2023-01-01
        - month: 2023-02-01
        - month: 2023-03-01

When running this test with v0.62.1, everything works fine.
When running it with v0.63.0, I get the following error:
Error: Incomplete test, missing input for table RANGE(CAST('2023-01-01' AS DATE), CAST('2023-04-01' AS DATE), INTERVAL '1' MONTH) at [...]

thanks for the report @pcasteran we'll take a look soon


History tab missing on DataElements

History tab missing
The User Interface for Data Elements does not enable the user to see the history of change for the data element.  The parent class history does not show the changes to elements on the classes either
Suggested resolution
Implement a means to view the history

Thanks for the report @oughnic, we should also make sure as part of the Micronaut work that the backend is recording the history in a consistent way for the different items.


Failing checks

Issue Addressed
Which issue # does this PR address?
Proposed Changes
Please list or describe the changes introduced by this PR.
Additional Info
Please provide any additional information. For example, future considerations
or information useful for reviewers.

hello @mergify queue

@mergify queue please

@mergify queue


Fixes the issue where gulp build was not building all css files #6622…

Issue Titles
[Build Tools] Fixes gulp build not building all css files
Closed Issues
#6622 #6067
Description
Inside css.js gulp build file, compressedStream was set by piping stream to clone(). But later on, that variable was again set. It means that the initial compressedStream was left open, which caused backpressure and paused the original stream. As a result, all css files were not built. Solved the issue by removing the first open stream.

I had to modify print        = require('gulp-print'),  to   print        = require('gulp-print').default, to make it work from my setup.

Tested and this fixed the issue I had with no css file being generated - V2.4.1

The compressed cloned stream was still referencing the original stream. With the gulp dependency updates this is causing issues.
 compressedStream = stream
    .pipe(plumber())
   /* etc

it should just be
 compressedStream
    .pipe(plumber())
   /* etc

I'm cutting a new release now.

 Fixes the issue where gulp build was not building all css files #6622…

 Fixes the issue where gulp build was not building all css files #6622…


[CKG Pills] No longer populate search page pills

Description:
Removed Search page ckg pills. From now on we'll only populate ckg pills for existing pages with matching ckg IDs
Also fixed the dynamic import not being properly awaited issue. this will help stabilize the rendering of SEO navs.
Resolves: MWPW-NUMBER
Test URLs:

Before: https://main--express--adobecom.hlx.page/express/templates/flyer?lighthouse=on
After: https://no-search-ckg-pill--express--adobecom.hlx.page/express/templates/flyer?lighthouse=on

Codecov Report

Merging #170 (2b2d100) into stage (028306e) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##            stage     #170   +/-   ##
=======================================
  Coverage   35.37%   35.37%
=======================================
  Files          27       27
  Lines        9489     9489
=======================================
  Hits         3357     3357
  Misses       6132     6132

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Various Minor CI fixes

using ctest to run the tests, which means we dont have to change the command executing tests every time we want to add a test executable or configuration;
specifies Debug and Release configurations to be explicitly built and tested, to avoid issues because of CMake's inconsistency in the output of generators (some build-systems allow multiple configurations, so that removes any ambiguity) - also for installing;
builds with both Ninja and VS on Windows, with msvc, mingw and clang;
git-ignore some poentially generated directories
fixed some ci runs names

I updated the first message here to reflect the intent of this PR.


JENKINS-33225: Add support for matrix projects

This patch adds a new project type combining Matrix and Multibranch projects.

Thank you for this pull request! Please check this document for how the Jenkins project handles pull requests.

Thanks for the feedback, I've addressed your comments in the latest changes.

@mjdetullio: Is there additional work needed on this PR?

Is there any EAT on when this feature will be merged and released?


Make copr-build functioning again

After some changes to oamgbot's account have been made need to apply them to github action.
OAMG-8876

Test it - https://github.com/fernflower/leapp/actions/runs/4692312952


How to use the repository for custom dataset.

Hey, I would like to use this repository for my dataset. My aim is to build translation model for En to De and De to En.
I am using Europarl En-De dataset and apart from this dataset, i have huge amount of monolingual DE dataset which also needs to be used for building a NMT model and i guess you guys are also trying to do same thing but for En-Sum dataset.
Can you please help me understanding how to use your repo for building model for POS, NER and NMT?

Hi,
You can use different models available in POS and NER Repos. You can provide the dataset of your own, see the argument need to pass for using the model.
To use condition random field you need to use your own feature.py file as it is language-specific.
But as you have a large dataset you should go for the FLAIR language model. You can even integrate it with BERT and all other available embeddings. You can check FLAIR Repo for that, also for further references follow (https://github.com/flairNLP/flair).
Using different machine translation techniques you can use (https://github.com/cdli-gh/Unsupervised-NMT-for-Sumerian-English)
Soon I will update the documentation for further references.


Add gosec, golint and gofmt workflows

Ref #170

Codecov Report

Merging #228 (8583904) into master (9957644) will decrease coverage by 0.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #228      +/-   ##
==========================================
- Coverage   33.64%   33.63%   -0.02%
==========================================
  Files          24       24
  Lines       10746    10746
==========================================
- Hits         3616     3614       -2
- Misses       6759     6761       +2
  Partials      371      371

Impacted Files
Coverage Δ

KubeArmor/audit/auditLog.go
44.27% <0.00%> (-1.53%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9957644...8583904. Read the comment docs.

@daemon1024 will be merged as soon as we fix security things.


applicant_questions.answerDateQuestion(...) is broken for North Star

Describe the bug
applicant_questions.answerDateQuestion(...) does not fill in a date question when North Star is enabled.
To Reproduce

Choose a browser test that calls answerDateQuestion(...)
Enable North Star in the test
Run the test

Source code: https://github.com/civiform/civiform/blob/e2ee7281dde006c4d77513012cd4412806e0ab6c/browser-test/src/support/applicant_questions.ts#L143
Expected behavior
The test fills in the date
Actual behavior
The test fails

In North Star, use answerMemorableDateQuestion instead.
https://github.com/civiform/civiform/blob/ab43db1ecb997e8f217af5d6cb4be549060045c6/browser-test/src/support/applicant_questions.ts#L152


Post idea: Permanent Event Handling using Windows WMI and PowerShell

Summary of the new document or enhancement

Details of requested document:

Are you offering to write the post [Y/N]: Y
Proposed title: Permanent Event Handling using Windows WMI and PowerShell
Links to related posts:
Description of the problem/scenario/question you want covered:
This article goes through the steps required to create a permanent WMI event Handling.
I used Windows Services Win32_Service as an example and also Win32_Share.
The Cmdlets are the CIM cmdlets, also I show the case using PowerShell 7.
I try to explain EventFilter, all Consumers classes, and Binding and provide multiple examples.
Also explained how to write the WMI Filter

We have just published an article on this subject: How Do I Discover Changes to an AD Group’s Membership. That article looks at permanent event handling in the context of AD groups.
I am not sure we need another one just yet so I am closing this issue with thanks.  As an alternative, why not refocus your suggested article to cover temporary eventing? I had intended to write a follow article on that and please post a post idea issue here.
Thanks.


Snapshot not recognized for sqn_order fold?

The following test case is suspicious, because even though we fold with snapshot true we don't seem to get the keys from only the snapshot.
leveledjc_eqc:init_backend(o_rkv,
    [{root_path, Dir}, {log_level, error}, {max_sstslots, 2},
     {cache_size, 10}, {max_pencillercachesize, 40},
     {max_journalsize, 20000}],
    sut) ->
  <0.2667.0>
leveledjc_eqc:put(<0.2667.0>, <<98, 117, 99, 107, 101, 116, 51>>,
    <<227, 142, 0, 237, 130, 199, 37, 238, 62, 225, 139, 160, 158,
      68, 105, 142>>,
    <<53, 1, 0, 0, 0, 43, 131,....>>,
    [], o_rkv) ->
  ok

Normal start, putting 1 object. Note that object has 43 and 131 in it to distinguish it later on.
Then:
leveledjc_eqc:objectfold(<0.2667.0>, o_rkv, {#Fun<leveledjc_eqc.30.5533705>, []},
    true, sqn_order, 4) ->
  #Fun<leveled_runner.10.98249213>
leveledjc_eqc:put(<0.2667.0>, <<98, 117, 99, 107, 101, 116, 51>>,
    <<227, 142, 0, 237, 130, 199, 37, 238, 62, 225, 139, 160, 158,
      68, 105, 142>>,
    <<53, 1, 0, 0, 0, 78, 131,...>>, [], o_rkv) -> ok

Start an object fold in sequence order with SNAPSHOT true! After that, with same bucket and key add a new object. Note the 78, 131 there.
If we now run the fold, the implementation returns:
leveledjc_eqc:fold_run(4, #Fun<leveled_runner.10.98249213>) ->
  [{<<98, 117, 99, 107, 101, 116, 51>>,
    <<227, 142, 0, 237, 130, 199, 37, 238, 62, 225, 139, 160, 158,
      68, 105, 142>>,
    <<53, 1, 0, 0, 0, 78, 131,...>>},
    {<<98, 117, 99, 107, 101, 116, 51>>,
    <<227, 142, 0, 237, 130, 199, 37, 238, 62, 225, 139, 160, 158,
      68, 105, 142>>,
    <<53, 1, 0, 0, 0, 43, 131, ...>>}]

Thus both objects. This surprises me a bit, I had expected to only get the object back from the snapshot moment.

https://github.com/martinsumner/leveled/pull/261
There is an eunit test leveled_bookie:sqnorder_mutatefold_test/0 that recreates the problem, and now passes after the change.


RswiftModifyXcodePackages doesn't change anything

My xCode is 14.2 and I added R.swift 7.2.4. I added RswiftGenerateInternalResources and ran RswiftModifyXcodePackage. My expected was to show "Allow Change Package" dialog as your youtube video but I couldn't see anything. What was issue?

Can you explain a bit more?
Is there an issue with running R.swift?
Are you able to access the generated R resources?

As following your tutorial video, once execute RswiftModifyXcodePackage command, plugin icon should be changed which means plugin added correctly. But it doesn't on my xCode. I tried on several projects and I got same result.

That's really strange. Are you sure your project or correct target is selected when running RswiftModifyXcodePackage?
As a workaround, you can manually edit the project.pbxproj file to do the thing the command would have done.
Find the lines that look like this:
E25F907729B69449002F57B6 /* RswiftGenerateInternalResources */ = {
    isa = XCSwiftPackageProductDependency;
    package = E2054F48298BC4C300347AE8 /* XCRemoteSwiftPackageReference "R" */;
    productName = "plugin:RswiftGenerateInternalResources";
};

And remove the package line. After the package line has been removed and the file is saved, the icon should change in Xcode and the Plugin should run when building.

@tomlokhorst Thanks for your workaround. It works for me. And about RswiftModifyXcodePackage running, yes I selected correct target. The problem is when I select a target, I can't see commit change dialog like your tutorial.

Hey. I also have problem but a little different. I tried solution above and this didn't work for me.

#813 didn't work for me. The generator looks validated but I still got Cannot find 'R' in scope errors everywhere.

@EricAtomic I think it's compiler error. Even though I can see above error on my xCode, I can build my app successfully.


[DOOR-9] Create/refactor data model of DOS client

From SyncLinear.com | DOOR-9

This will probably not be needed, as the current parsing of results from DOS API does not need down-to-detail data modeling.