[WIP] Store speculative states

New features
This pull request introduces

Speculative decode worker now have access draft token indices and scorer token indices from previous step of speculative decode. We plan to use this feature in the subsequent pull requests to implement new decode strategy for speculative decode that will make use of previous speculative decode states

New API streaming endpoint that allows users to access history of speculative decode states in order to collect appropriate dataset to train better speculative models and achieve higher acceptance rate in the future. We plan to use this feature to collect dataset and train appropriate models

Implementation details
We propose to extend return type of speculative decode worker to allow it return SpeculativeProposerSamplerOutput and SpeculativeScorerSamplerOutput as well as SamplerOutput
Those new outputs follow the same structure as SamplerOutput to maintain consistency. The structure suppose that each SpeculativeProposerSamplerOutput or SpeculativeScorerSamplerOutput is a step output and thus contains next token for every item in the batch of sequences
Similar approach was used with PoolerOutput so we find it convenient to use and simple to implement
After all on the top engine receives list of outputs where each output can be any of four listed above. The only assumption that needs to exist is correct order of outputs of the same type.   I've", "speculative_draft_token_indices": [38, 697, 11, 764], "speculative_scorer_token_indices": [38, 348, 11, 764, 2659], "decoded_speculative_draft_token_indices": ["\u0120I", "\u0120live", "\u0120in", "\u0120San"], "decoded_speculative_scorer_token_indices": ["\u0120I", "'ve", "\u0120in", "\u0120San", "\u0120Francisco"], "decoded_draft_sequence": " I live in San", "decoded_scorer_sequence": " I've in San Francisco"}

{"text": "San Francisco is a great place to live.  I've lived in San Francisco for", "speculative_draft_token_indices": [3033, 11, 764, 2659], "speculative_scorer_token_indices": [3033, 11, 764, 2659, 13], "decoded_speculative_draft_token_indices": ["\u0120lived", "\u0120in", "\u0120San", "\u0120Francisco"], "decoded_speculative_scorer_token_indices": ["\u0120lived", "\u0120in", "\u0120San", "\u0120Francisco", "\u0120for"], "decoded_draft_sequence": " lived in San Francisco", "decoded_scorer_sequence": " lived in San Francisco for"}

{"text": "San Francisco is a great place to live.  I've lived in San Francisco for a few years now and", "speculative_draft_token_indices": [10, 367, 107, 122], "speculative_scorer_token_indices": [10, 367, 107, 122, 8], "decoded_speculative_draft_token_indices": ["\u0120a", "\u0120few", "\u0120years", "\u0120now"], "decoded_speculative_scorer_token_indices": ["\u0120a", "\u0120few", "\u0120years", "\u0120now", "\u0120and"], "decoded_draft_sequence": " a few years now", "decoded_scorer_sequence": " a few years now and"}

{"text": "San Francisco is a great place to live.  I've lived in San Francisco for a few years now and I've never been to", "speculative_draft_token_indices": [38, 348, 393, 57], "speculative_scorer_token_indices": [38, 348, 393, 57, 7], "decoded_speculative_draft_token_indices": ["\u0120I", "'ve", "\u0120never", "\u0120been"], "decoded_speculative_scorer_token_indices": ["\u0120I", "'ve", "\u0120never", "\u0120been", "\u0120to"], "decoded_draft_sequence": " I've never been", "decoded_scorer_sequence": " I've never been to"}

{"text": "San Francisco is a great place to live.  I've lived in San Francisco for a few years now and I've never been to a city that has a", "speculative_draft_token_indices": [10, 343, 14, 34], "speculative_scorer_token_indices": [10, 343, 14, 34, 10], "decoded_speculative_draft_token_indices": ["\u0120a", "\u0120city", "\u0120that", "\u0120has"], "decoded_speculative_scorer_token_indices": ["\u0120a", "\u0120city", "\u0120that", "\u0120has", "\u0120a"], "decoded_draft_sequence": " a city that has", "decoded_scorer_sequence": " a city that has a"}

{"text": "San Francisco is a great place to live.  I've lived in San Francisco for a few years now and I've never been to a city that has a lot of people.", "speculative_draft_token_indices": [319, 9, 82, 4], "speculative_scorer_token_indices": [319, 9, 82, 4, 1437], "decoded_speculative_draft_token_indices": ["\u0120lot", "\u0120of", "\u0120people", "."], "decoded_speculative_scorer_token_indices": ["\u0120lot", "\u0120of", "\u0120people", ".", "\u0120"], "decoded_draft_sequence": " lot of people.", "decoded_scorer_sequence": " lot of people. "}

@WoosukKwon @Yard1 @youkaichao @cadedaniel what are your thoughts on this? Initial discussion is #7522

Discussing here https://github.com/vllm-project/vllm/discussions/7522#discussioncomment-10341966


Issue in lifetime checking with imported Verus crates

Hello! I encountered an issue similar to https://github.com/verus-lang/verus/issues/1249.
Basically I have a crate A importing crate B. And Verus emits many trait impl errors in the form of
error: the trait bound `Tail: T44_Combinator` is not satisfied
...

note: This error was found in Verus pass: ownership checking of tracked code` at the end.

where Tail and Combinator are both defined in crate B,
This seems to have happened during lifetime checking (no error if I do --no-lifetime), so I looked at the rust code emitted for lifetime checking (using --log lifetime), and the output .verus-log/crate-lifetime.rs is indeed omitting impls mentioned in the errors.
For example, impl T44_Combinator is missing for Tail for the error message above.
In .verus-log/crate-lifetime.rs, the only place where the impl T44_Combinator for Tail is needed is in an associated type definition:
impl T44_Combinator for D41_AlgorithmIdentifier {
    type A40_Result<'a43_a, > = .... <D93_Tail as T44_Combinator>::A40_Result<'a43_a, > ...;
    ...
}

(some code is omitted for readability)
D41_AlgorithmIdentifier is defined in crate B
Also this only happens if I separate crates A and B (no issue if I do it in the same crate).
The full .verus-log/crate-lifetime.rs file is here:
crate-lifetime.rs.txt

I wish we could assign a Blocking label to this issue. This essentially prevents many Verus library crates from being a library.

Question: if I use --no-lifetime with --compile, the lifetime is still going to be checked at the end and there's is no soundness issue, right?

That's not correct — running with --no-lifetime will cause proof-mode lifetime-checking to be skipped.

Can you try the lifetime-trait-impl branch?

Hi Chris, thanks for working on this!
I cherry-picked your fix (b90961) to the commit 25303c before #1289 (after that verus crashed for a different reason).
And it crashes now with this message:
thread 'rustc' panicked at rust_verify/src/spans.rs:221:9:
assertion failed: original_hi <= original_end_pos

This can be reproduced by running cd chain && make in this branch https://github.com/zhengyao-lin/x509/tree/chain-bug


Ignite 5569 4.13.b7 based

Closing PR, which seems to be test-only. Feel free to reopen if needed.


Fails to compile on Arm

I am trying to compile this on an Oracle Cloud Ampere instance and am getting the following error message:-
src/threading/Thread.cpp
src/threading/ThreadPool.cpp
src/Util.cpp
src/util/Log.cpp
In function ‘compress_parents_parallel’,
inlined from ‘compress_subtree_to_parent_node’ at src/b3/blake3.c:355:9,
inlined from ‘blake3_hasher_update.part.0’ at src/b3/blake3.c:534:7:
src/b3/blake3.c:242:5: warning: ‘memcpy’ writing 32 bytes into a region of size 0 overflows the destination [-Wstringop-overflow=]
memcpy(&out[parents_array_len * BLAKE3_OUT_LEN],
^
In function ‘compress_subtree_to_parent_node’,
inlined from ‘blake3_hasher_update.part.0’ at src/b3/blake3.c:534:7:
src/b3/blake3.c:356:5: warning: ‘memcpy’ reading between 64 and 96 bytes from a region of size 32 [-Wstringop-overflow=]
memcpy(cv_array, out_array, num_cvs * BLAKE3_OUT_LEN);
^

These are warnings, not errors. If it's failing to compile you might have grabbed the wrong snippet. Is there an error elsewhere?


LEGO: Pull request from lego/hb_919_20170614134505351 to master

LEGO: Pull request from lego/hb_919_20170614134505351 to master with localized lcls

@csigs,
Thanks for your contribution.
To ensure that the project team has proper rights to use your work, please complete the Contribution License Agreement at https://cla.microsoft.com.
It will cover your contributions to all Microsoft-managed open source projects.
Thanks,
Microsoft Pull Request Bot


Simulator runs C code before the "hardware" has started

Right now, the code running on the BPS Simulator is executed before the BeVolt has been started, which is not realistic. Ideally, the code running on the BPS simulator will be executed after BeVolt has been started.

To confirm: is the issue here that we would prefer for the C code to be executed only after giving the start command to the python simulator program?

Yes, that is correct. Otherwise we will run into bugs/race conditions. For example, the python script sets the clock to 16MHz on startup, but usually the C code will set the clock to 80 MHz on startup. Every time I have run this on the simulator, C will set the PLL first, but in the actual BPS, C will set the PLL after the hardware sets the PLL


add a way to merge two entries that are already in the library by selecting them

Describe your suggested feature

Basically, by selecting two or more entries, option to merge the entries appear

also, if possible make it so merged manga actually turns into one single entry instead of having two (one merged and one original).
basically what I want is to have both original entries disappear
I would technically have both original entries in my library only through the merged entry, but not individually
And then, if I wish to have the original individual entries back I would unmerge them (through a button or something like that)

(it would be a bonus if when clicking in the entry through the history tab, it would only show the merged entry instead of two separate original entries)

Other details
No response
Acknowledgements

[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a short but informative title.
[X] If this is an issue with an official extension, I should be opening an issue in the extensions repository.
[X] I have updated the app to version 1.10.5.
[X] I will fill out all of the requested information in this form.

this is done


Voice add universal instructions

For registration:
_Universal instructions
The universal actions will be updated to:
“#” which confirms the input
“*” repeats the recording / state
“0” returns the user to screen 2
However, the universal action for “0” should be switched off for the Gravida state to allow a user to submit “0”
Assumptions:
The universal actions * and 0 must be followed with the confirmation action of #_
For public line:
_Universal instructions
The universal actions will be updated to:
“#” which confirms the input
“*” repeats the recording / state
“0” returns the user to either screen A or A1
Assumptions:
The universal actions * and 0 must be followed with the confirmation action of #_

@gsvr please review. I would like to look at some of the changes together...

@NicolaasDieBaas Finished the review, looks good but I think we need some additional tests as mentioned. We can discuss testing strategy face to face.

@gsvr please review

@gsvr plz have a look.  Currently there's one '.skip' in voice_registration.test.js.  It bothers me that it doesn't stay on the retry of state_personnel_auth when restarting is prevented as a no_restart_state

@NicolaasDieBaas Didn't you want to merge in #90 and add another test for restarting further in the process?

:+1:


trt_convert error

Please make sure that this is a bug. As per our
GitHub Policy,
we only address code/doc bugs, performance issues, feature requests and
build/installation issues on GitHub. tag:bug_template
System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): Yes
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Ubuntu 18.04
TensorFlow installed from (source or binary): binary
TensorFlow version (use command below): 2.3.0
Python version:
Bazel version (if compiling from source):
GCC/Compiler version (if compiling from source):
CUDA/cuDNN version: 10.2, 8.0
GPU model and memory: Nvidia Xavier

I have keras model that I'm trying to convert to tensorrt using TrtGraphConverterV2. The model takes image and classifies it.
def my_input_fn():
	img = cv2.imread('messi5.jpg',0)
	img = np.expand_dims(img, axis=0)
	return img

conversion_params = trt.DEFAULT_TRT_CONVERSION_PARAMS
conversion_params = conversion_params._replace(
    max_workspace_size_bytes=(1<<32))
conversion_params = conversion_params._replace(precision_mode="FP16")
conversion_params = conversion_params._replace(
    maximum_cached_engines=100)

converter = trt.TrtGraphConverterV2(
    input_saved_model_dir="input_model/", conversion_params=conversion_params)
converter.convert()
converter.build(input_fn=my_input_fn)
converter.save("tensorrt_model")

With this code I'm getting:
2020-10-17 21:47:52.620064: W tensorflow/compiler/tf2tensorrt/kernels/trt_engine_op.cc:588] Running native segment forTRTEngineOp_0_0 due to failure in verifying input shapes: Input shapes do not match input partial shapes stored in graph, for TRTEngineOp_0_0: [[480,768,3]] != [[1,480,768,3]]
2020-10-17 21:47:52.677691: W tensorflow/core/framework/op_kernel.cc:1767] OP_REQUIRES failed at transpose_op.cc:157 : Invalid argument: transpose expects a vector of size 3. But input(1) is a vector of size 4
2020-10-17 21:47:52.677916: W tensorflow/core/framework/op_kernel.cc:1767] OP_REQUIRES failed at trt_engine_op.cc:401 : Invalid argument: transpose expects a vector of size 3. But input(1) is a vector of size 4
[[{{node StatefulPartitionedCall/model_1/conv2d_1/Conv2D-0-TransposeNHWCToNCHW-LayoutOptimizer}}]]
Traceback (most recent call last):
File "convert_to_tensorrt.py", line 118, in
converter.build(input_fn=my_input_fn)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/compiler/tensorrt/trt_convert.py", line 1174, in build
func(*map(ops.convert_to_tensor, inp))
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/function.py", line 1657, in call
return self._call_impl(args, kwargs)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/wrap_function.py", line 247, in _call_impl
args, kwargs, cancellation_manager)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/function.py", line 1675, in _call_impl
return self._call_with_flat_signature(args, kwargs, cancellation_manager)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/function.py", line 1724, in _call_with_flat_signature
return self._call_flat(args, self.captured_inputs, cancellation_manager)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/function.py", line 1926, in _call_flat
ctx, args, cancellation_manager=cancellation_manager))
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/function.py", line 550, in call
ctx=ctx)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/execute.py", line 60, in quick_execute
inputs, attrs, num_outputs)
tensorflow.python.framework.errors_impl.InvalidArgumentError:  transpose expects a vector of size 3. But input(1) is a vector of size 4
[[{{node StatefulPartitionedCall/model_1/conv2d_1/Conv2D-0-TransposeNHWCToNCHW-LayoutOptimizer}}]]
[[TRTEngineOp_0_0]] [Op:__inference_pruned_16623]

If I remove expand_dims I'm getting:
Traceback (most recent call last):
File "convert_to_tensorrt.py", line 118, in
converter.build(input_fn=my_input_fn)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/compiler/tensorrt/trt_convert.py", line 1174, in build
func(*map(ops.convert_to_tensor, inp))
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/function.py", line 1657, in call
return self._call_impl(args, kwargs)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/wrap_function.py", line 247, in _call_impl
args, kwargs, cancellation_manager)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/function.py", line 1675, in _call_impl
return self._call_with_flat_signature(args, kwargs, cancellation_manager)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/function.py", line 1697, in _call_with_flat_signature
len(args)))
TypeError: pruned(x) takes 1 positional arguments but 480 were given

@PawelFaron
Can you please share colab link or simple standalone code with supporting files to reproduce the issue in our environment.It helps us in localizing the issue faster.Thanks!


Bump up rk-entry version to v2.1.5

Codecov Report

Merging #71 (50e8a04) into master (67a01b9) will decrease coverage by 0.11%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master      #71      +/-   ##
==========================================
- Coverage   87.00%   86.88%   -0.12%
==========================================
  Files          19       19
  Lines        1500     1502       +2
==========================================
  Hits         1305     1305
- Misses        162      164       +2
  Partials       33       33

Impacted Files
Coverage Δ

boot/grpc_entry.go
83.65% <0.00%> (-0.33%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7338005...50e8a04. Read the comment docs.


Migration gyrations

Moves migrations to proper places, updates README accordingly.
Fixes #25.

needs manifest entry. :+1:


Invalid dependency breaking eas build<EMAIL_ADDRESS>

I am getting this error when eas build --profile development --platform ios:
Advice: Upgrade dependencies that are using the invalid package versions.

[stderr]

Expected package<EMAIL_ADDRESS>
[stderr]

Found invalid:

[stderr]

<EMAIL_ADDRESS>
[stderr]

  (for more info, run: npm why @expo/config-plugins)

[stderr]

One or more checks failed, indicating possible issues with the project.

Command "expo doctor" failed.
npx -y expo-doctor exited with non-zero code: 1

Is it possible to upgrade the dependency to<EMAIL_ADDRESS>Thanks!

Expected package<EMAIL_ADDRESS>Found invalid:
<EMAIL_ADDRESS>(for more info, run: npm why @expo/config-plugins)
Advice: Upgrade dependencies that are using the invalid package versions.


Create tasks that fails in sample (tests)

Useful to develop the gui and to a view of datamodel

@ddubuc


Automator: update ztunnel@master in istio/istio@master

Generated by Automator - 2023-06-29T14:37:16+00:00

/test integ-ambient
Flake or upstream change breaking tests?

@istio-testing: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

unit-tests-arm64_istio
c53aa36e82f4948a2c2dbcdadb4f10c3f0f97349
link
unknown
/test unit-tests-arm64

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/test unit-tests-arm64


Reconfigure Push

Hi @raix, thanks for your great work with this plugin, we are using it in our project Rocket.Chat.
We need some way to reconfigure the plugin options when users changes some settings in our admin without need to restart the server.
Today your plugin throws one exception when we try to configure again, there is some reason for that?
Thanks

The error being thrown is to alert the user that they might have both a json config and a in code config going.
It might be possible to use a new config, depending on the state you want to update it might involve destroying the current server and starting a new - but for minor changes it doesn't have to be that invasive I think

I prefer the option to destroy and configure again.

How can I do that?

It requires that we create a Push.destroy()
We couldd have the apn and gcm initializers append a destroy function to a onDestroyCallbacks array - making sure to destroy the connection and remove event listeners etc.
The Push.destroy function would simply:

call each of the functions in the onDestroyCallbacks
reset onDestroyCallbacks
set isConfigured to false

What are the implications of allowing Push.Configure to be called at various times during the running of the app? I have an issue where I need to allow multiple apps/certificates, so either need a way of associating certificates with apps or reconfiguring the push to use the correct certificate at the time.

@chrise86 it's not currently possible - potentially we could add the feature

@raix what if I was to fork and remove:
/ Block multiple calls
  if (isConfigured) {
    throw new Error('Push.Configure should not be called more than once!');
  }

what would be the implications?

That will not work out of the box

@raix How about this feature now? I need it so you can show the data flow, I will implement it.


Add Custom Slug Support for URL Shortening

Currently, the application generates random shortened URLs for users. We want to enhance the user experience by adding support for custom slugs, allowing users to specify their own short URL alias instead of relying on a randomly generated one.
Expected Behavior:

Users can shorten URLs with custom slugs.
If no custom slug is provided, a random one will be generated.
Users are notified of any errors.
please assign this issue to me and i will do it for you and also add gssoc-ext labels..

@adityakalburgi Yeah creating a custom url will be a great feature...but right now one of the contributor is working on implementing hashing algorithm.. so let us wait until he raise pr.. and i think we can focus on this feature after that..
i will assign this issue to you once that pr is merged..
i hope you understand..
Thanks


[Skia] ListBoxItem.Foreground: Red renders as Blue and Blue renders as Red

Funny thing.
MCVE:
xaml:
    <ListBox Items="{Binding Data}">
        <ListBox.Styles>
            <Style Selector="ListBoxItem">
                <Setter Property="Foreground" Value="Red" />
            </Style>
        </ListBox.Styles>
    </ListBox>

public IEnumerable<int> Data { get; } = Enumerable.Range(0, 5);

Version SkiaSharp: 1.68.0
Worked fine with SkiaSharp 1.60.0

Are you trying to use SkiaSharp 1.68 with Avalonia 0.7? That won't work because SkiaSharp has breaking ABI changes.

Are you trying to use SkiaSharp 1.68 with Avalonia 0.7?

Yep, but it wasn't by purpose - it was installed after updating packages.

That won't work because SkiaSharp has breaking API and ABI changes between versions.

Got it, thank you. Will close then.

Always use the version that comes with Avalonia.

It comes with Avalonia 🤷♂


It would be great if it could support custom output paths

I don't understand what this callback function onSave does. I just want to customize an output path after trim.

Thank you for your answer. I encountered a new problem。
I use wav format files for editing, but cannot save them. The error code is as follows。
I/flutter (24225): /storage/emulated/0/Android/data/com.example.flutter_keyboard_data/files/recording.wav
I/flutter (24225): 5121.0
I/flutter (24225): 6121.0
I/flutter (24225): DateTime: Dec 16, 2023 _ 13:45:02
I/flutter (24225): Formatted: Dec16,2023_13:45:02
I/flutter (24225): Exists
I/flutter (24225): Retrieved Trimmer folder
I/flutter (24225): Start: 0:00:05.121000 & End: 0:00:06.121000
I/flutter (24225): /data/user/0/com.example.flutter_keyboard_data/app_flutter/Trimmer/
I/flutter (24225): OUTPUT: .mp3
V/MediaPlayer(24225): resetDrmState:  mDrmInfo=null mDrmProvisioningThread=null mPrepareDrmInProgress=false mActiveDrmScheme=false
V/MediaPlayer(24225): cleanDrmObj: mDrmObj=null mDrmSessionId=null
I/flutter (24225): Loading ffmpeg-kit-flutter.
D/ffmpeg-kit-flutter(24225): FFmpegKitFlutterPlugin com.arthenica.ffmpegkit.flutter.FFmpegKitFlutterPlugin@38ade6b started listening to events on io.flutter.plugin.common.EventChannel$IncomingStreamRequestHandler$EventSinkImplementation@97bf0cc.
I/flutter (24225): Loaded ffmpeg-kit-flutter-android-https-x86_64-6.0.3.
I/flutter (24225): FFmpeg process exited with state COMPLETED and rc 1
I/flutter (24225): FFmpeg processing failed.
I/flutter (24225): Couldn't save the audio
I/flutter (24225): 处理完成,原输出路径为:null
I/flutter (24225): 处理完成,自定义为:null
Application finished.

Is it a storage problem caused by the file name?

did you add the permission for storage read and write?

I think I have read and write permissions, because my wav file is saved locally through flutter_record, and then trimmed using trimmer。


Adding args to PyLint in setting.json breaks linting

Environment data

VS Code version: 1.33.1
Extension version : ms-python 2019.3.6558
OS and version: Windows 10 Pro
Python version (& distribution if applicable, e.g. Anaconda): 3.6.8
Type of virtual environment used (N/A | venv | virtualenv | conda | ...): venv
Relevant/affected Python packages and their versions:
astroid           2.2.5
colorama          0.4.1
isort             4.3.17
lazy-object-proxy 1.3.1
mccabe            0.6.1
pip               19.0.3
pylint            2.3.1
setuptools        40.6.2
six               1.12.0
typed-ast         1.3.1
wrapt             1.11.1
opencv-python       <IP_ADDRESS>

Adding any type of argument for PyLint to settings.json, seems to cause a major issue with linting.
For instance, adding this line to setting.json:
"python.linting.pylintArgs": ["--extension-pkg-whitelist=cv2"],

causes linting to bug out, outputting a bunch of warnings never seen before.

I have tested this with other commands as well, and all of them does the same thing.
Steps to reproduce:

Use linting on PyLint without any options in settings.py.
Add any setting using the "python.linting.pylintArgs" command
Rerun linting

Example errors
{
"resource": "/c:/Work/ucpa-machine-learning/src/find_gaps_v2.py",
"owner": "python",
"code": "mixed-indentation",
"severity": 4,
"message": "Found indentation with tabs instead of spaces",
"source": "pylint",
"startLineNumber": 13,
"startColumn": 1,
"endLineNumber": 13,
"endColumn": 1
}
{
"resource": "/c:/Work/ucpa-machine-learning/src/find_gaps_v2.py",
"owner": "python",
"code": "bad-whitespace",
"severity": 2,
"message": "No space allowed before comma",
"source": "pylint",
"startLineNumber": 29,
"startColumn": 39,
"endLineNumber": 29,
"endColumn": 39
}

Unfortunately the error message is coming from pylint (a third party package).
Please report issues related to pylint on their repo


Fix alignment of relationships nested table

Note that this only occurs when user does not have edit permissions (i.e., only 2 action icons on right, not 3).


server is starting again and again flashing CM4

The server is set up but in some cases, it starts all o ver again the new flasing process.

Any idea about this?
I also see this, when connecting a new CM4 to the server. Then all the process starts from the beginning.
I also can not flash 4 CM4 at one time unfortunately.

Could be a power problem.
Make sure you power the modules separately and not off Pi's USB port.

with an external power supply the board are not visible by the server. I expect, that the rpiboot is not possible then even the should do it via ETH. I tried it with different power supply plugs. What do you recommend?

with an external power supply the board are not visible by the server.

If they units are already flashed, you do indeed need to connect them by USB to the server.
But do not do so directly, but through a powered USB hub that has an adapter.
(Or program the units with normal CMIO boards instead of third-party boards. The official boards have separate barell connector for power.)

even the "fresh" CM4 modules can not be connected by the server

Make sure the boot switch of fresh modules is set to "eMMC boot" "ON" so that they can network boot.

yes I tried this but no effort

server is starting again and again flashing two CM4.
in dmesg i can see this:
+0.000018] usb 1-1.1: Product: BCM2711 Boot
[  +0.000015] usb 1-1.1: Manufacturer: Broadcom
[  +0.000014] usb 1-1.1: SerialNumber: 74b0ffaa
[  +2.392993] usb 1-1.1: USB disconnect, device number 48
[  +0.226026] usb 1-1.1: new high-speed USB device number 49 using xhci_hcd
[  +1.135990] usb 1-1.1: new full-speed USB device number 50 using xhci_hcd
[  +0.102107] usb 1-1.1: not running at top speed; connect to a high speed hub
[  +0.008001] usb 1-1.1: New USB device found, idVendor=0a5c, idProduct=2764, bcdDevice= 0.00
[  +0.000029] usb 1-1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=1
[  +0.000015] usb 1-1.1: Product: BCM2711 Boot
[  +0.000012] usb 1-1.1: Manufacturer: Broadcom
[  +0.000012] usb 1-1.1: SerialNumber: Broadcom
[ +15.938219] usb 1-1.1: USB disconnect, device number 50
[  +0.479730] usb 1-1.1: new high-speed USB device number 51 using xhci_hcd
[  +5.296193] usb 1-1.1: device descriptor read/64, error -110
[  +8.884013] usb 1-1.1: device descriptor read/64, error -71
[  +0.187751] usb 1-1.1: new high-speed USB device number 52 using xhci_hcd
[  +0.100468] usb 1-1.1: config index 0 descriptor too short (expected 55, got 32)
[  +0.000496] usb 1-1.1: New USB device found, idVendor=0a5c, idProduct=2711, bcdDevice= 0.00
[  +0.000019] usb 1-1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[  +0.000015] usb 1-1.1: Product: BCM2711 Boot
[  +0.000013] usb 1-1.1: Manufacturer: Broadcom
[  +0.000012] usb 1-1.1: SerialNumber: 74b0ffaa
[  +0.234984] usb 1-1.2: new high-speed USB device number 53 using xhci_hcd
[  +0.100504] usb 1-1.2: config index 0 descriptor too short (expected 55, got 32)
[  +0.000508] usb 1-1.2: New USB device found, idVendor=0a5c, idProduct=2711, bcdDevice= 0.00
[  +0.000023] usb 1-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[  +0.000017] usb 1-1.2: Product: BCM2711 Boot
[  +0.000015] usb 1-1.2: Manufacturer: Broadcom
[  +0.000014] usb 1-1.2: SerialNumber: b91398e2
[  +1.869797] usb 1-1.1: USB disconnect, device number 52
[  +3.293209] usb 1-1.1: new high-speed USB device number 54 using xhci_hcd
[  +0.100821] usb 1-1.1: New USB device found, idVendor=0a5c, idProduct=2711, bcdDevice= 0.00
[  +0.000039] usb 1-1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=4
[  +0.000018] usb 1-1.1: Product: BCM2711 Boot
[  +0.000015] usb 1-1.1: Manufacturer: Broadcom
[  +0.000013] usb 1-1.1: SerialNumber: 74b0ffaa
[  +0.003556] usb 1-1.2: USB disconnect, device number 53
[  +2.235330] usb 1-1.1: USB disconnect, device number 54
[  +0.228151] usb 1-1.1: new high-speed USB device number 55 using xhci_hcd
[  +1.095995] usb 1-1.1: new full-speed USB device number 56 using xhci_hcd
[  +0.101934] usb 1-1.1: not running at top speed; connect to a high speed hub
[  +0.008006] usb 1-1.1: New USB device found, idVendor=0a5c, idProduct=2764, bcdDevice= 0.00
[  +0.000029] usb 1-1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=1
[  +0.000015] usb 1-1.1: Product: BCM2711 Boot
[  +0.000013] usb 1-1.1: Manufacturer: Broadcom
[  +0.000012] usb 1-1.1: SerialNumber: Broadcom
[  +0.230007] usb 1-1.2: new high-speed USB device number 57 using xhci_hcd
[  +0.100847] usb 1-1.2: New USB device found, idVendor=0a5c, idProduct=2711, bcdDevice= 0.00
[  +0.000031] usb 1-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=4
[  +0.000017] usb 1-1.2: Product: BCM2711 Boot
[  +0.000014] usb 1-1.2: Manufacturer: Broadcom
[  +0.000014] usb 1-1.2: SerialNumber: b91398e2
[Apr14 15:29] usb 1-1.2: USB disconnect, device number 57
[  +0.222338] usb 1-1.2: new high-speed USB device number 58 using xhci_hcd
[  +1.024004] usb 1-1.2: new full-speed USB device number 59 using xhci_hcd
[  +0.101964] usb 1-1.2: not running at top speed; connect to a high speed hub
[  +0.006007] usb 1-1.2: New USB device found, idVendor=0a5c, idProduct=2764, bcdDevice= 0.00
[  +0.000026] usb 1-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=1
[  +0.000015] usb 1-1.2: Product: BCM2711 Boot
[  +0.000013] usb 1-1.2: Manufacturer: Broadcom
[  +0.000012] usb 1-1.2: SerialNumber: Broadcom
[  +2.485798] usb 1-1.1: USB disconnect, device number 56
[  +0.366136] usb 1-1.1: new high-speed USB device number 60 using xhci_hcd
[  +5.148292] usb 1-1.1: device descriptor read/64, error -110
[ +15.616052] usb 1-1.1: device descriptor read/64, error -110
[  +0.187802] usb 1-1.1: new high-speed USB device number 61 using xhci_hcd

even the "fresh" CM4 modules can not be connected by the server

Make sure the boot switch of fresh modules is set to "eMMC boot" "ON" so that they can network boot.

now this worked!
fresh CM4 and boot switch to ON and external USB power supply and only ETH connection to the server

Problem:
I connected four CM4 already programmed via USB Hub (powered) to the USB port of the server. Also they are connected to the switch via ETH. They are booting up and trying to get flashed but the process is not finishing after 4 hours now....what is wrong here?

Got a photo of the HDMI output of those CM4s?

Meant the CM4 boards being provisioned, not the Pi 4 server.

O do not have access to them because they are not ready flashed

A Linux operating system is network booted on them during provisioning.
So they do should display SOMETHING when you connect HDMI to them....

sorry, i don't understand what you mean.
I am using a windows computer to add the file to the USB stick.
At a different system, where I worked before, i used linux and can flash the CM4 with the bmap tool which is running must faster and skippes the free spaces.

sorry, i don't understand what you mean.

I asked you to connect a HDMI display to the CM4 boards.
With that I mean your Sourcekit boards.
You show me 3 pictures that are of a HDMI display that is clearly connected to the Pi 4 that is playing server instead. Messages like "Product: BCM2711 boot" will only appear on the server, definitely not on the client.
That is not what I need.
If you want support, please follow instructions to the letter. And connect that HDMI display to one of the CM4/Sourcekit boards, and see what it shows on screen.
If the boards manage to network boot, and your start post suggest they do (otherwise it wouldn't show "starting to write image"), there should definitely be something on the screen.

At a different system, where I worked before, i used linux and can flash the CM4 with the bmap tool which is running
must faster and skippes the free spaces.

If you have a lot of free space in your images, then you are generating images the wrong way.
Make sure you use tools like pi-gen if what you have is based on Pi OS.
But that is a different discussion. And not relevant to your current issue.

I am using a yocto image so no Pi OS. we can skip this for now

"I asked you to connect a HDMI display to the CM4 boards."
nothing appears on the HDMI screen. I can understand this because the eMMC is not flashed

>I can understand this because the eMMC is not flashed
I think you are misunderstanding how cmprovision works.
We do NOT use the normal rpiboot payload that lets the cm4 act as a USB mass storage storage device to flash it.
We start a small Linux operating system first (made with buildroot, similar to Yocto) instead.
That small operating system contacts the cmprovision server for further instructions, and downloads and flashes the image from the server.
If you see messages in the webinterface of the server like "starting to write image" it means the small operating system has had contact with the server, so must have started.
And the small operating system certainly outputs to HDMI.
If you do not see anything on HDMI while you do see messages in the webjnterface, either your boards are broken, or there is something wrong with your HDMI display (which is unlikely because your HDMI display does seem to work when connected to the server)

thanks for clarification.
I already checked with some other boards I am using here. I can flash them at my laptop with a separate tool but after connection to the server and wait a few seconds, the HDMI still is no video visible.
When is the small operating system programmed to the module? How long does it take and how can this be indicated from outside?

When is the small operating system programmed to the module?

The small operating system gets booted to RAM (using an initramfs construct), it does not get written to flash.
It is stored inside scriptexecute.img that you can see getting downloaded by tftp in the dnsmasq log if network booted (or the rpiboot log if USB booted)
The moment you see messages like "Provisioning started" in the web interface, the small OS is already running.
The web interface writes that to log if it receives a HTTP request from the small OS running on the client asking for instructions.

thanks for the explanation.
The boards are powered like in any other flashing process so they have enough power I expect.
I will try to use an decompressed image...

The boards are powered like in any other flashing process so they have enough power I expect.

Recall that rpiboot's mass storage device stuff runs on the Videocore GPU.
Our utility operating system runs on the ARM CPU.
Different power footprint, and Pi 4 can only deliver 1.2 amperre for all USB ports combined.

"We are not "any other flashing process""
-> I mean I can also flash the CM4 with another way of flashing method where the CM4 needs power as well. I don't use the raspi USB for power the CM4

Hello,
I want to come back to the small operating system which is neccessary on the CM4 to get the image flashed by the server. You mentioned, that the CMs seems to have the small operating system installed because they show up in the log.
One step back: I expected that the server is running, and as soon as I connect a device via ETH to the ETH-switch the device is flashed. Even, when I connect more devices to the same ETH-swtich afterwards, the progress of the first one will continue and the second device will be flashed as well.
Can you acknowledge this expectation?
Can we find out together why my system is not running like it should? Is there any chance to get support by you on a different way? Is it possible to come to your location to verify the setup? Can we do a remote session or maybe you can tell me to share more details about my system?
Thanks for your help!

As mentioned elsewhere use a separate device to wipe the CM4, cmprovision is only developed for provisioning of new devices.


Update _index.html

- What I did Edited title and linkTItle
- How I did it Online editing
- How to verify it Read it
- Description for the changelog Updated title and linkTitle for SEO purposes

No -- thanks for catching this Tyler. I thought I was editing the title tags for SEO, didn't realize those were something else entirely!


service monitor wrapper

Description
Wrapper functions for generating all the components for prometheus metrics
Release Notes

NONE

What do you think about adding a new package called utils?
Feels kinda weird a component servicemonitor-wrapper 🤔

I don't like the idea of this being a utils package. Each of these is effectively a component, but to reduce code, we are iterating over all the underlying components. We could just call this the gitpod component and then create separate components for werft, cert-manager (and anything that these service monitor components are used). Then some of that code might go into a utils pkg

I disabled the Go e2e checks. Even after fixing the segfaults, it wasn't working. It's not from this PR and don't really want to solve it as part of this work

I disabled the Go e2e checks. Even after fixing the segfaults, it wasn't working. It's not from this PR and don't really want to solve it as part of this work

It is fine! We know they are not passing 🙂, they are not blocking the merge.

Hey @liam-j-bennett, while you were away I took the liberty to get this PR to completion 🙂
Some changes I've made:

Re-enabled the e2e-tests, we don't need them to pass at the moment.
Rebased and fixed all linting problems
Fixed Networkpolicies' Kind from ServiceMonitor to NetworkPolicy


Project fails to build - TypeError: expected str, bytes or os.PathLike object, not tuple

Related issue: https://github.com/meltano/edk/issues/50
Meltano dbt-ext relies on the main branch of the edk, so changes to either of those potentially break this project.
Eventually these should be versioned and published on Pypl but for now it is a risk of the project

FYI - all builds currently failing because of this issue.

@matsonj The latest EDK should fix the TypeError: expected str, bytes or os.PathLike object, not tuple error if you want to give it a try

Triggering this action: https://github.com/matsonj/nba-monte-carlo/actions/runs/3933351069
if it builds then I can close this issue

@edgarrmondragon great success!


walls

This might need to be reopened because we dont have windows or the other wall types(?)

Ill make windows a seperate issue

Ill make windows a seperate issue

dont forget about doors.


Add istio debug endpoints page to dashboard

Please provide a description of this PR:
Provide a convenient way to see the Istio debug endpoints.

what is the cmd output look like

what is the cmd output look like

@hzxuzhonghu Will be something like
istioctl d istio-debug istiod-ff7c47cfc-7xlqz
http://localhost:15014/debug

and automatically open the web browser, like other dashboard commands.


Optionally disable caching for AutoMoq

This PR resolves #625
The implementation is pretty simple. Please, tell me if we need more complex abstractions.
This is my first PR.

Hello @rus-art.
Thank you for the contribution.
I've had a look at the PR and I'm thinking that the implementation could be improved by extracting the value resolution responsibility in the MockTypes.ReturnsUsingContext() and injecting a strategy that would handle setting the Return value, since it all boils down to either setup.Returns(Func<TValue>) or setup.Returns(TValue) being used.
I believe this is also more or less what was suggested in #625 .


md-nav-list disableRipple

Bug, feature request, or proposal:
Bug
What is the expected behavior?
Putting just disableRipple should disable ripples
What is the current behavior?
disableRipple="true" works
What are the steps to reproduce?
(Based on material list example)
https://plnkr.co/edit/h2Jnm62Pzbn6P0UaXtgk
What is the use-case or motivation for changing an existing behavior?
Consistency with other controls such as buttons
Which versions of Angular, Material, OS, browsers are affected?
Angular 4.0.2
Material beta.3
Is there anything else we should know?

disableRipple have to be set to md-list-item instead of md-nav-list.


Fixed notification position by added header offset

Or maybe it would be better if the notification message moved to the bottom?

Let's show them at the bottom. It would be easier to manage the offset


Add fix for package running dnf5 on fedora

Hi,
on fedora 41 we experience the following errors due to the new dnf version, dnf5 (https://docs.fedoraproject.org/en-US/fedora/latest/release-notes/sysadmin/#dnf-5).
Error: Execution of '/usr/bin/dnf -d 0 -e 1 -y install XX' returned 2: Unknown argument "-d" for command "dnf5". Add "--help" for more information about the arguments.

The flags '-d' and '-e' have as a workaround been removed for newer versions of fedora.
This fixes https://github.com/puppetlabs/puppet/issues/9506

Can one of the admins verify this patch?

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

I just tested the PR, works great. Up next: group support.
h.boetes@habocp3 ~/Downloads %  sudo puppet agent -t
Info: Refreshing CA certificate
Info: CA certificate is unmodified, using existing CA certificate
Info: Refreshing CRL
Info: CRL is unmodified, using existing CRL
Info: Using environment 'production'
Info: Retrieving pluginfacts
Info: Retrieving plugin
Info: Loading facts
Notice: Requesting catalog from puppet:8140 (<IP_ADDRESS>)
Notice: Catalog compiled by theforeman.axis-flight-training-systems.at
Info: Caching catalog for habocp3.axis-flight-training-systems.at
Info: Applying configuration version '1731659031'
Notice: /Stage[main]/Desktop_fedora::Gnome/Package[gnome-tweaks]/ensure: created
Notice: /Stage[main]/Desktop_fedora/Service[rpc-statd-notify.service]/ensure: ensure changed 'running' to 'stopped' (corrective)
Notice: /Stage[main]/Desktop_fedora::Gnome/Yum::Group[workstation-product-environment]/Exec[yum-groupinstall-workstation-product-environment]/returns: Unknown argument "groupinstall" for command "dnf5". Add "--help" for more information about the arguments.
Notice: /Stage[main]/Desktop_fedora::Gnome/Yum::Group[workstation-product-environment]/Exec[yum-groupinstall-workstation-product-environment]/returns: It could be a command provided by a plugin, try: dnf5 install 'dnf5-command(groupinstall)'
Error: 'yum -y groupinstall 'workstation-product-environment'' returned 2 instead of one of [0]
Error: /Stage[main]/Desktop_fedora::Gnome/Yum::Group[workstation-product-environment]/Exec[yum-groupinstall-workstation-product-environment]/returns: change from 'notrun' to ['0'] failed: 'yum -y groupinstall 'workstation-product-environment'' returned 2 instead of one of [0] (corrective)
Info: Class[Desktop_fedora::Gnome]: Unscheduling all events on Class[Desktop_fedora::Gnome]
Notice: /Stage[main]/Desktop_fedora::Rstudio/Package[rstudio]/ensure: created
Info: Stage[main]: Unscheduling all events on Stage[main]
Notice: Applied catalog in 21.83 seconds

If I recall correctly, for dnf4, the old options were already deprecated. I don't know if dnf3 is still in use somewhere or how old it is, rocky linux 8 already uses dnf4. centos 7 also uses dnf4.
Perhaps we can do away with the conditionals altogether?

@QWolfp3 how can I help in moving this PR along?

@QWolfp3 how can I help in moving this PR along?

IMHO, we need a simple PR which does away with the deprecated settings. Those are settings from the RHEL6 era, which is no longer supported.
https://access.redhat.com/support/policy/updates/errata/

@Stricken1670 I created a branch for removing the flags: https://github.com/puppetlabs/puppet/compare/main...larhauga:puppet:fix/main/dnf5-fedora41-remove-deprecated-flags?expand=1
It would be much cleaner and the best option if you think that we can break compatability here.
I did not manage to find out where in the codebase the yum groupinstall comes from.

The calls to groupinstall are coming from https://github.com/voxpupuli/puppet-yum/blob/62b73b4c8989087367c4ac98037ed7c4d6e49562/manifests/group.pp, not Puppet itself. A separate PR will be needed for that repository.

@larhauga
Thanks for the branch. Please create the PR.
I have no say in the matter, all I can do is share my humble opinion.


Clear Data Before Adding

It's possible (though, I think, not probable) to end up with a FOOOF object with inconsistent data & results (coming from different power spectra).
Example:
fm = FOOOF()
fm.report(fs1, ps1)

# Recycle FOOOF object to plot some different data
fm.add_data(fs2, ps2)
fm.plot()

^ At this, point, the object will fail with a (confusing) inconsistent data size error, due to the 'fooofed_power_spectrum' from the first fit. Note that, in the case that first & second PSDs have the same size, this may run - but print out the wrong thing (this is a bigger problem).
Note: this is, I think, unlikely to happen - it's a weird use case / workflow - if you call 'fit' or 'report', the usual case, even with an object that already has data, everything gets over-written (though, I think, implicitly - still potentially good to have the explicit clear).
Solution:
We have a hidden sub-function to clear the object - I think we should just add this to be run in the 'add_data' method. I just need to check through if and when things are clearing, to remind myself if it tries and clears somewhere else, and make sure it all deals with possible ways to add data, etc.

So after a fairly quick scan - I've added to always explicitly clear the object upon adding data.
I think the reason it didn't have this before is that in the most common case, calling 'fit' or 'report', all data & results fields will be over-written anyways, and so explicit clearing didn't seem needed. However, given that 'add_data' is exposed as a viable way to interact with the data (and I find myself using this, adding just to plot), then it seems that calling this method after previous data should not fail out like this.
The only counter-point I can see is that this clearing is, in most cases, unneeded (it gets called, for example on empty objects the first time they are called) - but it's quick, so that doesn't seem super important.
A possible update is to add some kind of boolean attributes of 'has_data' / 'has_results', which could be checked to see when to clear, which could be marginally more efficient, and arguable cleaner.

Small update: changed it to check for presence of data before clearing (mildly cleaner / more efficient).
This should be all done then - leaving open for a bit in case anyone has any comments.


⚠ Samsung has degraded performance

In 3a2ff2e, Samsung (https://samsung.com) experienced degraded performance:

HTTP code: 200
Response time: 2519 ms

Resolved: Samsung performance has improved in 3789c21.


IDP Demo improvements

This issue is to collect and track feedback on IDP demo v1 that allows you to deploy a new GO Service.
Go-Service improvements

Remove showing GitOps Repository Location tab from the Go-Service template
Remove the Review tab from the Go-Service template
Improve Kratix Resource page - Creation Progress Box
Include back-link to Kratix Resource page from Component Page
Automate deprovisioning of service instances
Shorten GitHub Action pipeline name "validate and test" to "checks"
1st Commit on the New Service repository should be done as the Service requester
On the Component page of the Go Service. The Deployment Tab

has a table where the Section Action is only Links. Rename to "Links"
Lists Source as "lutzdemo/lutzdemo" which is wrong. Should be DemoTechInc/lutzdemo, right?
Installation is gazelle. It is a Management Cluster or an Infrastructure, but not an Installation.
Pull Requests page is empty an a newly created component. Could we switch to an initial PR to fill the repo?
Dependency Section of the the Component in Backstage is empty. We should add the ElasticCache and RDS there.

Additional simple templates

Create a simple "Create Namespace" template
Create a simple "Create a GitRepository " template

Tackle Day 2 Operation

How to iterate & version services
Provide a way to delete the Service through Backstage

Meeting scheduled for November 20.

Created the two stub templates. They don't show up yet in the Demotech portal. Have to check.


Create edu.txt

Created edu.txt file for Siemens Energy Professional Education

@KuebelHund This domain was already reviewed in #15045. The official website indicates that Siemens Energy is not a university or a college. The comment says "They provide courses for Companies bringing in their apprentices". It means that the organization is more like a training center.
Therefore, I have to close the request without merging, because this organization is a training center, not a college or a university. Please ensure that you are familiar with this repository rules located at the bottom of this page.
Please apply for an appropriate licensing option (which may also be free) at https://www.jetbrains.com/community/education/#courses.
Thank you for your understanding!


Feature Request: Make it possible to run several datasets in parallel

See my approach to make parallelization possible for KATARA:
https://github.com/FelixNeutatz/abstraction-layer/commit/70e9ce799c2ea2f9a3d1b81ceccdc1a802833bfc

Now, all the tools support parallelization except NADEEF. For NADEEF there is a danger of loosing data and getting exceptions. So, for now, it is not still parallelized.

OK, all the tools including NADEEF can be run in parallel.


Depth Anything is not working in A1111 Version: v1.9.4 - Always errors with TypeError: Expected state_dict to be dict-like, got <class 'NoneType'>

Depth Anything is not working in A1111 Version: v1.9.4 - on my side.
It always errors with TypeError: Expected state_dict to be dict-like, got <class 'NoneType'
I reinstalled the Plugin two times and it is same behavior.
Also used pip install -r requirements.txt and there have been no errors during this.
Final info here is:
Successfully installed depth-anything-2<IP_ADDRESS> timm-0.9.16
My Specs:
Windows 10 64 Bit
RTX 3080
A1111:
version: [v1.9.4]•  python: 3.10.9  •  torch: 2.1.2+cu121  •  xformers: 0.0.23.post1  •  gradio: 3.41.2  •
Settings to replicate

@DrSniffy Could you please provide the stacktrace (the full error message which is very long)?

I got the same problem. I use SD Forge and it seems the ui_tab_callback gives an error.
Details of the whole start up log

Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug  1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: f1.0.2v1.10.1-previous-151-gb7878058
Commit hash: b7878058f9144201924cf983e64d08174cf1756e
Launching Web UI with arguments:
Total VRAM 8188 MB, total RAM 97925 MB
pytorch version: 2.1.2+cu121
Set vram state to: NORMAL_VRAM
Device: cuda:0 NVIDIA GeForce RTX 4070 Laptop GPU : native
Hint: your device supports --pin-shared-memory for potential speed improvements.
Hint: your device supports --cuda-malloc for potential speed improvements.
Hint: your device supports --cuda-stream for potential speed improvements.
VAE dtype preferences: [torch.bfloat16, torch.float32] -> torch.bfloat16
CUDA Stream Activated:  False
Using pytorch cross attention
Using pytorch attention for VAE
ControlNet preprocessor location: C:\AI\SD Forge\webui_forge_cu121_torch21\webui\models\ControlNetPreprocessor
WARNING:dinov2:xFormers not available
WARNING:dinov2:xFormers not available
Loading weights [15012c538f] from C:\AI\SD Forge\webui_forge_cu121_torch21\webui\models\Stable-diffusion\realisticVisionV51_v51VAE.safetensors
StateDict Keys: {'unet': 686, 'vae': 248, 'text_encoder': 197, 'ignore': 0}
2024-08-06 17:15:26,043 - ControlNet - INFO - ControlNet UI callback registered.
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
*** Error executing callback ui_tabs_callback for C:\AI\SD Forge\webui_forge_cu121_torch21\webui\extensions\stable-diffusion-webui-depthmap-script\scripts\depthmap.py
    Traceback (most recent call last):
      File "C:\AI\SD Forge\webui_forge_cu121_torch21\webui\modules\script_callbacks.py", line 283, in ui_tabs_callback
        res += c.callback() or []
      File "C:\AI\SD Forge\webui_forge_cu121_torch21\webui\extensions\stable-diffusion-webui-depthmap-script\scripts\depthmap.py", line 104, in
        script_callbacks.on_ui_tabs(lambda: [(common_ui.on_ui_tabs(), "Depth", "depthmap_interface")])
      File "C:\AI\SD Forge\webui_forge_cu121_torch21\webui\extensions\stable-diffusion-webui-depthmap-script\src\common_ui.py", line 289, in on_ui_tabs
        inp += gr.File(label="Custom DepthMap", file_count="single", interactive=True,
      File "C:\AI\SD Forge\webui_forge_cu121_torch21\webui\modules\gradio_extensions.py", line 126, in __repaired_init__
        original(self, *args, **fixed_kwargs)
      File "C:\AI\SD Forge\webui_forge_cu121_torch21\system\python\lib\site-packages\gradio\component_meta.py", line 163, in wrapper
        return fn(self, **kwargs)
      File "C:\AI\SD Forge\webui_forge_cu121_torch21\system\python\lib\site-packages\gradio\components\file.py", line 98, in __init__
        raise ValueError(
    ValueError: Invalid value for parameter `type`: file. Please choose from one of: ['filepath', 'binary']

We might want to make a separate branch for sd forge or newer versions.
Basically anywhere were we use gr.File the parameter type='file' needs to be replaced with type='binary' but I'm pretty sure this will be a breaking change for people using older versions.

Uh-oh... This indeed may be a challenge. But I still hope that we could work around it without making a new branch. Basically we will need to detect which variant it is and then use the correct string. I feel that somehow it should be possible, but who knows.

We might want to make a separate branch for sd forge or newer versions.
Anywhere were we use gr.File the parameter type='file' needs to be replaced with type='binary' but I'm pretty sure this will be a breaking change for people using older versions.
Also we are going to need to do a bunch of other work to make the UI work. The API still works somehow haha.
flux only works on newer versions so I expect this to be a more common problem.
edit: So it seems that the model unload/reload needs edits, but that seems to be the only other issue.

Is this a matter of a find and replace for the 'type' in order for it to work in Forge?

I think it partially fixes some of the extension, but the memory loading and unloading also needs to be modified. If you have a bigger gpu you might just be able to remove the unloading part.
I'll try put some time into a forge branch this week.

Okay after looking into this.
The main issue is forge is using Gradio 4.xx vs auto1111 using Gradio 3.xx.
So it's going to be a fairly significant rewrite of common_ui.py.

Here's my first go at forge compatibility if you'd like to test out,
https://github.com/thygate/stable-diffusion-webui-depthmap-script/pull/467

Here's my first go at forge compatibility if you'd like to test out, #467

This is on the edge of my understanding of how to implement this update. Do I go to your commit and then copy and replace the 4 files over the default forge and extension scripts?

@tommcg This is one way to fo it, yes, but this will be fixed in the next update, so another way would be to update the extension once it is out (soon).


fix: wovalle#183 batch write within subcollection

Hi, @skalashnyk asked me to help him with the issue #183. I fixed that problem, and added the case to the tests.

@all-contributors please add @skalashnyk and @Fame513 for code

@all-contributors please add @Fame513 for code


Upgrade qunitjs to 2.x

As of this writing<EMAIL_ADDRESS>is available.
The new major version introduces breaking changes across the board, see migration guide.

Let's wait for 2.0.0 to be released.

Or put together a PR with a release candidate. If something breaks, report back to QUnit. If not, wait for the final release, update the PR once more and merge it.
@mucaho would you work on that?

@jzaefferer It seems like there is minimal coupling with qunitjs, which should make this transition pretty painless.
Afaik, phantomjs/bridge.js and the test/s would be prime candidates for regressions.
Here is a preliminary patch that fixes those issues and sets qunitjs to 2.0.0-rc1.
Any copyright of the following patch is dedicated to the Public Domain.
http://creativecommons.org/publicdomain/zero/1.0/
diff --git a/package.json b/package.json
index 68b14e9..d164e8a 100644
--- a/package.json
+++ b/package.json
@@ -24,7 +24,7 @@
     "grunt-contrib-connect": "^1.0.0",
     "grunt-contrib-internal": "^1.1.0",
     "grunt-contrib-jshint": "^1.0.0",
-    "qunitjs": "^1.20.0"
+    "qunitjs": "2.0.0-rc1"
   },
   "keywords": [
     "gruntplugin"
diff --git a/test/qunit_modules.js b/test/qunit_modules.js
index 87fb36d..2081d1a 100644
--- a/test/qunit_modules.js
+++ b/test/qunit_modules.js
@@ -1,14 +1,14 @@
-module('module1');
+QUnit.module('module1');

-test('basic test', function() {
-  expect(1);
-  ok(true, 'this had better work.');
+QUnit.test('basic test', function(assert) {
+  assert.expect(1);
+  assert.ok(true, 'this had better work.');
 });

-module('module2');
+QUnit.module('module2');

-test('a second basic test', function() {
-  expect(1);
-  ok(true, 'this had better work.');
+QUnit.test('a second basic test', function(assert) {
+  assert.expect(1);
+  assert.ok(true, 'this had better work.');
 });
diff --git a/test/qunit_noglobal_test.js b/test/qunit_noglobal_test.js
index 77f35e8..69b2964 100644
--- a/test/qunit_noglobal_test.js
+++ b/test/qunit_noglobal_test.js
@@ -2,7 +2,7 @@
 var pushFailure = QUnit.pushFailure;
 var failures = [];

-test('global pollution', function(assert) {
+QUnit.test('global pollution', function(assert) {
   window.pollute = true;
   assert.ok(pollute, 'nasty pollution');
   QUnit.pushFailure = function(message) {
@@ -10,8 +10,8 @@ test('global pollution', function(assert) {
   };
 });

-test('actually check for global pollution', function() {
-  expect(1);
+QUnit.test('actually check for global pollution', function(assert) {
+  assert.expect(1);
   QUnit.pushFailure = pushFailure;
-  deepEqual(failures, ['Introduced global variable(s): pollute']);
+  assert.deepEqual(failures, ['Introduced global variable(s): pollute']);
 });
diff --git a/test/qunit_test.js b/test/qunit_test.js
index e6a5ca7..28c01a7 100644
--- a/test/qunit_test.js
+++ b/test/qunit_test.js
@@ -1,12 +1,12 @@

-test('basic test', function() {
-  expect(1);
-  ok(true, 'this had better work.');
+QUnit.test('basic test', function(assert) {
+  assert.expect(1);
+  assert.ok(true, 'this had better work.');
 });

-test('can access the DOM', function() {
-  expect(1);
+QUnit.test('can access the DOM', function(assert) {
+  assert.expect(1);
   var fixture = document.getElementById('qunit-fixture');
-  equal(fixture.innerText, 'this had better work.', 'should be able to access the DOM.');
+  assert.equal(fixture.innerText, 'this had better work.', 'should be able to access the DOM.');
 });
diff --git a/test/qunit_test_error.js b/test/qunit_test_error.js
index fc19c53..0a87e3b 100644
--- a/test/qunit_test_error.js
+++ b/test/qunit_test_error.js
@@ -1,12 +1,12 @@

-test('basic test', function() {
-  expect(1);
-  ok(0, 'this had better work.');
+QUnit.test('basic test', function(assert) {
+  assert.expect(1);
+  assert.ok(0, 'this had better work.');
 });

-test('can access the DOM', function() {
-  expect(1);
+QUnit.test('can access the DOM', function(assert) {
+  assert.expect(1);
   var fixture = document.getElementById('qunit-fixture');
-  equal(fixture.innerText, 'this had better work.', 'should be able to access the DOM.');
+  assert.equal(fixture.innerText, 'this had better work.', 'should be able to access the DOM.');
 });

That looks good. Could you provide that as a pull request?


Problem With set_custom_titlebar on Windows 11

Software Versions

Python: 3.11.5
OS: Windows 11
Kivy: 2.21
Kivy installation method: pip install kivy[base]

Describe the bug
When running the custom_titlebar.py example from kivy example on windows 11, the window minimizes to the corner after resizing the window. Example video attached
https://github.com/kivy/kivy/assets/22190891/5d2f64c7-99d6-4f90-b4fa-a52d6602e6dd
Expected behavior
The window resizes the intended amount and the position remains the same as it was set before
To Reproduce
Run the example code on Kivy 2.2.1

Ran on the sample code on Python: 3.11.4, Windows 11, Kivy 2.21 - couldn't tell you how Kivy was installed, but probably pip install kivy[full]
The problem did not reproduce.
Then I noticed in the video that a modification had been made to the code that the text didn't mention:
import os
os.environ["KIVY_GL_BACKEND"] = "angle_sdl2"

I tried with that, and still could not reproduce it.
@Guhan-SenSam: Please try again with the original custom-titlebar.py and see if the problem still exists.
If not, please do a diff and see what other changes to the file you have made when you had the problem.

Reproduced. Software Versions:

Python: 3.9.5
OS: Windows 11 Home (64-bit)
Installation metod: pip
Kivy version: 2.2.1
Window provider: kivy_deps.sdl2 (0.6.0)

I can confirm I see the same issue as the OP on Win11.  NOTE:  The problem occurs when resizing the window.
[INFO   ] [deps        ] Successfully imported "kivy_deps.gstreamer" 0.3.3
[INFO   ] [deps        ] Successfully imported "kivy_deps.angle" 0.3.3
[INFO   ] [deps        ] Successfully imported "kivy_deps.glew" 0.3.1
[INFO   ] [deps        ] Successfully imported "kivy_deps.sdl2" 0.6.0
[INFO   ] [Kivy        ] v2.2.1

[INFO   ] [Python      ] v3.11.4 (tags/v3.11.4:d2340ef, Jun  7 2023, 05:45:37) [MSC v.1934 64 bit (AMD64)]

[INFO   ] [GL          ] Using the "OpenGL" graphics system
[INFO   ] [GL          ] GLEW initialization succeeded
[INFO   ] [GL          ] Backend used <glew>
[INFO   ] [GL          ] OpenGL version <b'4.6.0 - Build <IP_ADDRESS>75'>
[INFO   ] [GL          ] OpenGL vendor <b'Intel'>
[INFO   ] [GL          ] OpenGL renderer <b'Intel(R) Iris(R) Xe Graphics'>
[INFO   ] [GL          ] OpenGL parsed version: 4, 6
[INFO   ] [GL          ] Shading version <b'4.60 - Build <IP_ADDRESS>75'>

It is interesting that different people are getting different behaviour.
Here is a recording from my system, with the angle_sdl2 code in place.
The effect of resizing looks a little counter intuitive, but that is because my recording software realigns it in the scene when resized. On the actual window, it resizes normally.
https://github.com/kivy/kivy/assets/945973/8ee4d6b0-c316-43c3-a66d-962a98724f5e
Note the title-bar is not at the top of the window. Should it be?

As a workaround, you can replace lines 335-338 in window_sdl2.py with self._win.set_border_state function call. Your code should look something like this:
...
self._win.resize_window(w, h)
self._win.set_border_state(self.borderless or self.custom_titlebar)
self._win.set_fullscreen_mode(self.fullscreen)

But dragging still doesn't work.

Note the title-bar is not at the top of the window. Should it be?

No, buttons should be in the middle of the window.
@Julian-O, could you provide us with additional information about your Windows 11 (edition, build version, etc.)?

The title bar must be at the top of the window.  The example puts the buttons in the middle of the window, and sets them to the titlebar.  Creating two instances of TItleBar() (one for the buttons in the middle of the window, one for the title bar) does not change the behavior.

@mak8kammerer:
OS Name:	Microsoft Windows 11 Home
Version:   	10.0.22621 Build 22621
System Type:	x64-based PC
I'm guessing it is another factor.

My version:
OS Name	Microsoft Windows 11 Home
Version	10.0.22631 Build 22631
System Type	x64-based PC

Ran on the sample code on Python: 3.11.4, Windows 11, Kivy 2.21 - couldn't tell you how Kivy was installed, but probably pip install kivy[full]
The problem did not reproduce.
Then I noticed in the video that a modification had been made to the code that the text didn't mention:
import os
os.environ["KIVY_GL_BACKEND"] = "angle_sdl2"

I tried with that, and still could not reproduce it.
@Guhan-SenSam: Please try again with the original custom-titlebar.py and see if the problem still exists. If not, please do a diff and see what other changes to the file you have made when you had the problem.

Hello, Sorry for the late response.

I was able to reproduce the same issue after removing the the line os.environ["KIVY_GL_BACKEND"] = "angle_sdl2".
Created a new virtual environment and ran pip install kivy[full] still got the same behaviour.
I had a feeling that Microsoft Powertoys was interfering with this cause it is known to cause random windows resizes sometimes(due to the fancy zones). I removed Powertoys and got the same issue still.
Full list of specs are:
- Windows 11 Home Single Language
-  Version: 23H2
-  Build: 22631.2861
- AMD Radeon Integrated Graphics
- 64 bit

@ElliotGarbus: I was confused by your earlier comment about TitleBars, sorry.
I am trying to figure if there should be a separate bug report on the TitleBar code or on the example code, so that the example gives a TitleBar conformant with your reference (or is it working fine as is?)

@Julian-O Sorry for the confusion.  The custom_title_bar capability does not work.  The example matches the documentation.

On Windows 10 Pro and on Ubuntu (WSL2) everything works as it should. This bug is specific to Windows 11 and does not depend on the build version.

I'm using Windows 10 Home and have a similar problem when the display settings layout is not 100%.
Also, the problem does not occur if you set kivy==2.1.0 ( kivy_deps.sdl2==0.4.5 ).

@t-motomoto, you are right!
Everything is fine if 100% scaling is set. If the value is higher a bug occurs. Reproduced on Windows 10 (Pro) and Windows 11 (Home).
Also 2.1.0 is last version without bug.

I had a similar problem.
On Windows versions larger than 2.1.0, the display is corrupted when the display scaling is other than 100%.
This is probably the cause.
I have not modified the code to confirm this, as it seems to be a cython code.
https://github.com/kivy/kivy/blob/aeb27bbbcfa2d118da95d42c89237cfc19c69c53/kivy/core/window/_window_sdl2.pyx#L217-L218
SetProcessDpiAwareness seems to be called when SDL_HINT_WINDOWS_DPI_SCALING is set.
The workaround for this problem is to call SetProcessDpiAwareness(0) at the beginning of the main script.
import ctypes
SetProcessDpiAwareness(0)

SetProcessDpiAwareness can only be called once in a process.
So by calling it first, you can ignore the settings on the SDL side.
https://learn.microsoft.com/en-us/windows/win32/api/shellscalingapi/nf-shellscalingapi-setprocessdpiawareness
It might be nice to have an option to set SDL_HINT_WINDOWS_DPI_SCALING or not, although it is unclear what other modifications would be desirable since the scope of other effects is unknown.


Use rdkit Chemical Features

Cannot use the Chemical Features of rdkit
>>> from rdkit import Chem
>>> from rdkit.Chem import ChemicalFeatures
>>> from rdkit import RDConfig
>>> import os
>>> fdefName = os.path.join(RDConfig.RDDataDir,'BaseFeatures.fdef')
>>> factory = ChemicalFeatures.BuildFeatureFactory(fdefName)

Gives the error OSError: File: /tmp/pip-req-build-w2hdrjg9/build/temp.linux-x86_64-3.7/rdkit_install/share/RDKit/Data/BaseFeatures.fdef could not be opened

That should work now in https://pypi.org/project/rdkit-pypi/2<IP_ADDRESS>/.
Please update the packages pip install rdkit-pypi --upgrade


Add more bruteforced implications

This change introduces some more simple bruteforced implications. By my calculation, this change increases the transitive closure size from 4.5m to 4.75m.

Can you update the top-level README.md to report these improvements?  Also if you can update the blueprint to report on methodology and results that would also be great.

Can you update the top-level README.md to report these improvements? Also if you can update the blueprint to report on methodology and results that would also be great.

Done! Thanks for the reminder on the blueprint.

I think I may have caused a conflict with README.md by moving some stuff around.  Could you align your commit with the new version, then this PR can be merged.

Done.

Good god, what in git rebase did I do to this branch.


KSampler error (like everyone else)

Installed LayerDiffuse in custom node (like what was recommended), but still getting this error:
KSampler:
Given groups=1, weight of size [320, 12, 3, 3], expected input[2, 8, 96, 64] to have 12 channels, but got 8 channels instead
How do i fix this?

It seems I'm only getting this error when I run sd15_fbc_unet on the load diffusion model. Running fc_unet seems fine...

Error occurred when executing KSampler:
Given groups=1, weight of size [320, 4, 3, 3], expected input[2, 8, 64, 64] to have 4 channels, but got 8 channels instead
工作流是作者提供的，layerdiffuse已经安装，模型和节点也是按照作者的工作流设定的，仍然提示错误！

使用的是 fc_unet模型

This has been fixed, update comfy ui and the node extension to the latest version.
@huchenlei Thanks a lot.

Btw this has been fixed after a ComfyUI update.


perf(p2p): Make ingesting packets not block on channel unmarshal or channel receive logic

Handles a significant part of #3199
This separates out the entire left hand side of into its own goroutine that won't block further reading:

That is unblocking us from reading/ingesting packets 73% of the CPU time on a very light period of Osmosis traffic, and likely far more real-time as much of this is mutex blocked! (Separate PR's will improve I/O usage, and other non-I/O terms)
We guarantee that every channel receives packets in-order from a peer.
Furthermore this will allow concurrency across channels for getting their own packets unmarshalled and sent to respective reactors. (Meaning a mempool tx gossip will now not block on a consensus packet receive, unless the per-channel unmarshal/recv buffer is full. Right now its parameterized to be low, but @evan-forbes has a PR that composes with this, for adding a buffer into every reactor, that should fix this from being remotely likely)
To me, I think the main questions for this PR being merged are:

Are we fine w/ my API change of: mconn._recover to mconn.PanicRecover (publicly exporting it)? I do like where I ended up putting the panic recover.
Is it fine to put "setup channels fn" as a field element in peer?
Do we want any new behavior tested? I'll test this on mainnet osmosis. Due to matching the panic recovery path the old code, I don't think theres concern over that being handled differently.
Any other tests we think are missing? Nothing comes to mind

I'll get this tested on mainnet osmosis soon, to help build confidence :)

PR checklist

[ ] Tests written/updated - Some of the behavior here appears to never have been tested, so I we could introduce a test for sending an undecodable packet on a channel that does exist.
[ ] Changelog entry added in .changelog (we use unclog to manage our changelog)
[x] Updated relevant documentation (docs/ or spec/) and code comments
[x] Title follows the Conventional Commits spec

I could definitely be missing something, but it looks like we are breaking the previous guarantee where messages are processed in the order that they were sent by the peer. In most cases, I don't think this should have any effect. There could be some weird difficult to debug edge cases however.

We aren't breaking this guarantee within a channel. We are only potentially breaking this guarantee across channels. Though your right this could cause complicated edge cases -- You may receive a vote for a block before the proposal msg, even though the peer sent both.
Thats a good point though, maybe we should do this per-reactor.

one slight modification that could be interesting would be to combine it with the previous attempt, so instead of only passing the envelopes in a buffer, we stick the msgBytes in the buffer.

I think thats an amazing idea. If we want to do this without breaking changes so we can ship faster, maybe the move is:

Change my code to one thread per reactor
Do logic where "If reactor supports async receive bytes, use that. Else do whats in this PR"

That way we can ship with no breakage, and always get the guarantee we need?


Add back path for grub.cfg on Debian OS.

This was removed in e773a9a02d2a8d0cdecee658ba9b58d346f0b3bb
without any mentioning in the commit message.

Coverage decreased (-0.05%) to 95.349% when pulling 2ffa17384e637f9377276ec497dfb2dab0f698c1 on unibonn:fix-grub2-config-path into e773a9a02d2a8d0cdecee658ba9b58d346f0b3bb on hercules-team:master.

Coverage decreased (-0.05%) to 95.349% when pulling 2ffa17384e637f9377276ec497dfb2dab0f698c1 on unibonn:fix-grub2-config-path into e773a9a02d2a8d0cdecee658ba9b58d346f0b3bb on hercules-team:master.


Allow select a range of datepicker

In the new topic, we are implementing. It has an awesome feature of flatpickr is a select range date.
I think we need to support it.
https://flatpickr.js.org/examples/#range-calendar

Please create a new story that includes the range version of the date picker

Hi Is there something else I can improve here?

Please create a new story that includes the range version of the date picker

Hi Is there something else I can improve here?

Would be great if the component makes use of the design tokens. You could talk to @fabianhueske about further questions.

Please create a new story that includes the range version of the date picker

Hi Is there something else I can improve here?

Would be great if the component makes use of the design tokens. You could talk to @fabianhueske about further questions.

Ok, it takes time to apply the new style. I'm working on it

Please create a new story that includes the range version of the date picker

Hi Is there something else I can improve here?

Would be great if the component makes use of the design tokens. You could talk to @fabianhueske about further questions.

Ok, it takes time to apply the new style. I'm working on it

Hi @Haberkamp , storybook test is failing. Because it does not match with the snapshot. Do you know any way to generate a snapshot to pass the test?

Hi @Haberkamp , Could you help me check the pipeline here? The test is passed in the local but I don't know why it's failed here 😭

Please create a new story that includes the range version of the date picker

Hi Is there something else I can improve here?

Would be great if the component makes use of the design tokens. You could talk to @fabianhueske about further questions.

Ok, it takes time to apply the new style. I'm working on it

Hi @Haberkamp, Please help me check it


chore(deps): update module github.com/terraform-ibm-modules/ibmcloud-terratest-wrapper to v1.2.1

This PR contains the following updates:

Package
Type
Update
Change

github.com/terraform-ibm-modules/ibmcloud-terratest-wrapper
require
patch
v1.2.0 -> v1.2.1

Release Notes

terraform-ibm-modules/ibmcloud-terratest-wrapper
v1.2.1
Compare Source
Bug Fixes

deps: update gomod (#157) (0baa3b2)

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, click this checkbox.

This PR has been generated by Renovate Bot.

:tada: This PR is included in version 1.0.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


daily note template with utf8 encoding support

Thanks for working on this! I'll take a look next week.

Thanks for working on this! I'll take a look next week.

remind

bump @hauselin

I’m not sure if it’s compatible with the latest version of Obsidian, so I’m going to close the current PR.

I’m not sure if it’s compatible with the latest version of Obsidian, so I’m going to close the current PR.


Redirect Away Challenge bypassed

This works on both chrome and Firefox, however Firefox will not display the alert and chrome will
https://weizmangal.com/redirect-away-challenge/?js=location='javascript:location="http://example.com";alert(1)'
This shorter version seems to only work on chrome:
https://weizmangal.com/redirect-away-challenge/?js=location='javascript:location="http://example.com";'

Actually I made it even more complex than it's supposed to be.
https://weizmangal.com/redirect-away-challenge/?js=location="http://example.com";alert(1)
and this will only work on chrome:
https://weizmangal.com/redirect-away-challenge/?js=location="http://example.com";
This seems a bit too simple so maybe I missed something...

Actually, it seems that I missed something!
So my trick of using the "js" param makes more naive ways work for some reason (meaning the demo fails).
That's my bad.
Your solution will be accepted if it works by running it from devtools (after dom finished loading).
try again!

The top example still works in devtools actually. Replace the alert(1) with alert(location)
location="http://example.com";alert(location)


Random symbols appended to Cell Set Labels

Describe the bug
Just a minor issue. (This may be a Zarr issue rather than a Vitessce issue in which case I apologize for posting here.) When going from zarr to vitessce embedding, it seems like random symbols (#, !, ") are sometimes appended to our cell set labels, even though the metadata columns in the h5ad file from which the zarr was derived had no such symbols.
To Reproduce
If you want to take a look, I have uploaded the h5ad file and zarr directory to ftp://ftp.nygenome.org/hubmap/vitessce_ref.zarr and ftp://ftp.nygenome.org/hubmap/vitessce_ref.h5ad.
But if you don't have the bandwidth to take a deep dive, any debugging advice would be appreciated.
Screenshots
Here you can see an exclamation point was appended to 'Thymus-Thymocytes'

Environment:

Release or git hash:
Browser: Safari
Browser version: 12.1

It's probably a string parsing issue.  Going from python -> zarr -> javascript can be a bit hairy and we've had some issues in the past...thought we had got it right though.  We'll take a look.

Resolved by #957


Default the total population to 100k and positivity to 10%

Ref #1826

Due to #1828, retargeting to main.

LGTM. Looks like this only has an effect if the user doesn't have a stored value, which is fine.


Add Cordova Ubuntu 4.3.3 blog post

Blog post to announce cordova-ubuntu 4.3.3

Should this PR be closed ?

Yeah, probably. I'll redo an announcement for 4.3.4


ARROW-17190: [C++] Create a Fetch Node

This PR includes an initial version of the Fetch node. The objective of the PR is explained in detail here.
Includes the following:
Ability Fetch records with an offset and a limit with or without sorting.
Fetch without sort just fetches the top records received at the Fetch node after collecting all records in memory. This is a sub-optimial solution and requires more optimization and recorded the requirement here.

@westonpace Re: https://github.com/apache/arrow/pull/13700#discussion_r956123416
I think this should probably go for a JIRA and list the possible changes. Later on, child tasks can be added.
WDYT?

I think this should probably go for a JIRA and list the possible changes. Later on, child tasks can be added.
WDYT?

Yes, we should have a JIRA for an order-aware non-sink fetch node.  Once that is created we can drop the other nodes as part of that JIRA.

order-aware non-sink fetch node. Once

Created the JIRA here: https://issues.apache.org/jira/browse/ARROW-17622

@westonpace @nealrichardson I have updated the PR. Is it good to go? Or any moficiations required?

@westonpace @nealrichardson I have updated the PR. Is it good to go? Or any moficiations required?

Up to @westonpace. I won't know if there are shortcomings in this until someone adds R bindings.

Closing this PR in favor of a new proposal for Fetch Node. cc @westonpace


[fix](tablet sched) disable disk balance for single replica #29576

cherry pick from #29576

run buildall


🧑💻: google translator

It will change the language of whole website as we know in India even in world there are many language and our user can be from any place and some user doesn't understand english so it will be better if we provide them the content of our website in there native language

Please assign me i can work on this Default is english but user has a button on clicking he get option of language and we could select form that

It's not of informative website, just a resources website.


[suggestion] perk selection history/order (+ mountain discovery)

Hi,
I have a suggestion which might be too complicated or just not complicated but way too much work
so I don't really realize if it's something that someone may want to work on....
The issue that made me think of this :
-As you play & use this tool, inevitably some perks will differ from what noita seed tool tells you
for example : if you have "Extra perk" that you took in the east
and then go to the west, the tool ignores whatever happened in the east
-Additionally some perks once taken will be skipped from being spawned again resulting in a shift of perks selection by 1 more
my idea is that :
the user gets a new : "perk selection/history bar"
where perks go exactly as they were selected
so for example :
if you take East 2 Temple 4 "Extra Perk" then it goes in this "history bar" & stays there
and will be taken into account that extra perk if you go to west 1 temple 1 afterward
however if the player selects a perk from west 1 temple 1 first (it goes in this "history bar")
then the player take East 2 Temple 4 "Extra Perk"  goes in the history bar in slot number 2
tool assumes west 1 temple 1 was discovered first, hence it doesn't get "Extra Perk"
but going forward to west 1 temple 2 it'll add the "extra perk"

This is a awesome suggestion. I've been thinking about this too for a while now.
A history of things that the player does in the right order is the only way to make the tool always accurate.
Currently, it is assumed you always pick perks from the very left/west side of the world (which is probably wrong more often than it is correct), and from the first level to the last.
I would imagine a list of actions that the player has done (like you said, a history-bar), that would be automatically filled
whenever the player clicks on a perk and could be rearranged via drag n' drop.


Issues - Discussion

Issues I have seen in the App

Creating a new account takes too much time & same for login
Password eye toggle icon is not working

I am open to discuss to improve this app

As I paused database monogo db app , that why it was not working,I have now resumed mongo db app,so now app its working fine.And you will able to create and login into account.
For password toggle ,on click functionlity is not implemented.

Okay, I got it can you please merge my PR? I have removed the deprecated widgets from the app and we can work further on this


gcalbot: fix oauth expiry

Lgtm
On Tue, Feb 18, 2020 at 18:11 marceloneil<EMAIL_ADDRESS>wrote:

Merged #164 https://github.com/keybase/managed-bots/pull/164 into
master.
—
You are receiving this because your review was requested.
Reply to this email directly, view it on GitHub
https://github.com/keybase/managed-bots/pull/164?email_source=notifications&email_token=AAIXJVCKCTF7QHGGU2CHEHDRDRTJZA5CNFSM4KXOHJL2YY3PNVWWK3TUL52HS4DFWZEXG43VMVCXMZLOORHG65DJMZUWGYLUNFXW5KTDN5WW2ZLOORPWSZGOWXAS2UA#event-3049336144,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAIXJVBRPARR4K32IW7DBFLRDRTJZANCNFSM4KXOHJLQ
.


Look into publishing with cargo-bundle

https://crates.io/crates/cargo-bundle
Maybe this will help with the horrible macOS build pipeline?

Marking as wontfix to wait until after Bevy Jam 5.


Improve LLamaEmbedder

Description
The LLamaEmbedder at the moment does not expose all of the embedding capabilities of llama.cpp.
Currently:

It only returns 1 single vector as a float[]
Some models return a single vector which represents the entire input sequence (embeddings models) and some produce an embedding vector per token (generative models).
Pooling mode can be set with some models which sets a method for converting lots of embeddings into one embedding. Probably only compatible with some models?

Improvements:

Indicate which type of model an embedder was created with.
Indicate how many results there are.
Use llama_get_embeddings, llama_get_embeddings_ith and llama_get_embeddings_seq as appropriate to get the correct embeddings.

Random things to consider in no particular order:

What should be returned? float[][] or a Span<float>?
When tokens are added to the batch, should the logits flag be set for all tokens, none of the tokens, or just the last token?

Does this change with different models (generative vs embedding vs generative with pooling)?

Should returned embeddings always be normalized?

@Lyrcaxis Some notes on LLamaEmbedder improvements, as discussed in Discord.

See #902 for a start on some of this.


fix: enforce buffer type on data passed to serializer

The NATS client library can either return a Buffer or a Uint8Array (which Buffer extends). However, the
serializer only expects to work with a Buffer. If passed a Uint8Array the deserialize function will fail.

@icebob this is the first moleculer-channels PR I've put in. Can you let me know if it needs more documentation or testing? I wasn't totally sure what to include here.

Locally we were running traffic through the JetStream queue. I'm honestly not sure how the nats package decides if it will return a Buffer or a Uint8Array. I could try calling the function with Buffer and Uint8Array and see if it throws in either case.

Hey @icebob, I just wanted to ask if there's anything else needed from me to move this forward.

No, sorry it's waiting for me to test it in my env.

I've just checked your PR with benchmark. It looks the isBuffer is an expensive method. If I skip it and use always Buffer.from is faster, so I changed your code a little bit.
Original code in PR:

My modified code (+7%):

Released in 0.1.5


Demo app moves to different namespace

Change kubeadm instructions to show use of sock-shop namespace rather than default.
Background: the demo installs a DefaultDeny network policy annotation, which is tripping up some users who go on to create some more pods without removing the annotation.  This change matches https://github.com/microservices-demo/microservices-demo/pull/339 which moves the whole demo out of the default namespace.
This change should not be merged until the microservices-demo change is merged.
CC @errordeveloper

This change is

I signed a CNCF CLA as<EMAIL_ADDRESS>The upstream change to the demo app is now merged so would be good to get this through.

LGTM
@luxas PTAL

LGTM


BanglExercise

BanglExercise
Can automatically track exercises while wearing the Bangle.js watch.
Currently only push ups and curls are supported.
Disclaimer
This app is experimental but it seems to work quiet reliable for me.
It could be and is likely that the threshold values for detecting exercises do not work for everyone.
Therefore it would be great if we could improve this app together :-)
Usage
Select the exercise type you want to practice and go for it!
Press stop to end your exercise.
Screenshots

Great! I guess star jumps should be pretty doable as well.


Merge smartcontractkit curve updates

Merge : https://github.com/smartcontractkit/caigo/pull/8

Still needs to assess if this makes sense. Needs discussion.


Updates default https_ssl_policy to ELBSecurityPolicy-TLS13-1-2-2021-06

what

Updates default https_ssl_policy to ELBSecurityPolicy-TLS13-1-2-2021-06

why

ELBSecurityPolicy-TLS13-1-2-2021-06 is the default AWS recommendation.

The ELBSecurityPolicy-TLS13-1-2-2021-06 policy is the default security policy for TLS listeners created using the AWS Management Console.
- We recommend the ELBSecurityPolicy-TLS13-1-2-2021-06 security policy, which includes TLS 1.3, and is backwards compatible with TLS 1.2.

references

closes #178
https://docs.aws.amazon.com/elasticloadbalancing/latest/network/create-tls-listener.html#describe-ssl-policies

/terratest

I added the link https://docs.aws.amazon.com/elasticloadbalancing/latest/network/create-tls-listener.html#describe-ssl-policies and the quote to the pr body
Seems reasonable

/terratest

/terratest


Is flow currently beneficial to this project?

My exposure to flow is still fairly new (this project being the only exposure I have). As I was attempting to wire up my IDE, I realized that not all of the files within the react-sketchapp utilize flow.
I attempted to add the flow flag to the top of types.js and was greeted with 146 errors. Coupled with the fact that recent updates have mostly skirted around flow by repeatedly using the any type, I wonder how much use we are actually getting out of flow.
Broad question,  is flow beneficial to us as it is currently being used, or is it a burden?
cc @ljharb @mathieudutour

Sounds good @ljharb. I'll create a new issue to clean up the flow types. From my initial investigation, it looked like it may be substantial work to get everything back in a good place. I'm a little skeptical that anyone will want to put in the time, but hopefully I will be surprised 😊
Thanks for your input.
Do you think this issue should stay open and revisited if we don't see any movement on cleaning up the flow types, or shall I close it now?

I think it's worth keeping it open

Hey @jaridmargolin, although I don't have experience with Flow, I would definitely be willing to learn about it and help out in this matter if you're still looking for help. Would need a bit of guidance on where to start and stuff though as I'm completely new to this particular project. Is there an issue or something where I can see the current progress?

@Keraito all help is greatly appreciated. I created the issue #341 to track progress. As far as getting started, the flow documentation does a pretty good job introducing the core concepts.

Thanks! Will read up on all the stuff and try to help asap!


⚠ AGEG website (prod) has degraded performance

In e06f527, AGEG website (prod) (https://www.ageg.ca/) experienced degraded performance:

HTTP code: 200
Response time: 3731 ms

Resolved: AGEG website (prod) performance has improved in 78b5cf8.


API to get status of consumption of a table

https://github.com/apache/incubator-pinot/issues/6308
API to get status of consumption of a table. This includes 1. consumer status 2. partition to offsets map 3. server name, for consuming segments across all servers.
NOTE: Adding tests is pending.
API on the server returns status for all consumers found in the tableDataManager.
curl -i -X GET "http://localhost:8097/tables/transcript/consumingSegmentsInfo"

[{"segmentName":"transcript__1__2__20201204T2044Z","consumerState":"CONSUMING","partitionToOffset":{"1":"6"}},
{"segmentName":"transcript__0__14__20201204T1943Z","consumerState":"CONSUMING","partitionToOffset":{"0":"31"}}]

API on the controller calls the servers to get consumer info. It returns a map of segment name to consumption information for all servers
curl -i -X GET "http://localhost:9000/tables/transcript/consumingSegmentsInfo"

{
  "_segmentToConsumingInfoMap": {
    "transcript__0__14__20201204T1943Z": [
      {  "_serverName": "Server_<IP_ADDRESS>_8098", "_consumerState": "CONSUMING", "_partitionToOffset": {"0": "31"} }
    ],
    "transcript__1__2__20201204T2044Z": [
      { "_serverName": "Server_<IP_ADDRESS>_8098", "_consumerState": "CONSUMING", "_partitionToOffset": {"1": "6"} }
    ]
  }
}

Some manual testing:

Segment build failed. Consumer went into ERROR state. But IS, EV and segment metadata looks all good.

curl -i -X GET "http://localhost:9000/tables/transcript/consumingSegmentsInfo"

{
  "_segmentToConsumingInfoMap": {
    "transcript__0__14__20201204T1943Z": [
      { "_serverName": "Server_<IP_ADDRESS>_8098", "_consumerState": "CONSUMING", "_partitionToOffset": {"0": "31"}}
    ],
    "transcript__1__1__20201204T1935Z": [
      { "_serverName": "Server_<IP_ADDRESS>_8098", "_consumerState": "NOT_CONSUMING", "_partitionToOffset": {"1": "5"} }
    ]
  }
}

Exception in OFFLINE to CONSUMING state transition. Consumer never created. But IS and segment metadata looks all good. EV in ERROR state.

curl -i -X GET "http://localhost:9000/tables/transcript/consumingSegmentsInfo"

{
  "_segmentToConsumingInfoMap": {
    "transcript__0__14__20201204T1943Z": [
      { "_serverName": "Server_<IP_ADDRESS>_8098", "_consumerState": "CONSUMING", "_partitionToOffset": {"0": "31"}}
    ],
    "transcript__1__1__20201204T1935Z": [ ]
  }
}

Codecov Report

Merging #6322 (e70617e) into master (1beaab5) will decrease coverage by 1.22%.
The diff coverage is 45.12%.

@@            Coverage Diff             @@
##           master    #6322      +/-   ##
==========================================
- Coverage   66.44%   65.22%   -1.23%
==========================================
  Files        1075     1283     +208
  Lines       54773    61908    +7135
  Branches     8168     8993     +825
==========================================
+ Hits        36396    40381    +3985
- Misses      15700    18640    +2940
- Partials     2677     2887     +210

Flag
Coverage Δ

unittests
65.22% <45.12%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

...e/pinot/broker/api/resources/PinotBrokerDebug.java
0.00% <0.00%> (-79.32%)
:arrow_down:

...ot/broker/broker/AllowAllAccessControlFactory.java
71.42% <ø> (-28.58%)
:arrow_down:

.../helix/BrokerUserDefinedMessageHandlerFactory.java
33.96% <0.00%> (-32.71%)
:arrow_down:

...ker/routing/instanceselector/InstanceSelector.java
100.00% <ø> (ø)

...ava/org/apache/pinot/client/AbstractResultSet.java
66.66% <0.00%> (+9.52%)
:arrow_up:

.../main/java/org/apache/pinot/client/Connection.java
35.55% <0.00%> (-13.29%)
:arrow_down:

...inot/client/JsonAsyncHttpPinotClientTransport.java
10.90% <0.00%> (-51.10%)
:arrow_down:

...not/common/assignment/InstancePartitionsUtils.java
73.80% <ø> (+0.63%)
:arrow_up:

.../apache/pinot/common/exception/QueryException.java
90.27% <ø> (+5.55%)
:arrow_up:

...pinot/common/function/AggregationFunctionType.java
98.27% <ø> (-1.73%)
:arrow_down:

... and 1130 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 33e7ec8...e70617e. Read the comment docs.

Is the _consumerState a string or a well-defined set of values? If we are building an API, should we consider putting in a well-defined set of values in there, so that we can build (say) a management platform?
Also, is a map for the output better (instead of an array):
{
"testTable__0__1__20201204T2030Z" : {
  "idealstate" : "CONSUMING",
  "externalView" : "ERROR",
  "maxOffsetConsumed" : "somevalueComparable",
  "consumerState" : "CONSUMING" // Can be one of CONSUMING, CATCHING_UP,  BUILDING_SEGMENT, etc..(TBD)
},
"testTable__0__2__whatever" : {
},
.
.
}

Is the _consumerState a string or a well-defined set of values? If we are building an API, should we consider putting in a well-defined set of values in there, so that we can build (say) a management platform?
Also, is a map for the output better (instead of an array):
{
"testTable__0__1__20201204T2030Z" : {
  "idealstate" : "CONSUMING",
  "externalView" : "ERROR",
  "maxOffsetConsumed" : "somevalueComparable",
  "consumerState" : "CONSUMING" // Can be one of CONSUMING, CATCHING_UP,  BUILDING_SEGMENT, etc..(TBD)
},
"testTable__0__2__whatever" : {
},
.
.
}

It is a well defined set of values, containing CONSUMING and NOT_CONSUMING for now. The controller API's output is a Map. For each segment there's an array of map, to return info per replica.