Chunking for large content

Currently, chunking assumes that the whole message fits in memory. When dealing with large content (hundreds of MB), this model is limited.
This issue starts the discussion how support could be provided for dealing with large chunked messages in a streamed fashion.

It would theoretically be possible to provide the binary content as a stream. The most natural API I guess it would be to have a version of the BinaryFileMessage that declares the content as a Stream instead of a simple byte array.
Producing via a stream would be trivial: just read the stream till the desired chunk size, produce the message, repeat until the end of stream.
Consuming on the other hand might be a bit more tricky: I imagine that a BinaryStreamMessage would be published to the internal bus as soon as the first chunk in being received and then the further chunks are just being pushed to the open stream. (It sounds simple but for sure it isn't so trivial.)
(How to properly implement the stream, in an optimal way and of course avoiding to have the whole file being held in memory at any given time....well, that's an implementation detail.)

Yes, consuming is the tricky part. In any case, the existing support for chunking is not really helpful for a streaming solution.
For consuming, the challenge is to transform the flow of messages pushed by the poll loop into a flow of pulled messages (IEnumerable in the general case, Stream in the binary chunk case).
And we need back pressure if we don't read the Stream as fast as the messages are produced. If everything runs sync, we just introduce a blocking queue in the middle. I have not yet understood the threading model between the Kafka Consumer and the "internal bus". What happens if my business consumer blocks the thread in OnMessage(...)? Does it also block the poll loop of the consumer? Is it problem?

Here is what I envision:

A new module Silverback.Integration.Sequence providing dataset and streamed chunking. The goal is to have a minimum impact to the rest of the codebase.
Providing a message type Sequence<T>
Support enabled with something like .AddSequenceSupport<T>() to the configuration.
This creates a new subscriber for T, a SequenceItemSubscriber<T>
Upon receiving the first item of a sequence, it will publish a sequence message backed with a BlockingCollection of size 1 and will write the sequence items into this blocking collection. The sequence message is of type Sequence<T> which contains the sequence id and an IEnumerable<T>
Consumers can subscribe to Sequence<T> as they would subscribe to other message types.
When T is byte[], then an additional internal subscriber is created. It listens to Sequence<byte[]> and publishes BinarySequence which contains the sequence id and a Stream backed by the blocking collection.

I have two questions at this point:

Can we control when commits happen? The goal is to commit offsets at the end of the sequence, not for each item. Should we make a change to the core for that?
How can we have a more specific subscriptions? If I want to route according to other criterias than the type (e.g. the topic or some header) how can I do that?

Mmmh...I see it a bit differently at the moment but I really need to think thoroughly about it.

A new module Silverback.Integration.Sequence providing dataset and streamed chunking. The goal is to have a minimum impact to the rest of the codebase.

I don't think that's a good idea. Batches and chunking are already supported in Silverback.Integration and they need to be extended with (or replaced by) the new features.

Providing a message type Sequence<T>

I do like the Sequence<TMessage> idea. 👍

Support enabled with something like .AddSequenceSupport<T>() to the configuration.

I don't know. Right now the configuration is made per inbound/outbound connector and I think it should remain in there. It is more related to the topic being produced to or consumed from, than the message type. I fear it would create some weird edge cases if we configure at message type level but we either have the same message type used in different topics or multiple message types in the same topic.
I do think the configuration should still be in the IEndpoint (/IProducerEndpoint /IConsumerEndpoint). Like the serialization settings and of course the current ChunkSettings (the BatchSettings are also to be moved into the endpoint in v3.0).

This creates a new subscriber for T, a SequenceItemSubscriber<T>
Upon receiving the first item of a sequence, it will publish a sequence message backed with a BlockingCollection of size 1 and will write the sequence items into this blocking collection. The sequence message is of type Sequence<T> which contains the sequence id and an IEnumerable<T>
Consumers can subscribe to Sequence<T> as they would subscribe to other message types.
When T is byte[], then an additional internal subscriber is created. It listens to Sequence<byte[]> and publishes BinarySequence which contains the sequence id and a Stream backed by the blocking collection.

I do like the Sequence<TMessage> idea and leveraging the BlockingCollection to handle the back pressure.
I think it should be handled with the broker behaviors though, like the rest of the features (and the current chunking/batching implementation).

I have two questions at this point:

Can we control when commits happen? The goal is to commit offsets at the end of the sequence, not for each item. Should we make a change to the core for that?

In the IConsumerBehavior you can already control it. I've to admit that it isn't the piece of code I'm most proud of, as the implementation is not the cleanest ever, but it does it's job.
See https://github.com/BEagle1984/silverback/blob/master/src/Silverback.Integration/Messaging/LargeMessages/ChunkAggregatorConsumerBehavior.cs#L71.

How can we have a more specific subscriptions? If I want to route according to other criterias than the type (e.g. the topic or some header) how can I do that?

If you mean in the internal bus you got basically two options:

Subscribe to the IInboundEnvelope<TMessage> (that contains all the headers and endpoint details, as well as the message) and manually discard the messages (if (envelope....!= whatever) return;.
Create your custom MessageFilterAttribute. This is not a documented featured but it is what I used to implement the KafkaGroupIdFilterAttribute.

I don't think so but if you maybe mean how to route the outbound messages: https://beagle1984.github.io/silverback/docs/configuration/outbound#dynamic-custom-routing

@lbovet take all this with a grain of salt please. I need some time to look into the code and maybe mess around with a prototype to figure out how all this combines with the existing features.

Amazing, I just noticed that yesterday I had replied to the message here below, but I forgot to actually post it. Here it is.

Yes, consuming is the tricky part. In any case, the existing support for chunking is not really helpful for a streaming solution.
For consuming, the challenge is to transform the flow of messages pushed by the poll loop into a flow of pulled messages (IEnumerable in the general case, Stream in the binary chunk case).
And we need back pressure if we don't read the Stream as fast as the messages are produced. If everything runs sync, we just introduce a blocking queue in the middle. I have not yet understood the threading model between the Kafka Consumer and the "internal bus". What happens if my business consumer blocks the thread in OnMessage(...)? Does it also block the poll loop of the consumer? Is it problem?

Yes, at the moment it is just all synchronous. The poll loop is blocked until all subscribers have processed the message.
I don't think it is currently a problem but you gotta be careful with the max poll interval settings.
I thought a lot about this but I decided for the simplest flow possible: poll -> invoke subscribers -> commit (if no exception) -> poll  to consume next message. For chunked messages it is actually a bit different: poll -> store chunk -> poll -> store chunk -> ... -> poll -> aggregate message -> invoke subscribers -> commit -> poll again (and similar for the batch of messages being processed as an IEnumerable).
Of course this has to change to properly support streaming and the subscribers have to be called from a separate thread, without blocking the poll loop.
🤔
Interesting!
I will have a look at it and maybe try to build up a prototype.

Some extra thoughts...
One thing that may be tricky is to properly handle polymorphism, since Silverback is meant to allow messages of different types being trasferred through the same topic and it fully supports polymorphism in the subscribers. It means that you could fpor example subscribe to an IEnumerable<TMessage> , where TMessage is a specific type and Silverback filters the incoming messages batch and forwards to the method only the messages that are assignable to the type TMessage.
Another thing is that the enumerables tend to be materialized as soon as possible, to prevent multiple enumerations. Of course this has to change and we gotta be careful with that.

Okay, the discussion about having it implemented in Silverback.Integration or another module is interesting. If we do so, I expect that the existing "in memory chunk aggregation" would be actually re-implemented using the underlying "streamed chunking" stuff that we are defining now. This would be one of the pros. My proposal to have it outside had the idea to make the boundary clear and avoid cluttering the existing stuff (an approach I often have with contributions). It's basically aour choice to consider sequences and chunking a "core feature", and thus have them in the Integration module.
1b) I wonder if all this raises the question of the current chunking suppotr. Is it actually useful to provide the pluggable chunkstore if the whole things is at the end be kept in memory? Don't you think that this chunking support will probably be changed and actually a breaking change?
Right, it is very ok to have the sequence at the connector/endpoint level.
I'll have a look how we can replace my proposal of "internal subscribers" with behaviors.

Q1) Good, we can manipulate the offsets to commit in the context. That's a good point. It is actually an argument to use behaviors since they have access to the context (and not the subscribers, right?).
Q2) This is a nice secret feature!

Okay, the discussion about having it implemented in Silverback.Integration or another module is interesting. If we do so, I expect that the existing "in memory chunk aggregation" would be actually re-implemented using the underlying "streamed chunking" stuff that we are defining now. This would be one of the pros. My proposal to have it outside had the idea to make the boundary clear and avoid cluttering the existing stuff (an approach I often have with contributions). It's basically aour choice to consider sequences and chunking a "core feature", and thus have them in the Integration module.

Yes, the existing chunking feature has to be rewritten, based on the new one. It basically all boils down to buffering until the entire message is aggregated.
Anyhow, I decided to cut the modules (nuget packages) according to the dependencies more than anything else. Since this stuff doesn't depend on anything I'd keep it into Silverback.Integration. For simplicity, to avoid the users being confused by a ton of packages. Right now you basically just need to reference Silverback.Integration.Kafka and you get all the features you normally need (since it references Silverback.Integration that in turns references Silverback.Core), unless you use Avro.

1b) I wonder if all this raises the question of the current chunking suppotr. Is it actually useful to provide the pluggable chunkstore if the whole things is at the end be kept in memory? Don't you think that this chunking support will probably be changed and actually a breaking change?

I've no problem with introducing a breaking change at this point, where I'm just a bout to release a major version. So the timing would be just perfect.
That being said the chunk store is meant to allow for another temporary storage (DB, S3, whatever). I guess that if you deal with very big files or if the chunks are for whatever reason spread across multiple partitions, then the intermediate storage gives you a better flexibility, even though it's imo not a best practice.

Right, it is very ok to have the sequence at the connector/endpoint level.
I'll have a look how we can replace my proposal of "internal subscribers" with behaviors.

👍

Q1) Good, we can manipulate the offsets to commit in the context. That's a good point. It is actually an argument to use behaviors since they have access to the context (and not the subscribers, right?).

Yes, right. For simplicity the message broker details are hidden to the subscribers.

Q2) This is a nice secret feature!

😆

About the chunk store and the current chunking implementation, you can deal with very big files and store your chunks in the S3 chunkstore while you receive them. But once you have received all chunks, you rebuild the whole message in memory to send it to the internal bus. That means that you allocate everything.
Maybe the chunkstore configuration should have a way to choose if the actual message has to be rebuilt or if another type must be sent (e.g. the URL of the S3 bucket), let to the implementation of the chunkstore.
This can be a convergence with the Sequence or BinarySequence concept since are all just "views" on the whole sequence like the URL is. We have individual message as input, a behavior transforming it in the middle, and the "sequence view" as output.

About the chunk store and the current chunking implementation, you can deal with very big files and store your chunks in the S3 chunkstore while you receive them. But once you have received all chunks, you rebuild the whole message in memory to send it to the internal bus. That means that you allocate everything.

Yes, I should give it back as stream. But the intermediate store gives you the chance to not restart from the beginning if you restart your client app. Maybe I'm just overthinking it.
The intermediate store also allows to handle the case where all the chunks aren't in the same partition, are interleaved with other messages or a rebalance occurs. But sure, this is also something we need to rethink now.

Maybe the chunkstore configuration should have a way to choose if the actual message has to be rebuilt or if another type must be sent (e.g. the URL of the S3 bucket), let to the implementation of the chunkstore.
This can be a convergence with the Sequence or BinarySequence concept since are all just "views" on the whole sequence like the URL is. We have individual message as input, a behavior transforming it in the middle, and the "sequence view" as output.

This is maybe a step too much for this library. I mean, Silverback will provide the stream, while the client can store it wherever he wants (file system, s3, blob storage, db, ...).

A quick update, I thought a bit about the possible design and there are some first random thoughts and rough ideas:

The consumer (pipeline) should now return an enumerable (MessageEnumerable) that will pull from an internal BlockingCollection (to handle the back pressure).
The consumer (pipeline) appends the next messages to the same MessageEnumerable.
Some behaviors will be added to the pipeline to handle the sequencing. That simply means to create and publish a new MessageEnumerable and/or end the previous one(s). Yes, I'd consider the possibility to allow multiple ones to be active at the same time (e.g. for the case where you have multiple producers and the chunks may be interleaved). An abstract SequenceConsumerBehavior will probably provide some basic structure and make it easier to implement new types of sequence.
Rx should automatically be supported by the current Silverback.Reactive package, since all I do is transforming the IEnumerable into an IObservable.
The BinaryChunksSequenceConsumerBehavior will be a special behavior that is used for binaries and returns a BinaryFileStreamMessage exposing the binary stream as well as the file metadata information (or maybe I'll just replace the byte array in the current BinaryFileMessage). This behavior is active only when the BinaryFileMessageSerializer kicks in (either because explicitly configured or because the message type header indicates a binary file, the latter is probably only relevant for Silverback-to-Silverback communication)
On producer side I'll have some SequenceProducerBehavior implementations for chunking (split into chunks and add headers) and other types of sequences.
The master data use case will be handled with a MessageSet<TMessage> that the producer pipeline (actually the MessageSetSequenceProducerBehavior) will take care of decorating each contained message with the necessary headers.
The mediator (Publisher) has to be refactored to avoid materializing the enumerable, unless the subscriber signature wants a materialized collection (e.g. IReadOnlyCollection vs. IEnumerable).
The current batching (based on count and timeout) will be redesigned to use the same approach with a BatchSequenceConsumerBehavior.
Some events will be published when a new MessageEnumerable is created and completed to allow the client to subscribe to the single message and handle the operation setup and commit separately. To maintain some compatibility with today's batch (https://beagle1984.github.io/silverback/docs/configuration/inbound#batch-processing)

Well, more or less this...all to be validated, of course.

Note that with this approach, the IEnumerable (or IObservable) being subscribed will get the full messages stream, unless there is a SequenceConsumerBehavior kicking in to break it in segments.
I think this may be a very neat implementation indeed.

Your proposed design ideas look very good to me.
I am going to look into the codebase to see what I could do.  I guess you will start with the mediator changes and the changes needed to introduce the sequences as a "first-class citizen". I'll maybe have a look at BinaryChunksSequenceConsumerBehavior. The thing converting a Sequence<byte[]> into a Stream. It is quite isolated...

Yep, I actually started already with a prototype. What I figured out so far is that it will require quite a bit of refactoring to be able to keep all features, handle the commits correctly, etc.
What I currently began with:

RawInboundEnvelopeEnumerable, that is an implementation of IEnumerable<IRawInboundEnvelope> that intermediately stores the messages in a BlockingCollection. It basically exposes an Add method, used by the consumer, and a Complete method, to signal the end of the sequence. This is what I originally called MessageEnumerable, but I think this name is more accurate.
StreamConsumerBehavior, that will be probably be the last behavior in the consumer pipeline, taking care of creating the RawInboundEnvelopeEnumerable for the first message, appending all other messages to it (via Add) and take care ot the offset commit as soon as the current message has been successfully consumed from the enumerable. (This is one thing I immedialtely figured out, the commit thing will work a bit differently since the message processing will now potentially happen in a separate thread).
PublisherConsumerBehavior, that will publish the enumerable to the internal bus. This task is currently accomplished by the InboundConnector but I think it's now time to get rid of the connectors completely and move all logic into the behaviors (cleaner, more flexible and straightforward when dealing with commits and so on).

What I'm working on is basically the endless stream case. In a second step the StreamConsumerBehavior has to be refactored to either extract the base SequenceConsumerBehavior (and create other behaviors to be prepended to the StreamConsumerBehavior to split the sequences where needed) or use a sort of ISequencer (maybe with a nicer name) that is configured in the IConsumerEndpoint and whose sole purpose is to identify the start/end of a sequence and which message belongs to it, in order to add the messages to the right RawInboundEnvelopeEnumerable. The latter sounds more natural to me.
If we go down the sequencer route, for the binary file chunking case we will have a ChunksSequencer to read the headers and create the enumerables accordingly, plus another behavior (placed after the StreamConsumerBehavior) that transforms each RawInboundEnvelopeEnumerable into the BinaryFileStreamMessage.
We probably need to create an implementation of System.IO.Stream for our purpose and use it in the BinaryFileStreamMessage.Stream property. This would be a good starting point for you. 👍
⚠ There is one thing I still haven't fully figured out: how to properly (and cleanly) handle the chunked JSON message. In that case you really want it to be aggregated back in memory and deserialized before it is published to the internal bus. The issue is that the aggregated message has to be deserialized and only afterwards pushed to the RawInboundEnvelopeEnumerable, so the aggregator should be at the beginning of the pipeline, but if the sequencer is the last part of the pipeline it cannot work... I have some ideas but they need to be verified.
(PS: Have a nice and nerdy Sunday my friend 🤓)

Great! I think your plan makes sense. I am actually on the stream implementation.
Share a branch as soon as possible, so that I can use RawInboundEnvelopeEnumerable. I don't care if it is not stable, I'll rebase all the way.

Yes, sure, I'll push as soon as it at least compiles again. In the meanwhile here is the draft version I wrote so far: https://gist.github.com/BEagle1984/bf57e22a2c0de454c61aa5b833ba3d6f.
⚠ Beware, I didn't test it.
(Heading to the gym now, will be back later for a full immersion)

Had not so much time I expected today... Did that nevertheless: https://github.com/BEagle1984/silverback/compare/master...lbovet:chunk-stream?expand=1
Indeed, code style support in VSCode is not sufficient. I will continue with VS full in the office.

I want to base my branch on feature/streaming. Could you avoid force-pushes so that I don't have surprises when rebasing?
We can always squash the branch afterward.

I want to base my branch on feature/streaming. Could you avoid force-pushes so that I don't have surprises when rebasing?
We can always squash the branch afterward.

I force pushed because I rebased my branch on master. 😆
I'll try to minimize it anyway. Nice to know so I will in case create another branch for me, to transfer unfinished/uncompiling code for example, since I work on multiple notebooks.

Should we take the opportunity to align the header names with "emerging standards?".

Header
Description

x-chunk-index
The chunk number, starting at zero.

x-chunk-count
The total number of chunks if known.

x-chunk-last
Boolean marking the last chunk (mandatory if x-chunk-count is not used).

x-chunk-first-offset
Offset of the first chunk. Present in all chunks except the first one itself.

Sure, I don't have a strong opinion about the "correct" header names. We can set whatever we want as default, they can be customized in the app startup anyway.
But are those really a standard? Or are they made up?

They are standards in some big company that is an active user and contributor of Silverback!

@lbovet I merged the ChunkStream. (Thank you!)
But now I wonder if we shouldn't have explicitly  implemented the ReadAsync method as well. In your implementation you are always gonna block (Enumerator.MoveNext is blocking until the next chunk is consumed, while AsyncEnumerator.MoveNextAsync would free the thread).

Yes, I also though about it. In fact, supporting a Stream is interesting when we use other libraries (CSV/XML parsers for example) to process the binary data. I assumed that most of these libraries would use the blocking methods of Stream, but I don't know enough of the .NET ecosystem and maybe they are all modern enough to be fully non-blocking. I guess that we should support the blocking case anyway. That forces us to call the Stream consumer in a dedicated thread (from an elastic thread pool).

Are the headers already as specified in https://github.com/BEagle1984/silverback/issues/106#issuecomment-688164572 ?

Yes, they are: https://github.com/BEagle1984/silverback/blob/3aa777a1e492cb1504b51c725eadfd2e51532b24/src/Silverback.Integration/Messaging/Messages/DefaultMessageHeaders.cs#L40.
(It works with "your" producer out of the box, without any customization.)

A few beta versions including this feature have been released. The current latest version is v3.0.0-beta.streaming.5 and is currently being tested (both by me and in a project).

Silverback v3.0.0 has been released, including this feature.


Bad link for Confusion matrix example script

Hi,
Example script's URL for Confusion matrix docs ends with 404 error. Bad location is https://github.com/allegroai/trains/blob/master/examples/manual_reporting.py

Thanks @vfdev-5 ,
The logger.md is deprecated, I'll make sure we link to the documentation site, and remove the logger.md

@vfdev-5 , the documentation fix was pushed :)
Thanks again!

Thanks for the update. I close the issue as solved for me :)


Rename ArtifactoryPluginConvention to ArtifactoryPluginExtension

Better alignment with the migration of convention usages.
Follow up #72.

[x] All tests passed. If this feature is not already covered by the tests, I added new
tests.

Hey @Goooler and thanks for your contribution!
The renaming here does create a breaking change for Kotlin users, and it's important to note that we didn't make this change with that intention in mind. Do you think there's a genuine reason to justify this modification?

I believe we should follow the Gradle guidance to use a standard extension(including honoring the standard extension name), we can note this point in changelog and recommend users to use artifactory block to configure properties like the Groovy did, if so I'll update the configuration block in docs.


Stage test site on Pantheon

https://dashboard.pantheon.io/organizations/b8ba57d8-af7a-7a70-37f4-c544c5ffe5c1#sites
I have a test environment for this site, get it staged on Pantheon!

Done: https://dev-the-world-wp.pantheonsite.io/
Pantheon admin: https://dashboard.pantheon.io/sites/fa3253e3-f798-4bae-a25f-e278d44a9aab#dev/code


Develop/lock notification

Lock with notification with notification
Not with polling
Made with messaje pub/sub because it is cancellable
As blpop is uncancellable

Codecov Report

Merging #10 (d7092c2) into master (05a0bc7) will decrease coverage by 5.04%.
The diff coverage is 25.00%.

@@             Coverage Diff              @@
##             master      #10      +/-   ##
============================================
- Coverage     80.44%   75.40%   -5.05%
- Complexity      265      267       +2
============================================
  Files            23       25       +2
  Lines           808      874      +66
  Branches         66       67       +1
============================================
+ Hits            650      659       +9
- Misses          120      176      +56
- Partials         38       39       +1

Impacted Files
Coverage Δ

...s/interruptinglocks/JedisLockWithNotification.java
0.00% <0.00%> (ø)

...rg/obapanel/jedis/interruptinglocks/JedisLock.java
82.78% <87.50%> (-0.84%)
:arrow_down:

...java/org/obapanel/jedis/utils/OnMessagePubSub.java
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 05a0bc7...d7092c2. Read the comment docs.

Won't do for now


Extraneious Newline after 'ddev exec' output

Everytime I execute ddev exec I get an additional new line
$ echo Hello
Hello
$ ddev exec 'echo Hello'
Hello

$

Maybe something is wrong in my setup. I tried it with a fresh setup and a new project, that has no modifications, but even then I have this new line.
Is this the normal behavior or is it my fault?

I'm glad you asked. Fixed in https://github.com/drud/ddev/pull/3133


DeepSeek VL support

Hi, it would be awesome if DeepSeek VL will be supported for all the serving goodies!

Hi, are there any efforts at this or anything to work upon?


Update documentation

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 100.00%. Comparing base (16825e7) to head (a27cf2b).

Additional details and impacted files
@@            Coverage Diff            @@
##              main       #51   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files           33        33
  Lines          692       692
  Branches        54        54
=========================================
  Hits           692       692

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


train_on_label

How to set the "train_on_label" flag for predict tasks during fine-tuning

Keep in mind this is a decoder language model.
Cross-Entropy is a prediction loss already.
In order to only train on a single token, you need to set the "labels"  dict for every other token to -100.
There's an example of that in the "train on inputs" part of the code.
You might be used to having your classification token come at the start of the sequence, but since we're a decoder only model, you'll probably want to put at the end.
You may also need to write a new head for the model, if the CausalLM head doesn't suit your needs in this regard.


CONTRIBUTORS: generate our own list

CONTRIBUTORS says:
# This source code was written by the Go contributors.
# The master list of contributors is in the main Go distribution,
# visible at http://tip.golang.org/CONTRIBUTORS.

However I don't think anyone is backporting patches from here to the master list so maybe it would be better to just list it here, directly.

Dep was officially deprecated earlier this year, and the proposal to archive this repository was accepted. As such, I'm closing outstanding issues before archiving the repository. For any further comments, please use the proposal thread on the Go issue tracker. Thanks!


recieved_event.py:23: Перенести классы в отдельные файлы 62

The puzzle 899-0dfa323e from #899 has to be resolved:
https://github.com/blablatdinov/tg-quranbot/blob/686fe4a4224e67820a84993d231830e322988ca2/src/srv/events/recieved_event.py#L23-L23
The puzzle was created by Ilaletdinov Almaz on 20-Jun-24.
role: DEV.
If you have any technical questions, don't ask me, submit new tickets instead. The task will be "done" when the problem is fixed and the text of the puzzle is removed from the source code. Here is more about PDD and about me.

The puzzle 899-0dfa323e has disappeared from the source code, that's why I closed this issue.


Info Gathering Action Support

Description
Please include a summary of the change, motivation and context.
Fixes EN-5258

Adding support for gathering info actions

Testing
Please describe the tests that you ran to verify your changes. Please summarize what did you test and what needs to be tested e.g. deployed and tested helm chart locally.
Unit Testing
https://github.com/unskript/Awesome-CloudOps-Automation/assets/87547684/6d0a9241-3159-4a35-8484-9a14cf9bad76
Checklist:

[ ] My changes generate no new warnings.
[ ] I have added tests that prove my fix is effective or that my feature works.
[ ] Any dependent changes have been merged and published.

Documentation
Make sure that you have documented corresponding changes in this repository.

Video showing the List info options.
https://github.com/unskript/Awesome-CloudOps-Automation/assets/87547684/ba51d472-25e3-4743-bbea-b48b9d87942c


Convert Html to pdf | Python CLI

Script Title - convert HTML to PDF by taking input from CLI
python html2pdf.py <website_name>

Details: https://www.geeksforgeeks.org/python-convert-html-pdf/
what will change -
Instructions

Create a new folder for your script and file/folder name should be appropriate.
Create a README.md in your folder for program Instructions
add requirements.txt if needed
add your program name & Author name in main readme

Please add/delete options that are not relevant.

[x] Adding New Code
[x] Improving Code
[x] Improving Documentation
[x] Bug Fix

Programming Language

[x] Python

:star2: Star it :fork_and_knife:Fork it :handshake: Contribute to it!
Discord server  - https://discord.gg/FXyh2S3
Happy Coding,

can i take this issue?

[x] assigning the issue to @hpnightowl

Can i take this plz

@Bhavik-Ardeshna Issue already assigned, wait for new issues or create your new issue for script

can you label it as ‘hacktoberfest-accepted’ as per new rules thanks :)


MM-17060: Jira Plugin: OAuth error on API calls to Jira

Summary

Everything broke today because Jira deprecated the userkey claim in their jwt oauth2 flow.
Had to make a change to the oauth2 library here: https://github.com/cpoile/oauth2/commit/10945bd219c720af308178c74a42838ff6ab43b5
Plus a few changes with how we get user info
Needs to be tested to make sure everything is still working; informal testing seems like its working

Links

MM-17060

I pulled down your branch and confirmed it's working. Great job @cpoile  :+1:
Hosted here for testing

@cpoile We don't have a backport label. But I think we want the fix for 5.12/jira 2.0

@crspeller 👍 #231


Faster wallet synchronization

Abstract
Two commits that will make wallet faster

First commit: In getLatestBlocks download all blocks up to the actual chain tip. We can do this since we  are not relying anymore on blockbook.
Second commit: Call getLatestBlocks right after the initial sync. In this way users will not have to wait for a new event new-block  to complete the sync.

Testing
Receive some PIVs from someone and verify that the transactions arrives faster (1 block before) than the current master branch

tACK 2ca9609 but with an improvement suggestion:
The (Shield) Tx is instantly recognised in the next block, however, the UI doesn't instantly reflect this until the next getblockcount check, so there is an artificial delay to the UI showing balance changes.
Could you emit the balance/activity updates after post-init-sync getLatestBlocks?

What events are missing?
 // At this point download the last missing blocks in the range (blockCount -5, blockCount]
        await this.getLatestBlocks(blockCount);

        // Update both activities post sync
        getEventEmitter().enableEvent('balance-update');
        getEventEmitter().emit('balance-update');
        getEventEmitter().emit('new-tx')

tACK 2ca9609 but with an improvement suggestion:
The (Shield) Tx is instantly recognised in the next block, however, the UI doesn't instantly reflect this until the next getblockcount check, so there is an artificial delay to the UI showing balance changes.
Could you emit the balance/activity updates after post-init-sync getLatestBlocks?

What events are missing?
 // At this point download the last missing blocks in the range (blockCount -5, blockCount]
        await this.getLatestBlocks(blockCount);

        // Update both activities post sync
        getEventEmitter().enableEvent('balance-update');
        getEventEmitter().emit('balance-update');
        getEventEmitter().emit('new-tx')

That is after initial sync, I'm talking about post-sync Tx fetching (the refresh when the wallet is already fully open and synced). The Tx is synchronised, but the UI will not reflect it until the next block count check.

tACK 2ca9609 but with an improvement suggestion:
The (Shield) Tx is instantly recognised in the next block, however, the UI doesn't instantly reflect this until the next getblockcount check, so there is an artificial delay to the UI showing balance changes.
Could you emit the balance/activity updates after post-init-sync getLatestBlocks?

What events are missing?
 // At this point download the last missing blocks in the range (blockCount -5, blockCount]
        await this.getLatestBlocks(blockCount);

        // Update both activities post sync
        getEventEmitter().enableEvent('balance-update');
        getEventEmitter().emit('balance-update');
        getEventEmitter().emit('new-tx')

That is after initial sync, I'm talking about post-sync Tx fetching (the refresh when the wallet is already fully open and synced). The Tx is synchronised, but the UI will not reflect it until the next block count check.

ok I understood, should be fixed now


Make string plugin also support string stamped

@pjreed I accidentally pushed this to origin. Is there a way to delete that branch?

apart from the macro, this looks good to m e.

@daniel-dsouza should be good now

@pjreed I accidentally pushed this to origin. Is there a way to delete that branch?

Sure, done.

@pjreed looks good to merge


Use of unresolved identifier 'Validator'

Since I updated my xcode to 6.3.1, I got this error message
/Users/MNurdin/Documents/iOS/xxxxx/Controllers/LoginViewController.swift:20:21: Use of unresolved identifier 'Validator'

Please advice. Is there any updated library for swift 1.2?

Did you import as
import SwiftValidator

At the top of your file? 2.0.7 works (after fixing the optional issue) on 6.3.1 with the above Import

Fixed!! Thank you.


Integrate into Notebook

Add to its dependencies
Use cmd.exe as the default if /bin/sh is not available.

cf https://github.com/jupyter/notebook/pull/3087


Translation won't work if string contains & codes.

Extraction & futher translation of the string like this one, works fine:
This is somethign & else

But for string like the following one extraction would work, but translation would not:
This is a string with → an arrow!

Workaround for now would be using special symbols directly in a source code:
This is a string with → an arrow!

So clearly there is a problem with &xxx; symbols.

I found out that some angular template compilers convert '&', '>', '<', etc. in '&', '&gt', '&lt' ant this converted string will be passed to angular-gettext, which will be failed to match, since strings are collected on original file. In my case there was gulp html2js plugin.
So there are 3 possible solutions to workaround this problem:

Fix this symbols in original templates
Do not convert these symbols in your template compiler
Fetch angular-gettext from compiled files (which is not possible by the way)

I think this is a bug and should work:
me & you
. It get's extracted but not translated.
But... if I add
me & you
 and also extract and translate then they both work. :)

The "use UTF-8 character instead" workaround is unhandy if the character is not visible or not distinguishable from another character. For instance, U+00AD (soft hyphen) has no visual representation, but permits hyphenation in HTML.
I used the following workaround:

foo{{shy}}bar

Special characters like & inside a label cannot be translated in IE/Edge because here, the DOM is used to return the label key, which will return it encoded as &. Is there any workaround for this?

Ran across this caveat myself today. The problem, as I noticed it, is that when compiling strings, the text as it was written is passed to the template.pot html entities and all.
The resulting .po file also has those entities as originally authored.
In use, the translate directive uses javascript to get the html of the element it was applied to, and sends it to the compile function for processing. At this time, the html entities have been converted into their plain text counter part. Then the lookup for a translation string fails as the msgid is different in the compiled translations and what is being used at that time.
I prayed to google for possible answers on how, with javascript, to get raw contents of an element without interpreting special characters, and it seems this is a limitation of how javascript is able to access this information.
I think a possible workaround may be to manually call the gettextCatalog.getString() method with your string in code in your controller. But that sounds truly awful.


Made ember-get-helper optional, fixes #145

ember-one-way-controls includes the ember-get-helper addon, which is officially "deprecated and support for Ember 2.0 will not be maintained".
This PR makes ember-get-helper optional.

As mentioned in the linked issue: the correct fix is to update ember-get-helper so that it can properly noop on ember-source.

@rwjblue there's a PR open on ember-get-helper to fix this

It'd be great if we could get this merged.

This would also require removing the 1.13 test scenarios as they no longer work.  I tried playing around with using ember-cli-version-checker to conditionally add the ember-get-helper addon during installation based on the current version of Ember, but I couldn't get it to work with ember-try. Seems that given the drop in support it's not really a backwards compatible minor change, but a major one in terms of versioning.


chore(deps): bumps projen from 0.6.17 to 0.8.0

chore(deps): bumps projen from 0.6.17 to 0.8.0

@projen rebuild


Periodical api and setting update

🚀

API would be updated to 1.0.x when this https://github.com/polkadot-js/api/issues/1802 will be resolved


Migrate hub page to card based landingpage.

Finish DEV TASK 196851
Following this guide: Create or update a hub page

Docs Build status updates of commit 6016a03:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

sandbox/index.yml
:x:Error

Details

sandbox/index.yml

[Error]

Unable to load file 'index.yml' via processor 'Hub': Schema validation failed. Please validate the file and make sure it conforms to schema 'Hub' (https://static.docs.com/ui/latest/schemas/Hub.schema.json):
Array item count 1 is less than minimum count of 2. Path 'additionalContent.sections[2].items'.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Docs Build status updates of commit 6016a03:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

sandbox/index.yml
:x:Error

Details

sandbox/index.yml

[Error]

Unable to load file 'index.yml' via processor 'Hub': Schema validation failed. Please validate the file and make sure it conforms to schema 'Hub' (https://static.docs.com/ui/latest/schemas/Hub.schema.json):
Array item count 1 is less than minimum count of 2. Path 'additionalContent.sections[2].items'.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Docs Build status updates of commit 6016a03:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

sandbox/index.yml
:x:Error

Details

sandbox/index.yml

[Error]

Unable to load file 'index.yml' via processor 'Hub': Schema validation failed. Please validate the file and make sure it conforms to schema 'Hub' (https://static.docs.com/ui/latest/schemas/Hub.schema.json):
Array item count 1 is less than minimum count of 2. Path 'additionalContent.sections[2].items'.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Docs Build status updates of commit 89e9724:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

sandbox/index.yml
:x:Error

Details

sandbox/index.yml

[Error]

Unable to load file 'index.yml' via processor 'Hub': Schema validation failed. Please validate the file and make sure it conforms to schema 'Hub' (https://static.docs.com/ui/latest/schemas/Hub.schema.json):
Array item count 1 is less than minimum count of 2. Path 'additionalContent.sections[0].items'.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Docs Build status updates of commit ff227ba:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

sandbox/index.yml
:x:Error

Details

sandbox/index.yml

[Error]

Unable to load file 'index.yml' via processor 'Hub': Schema validation failed. Please validate the file and make sure it conforms to schema 'Hub' (https://static.docs.com/ui/latest/schemas/Hub.schema.json):
Array item count 1 is less than minimum count of 2. Path 'additionalContent.sections[2].items'.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Docs Build status updates of commit ff227ba:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

sandbox/index.yml
:x:Error

Details

sandbox/index.yml

[Error]

Unable to load file 'index.yml' via processor 'Hub': Schema validation failed. Please validate the file and make sure it conforms to schema 'Hub' (https://static.docs.com/ui/latest/schemas/Hub.schema.json):
Array item count 1 is less than minimum count of 2. Path 'additionalContent.sections[2].items'.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Docs Build status updates of commit 41160a8:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

sandbox/index.yml
:x:Error

Details

sandbox/index.yml

[Error]

Unable to load file 'index.yml' via processor 'Hub': Schema validation failed. Please validate the file and make sure it conforms to schema 'Hub' (https://static.docs.com/ui/latest/schemas/Hub.schema.json):
Array item count 1 is less than minimum count of 2. Path 'additionalContent.sections[0].items'.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Docs Build status updates of commit 04eee44:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

sandbox/index.yml
:x:Error

Details

sandbox/index.yml

[Error]

Unable to load file 'index.yml' via processor 'Hub': Schema validation failed. Please validate the file and make sure it conforms to schema 'Hub' (https://static.docs.com/ui/latest/schemas/Hub.schema.json):
Array item count 1 is less than minimum count of 2. Path 'additionalContent.sections[1].items'.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Docs Build status updates of commit 69c6a08:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

sandbox/index.yml
:x:Error

Details

sandbox/index.yml

[Error]

Unable to load file 'index.yml' via processor 'Hub': Schema validation failed. Please validate the file and make sure it conforms to schema 'Hub' (https://static.docs.com/ui/latest/schemas/Hub.schema.json):
Array item count 1 is less than minimum count of 2. Path 'additionalContent.sections[1].items'.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Docs Build status updates of commit 0642ed4:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

:x:Error

Details

sandbox/index.yml
:white_check_mark:Succeeded
View

[Error] Getting documents from document hosting service failed with locale: en-us, depot name: Azure.sandbox, branch name: pr-en-us-132. Error: A task was canceled.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Civilization: Beyond Earth options menu crash

Civ Beyond Earth crashes if once you get to the main menu press you then the options button. I have bisected this to not always be the case and that it seems to start with commit https://github.com/doitsujin/dxvk/commit/b746e1352b4c93b7d5f51d013f6aaef249c8aecd
While the logs makes it appear as a 32bit memory crash it acts a bit special in that the sequence above is the only way I've gotten it to crash in the little testing I've done so far. If i instead go in and play a game (starts fine without a crash) i can then access the options menu fine from there. Same if i from in game exit back to the main menu it will also work fine then.
Software information
Sid Meier's Civilization: Beyond Earth
System information

GPU: 7900 xtx
Driver: Few days old mesa-git
Wine version: Proton Experimental
DXVK version: https://github.com/doitsujin/dxvk/commit/b746e1352b4c93b7d5f51d013f6aaef249c8aecd and above

Apitrace file(s)
Pending. Isn't cooperating on Linux at least so far.
Log files
CivilizationBE_DX11_dxgi.log
CivilizationBE_DX11_d3d11.log
CivilizationBE_DX11_d3d9.log

@Blisto91 I have encountered a similar menu-crashing issue in another game using Proton 8.04.
This hasn't happened before and I would like to compare your logs in order to precisely discern whether the bug is a regression from DXVK or wine, so would you mind providing another debug log, perhaps by setting the PROTON_LOG environment variable?

steam-65980.log
Note that the commit bisected above was in use before Proton 8.
The easiest way to find if it's a dxvk regression is just to shove a old dxvk version in to the new Proton. E.g the one from 7.0-6.

Added a Windows native trace


Not compatible with latest Flutter or Camera plugin

I know things in this space change very quickly and it can be very difficult to stay in synchronization. Having said that, I was wondering if there are plans to upgrade to plugin to support latest Flutter(2.8.1) and make the plugin derive it's logic from the primary camera plugin (0.9.4)?
I cloned this repository and tried to to patch in the upgrades but looks like the current primary camera plugin is a major rewrite to what was being used when this repository was created and there are a lot of files that need to be created and modified to add the same features.

Shutter Speed
ISO
White Balance

I will post the files to be modified to in the primary camera plugin to create a given feature(e.g Shutter Speed) below. I don't have much experience in plugin writing and thus would be helpful if someone can pick it up and fix it.

Hello  @Mohit-Ak , thank you for opening this issue.
I'm currently busy with work right now, so I cannot upgrade this plugin to Flutter 2.0. However, if anyone does so, please, make a Pull Request and I'll do everything to merge it into main.

Any news on this? Would be nice to migrate it.

Hello @457r0n4u7. I'm sorry to inform you, but there is no news from my side. I've been focusing on other fields and I've not been using Flutter

Hello, @457r0n4u7 I tried to do it once but failed because I underestimated the amount of time this task would need. My company is almost willing to pay a bounty if someone can port this 🤣


Sdk update 0.22.0 error handling

Issue #

Description

General Checklist

[ ] Added new tests to cover change, if needed
[ ] Build succeeds with all target using Swift Package Manager
[ ] All unit tests pass
[ ] All integration tests pass
[ ] Security oriented best practices and standards are followed (e.g. using input sanitization, principle of least privilege, etc)
[ ] Documentation update for the change if required
[ ] PR title conforms to conventional commit style
[ ] New or updated tests include Given When Then inline code documentation and are named accordingly testThing_condition_expectation()
[ ] If breaking change, documentation/changelog update with migration instructions

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

https://github.com/aws-amplify/amplify-swift/pull/3248


How to actually install?

I downloaded and unpacked the file from the green "Code" button, but there is no executable. There is a file called EldenRingFpsUnlockAndMore, but that only opens with Microsoft Visual Studio Solution. How do I do the thing?

Click on the .exe here https://github.com/uberhalit/EldenRingFpsUnlockAndMore/releases/tag/<IP_ADDRESS>

Thanks for the quick reply. I googled how to dl stuff from github and the Code button was suggested, so I thought those were all the files. I appreciate your work.


[Feature Request]Add LLM Agent

Describe the solution you'd like
LLM Agentを追加します
https://github.com/aws-samples/bedrock-claude-chat/pull/241
See : https://docs.anthropic.com/claude/docs/tool-use
A clear and concise description of what you want to happen.
Why the solution needed
A clear and concise description of the reason why you want the solution.
Additional context
Add any other context or screenshots about the feature request here.
Implementation feasibility
Are you willing to discuss the solution with us, decide on the approach, and assist with the implementation?

[x] Yes
[ ] No

Impementation guide:
Rendering

Do not display the details of the thought process on the FE
Display the progress in the form of a progress bar

It might be good to display the tools being used

Send the full text from the BE
No streaming

Tools

Default is search only (?)
Contribute to app/agents/tools/examples

Initially, get weather, stock prices, etc.
Developers need to write scripts themselves and have them cdk deploy

Scan the tools in a directory like app/agents/tools/prod and return them to the FE

On the bot creation screen, the FE can turn the toggle switch ON/OFF
While there is no explicit RAG switch, if any switch is ON and Knowledge exists, it will automatically be used as a tool (let the LLM consider it)

@statefb - I suppose the most requested tool would be using external search engine (when necessary to answer a given question). I see it is set up as "planned" - what does it mean?

@tomaszdudek7 Yes I agree with you. But almost search engine api e.g. google search API requires secret values, which makes the deployment procedure complex. I'll add a guidance how to setup own tool on this project. It will be released by the end of June.

@statefb
こちらCloseしておきます！（FE,BEがMergeされた為）


[Feature] Code 93 extended support possible?

Would it be possible to support Code 93 Extended?
(https://www.activebarcode.com/codes/code93.html)

I don't see any obvious reason why it wouldn't be possible.  I'm not familiar with it, and I don't think that that link on it's own provides quite enough information.. this might be of some use https://en.wikipedia.org/wiki/Code_93#Full_ASCII_Code_93
as well as http://www.barcodeisland.com/code93.phtml
I do note also that there's a "decodeExtended" function inside Code 93 reader already, i'm not sure if that's directly related to the Extended format of code 93, or if it's just how the function was named internally. So it might? already be there.
If you could provide some samples, perhaps someone could take a stab at it?


[bug]: CSS/Display bug when clicking on the marketplace link from the main page of a custom service that is not published to the marketplace yet

Prerequisites

[X] I have searched for existing issues that already report this problem, without success.

EmbassyOS Version
0.3.0
Device
Laptop/Desktop
Device OS
Linux
Device OS Version
Pop!_OS 21.10
Browser
Firefox
Browser Version
96.0 (64 bit)
Current Behavior
When the marketplace is clicked, the right of the screen displays incorrectly. See attached screenshot
Expected Behavior
when clicked an alert should display indicating that this service is not in the marketplace.
Steps to Reproduce

On Custom service home page
Click on Marketplace
See display error

Anything else?
No response

I'm guessing if you look in the console you will see the error

If the package does not contain a valid marketplace-url, it means it was side loaded, and this button should be disabled or present a helpful alert as you mention.


Find Web-Scraping Targets

One idea may be to look at the SEC. I like it because it's (a) highly economic, (b) highly structured, but (c) stodgy enough to not have a simple API. See: this EDGAR service, which is exactly the kind of "have the RA do the downloads" work we were talking about. And there's plenty of data, both textual and numerical, for us to analyze.
There is also some prior art in this area:

A paper with some example code for scraping SEC:EDGAR.
This Python script, which I think does the same thing.

etc.
cc: @jlperla


jsFiddle linked the main page doesn't work

Anyone noticed the major Component example on the main page
https://angularjs.org/#create-components
links to jsFiddle
https://jsfiddle.net/api/post/library/pure/
that is broken?
It puts the comment with the non-existent link inside the CSS
 <!-- Ugly Hack due to jsFiddle issue: http://goo.gl/BUfGZ -->

whereas jsFiddle wants you to use external resources instead.
Maybe Plunkr can be used instead, consistently with the rest of the site?
Also replace probably shouldn't be used as it is deprecated?

We need to do a reworking of the home page examples...
@beardyco - fancy converting the examples to link to Plunker?

That's fixed now


java-openliberty: Slim down server feature definitions

Currently, the server configuration for the default template includes the full microProfile-3.2 feature. This can be slimmed down to improve startup time (i.e. mpHealth-2.0, mpMetrics-2.0, jaxrs).  In addition we should add an IT to test the application endpoint and make sure jaxrs is functioning and available.

Some interesting ideas, but on balance not helpful to have such an open-ended issue open, so closing for now.


Training error in tubedetr.py file.

I try to train the network on HC-STVGv2 dataset using the command provided in the README.md file:
python -m torch.distributed.launch --nproc_per_node=4 --use_env main.py --ema \
  2 --load=pretrained_resnet101_checkpoint.pth --combine_datasets=hcstvg --combine_datasets_val=hcstvg \
  3 --v2 --dataset_config config/hcstvg.json --epochs=20 --output-dir=output --batch_size=8

Unfortunately, I encountered this issue in models/tubedetr.py line 180
  File "/root/paddlejob/workspace/STVG/TubeDETR/models/tubedetr.py", line 180, in forward
    tpad_src = tpad_src.view(b * n_clips, f, h, w)
RuntimeError: shape '[160, 256, 7, 12]' is invalid for input of size 2817024

. Besides, the durations of the eight samples are: [100, 100, 69, 100, 65, 86, 100, 100].
I think this problem is probably related to the padding approach. Do you have any clue with this BUG and how to fix it? Thank you very much!

All experiments I did were with a batch size of 1 video per GPU given that it already takes quite a bit of GPU memory with long videos / high resolution, so there might be some padding to fix indeed.

Hi, I encountered the same issue.
Did you fix it?

Hi, Was anybody able to solve this issue?


[Bug] Can not scroll up and down when the model is steaming response

Describe the bug
Can not scroll up and down when the model is generating response. If open multiple conversations with GPT, and one of the conversation have a unfinished streaming response, other conversations can not scroll up and down. The conversation view will be forced to scroll down to the botton of the conversation.
To Reproduce
Steps to reproduce the behavior:

Go to the main page
Click New Chat
Send a request to ask GPT a question(the response should be long enough, usually take more than 5s to stream the complete response)
Click a conversation in the conversation list to open another conversation, while the GPT is streaming the response
Scroll up and down, the view will be forced to scroll down to the bottom

Expected behavior
Should allow user to go through other chat history while the GPT is streaming response
Screenshots
If applicable, add screenshots to help explain your problem.
https://github.com/ChatGPTNextWeb/ChatGPT-Next-Web/assets/33738071/835ac262-4dcb-4273-b8af-3001d32894f5
Deployment

[x] Docker
[ ] Vercel
[ ] Server

Desktop (please complete the following information):

OS: [e.g. iOS]
Browser [e.g. chrome, safari]
Version [e.g. 22]

Smartphone (please complete the following information):

Device: [e.g. iPhone6]
OS: [e.g. iOS8.1]
Browser [e.g. stock browser, safari]
Version [e.g. 22]

Additional Logs
Add any logs about the problem here.

ChatGPTNextWeb#4021

The expected behavior here should be to automatically increase the height upwards when the user is already at the bottom of the chat. Once manually slid off the bottom, it is not forced at the very bottom.

@KnaveM hi, this issue should be resolved. Ref:  #4149


How do it set header while uploading file

i want to upload media on s3 with following headers  " cache-control and expires ".
How can we acheive this in your module?

:+1: for this issue @andrewrk

You can apply any of the properties described here: http://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/S3.html#putObject-property
Found this by reading the readme, specifically: https://github.com/andrewrk/node-s3-client#clientuploadfileparams


Broken package for composer (Missing Dependants | PHP 7.2+)

The latest releases of PHP Binaries on Windows (7.2) removed support for Mcrypt which is required by a dependency of this project thus breaking deployment via Composer.
There doesn't seem to be any compiled PECL extensions which work, nor does manually compiling Mcrypt from sourcecode resolve the error as it results in an invalid PHP extension.
Would any workarounds be appreciated? Also, here is a copy of the error logs:
> composer.phar require php-ai/php-ml:0.5.0 --no-progress --no-interaction --ansi
PHP Warning:  PHP Startup: Unable to load dynamic library 'mcrypt' (tried: C:\php\ext\mcrypt (The specified module could not be found.
), C:\php\ext\php_mcrypt.dll (The specified module could not be found.
)) in Unknown on line 0

Warning: PHP Startup: Unable to load dynamic library 'mcrypt' (tried: C:\php\ext\mcrypt (The specified module could not be found.
), C:\php\ext\php_mcrypt.dll (The specified module could not be found.
)) in Unknown on line 0
./composer.json has been updated
Loading composer repositories with package information
Updating dependencies (including require-dev)
Your requirements could not be resolved to an installable set of packages.

  Problem 1
    - Installation request for defuse/php-passgen v1.0.1 -> satisfiable by defuse/php-passgen[v1.0.1].
    - defuse/php-passgen v1.0.1 requires ext-mcrypt * -> the requested PHP extension mcrypt is missing from your system.
  Problem 2
    - spomky-labs/oauth2-server-defuse-generator v4.0.0 requires ext-mcrypt * -> the requested PHP extension mcrypt is missing from your system.
    - spomky-labs/oauth2-server-defuse-generator-bundle 4.0.x-dev requires spomky-labs/oauth2-server-defuse-generator ~4.0 -> satisfiable by spomky-labs/oauth2-server-defuse-generator[v4.0.0].
    - Installation request for spomky-labs/oauth2-server-defuse-generator-bundle 4.0.x-dev -> satisfiable by spomky-labs/oauth2-server-defuse-generator-bundle[4.0.x-dev].

  To enable extensions, verify that they are enabled in your .ini files:
    - C:\php\php.ini
  You can also run `php --ini` inside terminal to see which files are used by PHP in CLI mode.

Installation failed, reverting ./composer.json to its original content.

Currently working around the issue, by separating into two projects: 7.1 (works, just its built-in the binary).
But hopefully, a proper solution can be found as running two PHP servers is a tad impractical.

Actually, despite starting to download another issue has arisen. The dependency of https://github.com/spomky-labs/oauth2-interface (does not exist) so the entire package on Composer is unable to install for anyone regardless of workspace environments.
> composer.phar require php-ai/php-ml:0.5.0 --no-progress --no-interaction --ansi
./composer.json has been updated
Loading composer repositories with package information
Updating dependencies (including require-dev)
Package operations: 8 installs, 0 updates, 0 removals
  - Installing spomky-labs/oauth2-interface (v4.0.4): Downloading    Failed to download spomky-labs/oauth2-interface from dist: The "https://api.github.com/repos/Spomky-Labs/oauth2-interface/zipball/45dcad2a10d85f2c861101640c8cf91d08f28679" file could not be downloaded (HTTP/1.1 404 Not Found)
    Now trying to download from source
  - Installing spomky-labs/oauth2-interface (v4.0.4): Cloning 45dcad2a10 from cache
    45dcad2a10d85f2c861101640c8cf91d08f28679 is gone (history was rewritten?)

  [RuntimeException]
  Failed to execute git checkout "45dcad2a10d85f2c861101640c8cf91d08f28679" -- && git reset --hard "45dcad2a10d85f2c8
  61101640c8cf91d08f28679" --

  fatal: reference is not a tree: 45dcad2a10d85f2c861101640c8cf91d08f28679

Turns out that the composer management of my IDE messed up the files and then somehow through an error blaming this as the cause. I re-added all packages and the issue cleared up. Aside from the 7.2+ matter.


feat: document how to use intermediate certificates

What does this PR do?
Just add a sentence on how we support intermediate certificates in Traefik
Motivation
Looking at the documentation, I asked myself if Traefik supports intermediate certificates, and it wasn't obvious. I am not the only one to ask the question: https://github.com/containous/traefik/issues/2957.
More

[ ] Added/updated tests
[x] Added/updated documentation

Additional Notes
I am not sure about the location of that new paragraph ?

I'm not convinced this belongs to the traefik doc itself, so I'll let someone else approve it for now.

Can anyone confirm that the proposed solution works? I don't presently have a development environment that would allow me to do this.

I'm not convinced this belongs to the traefik doc itself, so I'll let someone else approve it for now.

I second this, this is more of a client / consumer concern, and we're sort of just a messenger.

Hello @Trois-Six,
after checking, we will turn down this PR for now and see, if it will have a place later on.
Thanks!


Ask the purpose to valid certificate

Since certificate is public access, so we can get the certificate easily. What's the purpose to valid like thumbprint, issuer... etc. on our code?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: eb440603-950a-c224-f6c9-222ca502d5a5
Version Independent ID: 0b5c4944-0327-91fc-2b0b-c19a1b873b64
Content: Configure TLS mutual authentication - Azure App Service
Content Source: articles/app-service/app-service-web-configure-tls-mutual-auth.md
Service: app-service
GitHub Login: @cephalin
Microsoft Alias: cephalin

Hi @yansyunchen, the section you pointed out Access client certificate is for inbound traffic. Outbound traffic, your app will pull the certificate from either key vault or imported cert. All that section is saying is if a client sends a certificate identifying who they are to your app, then it's your responsibility to validate that certificate. There isn't anything app service can do otherwise.
Hope this helps. If not, please feel free to reopen the issue and tag us in your reply.
#please-close


Minor Clean-up in JoinSelection Tests

Which issue does this PR close?

Closes #.
Rationale for this change

https://github.com/apache/datafusion/pull/9346 removes the PipelineStatePropagator, so there is no need to check Arc<dyn ExecutionPlan> and TreeNode integrity anymore. The new rule applies on Arc<dyn ExecutionPlan>'s directly. This PR just cleans up redundant lines.
What changes are included in this PR?

Remove unnecessary and not-applicable test codes regarding this.
Are these changes tested?

Are there any user-facing changes?

Thanks everyone


Feature/pass version to precommit hook

Coverage increased (+0.09%) to 93.333% when pulling 7febd660c180719aaebd2a55622540e15756fa8c on feature/pass-version-to-precommit into 36961ca9201cdb2b22537302ce088dd220e7474f on master.

@leonardoanalista Yes, the script is now passed the version as an argument "v1.0.0" (for example).


Configure IBM Object Storage with Server

Whenever the server receives a base64 string as an avatar, we should:

persist it to object storage
update the json with the avatarURL
wipe out the base64 string to reduce load on couchDB

I need to look up which repo we need to add for support to this - will comment when I find it.

Some notes on this:

the line to add to Package.swift looks like so...

.package(url: "https://github.com/ibm-bluemix-mobile-services/bluemix-objectstorage-serversdk-swift.git", from: "0.9.0"),

...and we need to add "BluemixObjectStorage" to the list of dependencies in the Application target

per the generated server, the class we should add (ServiceObjectStorage.swift) looks like so:

import LoggerAPI
import CloudEnvironment
import BluemixObjectStorage
import Dispatch

func initializeServiceObjectStorage(cloudEnv: CloudEnv) throws -> ObjectStorage {
    // Load credentials for Object Storage using CloudEnvironment
    guard let storageCredentials = cloudEnv.getObjectStorageCredentials(name: "object_storage") else {
        throw InitializationError("Could not load credentials for Object Storage.")
    }
    guard let connectedObjectStorage = createObjectStorageAndConnect(credentials: storageCredentials) else {
        throw InitializationError("Could not connect to Object Storage")
    }
    Log.info("Found and loaded credentials for Object Storage.")
    return connectedObjectStorage
}

private func createObjectStorageAndConnect(credentials: ObjectStorageCredentials) -> ObjectStorage? {
    // Need to make network call synchronous since we need to know the result before proceeding.
    let semaphore = DispatchSemaphore(value: 0)
    var authenticated = false
    let objStorage = ObjectStorage(projectId: credentials.projectID)
    // Object Storage SDK requires region in uppercase
    let region = credentials.region.uppercased()
    Log.verbose("Making network call synchronous...")
    objStorage.connect(userId: credentials.userID, password: credentials.password, region: region) { error in
        if let error = error {
            Log.error("Could not connect to Object Storage. Error was: '\(error)'.")
            authenticated = false
        } else {
            Log.verbose("Successfully obtained authentication token for Object Storage.")
            authenticated = true
        }
        semaphore.signal()
    }
    let _ = semaphore.wait(timeout: DispatchTime.distantFuture)
    return (authenticated) ? objStorage : nil
}

This way, in the Application.swift file, we can import like so:
import BluemixObjectStorage

class ApplicationServices {
    public let objectStorageServce: ObjectStorage

    public init(cloudEnv: CloudEnv) throws {
        objectStorageService = try initializeServiceObjectStorage(cloudEnv: cloudEnv)
    }
}


Casmcms 8824

Summary and Scope
Modified the ims remote play to configure an arm based compute.
Issues and Related PRs
https://jira-pro.it.hpe.com:8443/browse/CASMCMS-8824
Testing
Tested on:
Mug/Baldar/Tyr
Test description:
Tested play execution against bare metal image from the metal team as well as an IMS built barebones image.
Risks and Mitigations
No
Pull Request Checklist

[x] Version number(s) incremented, if applicable
[x] Copyrights updated
[x] License file intact
[x] Target branch correct
[x] CHANGELOG.md updated
[x] Testing is appropriate and complete, if applicable
[x] HPC Product Announcement prepared, if applicable

I'll add a commit to cover the copyright nitpicks in my comments.


Create integration tests using a sample test App

Increase test coverage by creating a sample application using this lib and test it using Eth Mainnet.

i think the only thing i would change is maybe putting this in its own integration-tests folder with its own separate script


SpeedKit Image issue in getImageSize function

Describe the bug
I got several issues when use   <speedkit-image />.

getImageSize: https://{IMAGE_URL} TypeError [ERR_INVALID_ARG_TYPE]: The "obj" argument must be an instance of Blob. Received an instance of Blob
getImageSize: https://{IMAGE_URL} FetchError:  (404 Not Found (https://{IMAGE_URL})) (In Docker Swarm)
getImageSize: https://{IMAGE_URL} TypeError :  body used already for: https://{IMAGE_URL} (In Docker Swarm)

To Reproduce
Steps to reproduce the behavior:

Install the package
use speedkit image
  <speedkit-image  v-bind="image" @load="onLoadImage" />
image: {      source: {        format: 'webp',        src: this.url,        sizes: { default: '100vw', xxs: '100vw', xs: '100vw', sm: '100vw', md: '100vw', lg: '100vw', xl: '100vw', xxl: '100vw' }      },      title: this.title,      alt: this.alt,    }
Run npm run dev
See error

Expected behavior
The images loaded successfully, and did not cause any errors, especially when using Google Lighthouse.
Desktop (please complete the following information):

OS: Windows 10
Browser Chrome

Hello @alghifarifikri,
which node version and nuxt are you using?

Hello @alghifarifikri,
which node version and nuxt are you using?

Hello @ThornWalli
I'm using node v16.16.0

Can you update your node to a newer version?

@alghifarifikri Can you update your node to a newer version?

@ThornWalli I haven't tried it, is the solution just to upgrade the node version ?

@alghifarifikri Can you update your node to a newer version?

I'm try to update node to newer version and still error.

Which node version did you go to?
I tested the project myself under Windows 10 with Node 19.9.0 and it runs as expected.
Your error message may be due to an outdated node version being used.
There were a few changes between Node 16 and 19.

Which node version did you go to?
I tested the project myself under Windows 10 with Node 19.9.0 and it runs as expected.
Your error message may be due to an outdated node version being used.
There were a few changes between Node 16 and 19.

I'm using node version 20, do I need to downgrade again?

Extremely strange...
I also tested again with Node 20.9.0 and no problems...
Ran without problems, in the project repo and in a project with an installed package.
Could you share your installed dependency and the nuxt.config?

Extremely strange...
I also tested again with Node 20.9.0 and no problems...
Ran without problems, in the project repo and in a project with an installed package.
Could you share your installed dependency and the nuxt.config?

this is my dependency

this is my nuxt.config for nuxt-speedkit

Let me know if anything is missing or wrong.

I'm closing this issue for now.
Let me know if this bug still exists 🙃


Update CP analysis pipelines and environment

Update CP analysis pipelines and environment
In this PR, I have updated the CellProfiler 2ch and 4ch analysis pipelines to better segment the nuclei and cell compartments. Note that the 2ch pipeline uses Cellpose to segment the AnnexinV staining, which might lead to issues downstream in CytoTable where there might be cytoplasm without any associated nuclei (soon to be issue). The 4ch segmentation parameters were tested on the 6hr data.

@MikeLippincott Thanks for the review! I hope everything looks good on your end and I think that the results won't change too much, but hopefully improved! 🎉 I will be merging now!


about  completion backends

hi @abougouffa
I sent both cape and corfu in the configuration
According to my understanding they are the same
Question 1:
I want to know why you use both
Question 2:
What should I do if I want to use tabnine
Thank you for your frame and time : )

Hello @donneyluck
Answer 1
No, cape and corfu ARE NOT the same.
Corfu = COmpletion in Region FUnction: it allows to display completion candidates in a popup.
Cape = Completion At Point Extension: it is a set of completion backends/extensions to use for completion-at-point-functions.
The two packages are complementary, as both at built on top of the built-in Capf (Completion at point functions) mechanism.
Answer 2
I don't know, never heard of tabnine before

Please use the discussions section for direct questions not related to bugs.

ok i will thks


Buttons/shortcuts to hide subtitle tracks in subtitle player

ad624ed87c04ff9fbe063dbe1d9310739b432dee

@aiko-tanaka Letting you know that this is implemented in case it's still useful to you.
You can use D+1, D+2... to toggle subtitles in the list.
Regarding the order of the subtitle tracks, I haven't implemented any way to controls directly from asbplayer.
However, the subtitle file that you last click on when dragging files into asbplayer is always going to be the first track.


Minimal working example for Socket.Ahk

Hi, I'm trying to work with Socket.ahk via named pipes for existing compatibility with my existing codebase but I have trouble setting it up. I'm unfamiliar with socket technology so there's that as well.
From my limited understanding of the source code. I have set up something like this
Server
class TestServer extends Socket.Server {
    onREAD(wp){
        MsgBox "On Read"
    }
    onCONNECT(wp){
        MsgBox "On Connect"
    }
}

server := TestServer(,"\\.\pipe\testPipe")

Client
class TestClient extends Socket.Client {
    onREAD(data) {
        MsgBox("Client Read")
    }
    onWRITE(data){
        MsgBox "Client Write"
    }
}

tClient := TestClient("\\.\pipe\testPipe")
tClient.SendText("hi")

I assume that the server opens up the socket for listening via TestServer(,"\\.\pipe\testPipe") while the client connects to this listening port via TestClient("\\.\pipe\testPipe"). I'm definitely missing something here as this clearly doesn't work. It would be great if you could provide a minimal working example for both Server and Client classes so I know what the initial setup looks like.
I also happen to stumble across this AHK forum post but the code looks to be tailored towards communicating with LSP server which isn't my use case. I also notice the method static Call(path?, port := 1219) and the implementation doesn't seem to align with what I understood as it creates a server socket rather than a client socket.

#Include <Socket>
class TestServer extends Socket.Server {
	onACCEPT(err) {
		this.client := this.AcceptAsClient()
		this.client.onREAD := onread
		onread(this, err) {
			MsgBox("receive from client`n" this.RecvText())
			this.SendText('hello')
		}
	}
}

server := TestServer(, "\\.\pipe\testPipe")

class TestClient extends Socket.Client {
	onREAD(err) {
		MsgBox("receive from server`n" this.RecvText())
	}
}
Persistent
tClient := TestClient("\\.\pipe\testPipe")
tClient.SendText("hi")

I also happen to stumble across this AHK forum post but the code looks to be tailored towards communicating with LSP server which isn't my use case.

I tried to connect to the LSP server through the named pipe, but couldn't establish a connection to the nodejs end, while there was no problem between ahk.

Thank you for your time and the quick response. I got it working on my side too.
This particular line of code (this.client.onREAD := onread) looks a bit odd to read for me personally but I guess it implements an event handler on the client socket whenever the clients sends something? I do have additional questions if you don't mind the length
1. How do I close the socket for the following scenarios
1. Disconnecting the socket Client side after connection
2. Forcefully disconnecting the client from server side
3. Closing the server socket

I assume I should just remove the reference/pointer to those sockets and the corresponding __Delete method will be called accordingly for disposal?
2. Does this library fully allow asynchronous event handling
Normal Named Pipe servers with DLL call to ConnectNamedPipe will block the execution of the rest of the code and this proves to be a problem since I have a GUI running in my AHK application. I plan to fully refactor my codebase from using named pipes to socket depending on which is easier to maintain.
3. What are the relevant Events that I should handle for Server/Client in Named pipes or Pure Socket(in the future)
I assume only these are relevant for now? I'm only communicating via stringified JSON data between server and client

Client : onREAD
server : onACCEPT
Accepted client : onREAD

4. My Codebase isn't really communicating between 2 AHK Applications but AHK <-> C# so my solution is something like this
1. AHK -> C#, using Named Pipes
2. C# -> AHK, using WM_COPYDATA

I would rather have both side use the same method of communication but setting up named pipe server on AHK proves to be tricky as what  I mentioned on #2. I haven't tried using this library to talk with my C# named pipe server yet so that's something I'll try later on.
This is a bit out of scope but if I want to implement the socket on C# I guess this should be the class I'm working with? No worries if you are unsure about it as I'll try it out myself once I get things setup on AHK.
Are there any other platforms that I could contact you since opening an issue for questions is a bit strange to me.

1. How do I close the socket for the following scenarios
I assume I should just remove the reference/pointer to those sockets and the corresponding __Delete method will be called accordingly for disposal?

Yes, or call __Delete method to close.
If there is an onclose method, it will be triggered when the other end is disconnected.

2. Does this library fully allow asynchronous event handling

To implement any event, enable asynchronous mode, otherwise it is synchronous mode. If the onconnect method is not implemented, the connection is synchronously blocked.

3. What are the relevant Events that I should handle for Server/Client in Named pipes or Pure Socket(in the future)
I assume only these are relevant for now? I'm only communicating via stringified JSON data between server and client

Depending on the requirements, onread and onclose are generally implemented, and the server also needs to implement onaccept.

Are there any other platforms that I could contact you since opening an issue for questions is a bit strange to me.

autohotkey.com
But I didn't publish a special topic for the library

Alright, big thanks for the help.

But I didn't publish a special topic for the library

You should publish one! I struggled to get the library working until seeing your example.


null reference on FFImageLoading.Helpers.MiniLogger

Hi, guys, thanks for the great library. I wanted to said it is grateful and powerful image helper in xamarin forms. But i get this error message when I testing on it several time, it seem like can't download image and keep calling MiniLogger to display output message. I was trying to increase the RetryCount & RetryDelay, the problem isn't solve, even occur after all image download.
looking forward to heard anything from your guys, below is my detail:
I am getting Null reference  here is my full stacktrace.
at FFImageLoading.Helpers.MiniLogger.Error (System.String errorMessage, System.Exception ex) [0x00006] in <filename unknown>:0
  at FFImageLoading.Work.ImageLoaderTaskBase+<RunAsync>c__async0+<RunAsync>c__AnonStorey2+<RunAsync>c__async1.MoveNext () [0x000ea] in <filename unknown>:0
--- End of stack trace from previous location where exception was thrown ---
  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000b] in <filename unknown>:0
  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <filename unknown>:0
  at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <filename unknown>:0
  at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <filename unknown>:0
  at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () [0x00000] in <filename unknown>:0
  at FFImageLoading.Work.ImageLoaderTaskBase+<RunAsync>c__async0.MoveNext () [0x00110] in <filename unknown>:0
--- End of stack trace from previous location where exception was thrown ---
  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000b] in <filename unknown>:0
  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <filename unknown>:0
  at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <filename unknown>:0
  at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <filename unknown>:0
  at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () [0x00000] in <filename unknown>:0
  at FFImageLoading.Work.WorkScheduler+<RunAsync>c__async3.MoveNext () [0x00243] in <filename unknown>:0
--- End of stack trace from previous location where exception was thrown ---
  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000b] in <filename unknown>:0
  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <filename unknown>:0
  at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <filename unknown>:0
  at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <filename unknown>:0
  at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () [0x00000] in <filename unknown>:0
  at FFImageLoading.Work.WorkScheduler+<RunAsync>c__async3.MoveNext () [0x002ea] in <filename unknown>:0
--- End of stack trace from previous location where exception was thrown ---
  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000b] in <filename unknown>:0
  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <filename unknown>:0
  at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <filename unknown>:0
  at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <filename unknown>:0
  at System.Runtime.CompilerServices.ConfiguredTaskAwaitable+ConfiguredTaskAwaiter.GetResult () [0x00000] in <filename unknown>:0
  at FFImageLoading.Work.WorkScheduler+<Run>c__async2.MoveNext () [0x001d0] in <filename unknown>:0
--- End of stack trace from previous location where exception was thrown ---
  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000b] in <filename unknown>:0
  at System.Runtime.CompilerServices.AsyncMethodBuilderCore.<ThrowAsync>m__1 (System.Object state) [0x00000] in <filename unknown>:0`

here is my implementation:
public static FFImageLoading.Forms.CachedImage SetImagePlatformSpecific(
           ImageSource imageSource)
        {
            try
            {
                return new FFImageLoading.Forms.CachedImage()
                {
                    WidthRequest = 100,
                    HeightRequest = 100,
                    DownsampleWidth = 100,
                    RetryCount = 3,
                    RetryDelay = 250,
                    Aspect = Aspect.AspectFill,
                    CacheDuration = TimeSpan.FromDays(30),
                    HorizontalOptions = LayoutOptions.CenterAndExpand,
                    VerticalOptions = LayoutOptions.CenterAndExpand,
                    TransparencyEnabled = false,
                    //LoadingPlaceholder = (ImageSource)"<some image>",
                    //ErrorPlaceholder = (ImageSource)"<some image>",
                    Transformations = new List<FFImageLoading.Work.ITransformation>()
                    {
                        new FFImageLoading.Transformations.CircleTransformation()
                    },
                    Source = (ImageSource)imageSource
                };
            }
            catch (Exception ex)
            {
                Debug.WriteLine("Exception caught : " + ex.Message);
                return null;
            }
        }

@kirajhpang From your sample it's quite heard to understand what's going on.
Did you reference the nuget package in your iOS and Android package?
@daniel-luberda Any idea?

@molinch I follow the description on Github. Add FF library on PCL, Android, iOS project and WP (well, I know it can't work), and called init() on each platform.
I suspect that the image is fail to download so it called MiniLogger to print out message, and somehow the string is null, so it throw null reference exception.
Btw, the try catch exception didn't work, so I assume that's is no exception occur when putting the image. Exception occurs while download the image.

Could you give the URL for the image ?

I can't, it is return by the server, basically is just http URL and company own it.
Currently, maximum picture needed to be download is around 7-8 only, without this library, 4-5 image will crush definitely y java OutOfMemory exception.
Sometimes it work very smooth, but will crush after several action, exception same as above I described.

I know it is corporate stuff but would you be able to send a repro sample by email?
It will be way easier to solve

@kirajhpang You could also try to use alternative http handler (moderhttpclient) in platform specific project:
FFImageLoading.ImageService.Initialize(httpClient: new HttpClient(new NativeMessageHandler());
BTW: You don't need to cast to ImageSource (Source = (ImageSource)imageSource) - strings would work just fine!

@molinch can I have your email? I think I able to send you the images.
@daniel-luberda I quite new in Xamarin.Forms and most of my code handle in Xamarin.Forms PCL project, I got try the ImageService written on Github API page, but I have no idea how to implement it completely. Should I use DependencyService or Custom Image Render?

@kirajhpang fabien DOT molinet AT gmail DOT com

@kirajhpang You only need to add FFImageLoading.ImageService.Initialize(httpClient: new HttpClient(new NativeMessageHandler()); in every platform specific project (MainActivity.cs on Android, AppDelegate.cs on iOS)

@kirajhpang Great I just managed to reproduce it with your code sample & images

Damn that was a hard one to find!

ok, I expecting also something similar from your commit. Thanks for fix it!
Are we able to get new version from nuget now ?

@kirajhpang Pushed to nuget.
https://www.nuget.org/packages/Xamarin.FFImageLoading/
Sorry for the delay!
Could you give it a try?


WFCORE-1413 Web console doesn't accept passwords with non-ascii chara…

…cters
JIRA: https://issues.jboss.org/browse/WFCORE-1413

Can one of the admins verify this patch?

this is ok to test

Core - Full Integration Build 2776 outcome was FAILURE using a merge of b2e1dd7f9ce1389a72511739b8fd455038d7d05f
Summary: Tests failed: 1 (1 new), passed: 3305, ignored: 194 Build time: 00:57:47
Failed tests
org.jboss.as.test.integration.ejb.mdb.ejb2x.MDB20TopicTestCase.testEjb20TopicMDBs: java.lang.AssertionError: Reply message was null on reply queue: ActiveMQQueue[ejb2x/replyQueueA]
	at org.jboss.as.test.integration.ejb.mdb.ejb2x.MDB20TopicTestCase.testEjb20TopicMDBs(MDB20TopicTestCase.java:121)
------- Stdout: -------
 [0m15:51:08,007 INFO  [org.jboss.as.server.deployment] (MSC service thread 1-1) WFLYSRV0028: Stopped deployment mdb.jar (runtime-name: mdb.jar) in 21ms
 [0m [0m15:51:08,014 INFO  [org.jboss.as.repository] (management-handler-thread - 3) WFLYDR0002: Content removed from location /opt/buildAgent/work/db872761b443af46/full/testsuite/integration/basic/target/jbossas/standalone/data/content/76/d9d4cce6d6bd6d1d7ee1fb741acdc7cd5091ce/content
 [0m [0m15:51:08,014 INFO  [org.jboss.as.server] (management-handler-thread - 3) WFLYSRV0009: Undeployed "mdb.jar" (runtime-name: "mdb.jar")
 [0m15:51:08,023 INFO  [org.jboss.as.test.integration.common.jms.JMSOperationsProvider] (main) Operation successful for update = {
    "operation" => "remove",
    "address" => [
        ("subsystem" => "messaging-activemq"),
        ("server" => "default"),
        ("jms-queue" => "ejb2x/queue")
    ]
}
15:51:08,037 INFO  [org.jboss.as.test.integration.common.jms.JMSOperationsProvider] (main) Operation successful for update = {
    "operation" => "remove",
    "address" => [
        ("subsystem" => "messaging-activemq"),
        ("server" => "default"),
        ("jms-queue" => "ejb2x/replyQueue")
    ]
}
15:51:08,043 INFO  [org.jboss.as.test.integration.ejb.mdb.ejb2x.AbstractMDB2xTestCase] (main) MDB20TopicTestCase.jar:
/org/
/org/jboss/
/org/jboss/as/
/org/jboss/as/test/
/org/jboss/as/test/integration/
/org/jboss/as/test/integration/ejb/
/org/jboss/as/test/integration/ejb/mdb/
/org/jboss/as/test/integration/ejb/mdb/ejb2x/
/org/jboss/as/test/integration/ejb/mdb/ejb2x/MDB20TopicTestCase$JmsQueueSetup.class
/org/jboss/as/test/integration/ejb/mdb/ejb2x/EJB2xMDB.class
/org/jboss/as/test/integration/ejb/mdb/ejb2x/AbstractMDB2xTestCase.class
/org/jboss/as/test/integration/common/
/org/jboss/as/test/integration/common/jms/
/org/jboss/as/test/integration/common/jms/JMSOperations.class
/org/jboss/as/test/integration/common/jms/JMSOperationsProvider.class
/org/jboss/as/test/integration/common/jms/ActiveMQProviderJMSOperations.class
/org/jboss/as/test/integration/common/jms/JMSOperationsException.class
/org/jboss/as/test/shared/
/org/jboss/as/test/shared/TimeoutUtil.class
/META-INF/
/META-INF/MANIFEST.MF
/META-INF/jboss-permissions.xml
/META-INF/ejb-jar.xml
/META-INF/jboss-ejb3.xml
 [0m15:51:08,061 INFO  [org.apache.activemq.artemis.core.server] (ServerService Thread Pool -- 18) AMQ221003: trying to deploy queue jms.topic.ejb2x/topic
 [0m15:51:08,075 INFO  [org.jboss.as.test.integration.common.jms.JMSOperationsProvider] (main) Operation successful for update = {
    "operation" => "add",
    "address" => [

retest this please

Please squash the 2 commits when you rebase. Thanks!

Closing in favor of #1478 (which is just a rebase of this.)


chore(main): release 0.6.3

:robot: I have created a release beep boop
0.6.3 (2024-07-11)
Bug Fixes

Use common tracing (dfe464c)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/philipcristiano/w2z/releases/tag/v0.6.3 :sunflower:


[project-transfer] updating xgboost version

old xgboost version caused issues loading/exporting the model.
upgrading version

@rayaku
why did you request review from me? this is bug fix for existing notebook and i am not reviewing such stuff.
@oritnm  ???


IsVisible for NativeMenuItem(s)

What does the pull request do?
Add a property "IsVisible" to NativeMenuItems to allow hiding them.
Note that I only have Linux to test.
What is the current behavior?
Cannot hide NativeMenuItems, except by completely removing them from the list.
What is the updated/expected behavior with this PR?
Can hide NativeMenuItems with "IsVisible"
How was the solution implemented (if it's not obvious)?
Through the various platform-specific APIs.
Checklist

[ ] Added unit tests (if possible)?
[ ] Added XML documentation to any related classes?
[ ] Consider submitting a PR to https://github.com/AvaloniaUI/avalonia-docs with user documentation

Breaking changes

Obsoletions / Deprecations

Fixed issues

Fixes #7952

Missing declaration here, I think:
https://github.com/AvaloniaUI/Avalonia/blob/76caeedfd2baf1911f889011189d1c21657d2987/native/Avalonia.Native/src/OSX/menu.h#L53-L55
    virtual HRESULT SetIsVisible (bool isVisible) override;

Are those test failures my doing? I don't think I've touched any code that should matter for those.

Probably related. Failed tests are MacOS_Sanitizes_Access_Key_Markers_When_Included_In_Menu_Title, MacOS_Native_Menu_Has_ToolTip_If_Defined and MacOS_View_Menu_Select_Button_Tab. I can take a look what's wrong next week.

Seems to work on macOS


When I change local I don't get the translation

I used this package with L5.4 and package version 7.* everything was working fine. when I upgraded to Laravel 5.8 and package version 9.* no I don't see the translation
when I debug the local I get 'en' but the translation coming is 'ar'.

Could you please provide any more details? Code, Query, Settings and so on. Otherwise I can't help.

Yes of course
Here is my model for product category
class ProductCategory extends Model {
	use Translatable;
	public $translatedAttributes = [ 'name' ];
	protected $fillable = [ 'image', 'name', 'soft_delete' ];

	public function categoryProduct() {
		return $this->hasMany( Product::class, 'product_category_id' );
	}
}

and here is the product category translations model
class ProductCategoryTranslation extends Model {
	public $timestamps = false;
	protected $fillable = [ 'name', 'product_category_id' ];
}

Now in controller
$productCategories = ProductCategory::all(); local is English I get Arabic

@Gummibeer please if you'd like me to provide anything else let me know

At all this seems all valid. Which part of the response is wrong/arabic? The attributes or do you have arabic listed in the translations relation?

@Gummibeer when I change my local to English everything return English as static translations but the translations coming from the Database not getting the English translation.
Even I try something like this with
->whereHas( 'translations', function ( $query ) {
				$query->where( 'locale', 'en' );
			} )->first()

public function menu() {
		$categories = ( new ProductCategory )
			->where( 'soft_delete', 0 )
			->whereHas( 'translations', function ( $query ) {
				$query->where( 'locale', 'en' );
			} )->first()
			->with( 'categoryProduct' )
			->whereHas( 'categoryProduct', function ( $query ) {
				$query/*->where( 'quantity', '>', 0 )*/
				->where( 'product_category_id', '!=', null )
				->where( 'soft_delete', 0 );
			} )
			->withCount( 'categoryProduct' )
			->orderBy( 'sort_categories', 'ASC' )
			->orderBy( 'category_product_count', 'desc' )
			->get();

		return $categories;
	}

This will return Arabic data

@Gummibeer My php version 7.1.9