Entity Provider not working by default

Hello,
I am using LewikJwtBundle with Symfony 2.8.*.
I have implemented a custom User Entity (not FOSUserBundle) (following this:
http://symfony.com/doc/current/security/entity_provider.html) with username OR email login. It works correctly without LexikJwtBundle as per the official doc. However with LexikJwt it returned 401 everytime. The solution was to create a custom user provider. It could be worth mentionning in the doc?
Default test which wasn't working:
// src/AppBundle/Entity/UserRepository.php
namespace AppBundle\Entity;

use Symfony\Bridge\Doctrine\Security\User\UserLoaderInterface;
use Doctrine\ORM\EntityRepository;

class UserRepository extends EntityRepository implements UserLoaderInterface
{
    public function loadUserByUsername($username)
    {
        return $this->createQueryBuilder('u')
            ->where('u.username = :username OR u.email = :email')
            ->setParameter('username', $username)
            ->setParameter('email', $username)
            ->getQuery()
            ->getOneOrNullResult();
    }
}

and
# app/config/security.yml
security:
    # ...

    providers:
        our_db_provider:
            entity:
                class: AppBundle:User

Then afterjust creating a custom user provider in the same fashion as the one FOSUserBundle: (http://symfony.com/doc/current/security/custom_provider.html) it worked properly.
<?php

namespace UserBundle\Security\User;

use Symfony\Component\Security\Core\User\UserProviderInterface;
use Symfony\Component\Security\Core\User\UserInterface;
use Symfony\Component\Security\Core\Exception\UsernameNotFoundException;
use Symfony\Component\Security\Core\Exception\UnsupportedUserException;

class EmailUserProvider implements UserProviderInterface
{
    protected $userManager;

    public function __construct($userManager)
    {
        $this->userManager = $userManager;
    }

    public function loadUserByUsername($username)
    {
        $user = $this->userManager->getUserByUsernameOrEmail($username);

        if (!$user) {
            throw new UsernameNotFoundException(sprintf('Username "%s" does not exist.', $username));
        }

        return $user;
    }

    public function refreshUser(UserInterface $user)
    {
        if (!$user instanceof User) {
            throw new UnsupportedUserException(
                sprintf('Instances of "%s" are not supported.', get_class($user))
            );
        }

        return $this->loadUserByUsername($user->getUsername());
    }

    public function supportsClass($class)
    {
       return $class === 'UserBundle\Entity\User';
    }
}

Hi @xavierfaucon,
Thank you for reporting that!
We'll investigate and, if the bug is confirmed, we'll try to fix it.
If it can't be fixed, then it should indeed be mentioned in in the documentation.
Keep you informed here.

Hi guys,
I got the same issue as @xavierfaucon today when I implemented the security with users from my database (it was from in_memory provider until today).
Well, I fixed that issue by creating my own User Provider as @xavierfaucon did.
Hope we'll find a solution soon for future users.

Hi,
It was a good surprise to see that this bundle works as expected with this database user loading system.
I created a sample project to let you see it in action and maybe fix the problem in your code by picking the sample's one: chalasr/lexik-jwt-authentication-sandbox.
It is a strict implementation of http://symfony.com/doc/current/security/entity_provider.html.
To try it yourself, just follow the README file distributed in the repository.
I close the issue, do not hesitate to ping me for questions or details.
Cheers


Firehose crashes every 25min w/ SeaweedFS S3 server

Using:

firehose-ethereum:v1.4.4-geth-v1.12.0-fh2.2
chrislusf/seaweedfs:3.57 (though the issue was happening for many versions prior, didn't keep track)

Chain of events:

The firehose would work full speed for ~25 minutes. No error messages on either side.
After 25 minutes, the firehose would stop serving historical data, only serves last blocks. CPU usage falls to almost 0.
SeaweedFS logs many errors like this:I0927 20:02:47.092092 filechunk_manifest.go:197 read http://<IP_ADDRESS>:8080/81883,cbbda166b6a42e failed, err: read tcp
<IP_ADDRESS>:44244-><IP_ADDRESS>:8080: read: connection reset by peer
I0927 20:02:47.092110 filechunk_manifest.go:203 retry reading in 1s

Then like that:E0927 20:02:48.650523 common.go:297 processRangeRequest: read chunk: http://<IP_ADDRESS>:8080/82254,cd85ecc70c87fe?readDeleted=true: 500 Internal Server Error
2023/09/27 20:02:48 http: superfluous response.WriteHeader call from github.com/seaweedfs/seaweedfs/weed/server.processRangeRequest (common.go:298)
E0927 20:02:48.650636 filer_server_handlers_read.go:259 failed to stream content /buckets/fireeth-merged-blocks/0014719400.dbin.zst: read chunk: http://<IP_ADDRESS>:8080/82253,cd85a91873c7d3?readDeleted=true: 500 Internal Server Error

After ~5min, the Firehose finally crashes with:2023-09-27T12:50:01.846-0400 INFO (firehose) blocks archive streaming was asked to stop {"trace_id": "e98af87e6fe0eb6088a82cdc239ba4df"}
2023-09-27T12:50:01.847-0400 DEBG (firehose) source shutting down {"trace_id": "e98af87e6fe0eb6088a82cdc239ba4df", "error": "processing of file \"0013351400\" failed: error processing incoming file: failed reading next dbin message: unexpected literal count, want 92 bytes, but only 61 is available"}
2023-09-27T12:50:01.847-0400 INFO (firehose) firehose process completed {"trace_id": "e98af87e6fe0eb6088a82cdc239ba4df", "error": "processing of file \"0013351400\" failed: error processing incoming file: failed reading next dbin message: unexpected literal count, want 92 bytes, but only 61 is available"}
2023-09-27T12:50:01.847-0400 INFO (firehose) unexpected stream of blocks termination {"trace_id": "e98af87e6fe0eb6088a82cdc239ba4df", "error": "processing of file \"0013351400\" failed: error processing incoming file: failed reading next dbin message: unexpected literal count, want 92 bytes, but only 61 is available"}
2023-09-27T12:50:01.847-0400 ERRO (firehose) finished streaming call with code Internal {"grpc.start_time": "2023-09-27T12:38:43-04:00", "system": "grpc", "span.kind": "server", "grpc.service": "sf.firehose.v2.Stream", "grpc.method": "Blocks", "peer.address": "<IP_ADDRESS>:44700", "error": "rpc error: code = Internal desc = unexpected stream termination", "grpc.code": "Internal", "grpc.time_ms":<PHONE_NUMBER>}
2023-09-27T12:50:02.449-0400 INFO (firehose) processing incoming blocks request {"trace_id": "d45dd5e0349bad9fa9f4032c86ff8328", "req_start_block": 14676216, "req_cursor": "TvEQnm9CXPwCG67Os7-AwqWwLpc_DFtrUwzjKBdEj473oiOW35muUTcnbUnTk6n21Ba_TVL4iNyfF3gu98lTvYW_wbxj6nI_T3N-kYy__-K5ePbwO1wYcrpgWbyGM4rRWjjRZQz5fLQK5dS1a6DbY0pjNJUjeGWwjzlZodFSePdHuiE2xWn4eszThK6U9YVGrOUsTLajkHqnUWN9KU1Ya8-BZvCZ6TRxNw==", "req_stop_block": 0, "final_blocks_only": false, "with_index_provider": true, "transform_desc": "Combined filter: Calls:[], Logs:[{addrs: 0x7f2722741f997c63133e656a70ae5ae0614ad7f5,0x92e0d1ca2de2c8c7a11e27c4494024aa6f9e9...}], SendAllBlockHeaders: false"}
2023-09-27T12:50:02.449-0400 DEBG (firehose) setting up firehose source {"trace_id": "d45dd5e0349bad9fa9f4032c86ff8328"}
2023-09-27T12:50:02.449-0400 INFO (firehose) creating new joining source {"trace_id": "d45dd5e0349bad9fa9f4032c86ff8328", "cursor": "c1:17:14676265:51bac248afb5d330693d68df3b36e5931de2477c798b25a4ff0522f33126f8ab:14676265:51bac248afb5d330693d68df3b36e5931de2477c798b25a4ff0522f33126f8ab", "start_block_num": 14676216}
2023-09-27T12:50:02.449-0400 DEBG (bstream) error getting source_from_cursor {"error": "complete segment does not include cursor LIB (lowest block: 18228000, cursor lib: 14676265)"}
2023-09-27T12:50:02.450-0400 DEBG (bstream) couldn't open index from dstore {"error": "s3 open object (1 attempts, buffered_read: false): not found", "filename": "0014600000.100000.combined.idx"}
2023-09-27T12:50:07.628-0400 INFO (firehose) processing incoming blocks request {"trace_id": "d98c6504fe2b4a458cab3d10b4509fc7", "req_start_block": 18228360, "req_cursor": "", "req_stop_block": 18228360, "final_blocks_only": false}
2023-09-27T12:50:07.629-0400 DEBG (firehose) setting up firehose source {"trace_id": "d98c6504fe2b4a458cab3d10b4509fc7"}
2023-09-27T12:50:07.629-0400 INFO (firehose) creating new joining source {"trace_id": "d98c6504fe2b4a458cab3d10b4509fc7", "cursor": "<nil>", "start_block_num": 18228360}
2023-09-27T12:50:07.656-0400 DEBG (firehose) stream sent block {"trace_id": "d98c6504fe2b4a458cab3d10b4509fc7", "block": "#18228360 (082ff7255d20bdaef18a59afc9dc7c8e5fb22fa07456c1f5de1e121d834ab20d)", "duration": "17.017034ms"}
2023-09-27T12:50:07.656-0400 DEBG (firehose) source shutting down {"trace_id": "d98c6504fe2b4a458cab3d10b4509fc7", "error": "stop block reached"}
2023-09-27T12:50:07.656-0400 INFO (firehose) firehose process completed {"trace_id": "d98c6504fe2b4a458cab3d10b4509fc7", "error": "stop block reached"}
2023-09-27T12:50:07.656-0400 INFO (firehose) stream of blocks reached end block {"trace_id": "d98c6504fe2b4a458cab3d10b4509fc7"}
2023-09-27T12:50:07.656-0400 DEBG (firehose) finished streaming call with code OK {"grpc.start_time": "2023-09-27T12:50:07-04:00", "system": "grpc", "span.kind": "server", "grpc.service": "sf.firehose.v2.Stream", "grpc.method": "Blocks", "peer.address": "<IP_ADDRESS>:44700", "grpc.code": "OK", "grpc.time_ms": 27.53700065612793}
2023-09-27T12:50:09.077-0400 INFO (firehose) blocks archive streaming was asked to stop {"trace_id": "6befdd868c074d9f22192f3255e2156b"}
2023-09-27T12:50:09.077-0400 DEBG (firehose) source shutting down {"trace_id": "6befdd868c074d9f22192f3255e2156b", "error": "processing of file \"0016651000\" failed: error processing incoming file: failed reading next dbin message: tableLog too large"}
2023-09-27T12:50:09.077-0400 INFO (firehose) firehose process completed {"trace_id": "6befdd868c074d9f22192f3255e2156b", "error": "processing of file \"0016651000\" failed: error processing incoming file: failed reading next dbin message: tableLog too large"}
2023-09-27T12:50:09.079-0400 INFO (firehose) unexpected stream of blocks termination {"trace_id": "6befdd868c074d9f22192f3255e2156b", "error": "processing of file \"0016651000\" failed: error processing incoming file: failed reading next dbin message: tableLog too large"}
2023-09-27T12:50:09.080-0400 ERRO (firehose) finished streaming call with code Internal {"grpc.start_time": "2023-09-27T12:41:40-04:00", "system": "grpc", "span.kind": "server", "grpc.service": "sf.firehose.v2.Stream", "grpc.method": "Blocks", "peer.address": "<IP_ADDRESS>:44700", "error": "rpc error: code = Internal desc = unexpected stream termination", "grpc.code": "Internal", "grpc.time_ms":<PHONE_NUMBER>5}
panic: unable to decode block #16651067 (fb80c53f0b9ad8a026d21cf9aab801e42ea6db209de86053fead6a751f8f6477) payload (kind: ETH, version: 3, size: 1047315, sha256: 0614c58482dfdd1ebfd10abda656531bd8b81e15852dc54138ad8e0f592e9f3c): unable to decode payload: proto: cannot parse invalid wire-format data

Payload: [OMITTING HUGE LINE OF BINARY DATA]

goroutine 345531 [running]:
github.com/streamingfast/bstream.(*Block).ToProtocol(0xc02376c500)
	/home/runner/go/pkg/mod/github.com/streamingfast/bstream@v0.0.2-0.20230510131449-6b591d74130d/block.go:246 +0x6e9
github.com/streamingfast/firehose-ethereum/transform.(*CombinedFilter).Transform(0xc0003b05f8?, 0x681d52?, {0x64c0f1?, 0x3476c60?})
	/home/runner/work/firehose-ethereum/firehose-ethereum/transform/combined_filter.go:185 +0x36
github.com/streamingfast/bstream/transform.(*Registry).BuildFromTransforms.func1(0xc01fe9be00)
	/home/runner/go/pkg/mod/github.com/streamingfast/bstream@v0.0.2-0.20230510131449-6b591d74130d/transform/builder.go:82 +0x1d3
github.com/streamingfast/bstream.(*FileSource).preprocess(0xc001bcf5c0, 0xc01fe9be00, 0xc0404bb860)
	/home/runner/go/pkg/mod/github.com/streamingfast/bstream@v0.0.2-0.20230510131449-6b591d74130d/filesource.go:506 +0x5b
created by github.com/streamingfast/bstream.(*FileSource).streamReader
	/home/runner/go/pkg/mod/github.com/streamingfast/bstream@v0.0.2-0.20230510131449-6b591d74130d/filesource.go:495 +0x68a

Firehose restarts, and works normally again for ~25min.

@aasseman Do you run with DSTORE_S3_BUFFERED_READ=true or not? If not, could you try with it and see if it makes a difference?
The Seaweed logs shows http://<IP_ADDRESS>:8080 in your setup, what is this pointing to?

@aasseman Do you run with DSTORE_S3_BUFFERED_READ=true or not? If not, could you try with it and see if it makes a difference?

I've never heard of it before, it's not listed when I run fireeth start --help. Is there a list for those extra options somewhere?
I tried it and it worked! Ran for 3 hours without a crash!

The Seaweed logs shows http://<IP_ADDRESS>:8080 in your setup, what is this pointing to?

This is the address of what they call the "filer". Since I'm running SeaweedFS in the simplest form possible (single container), it spawns all of its components in it, that's why it shows as localhost.

I did mention this when we were discussing setting up S3:
https://discord.com/channels/438038660412342282/877310167060971550/1075618323594743858

I did mention this when we were discussing setting up S3:
https://discord.com/channels/438038660412342282/877310167060971550/1075618323594743858

Indeed, I didn't catch it back then... Still, it'd be nice to have it all in one place (in --help for ex) with explanations. I still don't know what DSTORE_S3_BUFFERED_READ exactly means apart from the fact that now my firehose works :shrug:

DSTORE_S3_BUFFERED_READ reads everything in memory and then act as a io.Reader interface while the normal operation is to expose the request as a io.Reader which "streams" from the HTTP request directly.
The DSTORE_S3_BUFFERED_READ increases memory usage since the full file is held in memory. It seems we have a problem with "streaming" in the S3 implementation, the same kind of weird errors has been reported on other providers.

Indeed, I didn't catch it back then... Still, it'd be nice to have it all in one place (in --help for ex) with explanations.

I don't the --help would be a good place for this sadly, the options applies to a lot of flags. But there should be a least a mention of the page where all options are listed.

Thanks @maoueh ! DSTORE_S3_BUFFERED_READ=true is a good workaround for me for now. I see that you opened an issue to tackle the underlying bug, so I think I can close this one.


Missing list of official Azure Landing Zone accelerators

Some of the types are collated here: https://aka.ms/alz/aac. This list is a good start, but it is not a comprehensive list of official Azure Landing Zones (e.g. the ones published in GitHub Azure organisation) according to my research. I collated a more comprehensive list in my repo here. I'd be happy to contribute to the https://aka.ms/alz/aac list to make it more comprehensive.
Proposal:

Add more Application ALZ accelerators (e.g. Data (Cloud-analytics), Spring Apps, Azure Container Apps).
Add a table about Scenario-specific Landing Zones
Add a table about Custom Purpose Landing Zones

@oliverlabs
Thank you for bringing this to our attention.
I've delegated this to content author @, who will review it and offer their insightful opinions.

Any comments @RobBagby ?

bump

closing as no response.

@oliverlabs, feel free to reach out to Rob directly on Teams.  He might be able to share a bit of the roadmap for ALZ accelerators in AAC.


I have a question.

Hello, thank you so much for sharing a good model.
I left a message like this because I had a question while studying the code.
Why take a search/template image, extract a feature with a vit, and then "encode each feature again from the head to the encoder" without moving directly to the decoder?
I'm asking because this is not included in the paper.
Thank you.

It's for a more stable training process, if you want to get the same accuracy without using this extra encoder, you can use the attention mask like in ARTrackV2. I think it is the best solution.

Thank you for your response. !!
I have another question.
When the seqs_input in the artrack head part is not None, it seems like a training stage, so why use the " 'feat': at" part at once without learning by predicting the coordinates sequentially like val/test??

sequentially training will lead to infinite usage of GPU memory, thus we detach each batch in temporal.

Thank you so much for your quick response!!
For example, if I get data for [batch_size,4] as input when I train, is it impossible to train by learning and updating xmin, learning and updating ymin? (like in the val/test way)

hello,
When training the artrack_seq model, why do you calculate self.actor.explore(data) and hand it over to loss instead of calculating forward_pass and loss directly like artrack?
And why do you do network work in the expore() part and network work in the loss part?

Explore is a kind of simulator to the evaluation, we try to get the real action of tracker. For example, give an sequence of frames 0, 1, 2, 3, 4 ... , 32, if we want to get the real action of tracker in the 2 frame, we should evaluate the tracker in the 0 frame to get the bounding box and prompt the 1 frame to get the specific box, after that the 0 and 1 frames box as the prompt for the 2 frame. Explore part do the things as before mentioned, after that if we directly calculate the loss in explore pare, there is a problem for training, when calculate the loss in the 2 frame, the calculate graph will include 1 frame and 0 frame, which make rapid expansion of graphics memory. As a compromise, we save the trajectory in each frame to detach each coordinate tokens in different frames, and introduce the forward_pass to execute the training.

(Frame 0 → Frame 1 → Frame 2 → … Frame 31 → Frame 32) <- Are you saying that you predict coordinates like this??
Then, is it impossible to predict the coordinates for frame 32 after extracting the features for the coordinates from frame 0 to frame 31 at once? (Like time series prediction)

I understand what you mean, thank you so much.

(Frame 0 → Frame 1 → Frame 2 → … Frame 31 → Frame 32) <- Are you saying that you predict coordinates like this??
Then, is it impossible to predict the coordinates for frame 32 after extracting the features for the coordinates from frame 0 to frame 31 at once? (Like time series prediction)

As u said, i save the predict coordinates as you mentioned.
The true reason is that we want to simulate the evaluation in tracking to reduce the bias in traditional training and inference. As we know, the frame 1's search region is cropped according to the frame0's prediction in evaluation time. So if we conduct the groundtruth as the cropped region, the tracker can not learn how to refine the tracking in real evaluation scenaiors but study how to overfit into the groundtruth. The groundtruth label lead the training and inference gap, because when inference, the frame 1's region is cropped rely on previous predict, but in training we imply the tracking is pefect.


[BUG] Undefined class constant 'XLSX'

Prerequisites

[X] Checked if your Laravel Excel version is still supported: https://docs.laravel-excel.com/3.1/getting-started/support.html#supported-versions
[ ] Able to reproduce the behaviour outside of your code, the problem is isolated to Laravel Excel.
[X] Checked that your issue isn't already filed.
[X] Checked if no PR was submitted that fixes this problem.
[X] Filled in the entire issue template

Versions

PHP version:  7.4.3
Laravel version:  6.18.3
Package version:  3.1.19

Description
I am trying to get the raw content of my export using Excel::raw(class, type). I get the error Undefined class constant XLSX.
Steps to Reproduce
From the controller, import the facade and call the raw method on it.
use Illuminate\Http\Request;
use Excel;
class PunchController extends Controller
{
    public function generateExcelReport(Request $request)
    {
        $parameters = $this->prepareReportParameters($request);
        $export = new UsersScheduleConformityExport($parameters);
        $exportString = Excel::raw($export, Excel::XLSX); // This line cause the error
    }
}

Expected behavior:
The Excel::XLSX call should not throw an error, or documentation should be revised
https://docs.laravel-excel.com/3.1/exports/collection.html#storing-raw-contents
Actual behavior:
Excel::XLSX throws an error.
Additional Information
Facade is registered in config/app.php as following 'Excel'     => Maatwebsite\Excel\Facades\Excel::class,
There are similar issues closed, but the issue was related to people using version 2.x of this package instead of 3.1
Meanwhile, as a workaround, I replaced Excel::XLSX by the string Xlsx
EDIT: I am not sure how I could test this outside my code. Any hints?

Needs to be \Maatwebsite\Excel\Excel::XLSX (See https://docs.laravel-excel.com/3.1/exports/export-formats.html ) Feel free to PR the docs  using the "Help us improve this page!" button.

still I am facing with this issue. Can any one can help me?

still I am facing with this issue. Can any one can help me?

@gopakumar180 Turns out it was not a bug, you need to verify that you import the right class : \Maatwebsite\Excel\Excel::XLSX instead of Excel::XLSX.

@gopakumar180 Turns out it was not a bug, you need to verify that you import the right class : \Maatwebsite\Excel\Excel::XLSX instead of Excel::XLSX.


Hi i am facing an error in zodiacpress wordpress plugin as mentioned blow I am using divi theme right now with it

here is my page link
https://astrologielounge.com/dein-horoskop/
you may test it when i put data and click on submit the java script code show an error
Error from search console
zp.min.js?ver=2.0.2:1 Uncaught TypeError: Cannot read property 'insertAdjacentHTML' of null
at XMLHttpRequest.n.onload (zp.min.js?ver=2.0.2:1)
n.onload @ zp.min.js?ver=2.0.2:1
load (async)
(anonymous) @ zp.min.js?ver=2.0.2:1

.github/ISSUE_TEMPLATE/bug_report.md


[11.x] Add URL::forceHttps() to enforce HTTPS scheme for URLs

This PR introduces the URL::forceHttps() method, which simplifies enforcing the HTTPS scheme for URLs without requiring the scheme name.
A useful use case is to enforce HTTPS only in the production environment. You can achieve this with the following code:
URL::forceHttps(
    $this->app->isProduction()
);

@dasundev Would you care to submit a PR to docs? 🙂

@ahinkle I couldn't do that. Maybe you can help me with that.


Why I can't open the offset editor?

If you are playing a downloaded version of the game, what operating system are you using?
Windows (x86), Windows (x86_64), Linux, or macOS? Specify below.
Windows x86
What version of the game are you using? Look in the bottom left corner of the main menu.
<IP_ADDRESS> FNF - 1.5.4 Kade Engine
Have you identified any steps to reproduce the bug? If so, please describe them below. Use images if possible.
I didn't identify anything, I just add a character
Please describe your issue. Provide extensive detail and images if possible.
When I test the game in Debug Mode on the Windows PowerShell, I enter to Freeplay and open Bopeebo, I pressed the 7 key to change the character and I tried to press the 8 key in the Chart Editor and the song and it doesn't work, I have checked the code to see the problem but I don't find any errors

7 key to chart editor.
8 key to offset editor.

Is 3 now. Than 8.

I found the error and it at line 1936. So pressing 8 or 0 keyboard is not been fixed from 1.5.3 and 1.5.4.


How to get document id when we get all documents from an envelope in 'archive' format (Zip)

We have 'archive' method to download all documents from an envelope at once , but I'm having hard time to get document info like document ID or some manifest data of the downloaded zip file , is there any way that we can achieve this ?

I'm not aware of any information you would be able to get from the zip folder itself but you could make an API call to list the envelope documents and that should return the information about the documents contained with the envelope (including the document ID and document name): https://developers.docusign.com/docs/esign-rest-api/how-to/list-envelope-documents/

Thanks for the reply @asingh611 , I’m aware of that api endpoint but only thing is would the order of the documents in the zip be the same as list of documents we get in that api response


Investigate why images don't have titles in the database

Problem

Currently, 1 096 025 images in the database don't have titles.
Description

While some of the images might really not have any titles, I suspect that most do have titles available at the providers.
We should investigate the state and re-download the information if necessary.

There are many Flickr images that don't have titles.
3 images in Phylopic do not have titles, and their foreign landing URLs also return 404 (although the direct URL works).
deploy@localhost:openledger> SELECT foreign_landing_url, provider from image where title='' and provider ='phylopic' LIMIT 10;
+----------------------------------------------------------------+----------+
| foreign_landing_url                                            | provider |
|----------------------------------------------------------------+----------|
| http://phylopic.org/image/58df2e35-c937-48b4-8519-fdff76a763ae | phylopic |
| http://phylopic.org/image/fb4c6eb0-6676-4a37-9ca2-702d76fdf521 | phylopic |
| http://phylopic.org/image/acc68846-6c2f-41ae-a9b4-53e77ede9e15 | phylopic |
+----------------------------------------------------------------+----------+

There are many Metropolitan Museum images that do not have titles:
deploy@localhost:openledger> SELECT foreign_landing_url  from image where title='' and provider ='met' LIMIT 10;
+--------------------------------------------------------+
| foreign_landing_url                                    |
|--------------------------------------------------------|
| https://www.metmuseum.org/art/collection/search/479    |
| https://www.metmuseum.org/art/collection/search/747045 |
| https://www.metmuseum.org/art/collection/search/5915   |
| https://www.metmuseum.org/art/collection/search/4542   |
| https://www.metmuseum.org/art/collection/search/4565   |
| https://www.metmuseum.org/art/collection/search/773049 |
| https://www.metmuseum.org/art/collection/search/51803  |
| https://www.metmuseum.org/art/collection/search/747045 |
| https://www.metmuseum.org/art/collection/search/747045 |
| https://www.metmuseum.org/art/collection/search/51803  |
+--------------------------------------------------------+


Better mobile calendar setup explanation

PR Checklist
Please check if your PR fulfills the following requirements:

[x] The commit message follows Conventional Commits
[ ] Tests for the changes have been added (for bug fixes / features)
[x] Docs have been added / updated (for bug fixes / features)

PR Type
What kind of change does this PR introduce?

[ ] Bugfix
[ ] Feature
[ ] Refactoring (no functional changes, no api changes)
[x] Other: docs update

What is the current behavior?
The docs for TuiMobileCalendar are unclear about the requirements for the component to work, leading to a difficult setup experience if one has never used Taiga UI.
Closes #663.
What is the new behavior?
With the changes proposed, the docs explicitly state to add TuiDialogModule in order for the component to work.
Does this PR introduce a breaking change?

[ ] Yes
[x] No

@waterplea done! Let me know 😄


LibCI enhancement - recycle all ports at start & disable all ports when finish

This PR change 2 behaviors:

When starting LibCI it used to enable all ports and discover the cameras,
If a device port was enabled on the previous run, it stays on.
If it failed and even the FW crashed on last run, this device will not be discovered in the next run as it's port is already on and the FW crashed.
Now we will always start from a fresh power cycle of the device

When LibCI finish, disable all ports.
No need to keep devices on between LibCI runs. D585S for example is projecting laser from the moment it get power.
No need for the laser to be on all weekend.
This should extend the HW life

Jetson had 2 failures,

known - t2ff WIP
profile-eq, not sure where this comes from.
I will rerun

Jetson had 2 failures,

known - t2ff WIP
profile-eq, not sure where this comes from.
I will rerun

Now it looks better, I added a 3 sec sleep after HW reset before we start the next test (for mipi (port is None) only )
Please review


Kick CI to repopulate Sauce API results

Whatever changes Sauce Labs made to their Open Sauce program recently, it seems to have had the effect of wiping out all previous results returned by the API. If you hit the wml-little-loader jobs endpoint (...until it runs this PR that is) you can see it returns an empty array, and filtering by the timestamp of the last known build doesn't help.
It could be that going forward they are simply expiring "old" results for open source accounts, but either way... let's retrigger a build, cuz right now our badge says "browsers: unknown".

Coverage remained the same at 100.0% when pulling fcc28c418d472b0a6c7904f69a177588ecde8706 on chore/kick-ci into 4f9c26c575653f422e8a132ef8160a415f17d301 on master.

The badge is back 🎉

Merging this empty commit so we get fresh Travis results for master.

If Sauce Labs is expiring old results from their API endpoint, we should be safe from the browser badge breaking in the future. I've modified the /sauce endpoint in badge-matrix to request Sauce Labs' own browser-matrix SVG by default, and simply transform it into our pretty version. So as long as Sauce keeps their badge working, we don't even need to talk to the API. (If any of the job filtering parameters are used, we still talk to the API instead.)


Mask in Groups Loses Its Width And Height

This Issue is about a graphic object's properties when turned into a mask and added into an group. I need to get the width and height properties of a graphic object mask that's in a group. It worked in the last version, but it doesn't in the current version.

A bug in the API:

Phaser version(s): 2.11.0

Live example:

What should happen:
In version 2.10.0, this is what happens:

    mask = this.game.add.graphics(0, 0);
    mask.beginFill(0xFF0000);
    mask.drawRect(0, 0, 200, 400;
    mask.endFill();
    console.log(mask.width) // shows up as 200, correct;
    console.log(mask.height) // shows up as 400, correct;

    newgroup = this.game.add.group();
    newgroup.add(mask);
    console.log(mask.width) // shows up as 200, correct;
    console.log(mask.height) // shows up as 400, correct;

What happens instead:
In the current public build of version 2.11.0, this is what happens:

    mask = this.game.add.graphics(0, 0);
    mask.beginFill(0xFF0000);
    mask.drawRect(0, 0, 200, 400;
    mask.endFill();
    console.log(mask.width); // shows up as 200, correct
    console.log(mask.height); // shows up as 400, correct

    newgroup = this.game.add.group();
    newgroup.add(mask);
    console.log(mask.width); // shows up as 0, huh?
    console.log(mask.height); // shows up as 0, huh?

I'm not sure where it's coming from, but it seems to be a read-only property. Assigning a new width or height to the mask (that's been added to a group) doesn't change it. It's still 0.

Graphics used as masks have dimensions 0 × 0. That lets mask containers (in your case, newgroup) calculate their own dimensions correctly (#334).
If you need to know the current drawn area, you can use
mask.updateLocalBounds();

var maskBounds = Phaser.Rectangle.Clone(mask._localBounds);

Maybe we can add a public method for that.
If the drawing area never changes, it's best to just define it and use it instead:
var maskBounds = new Phaser.Rectangle(0, 0, 200, 400);

Oh there it is! Thanks! What I did was take note of the width and height and put those in an object. But I might just use the _localBounds, assuming this won't be changing for a long time.


cmd/scollector: Added Elastic config options

To address: #2256

Hi @chriswhite199, I'm going to see if I can help this PR along since I'd also like this functionality in scollector.

@kylebrandt @captncraig  if either of you fine humans would be so kind as to also give your +1 before someone smacks the merge button, that'd be fantabulous.


tvalepc for illegal instruction

hi:
from table 7.2, the tvalepc description:

Exception address if ecause is 2 and interrupt is 0(illegal instruction exception), or trap value otherwise

but for section 7.3.1.

This field reports the address of illegal instructions, or the trap value otherwise. This ensures
that the address of the faulting instruction is reported for all required cases. The trap value is
set to the address of the faulting instruction for hardware breakpoints, access or page faults and
instructions, loads or stores that are mis-aligned, but not for illegal instructions (for which it is set
to the opcode)

the two descriptions are not match for illegal instruction.
which description is correct?
thanks
lujun

Lujun,
The descriptions are correct and consistent.  The ‘trap value’ in both sections refers to the tval input provided by the HART.  “This field” in section 7.3.1 is tvalepc.
From: jun.lu<EMAIL_ADDRESS>Sent: 27 October 2020 03:42
To: riscv/riscv-trace-spec<EMAIL_ADDRESS>Cc: Subscribed<EMAIL_ADDRESS>Subject: [EXTERNAL] [riscv/riscv-trace-spec] tvalepc for illegal instruction (#45)
hi:
from table 7.2, the tvalepc description:
Exception address if ecause is 2 and interrupt is 0(illegal instruction exception), or trap value otherwise
but for section 7.3.1.
This field reports the address of illegal instructions, or the trap value otherwise. This ensures
that the address of the faulting instruction is reported for all required cases. The trap value is
set to the address of the faulting instruction for hardware breakpoints, access or page faults and
instructions, loads or stores that are mis-aligned, but not for illegal instructions (for which it is set
to the opcode)
the two descriptions are not match for illegal instruction.
which description is correct?
thanks
lujun
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/riscv/riscv-trace-spec/issues/45, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ALQOPSS4UYBJ2FPGT5XAVYLSMY6PLANCNFSM4TAHUOXA.
Disclaimer
The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.
This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer and more useful place for your human generated data. Specializing in; Security, archiving and compliance. To find out more visit the Mimecast website.

thanks for yout replay


Fix environment variables in GCP deployment guide

Description of changes
Summarize the changes made by this PR.
Fix the environment variables names in the GCP deployment guide. The prefix should be TF_VAR_ instead of TF_.
Test plan
How are these changes tested?

[x] Tests pass locally with pytest for python, yarn test for js, cargo test for rust

Documentation Changes
Are all docstrings for user-facing APIs updated if required? Do we need to make documentation changes in the docs repository?

@tazarov can you take a look here?


Development: Update server and client dependencies

Update server and client dependencies. We just need to make sure all checks pass

Codecov Report

Merging #6416 (ecfda71) into develop (7397f7d) will decrease coverage by 0.01%.
The diff coverage is n/a.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@              Coverage Diff              @@
##             develop    #6416      +/-   ##
=============================================
- Coverage      80.39%   80.39%   -0.01%
  Complexity     12986    12986
=============================================
  Files           2310     2310
  Lines          88851    88851
  Branches       13142    13142
=============================================
- Hits           71434    71432       -2
- Misses          9611     9613       +2
  Partials        7806     7806

see 2 files with indirect coverage changes

Flag
Coverage Δ

client
76.44% <ø> (-0.01%)
:arrow_down:

server
84.80% <ø> (-0.01%)
:arrow_down:

Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7397f7d...ecfda71. Read the comment docs.


Fix typo

@dominicbetts : Thanks for your contribution! The author, @chrissie926, has been notified to review your proposed change.


Chat goes up and down for a while after pin or unpin fast.

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Action Performed:

Open three or four chats one by one and pin them a little faster.
Check that the user's chat position while pinning the chat.
Now unpin them a little faster.
Check that the user's chat position.

Expected Result:
The chat should not go up and down for a while after the pin or unpin.
Actual Result :
The chat goes up and down for while after the pin or unpin.
Workaround:
unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android / native
[ ] Android / Chrome
[ ] iOS / native
[ ] iOS / Safari
[x] MacOS / Chrome / Safari
[ ] MacOS / Desktop

Version Number:
Reproducible in staging?: Need reproduction
Reproducible in production?: Need reproduction
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Notes/Photos/Videos: Any additional supporting documentation
https://user-images.githubusercontent.com/43996225/229236937-acc385a2-cd0a-455f-93d2-ec9a99f014c8.mp4
Expensify/Expensify Issue URL:
Issue reported by: @ayazhussain79
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1680283936892829
View all open jobs on GitHub

Triggered auto assignment to @isabelastisser (Bug), see https://stackoverflow.com/c/expensify/questions/14418 for more details.

Bug0 Triage Checklist (Main S/O)

[ ] This "bug" occurs on a supported platform (ensure Platforms in OP are ✅)
[ ] This bug is not a duplicate report (check E/App issues and #expensify-bugs)

If it is, comment with a link to the original report, close the issue and add any novel details to the original issue instead

[ ] This bug is reproducible using the reproduction steps in the OP. S/O

If the reproduction steps are clear and you're unable to reproduce the bug, check with the reporter and QA first, then close the issue.
If the reproduction steps aren't clear and you determine the correct steps, please update the OP.

[ ] This issue is filled out as thoroughly and clearly as possible

Pay special attention to the title, results, platforms where the bug occurs, and if the bug happens on staging/production.

[ ] I have reviewed and subscribed to the linked Slack conversation to ensure Slack/Github stay in sync

Sorry, I don't have the capacity to work on this and need to reassign.

Triggered auto assignment to @tjferriss (Bug), see https://stackoverflow.com/c/expensify/questions/14418 for more details.

Bug0 Triage Checklist (Main S/O)

[ ] This "bug" occurs on a supported platform (ensure Platforms in OP are ✅)
[ ] This bug is not a duplicate report (check E/App issues and #expensify-bugs)

If it is, comment with a link to the original report, close the issue and add any novel details to the original issue instead

[ ] This bug is reproducible using the reproduction steps in the OP. S/O

If the reproduction steps are clear and you're unable to reproduce the bug, check with the reporter and QA first, then close the issue.
If the reproduction steps aren't clear and you determine the correct steps, please update the OP.

[ ] This issue is filled out as thoroughly and clearly as possible

Pay special attention to the title, results, platforms where the bug occurs, and if the bug happens on staging/production.

[ ] I have reviewed and subscribed to the linked Slack conversation to ensure Slack/Github stay in sync

I'm not able to reproduce this issue. My pins are working as expected.
https://user-images.githubusercontent.com/8292562/229916373-572c244f-4a03-41fa-a49b-3503cc13d06c.mov

@tjferriss Huh... This is 4 days overdue. Who can take care of this?

@tjferriss Huh... This is 4 days overdue. Who can take care of this?

@kavimuru are you still able to reproduce or should we close?

@tjferriss I am still not able to reproduce.


Improve file-based kernel cache

Often ~/.cupy/kernel_cache inode becomes very big. I think it's better to introduce a hierarchy e.g. using the first 2 chars from the cache key: ~/.cupy/ab/abXXXXXXXXX....cubin.
Avoid appending MD5 to a file. The reason this is introduced was to support Windows that needs special care to do atomic rename (https://github.com/cupy/cupy/pull/37/files#r115385936).
os.replace is in Python 3 so we can just use it now.
(FYI, on Windows os.replace uses MoveFileExW with MOVEFILE_REPLACE_EXISTING flag which can be considered atomic in our usecase; there is a long thread in the forum.)
Include some hint info to filename to manage cache files easily. (maybe NVRTC version and compute capability)

Often ~/.cupy/kernel_cache inode becomes very big.

I've been wondering about this. I would be interested in exploring solutions like periodically invalidating outdated caches (any update of CUDA or CuPy or CC versions could trigger this). We could also do it a bit aggressively, say purging caches older than a month. So far I've been cleaning this manually, and it would be great if there's a mechanism doing a better job than II do...😄
The hierarchy approach is not mutually exclusive to this auto invalidation, nor does it address the inode inflation problem entirely.

How about adding this tool https://github.com/cupy/cupy/blob/master/.pfnci/trim_cupy_kernel_cache.py to cupyx/tools?

Include some hint info to filename to manage cache files easily. (maybe NVRTC version and compute capability)

Also including a CuPy's major version ('8', '9', etc.) to filename may help managing caches.

How about adding this tool https://github.com/cupy/cupy/blob/master/.pfnci/trim_cupy_kernel_cache.py to cupyx/tools?

Yeah, something like this would likely help. Do users need to run this manually? Is it cross platform (i.e. support Windows)?

Do users need to run this manually?

Yes, users need to manually run the tool. Once we have a hint tag in filename we can add some more convenient filters (e.g. purge all caches for non-current CUDA versions).
I'm not sure about running it automatically. If we do this for example at startup users may see it as "import cupy is extremely slow.
Maybe ading a warning to run the tool at shutdown if os.stat('.cupy/kernel_cache').st_size (which is O(1) = do not have to  iterate all cache files) exceeds some threshold value?

Is it cross platform (i.e. support Windows)?

Yeah I wrote this for Windows CI 😄

Maybe ading a warning to run the tool at shutdown if os.stat('.cupy/kernel_cache').st_size (which is O(1) = do not have to iterate all cache files) exceeds some threshold value?

Sounds good to me, but now I am concerned with a multi-process environment like Dask or mpi4py. We might need a lock to do this...?

Is it cross platform (i.e. support Windows)?

Yeah I wrote this for Windows CI 😄

Right, I forgot, sorry 😅

btw it'd be nice to also distinguish from the hint tag whether it's ptx being cached or cubin (#4591).

related? #1890


Same issues with https://github.com/microsoft/qlib/issues/684#issue-1051706048

Hi,
I tried to run examples/model_rolling/task_manager_rolling.py  and encountered following issues, which is same with the link above.
[4490:MainThread](2022-03-16 23:41:19,948) INFO - qlib.timer - [log.py:113] - Time cost: 2.219s | CSZScoreNorm Done
[4490:MainThread](2022-03-16 23:41:19,948) INFO - qlib.timer - [log.py:113] - Time cost: 2.359s | fit & process data Done
[4490:MainThread](2022-03-16 23:41:19,948) INFO - qlib.timer - [log.py:113] - Time cost: 6.673s | Init data Done
[0]     train-rmse:1.05221      valid-rmse:1.05333
[20]    train-rmse:0.96462      valid-rmse:0.99454
[40]    train-rmse:0.94751      valid-rmse:0.99711
[60]    train-rmse:0.93133      valid-rmse:0.99901
[61]    train-rmse:0.93027      valid-rmse:0.99892
[4490:MainThread](2022-03-16 23:41:37,447) INFO - qlib.workflow - [record_temp.py:194] - Signal record 'pred.pkl' has been saved as the artifact of the Experiment 1
'The following are prediction results of the XGBModel model.'
score
datetime   instrument
2019-04-09 SH600000    0.031448
SH600009   -0.114521
SH600010    0.133871
SH600011    0.022843
SH600015   -0.006089
{'IC': 0.019224824145083887,
'ICIR': 0.12174991104957546,
'Rank IC': 0.027944959160536458,
'Rank ICIR': 0.19297428591470864}
Exception in thread Thread-8:
Traceback (most recent call last):
File "/home/liujia/anaconda3/envs/qlib/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/liujia/anaconda3/envs/qlib/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/liujia/anaconda3/envs/qlib/lib/python3.7/site-packages/qlib/utils/paral.py", line 88, in run
data()
File "/home/liujia/anaconda3/envs/qlib/lib/python3.7/site-packages/qlib/workflow/recorder.py", line 371, in log_metrics
self.client.log_metric(self.id, name, data, step=step)
File "/home/liujia/anaconda3/envs/qlib/lib/python3.7/site-packages/mlflow/tracking/client.py", line 690, in log_metric
self._tracking_client.log_metric(run_id, key, value, timestamp, step)
File "/home/liujia/anaconda3/envs/qlib/lib/python3.7/site-packages/mlflow/tracking/_tracking_service/client.py", line 233, in log_metric
self.store.log_metric(run_id, metric)
File "/home/liujia/anaconda3/envs/qlib/lib/python3.7/site-packages/mlflow/store/tracking/file_store.py", line 776, in log_metric
run_info = self._get_run_info(run_id)
File "/home/liujia/anaconda3/envs/qlib/lib/python3.7/site-packages/mlflow/store/tracking/file_store.py", line 554, in _get_run_info
run_info = self._get_run_info_from_dir(run_dir)
File "/home/liujia/anaconda3/envs/qlib/lib/python3.7/site-packages/mlflow/store/tracking/file_store.py", line 563, in _get_run_info_from_dir
run_info = _read_persisted_run_info_dict(meta)
File "/home/liujia/anaconda3/envs/qlib/lib/python3.7/site-packages/mlflow/store/tracking/file_store.py", line 104, in _read_persisted_run_info_dict
dict_copy = run_info_dict.copy()
AttributeError: 'NoneType' object has no attribute 'copy'
My collector info:
Linux
x86_64
Linux-5.13.0-35-generic-x86_64-with-debian-bullseye-sid
#40~20.04.1-Ubuntu SMP Mon Mar 7 09:18:32 UTC 2022
Python version: 3.7.11 (default, Jul 27 2021, 14:32:16)  [GCC 7.5.0]
Qlib version: <IP_ADDRESS>
numpy==1.21.5
pandas==1.3.5
scipy==1.7.3
requests==2.27.1
sacred==0.8.2
python-socketio==5.5.2
redis==4.1.4
python-redis-lock==3.7.0
schedule==1.1.0
cvxpy==1.2.0
hyperopt==0.1.2
fire==0.4.0
statsmodels==0.13.2
xlrd==2.0.1
plotly==5.6.0
matplotlib==3.5.1
tables==3.7.0
pyyaml==6.0
mlflow==1.24.0
tqdm==4.63.0
loguru==0.6.0
lightgbm==3.3.2
tornado==6.1
joblib==1.1.0
fire==0.4.0
ruamel.yaml==0.17.21

Hi liujianliuku,
I meet the same issue, but it disappeared after I run the same script again

I assume there is some thread unsafe issue in workflow_by_code.py. I will also post my log msg here.
2022-03-20 11:57:23.194 | WARNING  | qlib.tests.data:qlib_data:150 - Data already exists: ~/.qlib/qlib_data/cn_data, the data download will be skipped
       If downloading is required: `exists_skip=False` or `change target_dir`
[10671:MainThread](2022-03-20 11:57:23,195) INFO - qlib.Initialization - [config.py:402] - default_conf: client.
[10671:MainThread](2022-03-20 11:57:23,201) INFO - qlib.Initialization - [__init__.py:73] - qlib successfully initialized based on client settings.
[10671:MainThread](2022-03-20 11:57:23,202) INFO - qlib.Initialization - [__init__.py:75] - data_path={'__DEFAULT_FREQ': PosixPath('/home/q/.qlib/qlib_data/cn_data')}
[10671:MainThread](2022-03-20 11:58:25,445) INFO - qlib.timer - [log.py:113] - Time cost: 59.355s | Loading data Done
[10671:MainThread](2022-03-20 11:58:33,478) INFO - qlib.timer - [log.py:113] - Time cost: 0.272s | DropnaLabel Done
/home/q/FundFusion/env/lib/python3.8/site-packages/pandas/core/frame.py:3641: SettingWithCopyWarning:
A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
 self[k1] = value[k2]
[10671:MainThread](2022-03-20 11:58:38,979) INFO - qlib.timer - [log.py:113] - Time cost: 5.500s | CSZScoreNorm Done
[10671:MainThread](2022-03-20 11:58:38,981) INFO - qlib.timer - [log.py:113] - Time cost: 13.535s | fit & process data Done
[10671:MainThread](2022-03-20 11:58:38,981) INFO - qlib.timer - [log.py:113] - Time cost: 72.892s | Init data Done
                          KMID      KLEN     KMID2       KUP      KUP2      KLOW     KLOW2      KSFT     KSFT2  ...   VSUMN20   VSUMN30   VSUMN60    VSUMD5   VSUMD10   VSUMD20   VSUMD30   VSUMD60    LABEL0
datetime   instrument                                                                                ...
2008-01-02 SH600000    0.010377  0.061132  0.169754  0.028302  0.462962  0.022453  0.367285  0.004528  0.074077  ...  0.490807  0.485962  0.510337 -0.022349 -0.101278  0.018386  0.028076 -0.020675  0.042068
          SH600004    0.057279  0.059666  0.960000  0.002387  0.040000  0.000000  0.000000  0.054893  0.920001  ...  0.392360  0.423984  0.514932  0.633267  0.342211  0.215280  0.152031 -0.029863  0.000000
          SH600006    0.012673  0.040323  0.314285  0.008065  0.200000  0.019585  0.485715  0.024194  0.600000  ...  0.433405  0.494553  0.524930 -0.064064 -0.045677  0.133190  0.010894 -0.049861 -0.008830
          SH600007    0.066977  0.084186  0.795579  0.007907  0.093923  0.009302  0.110498  0.068372  0.812153  ...  0.291541  0.352613  0.420448  0.878055  0.514779  0.416918  0.294774  0.159104  0.007496
          SH600008    0.051163  0.082326  0.621469  0.027907  0.338984  0.003256  0.039547  0.026512  0.322033  ...  0.381852  0.400486  0.469882  0.482783  0.148572  0.236296  0.199027  0.060235 -0.015445

[5 rows x 159 columns]
[10671:MainThread](2022-03-20 11:58:45,679) INFO - qlib.workflow - [expm.py:318] - <mlflow.tracking.client.MlflowClient object at 0x7f9db78547f0>
[10671:MainThread](2022-03-20 11:58:45,708) WARNING - qlib.workflow - [expm.py:198] - No valid experiment found. Create a new experiment with name workflow.
[10671:MainThread](2022-03-20 11:58:45,712) INFO - qlib.workflow - [exp.py:257] - Experiment 1 starts running ...
[10671:MainThread](2022-03-20 11:58:46,068) INFO - qlib.workflow - [recorder.py:293] - Recorder 7efca793ef574b4ca1c0b25218f090d7 starts running under Experiment 1 ...
Training until validation scores don't improve for 50 rounds
[20]    train's l2: 0.99032     valid's l2: 0.99407
[40]    train's l2: 0.98654     valid's l2: 0.993434
[60]    train's l2: 0.983952    valid's l2: 0.993192
[80]    train's l2: 0.981825    valid's l2: 0.993024
[100]   train's l2: 0.97992     valid's l2: 0.992874
[120]   train's l2: 0.978043    valid's l2: 0.992838
[140]   train's l2: 0.976317    valid's l2: 0.992838
[160]   train's l2: 0.974702    valid's l2: 0.992849
[180]   train's l2: 0.97313     valid's l2: 0.992885
[200]   train's l2: 0.971546    valid's l2: 0.992959
Early stopping, best iteration is:
[168]   train's l2: 0.974048    valid's l2: 0.992791
[10671:MainThread](2022-03-20 11:59:55,049) INFO - qlib.workflow - [record_temp.py:194] - Signal record 'pred.pkl' has been saved as the artifact of the Experiment 1
'The following are prediction results of the LGBModel model.'
                         score
datetime   instrument
2017-01-03 SH600000   -0.036180
          SH600008    0.012532
          SH600009    0.036990
          SH600010   -0.020218
          SH600015   -0.129913
{'IC': 0.05148803800355824,
'ICIR': 0.42031572365231823,
'Rank IC': 0.05356542355384916,
'Rank ICIR': 0.4463195692082111}
[10671:MainThread](2022-03-20 11:59:56,221) INFO - qlib.backtest caller - [__init__.py:82] - Create new exchange
[10671:MainThread](2022-03-20 12:00:07,081) WARNING - qlib.BaseExecutor - [executor.py:111] - `common_infra` is not set for <qlib.backtest.executor.SimulatorExecutor object at 0x7f9e4dcb6d90>
backtest loop:   0%|                                                                                | 0/871 [00:00<?, ?it/s]/home/q/FundFusion/env/lib/python3.8/site-packages/qlib/utils/index_data.py:480: RuntimeWarning: Mean of empty slice
 return np.nanmean(self.data)
backtest loop: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 871/871 [00:17<00:00, 49.72it/s]
[10671:MainThread](2022-03-20 12:00:25,565) INFO - qlib.workflow - [record_temp.py:499] - Portfolio analysis record 'port_analysis_1day.pkl' has been saved as the artifact of the Experiment 1
'The following are analysis results of benchmark return(1day).'
                      risk
mean               0.000477
std                0.012295
annualized_return  0.113561
information_ratio  0.598699
max_drawdown      -0.370479
'The following are analysis results of the excess return without cost(1day).'
                      risk
mean               0.000687
std                0.005483
annualized_return  0.163574
information_ratio  1.933691
max_drawdown      -0.097084
'The following are analysis results of the excess return with cost(1day).'
                      risk
mean               0.000492
std                0.005482
annualized_return  0.117084
information_ratio  1.384504
max_drawdown      -0.105894
[10671:MainThread](2022-03-20 12:00:25,584) INFO - qlib.workflow - [record_temp.py:524] - Indicator analysis record 'indicator_analysis_1day.pkl' has been saved as the artifact of the Experiment 1
'The following are analysis results of indicators(1day).'
    value
ffr    1.0
pa     0.0
pos    0.0
Exception in thread Thread-7:
Traceback (most recent call last):
 File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
   self.run()
 File "/usr/lib/python3.8/threading.py", line 870, in run
   self._target(*self._args, **self._kwargs)
 File "/home/q/FundFusion/env/lib/python3.8/site-packages/qlib/utils/paral.py", line 88, in run
   data()
 File "/home/q/FundFusion/env/lib/python3.8/site-packages/qlib/workflow/recorder.py", line 373, in log_metrics
   self.client.log_metric(self.id, name, data, step=step)
 File "/home/q/FundFusion/env/lib/python3.8/site-packages/mlflow/tracking/client.py", line 690, in log_metric
   self._tracking_client.log_metric(run_id, key, value, timestamp, step)
 File "/home/q/FundFusion/env/lib/python3.8/site-packages/mlflow/tracking/_tracking_service/client.py", line 233, in log_metric
   self.store.log_metric(run_id, metric)
 File "/home/q/FundFusion/env/lib/python3.8/site-packages/mlflow/store/tracking/file_store.py", line 776, in log_metric
   run_info = self._get_run_info(run_id)
 File "/home/q/FundFusion/env/lib/python3.8/site-packages/mlflow/store/tracking/file_store.py", line 554, in _get_run_info
   run_info = self._get_run_info_from_dir(run_dir)
 File "/home/q/FundFusion/env/lib/python3.8/site-packages/mlflow/store/tracking/file_store.py", line 563, in _get_run_info_from_dir
   run_info = _read_persisted_run_info_dict(meta)
 File "/home/q/FundFusion/env/lib/python3.8/site-packages/mlflow/store/tracking/file_store.py", line 104, in _read_persisted_run_info_dict
   dict_copy = run_info_dict.copy()
AttributeError: 'NoneType' object has no attribute 'copy'
[10671:MainThread](2022-03-20 12:00:25,620) INFO - qlib.timer - [log.py:113] - Time cost: 0.005s | waiting `async_log` Done

And
Linux
x86_64
Linux-5.4.72-microsoft-standard-WSL2-x86_64-with-glibc2.29
#1 SMP Wed Oct 28 23:40:43 UTC 2020

Python version: 3.8.10 (default, Nov 26 2021, 20:14:08)  [GCC 9.3.0]

Qlib version: <IP_ADDRESS>
numpy==1.21.4
pandas==1.3.4
scipy==1.7.2
requests==2.27.1
sacred==0.8.2
python-socketio==5.5.2
redis==4.1.4
python-redis-lock==3.7.0
schedule==1.1.0
cvxpy==1.2.0
hyperopt==0.1.2
fire==0.4.0
statsmodels==0.13.2
xlrd==2.0.1
plotly==5.6.0
matplotlib==3.5.0
tables==3.7.0
pyyaml==6.0
mlflow==1.24.0
tqdm==4.62.3
loguru==0.6.0
lightgbm==3.3.2
tornado==6.1
joblib==1.1.0
fire==0.4.0
ruamel.yaml==0.17.21

Right, I can replay these issues when I run two processes of task_manager_rolling  simultaneously, after hours running, it will fail like this.

I'm trying to replay this issue and I find that some times it does occur and some times it doesn't. Is there a stable way to replay this issue?

I meet the same issue. According to the exception, I think it is related to async call by MLflow, which causes thread unsafe issue. But I don't know how to deal with this issue.

same issue,by debug, when this error,meta.yaml is empty,that cause this error.
but after continue,meta.yaml will has value

This error keeps poping up and is quite annoying.


[feat]: Select fields update

Feature description
Select field should be able to accept number values too not only string
Affected component/components
Select
Additional Context
Additional details here...
Before submitting

[X] I've made research efforts and searched the documentation
[X] I've searched for existing issues and PRs

Yep would be good to add. Would appreciate this as well.


Fix #375 Add more formatting options

Introduce some more formatting options related to:

inserting a newline at the end of the file
trimming whitespace at the end of a line
trimming excessive newlines at the end of the file

This fixes #375.

I didn't update the change log as I presume we want to update it only when everything for 3.15.0 is good to go.

Merged by hand into dbaeumer/3.15.


Can't drag tabs to adjust order in Winui3 for a tabview

Describe the bug
Can't drag tabs to adjust order in Winui3 for a tabview
Steps to reproduce the bug

Steps to reproduce the behavior:

Go to Xaml-Controls-Gallery Tab View Page
Try to move document3 to front of document2 using a mouse

Expected behavior
moved
Screenshots

Version Info
winui3 alpha
NuGet package version:

Windows 10 version
Saw the problem?

Insider Build (xxxxx)

November 2019 Update (18363)
Yes

May 2019 Update (18362)

October 2018 Update (17763)

April 2018 Update (17134)

Fall Creators Update (16299)

Creators Update (15063)

Device form factor
Saw the problem?

Desktop
Yes

Mobile

Xbox

Surface Hub

IoT

Additional context

@Austin-Lamb FYI, looks like a bug coming in from the work Xaml Controls Gallery did to run their tests against winui3.  We should investigate/track.

This works now in the 0.8 release (albeit with some visual problems tracked by other issues).


update "Unit Testing with Robolectric" page for Android studio versions 2+

Steps to configure Android studio and screenshots need to be updated.

Can you take a stab to update it?


Webhook support?

I might be missing something obvious, so I apologize if so, but I can't see where webhook support is implemented (if it is). If there is, can you point me in the right direction, and if not, do we have plans to add it? Thanks in advanced.

@jbaugh I missed this question somehow, sorry for the delay. There isn't any webhook support built into the library currently. I've never made use of their webhooks and never had cause to implement them.
A PR would certainly be welcome, even if only for a subset of the potential events: https://developers.braintreepayments.com/guides/webhooks/overview

@sorentwo I think I'll work on that. I got it working for my use case, so I think I might be able to at least get something put together than can help :)

@jbaugh @sorentwo  - I ended up sharing some code I made for validation to check the initial webhook payload because I desperately wanted something like this for my use case, not sure if it overlaps with any of your proposed changes @jbaugh, but happy to find a way to collaborate if you'd like.


NN parse error

The search.py class find_nouns appears to be slightly broken.
NN and NNP tags are found, but not all are included, and I'm not quite sure why that is.
Example question:
Barney Stinson is a character from which TV show?

Question nouns: ['character', 'barney stinson']
Running method 3
Search processed
URLs fetched

Arrow: {'character': 46, 'barney stinson': 0}
Community: {'character': 14, 'barney stinson': 0}
How I Met Your Mother: {'character': 7, 'barney stinson': 14}

Keyword scores: {'Arrow': 302, 'Community': 166, 'How I Met Your Mother': 247}
Noun scores: {'Arrow': 46, 'Community': 14, 'How I Met Your Mother': 21}
Arrow
Search took 6.013584613800049 seconds

Here, "TV show" should be another instance in the list of question_key_nouns, as there are two consecutive NN tags, but it isn't. NNS tags should probably be included too I think, or really NN* since there are 4 POS tags for nouns, unless this elif:
elif "NN" in tag_type or "NNP" in tag_type:

includes them already.

It didn't include TV show because it includes a certain number of nouns on the opposite side of the question word. Don't know how method 1 failed to detect "how i met your mother" because it worked on my machine. For method 3, you would have to determine yourself that "barney stinson" is  the more important noun.
You might not have the most updated repository, because that line of code does not exist anymore. "NN" in tag_type detects all types of nouns.


Not Working In A1111 1.10?

Does this not work in A1111 1.10? Can this be updated please?

Sorry my bad, my UI keeps becoming disconnected with the console. I got it working now. Please delete this thread if you can. I shall close this too.


Version mismatch between README and published crate

The latest version published to https://crates.io/crates/tonlib is tonlib = "0.17.6", but the Usage section in the README refers to version 0.19: https://github.com/ston-fi/tonlib-rs#usage.

Thank you for noticing this issue. We are splittng former tonlib-rs into two crates tonlib-core and  tonlib-client.
The readme will be updated soon.


Convert the hand tool, interfaces and secondary toolbar to ES6 syntax

Easier reviewing with https://github.com/mozilla/pdf.js/pull/8391/files?w=1.

/botio-linux preview


Custom Emoji Cache, now without Database

Uses numerical id for the file name (inspired by Discord itself) so averted colon issue
Caches get more reliable
Lightly tested
Confidence Level 6/10

lgtm
disclaimer: did not look too hard


Engines built on LÖVE?

I don't know if this has a place here, since it's probably not appropriate for the list, but thought I might ask.
The folks from @Planimeter and I have been working on Grid for a while and was wondering if it would be appropriate to add to an Engines powered by LÖVE category or something of the sort.
There's a small handful of us in the engine development community that have built full-blown engines on LÖVE's framework and thought it would be a nice addition to the list.
If that's acceptable, I'll submit a PR, but wanted to check beforehand.

I think the idea of showing Engines built on Löve is great. I actually had a category for that in my initial draft. But since the only nearly finished Löve Engine I could find was by @adonaac I removed the category.
So overall I would love to have them in the list, but the documentation has to on par with the other libraries. That doesn't seem to be the case with Grid though. The Features, Tutorials & API are missing descriptions and examples. I'm sorry but in this state I won't add it to the list (happend before and is noted in the contribution notes)


Add Java 17 to build

Similar to https://github.com/XRPLF/xrpl4j/issues/141, we should add Java 17 to the build now that Java 17 is GA.

Kindly assign to me


Add ADMM Algorithm

Initial implementation of the ADMM algorithm.
Needs testing.
closes #72

see #364


⚠ ClamAV has degraded performance

In ff56844, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 56 ms

Resolved: ClamAV performance has improved in 5643c93.


data parallel training uses local init score for some objectives, but should use a global init score

Description
Created from https://github.com/microsoft/LightGBM/pull/4332#issuecomment-853657414.
During distributed training, when a user-provided init_score is not given (the default), each worker determines an initial score to boost from based on its local data. These initial scores are then synced up by mean between all workers.
In situations where the distribution of the target is very different across different workers, this could lead to a lower-quality initial score, which might increase the number of boosting rounds it takes to fit to the training data.
#4332 addressed this for binary classification, but this problem is still present in other objectives. See https://github.com/microsoft/LightGBM/pull/4332#pullrequestreview-686980969.
Reproducible example
Environment info
LightGBM version or commit hash: https://github.com/microsoft/LightGBM/commit/0701a32da9fae7b2de8a01d702fa7d6abf36e836
Command(s) you used to install LightGBM: this affects any installation of LightGBM used for distributed training.
Additional Comments
I've given this the label "dask" because it will affect training with lightgbm.dask, but it is not specific to this project's Dask interface. Any other distributed training option (https://lightgbm.readthedocs.io/en/latest/Parallel-Learning-Guide.html#integrations) will be affected by this as well.

@shiyu1994 please feel free to edit the description to add more details or fix anything I've written that is misleading or incorrect.
copying @imatiach-msft , as I think this issue is relevant for mmlspark as well.


[type: refactor] refactor shenyu divide plugin

// Describe your PR here; eg. Fixes #issueNo

Make sure that:

[ ] You have read the contribution guidelines.
[ ] You submit test cases (unit or integration tests) that back your changes.
[ ] Your local test passed mvn clean install -Dmaven.javadoc.skip=true.

Codecov Report

Merging #3324 (88c703c) into master (3398a80) will decrease coverage by 0.17%.
The diff coverage is 0.00%.

@@             Coverage Diff              @@
##             master    #3324      +/-   ##
============================================
- Coverage     64.33%   64.15%   -0.18%
+ Complexity     5173     5161      -12
============================================
  Files           743      743
  Lines         20971    20970       -1
  Branches       1918     1918
============================================
- Hits          13492    13454      -38
- Misses         6200     6229      +29
- Partials       1279     1287       +8

Impacted Files
Coverage Δ

...common/dto/convert/rule/impl/DivideRuleHandle.java
75.75% <ø> (-1.39%)
:arrow_down:

.../org/apache/shenyu/plugin/divide/DividePlugin.java
38.63% <0.00%> (-3.23%)
:arrow_down:

...controller/ShenyuClientHttpRegistryController.java
77.77% <0.00%> (-22.23%)
:arrow_down:

...ache/shenyu/plugin/grpc/cache/GrpcClientCache.java
87.50% <0.00%> (-12.50%)
:arrow_down:

...ruptor/RegisterClientServerDisruptorPublisher.java
52.94% <0.00%> (-11.77%)
:arrow_down:

...a/org/apache/shenyu/common/utils/VersionUtils.java
67.85% <0.00%> (-10.72%)
:arrow_down:

...henyu/plugin/grpc/resolver/ShenyuNameResolver.java
54.25% <0.00%> (-9.58%)
:arrow_down:

.../logging/rocketmq/utils/LogCollectConfigUtils.java
66.66% <0.00%> (-8.89%)
:arrow_down:

...ng/rocketmq/rocketmq/RocketMQLogCollectClient.java
68.00% <0.00%> (-8.00%)
:arrow_down:

...rg/apache/shenyu/plugin/rewrite/RewritePlugin.java
66.66% <0.00%> (-5.56%)
:arrow_down:

... and 5 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3398a80...88c703c. Read the comment docs.


Update AksEdgeQuickStartForAio.ps1

Script fails with:
Associate Custom location with temptemp002 cluster
ERROR: argument --custom-locations-oid: expected one argument

When piping to Out-Null the variable $objectId is empty.

Closing since this is included in PR #163


chore(update): Updated gatsby-ipfs-web-wallet dependencies

PR related to this trello task --> https://trello.com/c/c6wpCuGi

:tada: This PR is included in version 1.25.2 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Dont force rustformating

Default seems okay
Inspired from https://github.com/rust-lang/crates.io/blob/master/.rustfmt.toml

Thank you :)


raidboss: a7s fr

adds missing translations fr + removal missingTransaltion.
Several lines disturbed me, so I have a question to be sure of what I translated in replaceSync.
Here is what I translated
'Frostbite': 'gelure',
'Pyretic': 'chaleur',
'Quickthinx Allthoughts': 'Quickthinx le Cerveau',
'Shanoa': 'Chat-noir',

is that correct, or should be whole lines like below?
Quickthinx Allthoughts uses Sizzlespark
Quickthinx Allthoughts uses Zoomdoom
Quickthinx Allthoughts uses Sizzlebeam
Quickthinx Allthoughts uses Flamethrower
Shanoa readies Undying Affection
suffers the effect of Pyretic
suffers the effect of Frostbite

Yeah, this is marked as timelineNeedsFixing: true, because this timeline is not done.  It shouldn't show up in util/find_missing_translations.py and I would not recommend doing translations for this timeline at this point.

If I understood correctly, what I wrote in replaceSync is correct?
How to resolve this ?  fr:no translation for replaceText '' sorry for the inconvenience.
it appears in the txt file.
924 ""
924 ""
924 ""
924 ""
924 ""
924 ""
924 ""
924 ""
924 ""

util/find_missing_translations.py -l fr does not list anything for the a7s timeline.
Sorry, please do not do translations for the a7s timeline until some point in the future when it is rewritten.

Ok, I restored the replacText section, and just left the triggers additions. There is just a fix and addition of the zone name in replaceSync.


What happens if you change to "Do not allow users to create app passwords to sign in to non-browser apps"

I think it would be good to clarify on this page what happens if you change to (o) Do not allow users to create app passwords to sign in to non-browser apps after the fact and you know if you have users that use app passwords. Will this instantly block all those users using it today or will the continue to work and only block creation of NEW app passwords?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 42fff764-77f2-2878-f27f-867c71d9a8fc
Version Independent ID: 669c3568-eedc-f959-01d6-fcde93b9daaa
Content: Configure app passwords for Azure Multi-Factor Authentication - Azure Active Directory
Content Source: articles/active-directory/authentication/howto-mfa-app-passwords.md
Service: active-directory
Sub-service: authentication
GitHub Login: @iainfoulds
Microsoft Alias: iainfou

@JonesMikael
Thanks for your feedback! We will investigate and update as appropriate.

Thanks for the feedback, @JonesMikael
All you're controlling is the ability to create app passwords. Users can still use existing app passwords when you disable this ability. Ideally, you'd disable the ability to create app passwords, then use a Conditional Access policy to disable legacy authentication methods.
I'll update the to doc to make it clear you're not disabling the use of any existing app passwords.
#in-progress


Allow receive data length bigger than expected

Hello
I'm trying read data from my company energy meter with your plugin but I'm getting problem with a data length bigger than expected "Error: Data length error, expected 7 got 9"
I don't know if this is a mistake of their modbus implementation or if in fact this is possible. Just to explain.
All registers are consecutive with some of them single others double:
Index  Address  data
1         0x0001      FF FF               (single)
2         0x0002      FF FF FF FF      (double)
3         0x0003      FF FF FF FF
4         0x0004      FF FF
5 ...
When I read single registers like 1 or 4 I've no problem
I get "Error: Data length error, expected 7 got 9" when I try read "double registers"
Is there a way to add possibility to overcome this limitation?
Best regards
ENina

Hello, to complete information above
Meter information JANZ 3801 (national company meter)
Example of single register:
Voltage -> Index 108 (HEX -> 6C )
resquest:  00 01 00 00 00 06 01 04 00 6c 00 01
response: 00 01 00 00 00 05 01 04 02 08 E5  ->  (hex 08 e5  -> 2277  -> 227,7V)
Example of double register:
rate 1 total energy -> Index 38 (HEX -> 26 )
resquest:  00 01 00 00 00 06 01 04 00 26 00 01
response: 00 01 00 00 00 07 01 04 04 00 01 92 B1  ->  (hex 00 01 92 B1  -> 103089  -> 103,089 kwh)
As you can see request is exactly the same but response output is different
It make sense add the possibility to add a switch to not compare data lengths, or a function to mention expected size of response?
Best regards
ENina

Hello ENina,
I am not sure this possibility is in the standard.
I have dissected the modbus request and response and those are correct (not expected but still correct):
Example of single register:
Voltage -> Index 108 (HEX -> 6C )
request:
Transaction Identifier: 00 01
Protocol Identifier: 00 00
Length: 00 06 (only the * are counted)

Unit Identifier: 01
Function Code: 04
Starting Address: 00 6c
Quantity of Registers: 00 01
response:
Transaction Identifier: 00 01
Protocol Identifier: 00 00
Length: 00 05 (only the * are counted)
Unit Identifier: 01
Function Code: 04
Byte count: 02
Input Registers: 08 E5 -> (hex 08 e5 -> 2277 -> 227,7V)

Example of double register:
rate 1 total energy -> Index 38 (HEX -> 26 )
request:
Transaction Identifier: 00 01
Protocol Identifier: 00 00
Length: 00 06 (only the * are counted)

Unit Identifier: 01
Function Code: 04
Starting Address: 00 26
Quantity of Registers: 00 01
response:
Transaction Identifier: 00 01
Protocol Identifier: 00 00
Length: 00 07 (only the * are counted)
Unit Identifier: 01
Function Code: 04
Byte count: 04
Input Registers: 00 01 92 B1 -> (hex 00 01 92 B1 -> 103089 -> 103,089 kwh)

Whet if you ask in the request not 1 but 2 register for the address 0x26  ?
Will your device give an error ?

Hello,
yes it give error.
Them error message is:
Error: Data length error, expected 9 got 13
Replay data is:
resquest: 00 01 00 00 00 06 01 04 00 26 00 02
response: 00 01 00 00 00 0B 01 04 08 00 01 A2 CA, 00, 00, 58, 58
00 01 A2 CA are the data for register 0x26
->    rate 1 total energy - 107,210 kwh
00, 00, 58, 58 are the data for register 0x27
->    rate 2 total energy - 22,616 kwh

error messages are from Node Red

To complete my statements before, i can communicate with my device trough windows program and no problem at all (data/examples I provide are taken from that), issue is with Node-red plugin node-red-contrib-modbus, that brake with the messages "Data length error, expected XX got YY" and no data are show/retained.
It's possible add a switch to not compare data lengths, or a function to mention expected size of response?
If not, can give me some hints how to delete/baypass this check on the code of plugin?

Hello I have done some digging in the code. It seem this error is not from the code made by christian but from the base library :
https://github.com/yaacov/node-modbus-serial/
Maybe you can try to ask there.
Unfortunately we can disable this check in the node, this must be done in the library.

We will check for new updates for serial here.


upgrade gdal and R using r2u to have unlimited GeoTIFF metadata

Problem with terra::writeRaster():
Metadata exceeding 32000 bytes cannot be written into GeoTIFF. Transferred to PAM instead.

https://github.com/OSGeo/gdal/issues/4116#issue-944780416
fix: https://github.com/OSGeo/gdal/commit/0e4f770d547b1b3424959bd239c230bb97fdf3e7

This limitation came from the initial revision of metadata writing, in e86e2db, 20 years ago. There's no limitation in the TIFF spec nor in libtiff itself, to text tag data larger than 32 KB, so just remove it.

terra::gdal() # "3.4.1" on server

terra::gdal() # "3.5.3" on Mac

GDAL 3.5.0 - Overview of Changes
https://github.com/OSGeo/gdal/blob/v3.5.0/NEWS.md
May 9, 2022

remove limitation to 32,000 bytes when writing the GDAL metadata tag (#4116)

r2u, stars

CRAN as Ubuntu Binaries - r2u
How to Install R on Ubuntu 20.04 and 22.04
Spatiotemporal Arrays, Raster and Vector Data Cubes • stars
2. stars proxy objects • stars


Create endpoint to get subscription status of a user for a stream

This endpoint will be convenient for clients (like zulip-mobile) instead of fetching the complete list of subscribers to a stream (which can be very large).
The endpoint can be of the form /users/{user_id}/subscription/{stream_id, returning data in a JSON format: {"subscribed": true}, so that it can be extended in the future to include other fields like stream_admin: true or role etc.
See also:
Discussion on CZO
zulip-mobile issue

@timabbott said:
We'll want it to be extensible to have other fields, like `stream_admin: true` or `role` if we format it that way.

@zulipbot claim


cannot train LSTM policy by PPO2 when mujoco env is selected

Hi,
I think I discovered bug when I train LSTM Policy by PPO2 when mujoco env is selected.
I run this code.
python -m baselines.run --alg=ppo2 --env=Reacher-v2 --num_timesteps=1e6 --network=lstm --nminibatches=2 --num_env=4
and I get this error.

Traceback (most recent call last):
File "/home/isi/yoshida/anaconda3/envs/baselines/lib/python3.5/runpy.py", line 193, in _run_module_as_main
"main", mod_spec)
File "/home/isi/yoshida/anaconda3/envs/baselines/lib/python3.5/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/home/isi/yoshida/baselines/baselines/run.py", line 235, in
main()
File "/home/isi/yoshida/baselines/baselines/run.py", line 214, in main
model, _ = train(args, extra_args)
File "/home/isi/yoshida/baselines/baselines/run.py", line 69, in train
**alg_kwargs
File "/home/isi/yoshida/baselines/baselines/ppo2/ppo2.py", line 245, in learn
obs, returns, masks, actions, values, neglogpacs, states, epinfos = runner.run() #pylint: disable=E0632
File "/home/isi/yoshida/baselines/baselines/ppo2/ppo2.py", line 104, in run
actions, values, self.states, neglogpacs = self.model.step(self.obs, S=self.states, M=self.dones)
File "/home/isi/yoshida/baselines/baselines/common/policies.py", line 89, in step
a, v, state, neglogp = self._evaluate([self.action, self.vf, self.state, self.neglogp], observation, **extra_feed)
File "/home/isi/yoshida/baselines/baselines/common/policies.py", line 71, in _evaluate
return sess.run(variables, feed_dict)
File "/home/isi/yoshida/anaconda3/envs/baselines/lib/python3.5/site-packages/tensorflow/python/client/session.py", line 877, in run
run_metadata_ptr)
File "/home/isi/yoshida/anaconda3/envs/baselines/lib/python3.5/site-packages/tensorflow/python/client/session.py", line 1100, in _run
feed_dict_tensor, options, run_metadata)
File "/home/isi/yoshida/anaconda3/envs/baselines/lib/python3.5/site-packages/tensorflow/python/client/session.py", line 1272, in _do_run
run_metadata)
File "/home/isi/yoshida/anaconda3/envs/baselines/lib/python3.5/site-packages/tensorflow/python/client/session.py", line 1291, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InvalidArgumentError: You must feed a value for placeholder tensor 'ppo2_model/vf/Placeholder_1' with dtype float and shape [1,256]
[[Node: ppo2_model/vf/Placeholder_1 = Placeholderdtype=DT_FLOAT, shape=[1,256], _device="/job:localhost/replica:0/task:0/device:CPU:0"]]
Caused by op 'ppo2_model/vf/Placeholder_1', defined at:
File "/home/isi/yoshida/anaconda3/envs/baselines/lib/python3.5/runpy.py", line 193, in _run_module_as_main
"main", mod_spec)
File "/home/isi/yoshida/anaconda3/envs/baselines/lib/python3.5/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/home/isi/yoshida/baselines/baselines/run.py", line 235, in
main()
File "/home/isi/yoshida/baselines/baselines/run.py", line 214, in main
model, _ = train(args, extra_args)
File "/home/isi/yoshida/baselines/baselines/run.py", line 69, in train
**alg_kwargs
File "/home/isi/yoshida/baselines/baselines/ppo2/ppo2.py", line 230, in learn
model = make_model()
File "/home/isi/yoshida/baselines/baselines/ppo2/ppo2.py", line 229, in
max_grad_norm=max_grad_norm)
File "/home/isi/yoshida/baselines/baselines/ppo2/ppo2.py", line 25, in init
act_model = policy(nbatch_act, 1, sess)
File "/home/isi/yoshida/baselines/baselines/common/policies.py", line 159, in policy_fn
vf_latent, _ = _v_net(encoded_x)
File "/home/isi/yoshida/baselines/baselines/common/models.py", line 105, in network_fn
S = tf.placeholder(tf.float32, [nenv, 2*nlstm]) #states
File "/home/isi/yoshida/anaconda3/envs/baselines/lib/python3.5/site-packages/tensorflow/python/ops/array_ops.py", line 1735, in placeholder
return gen_array_ops.placeholder(dtype=dtype, shape=shape, name=name)
File "/home/isi/yoshida/anaconda3/envs/baselines/lib/python3.5/site-packages/tensorflow/python/ops/gen_array_ops.py", line 4925, in placeholder
"Placeholder", dtype=dtype, shape=shape, name=name)
File "/home/isi/yoshida/anaconda3/envs/baselines/lib/python3.5/site-packages/tensorflow/python/framework/op_def_library.py", line 787, in _apply_op_helper
op_def=op_def)
File "/home/isi/yoshida/anaconda3/envs/baselines/lib/python3.5/site-packages/tensorflow/python/util/deprecation.py", line 454, in new_func
return func(*args, **kwargs)
File "/home/isi/yoshida/anaconda3/envs/baselines/lib/python3.5/site-packages/tensorflow/python/framework/ops.py", line 3155, in create_op
op_def=op_def)
File "/home/isi/yoshida/anaconda3/envs/baselines/lib/python3.5/site-packages/tensorflow/python/framework/ops.py", line 1717, in init
self._traceback = tf_stack.extract_stack()
InvalidArgumentError (see above for traceback): You must feed a value for placeholder tensor 'ppo2_model/vf/Placeholder_1' with dtype float and shape [1,256]
[[Node: ppo2_model/vf/Placeholder_1 = Placeholderdtype=DT_FLOAT, shape=[1,256], _device="/job:localhost/replica:0/task:0/device:CPU:0"]]

How can I train LSTM Policy by PPO2 in mujoco?
For your information, I can sucessfully train LSTM policy by PPO2 in PongNoFrameskip-v4.

this is not related to mujoco per se, but rather to a fact that mujoco uses value_network='copy' by default; and when creating a copy of a network, a new set of placeholders is created for lstm state and mask. As a workaround I'd suggest using --value_network=shared flag (this way, policy and value networks will have a shared lstm cell with the same placeholders). I am looking into solving this issue in a more principled way.

Thank you! I realize that error means I didn't feed a value for placefolder of value net which is created by 'copying' policy net.
I run this command. And sucessfully train LSTM policy!
python -m baselines.run --alg=ppo2 --network=lstm --num_timesteps=1e6 --env=Reacher-v2 --num_env=4 --nminibatches=2 --value_network=shared

@pzhokhov Have you found that the 'copy' value network(not sharing parameters) produces better results on mujoco? Do you have any guess as to why this would be the case?

generally not sharing parameters makes training more stable (less sensitive to hyperparameters such as value function coefficient in the training objective or learning rate) because two different objectives do not compete with each other, whereas sharing parameters allows for faster learning (when it works).  For image-based observations (and convolutional layers) we use parameter sharing , because otherwise both value function approximator and policy would have to learn good visual features, and that may take too many samples. Mujoco has simulator state-based observations that do not require much of feature learning; and not sharing parameters gets us training that works on decently on all environments without much hyperparameter tuning.

@pzhokhov is there any update so far? Still 'copy' value network is not supported for lstm with ppo2.


pod health check fails when starting a new node

Description
issue: Pods with health checks will fail health checks on newly booted nodes.  But on a booted node, it will work fine.
env:
eks: 1.24
karpenter: v0.31.0

the step is

1.Pod started, in pending state
2.karpenter starts a new node
3.The pod is called to the new node
4.pod crash.

but this step is work fine:

1.karpenter starts a new node
2.Create a pod and schedule it on the node where karpenter is started.
3.pod run.

pod yaml
apiVersion: apps/v1
kind: Deployment
metadata:
  name: testapp-general
  namespace: karpenter
spec:
  replicas: 2
  selector:
    matchLabels:
      app: inflate
  template:
    metadata:
      labels:
        app: inflate
    spec:
      containers:
        - name: goproxy
          image: registry.k8s.io/goproxy:0.1
          ports:
            - containerPort: 8080
          readinessProbe:
            tcpSocket:
              port: 8080
            initialDelaySeconds: 15
            periodSeconds: 10
          livenessProbe:
            tcpSocket:
              port: 8080
            initialDelaySeconds: 15
            periodSeconds: 10
          resources:
            requests:
              cpu: 1
      nodeSelector:
        group: general

Provisioner yaml
apiVersion: karpenter.sh/v1alpha5
kind: Provisioner
metadata:
  name: test-group-general
spec:
  requirements:
    - key: "karpenter.sh/capacity-type"
      operator: In
      values: [ "spot", "on-demand" ]
    - key: kubernetes.io/arch
      operator: In
      values: [ "arm64", "amd64" ]
    - key: "karpenter.k8s.aws/instance-cpu"
      operator: In
      values: ["4"]
    - key: "karpenter.k8s.aws/instance-memory"
      operator: In
      values: ["8192"]
  labels:  # this will used by pod nodeSelector label.
    group: general
  consolidation:
    enabled: true
  limits:
    resources:
      cpu: 1000
  providerRef:
    name: test-group-general
  kubeletConfiguration:
    imageGCHighThresholdPercent: 70
    imageGCLowThresholdPercent: 50
    maxPods: 123
  startupTaints:
    - key: node.cilium.io/agent-not-ready
      value: "true"
      effect: NoExecute
---
apiVersion: karpenter.k8s.aws/v1alpha1
kind: AWSNodeTemplate
metadata:
  name: test-group-general
spec:
  subnetSelector:
    aws-ids: "subnet-xxx"
  securityGroupSelector:
    aws-ids: "sg-xxx"
  tags:
    eks:cluster-name: test-main
    karpenter.sh/discovery: test-main
  metadataOptions:
    httpEndpoint: enabled
    httpPutResponseHopLimit: 2
    httpTokens: optional

kubelet log

Nov 07 03:40:29 ip-10-155-135-252.ap-southeast-1.compute.internal kubelet[1579]: I1107 03:40:29.125161    1579 scope.go:110] "RemoveContainer" containerID="6e888d1c24d1374e7f1eae85a01eb76c78c2416fe57e15438f79fd5bb5d981e6"
Nov 07 03:40:29 ip-10-155-135-252.ap-southeast-1.compute.internal kubelet[1579]: E1107 03:40:29.125392    1579 pod_workers.go:965] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goproxy\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=goproxy pod=testapp-general-649cc6d59-6csmn_karpenter(3d5ffe6b-b1c0-43fe-b013-d04b8823a800)\"" pod="karpenter/testapp-general-649cc6d59-6csmn" podUID=3d5ffe6b-b1c0-43fe-b013-d04b8823a800

➜  ~ k describe po testapp-general-649cc6d59-fmlgc
Name:             testapp-general-649cc6d59-fmlgc
Namespace:        karpenter
Priority:         0
Service Account:  default
Node:             ip-10-155-135-252.ap-southeast-1.compute.internal/<IP_ADDRESS>
Start Time:       Tue, 07 Nov 2023 16:32:23 +0800
Labels:           app=inflate
                  pod-template-hash=649cc6d59
Annotations:      kubernetes.io/psp: eks.privileged
Status:           Running
IP:               <IP_ADDRESS>
IPs:
  IP:           <IP_ADDRESS>
Controlled By:  ReplicaSet/testapp-general-649cc6d59
Containers:
  goproxy:
    Container ID:   containerd://c35a0669b10fcd36f062ae9698ac918f0bb08ef8e72039c4e92a265442ad68c3
    Image:          registry.k8s.io/goproxy:0.1
    Image ID:       registry.k8s.io/goproxy@sha256:5334c7ad43048e3538775cb09aaf184f5e8acf4b0ea60e3bc8f1d93c209865a5
    Port:           8080/TCP
    Host Port:      0/TCP
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       Error
      Exit Code:    1
      Started:      Wed, 08 Nov 2023 07:28:08 +0800
      Finished:     Wed, 08 Nov 2023 07:28:08 +0800
    Ready:          False
    Restart Count:  180
    Requests:
      cpu:        1
    Liveness:     tcp-socket :8080 delay=15s timeout=1s period=10s #success=1 #failure=3
    Readiness:    tcp-socket :8080 delay=15s timeout=1s period=10s #success=1 #failure=3
    Environment:  <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-2r4zb (ro)
Conditions:
  Type              Status
  Initialized       True
  Ready             False
  ContainersReady   False
  PodScheduled      True
Volumes:
  kube-api-access-2r4zb:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   Burstable
Node-Selectors:              group=general
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason   Age                   From     Message
  ----     ------   ----                  ----     -------
  Normal   Pulled   31m (x175 over 14h)   kubelet  Container image "registry.k8s.io/goproxy:0.1" already present on machine
  Warning  BackOff  82s (x4422 over 14h)  kubelet  Back-off restarting failed container
➜  ~
➜  ~
➜  ~
➜  ~ k describe po testapp-general-649cc6d59-smjg8
Name:             testapp-general-649cc6d59-smjg8
Namespace:        karpenter
Priority:         0
Service Account:  default
Node:             ip-10-155-135-252.ap-southeast-1.compute.internal/<IP_ADDRESS>
Start Time:       Tue, 07 Nov 2023 11:28:04 +0800
Labels:           app=inflate
                  pod-template-hash=649cc6d59
Annotations:      kubernetes.io/psp: eks.privileged
Status:           Running
IP:               <IP_ADDRESS>
IPs:
  IP:           <IP_ADDRESS>
Controlled By:  ReplicaSet/testapp-general-649cc6d59
Containers:
  goproxy:
    Container ID:   containerd://4f27a28b82ad2f1a04ec56c1358d98055b7d91b265a9235e005ba64f4e5aba66
    Image:          registry.k8s.io/goproxy:0.1
    Image ID:       registry.k8s.io/goproxy@sha256:5334c7ad43048e3538775cb09aaf184f5e8acf4b0ea60e3bc8f1d93c209865a5
    Port:           8080/TCP
    Host Port:      0/TCP
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       Error
      Exit Code:    1
      Started:      Wed, 08 Nov 2023 07:26:39 +0800
      Finished:     Wed, 08 Nov 2023 07:26:39 +0800
    Ready:          False
    Restart Count:  239
    Requests:
      cpu:        1
    Liveness:     tcp-socket :8080 delay=15s timeout=1s period=10s #success=1 #failure=3
    Readiness:    tcp-socket :8080 delay=15s timeout=1s period=10s #success=1 #failure=3
    Environment:  <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-nwlmc (ro)
Conditions:
  Type              Status
  Initialized       True
  Ready             False
  ContainersReady   False
  PodScheduled      True
Volumes:
  kube-api-access-nwlmc:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   Burstable
Node-Selectors:              group=general
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason   Age                   From     Message
  ----     ------   ----                  ----     -------
  Warning  BackOff  51s (x5900 over 20h)  kubelet  Back-off restarting failed container

Can you provide the karpenter logs and the state of the newly created node that the pod tries to run on?

@txjjjjj were you able to figure out the solution?


oscm-app-sample with wrong port in technical service

The example technical services hold a wrong provisioning URL
provisioningUrl="http://oscm-app:8080/oscm-app/webservices/oscm-app/oscm-app/org.oscm.app.v2_0.service.AsynchronousProvisioningProxy?wsdl" provisioningVersion="1.0"
should be
provisioningUrl="http://oscm-app:8880/oscm-app/webservices/oscm-app/oscm-app/org.oscm.app.v2_0.service.AsynchronousProvisioningProxy?wsdl" provisioningVersion="1.0"

This is fixed upstream. Tbd: Updating app-sample-controller.zip on the oscm release tab.


[api-docs] Document endpoints that support the

A new commit was made into the api-docs repo. This issue was created automatically. Need to review if we made any change to the library for this commit.
https://github.com/discord/discord-api-docs/commit/ab9e3855ca2346075ee4d982a661cfa69a547260

Done


Make it available to handle Raw SQL default value

Is your feature request related to a problem? Please describe.
addTimeColumn(tableName, "time_column", default = "CURRENT_TIMESTAMP")

This code is recognized as to add Time Column with default value 'CURRENT_TIMESTAMP', string value.
Describe the solution you'd like
Make it available to handle Raw SQL default value.
Other
Raw class or RawSql class might be the solution.
And enable to set Raw object to the default parameter.
Either class like haskell may make it easier... 🤔

Is this problem still occurring with addDateTimeColumn ? 🤔

@nacika-ins
in my understanding, you can use SQL for column default value, using RawSql class.
https://github.com/KenjiOhtsuka/harmonica/releases/tag/1.1.15


NRF52: protect the I2C transfer with a semaphore and fix some coding standard issues

There is a good description of how cancellation points are supposed to work here:  https://cwiki.apache.org/confluence/display/NUTTX/Cancellation+Points  I think from that is is clear how nxsem_[timed]wait_uninterruptible breaks cancellation points.


Figure out branch pattern/workflow for publishing releases to npm

... and add logic to TravisCI config.

@jaeddy does this include automated npm publishes upon version number increments in package.json? If so, we could do something with Github Actions, whereupon every time we merge a release branch into master we trigger a publish, or something to that effect.
As an aside, it might also be good to release some of these workflow/build processes we're learning as a guide in TASC.

@jb-adams - yep. The automation itself should be relatively manageable with GH Actions, TravisCI, or whatever other system. The "flow" and conditions on which releases are created and published feel a bit trickier to me. Maybe we go with Hubflow, as that seems to be the preferred choice for Cloud WS products... in which case the exercise of implementing should hopefully be pretty straightforward.
Agreed re: TASC — especially with GitHub now supporting workflow templates for Actions. I guess that raises a related question: is GitHub itself a prescribed standard for GA4GH (versus Bitbucket, GitLab, etc.); what about CI/CD frameworks?

I don't know of any GA4GH products/projects that aren't tracked in GitHub and aren't built/tested on Travis, so while it may not be prescribed yet, it's definitely a mainstay. I think this falls under the realm of Guides (we recently fleshed out our strategic roadmap, the gist of it is that we have different product types, ie. Technical Specifications are different from Policies are different from Guides and Resources). So if we put together a 'Best Practices flow for maintaining GA4GH specifications' guide I think that's perfectly valid, and TASC (or somewhere else in GA4GH) can host the documentation.


Implement args_get and args_sizes_get

Implement simple system calls, args_get and args_sizes_get first.  This PR also introduces APIs to safely access any guest address given by the user without the runtime crashing.
Signed-off-by: Takaya Saeki<EMAIL_ADDRESS>

looks good overall.. I will review within today!

oh sorry I missed that you used there!

agreed we shouldn't put things like unittests under examples/, let's move them into wasi/_test.go as adrian suggested!

Thanks for the feedbacks! I will move the tests to under wasi directory (not under examples but under /wasi).
This will be another topic and would be another PR, but I think it might be better to make the purpose of example more explicit. From its name, it reads like it's an example directory for users of wazero, but its README clearly states that it is a directory for e2e tests and it also has some files which are rather tests than examples for users, which makes the purpose of example ambiguous. I feel it's better to move some files like file_system.go to WASI's directory as well and elaborate the README. Will do it later.

Thanks for the progress, @nullpo-head I will take another review pass after you have addressed @mathetake's comments, to help avoid feedback storm!


[SC-1029] update deps

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 35.58%. Comparing base (0f4d2cf) to head (65e3b54).

Additional details and impacted files
@@             Coverage Diff             @@
##           master      #27       +/-   ##
===========================================
+ Coverage    0.74%   35.58%   +34.83%
===========================================
  Files          12       12
  Lines         267      267
  Branches       42       42
===========================================
+ Hits            2       95       +93
+ Misses        265      172       -93

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Translation

I translated shifts in Dutch. First language after install was German, after translation there are three languages: Dutch, German and English. I can not change that.

Hi MKbyte,
i may be wrong but the translation should be handled by the nextcloud itself. Which language is configured in your instance?

I agree, but it does not. The Nextcloud language is Dutch

Hi @MKbyte
ah I see, only the week days are not translated.
We currently re-implementing the app and will publish a new version 2 in the near future. Hence we might not fix this in the old version.