Not able to call azure api of Virtual machine scale set through java sdk

Hello , My application on Azure VM is trying to call api of (Virtual machine scale set)VMSS through JAVA SDK but we are getting error message 'javax.net.ssl.SSLHandshakeException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target' . We are using jdk1.8.0_321 , I see required ssl certificates e.g 'Baltimore CyberTrust Root', 'DigiCert Global Root G2', 'DigiCert Global Root CA' ("https://docs.microsoft.com/en-us/azure/security/fundamentals/tls-certificate-changes") are present under '/jdk1.8.0_321/jre/lib/security/cacerts'. Can you suggest if any other specific certificates are required ?

I am using Eclipse

Hi @ningle12 someone from the Mgmt team will follow up with you shortly.
In the mean time, could you please add missing details to the issue above specifically on the SDK version that you're using?
The GitHub issue template for the repo can be seen here: https://github.com/Azure/azure-sdk-for-java/blob/main/.github/ISSUE_TEMPLATE/bug_report.md
Setup (please complete the following information):

OS: [e.g. iOS]
IDE: [e.g. IntelliJ]
Library/Libraries: [e.g. com.azure:azure-core:1.16.0 (groupId:artifactId:version)]
Java version: [e.g. 8]
App Server/Environment: [e.g. Tomcat, WildFly, Azure Function, Apache Spark, Databricks, IDE plugin or anything special]
Frameworks: [e.g. Spring Boot, Micronaut, Quarkus, etc]

Thank you so much

/cc @weidongxu-microsoft from Mgmt

@ningle12
ARM connects to https://management.azure.com/
Its CA path has this (root is same "DigiCert Global Root G2")
CN = Microsoft Azure TLS Issuing CA 01
O = Microsoft Corporation
C = US

OS: Linux
IDE: Eclipse
Library/Libraries:  groupId= com.microsoft.azure , artifactId= azure, version= 1.27.2
Java version: jdk1.8.0_321
App Server/Environment: Tomcat
Frameworks: Eclipse Modeling Framework (EMF)
Code Snippet: Whenever trying to make call to (Virtual Machine Scale Set)VMSS api.

Error: thread:javax.net.ssl.SSLHandshakeException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target

IDE: Eclipse
Library/Libraries: groupId= com.microsoft.azure , artifactId= azure, version= 1.27.2
Java version: jdk1.8.0_321
App Server/Environment: Tomcat
Frameworks: Eclipse Modeling Framework (EMF)
Code Snippet: Whenever trying to make call to (Virtual Machine Scale Set)VMSS api

Error: thread:javax.net.ssl.SSLHandshakeException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target

com.microsoft.azure:azure is deprecated
https://github.com/Azure/azure-libraries-for-java

@ningle12
Please migrate to https://aka.ms/azsdk/java/mgmt
PS: would you let me know why using this particular version 1.27.2? Even for that deprecated lib, latest is 1.41.2

Hii @weidongxu-microsoft
I have update azure libs from 1.27.2 to latest i.e   groupId: com.azure.resourcemanager , artifactId: azure-resourcemanager, version: 2.13.0 still i am getting same error
Getting error at same line i.e:

Azure configure code:

sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
at sun.security.provider.certpath.SunCertPathBuilder.build(SunCertPathBuilder.java:141)
at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:126)
at java.security.cert.CertPathBuilder.build(CertPathBuilder.java:280)
at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:434)
3/29/22 10:18:52.402 t:[id:115]INFO: [ClientSecretCredential] Azure Identity => getToken() result for scopes [https://management.core.windows.net//.default]: SUCCESS
03/29/22 10:18:52.402 t:[id:115]INFO: [AccessTokenCache] Acquired a new access token.
03/29/22 10:18:52.580 t:[id:112]WARNING: [HttpClientConnect] [845ef473, L:/<IP_ADDRESS>:55850 - R:management.azure.com/<IP_ADDRESS>:443] The connection observed an error javax.net.ssl.SSLHandshakeException: General OpenSslEngine problem
at io.netty.handler.ssl.ReferenceCountedOpenSslEngine.handshakeException(ReferenceCountedOpenSslEngine.java:1898)
at io.netty.handler.ssl.ReferenceCountedOpenSslEngine.wrap(ReferenceCountedOpenSslEngine.java:822)
at javax.net.ssl.SSLEngine.wrap(SSLEngine.java:511)
at io.netty.handler.ssl.SslHandler.wrap(SslHandler.java:1039)
at io.netty.handler.ssl.SslHandler.wrapNonAppData(SslHandler.java:925)
at io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1407)
at io.netty.handler.ssl.SslHandler.decodeNonJdkCompatible(SslHandler.java:1245)
at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1285)
at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:510)
at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:449)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:279)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:795)
at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe$1.run(AbstractEpollChannel.java:425)
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:469)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:384)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:750)
Caused by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:439)
at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:306)
at sun.security.validator.Validator.validate(Validator.java:271)
at sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:312)
at sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:275)
at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:140)
at io.netty.handler.ssl.ReferenceCountedOpenSslClientContext$ExtendedTrustManagerVerifyCallback.verify(ReferenceCountedOpenSslClientContext.java:234)
at io.netty.handler.ssl.ReferenceCountedOpenSslContext$AbstractCertificateVerifier.verify(ReferenceCountedOpenSslContext.java:748)
at io.netty.internal.tcnative.CertificateVerifierTask.runTask(CertificateVerifierTask.java:36)
at io.netty.internal.tcnative.SSLTask.run(SSLTask.java:48)
at io.netty.internal.tcnative.SSLTask.run(SSLTask.java:42)
at io.netty.handler.ssl.ReferenceCountedOpenSslEngine$TaskDecorator.run(ReferenceCountedOpenSslEngine.java:1465)
at io.netty.handler.ssl.SslHandler.runDelegatedTasks(SslHandler.java:1547)
at io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1393)
...

@ningle12

Please migrate to https://aka.ms/azsdk/java/mgmt
Please try add certificate "Microsoft Azure TLS Issuing CA 01"

Hi @weidongxu-microsoft
I have updated my application to latest azure libs i.e com.azure.resourcemanager  with latest version i.e 2.13.0
I added "Microsoft Azure TLS Issuing CA 01" in java keystore i.e cacerts  still facing same SSLHandshakeException

Certificates present in java keystore

@XiaofeiCao Would you take a look?

Please reply

@ningle12 Sorry for the delay, will investigate.

Hii @XiaofeiCao
Any update ?

@ningle12
Hi, currently I'm not able to reproduce the bug using jdk_1.8.0_321 and eclipse. My truststore has DigiCert Global Root G2 without Microsoft Azure TLS Issuing CA 01 and it works fine...
Does your cacerts contain this certificate(DigiCert Global Root G2, not DigiCert Assured ID Root G2 in your screenshot)?
.

Hii  @XiaofeiCao my keystore i.e cacerts have the following certificate.
And When i call Api's from my eclipse(Wrote a demo program) it also works for me but when i bundled my application with maven install and create tar and install my application on Azure VM at that time i am facing  issue.

That's weird.. Please try adding the site's certificate:

Visit https://management.azure.com (the site that has issue handshaking)
Get the site's certificate

Import the certificate to your keystore i.e cacerts

Please also make sure that the JDK that Eclipse uses is actually where you import your certificates...

Hi @XiaofeiCao
https://management.azure.com  ??
I have added certificates from azure portal that I am using

But still facing same issue.

@ningle12 mgmt SDK actually called API through gateway https://management.azure.com, not azure portal, as is reported handshake exception in your log here:

03/29/22 10:18:52.580 t:[id:112]WARNING: [HttpClientConnect] [845ef473, L:/<IP_ADDRESS>:55850 - R:management.azure.com/<IP_ADDRESS>:443] The connection observed an error javax.net.ssl.SSLHandshakeException: General OpenSslEngine problem

Normally this isn't necessary, since it's issued by Microsoft Azure TLS Issuing CA 01. In this issue's case, you can try adding management's certificate...

I have added Microsoft Azure TLS Issuing CA 01 but same result
thread:javax.net.ssl.SSLHandshakeException: General OpenSslEngine problem
04/11/22 06:58:57.533 t:[id:111]WARNING: [HttpClientConnect] [16f02768, L:/<IP_ADDRESS>:45182 - R:management.azure.com/<IP_ADDRESS>:443] The connection observed an error javax.net.ssl.SSLHandshakeException: General OpenSslEngine problem
at io.netty.handler.ssl.ReferenceCountedOpenSslEngine.handshakeException(ReferenceCountedOpenSslEngine.java:1898)

@ningle12 Have you tried adding https://management.azure.com, or it still reports the same result?

I am not able to open this https://management.azure.com
{"error":{"code":"MissingApiVersionParameter","message":"The api-version query parameter (?api-version=) is required for all requests."}}

Not able to open this https://management.azure.com
{"error":{"code":"MissingApiVersionParameter","message":"The api-version query parameter (?api-version=) is required for all requests."}}

It's expected as it's reported from server-side. The SSL validation is complete. You can export the certificate in this page.

Not able to open this https://management.azure.com
{"error":{"code":"MissingApiVersionParameter","message":"The api-version query parameter (?api-version=) is required for all requests."}}
Can u pls provide certificate names on https://management.azure.com ?

Added certificates still same error

@ningle12 I can't reproduce the bug for now. If this is urgent issue, consider raising an IcM(https://portal.microsofticm.com/imp/v3/incidents/create) and full-time support will be involved.


CreateTranscriptionAsync in the same second

Found an issue when creating more than one CreateTranscriptionAsync per second that it fails.
Might have something to do with filename in temp folder. When I put a delay to creating all keeps working well.
Sorry for the short msg, kids here and stuff :)

Thanks for reporting, I'll take a look and see what might be causing this issue.
Can you send me a code snippet for repro?

This is the error I get (it happened very occasionally until I added a delay to the generation...).
It seems to be trying to overwrite the existing file because file with same name already exists.
ERROR
RestException: [POST:0] file:///C:/Users/hello/AppData/Local/Temp/Pxxxxxxxe/Axxxxxr/download_cache/Nova-20240202T081616.mp3 Failed!
[Headers]
Invalid Headers: Invalid Headers
[Errors]
Invalid HTTP Method

Maybe adding milliseconds  could help solve this?
var clipName = $"{request.Voice}-{DateTime.UtcNow:yyyyMMddThhmmssfff}.{ext}";
Ideally the file would not be written to disk but just stored in memory until discarded?
YOUR CODE
public async Task<Tuple<string, AudioClip>> CreateSpeechAsync(SpeechRequest request, CancellationToken cancellationToken = default)
{
var audioFormat = request.ResponseFormat switch
{
SpeechResponseFormat.MP3 => AudioType.MPEG,
_ => throw new NotSupportedException(request.ResponseFormat.ToString())
};
var ext = request.ResponseFormat switch
{
SpeechResponseFormat.MP3 => "mp3",
_ => throw new NotSupportedException(request.ResponseFormat.ToString())
};
var payload = JsonConvert.SerializeObject(request, OpenAIClient.JsonSerializationOptions);
var clipName = $"{request.Voice}-{DateTime.UtcNow:yyyyMMddThhmmss}.{ext}";
var clip = await Rest.DownloadAudioClipAsync(
GetUrl("/speech"),
audioFormat,
UnityWebRequest.kHttpVerbPOST,
clipName,
payload,
parameters: new RestParameters(client.DefaultRequestHeaders),
debug: EnableDebug,
cancellationToken: cancellationToken);
Rest.TryGetDownloadCacheItem(clipName, out var cachedPath);
return new Tuple<string, AudioClip>(cachedPath, clip);
}


Outline view

Is there a way to generate the outline view?

There is not, however, that's a great feature for the next version and i've started working on it.

[Closing due to age]


net/frr: show bgp status for IPv4 and IPv6 in diagnostics

By omitting the parameter 'ip' vtysh shows IPv4 as well as IPv6 sessions.

@mimugmail if it is ok, I will create the version bump and release note after merge.


How to   use  PbFieldType.OY  type  in dart?

In my project  the  "bytes"  in protobuf file translater to Dart  is Lint  type  like:
message RequestPublicChatHChannel{     bytes text = 4;    }
int  Dart file is :
..a<List<int>>(4, 'text', PbFieldType.OY)
if i want  a  String  type  to the   'text',how should i to Assignment，thanks!

If I understand your question correctly you can use
import 'dart:convert';

main() {
  Foo foo = Foo.fromBuffer(...);
  String textAsString = utf8.decode(foo.text);
}


feat: add operator scope RBAC

Operator groups
There are instructions on how to get the deployment of the controller to get the target namespace of the operator-group. At implementation time, you need to obtain the olm.targetNamespaces value from the current deployment annotation on the deployment container.


Disable internet access for the tests

The test dinds shouldn't need to pull images from the internet, if they do then things got out of date.
Disable internet access in the test dinds to force us to keep our caches up to date.

It's a pain when we want to apt-get install some tool in a dind container for debuggering, though...
Suggestion:

Fix the current problem with the docker network being 192.168.*.* that means it has problems doing NAT when your home network is 192.168.something.something, by using 192.168.195.* instead of the whole /16
Extract the code that sets up NAT (spelt "masquerading" in ipchains land) from the test dind setup so there's no NAT by default.
Put it in citools/scripts/enable_dind_nat.sh script we can run when we want to hack with stuff.
Write a citools.scripts/disable_dind_nat.sh script to reverse it.


Updated KB with new flow

There has been changes to the master account creation flow.  This update reflects those changes.  The KB has been updated, a long with a few screenshots.

@asanokhin please review and merge for tomorrow's deployment 7/17


unit tests + confirmation popup for unsaved changes in case files form

Codecov Report
Attention: Patch coverage is 50.00000% with 7 lines in your changes missing coverage. Please review.

Project coverage is 58.16%. Comparing base (a0ab7de) to head (ff417c3).
Report is 1 commits behind head on develop.

Files
Patch %
Lines

...eb/src/components/App/CaseFiles/CaseFileDrawer.tsx
33.33%
6 Missing :warning:

...src/components/Shared/Popups/ConfirmationModal.tsx
0.00%
1 Missing :warning:

Additional details and impacted files
@@             Coverage Diff              @@
##           develop      #39       +/-   ##
============================================
+ Coverage    25.79%   58.16%   +32.37%
============================================
  Files           57       61        +4
  Lines          845      863       +18
  Branches       221      224        +3
============================================
+ Hits           218      502      +284
+ Misses         595      337      -258
+ Partials        32       24        -8

Flag
Coverage Δ

compliance-web
58.16% <50.00%> (+32.37%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


id: estoppel breaches should pre-check the condition-based defenses if tenant raised bad conditions

condition-based estoppel defenses were removed at terry's request

#322


Cluster owner unable to modify Project members

Internal Reference: SURE-6940
I have a cluster where an admin with Cluster Owner entitlements is unable to manage members of projects in the same cluster.
I do not even see the "Members" tab when creating/modifying a project.

Looks related to https://github.com/rancher/dashboard/issues/10215

Workaround: Create a new custom role that includes read permissions for role templates ("get", "list", "watch" on "roletemplates" in "management.cattle.io")
Backend took a look and reported:

I was able to add a project member to one of the projects through Norman. Because of this (and the note in the issue , I suspect that this is a UI issue, due to the user not being able to see RoleTemplates. Similar to what was described in the issue, when I added the "Manage Roles" global role to the user (which gives * on RoleTemplates), the issue somewhat resolved and I was able to at least see the buttons to add users (though the principal search functionality was also non-functional).

E2E should be able to cover it.

@richard-cox to investigate in this area some more and we can groom again.

Marking this as blocked on our side (https://github.com/rancher/dashboard/issues/10787), from that the solution may not be UI related


Binary path issue and init function missing

Hi,
With some packaged version of Redis (2.4 for Centos6 for example) the redis-server and redis-cli are not in the same path which is a problem with the init script you provides as they are supposed to be in the same path.
Following the init convention (https://fedoraproject.org/wiki/Packaging:SysVInitScript), you do not load init functions which lead to missing variables like PATH.
What I suggest is to load this PATH by using init functions, stop using the binary full path in the init file and customize the PATH for customized versions. This resolve all those issues, I purpose this update of the init script to be much more clean and compliant.

Can you rebase this on master to verify all of the tests pass?

Hi
We have just adopted this cookbook and are aiming to rebaseline it, as part of this we are closing down all prs older than 1 year.
If you still need this change please open a new PR and we will assess this as part of our rebaseline
Thanks for your understanding
Sous-Chefs


Exposed Username and password in URI

Potential security breach. See /TestProjects/Microwave.Persistence.UnitTestsSetup/MongoDb/MongoDbTestSetup.cs

thanks, this is just a cloud test db that is not used anywhere else, I just wanted to get the tests to run on machines where no mongo db is installed.


flutter should be able to handle multiple connections / ViewProvider requests

Current doing this assert fails on https://github.com/flutter/engine/blob/master/sky/shell/platform/mojo/application_impl.cc#L69
Instead as discussed with @abarth, this should create a new instance of the flutter app.

I can take a look at this in a couple days.

Done.


can not read parsed data

url created on marketing tab ( https://dashboard.branch.io/marketing ) can be properly read by code.
branch.init(key, function (err, data) {
  var parsed = data['data_parsed'];
  ///...
})

but url created by myself with web-sdk or ios-sdk can not be read
parsed  data from marketing link includes many key, value
but from link i created with sdk have only +clicked_branch_link:fasle, +is_first_session:true
i think i properly make link
here is code for creating my link
// branch.init() already call
branch.link({
        tags,
        campaign,
        channel,
        feature: 'web',
        data: {
          '$deeplink_path': `foo`,
          '$og_title': `foo`,
          '$og_description': foo',
          '$og_url': 'https://rememberapp.co.kr',
          '$ios_deepview': 'sharebook_deepview',
          '$desktop_url': `https://rememberapp.co.kr/deeplink`,
          '$android_url': `https://play.google.com/store/apps/details?id=kr.co.rememberapp&utm_campaign=${campaign}&utm_source=${channel}&utm_medium=${tags[0]}`,
          '$ios_url': `itms-apps://itunes.apple.com/app/id840553277?pt=41308801ct=${campaign}_${channel}_${tags[0]}&mt=8`,
          '$rmbr_referrer_id': id, // my custom data
        }
      }, function (err, branchLink) {
        console.log(err, branchLink);
      });

Hi @holdonnn, sorry about the trouble!
I just tried running your code and ran into an error. '$og_description': foo', is missing the opening ' in front of foo. Try that out and let me know if it works :)

sorry, i had some mistake above example code.


Tag push?

Hi,
is the tag 'push' there by intention or is this tag just a mistake?
If its a mistake can you please delete it as it makes tag sorting a little bit difficult.
Thanks
Thomas

The "push" tag has been removed.


Added Code for Verification Server

Added code for the verification server

[x] Automatic fetching of fields from Specification Registry
[x] Automatic updates at a fixed time of the day
[x] Verification of Signatures using Public Keys

Few other functionalities such as DID resolutions, public key fetching from DID Documents and Public Key caching to be done after implementation of DID system.
Linked to Issue : #10

@bharatkashyap kindly do review the PR. Thank You !


fix(aws-logs): add export()/import() capabilities

LogGroups and LogStreams can now be exported and imported.
ALSO IN THIS COMMIT

All exports() for other resources would run afoul of
ClassCastException in Java. Wrap all FnImportValues in the right
type to avoid this.
The addition of some convenience methods to the Arn class flushed
out a number of places where we were using some other Token-derived
value in places where Arns were expected.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license.

I like the .bucketName option. Alternatively, we can just make everything a string and be done with tokens for intrinsic functions forever and ever, can't we?

Maybe. We'll also lose all benefits to type declarations, every Token-derivative can be interchanged with every other one. If we wanted to have that, is there a reason we have BucketName and QueueUrl and TopicArn classes today? Why not just declare everything as Token?
Also, it would super-violate the principle of least surprise for statically typed language users.


feat(avm): indirect support for kernel read opcodes

Overview
Adds indirect support and unit tests for kernel input opcodes

#6940  👈
master

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @Maddiaa0 and the rest of your teammates on  Graphite

Benchmark results
No metrics with a significant change found.

Detailed results
All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call  to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.
This benchmark source data is available in JSON format on S3 here.
Proof generation
Each column represents the number of threads used in proof generation.

Metric
1 threads
4 threads
16 threads
32 threads
64 threads

proof_construction_time_sha256_ms
5,697
1,537
705
745 (+2%)
775 (+1%)

proof_construction_time_sha256_30_ms
11,875 (+1%)
3,137
1,406
1,429
1,471 (+1%)

proof_construction_time_sha256_100_ms
44,710
12,080
5,709 (+1%)
5,615 (+1%)
5,490

proof_construction_time_poseidon_hash_ms
78.0 (-1%)
34.0
34.0
57.0 (-2%)
88.0

proof_construction_time_poseidon_hash_30_ms
1,515
416
201 (+1%)
231 (+5%)
267

proof_construction_time_poseidon_hash_100_ms
5,716 (-1%)
1,574
734 (+1%)
802 (+3%)
797

L2 block published to L1
Each column represents the number of txs on an L2 block published to L1.

Metric
4 txs
8 txs
16 txs

l1_rollup_calldata_size_in_bytes
1,412
1,412
1,412

l1_rollup_calldata_gas
9,476
9,454
9,464

l1_rollup_execution_gas
610,297
610,275
610,285

l2_block_processing_time_in_ms
698
1,299
2,468 (+1%)

l2_block_building_time_in_ms
22,235
46,086 (+1%)
87,072

l2_block_rollup_simulation_time_in_ms
22,128
45,758 (+1%)
86,679

l2_block_public_tx_process_time_in_ms
18,985
42,332 (+1%)
83,362 (-1%)

L2 chain processing
Each column represents the number of blocks on the L2 chain where each block has 8 txs.

Metric
3 blocks
5 blocks

node_history_sync_time_in_ms
5,949
8,606 (+1%)

node_database_size_in_bytes
9,490,512
12,734,544

pxe_database_size_in_bytes
9,242
15,127

Circuits stats
Stats on running time and I/O sizes collected for every kernel circuit run across all benchmarks.

Metric
1 leaves
16 leaves
64 leaves
128 leaves
256 leaves
512 leaves
1024 leaves
32 leaves

batch_insert_into_append_only_tree_16_depth_ms
10.4 (+1%)
16.9
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_count
16.7
31.8
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_ms
0.604
0.518
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_32_depth_ms
N/A
N/A
48.7
76.6 (+1%)
133
247
474
N/A

batch_insert_into_append_only_tree_32_depth_hash_count
N/A
N/A
95.9
159
288
543
1,055
N/A

batch_insert_into_append_only_tree_32_depth_hash_ms
N/A
N/A
0.497
0.471 (+1%)
0.456
0.447
0.444 (+1%)
N/A

batch_insert_into_indexed_tree_20_depth_ms
N/A
N/A
59.4
113 (+1%)
184 (+1%)
356
699 (+1%)
N/A

batch_insert_into_indexed_tree_20_depth_hash_count
N/A
N/A
108
208
355
691
1,363
N/A

batch_insert_into_indexed_tree_20_depth_hash_ms
N/A
N/A
0.505
0.506 (+1%)
0.488
0.481
0.481 (+1%)
N/A

batch_insert_into_indexed_tree_40_depth_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
60.0

batch_insert_into_indexed_tree_40_depth_hash_count
N/A
N/A
N/A
N/A
N/A
N/A
N/A
103

batch_insert_into_indexed_tree_40_depth_hash_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0.551

Miscellaneous
Transaction sizes based on how many contract classes are registered in the tx.

Metric
0 registered classes
1 registered classes

tx_size_in_bytes
79,470
665,267

Transaction size based on fee payment method
| Metric |  |
| - |  |


Proposed changes

Thank you for your submission! We require that all contributors sign our Contributor License Agreement ("CLA") before we can accept the contribution. Read and sign the agreement
Learn more about why HashiCorp requires a CLA and what the CLA includes

0 out of 2 committers have signed the CLA.

[ ] Bill Kindle
[ ] billkindle

Bill Kindle seems not to be a GitHub user.
You need a GitHub account to be able to sign the CLA. If you already have a GitHub account, please add the email address used for this commit to your account.
Have you signed the CLA already but the status is still pending? Recheck it.


Folder Path Value is Incorrect

The folder path isnt "/Runbooks" its "/"

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 83c90e64-b615-711f-a53d-fc76606e2ecd
Version Independent ID: 2d164036-6886-4440-50f7-369f99f41cea
Content: Source control integration in Azure Automation
Content Source: articles/automation/source-control-integration.md
Service: automation
Sub-service: process-automation
GitHub Login: @MGoedtel
Microsoft Alias: magoedte

@cconrado Thanks for your comment! We will review and provide an update as appropriate.

@cconrado It works with "/Runbooks" or "/" or any valid path that you ideally have in your repository. In the referred Azure document it's mentioned as "/Runbooks" for example and illustration purpose. Hope this clarifies!

So at this point it appears that there's no edits or updates needed for the documentation hence closing this issue for now. If there are further questions regarding this matter or feedback on the documentation, please do let us know and we will gladly continue the discussion.

@KrishnaG-MSFT I wouldn't close this yet. I literally ran the command and it failed with /runbooks so I'm not sure if thats a bug or not.

@cconrado Before you run the command, can you double check if you have the folder path "/Runbooks" available ?
For example,  I have tested by having "/Runbooks" folder path and it works without any issues.

If issue still persists, provide more context like

which source control type you are using
did you double check personal access token validity
what is the error you get when it fails
did you enable verbose / debug to capture in detail exception information, if yes, pls share the exception details
provide screenshot of the exact command you tried using New-AzAutomationSourceControl cmdlet, etc.

@KrishnaG-MSFT well its just clicked what that argument meant. I thought it was referring to the location to sync in the automation account and not the repo. You can close


Minor improvement to cellery pull warning message printed in version mismatch

Purpose

Minor improvement to cellery pull warning message printed in version mismatch

Goals

Minor improvement to cellery pull warning message printed in version mismatch

Approach

Minor improvement to cellery pull warning message printed in version mismatch

User stories

N/A

Release note

N/A

Documentation

N/A

Training

N/A

Certification

N/A

Marketing

N/A

Automation tests

Unit tests

N/A

Integration tests

N/A

Security checks

Followed secure coding standards in http://wso2.com/technical-reports/wso2-secure-engineering-guidelines? yes
Ran FindSecurityBugs plugin and verified report? yes
Confirmed that this PR doesn't commit any keys, passwords, tokens, usernames, or other secrets? yes

Samples

N/A

Related PRs

N/A

Migrations (if applicable)

N/A

Test environment

N/A

Learning

N/A

Codecov Report

Merging #526 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #526   +/-   ##
=======================================
  Coverage   64.45%   64.45%
=======================================
  Files          34       34
  Lines        1176     1176
  Branches       98       98
=======================================
  Hits          758      758
  Misses        365      365
  Partials       53       53

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d4645bd...220c87a. Read the comment docs.


Bug broke my Death Recap

I was adjusting the size of the columns while checking a recap and now the plugin doesn't work for me anymore.
Plugin doesn't show recaps anymore, it's like in the picture.
If I open a recap, the window doesn't close anymore and I have to disable the plugin.
I tried reinstalling the plugin but it didn't fix the issue.

Sorry to hear, you can reset your UI by deleting %APPDATA%/XIVLauncher/dalamudUI.ini


Workflow Notification form should use AJAX

See http://www.concrete5.org/community/forums/customizing_c5/strange-workflow-error/
When I click on Approve Page button, the form is submitted via a regular HTTP request to a tool script that returns a JSON response. The form should be handled via an AJAX request (as in dashboard Workflow page) to solve this.

:+1: same for me


Database performance audit

[ ] In this branch, we decreased the execution time of the provided queries:

The first query:

Before indexing

After indexing

The second query:

Before indexing

After indexing

The third query:

Before indexing

After indexing

Dear Code Reviewer!
We submitted the 1st image (1st query, before indexing) not as required. Because when we took a screenshot before indexing we looked at the message seconds instead of the execution time amount. So we realized we did that part wrong when Mr Shahadat (previous code reviewer) mentioned it. After indexing we can't set Seq Scan back, it is impossible: impossible to disable the indexing, and even when I re-run preparation step 3 the indexing wasn't disabled. This means we can't take screenshot of the Seq Scan execution time>1000ms.
We want to mention here that we understood the topic well but we can't fix the problem because it is impossible.


Updating environments - no longer tier 1 offered

You might want to update the section as the tier 1 environments are no longer offered as part of the subscription:

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 5080f3d7-0ad1-940c-284a-92008d7c19d5
Version Independent ID: c911e39b-82ee-2ae3-4493-d2e39afccc2b
Content: Cloud deployment overview - Finance & Operations | Dynamics 365
Content Source: articles/fin-ops-core/dev-itpro/deployment/cloud-deployment-overview.md
Service: dynamics-ax-platform
Product: ****
Technology: ****
GitHub Login: @laneswenka
Microsoft Alias: laswenka

@robabb123 - thanks for the feedback.
@laneswenka - Can you please update the topic based on this feedback?

A PR is out for this that solves another reported issue.  @kfend this can be resolved.


ci: add darwin check

this adds a check that verifies that the nomt crate and
benchtop builds cleanly on darwin.
This is limited to the nomt crate because this is definitely
sketchy and some crates (at the moment of writing it's at
least libfuzzer) do not build.
x86-64 darwin is picked because this is what ubuntu-latest
is running.

#571  👈 (View in Graphite)
master

This stack of pull requests is managed by Graphite. Learn more about stacking.

Merge activity

Nov 20, 5:04 PM EST: A user started a stack merge that includes this pull request via Graphite.


max_api fix

Remove the special value "latest" from max_api. If no max_api is needed, just let None be the value.
This will fix https://github.com/Azure/azure-cli/pull/7140, since this "latest" special string was not backported to SemVer API versionning.
FYI @schaabs

More details:
The current implementation says that if you want to test api_version (using min_api/max_api), and the service you want does not exist in the loaded Profile, use the profile name as the api_version .
However, profile name is not relevant and cannot be parsed anyway as an api-version. So removing this as well. If you ask an API version of something which is not in the profile, just fail.

Let's make it a more discussed refactoring after Ignite. The concept of min_profile / max_profile does not actually matches the reality of Profile and should be discussed.


Command routing causes unpredictable results

If an application works in a single thread and uses Direct delivery (test configuration), command routing causes unpredictable results.
Let's say, there are 3 entities: TaskAggregate, TaskProjection and TaskCreationProcessManager.
TaskAggregate:

Has a handler for CreateTask, which produces TaskCreated.
Has a handler for AssignTask, which produces TaskAssigned.

TaskProjection:

Has a subscriber on TaskCreated.
Has a subscriber on TaskAssigned.

TaskCreationProcessManager:

Reacts on TaskCreated and routes AssignTask.

With this configuration, there are two possible scenarios (all in the order of the execution):

TaskCreated is dispatched to TaskCreationProcessManager, the PM routes AssignTask and TaskAssigned is emitted by the aggregate. Then TaskAssigned is dispatched to TaskProjection and only then source TaskCreated is dispatched to the projection. In this case, TaskCreated was emitted before TaskAssigned, but the projection handled TaskAssigned and only then TaskCreated.

TaskCreated is dispatched to TaskProjection, then it dispatched to TaskCreationProcessManager. The PM routes AssignTask and TaskAssigned is emitted by the aggregate. Then TaskAssigned is dispatched to TaskProjection. This case is valid unlike the first one, the projection handled TaskCreated and then TaskAssigned.

These two scenarios are possible because DispatcherRegistry returns dispatchers in an unpredictable order. So, depending on the order of dispatchers, TaskCreated will be dispatched first either to the process manager or to the projection.
The second questionable thing is that a command router posts commands to the bus, before the execution of the handler (which routes commands), is finished.

The proposed solution is to add a FIFO queue for messages at the bus level. In this case, commands, events and rejections will be dispatched in the order, in which they were posted into a bus.
A message should be added to the queue after it was posted to the bus. After a message was delivered to all consumers it should be removed from the queue.


Language specification of 'EN' not working

Hello, I am running a two weeks old version of faster-whisper. The thing is that I only need English transcriptions, so I specify it as a parameter (language="en"). It does not seem to work because of some reason. It might be a bug, but I couldn't find out. It keeps on generating transcripts in other languages. Thanks in advance.

I cannot really share the audio file. The model size is the small one.

shouldn't it still generate the transcription in the specified language?

There is no guarantee, especially if the audio file triggers the "temperature fallback" which is based on random generation.
I suggest that you try with the latest version and also with openai/whisper. If you see a similar behavior in openai/whisper it means it is a model issue.

I ran the normal whisper model on the same sample. It always gives me an English transcript if I specify that my language is "en". I'm gonna checkout the temperature fallback and if you have any other suggestions I'm open to hear them. Thank you


google.protobuf.text_format.ParseError: 161:14 : Message type "object_detection.protos.Optimizer" has no field named "i".

sparse.so.11: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/aarju/anaconda3/envs/demo_model/lib:/usr/lib/x86_64-linux-gnu:/home/aarju/anaconda3/envs/caffe/lib:/usr/lib/x86_64-linux-gnu
2021-01-25 14:30:04.810886: W tensorflow/stream_executor/platform/default/dso_loader.cc:60] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/aarju/anaconda3/envs/demo_model/lib:/usr/lib/x86_64-linux-gnu:/home/aarju/anaconda3/envs/caffe/lib:/usr/lib/x86_64-linux-gnu
2021-01-25 14:30:04.810902: W tensorflow/core/common_runtime/gpu/gpu_device.cc:1757] Cannot dlopen some GPU libraries. Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU. Follow the guide at https://www.tensorflow.org/install/gpu for how to download and setup the required libraries for your platform.
Skipping registering GPU devices...
2021-01-25 14:30:04.811643: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 AVX512F FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2021-01-25 14:30:04.814596: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2021-01-25 14:30:04.814714: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2021-01-25 14:30:04.814742: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]
WARNING:tensorflow:There are non-GPU devices in tf.distribute.Strategy, not using nccl allreduce.
W0125 14:30:04.820366<PHONE_NUMBER>30176 cross_device_ops.py:1321] There are non-GPU devices in tf.distribute.Strategy, not using nccl allreduce.
INFO:tensorflow:Using MirroredStrategy with devices ('/job:localhost/replica:0/task:0/device:CPU:0',)
I0125 14:30:04.821369<PHONE_NUMBER>30176 mirrored_strategy.py:350] Using MirroredStrategy with devices ('/job:localhost/replica:0/task:0/device:CPU:0',)
Traceback (most recent call last):
File "model_main_tf2.py", line 113, in
tf.compat.v1.app.run()
File "/home/aarju/anaconda3/envs/demo_model/lib/python3.8/site-packages/tensorflow/python/platform/app.py", line 40, in run
_run(main=main, argv=argv, flags_parser=_parse_flags_tolerate_undef)
File "/home/aarju/anaconda3/envs/demo_model/lib/python3.8/site-packages/absl/app.py", line 300, in run
_run_main(main, args)
File "/home/aarju/anaconda3/envs/demo_model/lib/python3.8/site-packages/absl/app.py", line 251, in _run_main
sys.exit(main(argv))
File "model_main_tf2.py", line 104, in main
model_lib_v2.train_loop(
File "/home/aarju/anaconda3/envs/demo_model/lib/python3.8/site-packages/object_detection/model_lib_v2.py", line 466, in train_loop
configs = get_configs_from_pipeline_file(
File "/home/aarju/anaconda3/envs/demo_model/lib/python3.8/site-packages/object_detection/utils/config_util.py", line 139, in get_configs_from_pipeline_file
text_format.Merge(proto_str, pipeline_config)
File "/home/aarju/anaconda3/envs/demo_model/lib/python3.8/site-packages/google/protobuf/text_format.py", line 728, in Merge
return MergeLines(
File "/home/aarju/anaconda3/envs/demo_model/lib/python3.8/site-packages/google/protobuf/text_format.py", line 802, in MergeLines
return parser.MergeLines(lines, message)
File "/home/aarju/anaconda3/envs/demo_model/lib/python3.8/site-packages/google/protobuf/text_format.py", line 827, in MergeLines
self._ParseOrMerge(lines, message)
File "/home/aarju/anaconda3/envs/demo_model/lib/python3.8/site-packages/google/protobuf/text_format.py", line 849, in _ParseOrMerge
self._MergeField(tokenizer, message)
File "/home/aarju/anaconda3/envs/demo_model/lib/python3.8/site-packages/google/protobuf/text_format.py", line 974, in _MergeField
merger(tokenizer, message, field)
File "/home/aarju/anaconda3/envs/demo_model/lib/python3.8/site-packages/google/protobuf/text_format.py", line 1048, in _MergeMessageField
self._MergeField(tokenizer, sub_message)
File "/home/aarju/anaconda3/envs/demo_model/lib/python3.8/site-packages/google/protobuf/text_format.py", line 974, in _MergeField
merger(tokenizer, message, field)
File "/home/aarju/anaconda3/envs/demo_model/lib/python3.8/site-packages/google/protobuf/text_format.py", line 1048, in _MergeMessageField
self._MergeField(tokenizer, sub_message)
File "/home/aarju/anaconda3/envs/demo_model/lib/python3.8/site-packages/google/protobuf/text_format.py", line 939, in _MergeField
raise tokenizer.ParseErrorPreviousToken(
google.protobuf.text_format.ParseError: 161:14 : Message type "object_detection.protos.Optimizer" has no field named "i".
System information

OS Platform and Distribution (e.g., Linux Ubuntu 16.04):

TensorFlow installed from (source or binary):

TensorFlow version (use command below):: 2.4

Python version: : 3.7

Bazel version (if compiling from source):

GCC/Compiler version (if compiling from source):

CUDA/cuDNN version: 10.2

GPU model and memory:

Exact command to reproduce:

@aarju123,
In order to reproduce the issue reported here, could you please provide the TensorFlow version, the complete code and the dataset you are using. Thanks!

@aarju123,
In order to reproduce the issue reported here, could you please provide the TensorFlow version, the complete code and the dataset you are using. Thanks!

this is protos error getting to run program, using tensorlow 2.4.1

this is protos error getting to run program, using tensorlow 2.4.1

@aarju123,
Could you please share the script you are running, so that we can reproduce the issue on our end. Thanks!

@aarju123,
Could you please share the script you are running, so that we can reproduce the issue on our end. Thanks!


Moves sources to their own column. fixes #21

Fixes #21

Moves sources to their own column
Improves formatting of markdown source (done automatically with prettier.io)
Changes "WFH" to "WFH Policy" (since this column is wide, there is room for the extra word)
Changes "Last Updated" to "Updated" (to keep that column no wider than it needs to be)

If you hate the changes to markdown formatting, let me know.

I updated a couple things you mentioned, working on getting that reflected in this PR

this can be closed if #65 is accepted

closing this in favor of #65


add d3.time.milliseconds to support millisecond resolution ticks

This addition makes it very easy to have millisecond resolution ticks on the axis
e.g.
maxBottomAxis.ticks(d3.time.milliseconds, 100).tickFormat(d3.time.format('%L'));

Issue #1529 does not provide quite the same functionality since it requires an explicit modification of the data.
d.time = new Date(+d.time * 1000);

This is already supported in the new d3-scale module, which will be the basis of the 4.0 API; see time.ticks. For example:
s.ticks("milliseconds", 100);

I’ve also added a millisecond time interval to d3-time for completeness.

Closing since this is implemented in d3-hierarchy.


Keep real part of Mahalanobis distance

Solves #248,
keeping real part of Mahalanobis distance,
and updating tests for test functions.

Thanks @qbarthelemy !


Tensorflow-Prune on GPU

Is there a way to run your tensorflow code for Lenet 300-100 on GPU? like as you did for computing hessian for Alexnet on GPU. Pruning on CPU takes very long time.

@rahimentezari , pruning is really time consuming, I don't think GPU can help, maybe implement in C could help.


Apexchart not clearing old data

Using "apexcharts": "^3.26.0",
See the video at the end showing the bug
Bug description
In my project, I select the data and when I click the button to generate the graph, it shows it correctly. However, when I select new data and re-generate the graph, it does not change. I have to press the button twice for the generation of the graph to work correctly. Also when I press the button, for a fraction of seconds 2 graphs appear .
Unwanted solutions

I know there is a method to update the chart data (update series). But I don't want to have to use 2 buttons. 1 to create the new graph and another to update as it would break the current project design.
I have found a post on stack overflow that says I should use render() at the beginning of my "generate" method to clean up the chart, but that involves creating a new config object for a new Apexchart object just to clean up a chart. That, not only has not worked for me, but it seems to me a somewhat sloppy solution.
(my project is a Vue 2 project) I know there is vue-apexchart, but I would like not to have to start from 0 since everything works perfectly now (apart from this "bug").

Expected solution
I have the feeling that it is a bug in the library, but if it is not, I would like to know how I can solve this in a clean and simple way without having to add more buttons, or create multiple apexcharts objects.
Code that generates the graph and is launched by the button
    generateGraf() {

      let colores = [
        "#00BAEC",
        "#FF2D00",
        "#67E400",
        "#F700FF",
        "#04FFD9",
        "#FFC800",
        "#FF00BF",
        "#8400FF",
        "#FFFB00",
        "#11FF00",
      ];
      // generate the data
      let datas = grafsUtils.generateDataForGraf(
        this.grfRawData,
        this.grfPerioTypes
      );

      // generate Y axis for each line
      let yaxis = grafsUtils.generateYaxis(datas, colores);

      // generating Series
      let series = grafsUtils.generateSeries(datas);

      // creating the Option object
      let options1 = {
        chart: {
          id: "grfPrincipal",
          type: "line",
          height: "100%",
          foreColor: "#A8A8A8",
          toolbar: {
            show: true,
            offsetY: -5,
            tools: {},
            export: {
              csv: {
                columnDelimiter: ";",
              },
            },
          },
        },
        colors: colores,
        stroke: {
          width: 2,
        },
        grid: {
          borderColor: "#F3F3F3",
          clipMarkers: false,
          yaxis: {
            lines: {
              show: true,
            },
          },
        },
        dataLabels: {
          enabled: false,
        },
        markers: {
          size: 0,
          colors: ["#818181"],
          strokeColor: ["#00BAEC"],
          strokeWidth: 0,
        },
        series: series,
        title: {
          text: undefined,
        },
        legend: {
          show: true,
          position: "top",
          horizontalAlign: "left",
          floating: true,
          offsetY: -5,
          offsetX: -5,
        },
        tooltip: {
          enabled: true,
          theme: "dark",
          shared: false,
          custom: function ({ series, seriesIndex, dataPointIndex, w }) {
            return (
              '
' +
              "" +
              moment(w.globals.seriesX[seriesIndex][dataPointIndex]).format(
                "DD-MM-YYYY hh:mm"
              ) +
              "
" +
              "" +
              w.globals.seriesNames[seriesIndex] +
              ": " +
              series[seriesIndex][dataPointIndex] +
              " " +
              w.globals.seriesZ[seriesIndex][dataPointIndex] +
              "" +
              "
"
            );
          },
        },
        xaxis: {
          type: "datetime",
        },

        yaxis: yaxis,
      };

      let chart1 = new ApexCharts(this.$refs.grfGrafica, options1);

      chart1.render();
    },

##Video showing the bug
https://user-images.githubusercontent.com/55595063/115763669-fd072500-a3a4-11eb-92a8-26a57506f349.mp4

I do not know if it is a very professional or adequate solution but the only thing that has occurred to me to solve this problem, since it does not have mechanisms to delete the graph (apart from updating), is to empty the DOM element.
// this.$refs.grfGrafica.innerHTML (in vue is)= document.getElementById('grfGrafica).innerHTML (in vanilla js)
this.$refs.grfGrafica.innerHTML="";


Regenerate mock client and services

cc @jeromefroe @cw9
This PR regenerates the mock client and services due to recent interface change.

Coverage decreased (-0.2%) to 82.607% when pulling 945cf577f572a3bc161c348e2a081acec2d5c9d7 on xichen-gen-mock-client into bd4e03f63eac38b60474e2ffe538071c1653421e on master.


ExecuteJavaScript with parameters

Currently ExecuteScript is always called with new object[0] as second argument (see SeleniumWebDriver.ExecuteScript), however, sometimes you want to pass an argument to the ExecuteScript() call. Currently I have to use
(browser.Native as IJavaScriptExecutor).ExecuteScript("myscript", scope.Native as IWebElement)

which is not all too nice :-)
Would be nice if there is parameter support.

Any chance you could do a PR for this one, looks straight forward to pass the params list all the way down?

Done that, see https://github.com/featurist/coypu/pull/130 (review points for you @ pull request comments).

Guess we can close this, after #130 has been merged :-)


Can 'MongoConstants.FILTER_LENGTH_LIMIT' in agent be configable?

https://github.com/apache/skywalking/blob/80af1667528cfd8924cce5ca4bc62a31c116974f/apm-sniffer/apm-sdk-plugin/mongodb-3.x-plugin/src/main/java/org/apache/skywalking/apm/plugin/mongodb/v3/support/MongoConstants.java#L34

Not today, if you want that, you need to submit a PR to move it to Agent Config. Like this
https://github.com/apache/skywalking/blob/master/apm-sniffer/apm-agent-core/src/main/java/org/apache/skywalking/apm/agent/core/conf/Config.java#L222

I will finish this.

Provided.


Correctly indicate which node versions support N-API

Values taken from the Node docs: https://nodejs.org/api/n-api.html#n_api_n_api_version_matrix
I left out Node.js 9 as it's no longer supported.

@pipobscure Could you take a look at this one? 🙏

@pipobscure Ping. IMO this patch doesn't really depend on the libuv question and it'd be nice to get accurate information into the repo.

We reworked it under the assumption that libuv is ali/abi stable. That notion is being challenged.
So i’ll be rejigging this back to use the me napi feature over xmas.
Please hold :smile:


FR: compatibility with OpenAI's API

If I'm not mistaken, this API is different from OpenAI's.
It prevents usage as a drop-in replacement for other applications or plugins that connect to Whisper (such as https://github.com/nikdanilov/whisper-obsidian-plugin).
This would be great to avoid ad-hoc implementations in each of these applications and plugins.

I like this idea. It would be useful if you could explain OpenAI's endpoints a bit and what the output format is for the data. thank you

I've ended up forking a project that does specifically that: https://github.com/didmar/whisper-api-server
There is also the official doc: https://platform.openai.com/docs/guides/speech-to-text

Good idea! I was actually planning to implement this change in version 2.0. I'll start to make some breaking changes to the repository after the new year.

I've recently created faster-whisper-server, which supports /v1/audio/transcriptions, /v1/audio/transcriptions, /v1/models, and /v1/models/{model} routes, as well as streaming transcription/translation (SSE), and live audio transcription (web socket)

proof of concept: #237. Still needs a lot of love and some abstraction to work across openai-whisper/faster-whisper cores


Cannot currently update package

Due to a non-standard version check (Ref: https://github.com/conda-forge/smac-feedstock/pull/9) it is currently impossible for us to update the package until this is changed upstream.

Hey @BastianZim is this an issue in conda-forge or SMAC?

Hi @mfeurer it's a bit of both. Some of the packages in conda-forge don't have a version attached in a way that can be read by pkg_resources.get_distributiondue to the way conda-forge compiles them.
Unfortunately, smac is unable to fall back to other ways to read them as outlined in https://github.com/conda-forge/smac-feedstock/pull/9#issuecomment-1044290983 so the import process fails.
IMHO checking for a version during import is a non-standard thing to do so I'm not sure why smac actually does that.

We used to get a lot of issues about the dependencies not being installed correctly wrt a package that requires compilation and SWIG (pyrfr), and people using the wrong OS (Windows). To not have these issues during the optimization we decided to fail at import time. @renesass could you please have a look at #9 here?


turn on Travis-CI tests

I enabled travis-CI builds on my fork a long time ago, it's really nice to get a report if a commit/branch/pull request breaks the build for any version of Python {2.6, 2.7, 3.3}. Totally up to you if you want to enable it, but I like it a lot.
Here's an example report https://travis-ci.org/kylewm/mf2py/builds/47810611

I did this a while back. Closing this up.


Need to have performance test in place

With the refactor of the synchronizer, we feel that we need a way to tell the performance differences between the new and old synchronizers.
Speaking of the performance, we are talking about the deployment delay between a batch of subscriptions. For instance,
If we apply 100 subscriptions at the same time, then,
a. would the code be able to handle these many subscriptions at once?(would all the subscriptions be processed eventually?)
b. if the first subscription deployed at t=0s, would the last subscription deploy at t=1hr?
In addition, we are assuming

the test is running on 1 hub and 1 managed clusters(meaning the kubeconfig of both clusters will be provided) and we are measuring the result on the managed cluster side.
each subscription is deployed via namespace channel
each subscription is targeted to deploy a configmap at the spoke cluster

@xiangjingli
@rokej
@mikeshng
@evelinec
If you guys have any other ideas please also let me know.

@ianzhang366 I like the measurement plan you outlined here. Is the baseline going to be the performance of the old synchronizer? Also, how difficult would it be to increase the concurrency? For example, 10, 20, 30, 50, 100 concurrent subscriptions.

@ianzhang366 I like the plan but I feel like we should focus on correctness and throughput over performance for now.

@ianzhang366 test notification

@ianzhang366 test notification x2

@ianzhang366 test notification x2

@ianzhang366 comment x3

@mikeshng @xiangjingli @rokej @jnpacker
Hi team, here's a quick update for this issue,
Object

Build up the benchmark for synchronizer 1.0(batch apply model) and 2.0(the channel version)
Compare the above 2 models and identify the bottleneck

Benchmark

Test method and measurement

Test method
Given hub and spoke cluster kubeconfig, then apply N subscriptions on the hub, then measure the resource created time on spoke.
The subscription is pointing to a namespace channel. The namespace channel has 1 deployable which has a configmap as payload.

Test ENV
a. How to run the controller
Both tests are running against the binary file of the subscription controller on my Mac.

Sample running command:
go run cmd/manager/main.go --alsologtostderr true --hub-cluster-configfile $GOPATH/src/github.com/openshift-install-mac/hubconfig/kubeconfig --kubeconfig $GOPATH/src/github.com/openshift-install-mac/managedconfig/kubeconfig --cluster-name ocp-managed --cluster-namespace ocp-managed  --disable-tls true  2> out.log

b. How to apply and measure the resource
I wrote the following tool to implement the test method. You can clone and
build the tool.
https://github.com/open-cluster-management/acmapp
Sample running command:
Apply 30 subscriptions and wait till all of them created at managed cluster.
acmapp perf --n 30 --hubcfg $GOPATH/src/github.com/open-cluster-management/acmapp/hub --spokecfg $GOPATH/src/github.com/open-cluster-management/acmapp/managecfg

Measurement
Then we measure how long will it take for the configmap created on spoke
cluster.

Note: we apply the N subscriptions on the hub at once.

Result

Batch model(sync_interval is default 1 min)

N = 10 (need 2mins)
N = 30 (crash)

Channel model

N = 10 (20 seconds)
N = 30 (around 3mins)
N = 100 (around 27 mins)

Bottleneck

Batch model
As the error shows(in raw data), when we are having large amount resource applied, the
synchronizer crashed due to the map write and read at the same time.

Channel model
As you may notice, the channel model won't crash when N = 30, it took about 3 mins to deploy all configmap on the managed cluster.
However, it will take quite a long time to apply this resource, when N = 100, in the beginning, it took more than 1 hour to apply all
the resource. So I did some parameter tunning around the channel model,
mainly,
(tunning PR is:
https://github.com/open-cluster-management/multicloud-operators-subscription/pull/198
)

let the processing request waiting longer before retrying.
when re-queuing, we try to re-queue request in a uniform manner
After these changes, when N = 100, we are able to get all the resource
deployable around 22 mins.

Moving forward, I inspected the processing time for each request. I mean, from
the synchronizer get the request to the synchronizer get back to the
request with the result.
From the observed data, we can see:

the single processing time increased when the amount of request increased
the default '/' request kicks in too often and used up too much resource

Raw data
https://github.com/open-cluster-management/acmapp/blob/master/raw_data/benchmark_may_15th.md

FYI, we can use the sync.Map instead of the map to achieve the thread-safe map. With this, we can increase the number of workers on the cache server-side.

sync.Map
https://golang.org/pkg/sync/#Map

current cache map definition
https://github.com/open-cluster-management/multicloud-operators-subscription/blob/2159f30ae0e7e77c01b80814c98c1c1c1cda666a/pkg/synchronizer/kubernetes/sync_server.go#L39-L52

@ianzhang366 The sync.Map doc says The Map type is optimized for two common use cases: (1) when the entry for a given key is only ever written once but read many times, as in caches that only grow, or (2) when multiple goroutines read, write, and overwrite entries for disjoint sets of keys.. Do you think the synchronizer's usage is one of these?

I think we fall into the 2nd case since our resource map is mapping the GVK, and I assume the concurrent subscriptions are not always trying to access the same resource(GVK).
However, I'm not sure would the assumption holds true when we are talking about config map or secret... since these are very popular resources.
In addition, there're some options other than the sync.Map, for example, the following,
https://github.com/orcaman/concurrent-map

moving to backlog issue to track this item


Disallow the same bridge on one chain:

Before this patch, two door accounts on the same chain could could own the same bridge spec (of course, one would have to be the issuer and one would have to be the locker). While this is silly, it does not violate any bridge invariants. However, on further review if we allow this then the claim transactions would need to change. Since it's hard to see a use case for two doors to own the same bridge, this patch disallows it. (The transaction will return tecDUPLICATE).

[x ] Bug fix (non-breaking change which fixes an issue)

note: have tests for this (Ram)


Fix OptionalUnwrapper after fixing problem in hibernate-validator

see<EMAIL_ADDRESS>

Was fixed in 5.2.0.Alpha1. Need to wait for official v5.2.0


AAE canonical trees

N.B. Successor to #828, requires basho/eleveldb#188 merged for dialyzer to pass.
Context
This pull request resolves issues discovered while debugging yz_aae_test.
The test would fail when AAE did not repair the same set of keys.
Hashtree Fixes

If keys in the last segments of the tree were deleted (but when there was another treeid following it in the same leveldb database), then the accumulator function was not called with an empty list of hashes for the remaining final segments.

Always calls prefetch_stop after using iterators to make sure their output is ordered.

Adds a paranoia check to update_tree to do a full rebuild if the list of dirty hashes is not the right length, and log.

Replaces the previous bucket clearing code which issued a delete for all buckets regardless whether they were populated.  Now scans the on disk bucket keys to do the removal.

Removes empty segments/buckets from higher levels to keep the tree canonical.

Avoids empty call to leveldb:write if the flush buffer is empty.

Model Fixes:

Open/close counters only work correctly if the rebuild mode is set to full between snapshot creation and and update perform.  The *_index_hashtree modules will need to implement that as separate PRs.

Now checks top level hashes if the compare set is empty to make sure the trees are canonical.

Reproduction
If you check code out to the first commit in the PR, the test has been modified, but the fix not applied yet.  It often takes longer than the eunit test time, so you can provoke from the console using
eqc:quickcheck(eqc:testing_time(30*60,hashtree_eqc:prop_correct())).

Make sure the .eunit is in your path to pick up hashtree with the right exports.
Example Failure
hashtree_eqc:start({1048576, 1024, 0}, [{1, 0}, {1, 1}], mark_empty, mark_empty,
    []) ->
  ok
hashtree_eqc:write(t2,
    [{<<50, 51>>,
      <<150, 155, 129, 115, 36, 118, 147, 22, 134, 106, 101, 83, 105,
        135, 166, 182, 63, 51, 224, 94>>},
     {<<48>>,
      <<150, 155, 129, 115, 36, 118, 147, 22, 134, 106, 101, 83, 105,
        135, 166, 182, 63, 51, 224, 94>>}]) ->
  ok
hashtree_eqc:delete(t1, <<50, 51>>) -> ok
hashtree_eqc:delete(t2, <<49, 53>>) -> ok
hashtree_eqc:update_snapshot(t1, s1) -> ok
hashtree_eqc:update_snapshot(t2, s2) -> ok
hashtree_eqc:update_perform(t2) -> ok
hashtree_eqc:update_perform(t1) -> ok
hashtree_eqc:local_compare() -> [{missing, <<48>>}]

Reason:
  Post-condition failed:
  [{missing, <<48>>}, {missing, <<50, 51>>}] /= [{missing, <<48>>}]

@jonmeredith any way I can con you into completing the sentence "If keys in the last segments of the tree were deleted (but when there was another treeid following it in the same leveldb database), then the accumulator function being called on" in the PR description - seems to be missing something.

👍 c8efc3e
After much reviewing, testing, and playing with this code, I'm satisfied that I can't find any issues with it. Also, hopefully no issues with +1ing my own commit - everything else looks good, and since that last fix is just a trivial comment change (which I ran by Doug already), I'm bending the rules slightly and going ahead with it.

Bumping the eleveldb version has fixed the eunit and dialyzer errors we were hitting before. Merging...

@borshop merge

:+1: a83023e

@borshop merge

create jira issue

[~pbrewer] What was done here and why? Need information for documentation for e.g.
[posted via JIRA by Seema Jethani]

[~nmarino] Can you provide some info on what was done for this?  Looks like you worked on it per GH.  [~seema][~lrother] This one appears it may have missed the release notes pull list for 2.0.7.  I found some stories yesterday that had the correct label of 2.0.7 but had "2.2" instead of "2.2.0" which means the story probably did not make the release notes starter list.  Lauren, if it helps, I can make a differences list from 2.0.7 to 2.2.0 as we get closer to release.
[posted via JIRA by Patricia Brewer]

[~pbrewer], nothing else needs to be done here. The GitHub PR has already been reviewed and merged, but for some reason when you commented with "create jira issue" on the PR, the JIRA issue was created as "needs review". I'll go ahead and mark this as "done".
It looks like it actually was included in the release notes for 2.0.7. Search for #830: http://docs.basho.com/riak/kv/2.0.7/release-notes/ The summary given was:
"Several bugs were found with hash trees that, in rare cases, could cause AAE to fail to repair missing data."
This is a very brief, high-level summary of the issue, but I think that's about as good as it's going to get from an end-user perspective. The PR includes a few different fixes for very subtle edge cases in AAE, and they are hard to describe succinctly. I think it's good that we linked the PR in the release notes though, so that if someone does have the desire and know-how to understand the details, they can still click through and read about it in more detail.
[posted via JIRA by Nick Marino]

Oh, and this has also been merged forward into to develop-2.2, so no worries there either.
[posted via JIRA by Nick Marino]


How to Use the video annotation instead of images in tensorflow API

I have trined my model using label images annotation but i have not done in videos. Is it the same way or do i need to do anything extra in tensorflow API

Hi Assam,
Thank you for your interest in our dataset. Unfortunately, we cannot help you with machine learning libraries such as Tensorflow. I recommend directing your question to corresponding forums.


Regarding compliance with license terms

Please be advised that all patches distributed through https://github.com/shiguredo-webrtc-build/webrtc-build/ are licensed under the Apache License 2.0.
If you wish to continue using these patches, please ensure compliance with the license terms.

Hi @voluntas,
Thanks for bringing this into the spotlight 👍
We'll address this asap.

Hi @voluntas,
Sorry for the delay in addressing this. Thanks for your patience and for highlighting the issue.


Access to Wandb

Hi,
As I've been trying to train and replicate the same result as yours based on the code provided I was directed to Wandb to visualize the results but I would get this error that I do not have sufficient permission to do so, I was wondering if this is possible that the permission would be granted or maybe you could walk me through it whether I can do it myself and generate my own Wandb because I am not very familiar with Wandb tool.
Thank you

Hi, @behzadtabari
If you want to use the wandb, you need to log in and provide your API key.
Or,  you can also use tensorboard for visualization.
Jay

Hi, @behzadtabari
If you want to use the wandb, you need to log in and provide your API key.
Or, you can also use tensorboard for visualization.
Jay

When I logged in, it said I've no permission to this project and shutted down my process. So I've to restart the train program and reload all these data again, orz


Migration script that updates index mapping without loss of data

After allowing users to directly insert answers and rumors into database, we will need a non-destructive way to update index mappings.

Planned in #7.
Closing this.


Cannot get device token

Previous version had a function to get device token, its gone.. So this plugin is unusable? Because device token is required.. ! (Ios)

Its now called the Registration ID ! (for other users, who are confused..
push.on('registration', function(data) {
console.log("registration event");
console.log(data);
});

Is this a problem or can I just close this?

Can be closed, but I was confused, because the device token is now called " Registration ID" )..


Problem with scrollbar

I'm trying to get an app to show a scrollbar, but I can't figure out how it's supposed to be done.
The code is essentially:
`    StackPanel.create [
    StackPanel.children [

        ScrollViewer.create [

            ScrollViewer.verticalScrollBarVisibility Primitives.ScrollBarVisibility.Visible ;

            ScrollViewer.content (

                StackPanel.create [

                    StackPanel.children [

                        // STUFF HERE

                    ]

                ]

            )

        ] ;

    ]

]     `

The view shows a scrollbar to the right, but it's not allowing any scrolling, even if the content becomes bigger than the window. Is there anything obvious I'm doing wrong?

Not something that I immediately recognise. Can you create a minimal reproduction? (like a single file a can run?)

That would be very helpful. Here is a quick example:
Gui.zip

Can't build the attached project, but looks fine.
There are big upcoming changes to FuncUI (see PR below). I'd recommend you to check out that branch so you can use the latest version of Avalonia + other cool stuff. Will be released soon.
https://github.com/fsprojects/Avalonia.FuncUI/pull/179

Weird... for me it builds alright.
Anyway, for me it just becomes a list of textbooks that goes beyond the window, but the scrollbar doest work.

Looking forward to the new changes. Will try the one you showed.

You could try using a dock panel as the top-level control / or a scroll viewer directly. I think your code will just work with the latest version of avalonia.

Hey! With a DockPanel it actually worked.
I assume the new version is not released as a package yet, and I have to build it myself?

I assume the new version is not released as a package yet, and I have to build it myself?

Yes, but it's sooo close to being released!


Is streaming2.3 available for spark2.3.0?

Env:
streamingpro-spark_2.3-1.1.6
spark_2.3.0

SQL:
`kafka.bootstrap.servers`="localhost:9092"
and `failOnDataLoss`="false"
and `startingOffsets`="latest"
and `subscribe`="test"
and valueFormat="json"
and valueSchema="st(field(dstIp,string),field(sourceIp,string))"
as kafka_post_json;

Q:
When i run streming2.3 on spark2.3.0,there will be an error:
Caused by: java.lang.NoSuchMethodError: org.apache.spark.sql.internal.SQLConf$.FROM_JSON_FORCE_NULLABLE_SCHEMA()Lorg/apache/spark/internal/config/ConfigEntry;
	at org.apache.spark.sql.WowJsonToStructs.<init>(WowJsonToStructs.scala:18)
	at streaming.source.parser.impl.JsonSourceParser.parse(JsonSourceParser.scala:12)

.
And then i changed spark2.3.0 to spark2.3.2, streaming2.3 worked well.
So does the streming2.3.2 only for the  spark2.3.2?

It seems there is  compatibility problem  with  2.3.0.  Yes, for now, spark 2.2.0,2.3.2,2.4.0 are tested.

Ok, thanks


[Feature Request] Ability to set a downloads folder outside the mangadesk directory

Is your feature request related to a problem? Please describe.
Currently if you change the DownloadDir the directory you set will always be inside the mangadesk folder. This makes it harder to organize big collections in one folder.
Describe the solution you'd like
It would be nice if DownloadDir used ~/Pictures/Mangas for example instead of creating a ~/Pictures/Mangas folder in its own folder.

you can actually make the downloads go to any folder by starting your path with / or using environment variables like $HOME, but you cant do it with ~ since those are usually expanded by the terminal and cant be done programmatically.

you can actually make the downloads go to any folder by starting your path with / or using environment variables like $HOME, but you cant do it with ~ since those are usually expanded by the terminal and cant be done programmatically.
for example to save the files in the Downloads folder u can set the path up to be /home/usr/Downloads or $HOME/Downloads

Thank you that actually worked, solved.


[Add display name-Build webhooks and connectors][Update TOC.yml][2594194]

Added display name

Acrolinx Scorecards
We currently enforce a minimum score of 80.
Click the scorecard links for each article to review the Acrolinx feedback on grammar, spelling, punctuation, writing style, and terminology:

Article
Score
Issues
Scorecard
Processed

msteams-platform/TOC.yml
98
6
link
:white_check_mark:

More info about Acrolinx
Use the Acrolinx extension, or sidebar, in Visual Studio Code to check spelling, grammar, style, tone, clarity, and key terminology when you're creating or updating content. For more information, see Use the Visual Studio Code extension to run Acrolinx locally.

Docs Build status updates of commit 094c564:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

msteams-platform/TOC.yml
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


CRA 3 fails to handle a trailing comma in tsconfig.json - TSC has no problem

This is a bug report. To reproduce it, run npx create-react-app . --typescript and change the "jsx": "preserve" line to "jsx": "preserve",. This is with CRA3 and I don't think this happened in CRA2 because I kept my tsconfig.json the same while upgrading CRA from 2 to 3 and only now got the error. I think this is a CRA issue because running tsc -p . in the directory goes through with no problem.

Yeah you're definitely right that tsconfig.json supports it. We'll have to investigate this. Likely a JSON.parse() somewhere.

TypeScript also allows you to put comments in tsconfig.json which makes it not actually JSON. As far as I know they strip them before parsing the file so it's possible they are doing something similar with trailing commas.

I think as long as a JSONC parser is used it should all go through because that's what TS is using I'd assume.

Unfortunately it looks like typescript uses a hand-written parser. I traced it down to parseJsonText which is defined in src/compiler/parser.ts. Ahahaha.
If we're allowed to hook into the typescript package, it looks like they provide public access to their parse function.

For whomever investigates this, I recommend taking a look at https://github.com/Realytics/fork-ts-checker-webpack-plugin for similar logic. I did a few PRs there related to parsing tsconfig using the TypeScript API that may be helpful.
However be careful as some of their functions will actually mutate the config. May not be worth using TS API potentially.

This might have been fixed by #7248? In which case can be closed. I see it deals with comments, not sure if it fixed the commas as well?


BatteryPool should be more explicit about using all components or a given set of component ids

What's needed?
Working a bit with the scenario of possibly changing component ids in the FCR actor, I found it cumbersome that
the empty set had the special meaning of "use all components".
Proposed solution
I propose we:

Add an explicit parameter use_all_components: bool
Also add a new getter using_all_components: bool to explicitly know if it is using all components or a a specific set

Use cases
No response
Alternatives and workarounds
No response
Additional context
No response

So calling without either some component_ids or use_all_components will be an error? I don't like that it makes the interface more complicated and that you can end up with some exception if you call it with the wrong combination of arguments.
Also, why it is important to know if it was created with all available components or not? It would be good to explain the user case a little bit.

It's fundamentally different if you use the pool with "use everything you can, even new things" and "use this fixed set of ids" and right now it's non-trivial to find out which of those two cases it is, once the pool is created.
and because it is so fundamentally different, I feel it should be setup differently, too.

So calling without either some component_ids or use_all_components will be an error?

No I think it' still fine to have use_all as default, it just shouldn't be use_all if you pass an empty set or None, imo, that mixes the two different cases too much.

Also, why it is important to know if it was created with all available components or not? It would be good to explain the user case a little bit.

Probably becoming less relevant once the SDK does pool caching or so, but it would help to then decide if you want to recreate the pool because you need a different set of ids (or all)

OK, I see your point now, but I if the issue is the interface being confusing and error prone, then I think your suggestion introduces other set of issues, as we have an overlapping set of options.
What about creating a sentinel value USE_ALL and make the signature: new_pool(batteries: USE_ALL | Set[int] = USE_ALL)? Then we can make passing an empty set an error and I think the interface should be pretty clear and explicit.
Then we can expose the requested batteries as a property (which might be different to the "currently used batteries", we should expose this as a separate property), which will have the info if you requested all or a fixed set.

@jh2007github this might be a good issue for you to pick up.

It's fundamentally different if you use the pool with "use everything you can, even new things" and "use this fixed set of ids" and right now it's non-trivial to find out which of those two cases it is, once the pool is created.

Sorry, a bit late, but this is not entirely accurate.  When nothing is specified, it uses the available components at start.  It doesn't pick up new or dropped components dynamically: https://github.com/frequenz-floss/frequenz-sdk-python/blob/2faab71a75b1eae1ff35f7a188e39aa5a26bb187/src/frequenz/sdk/timeseries/battery_pool/_battery_pool_reference_store.py#L79-L83
It just checks the component graph one time, so even components that are not connected, but present in the component graph are added.  So there's no real difference between how they behave,  and using battery_pool.component_ids would be stable irrespective of how it was created.
Also, using newly added components is not really possible without a restart.  The component graph doesn't get updated once setup.  We were discussing in the early days about having a trigger to automatically update the component graph when there are changes and rebuild the formulas, and reconfigure the power distributor, etc.  But that's all a lot of work, and hasn't been prioritized because it happens so rarely and we've just been restarting the apps.
All that said, I'm still ok with the proposal from Luca of having USE_ALL rather than an empty set as code to automatically fetch the components.

Third option is to take only a set, without any special meaning, and having a simple function to get all components of a particular category. Then it is new_battery_pool(get_all_batteries()). Super explicit also and we get an extra convenience feature of being able to retrieve all components of a category, but it requires extra work and it is considerably more verbose.

Then it is new_battery_pool(get_all_batteries()).

While I do like that idea, I think we should try to make the most common case the most convenient one, too.
Maybe this + factory function?

Yeah, even when I like explicitness a lot, I also have my doubts if it is just too long for the most common case. What do you mean by "this + factory function"?

your suggestion as is, additionally a convenience function to do exactly what your suggestion says

Also taking some distance from the topic and just reading pool = microgrid.new_battery_pool() for me there is not much other option than getting a pool with all the available batteries. So not sure if we really need a change here. I guess the original issue was it was confusing to have pool = microgrid.new_battery_pool(set()) get all the batteries, and this is true, so back to new_pool(batteries: USE_ALL | set[int] = USE_ALL), this sounds reasonable as we can make receiving an empty set an error.


Note in usage that this can be used for DLLs/libraries too

Just adding a note to the usage function that this tool also works perfectly for libraries/DLLs.

Yeah, that's exactly why I used the -F option. Cheers!


Support for .NET 4.6

Support for .NET 4.6: (1) Added projects. (2) Updated nuspec and readme text.

@manastalukdar Thanks for the pull request however given that no 4.6 features are used there is no no benefit in providing a NET 4.6 library and hence maintaining another project.


Error Model Optimizer

Hi, i have an issue when i launch mo.py, this is the error
mo.utils.error.Error: Exception occurred during running replacer "REPLACEMENT_ID" (<class 'extensions.middle.PartialInfer.PartialInfer'>): Stopped shape/value propagation at "TensorArrayV2" node.
For more information please refer to Model Optimizer FAQ (https://docs.openvinotoolkit.org/latest/_docs_MO_DG_prepare_model_Model_Optimizer_FAQ.html), question #38.
This is the run code.
python mo.py --input_model /Users/antoniosambataro/Desktop/frozen/d4/efficientdet-d4_frozen.pb  --transformations_config /Users/antoniosambataro/Desktop/automl_efficientdet.json  --input_shape "[1, 1024, 1024, 3]" -o /Users/antoniosambataro/Desktop/ --log_level=DEBUG
Im using ubuntu 18.04 and python3.7 and i try 3.6 too.
Can you help me plz? Also i tested the d6 version but same error
Thanks

Hi! Can you please specify which version of TensorFlow do you have?
python -c "import tensorflow as tf; print(tf.__version__)"

Hi, i have Tensorflow 2.3.1 and yes, this is up to date "automl_efficientdet.json"
thx

Well, we tested with 2.1.0 and 2.3.0. It might be an issue. Can you please share a model?

I am currently using checkpoints take from here https://github.com/google/automl/tree/master/efficientdet
Attached instead the models on this mega link, later I try the version 2.3.0 of Tensorflow
https://mega.nz/file/mFhx2SQZ#L4DjWeZVrV5ukltwRWXDzAQ3GiU7kL50EmbZq8Qt1CY

Hi! Sorry for delay.
Tried the latest master branch of OpenVINO (https://github.com/openvinotoolkit/openvino/commit/20df6eada6744b254798c046380a98fcc3bb6a87). Both d4 and d6 models are converted. TensorFlow 2.0.0 is installed.
python3 model-optimizer/mo.py \
  --input_model d6/efficientdet-d6_frozen.pb \
  --input_shape "[1, 1280, 1280, 3]" \
  --transformations_config model-optimizer/extensions/front/tf/automl_efficientdet.json

hi @dkurt, thanks for your great work. And I meet the same issue.
With my test, I think the python version(3.x is OK) and tensorflow2 version is not the point of this issue.
I test the model on mega by @samba45, because my winodws PC can not frozen the model, the linux PC can frozen model on my workplace...
Well, the test continue...
I see you last comment, and try to do this convert. I install the offical OpenVINO package l_openvino_toolkit_p_2021.1.110.tgz. Use the converter from this package and get the result like below:
xiaowei@xiaowei-1125:/mnt/e/openSourceProjecrts/efficient-test/model$ mo.py --input_model d4/efficientdet-d4_frozen.pb  --input_shape "[1,1024,1024,3]" --transformations_c
onfig automl_efficientdet.json
Model Optimizer arguments:
Common parameters:
        - Path to the Input Model:      /mnt/e/openSourceProjecrts/efficient-test/model/d4/efficientdet-d4_frozen.pb
        - Path for generated IR:        /mnt/e/openSourceProjecrts/efficient-test/model/.
        - IR output name:       efficientdet-d4_frozen
        - Log level:    ERROR
        - Batch:        Not specified, inherited from the model
        - Input layers:         Not specified, inherited from the model
        - Output layers:        Not specified, inherited from the model
        - Input shapes:         [1,1024,1024,3]
        - Mean values:  Not specified
        - Scale values:         Not specified
        - Scale factor:         Not specified
        - Precision of IR:      FP32
        - Enable fusing:        True
        - Enable grouped convolutions fusing:   True
        - Move mean values to preprocess section:       None
        - Reverse input channels:       False
TensorFlow specific parameters:
        - Input model in text protobuf format:  False
        - Path to model dump for TensorBoard:   None
        - List of shared libraries with TensorFlow custom layers implementation:        None
        - Update the configuration file with input/output node names:   None
        - Use configuration file used to generate the model with Object Detection API:  None
        - Use the config file:  None
Model Optimizer version:        2021.1.0-1237-bece22ac675-releases/2021/1
[ ERROR ]  Cannot infer shapes or values for node "TensorArrayV2".
[ ERROR ]  Tensorflow type 21 not convertible to numpy dtype.
[ ERROR ]
[ ERROR ]  It can happen due to bug in custom shape infer function <function tf_native_tf_node_infer at 0x7fc5c5083400>.
[ ERROR ]  Or because the node inputs have incorrect values/shapes.
[ ERROR ]  Or because input shapes are incorrect (embedded to the model or passed via --input_shape).
[ ERROR ]  Run Model Optimizer with --log_level=DEBUG for more information.
[ ERROR ]  Exception occurred during running replacer "REPLACEMENT_ID" (<class 'extensions.middle.PartialInfer.PartialInfer'>): Stopped shape/value propagation at "TensorArrayV2" node.
 For more information please refer to Model Optimizer FAQ, question #38. (https://docs.openvinotoolkit.org/latest/openvino_docs_MO_DG_prepare_model_Model_Optimizer_FAQ.html?question=38#question-38)

The same screenprint with samba45.
En, the automl_efficientdet.json is latest.
Clone the openvino repo with the latest automl_efficientdet.json, the json is same.
openvino git repo info:
xiaowei@xiaowei-1125:/mnt/e/openSourceProjecrts/openvino$ git log -n 1
commit 27c97a037f84e764c5570060aa8f60a68aca3579 (HEAD -> master, origin/master, origin/HEAD)
Author: Maxim Kurin<EMAIL_ADDRESS>Date:   Wed Nov 11 17:40:37 2020 +0300

    [IE][VPU]: Optimize swish layer and remove swish replacement pass (#2993)

    * Swish layer optimization
    * Update VPU firmware 1468

Then, I try the git repo converter use the same input parameters. like:
xiaowei@xiaowei-1125:/mnt/e/openSourceProjecrts/efficient-test/model$ python3 /mnt/e/openSourceProjecrts/openvino/model-optimizer/mo.py --input_model d4/efficientdet-d4_fr
ozen.pb  --input_shape "[1,1024,1024,3]" --transformations_config /mnt/e/openSourceProjecrts/openvino/model-optimizer/extensions/front/tf/automl_efficientdet.json
Model Optimizer arguments:
Common parameters:
        - Path to the Input Model:      /mnt/e/openSourceProjecrts/efficient-test/model/d4/efficientdet-d4_frozen.pb
        - Path for generated IR:        /mnt/e/openSourceProjecrts/efficient-test/model/.
        - IR output name:       efficientdet-d4_frozen
        - Log level:    ERROR
        - Batch:        Not specified, inherited from the model
        - Input layers:         Not specified, inherited from the model
        - Output layers:        Not specified, inherited from the model
        - Input shapes:         [1,1024,1024,3]
        - Mean values:  Not specified
        - Scale values:         Not specified
        - Scale factor:         Not specified
        - Precision of IR:      FP32
        - Enable fusing:        True
        - Enable grouped convolutions fusing:   True
        - Move mean values to preprocess section:       None
        - Reverse input channels:       False
TensorFlow specific parameters:
        - Input model in text protobuf format:  False
        - Path to model dump for TensorBoard:   None
        - List of shared libraries with TensorFlow custom layers implementation:        None
        - Update the configuration file with input/output node names:   None
        - Use configuration file used to generate the model with Object Detection API:  None
        - Use the config file:  None
Model Optimizer version:        unknown version

[ SUCCESS ] Generated IR version 10 model.
[ SUCCESS ] XML file: /mnt/e/openSourceProjecrts/efficient-test/model/./efficientdet-d4_frozen.xml
[ SUCCESS ] BIN file: /mnt/e/openSourceProjecrts/efficient-test/model/./efficientdet-d4_frozen.bin
[ SUCCESS ] Total execution time: 119.66 seconds.
[ SUCCESS ] Memory consumed: 691 MB.

WoW! And try d6
xiaowei@xiaowei-1125:/mnt/e/openSourceProjecrts/efficient-test/model$ python3 /mnt/e/openSourceProjecrts/openvino/model-optimizer/mo.py --input_model d6/efficientdet-d6_frozen.pb  --input_shape "[1,1280,1280,3]" --transformations_config /mnt/e/openSourceProjecrts/openvino/model-optimizer/extensions/front/tf/automl_efficientdet.json
Model Optimizer arguments:
Common parameters:
        - Path to the Input Model:      /mnt/e/openSourceProjecrts/efficient-test/model/d6/efficientdet-d6_frozen.pb
        - Path for generated IR:        /mnt/e/openSourceProjecrts/efficient-test/model/.
        - IR output name:       efficientdet-d6_frozen
        - Log level:    ERROR
        - Batch:        Not specified, inherited from the model
        - Input layers:         Not specified, inherited from the model
        - Output layers:        Not specified, inherited from the model
        - Input shapes:         [1,1280,1280,3]
        - Mean values:  Not specified
        - Scale values:         Not specified
        - Scale factor:         Not specified
        - Precision of IR:      FP32
        - Enable fusing:        True
        - Enable grouped convolutions fusing:   True
        - Move mean values to preprocess section:       None
        - Reverse input channels:       False
TensorFlow specific parameters:
        - Input model in text protobuf format:  False
        - Path to model dump for TensorBoard:   None
        - List of shared libraries with TensorFlow custom layers implementation:        None
        - Update the configuration file with input/output node names:   None
        - Use configuration file used to generate the model with Object Detection API:  None
        - Use the config file:  None
Model Optimizer version:        unknown version

[ SUCCESS ] Generated IR version 10 model.
[ SUCCESS ] XML file: /mnt/e/openSourceProjecrts/efficient-test/model/./efficientdet-d6_frozen.xml
[ SUCCESS ] BIN file: /mnt/e/openSourceProjecrts/efficient-test/model/./efficientdet-d6_frozen.bin
[ SUCCESS ] Total execution time: 154.93 seconds.
[ SUCCESS ] Memory consumed: 1371 MB.

Prefect!
I try the tensorflow-cpu 2.0.0, 2.3.1, 2.4.0rc, and python 3.6.9, 3.8.5, 3.8.3, no effect for openvino model-optimizer.
I will try the script for forward, hopeful I can get the right result on OpenVINO.

@xiaoweiChen, OpenVINO from GitHub should be used for conversion, that's right. Then resulting model can be executed with already released binaries.

Hi everyone, I tried with the openvino repo and everything works perfectly! Can I ask what performance you have in fps with the d6 model? thanks!!

@samba45, you may try to benchmark it on Intel DevCloud


The name 'ModelReplacementAPI' does not exist in the current context error

I made one model and I didn't get this error and it worked fine, but I made another one and it threw this error. I even made a separate Unity project and tried again and I'm still getting this error.

Nevermind, forgot to put in the ModelReplacementAPI.dll


Don't focus input on mouseup

Thanks a lot for contributing to react-autosuggest :beers:
Before submitting the Pull Request, please:

write a clear description of what this Pull Request is trying to achieve
npm run build to see that you didn't break anything

After clicking on a suggestion, clicking anywhere else triggers onDocumentMouseUp (even after a period of time, I guess the component isn't being unmounted and thus the event listener isn't being removed). this.justSelectedSuggest is false / undefined which causes the input to be focussed again. This fix isn't a perfect fix, but it will prevent the input from refocusing if the focusInputOnSuggestionClick prop is set to false.
I've built and have this working in my project, and no changes to any tests were required.

Thanks for the contribution @foodforarabbit, I'm just digging through old PRs here to clean them up. I'm not sure about this description though:

After clicking on a suggestion, clicking anywhere else triggers onDocumentMouseUp (even after a period of time, I guess the component isn't being unmounted and thus the event listener isn't being removed)

From looking at the code, it certainly appears that this shouldn't happen - pressedSuggestion is set only on mouse down on a suggestion, and is removed on the next mouse up anywhere, so you should never see a fresh click elsewhere triggering the focus change that pressedSuggestion causes.
I know it's been a while, but do you have any more detail on the specific issue, or how we can reproduce it? It'd be much better to fix this properly, if it still exists, rather than adding this new quick prop to disable the correct input focus behaviour because of a bug.

Hi @foodforarabbit are you still interested in this? I'd love to get this issue resolved for you, if you're still facing it, and you've got a little time to look into my comment above? No worries if not, but I'll probably close this PR in a few days.

Hmm sorry I haven't worked with this in a long time, not sure how to reproduce anymore. I think it is ok to close this, maybe initial issue was just some version mismatch or some other bug in my code. Thanks!

No problem, thanks for letting us know! :+1:


GBLinear model dump has wrong bias value

Hello XGBoost-Team,
I stumbled across an oddity related to the linear booster.
As I test I created a dataset that follows y = 3*x + 1 and trained a linear model.
A plot of the predicted values shows that the model perfectly learned the function, however, if I look at the model dump, I get a bias value of approximately 0.5 which is strange since the predictions are correct.
This behavior appears both for the Python as well as the Java API.
Python example:
import xgboost as xgb
import numpy as np

x = np.linspace(-100, 100, num=1000).reshape([1000, 1])
y = 3 * x + 1

dtrain = xgb.DMatrix(x, label=y)

param = {'booster': 'gblinear'}

bst = xgb.train(param, dtrain, num_boost_round=1000)

print(bst.get_dump())

Am I misunderstanding something?
Kind regards,
AtR1an

There is a parameter called base_score, which adds the same number to all predictions. By default, base_score is set to 0.5. Try setting this parameter to 0; you should then get bias 1.


How can I customize this bar  with custom html ?

Summary
I want to use custom style like

Screenshots

@shakil-brl
Change the value of week.timegridSchedule.borderRadius in theme. and modify some CSS on your own.
And Please write a description in detail as you can to get help from others.

sir @adhrinae I want to add 2 custom dives in timegridSchedule
the area where I want to use border-color as per timegridSchedule dynamic  border-color  please check the image,

timegridSchedule top and bottom will add extra dive where the div will get dynamic border-color Not background color.
thank you for your quick response

@Shakil1081
There are goingDuration and comingDuration templates for schedules having goingDuration and comingDuration properties. So you can leverage them.

https://nhn.github.io/tui.calendar/latest/Schedule
https://nhn.github.io/tui.calendar/latest/Template

You'll need to override CSS properties and I'm not sure it's possible to implement what you want.


Align sentendes of a Web site based on cross-lingual sentence embeddings

For sentences in a Wet site, align them based on cross-lingual sentence embeddings, e.g., LaBSE. So, the basic steps are as follows:

For pages in a Web site, segment text into sentences;
Convert sentences into dense vectors using LaBSE;
Find the most similar senteces. i.e., parallel sentences, based on embedding vectors.

See CCMatrix for better preformance.