Example of SSL Pinning

After review the documentation I can't found how to implement SSL Pinning. Is possible add an example to documentation?

done, https://github.com/flutterchina/dio#https-certificate-verification

@wendux
Pinning is an optional mechanism that can be used to improve the security of a service or site that relies on SSL Certificates. Pinning allows you to specify a cryptographic identity that should be accepted by users visiting your site.

Basically is to avoid Man in the Middle attack using a proxy(Charles Proxy for example) and monitoring the App traffic. The self-signed certificate can be installed in the phone manually and the App will see it as valid. badCertificateCallback will never be called.
badCertificateCallback is only called when a server certificate cannot be authenticated by any of our trusted root certificates.
We need an onCertificateCallback to properly implement an SSL pinning mechanism.

We need SSL Pinning by SHA-256(Subject Public Key Info)

Need too.

An update on sha256 certificate pinning?

found a lib - https://pub.dev/packages/http_certificate_pinning


[WiP] Add script for setting up a test server

[ ] change the apache conf to use the LE cert from the host
[ ] add mariadb container
[ ] add pubsub container; maybe published on a different port?


Error with sct_env using zsh

I'm running sct_v3.1.0 and having some issues using sct_env with Z shell. When sct_env is sourced in my .zshrc it returns the following error
addtopath:3: bad substitution

When running bash as my shell, this error doesn't occur. It seems to be this line that gives the error
if [[ ":${!2}:" != *":$1:"* ]]; then

Apparently there are some differences between zsh and bash in terms of handling arrays which might be the root cause here. I tried to figure out how to fix this but couldn't find a fix directly. Thought someone here, better versed with the shell, might know.
It should be reproducible by installing zsh and running source sct_env.
This is not a major issue since most users probably doesn't use zsh but thought I would let you know. It is easy to do a manual workaround for me at the moment.
Thanks!

Thanks @zougloub! All works now without any problems.
Cheers!


TestBenchConfiguration cast exception

Hi!
I have updated to ver. 1.1.10 and I have the following error (with stacktracing ON):
`
:testClasses UP-TO-DATE
FAILURE: Build failed with an exception.

What went wrong:
Cannot cast object 'fi.jasoft.plugin.configuration.TestBenchConfiguration_Decorated@6d31cb64' with class 'fi.jasoft.plugin.configuration.TestBenchConfiguration_Decorated' to class 'fi.jasoft.plugin.configuration.TestBenchConfiguration'

Try:
Run with --info or --debug option to get more log output.

Exception is:
org.codehaus.groovy.runtime.typehandling.GroovyCastException: Cannot cast object 'fi.jasoft.plugin.configuration.TestBenchConfiguration_Decorated@6d31cb64' with class 'fi.jasoft.plugin.configuration.TestBenchConfiguration_Decorated' to class 'fi.jasoft.plugin.configuration.TestBenchConfiguration'
at fi.jasoft.plugin.TaskListener.configureTest(TaskListener.groovy:235)
at fi.jasoft.plugin.TaskListener.beforeExecute(TaskListener.groovy:70)
...
`

I think this is the same as #343.
Could you post the vaadin related parts of your build.gradle? Is your project a single or multimodule project?If you run gradle clean test does it work then?

Ofc.
This is a multi-module build:

main module
_ app module
_widgetSet module

I'm trying to run only the clean&build tasks of widgetSet module when the error occures.
gradle clean test is fine btw.
Vaadin ver.: 8.0.5
Gradle ver.: 3.5
widgetSet build.gradle:
Somehow the MD parser don't format my code I pasted here, so here is the gist:
https://gist.github.com/atistrcsn/99b7aeae7d88f49d42ff627c81afa0d8

I can make code inserting to work (github newbie =)):
plugins {
    id 'fi.jasoft.plugin.vaadin' version '1.1.9'
}

apply plugin: 'java'
description = '***-widgetset'

vaadinCompile {
    widgetset '***.AdminWidgetSet'
    widgetsetGenerator '***.admin.app.WidgetSetGenerator'
    userAgent "safari"
}

jar.dependsOn 'vaadinCompile'
jar.from 'src/main/webapp'
war.enabled false

configurations {
    justJar
}

artifacts {
    justJar jar
}

dependencies {
    compile group: 'com.vaadin', name: 'vaadin-context-menu', version: '2.0.0'
//    compile group: 'com.vaadin', name: 'vaadin-charts-compatibility', version: '4.0.0'
    compile group: 'org.vaadin.addons', name: 'vaadin-sliderpanel', version: '2.0.0'
    compile group: 'org.vaadin.addon', name: 'confirmdialog', version: '3.1.1'
    compile group: 'org.vaadin.addon', name: 'easyuploads', version: '8.0.0'
    compile group: 'org.vaadin.addons', name: 'vaadin-jcrop', version: '1.1.2'
    compile group: 'org.vaadin.addons', name: 'dom', version: '0.1.0'
    compile group: 'org.vaadin', name: 'viritin', version: '2.0.beta1'
    compile(group: 'com.vaadin', name: 'vaadin-compatibility-client', version: '8.0.5')
    compile(group: 'com.vaadin', name: 'vaadin-client-compiler', version: '8.0.5')
}

UPDATED: gradle clean test has the same exception.

Do you have a settings.gradle? Do you have any Vaadin related there?

	Nothing vaadin related, only project names..

On Tue, May 2, 2017 at 7:15 PM +0200, "John Ahlroos"<EMAIL_ADDRESS>wrote:
Do you have a settings.gradle? Do you have any Vaadin related there?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.

Hi,
Could you try the new 1.2.beta1 version (https://plugins.gradle.org/plugin/com.devsoap.plugin.vaadin)?
A lot a of code around this has been improved and this shouldn't be an issue anymore.

Hi,
I could try it, but right now I have no extra time for this. I will try it within 1-2 weeks. We have to provide some working demo to the client :)

Alright, I'll close this then for now. Please re-open if you are getting something similiar with 1.2.x.
Good luck with the demo! :)

Hi,
I have some problem and on new version: "com.devsoap.plugin:gradle-vaadin-plugin:1.2.1"

Cannot cast object 'task ':kpsplus-vaadin-theme:vaadinCompile'' with class 'com.devsoap.plugin.tasks.CompileWidgetsetTask_Decorated' to class 'com.devsoap.plugin.tasks.CompileWidgetsetTask'


show/hide connectivity status with Prism

Hi James, so... what's tehe best way to use this API with Prism? Do I put a property in the ViewModelBase or leave it int the views code behind? Do you have an example to help me?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 33758e0e-bd5d-0829-b458-6cdfabe98b44
Version Independent ID: d3ed3057-798b-44b9-b5a0-35e657f7a4b8
Content: Xamarin.Essentials: Connectivity - Xamarin
Content Source: docs/essentials/connectivity.md
Product: xamarin
GitHub Login: @jamesmontemagno
Microsoft Alias: jamont

You can do it in either. Up to you and where you want to put it and if you need to mock it out.


Yash/refactor/enhancement

Description
Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.
Fixes # (issue)
Type of change
Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

[ ] Test A
[ ] Test B

Test Configuration:

Hardware:
OS:
Browser:

Checklist:

[ ] My code follows the style guidelines of this project
[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules

need to update changes


Chat - Whitespace isn't added after the second native emoji in the composer

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: <IP_ADDRESS>
Reproducible in staging?: Y
Reproducible in production?: Y
If this was caught during regression testing, add the test name, ID and link from TestRail: https://expensify.testrail.io/index.php?/tests/view/4533081&group_by=cases:section_id&group_id=292106&group_order=asc
Issue reported by: Applause - Internal Team
Action Performed:

Open any chat
Tap inside the composer
Tap on the native emoji picker on the keyboard
Tap on any two native emojis

Expected Result:
Whitespace should be added after the second one
Actual Result:
Whitespace isn't added after the second native emoji in the composer. It's present after the first one
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android: Native
[ ] Android: mWeb Chrome
[x] iOS: Native
[ ] iOS: mWeb Safari
[ ] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos
Add any screenshot/video evidence

https://github.com/Expensify/App/assets/78819774/31322047-3f5c-488a-a484-3ce4380e9b24
View all open jobs on GitHub

@muttmuure  FYI I haven't added the External label as I wasn't 100% sure about this issue. Please take a look and add the label if you agree it's a bug and can be handled by external contributors

We think that this bug might be related to #vip-vsp

Proposal
Please re-state the problem that we are trying to solve in this issue.
There is not whitespace when adding an emoji from native keyboard for the 2nd time.
What is the root cause of that problem?
When we add an emoji either from the emoji picker or the native keyboard, the whitespace will be added only if the isEmojiInserted condition is true.
https://github.com/Expensify/App/blob/20bd1140e14c220af3704c81cd1cc69bbe052d45/src/pages/home/report/ReportActionCompose/ComposerWithSuggestions/ComposerWithSuggestions.tsx#L393-L399
In our case, the condition that fails is the diff.trim() === diff. The reason is that the diff contains a leading whitespace. The diff is calculated based on the selection of the text input. The startIndex is the start of the newly inserted text and the maximum value is the selection start value.
https://github.com/Expensify/App/blob/20bd1140e14c220af3704c81cd1cc69bbe052d45/src/pages/home/report/ReportActionCompose/ComposerWithSuggestions/ComposerWithSuggestions.tsx#L363-L366
for the explanation below, we use the emoji length as 2
However, the selection value is wrong. When we add the first emoji, the selection is first manually updated to emoji length + space length (2 + 1 = 3).
https://github.com/Expensify/App/blob/20bd1140e14c220af3704c81cd1cc69bbe052d45/src/pages/home/report/ReportActionCompose/ComposerWithSuggestions/ComposerWithSuggestions.tsx#L428-L431
Then, because we add the emoji from the keyboard, it triggers the onSelectionChange with the value of the emoji length without the space length (2). In iOS, if we update the input value manually (not from the keyboard, in this case the whitespace), it won't trigger onSelectionChange.
So, the selection now is 2 instead of 3. When we add the 2nd emoji, findNewlyAddedChars think that the new text starts at the selection position of 2, that is the emoji with the leading space that is added from the first emoji ( 😄).
What changes do you think we should make in order to solve the problem?

Ignore the selection update from onSelectionChange if we already update it manually inside updateComment. We will create a new ref, set the ref to true when updating the selection in updateComment, and return early (ignore) the selection change event if the ref is true and reset it back to false.
https://github.com/Expensify/App/blob/20bd1140e14c220af3704c81cd1cc69bbe052d45/src/pages/home/report/ReportActionCompose/ComposerWithSuggestions/ComposerWithSuggestions.tsx#L550-L558
if ((textInputRef.current?.isFocused() && suggestionsRef.current?.onSelectionChange?.(e))) {
    if (isSelectionUpdatedManually.current) {
        isSelectionUpdatedManually.current = false;
    }
    return;
}

What alternative solutions did you explore? (Optional)
I think the reason we compare the newly added text with the trimmed newly added text is to prevent adding another trailing whitespace if we are adding an emoji with a trailing whitespace. In that case, we can change this to .trimEnd
https://github.com/Expensify/App/blob/20bd1140e14c220af3704c81cd1cc69bbe052d45/src/pages/home/report/ReportActionCompose/ComposerWithSuggestions/ComposerWithSuggestions.tsx#L394

Not a priority


Support for epoch conversions

I had worked on adding support for epoch time conversions to human readable on my fork.
% dig 784783800.epoch @<IP_ADDRESS> -p 5354

;; QUESTION SECTION:
;784783800.epoch.		IN	A

;; ANSWER SECTION:
784783800.		1	IN	TXT	"1994-11-14 09:00:00 +0530 IST"

If you are okay with this, I can send in the PR.
Thanks and have a happy weekend! :slightly_smiling_face:

I like this idea. This is useful for me too. Can we have a switch for UTC or other timezones too? Something like:
❯ dig 784783800-UTC.epoch @<IP_ADDRESS> -p 5354

;; QUESTION SECTION:
;784783800.epoch.		IN	A

;; ANSWER SECTION:
784783800.		1	IN	TXT	"1994-11-14 09:00:00 UTC"

Hey @varunlakkur
Thanks for the suggestion! I made a quick change such that the result now includes both UTC and local time.
% dig 784783800.epoch @<IP_ADDRESS> -p 5354

;; QUESTION SECTION:
;784783800.epoch.		IN	A

;; ANSWER SECTION:
784783800.		1	IN	TXT	"1994-11-14 03:30:00 +0000 UTC" "1994-11-14 09:00:00 +0530 IST"

Thanks @aneeraj. Please do send a PR.


Make samples work with relative path OR with npm module

A common pattern is for one to copy our samples and just deploy them. Currently you have to modify code as the Azure module is relatively referenced in the require.
A fix would be to add logic that tries to resolve relative, if not found it does a simple require.

Fixed in dev.

Great!
Sent from my Windows Phone
From: Andre Rodrigues
Sent: 1/26/2012 10:59 AM
To: Glenn Block
Subject: Re: [azure-sdk-for-node] Make samples work with relative path
OR with npm module (#2)
Fixed in dev.

Reply to this email directly or view it on GitHub:
https://github.com/WindowsAzure/azure-sdk-for-node/issues/2#issuecomment-3674382


Add Dockerfile for agent

Adds Dockerfile for the agent and Makefile command to build the agent container (#376)
I had to add a couple workarounds in the Dockerfile that are outlined below and in the comments of the file itself:

For now, we install the agent by downloading the .apk file from their github releases. Ideally, we would install the agent via a pre-built and published package. If/when that is supported, we will update our installation process.
We do not add the Linux capability (CAP_NET_BIND_SERVICE) to the nginx and nginx debug binaries. This capability allows nginx to bind to privileged ports. Adding this capability prevents the agent from reading nginx's /proc/<pid>/exe symlink which the agent requires to determine the path to the nginx binary. While we wait for a more permanent fix, we will work around this by having nginx bind to non-privileged ports. See this write-up for more details: https://dxuuu.xyz/filecaps.html

In addition to the Dockerfile, I added a deployment manifest for the agent. This is for testing purposes only, and is not the agent's final manifest.
One final note, CI build/publish steps are out of scope for this PR

Is the intention to then use this container and add a layer with NGINX?
Asking since this appeared to be agent only and not NGINX / NGINX Plus.
And I didn't think we were following a sidecar pattern (nor do I think that in the best interest of the customer).

Is the intention to then use this container and add a layer with NGINX? Asking since this appeared to be agent only and not NGINX / NGINX Plus. And I didn't think we were following a sidecar pattern (nor do I think that in the best interest of the customer).

The docker container runs both NGINX OSS and the agent processes. The docker image is based off the nginx image and the entrypoint.sh script kicks off nginx and nginx-agent processes.


Updating to work with Python 3

Some modifications to be able to run with Python 3

This is probably best directed upstream @ https://bitbucket.org/birkenfeld/sphinx-contrib since I no longer maintain this repository. Thanks for your contribution!


Eviction policy needs to consider whether the KV Chunk is being read.

Why is it missing? The LRU evictor does consider this already?


OffScrubC2R.vbs is not removing [Desktop > Context Menu > New > Office apps entries]

OS - Windows 10 x86 1809
Office installed - C2R O2013 15.0.4433.1508
Upon force removal with OffScrubC2R.vbs,
[Desktop > Context Menu > New > Office apps entries] were left.

Just noticed
Development of https://github.com/OfficeDev/Office-IT-Pro-Deployment-Scripts has stopped.


added a semi transparent layer when laying out; fixed the bug when la…

Changes

added a semi transparent layer when laying out
fixed the bug when layout algorithm is triggered multiple time

Coverage decreased (-0.3%) to 83.945% when pulling 2ab6c3574a89e7863d0ffb778e177cede8d1781c on conglei:conglei--network--fix into 714657f38f68c62e480e3bc682b2623ce05ef1c1 on williaster:master.

Coverage decreased (-0.3%) to 83.945% when pulling 3042cd777d00840efd26588cceed6cdb0902f3b8 on conglei:conglei--network--fix into 714657f38f68c62e480e3bc682b2623ce05ef1c1 on williaster:master.

Coverage decreased (-0.07%) to 84.177% when pulling b7bb7e42e2ca6a306d925f8f2b886b950be7c8a2 on conglei:conglei--network--fix into 714657f38f68c62e480e3bc682b2623ce05ef1c1 on williaster:master.

LGTM thanks! 🏆 will merge and release later tonight or tomorrow AM (working on react 16 so switching between branches is a little more painful)


update showcase.json to update hot-or-not to yral

Update showcase.json file
update assets (logo, screenshot and video)

Dear @adarsh-kumar-yral,
In order to potentially merge your code in this open-source repository and therefore proceed with your contribution, we need to have your approval on DFINITY's CLA.
If you decide to agree with it, please visit this issue and read the instructions there. Once you have signed it, re-trigger the workflow on this PR to see if your code can be merged.
— The DFINITY Foundation


Made nock recordings always consist order (order by keys)

This will make it much easier to review changed recordings!

This is done, however recording can not be valid for replay and might require manual re-ordering ...


Adding in the 1350 clamping requirement

Hi @EvanBasalik, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!

This seems like a small (but important) contribution, so no contribution license agreement is required at this point. Real humans will now evaluate your PR.

TTYL, AZPRBOT;

@EvanBasalik : Thanks for your contribution to the Azure documentation! The author, @cherylmc, has been notified to review your proposed change.

Thanks @EvanBasalik! @tysonn, can you please merge this in?


Animation recorder: UI messed up when we add an object to record

What happened?
The UI is broken when we click on the "Add Object To Record" button
The new "Object Recorder" section appears but is empty and there is an error in the console
KeyNotFoundException: The given key was not present in the dictionary.
System.Collections.Generic.SortedDictionary`2[System.Int32,UnityEditor.Recorder.RTInputSelector+InputGroup].get_Item (Int32 key)
Is it reproduceable?

Open the Animation recorder window
Click on the "Add Object To Record" button

Released package version / tag?
Recorder package <IP_ADDRESS>2

fixed in build <IP_ADDRESS>3


Trap ctrl-c signal to allow stopping the watcher and continue to delete

Now, if some hosted cluster installation fails, watcher never ends, because it waits until all clusters are ready.
This makes us to kill the process and manually delete all the stuff.
With this change, watcher process will be terminated and wrapper will continue to the deleting process
All loops are now controlled by this trap, so only installing/destroy processes are allowed to finish after Ctrl-C is pressed:
2023-02-22 16:00:26.700 WARNING rosa-hosted-wrapper - set_force_terminate: Captured Ctrl-C, sending exit event to watcher, any cluster install/delete will continue it execution

2023-02-22 16:04:04.357 ERROR rosa-hosted-wrapper - _download_cluster_admin_kubeconfig: Exiting cluster access process for mrnd-x96-0003 cluster after capturing Ctrl-C

Merged this change into the MultiAZ PR


Trying to deploy on PRs for review

@davidascher What is this PR? I'm not clear what the issue it addresses is.


Fix 'npm run prestart'

'npm run prestart' is broken, since it uses 'sh' but the pre-start script requires bash. I also added 'execute' permission to the bash script.
This fixes the following error:
`npm run start

<EMAIL_ADDRESS>prestart /home/james/code/lesswrong2
sh prestart_lesswrong.sh

Vulcan requires Meteor but it's not installed. Trying to Install...
prestart_lesswrong.sh: 18: [: Linux: unexpected operator
prestart_lesswrong.sh: 22: [: Linux: unexpected operator
prestart_lesswrong.sh: 26: [: Linux: unexpected operator
`

Yep, this seems reasonable. Looks like Mac does some magic here to have it work anyways on my machine, but your change doesn't seem to break it.


[Issue]: Refactor ConversableAgent

Describe the issue
ConversableAgent is overly bloated. It is not easy to add new feature without introducing bugs.
Steps to reproduce
Make the class more modular.
Break it into multiple classes.
This need more investigation and detailed planning.
We can set the investigation as the first milestone.
Screenshots and logs
No response
Additional Information
No response

Thank you @AgentGenie! This is a great point!


User stats page | Codeforces

When user enters any username under Codeforces in the "User Stats" page, it should display a block below that display all relevant details and statistics about that user, using charts or graphs wherever relevant. Use codeforces API for this.

Hey Sahan, Can you assign this issue to me, I can get this done for you.

Assigned

I have made a PR for the same, please review it when possible.

Merged

Just wanted to ask, can you add background colors to the rating curve like Codeforces does? You can make a seperate PR for that and I will merge it along with the hacktoberfest labels.

Made a PR with background colors to the rating curve as suggested by you. Please review when possible and add the hacktoberfest labels if possible.


Update useFormatted.ts

In some cases, a formatted value may be given to the address parameter, so these changes, convert the formatted value to substrate address and again check for availability in the extension.

@AMIRKHANEF we have a formatted as props, right ?
we can use get substrate address.


Fix of configuring example.

Need to do so, for database tablenames prefixes support. Because you've shown example of migrations with prefix support above.

Good catch! Thanks!


GPT-2 torch to tosa

The python script to run:
gpt2tosa.py

This linalg patch can test tosa with tinny change https://github.com/nod-ai/SHARK/pull/341. But now get the bug
    raise TorchMlirCompilerError(trimmed_message) from None
torch_mlir.compiler_utils.TorchMlirCompilerError: Lowering Torch Backend IR -> TOSA Backend IR failed with the following diagnostics:
error: failed to legalize operation 'torch.constant.int'
note: see current operation: %0 = "torch.constant.int"() {value = 5 : i64} : () -> !torch.int

Error can be reproduced with:
$ torch-mlir-opt -pass-pipeline='torch-backend-to-tosa-backend-pipeline' /tmp/_lambda.mlir
Add '-mlir-print-ir-after-all -mlir-disable-threading' to get the IR dump for debugging purpose.

This error is probably due to a missing op or unhandled variables in an op. Check all the ops where %0 is used to triage the error further

Byte bug patch https://github.com/llvm/torch-mlir/pull/1384 and View Bug Patch https://github.com/llvm/torch-mlir/pull/1384 , after apply this two patch , we got broadcast_to bug.
Traceback (most recent call last):
  File "/home/chi/src/ubuntu20/shark/SHARK/tank/gpt2_torch/gpt2.py", line 89, in <module>
    module = torch_mlir.compile(
  File "/home/chi/src/ubuntu20/shark/torch-mlir/build/tools/torch-mlir/python_packages/torch_mlir/torch_mlir/__init__.py", line 262, in compile
    run_pipeline_with_repro_report(
  File "/home/chi/src/ubuntu20/shark/torch-mlir/build/tools/torch-mlir/python_packages/torch_mlir/torch_mlir/compiler_utils.py", line 73, in run_pipeline_with_repro_report
    raise TorchMlirCompilerError(trimmed_message) from None
torch_mlir.compiler_utils.TorchMlirCompilerError: Lowering Torch Backend IR -> TOSA Backend IR failed with the following diagnostics:
error: failed to legalize operation 'torch.aten.broadcast_to' that was explicitly marked illegal
note: see current operation: %469 = "torch.aten.broadcast_to"(%467, %468) : (!torch.vtensor<[],i1>, !torch.list<int>) -> !torch.vtensor<[1,1,5,5],i1>

Error can be reproduced with:
$ torch-mlir-opt -pass-pipeline='torch-backend-to-tosa-backend-pipeline' /tmp/_lambda.mlir
Add '-mlir-print-ir-after-all -mlir-disable-threading' to get the IR dump for debugging purpose.

Byte bug patch llvm/torch-mlir#1384 and View Bug Patch llvm/torch-mlir#1384 , after apply this two patch , we got broadcast_to bug.

Actually, bert to tosa is also failing on this op. I think due to some upstream changes this is happening. I would try to support more cases for this ops lowering.

Byte bug patch llvm/torch-mlir#1384 and View Bug Patch llvm/torch-mlir#1384 , after apply this two patch , we got broadcast_to bug.
Traceback (most recent call last):
  File "/home/chi/src/ubuntu20/shark/SHARK/tank/gpt2_torch/gpt2.py", line 89, in <module>
    module = torch_mlir.compile(
  File "/home/chi/src/ubuntu20/shark/torch-mlir/build/tools/torch-mlir/python_packages/torch_mlir/torch_mlir/__init__.py", line 262, in compile
    run_pipeline_with_repro_report(
  File "/home/chi/src/ubuntu20/shark/torch-mlir/build/tools/torch-mlir/python_packages/torch_mlir/torch_mlir/compiler_utils.py", line 73, in run_pipeline_with_repro_report
    raise TorchMlirCompilerError(trimmed_message) from None
torch_mlir.compiler_utils.TorchMlirCompilerError: Lowering Torch Backend IR -> TOSA Backend IR failed with the following diagnostics:
error: failed to legalize operation 'torch.aten.broadcast_to' that was explicitly marked illegal
note: see current operation: %469 = "torch.aten.broadcast_to"(%467, %468) : (!torch.vtensor<[],i1>, !torch.list<int>) -> !torch.vtensor<[1,1,5,5],i1>

Error can be reproduced with:
$ torch-mlir-opt -pass-pipeline='torch-backend-to-tosa-backend-pipeline' /tmp/_lambda.mlir
Add '-mlir-print-ir-after-all -mlir-disable-threading' to get the IR dump for debugging purpose.

This error is fixed with the following patch: https://github.com/llvm/torch-mlir/pull/1429. But there are many other ops whose TorchToTosa lowering needs to be added, like:
torch.aten.arange.start_step, torch.prim.NumToTensor.Scalar, torch.aten.to.dtype, torch.valsem.aten.copy, torch.aten.where.self

Byte bug patch llvm/torch-mlir#1384 and View Bug Patch llvm/torch-mlir#1384 , after apply this two patch , we got broadcast_to bug.
Traceback (most recent call last):
  File "/home/chi/src/ubuntu20/shark/SHARK/tank/gpt2_torch/gpt2.py", line 89, in <module>
    module = torch_mlir.compile(
  File "/home/chi/src/ubuntu20/shark/torch-mlir/build/tools/torch-mlir/python_packages/torch_mlir/torch_mlir/__init__.py", line 262, in compile
    run_pipeline_with_repro_report(
  File "/home/chi/src/ubuntu20/shark/torch-mlir/build/tools/torch-mlir/python_packages/torch_mlir/torch_mlir/compiler_utils.py", line 73, in run_pipeline_with_repro_report
    raise TorchMlirCompilerError(trimmed_message) from None
torch_mlir.compiler_utils.TorchMlirCompilerError: Lowering Torch Backend IR -> TOSA Backend IR failed with the following diagnostics:
error: failed to legalize operation 'torch.aten.broadcast_to' that was explicitly marked illegal
note: see current operation: %469 = "torch.aten.broadcast_to"(%467, %468) : (!torch.vtensor<[],i1>, !torch.list<int>) -> !torch.vtensor<[1,1,5,5],i1>

Error can be reproduced with:
$ torch-mlir-opt -pass-pipeline='torch-backend-to-tosa-backend-pipeline' /tmp/_lambda.mlir
Add '-mlir-print-ir-after-all -mlir-disable-threading' to get the IR dump for debugging purpose.

This error is fixed with the following patch: llvm/torch-mlir#1429. But there are many other ops whose TorchToTosa lowering needs to be added, like:
torch.aten.arange.start_step, torch.prim.NumToTensor.Scalar, torch.aten.to.dtype, torch.valsem.aten.copy, torch.aten.where.self

https://github.com/AmosLewis/torch-mlir/tree/gpt-tosa. I tried to repeat the error with upstream/main + 1429 + 1384. But I got the old 'torch.constant.int' issue. Are you 5 ops got from this issue?

Some usefully tosa support link https://discourse.llvm.org/t/basic-tosa-support/4432/7

Byte bug patch llvm/torch-mlir#1384 and View Bug Patch llvm/torch-mlir#1384 , after apply this two patch , we got broadcast_to bug.
Traceback (most recent call last):
  File "/home/chi/src/ubuntu20/shark/SHARK/tank/gpt2_torch/gpt2.py", line 89, in <module>
    module = torch_mlir.compile(
  File "/home/chi/src/ubuntu20/shark/torch-mlir/build/tools/torch-mlir/python_packages/torch_mlir/torch_mlir/__init__.py", line 262, in compile
    run_pipeline_with_repro_report(
  File "/home/chi/src/ubuntu20/shark/torch-mlir/build/tools/torch-mlir/python_packages/torch_mlir/torch_mlir/compiler_utils.py", line 73, in run_pipeline_with_repro_report
    raise TorchMlirCompilerError(trimmed_message) from None
torch_mlir.compiler_utils.TorchMlirCompilerError: Lowering Torch Backend IR -> TOSA Backend IR failed with the following diagnostics:
error: failed to legalize operation 'torch.aten.broadcast_to' that was explicitly marked illegal
note: see current operation: %469 = "torch.aten.broadcast_to"(%467, %468) : (!torch.vtensor<[],i1>, !torch.list<int>) -> !torch.vtensor<[1,1,5,5],i1>

Error can be reproduced with:
$ torch-mlir-opt -pass-pipeline='torch-backend-to-tosa-backend-pipeline' /tmp/_lambda.mlir
Add '-mlir-print-ir-after-all -mlir-disable-threading' to get the IR dump for debugging purpose.

This error is fixed with the following patch: llvm/torch-mlir#1429. But there are many other ops whose TorchToTosa lowering needs to be added, like:
torch.aten.arange.start_step, torch.prim.NumToTensor.Scalar, torch.aten.to.dtype, torch.valsem.aten.copy, torch.aten.where.self

torch.aten.arange.start_step MERGED
torch.prim.NumToTensor.Scalar + torch.aten.to.dtype + torch.valsem.aten.copy WIP
torch.aten.where.self READY FOR REVIEW

General update conclusion for right now.
aten.view MERGED
aten.sum.dim_IntList test MERGED
aten.broadcast_to MERGED
aten.clone MERGED
torch.uint8 type support MERGED
torch.aten.arange.start_step MERGED
torch.aten.where.self READY FOR REVIEW
torch.prim.NumToTensor.Scalar + torch.valsem.aten.copy + torch.aten.to.dtype  3 op in one patch, first 2 ready, last one WIP

Traceback (most recent call last):
  File "/home/chi/src/ubuntu20/shark/SHARK/tank/pytorch/gpt2/gpt2tosa.py", line 91, in <module>
    module = torch_mlir.compile(
  File "/home/chi/src/ubuntu20/shark/torch-mlir/build/tools/torch-mlir/python_packages/torch_mlir/torch_mlir/__init__.py", line 371, in compile
    run_pipeline_with_repro_report(
  File "/home/chi/src/ubuntu20/shark/torch-mlir/build/tools/torch-mlir/python_packages/torch_mlir/torch_mlir/compiler_utils.py", line 73, in run_pipeline_with_repro_report
    raise TorchMlirCompilerError(trimmed_message) from None
torch_mlir.compiler_utils.TorchMlirCompilerError: Lowering TorchScript IR -> Torch Backend IR failed with the following diagnostics:
error: unsupported by backend contract: tensor with unknown dtype
note: see current operation: %923 = "torch.aten.tanh"(%922) : (!torch.vtensor<[1,5,3072],f32>) -> !torch.vtensor<[1,5,3072],unk>
note: this is likely due to a missing case in RefineTypes

For Torch-MLIR developers, the error can be reproduced with:
$ torch-mlir-opt -pass-pipeline='builtin.module(torchscript-module-to-torch-backend-pipeline{backend-legal-ops=torch.aten.flatten.using_ints,torch.aten.native_layer_norm,torch.aten.linear})' /tmp/_lambda.mlir
Add '-mlir-print-ir-after-all -mlir-disable-threading' to get the IR dump for debugging purpose.

Legalizing operation : 'torch.aten.view'(0x845add0) {
  %216 = "torch.aten.view"(%arg1, %215) : (!torch.tensor, !torch.list<int>) -> !torch.tensor

  * Fold {
  } -> FAILURE : unable to fold

  * Pattern : 'torch.aten.view -> ()' {
Trying to match "(anonymous namespace)::ConvertAtenOp<mlir::torch::Torch::AtenViewOp>"
    ** Failure : Only tensor types are currently supported
"(anonymous namespace)::ConvertAtenOp<mlir::torch::Torch::AtenViewOp>" result 0
  } -> FAILURE : pattern failed to match
} -> FAILURE : no matched legalization pattern
//===-------------------------------------------===//
<eval_with_key>.2:5:11: error: failed to legalize operation 'torch.aten.view' that was explicitly marked illegal
<eval_with_key>.2:5:11: note: see current operation: %27 = "torch.aten.view"(%arg1, %26) : (!torch.tensor, !torch.list<int>) -> !torch.tensor

%arg1: !torch.tensor {torch.type_bound = !torch.vtensor<[1,5],si64>}
%int-1 = torch.constant.int -1
%int5 = torch.constant.int 5
%0 = torch.prim.ListConstruct %int-1, %int5 : (!torch.int, !torch.int) -> !torch.list<int>
%1 = torch.aten.view %arg1, %0 : !torch.tensor, !torch.list<int> -> !torch.tensor

The new tosa file with refine types bug fix: https://gist.github.com/AmosLewis/fd8b242db2b5f328fa56e9afa270cbd6


Downloading by tags stopped with unknow reason

I'm trying to download images with tag "ウマ娘 or 赛马娘 or 賽馬娘" but it always stop at page 36.
I did search the string on Pixiv and the result is over 1000 pages.
Then I tried start  download from page 37 but it stopped immediately.
I tried another tag and it stopped at page 223 and it should have over 1000 pages too.
Last message in log :
2022-02-24 13:32:57,217 - PixivUtil20211104 - INFO - Last page: 223
program version : v20211104

It will download R18 only if r18mode = True is set in config.ini

https://github.com/Nandaka/PixivUtil2/blob/2a149364ac60838e549f91cf5c0d63aa474f814f/PixivHelper.py#L890
https://github.com/Nandaka/PixivUtil2/blob/2a149364ac60838e549f91cf5c0d63aa474f814f/PixivTagsHandler.py#L72
from pixiv website:
https://www.pixiv.net/ajax/search/artworks/%E3%82%A6%E3%83%9E%E5%A8%98%20or%20%E8%B5%9B%E9%A9%AC%E5%A8%98%20or%20%E8%B3%BD%E9%A6%AC%E5%A8%98?word=%E3%82%A6%E3%83%9E%E5%A8%98%20or%20%E8%B5%9B%E9%A9%AC%E5%A8%98%20or%20%E8%B3%BD%E9%A6%AC%E5%A8%98&order=date_d&mode=all&p=1&s_mode=s_tag&type=all&lang=en

&order=date_d
*&mode=all*
&p=1
&s_mode=s_tag
&type=all
&lang=en

from the script
https://www.pixiv.net/ajax/search/artworks/%E3%82%A6%E3%83%9E%E5%A8%98%20or%20%E8%B5%9B%E9%A9%AC%E5%A8%98%20or%20%E8%B3%BD%E9%A6%AC%E5%A8%98?word=%E3%82%A6%E3%83%9E%E5%A8%98%20or%20%E8%B5%9B%E9%A9%AC%E5%A8%98%20or%20%E8%B3%BD%E9%A6%AC%E5%A8%98&s_mode=s_tag&type=all&mode=r18&order=date_d

&order=date_d
*&mode=r18*
&s_mode=s_tag
&type=all

https://www.pixiv.net/ajax/search/artworks/ウマ娘 or 赛马娘 or 賽馬娘?word=ウマ娘 or 赛马娘 or 賽馬娘&order=date_d&mode=all&p=1&s_mode=s_tag&type=all&lang=en
&order=date_d
&mode=all
&p=1
&s_mode=s_tag
&type=all
&lang=en

But my "r18mode" setting in config.ini is "False"

I tried to update cookie PHPSESSID, now one of them is downloading, but another only run one page then stopped.

upload the pixivutil.log?

also do you run with partial tag match = y?

Here's the log.
Line 1~10 is the one stopped at page 1.
Line 11+ is I chage PHPSESSID back to old one.
I download with "s_tag = y" and "search type = a (all)"
pixivutil.log

uploaded new releases https://github.com/Nandaka/PixivUtil2/releases/tag/v20220224-beta1
can you try to use that version? if it still have issue, please upload the log file here again.

Still stopped
pixivutil.log

Looks like pixiv server will return empty result if it detect too many download from the script at random page.

I think need to add back off timer to wait for few minutes until the server can return more posts.

rerun the same query and this time stopped at page 198

adding delay and retry for 180s still doesnt help...

setting some downloadDelay in config.ini might help. Looks like pixiv does return empty result if it detect too many request to its api.

Setting downloadDelay from 2 to 10 works fine for now, don't know will it stopped again.

Setting downloadDelay works for those not downloaded ,
but still stopped when most images are already downloaded.

if that the case, then you need wait a while and manually start from the stopped page. I can't do anything, as the server itself doesn't return the result back.


Covert checks and uses of envvars to use the centralized mechanism

Definitely not where we want to do these, haha. I'm basically just waiting on the stuff you have on your branch to make it in and we can do a pass through all of these and make them use the new way of orchestrating them.
Originally posted by @jdharvey-ibm in https://github.com/carbon-design-system/carbon-platform/pull/191#discussion_r790020264

These conversions have been completed and are merged into the main branch.


Use native approach to load web workers

Currently to use Monaco with module bundlers such as Webpack 5, Parcel, Snowpack, or natively in ESM in a browser, one needs to use the following:
window.MonacoEnvironment = {
  getWorker(moduleId, label) {
    switch (label) {
      case 'css':
      case 'less':
      case 'scss':
        return new Worker(new URL('monaco-editor/esm/vs/language/css/css.worker', import.meta.url));
      case 'editorWorkerService':
        return new Worker(new URL('monaco-editor/esm/vs/editor/editor.worker', import.meta.url));
      case 'handlebars':
      case 'html':
      case 'razor':
        return new Worker(new URL('monaco-editor/esm/vs/language/html/html.worker', import.meta.url));
      case 'json':
        return new Worker(new URL('monaco-editor/esm/vs/language/json/json.worker', import.meta.url));
      case 'javascript':
      case 'typescript':
        return new Worker(new URL('monaco-editor/esm/vs/language/typescript/ts.worker', import.meta.url));
      case 'yaml':
        return new Worker(new URL('monaco-yaml/lib/esm/yaml.worker', import.meta.url));
      default:
        throw new Error(`Unknown label ${label}`);
    }
  },
};

All official documentation and examples on this subject are outdated.
It appears the issue of having to resolve a worker is going away. Instead of putting this burden on the user if this library, it may be better to move this to the plugins instead. I.e., a plugin could call something like:
import { registerWorker } from 'monaco-editor';

registerWorker('json', new Worker(new URL('./json.worker', import.meta.url)));

This way users don’t have to deal with workers explicitly anymore.

Is there a specific demo? Tried but not working.

I think that web workers should use new Worker(url, { type: module })  variant

I think that web workers should use new Worker(url, { type: module }) variant

Firefox doesn't support yet modules in web workers.

Undici (aka fetch) now wants to create blobs backed up by filesystems as well when parsing multipart FormData.
New discussion is taking place here to bring life into some kind of fs.getFileBlob('some-file-path.txt') so just more reason to wanting to have this in the feature


add denkensk as member

6 PR merged in kubeflow/arena

/cc @zw0610
/cc @cheyang

/lgtm
/approve

/lgtm
Let's expand your effort and contribution from arena to other kubeflow projects.

/assign @james-jwu
/ok-to-test

/assign @bobgy

Thank you for your contributions!
/lgtm
/approve


can we have new release with no-choice?

You have a cool feature in master ui-select-no-choice, can we have a new release with this feature?

+1

Also ui-select-no-choice is working only with bootstrap theme. Can we include the same for selectize and select2 themes?

@khanhto
Could you please advise if this feature can be expanded to selectize and select2 themes?

This should have been released as part of v0.17.0 but I believe the npm version was still outdated.
This should be released as of v0.17.1

Worked for anyone? here is still not showing anything.

Working for me. Try to download new release v0.17.1

I have already downloaded this version, the directive "uiSelectNoChoice" is in file "dist/select.js", but when the search returns no results, it does not appear.
<ui-select ng-model="elementExtensions.ator" theme="bootstrap" fix-focus-ui-select>     <ui-select-match allow-clear="true" placeholder="{{::'TYPE_FOR_SEARCH' | translate}}">       {{$select.selected.name}}     </ui-select-match>     <ui-select-choices refresh="loadAsyncActors($select.search)" refresh-delay="300"                        repeat="actor in actorPropertyViewControl.availableActors">

     </ui-select-choices>     <ui-select-no-choice>       Dang! We couldn't find any choices...     </ui-select-no-choice>   </ui-select>

Doesn't work with ui-select add no-choice, plunker link.

@Grade, can you post your code?

I tried. But it doesn't work in plunker as well. But it works when I just run it in browser (Chrome, Firefox)

Plunker example also doens't run here :/

@santosguilherme I have been busy these days and this pull request was created very long ago (nearly a year). At that time, it was working properly. I'm not sure if it's still working today. I'll check it when I have time.

@siva-I sorry for the late reply, this feature should be fairly easy to be extended to selectize and select2 themes, but I'm not sure when I'll get back to this.


OCPEDGE-1000: feat: implement thick provisioning

Codecov Report
Attention: Patch coverage is 51.72414% with 14 lines in your changes are missing coverage. Please review.

Project coverage is 77.57%. Comparing base (fd45f00) to head (4e95260).

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #596      +/-   ##
==========================================
- Coverage   77.92%   77.57%   -0.36%
==========================================
  Files          27       27
  Lines        1948     1953       +5
==========================================
- Hits         1518     1515       -3
- Misses        316      320       +4
- Partials      114      118       +4

Files
Coverage Δ

api/v1alpha1/lvmcluster_types.go
100.00% <ø> (ø)

api/v1alpha1/lvmvolumegroup_types.go
100.00% <ø> (ø)

internal/controllers/vgmanager/controller.go
72.93% <51.72%> (-0.68%)
:arrow_down:

... and 1 file with indirect coverage changes

/lgtm

/override ci/prow/snyk-deps


introduce groundwork for FP16 (half precision IEEE 754 FLOAT)  support in both AVX512 and f16c versions

This PR provides for the basic infrastructure needed for detecting the presence of hardware for supporting any and all available FP16 capabilities available on x86_64 hardware.
FP16 differs from BF16 in how bits are allocated to range and precision. Where BF16 is basically a truncated FP32, FP16 attempts to keep roughly the same ratio of precision to range as other IEEE 754 Floating point types.
x86_64 has 2 different ways of supporting FP16.
The first is a legacy support model using f16c, or Float 16 convert. This small ISA extension introduced with the Ivybridge generation allows for conversion of FP32 types to fp16 types in general purpose registers and/or SIMD vector registers (works on XMM, YMM and ZMM registers if present.)
It was introduced on AMD in the bulldozer generation after being announced under the name CVT16 (Convert 16) before being renamed to f16c a few years later.
The second is AVX512 FP16.
Introduced unofficially with Alderlake Pcores in their Golden cove architecture, avx512FP16 differs from f16c in that it does no simply use the lower half of FP32 registers. This means that twice as many values can be stored in an equivalent register (32 in ZMM using AVX512FP16 as opposed to 16 values using AVX512f+f16c) increasing effective memory through put as well as removing the need for conversion overhead.
AVX512FP16 will officially debut in market with the launch of Sapphire Rapids.
certain types of applications have no need for the precision of FP32, but need slightly more precision than what is offered by BF16. FP16 reaches a good compromise.
Being as GPU's, ARM and other accelerators, ISA's and uArchs have had IEEE 754 FP16 for a few years, it's high time support be added.
-FelixCLC

should probably mention that this in part addresses #3512 #3490

additional changes for cleanup, added self to contributors etc.

thanks - but are these SapphireRapids kernels for bfloat16 or fp16 ? I suspect naming confusion, in #2767 it was agreed to use "b" prefixes for bfloat16 and "h" for an eventual fp16 (which does not appear to have been missed in all these years, and for which the entire groundwork of function table entries, headers, generic implementation would need to be added like it was for bfloat)
Also I do not think we need a subdirectory for SR kernels in x86_64 (?)

thanks - but are these SapphireRapids kernels for bfloat16 or fp16 ? I suspect naming confusion, in #2767 it was agreed to use "b" prefixes for bfloat16 and "h" for an eventual fp16 (which does not appear to have been missed in all these years, and for which the entire groundwork of function table entries, headers, generic implementation would need to be added like it was for bfloat)
Also I do not think we need a subdirectory for SR kernels in x86_64 (?)

Apologies, this can be ignored and removed entirely, it's from when I was doing some testing and messing about with other code.
I've got a few more changes about to come in, I'll remove the files while I'm at it.


feat: Add TypeScript support to compiler

Adds the ability to generate TypeScript declarations for PBF-encoded messages.
A new --typescript flag has been added to the CLI and as an option to the compileRaw function. When enabled, this will produce a TypeScript .d.ts file containing interfaces for each of the messages defined in the input protobuf schema.

Hey @jlucaso1, thank you very much for working on this! Just letting you know that we're appreciate the PR and will review it closely. It may take some time as there was an alterative push on this in https://github.com/mapbox/pbf/pull/137, but don't let silence / delay discourage you.


[BEAM-8756] Google cloud client libraries to use 2019 versions

Fixes https://issues.apache.org/jira/projects/BEAM/issues/BEAM-8756

google_clients_version from 1.28.0 to 1.30.3
libraries related to google-api-client; proto-google- and google-api-services- libraries
google-cloud-core from 1.61.0 to 1.92.2
proto-google-cloud-datacatalog-v1beta1 from 0.27.0-alpha to 0.29.0-alpha. This is not latest, which would require code change (I will raise another PR for this)

Linkage Check Result
The following modules use the affected libraries
beam-sdks-java-extensions-google-cloud-platform-core

before: https://gist.github.com/suztomo/c31254c5cc4a4f6942a7ea6784f823f3
after: https://gist.github.com/suztomo/8bc7b55b796c492191a3a80463828da1 (same as above)

beam-sdks-java-io-google-cloud-platform

before: https://gist.github.com/suztomo/ce0b4b9c8e347ec8f27e7f2a03129f41
after: https://gist.github.com/suztomo/159579ecd899796ecf1a268ab608a4df (same as above)

beam-runners-google-cloud-dataflow-java

before: https://gist.github.com/suztomo/8cce31ad29289fa7f4ac92862a430f37
after: https://gist.github.com/suztomo/28059da42ceceb3224b81df42beb8a03 (same as above)

beam-sdks-java-io-hadoop-format

before: https://gist.github.com/suztomo/119063490c5e6e517c31a64b619a52c4
after: https://gist.github.com/suztomo/de96101b13488cb7d4150a836a3108bc (same as above)

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[x] Choose reviewer(s) and mention them in a comment (R: @username).
[x] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[x] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

This broke nightly snapshots: https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/874/console
https://issues.apache.org/jira/browse/BEAM-9246
Any idea what needs to be done?

cc self @ibzib

Created PR to fix that.
https://github.com/apache/beam/pull/10756

Thanks for the fix, sorry for the miss during review.


[R] package development builds broken for Windows and MacOS

Describe the bug, including details regarding any error messages, version, and platform.
If we try to build the R package on Windows or MacOS from a checkout, it fails at a point where it is supposed to download a suitable nightly build of libarrow:
remotes::install_github('apache/arrow/r')
# -- R CMD build -------------------------------------------
# -  preparing 'arrow': (392ms)
# -  checking DESCRIPTION meta-information
# -  cleaning src
# -  checking for LF line-endings in source and make files and shell scripts
# -  checking for empty or unneeded directories
# -  building 'arrow_<IP_ADDRESS>00.tar.gz'
# Installing package into ‘C:/Users/Jeroen/AppData/Local/R/win-library/4.3’
# (as ‘lib’ is unspecified)
# * installing *source* package 'arrow' ...
# ** using staged installation
# Warning message:
# In unzip("lib.zip", exdir = "windows") :
#   error 1 in extracting from zip file
...
# using C++17
# g++  -std=gnu++17 -I"C:/PROGRA~1/R/R-43~1.0/include" -DNDEBUG -I../windows//include -DARROW_STATIC -DPARQUET_STATIC -DARROW_DS_STATIC               -DARROW_ACERO_STATIC -DARROW_R_WITH_PARQUET -DARROW_R_WITH_ACERO               -DARROW_R_WITH_DATASET -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -DARROW_R_WITH_GCS -I'C:/Users/Jeroen/AppData/Local/R/win-library/4.3/cpp11/include'   -I"C:/rtools43/x86_64-w64-mingw32.static.posix/include"     -O2 -Wall  -mfpmath=sse -msse2 -mstackrealign  -c RTasks.cpp -o RTasks.o
# In file included from RTasks.cpp:18:
# ./r_task_group.h:20:10: fatal error: arrow/util/parallel.h: No such file or directory
#    20 | #include <arrow/util/parallel.h>
#       |          ^~~~~~~~~~~~~~~~~~~~~~~
# compilation terminated.

Same on MacOS.
I'm not sure if it is related, but the builds on https://nightlies.apache.org/arrow/r/libarrow/bin/ have not been updated for 6 weeks. But even before that it was not working, I think the R package script does not not find the correct URLs.
Component(s)
R

(Setting aside Windows), R CMD build && R CMD INSTALL won't work without some additional build prep to put a copy the C++ source inside the R package directory. R CMD INSTALL (aka remotes::install_github('apache/arrow/r', build = FALSE)) does work out of the box because the build script can look for the C++ source in the monorepo parent directory at ../cpp/src. This is all using our bundled build script, not autobrew on mac.
Our nightly packaging job has this pre-build step to copy in the C++ source, along with putting a copy of the homebrew/autobrew formula inside the package and pinning the C++ library version in the formula to the same git SHA as the R package, so that they are in sync: https://github.com/ursacomputing/crossbow/blob/nightly-packaging-2023-05-08-0-github-r-binary-packages/.github/workflows/crossbow.yml#L47-L86 After doing this, R CMD build && R CMD INSTALL will work.
Windows is different and we don't currently have a path that will call the mingw makepkg command to build the C++ libraries at R package installation time. Presumably it could be done, but I don't think there's much interest in it.
As @paleolimbot says, we could (just) download the latest nightly binary packages instead of building from source, and that will almost always work. That's probably the way to go on Windows; on mac/linux, there's probably an env var we'll want to expose to control that behavior--perhaps it's the fallback you get instead of *** Proceeding without libarrow (no local source), and you can opt-in to it even if you have the source available?
As for our nightly binary packaging workflow, I'm not sure what's going on. The job that builds them continues to report success (latest: https://github.com/ursacomputing/crossbow/actions/runs/4906238724/jobs/8760994170). I don't see where they are uploaded to the nightlies repository though, and I have a faint recollection that that's a separate process. @assignUser do you know what's up, and why we aren't seeing that the packages aren't being successfully uploaded?

tools/winlibs.R  tries to download a libarrow zip matching the version (<IP_ADDRESS>0 here) but the nightlies are numbered consecutively (which is a recent'ish change from being date based) so we would need to beef up the script in that regard.
I will have a look at the upload @nealrichardson

#35478 fixes the nightly issue, not sure why I failed to update that workflow when we updated the rest after the switch...

@paleolimbot very cool. That should help with the remotes::install_github() path. I think we still have a gap if someone is doing the R CMD stuff at the CLI (which we do in our CI scripts), but still that will allow us to consolidate that bootstrapping logic in one place, which is an improvement for sure.

@paleolimbot while on-the-fly vendoring can be useful for some, it deviates the CI even further from the build process used for (CRAN) releases, which relies on 3rd parties providing libarrow builds for win/mac that the R package can download.
I think the priority should be to make the arrow CI self sustaining and focus on getting such libarrow nightlies and releases built for the win/mac targets that you want to support.

@paleolimbot while on-the-fly vendoring can be useful for some, it deviates the CI even further from the build process used for (CRAN) releases, which relies on 3rd parties (me) providing libarrow builds for win/mac that the R package can download.

We vendor the C++ source before submitting to CRAN, so the .tar.gz source package one installs there has it included. What @paleolimbot was mentioning would make that pre-build step we do become a part of the remotes/devtools workflow, so it would be more like the CRAN scenario.

I think the priority should be to make the arrow CI self sustaining and focus on getting such libarrow nightlies and releases built and published for the platforms that you want to support.

For windows, we already build and host the static libraries for releases (e.g. https://apache.jfrog.io/ui/native/arrow/r/12.0.0/libarrow/bin/windows/), so we may be able to just drop the rwinlib path if that's helpful. Mac is more involved with the autobrew/bottle setup, but I'm sure we could find ways to make that more self-sustaining.

We vendor the C++ source before submitting to CRAN, so the .tar.gz source package one installs there has it included. What @paleolimbot was mentioning would make that pre-build step we do become a part of the remotes/devtools workflow, so it would be more like the CRAN scenario.

OK that makes sense. How is the vendored libarrow code currently copied into the CRAN source package? Is this scripted somewhere I can reproduce it?

It's currently make sync-cpp, though putting that in bootstrap.R like Dewey proposed would help so that you don't have to maintain ad-hoc if arrow logic.
For the nightly/on-demand autobrew build, we don't use that vendored source (though presumably there would be a way?). Instead we use a copy of the formula(e) where we pin to a git SHA, so that when we brew install --HEAD it builds the right C++ code. That looks like https://github.com/ursacomputing/crossbow/blob/nightly-packaging-2023-05-08-0-github-r-binary-packages/.github/workflows/crossbow.yml#L47-L86 (the workflow is templated).

It's currently make sync-cpp, though putting that in bootstrap.R like Dewey proposed would help so that you don't have to maintain ad-hoc if arrow logic. For the nightly/on-demand autobrew build, we don't use that vendored source (though presumably there would be a way?).

OK thanks, this fixes the Linux build. If I try to build a copy of arrow with vendored source on Windows, it fails with:
   ===== ./arrow.Rcheck/00install.out =====
  * installing *source* package 'arrow' ...
  ** using staged installation
  trying URL 'https://nightlies.apache.org/arrow/r/libarrow/bin/windows/arrow-<IP_ADDRESS>00.zip'
  Error in download.file(sprintf(template, version), "lib.zip", quiet = quietly) :
    cannot open URL 'https://nightlies.apache.org/arrow/r/libarrow/bin/windows/arrow-<IP_ADDRESS>00.zip'

I see the nightlies on https://nightlies.apache.org/arrow/r/libarrow/bin/windows/ have a different version scheme for example todays build is arrow-<IP_ADDRESS>000043.zip.


unix: implement sysv shared memory support for Darwin

Provides simple helpers for shmget/shmat/shctl/shmdt . Seems to work. Open to suggestions for the API -- I realize that this  package isn't really quite the right place for higher level wrappers, but mmap has similar wrapped functionality. If the API is fine, I intend to also implement/test this for Linux, but I don't have other OS to test/generate content on.

Closing, will open a separate PR for the API listed in the proposal.


Fix the grammar in contribute page, fix issue #1270

Fix the grammar in contribute page

Modify the description so that the verb agrees with the subject and the meaning is well-established.
Modify the <p> tag so that the pronoun is correct.

Fix issue #1270

Close the <input> tag properly.

Thanks for contribution, but unfortunately the fix for forms is already waiting for a release => https://github.com/mdbootstrap/Tailwind-Elements/blob/dev/site/content/docs/standard/forms/radio/index.html
Also, we will be updating the contribution page soon, so the content will probably change.


Wtf is the point of this?

Surely this only accounts for heavy?


[Roadmap] Refactor all grammar help documents

At present, many grammatical help documents of Doris are missing, and some documents have not been updated for a long time, which makes it inconvenient for users to view grammatical help.
I sorted out all the grammars currently supported by Doris and established corresponding documents for all grammars. See #6277
In order to facilitate management, these documents are all created in the new directory sql-reference-v2. The directory structure is as follows:
└── sql-statements
    ├── Account-Management-Statements
    ├── Cluster-Management-Statements
    ├── Database-Administration-Statements
    ├── Data-Definition-Statements
    │ ├── Alter
    │ ├── Backup-and-Restore
    │ ├── Create
    │ └── Drop
    ├── Data-Manipulation-Statements
    │ ├── Load
    │ └── Manipulation
    ├── Show-Statements
    └── Utility-Statements

The content of the grammar help file follows a unified title frame. Take the CREATE-ROLE.md file as an example:
---
{
    "title": "CREATE-ROLE",
    "language": "en"
}
---

<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

  http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->

## CREATE-ROLE

### Description

### Example

### Keywords

    CREATE, ROLE

### Best Practice

Description: used to describe the specific grammar and the description of each part of the grammar.
Example: Part of it is used to list specific examples.
Keywords: Part of it is used to index this document.
Best Practice: The part mainly contains some additional instructions or best practices for the grammar.

For example, you can refer to these 2 docs in #6337 :
sql-statements/Data-Definition-Statements/Create/CREATE-TABLE.md
sql-statements/Show-Statements/SHOW-PROPERTY.md

What should be include in Database-Administration-Statements ?

What should be include in Database-Administration-Statements ?

I referenced mysql manual: https://dev.mysql.com/doc/refman/8.0/en/

#9272


fix cannot convert f

closes #225

Well. That’s a lot of changes for a patch release. :(
I’ll merge now in good faith.


Image mem problem

Memory from this statement is not freed after the function call
pdf = Image(blob=pdf_endpoint.get_data(), resolution=150)
Reason unknown. Also forum suggested that it may be related to Image.sequence.
Solution is to put the the pdf in a with statement so that memory is garbaged in exit
https://stackoverflow.com/questions/44209861/how-to-reduce-wand-memory-usage

True. Now moved them out.


fix: remove verbose flag and change args order

Remove the verbose option, already hard-coded in the args.
Re-order the args

Codecov Report

Merging #328 (1ac9154) into list-gh-action-mktplace (5baf851) will not change coverage.
The diff coverage is n/a.

@@                   Coverage Diff                    @@
##           list-gh-action-mktplace     #328   +/-   ##
========================================================
  Coverage                    94.31%   94.31%
========================================================
  Files                           75       75
  Lines                         3023     3023
========================================================
  Hits                          2851     2851
  Misses                         172      172

Flag
Coverage Δ

unittests
94.31% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Fractal cursor support

I saw that Fractal cursor support was added somewhere in 2014, but it seems to be missing now. How should I go about this?

Does anyone know this? im running into this issue as well

The following works. Though it would be nice to have a function for this on the response factory.
        $cursor = new Cursor(2, 1, 3, 100);

        $resource = new Fractal\Resource\Collection(collect($feed), new FeedEntryTransformer());
        $resource->setCursor($cursor);

        $fractal = new Fractal\Manager;
        $fractal->setSerializer(new CamelDataArraySerializer());

        return $this->response->array($fractal->createData($resource)->toArray());

Aye, would most likely need to do it manually, I do remember adding in cursor support but that was a long time ago before a fairly significant rewrite.

+1, definitely love to see this..

Quite old, but the answer above helped me get it working. This seems to work for me, just create a Cursor and add it in the collection after callback...
use League\Fractal\Pagination\Cursor;

...

$cursor = new Cursor(
  $currentCursor,
  $previousCursor,
  $newCursor,
  $results->count()
);

return $this->response->collection(
  $results,
  new ResultItemTransformer,
  function($resource) use ($cursor) {
    $resource->setCursor($cursor);
  }
);


Logic consolidation and cleaner handling of scalar results without units

passes both BONNIE-828 and BONNIE-779

Passes regression


[CONFIG] [Github Actions] CodeQL code analisys tool added.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 100.00%. Comparing base (74e7061) to head (6688825).

Additional details and impacted files
@@            Coverage Diff            @@
##              main       #13   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            3         3
  Lines           15        15
  Branches         4         4
=========================================
  Hits            15        15

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Switch timeline orientation from vertical to horizontal

Todos

[x] Change orientation of the timeline.
[ ] Update colors of the visited nodes and add a checkmark icon.
[ ] Show blue checkmark for the visited.
[ ] Only the visited node lines should be blue.
[ ] The text should not become darker.
[ ] Use the PSAT default font, colors used in FIGMA.
[ ] Vertical lines should connect with the circles and increase distance between circles.
[ ] Update the width of the canvas according to the number of circles.
[ ] Eventually match FIGMA design.

Closed in favour of https://github.com/GoogleChromeLabs/ps-analysis-tool/pull/858


Import CUDAnative in Fields submodule

Fixes #634
cc @arnscheidt

Caught a file using CRLF line endings so I converted it to LF.
@glwagner Don't worry about the test_fields.jl diff, I only added this test:
https://github.com/climate-machine/Oceananigans.jl/pull/635/files#diff-8f5b49779286e5727c493613d03d2d1bR61-R67

To be clear, the bug was a lack of import for CUDAnative (not in the function set! for CuArray)?

Yes. I've changed the PR title accordingly but left the issue title as is.


Add emailSchedules and magazineSchedules to GTM content context

 Question: Can we expose these 3 pieces of date for GA4 like we did for Author?


Release 1.0 unit testing

@SAzouaou, I looked into the changes and they are fine but missing. On the other hand, I noticed your pull request would merge into the EdgeNet's master branch. Therefore, I cannot approve this request. Can you please repeat this pull request by using the release-1.0-unit-testing branch?

I've already changed that. There is no problem anymore.


Loading deep learning model has an error

Executing code loading deep learning model has the following error
from auto_ml.utils_models import load_ml_model trained_ml_pipeline = load_ml_model("auto_ml_saved_pipeline.dill")
trained_ml_pipeline.predict(data)
An error occurred：
Traceback (most recent call last):
File "/root/situ/automl/ctest.py", line 48, in
trained_ml_pipeline = load_ml_model("auto_ml_saved_pipeline.dill")
File "/root/anaconda3/envs/automl/lib/python3.6/site-packages/auto_ml/utils_models.py", line 629, in load_ml_model
pipeline_step.model = insert_deep_learning_model(pipeline_step, file_name)
File "/root/anaconda3/envs/automl/lib/python3.6/site-packages/auto_ml/utils_models.py", line 594, in insert_deep_learning_model
model = keras_load_model(keras_file_name)
TypeError: 'NoneType' object is not callable

I am also having this issue, making it very hard to run different datasets

The problem is that the initialization of keras is done in utils_models.get_model_from_name(). Which, in turn, is called only from a couple places in Predictor ().
The workaround for this bug is to call the method directly before loading the model:
from auto_ml import utils_models
     ...
utils_models.get_model_from_name ('DeepLearningRegressor')
model = utils_models.load_ml_model (file_name)


Blockquote incorrectly displayed when it contains a list

Have you done all of these?

[x] I am using the latest version of the plugin.
[x] I have checked the wiki.
[x] I have checked previous issues(even closed ones).

Describe the bug
Blockquote doesn't show in correct location when it contains a list item.
Neovim version
nvim --version
# Output
NVIM v0.10.0
Build type: Release
LuaJIT 2.1.1716656478
Run "nvim -V1 -v" for more info

Are you using a distro?
No
To Reproduce
Steps to reproduce the bug:

Install markview.nvim.
Open a markdown document.
Type in:

> Workers are created as daemon threads. This is done to allow the interpreter
> to exit when there are still idle threads in a ThreadPoolExecutor's thread
> pool (i.e. shutdown() was not called). However, allowing workers to die with
> the interpreter has two undesirable properties:
>
> - The workers would still be running during interpretor shutdown,
>   meaning that they would fail in unpredictable ways.
> - The workers could be killed while evaluating a work item, which could
>   be bad if the callable being evaluated has external side-effects e.g.
>   writing to a file.
>
> To work around this problem, an exit handler is installed which tells the
> workers to exit when their work queues are empty and then waits until the
> threads finish.

Configuration table
If you have configured the plugin then you must share your config.
require("markview").setup({
    -- Your config table
});

Expected behavior
Blockquote marker before list bullets.

Actual behavior
Incorrect list/quotes.

Additional context
nvim-scrollview nvim-scrollbar, but I toggled it off, and the bug still occurs.

This will probably not be fixed since there's no easy(and consistent) way to get the indentation of the list without using the spaces.

The main issue is that the parent-level blockquotes are not displayed in the leftmost column:

There's no text where the extmark can be placed so it shifts to the position where it can find some text.
In this case, that's after the -.

I don't know much about this, but possible solutions:

Ask upstream (neovim/neovim) to introduce API for extmarks that can occur anywhere on the line.
Use virtual text for the blockquote guides. (See related project: https://github.com/lukas-reineke/indent-blankline.nvim )
Use some combination of virtual text AND extmarks (with blank spaces if the formatting is weird).

I don't know much about this stuff, but possible solutions:

Ask upstream (neovim/neovim) to introduce API for extmarks that can occur anywhere on the line.
Use virtual text for the blockquote guides. (See related project: https://github.com/lukas-reineke/indent-blankline.nvim )
Use some combination of virtual text AND extmarks (with blank spaces if the formatting is weird).

If only it was that easy. It's a lot harder then that as the plugin needs to calculate where a list item starts(tree-sitter is unreliable here, so using it is simply not possible). Finding a proper lua-pattern, adding support for nested lists(lists inside block quotes inside lists inside block quotes) etc. made it a very hard job.
Hopefully, this early version should work most of the time.

[!Warning]
Items inside block elements may be larger then they appear. So, some edge-cases is bound to happen.

E.g. block quotes existing without >.


Would it be possible to share ADNI dataloader files

Excellent work!
I'm wonder whether it would be possible to share ADNI dataloader python files.
A question here, are masks needed to construct a dataset? Based on my interpretation, the dataset just needs to contain image and class label. But the code constructing biobank dataset seems to require masks provided.
If I misunderstood your work, please let me know.

Cher is no longer working on the project so not sure she can help. I have Cc'd Helena in case she can answer any of the questions, but I don't think we have access to any more of the historical code.
Sorry
Emma
Sent from Outlook for Androidhttps://aka.ms/AAb9ysg

From: grant @.>
Sent: Monday, April 3, 2023 1:15:14 PM
To: CherBass/ICAM @.>
Cc: Subscribed @.***>
Subject: [CherBass/ICAM] Would it be possible to share ADNI dataloader files (Issue #7)
Excellent work!
I'm wonder whether it would be possible to share ADNI dataloader python files.
A question here, are masks needed to construct a dataset? Based on my interpretation, the dataset just needs to contain image and class label. But the code constructing biobank dataset seems to require masks provided.
If I misunderstood your work, please let me know.
—
Reply to this email directly, view it on GitHubhttps://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FCherBass%2FICAM%2Fissues%2F7&data=05|01|emma.robinson%40kcl.ac.uk|cefcc48cc4b6455ebeef08db343d1564|8370cf1416f34c16b83c724071654356|0|0|638161209172338568|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=iNXfiOSDljud4rHQv0i7tsqfCX%2BhJ6SpDqPv5%2FZxByw%3D&reserved=0, or unsubscribehttps://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAD7GXPFJMRUYY7GBA4W4ZULW7K5NFANCNFSM6AAAAAAWRHNPSY&data=05|01|emma.robinson%40kcl.ac.uk|cefcc48cc4b6455ebeef08db343d1564|8370cf1416f34c16b83c724071654356|0|0|638161209172338568|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=ezeah4OYM6%2Fcmotp3qYRE2jWOsJdDWAoKK4%2FQs6x5dQ%3D&reserved=0.
You are receiving this because you are subscribed to this thread.Message ID: @.***>

Hi, thank you for your comment and sorry for the very late reply.
Masks are not needed to construct the datasets (they are only optional)... the image and class label are the only essentials as you mentioned - but if you can/want to use masks for the datasets you are also able to use the cross-correlation option ( --cross-cor in options.py ) for example.
And I've attached here the original python script for the ADNI dataloader (might need some slight modifications to work).
Thank you!
adni_dataloader.py.zip


Error when running conan install

Hello all,
first of all thanks for creating this repository that enables to use tf2 ROS library outside ROS.
I was wondering why I'm dealing with some errors when running the comand conan install once the library is cloned.
The steps I followed are the following:
1.- Cloning the repository
2.- Enter in the repository folder, create a build folder and enter in this folder
3.- run the command "conan install .."
At this point I realized that the minimum boost version for boost using conan is 1.70 so I had to modify the required condition for the boost library. Once this was fixed, and successfully installed, the following error appears when running the conan install comand:
ERROR: Failed requirement 'console_bridge/0.4.2@ntc/stable' from 'conanfile.py (tf2/melodic)'
ERROR: Unable to find 'console_bridge/0.4.2@ntc/stable' in remotes
I honestly don't know how to fix this problem in order to be able to build and install the library. I hope developers still check this repo since last update was few months ago.
Thanks in advance
Antonio Miranda

Hi, I haven't touched this in 4 years now.  Though I think the solution would be to first create the package provided in https://github.com/kheaactua/conan-console-bridge
I hope this helps


[Help] How to get some country flags in?

Joel, first of all, feel free to close this issue if you don't have plans to include country flags in the icons. I am just looking for some ideas here.
I'd like to have a set of country flags, this repo looks good https://github.com/lipis/flag-icon-css  then the challenges are SVGs, I think. As suggested by you, I tried to drag some of the flags on http://fontello.com/ the generated icons was not coloured, I think that's expected? Considering the colors of the flags are fixed and not meant to be changed later, and dragging that many icons doesn't seem to be viable, do you have some suggestions?  It would be cool to just continue to use <Icon for country flags.

Hi, I don't think that's a viable way because of the monochrome nature of fonts. I'd convert all the SVGs to PNG.

Sure! Tack.


Add Super/Command/Win key support

Hello, Thank you for creating this crate.
I've checked the keycodes.rs file, searching for the OS-specific key, which is the 'Command' key in macOS or the 'Super'/'Win' key in Linux and windows, and I can't find any.
Could you support this key so that users can automate OS-specific commands?

It's called meta which is a more generic name that fits better all oses I think.

It's called meta which is a more generic name that fits better all oses I think.

Alright then, I got it.
I am closing this issue. Thanks for this great library again.


RHOARDOC-1574: Rename 'boosters' and 'missions' to 'examples'

The PR doesn't contain the following changes that are known to come later:

SSO code examples using booster
Contribution Guide using booster in some places

I am merging the PR because the individual sub-PRs have each been individually reviewed.