COLLATE is missing in the JSON inspect output

e.g., you have this SQL:
CREATE TABLE `products` (
  `id` char(20) NOT NULL COLLATE utf8mb4_bin,
  ...

COLLATE will be in the output if the format is HCL and SQL but not JSON.

I had a similar problem，the "CHARACTER SET" and "COLLATE" of column definition will be lost in SQL format
version information:
atlas:
atlas community version v0.12.1-98bb7b9-canary
MySQL:
8.0.33 MySQL Community Server

The charset/collate/comment attributes were added to the JSON format in https://github.com/ariga/atlas/pull/2020. A new binary will be available after the PR is merged.

I had a similar problem，the "CHARACTER SET" and "COLLATE" of column definition will be lost in SQL format

The collation and the charset attributes are not added to the format if the default settings are used.


Verify that iSCSI is configured- Could have been explained little bit more

Choose one: BUG REPORT or FEATURE REQUEST
<!--
If this is a BUG REPORT, please:
  It has mentioned that Verify that Iscsi is configured ,  just below that it asks to verify Check that initiator name is configured and iSCSI service is running using the following commands.. But the point is how can we get to know that iscsi is configured the commands that follow tells about the  initiator name configuration.
**What happened**:
 It has mentioned that Verify that Iscsi is configured ,  just below that it asks to verify Check that initiator name is configured and iSCSI service is running using the following commands.. But the point is how can we get to know that iscsi is configured the commands that follow tells about the  initiator name configuration.

**What you expected to happen**:

**How to reproduce it (as minimally and precisely as possible)**:

**Anything else we need to know?**:

**Environment**:
- kubectl get nodes
- kubectl get pods --all-namespaces
- kubectl get services
- kubectl get sc
- kubectl get pv
- kubectl get pvc
- OS (e.g. from /etc/os-release):
- Kernel (e.g. `uname -a`):
- Install tools:
- Others:

Please check the generalized page at  https://v05-docs.openebs.io/docs/next/installation.html.


Typos

Sorry, after the 2nd one action needed to be taken ;)

I appreciate your help, and have installed a spell checker in Visual Studio Code :)
It's a little weird for someone to have a fork of my blog though :P


Allow Grid to show cell selection

Our current Grid css hides cell selection with:
.ag-cell-focus {
border-color: var(--xh-grid-cell-focus-border-color) !important;
outline: 0 !important;
}
It is sometimes nice to see cell selection.  We should use a boolean prop to the Grid component that when true will add a css class to the grid to use alternate css that shows cell selection:
.ag-cell-focus {
border-color: var(--xh-green) !important;
outline: 1px !important;
}
While on the subject of cell navigation....
When cell navigation is visible, a tree group should open only when the left most cell is selected and the user hits the right arrow.  Right now, the group opens when any cell in the group row is selected and the user hits the right arrow.
Same for closing a tree group:  When cell navigation is visible, a left arrow event should only close the tree group when the left most cell is selected.

Hi - submitted a PR to enable optional cell focus borders, along with the other new grid style flags we have teed up.
I was not seeing the different issue re. keyboard handling in the Toolbox treeGrid example.  The left/right arrows there only serve to navigate the selection.  Enter can be used to expand/collapse a group.  (And finally spacebar selects/deselects).  Can you check that out and let me know if I am missing something, or if this is an issue elsewhere?  If there's something outstanding there we can file a dedicated ticket.


Fix missing XNNPACK

Description
The Dockerfile has some bad flags in it. This leads to ultimately not finding XNNPACK which terminates the build. This was reported upstream as Issue #2391. It was fixed by PR #2414. This patch picks the important part of the PR. Applying this allows the build to complete successfully.
How Has This Been Tested?
This was tested using: podman build --tag my:model_server --build-arg RUN_TESTS=0  --build-arg BUILDAH_FORMAT=docker --build-arg ov_use_binary=0 --build-arg BASE_OS=redhat --build-arg RH_ENTITLEMENT=0 --build-arg ov_source_branch='releases/2024/0' --build-arg ov_contrib_branch='releases/2024/0' -f Dockerfile.redhat
Merge criteria:

[ x ] The commits are squashed in a cohesive manner and have meaningful messages.
[ x ] Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
[ x ] The developer has manually tested the changes and verified that the changes work

/retest


we have to update the buildimage hash for all build images

and not only for mfext-buildimage ones

Done (when merged to master) for buildimage for mfext, mfcom and mfxxx, centos6 and centos7

Not done (I had misunderstood)... but will be soon !


Crazy color glitches

Hello,
I hope I can get help with this issue. I noticed after I ran the script my colors look insane,

I couldn't capture it correctly with my pc cause it seems like screen updates fix it but games look messy.

How can I fix this issue? it's affecting my work and my gaming time as well and I'm starting to get worried. Any help is appreciated!
Thank you
Have a great day.

I can’t imagine that the debloater script causes this issue. That looks like a video card going bad, in my opinion.
Try reinstalling your video drivers and see if that makes any difference.
Sent from my iPhone

On Apr 6, 2020, at 5:46 AM, omerbadawy11<EMAIL_ADDRESS>wrote:

Hello,
I hope I can get help with this issue. I noticed after I ran the script my colors look insane,
I couldn't capture it correctly with my pc cause it seems like screen updates fix it but games look messy.
How can I fix this issue? it's affecting my work and my gaming time as well and I'm starting to get worried. Any help is appreciated!
Thank you
Have a great day.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

It happened right after so I assumed it caused it, I'll try that out.
Thank you for your response!


Implemented horizontal scrolling sync; plus mousewheel scrolling

Very small straight-forward change to improve synchonized scrolling.

Thank you for this 👍 I'll check check functionality and release a NuGet after that. Let me know if you do not want your name on the thanks to list 🙂


treewide: replace mkPackageOptionMD with mkPackageOption

Description of changes

I've replaced all occurences of mkPackageOptionMD with mkPacageOption, and added a deprecation warning to the function.
Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[x] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Priorities
Add a :+1: reaction to pull requests you find important.

Do they have the same functionality?

Yes, these days one is an alias of the other

Ping @pennae who's the most knowledgeable about the markdown transition :)


enhancesupport replace materialized view (#36749)

pick: https://github.com/apache/doris/pull/36749

run buildall


Licence Metadata appears to be missing from pypi

Describe the bug
Up to an including v0.13.0 the licence on pypi was correct with reference to the repo itself, i.e. MIT Licence. However from v0.14.0 onwards this is not the case. This can be seen if you inspect the releases page for v0.13.0 on pypi as compared to v0.14.0. This is probably something really simple but if it could be resolved that would be brilliant because this is causing deptry to flag as unlicensed in security tooling.
To Reproduce
Steps to reproduce the behavior:

Head to https://pypi.org/project/deptry/0.13.0/, observe that in the left hand sidebar itself lists License: MIT License (MIT)
Head to https://pypi.org/project/deptry/0.14.0/, observe that in the left hand sidebar there is no License entry.

Expected behavior
The licence listing would continue between versions as it has not changed.
Additional context
Thank you so much for making a tool like deptry that is so cool and useful, I hope this can be fixed quickly :)

Thanks for your report! It looks like Poetry sets that automatically, so we lost that information when switching over PDM. Will add the classifier manually.

0.14.2 has been released with the proper classifier. Thanks again for the report, appreciate it!

@mkniewallner thanks for being so responsive! I really love deptry so I’m glad I can now use it without tripping our security tooling. Thanks again for acting so quickly!


added some content in about us page  #1045

Hello @anuragverma10,
I have added some information regarding this Wildguard website so that user gets some information about the website
kindly merge this PR under the hacktober fest 2024

@anmol-tripathi83 Please see the conflicts . Resolve the conflicts . Ensure you pull all the latest changes before pushing your feature/bug fixes to the main branch. After resolving the conflicts, please open a new PR for review.
Thank you!


How to deploy Hashing Encoder?

Hi,
I used Hashing encoder for my model.
The problem is now I want to deploy my model.
How will I encode my values at prediction time?
The Hashing encoder has only hash_method attribute but no mapping attribute.
Please help.

I'd recommend serializing the trained encoder with joblib, loading it at prediction time, and calling transform().
There is no mapping for a hashing encoder.

@wdm0006 thanks, are the encodings trained? What is the training procedure? I saw md5 as the  I though encodings like binary establish arbitrary mappings to categorical inputs.. could you elaborate or point me to a resource where this training is explained..

@wdm0006 also, can't I pickle the encoder and use it?

The encodings are trained differently depending on the encoder. For hashing trick, in general, it's a just a hash, so there is nothing to learn. This runs in transform: https://github.com/scikit-learn-contrib/categorical-encoding/blob/master/category_encoders/hashing.py#L161, you can specify different hashing methods, like MD5.
The methodology is also explained well here: https://en.wikipedia.org/wiki/Feature_hashing
Pickle may work but I'd recommend joblib. Scikit-learn has good documentation on how to serialize estimators and transformers, which I'll defer to here.


[ISSUE #5555 ]fix:build instance name with pid instead of pid+nanotime .Because tha…

fix that create a MQClientInstance as long as create a producer or a consumer.
That lead to clientInstance just manages one producer or producer,
but clientInstance is designed for managing many of producers and consumers;
#5555

Codecov Report

Merging #5557 (6efd4aa) into develop (1657475) will decrease coverage by 5.66%.
The diff coverage is n/a.

@@              Coverage Diff              @@
##             develop    #5557      +/-   ##
=============================================
- Coverage      48.39%   42.73%   -5.67%
- Complexity      4618     8040    +3422
=============================================
  Files            555     1031     +476
  Lines          36731    72743   +36012
  Branches        4839     9614    +4775
=============================================
+ Hits           17776    31084   +13308
- Misses         16726    37724   +20998
- Partials        2229     3935    +1706

Impacted Files
Coverage Δ

.../java/org/apache/rocketmq/client/ClientConfig.java
63.37% <ø> (+2.22%)
:arrow_up:

...che/rocketmq/common/consumer/ConsumeFromWhere.java
0.00% <0.00%> (-100.00%)
:arrow_down:

...rocketmq/test/client/rmq/RMQBroadCastConsumer.java
0.00% <0.00%> (-100.00%)
:arrow_down:

...est/listener/rmq/concurrent/RMQNormalListener.java
0.00% <0.00%> (-96.16%)
:arrow_down:

.../apache/rocketmq/test/message/MessageQueueMsg.java
0.00% <0.00%> (-94.74%)
:arrow_down:

.../apache/rocketmq/test/factory/ConsumerFactory.java
0.00% <0.00%> (-89.48%)
:arrow_down:

...ava/org/apache/rocketmq/test/util/RandomUtils.java
0.00% <0.00%> (-85.72%)
:arrow_down:

...rocketmq/test/client/rmq/RMQAsyncSendProducer.java
0.00% <0.00%> (-80.51%)
:arrow_down:

...pache/rocketmq/test/client/rmq/RMQSqlConsumer.java
0.00% <0.00%> (-80.00%)
:arrow_down:

...he/rocketmq/test/client/rmq/RMQNormalProducer.java
0.00% <0.00%> (-79.79%)
:arrow_down:

... and 1023 more

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Use provided json encoder/decoder for stats & info queries

i don't think this works, json.loads expects a string but you're going get bytes

i don't think this works, json.loads expects a string but you're going get bytes

From Python 3.6 arg s in json.loads can also be bytes and bytearray

can you fix the build?

Working on it


Alloc felt dict test

TITLE
Description
This PR tests the hints AllocFeltDict and ShouldContinueSquashLoop
Checklist

[x] Linked to Github Issue
[x] Unit tests added
[x] Integration tests added.
[ ] This change requires new documentation.

[ ] Documentation has been added/updated.
[ ] CHANGELOG has been updated.

Please remove the cairo submodule. This should also fix CI


input + icon + errorTip

In my project, I want to add Icon to the input box, and the error prompt can also be displayed when a mistake is made. so I wrote the HTML structure:

  <input class="form-input input-sm is-error" type="text" placeholder="Name">

The name is valid.

The final results are not satisfactory, and I think the input error display is not well defined.
An issue:

form-input-hint class must be the next brother node of input.
The definition of more than one line is not allowed in the input icon definition.

You could try this.

    <input class="form-input input-sm" type="text" placeholder="Name">

The name is valid.


Serializers file needs DocStrings

The source file https://github.com/hangqianjun/python-intermediate-inflammation/blob/1721cab03f543646475d194cacf95c06e490e2df/inflammation/serializers.py does not contain any DocStrings comments, which would be helpful for someone who wished to contribute to the project.

This should take 30 mins.


404 at /docker-for-windows/wsl/%20for%20details.

I found a broken link : https://docs.docker.com/docker-for-windows/wsl/ for details.

Hey @awet2001
Thanks for reporting the broken link issue. Could you let us know how you arrived at the broken link?

Thanks for reporting; the correct URL is now https://docs.docker.com/desktop/windows/wsl/
I found where the "faulty" URL is coming from; more details in https://github.com/docker/docker.github.io/pull/13382.
I'm closing this ticket, because the broken link is not in the docs itself, but will be fixed in Docker Desktop.


[google_sign_in] Android documentation is wrong

I'm trying to use Google Sign In and it works fine on iOS but on Android the documentation is weird/not clear.
For example I'm trying to init the library like this:
final googleUser = await GoogleSignIn(
  serverClientId: 'your_server_client_id',
  clientId: 'your_client_id'
).signIn();

However, in the documentation it says this in regards to the clientId param (source):

This option is not supported on all platforms (e.g. Android)

And it says this in regards to serverClientId param (source):

Optional and not supported on all platforms (e.g. web)

Which implies that serverClientId is working on Android.
However if we look at the implementation here, the serverClientId is actually not used and not only that but clientId param is used even if the documentation says it is not supported on Android.

Hi @tudor07
"Optional and not supported on all platforms (e.g. web)"

Which implies that serverClientId is working on Android.

IMO, this speculation is not correct. The web is only one example of unsupported platforms. It's not sure about including Android in there.

However if we look at the implementation here, the serverClientId is actually not used and not only that but clientId param is used even if the documentation says it is not supported on Android.

This is due to the inference above. And you can see the clientId and serverClientId parameters are optional, which means they can be used or not depending on the case.
However, yes, the documentation is pretty unclear about supported platforms.
Does the above explanation make sense to you?

Makes sense.
I also want to add that if I used the clientId param on Android, the feature would not work. Once I stopped using it then auth worked. Taking this into consideration maybe clientId should be removed altogether from Android if it's really not supported and also breaks the feature as it was in my case.

Makes sense. I also want to add that if I used the clientId param on Android, the feature would not work. Once I stopped using it then auth worked. Taking this into consideration maybe clientId should be removed altogether from Android if it's really not supported and also breaks the feature as it was in my case.

@tudor07 In this case, updating documentation can help avoid such problems. The README docs (Android, iOS) should be updated to be clearer, the same with Web.
Labeling this issue for further opinions! Thanks!

Same issue here. iOS works fine. But android had some issues. I got the server auth code but it's not working when checking on my back-end.
       final googleSignIn = GoogleSignIn(               scopes: [                 'https://www.googleapis.com/auth/userinfo.email',                 'https://www.googleapis.com/auth/userinfo.profile',                 'openid',               ],               serverClientId:  'myid...',          );
I hope this will be fixed on Android in the future :)

So we're seeing the same issue in android play store..  However, we're using the flutterfire_ui library .

Makes sense. I also want to add that if I used the clientId param on Android, the feature would not work. Once I stopped using it then auth worked. Taking this into consideration maybe clientId should be removed altogether from Android if it's really not supported and also breaks the feature as it was in my case.

&  specifically the firebase_ui_oauth_google pacakge.
In that case, the clientId is required, when passing in to the SignInScreen

B/c we're passing in GoogleProviderConfiguration:

Could this be related at all?

I've added clientId to make it work on WEB and it broke the Android. It didn't work on Android until I remove the clientId
@module
abstract class ThirdPartyAuthInjectableModule {
  @singleton
  GoogleSignIn get googleSignIn => kIsWeb
      ? GoogleSignIn(
          clientId:
              'xx.apps.googleusercontent.com',
          scopes: ['email'],
        )
      : GoogleSignIn(
          scopes: ['email'],
        );

Bad docs...on Android you have to leave clientId AND serverClientID empty.
googleSignIn = GoogleSignIn(       clientId: Platform.isIOS ? EnvService().googleClientIdForiOS : null, );

Just want to say that I've been wrestling with this one out for days... when following the package instructions to the letter causes it to fail, something's very wrong. Thanks to all of you for figuring this out and posting about it here!


[WIP] commander delete unused and minor cleanup

This diff might break other PRs - should we coordinate on a commander rewrite? (which is due anyway).

Yes! The only question is how we approach it without breaking the world.
As appealing as a rewrite sounds the current commander isn't beyond saving incrementally. Delete everything broken or no longer relevant, move anything that doesn't belong in commander, then one by one extract and encapsulate the bigger core behaviour (HOME, command handling, etc). Then turn the base commander into a class, move all the static variables in, params to controllib.
As a crude testing method we could replay logs (real and simulated) with something in place to catch differences in messages published by a stable commander.

@LorenzMeier thinking through this a bit more, can you describe what you think is and isn't appropriate for the new events module? Should all calibration code live there and drop the low priority commander thread?

I'll revisit this when there's no other active development in commander and we're ready to think about a commander rewrite/refactor.


Hello

I heard that you need PSD support? If anything, we already have a working version of the module and I can give you an build.
I'm working with a visual novel, too, by the way.
https://youtu.be/HhiW25nzqLk

The video seems great, I'd like to have a try, thanks!
By the way this repo is just a hobby project now, we are using Nova engine for production. May switch to godot if I find a mature solution.

Editor:
https://disk.yandex.com/d/yKrOBxL771nMFQ
Test project:
psd-test.zip
You can build it yourself if you get this code https://github.com/godotengine/godot/pull/73417
and move to 3f84964ad3be64d665d1150897dfb983471a48d5 commit.
if you merge it with https://github.com/V-Sekai/godot/tree/psd you can get cross-platform variant

Thanks!


output TS file.

Hi first of all. great work thanks a lot.
I have a question, how can emit a source as a '.ts' file? cause when I save a project (after I make some changes) it outputs JavaScript files but I need TypeScript files.
Thanks.

Ok, actually I wrote it out just now. Try this:
// untested
const srcDir = project.getDirectoryOrThrow("./src"); // get the root directory of the source of your project
const destDir = project.getDirectoryOrThrow("./destination");
const fileSystem = project.getFileSystem();
const promises: Promise<void>[] = [];

for (const sourceFile of srcDir.getDescendantSourceFiles()) {
    const relativePath = srcDir.getRelativePathTo(sourceFile);
    promises.push(fileSystem.writeFile(path.join(destDir.getPath(), relativePath), sourceFile.getFullText()));
}

await Promise.all(promises);

Thanks a lot.

@navid9675 I've been thinking about this a bit and I think this will be covered by #256. Basically the code would look like this:
// get the directory you want to copy
const srcDir = project.getDirectoryOrThrow("./src");
// copy the directory
const newDir = srcDir.copy("./destination"); // method doesn't exist yet
// save it to the file system
await newDir.save();

I'll comment back here when #256 is implemented.

Thank you @dsherret, that would be great. Should I reopen the issue?

@navid9675 no it's ok. I'm working on #256 right now and this will be covered by that.
By the way, it looks like there is a directory.copy method that currently exists, but there's a problem with it in that it doesn't update module specifiers appropriately when copying (I'm updating it for version 11 along with #256). I don't believe that matters for your scenario though so the above code should work today.

@navid9675 in version 11 the following code should work:
const srcDir = project.getDirectoryOrThrow("./src");
// need to specify false here to prevent it from including other files in the directory
const newDir = srcDir.copy("./destination", { includeUntrackedFiles: false });
await newDir.save();

Let me know if you run into any issues.

@dsherret  thanks a lot, it worked like a charm. Great job!
if I found anything else I will let you know.  thank you


ARTEMIS-1256 PagingOMETest.testPageCleanup fails

Queue.getMessageCount does not guarantee you get accurate number
of messages on the queue. To get precise number, the test must
wait until all asynchronous tasks on the queue are finished.

I'm pushing a new commit closing this one instead.. if you disagree please let me know.

Nice wait expression. It is good to know about Wait.waitFor utility. Thanks.


Import Error

Hi Sir,
Thanks for your excellent work! I met a problem after following the installation process and dataset preparation:  when I run the code: it shows that
ImportError: cannot import name 'datasets' from partially initialized module 'mask2former.data' (most likely due to a circular import)
Could you find out the possible problems?
Thanks

We didn't face it.

Hi, thanks for your reply,
I installed the environment follow your instruction and try to run the following code:
python train_net_grattvis.py --num-gpus 2 --config-file configs/grattvis/youtubevis_2019/grattvis_R50_bs8.yaml
Traceback (most recent call last):
File "train_net_grattvis.py", line 42, in
from mask2former import add_maskformer2_config
File "/data/project/GRAttVIS/mask2former/init.py", line 2, in
from . import data  # register all new datasets
File "/data/project/GRAttVIS/mask2former/data/init.py", line 2, in
from . import datasets
ImportError: cannot import name 'datasets' from partially initialized module 'mask2former.data' (most likely due to a circular import) (/data/project/GRAttVIS/mask2former/data/init.py)
Could you please give any clues about the errors?
Kindly Regards

This is solved in the latest commit.
The gitignore removed datasets folders from mask2former and vita folders. That was the problem. Thanks for pointing it out.

Hi,
Thanks much for your prompt reply and solution.
I will have a try


[Feature] support fe executes all constant query

Why I'm doing:
support fe executes all constant query.
What I'm doing:
Convert the scalar-type constant values directly into MySQL text protocol in FE. For float/double type, we used ryu to convert value to string value, so we need rely its java version to convert string value, but to ensure compatibility with the backend, we also need to modify the format of scientific notation in its java version.
The following conditions need to be met:

enable_constant_execute_in_fe = true
not explain analyze or explain scheduler clause
query is in MySQL text protocol. unsupport MySQL prepare binary protocal and Http protocol.
all values are constantOperator and without referencing any data object.

Fixes #issue
What type of PR is this:

[ ] BugFix
[x] Feature
[ ] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Does this PR entail a change in behavior?

[x] Yes, this PR will result in a change in behavior.
[ ] No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

[ ] Interface/UI changes: syntax, type conversion, expression evaluation, display information
[ ] Parameter changes: default values, similar parameters but with different default values
[x] Policy changes: use new policy to replace old one, functionality automatically enabled
[ ] Feature removed
[ ] Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

[x] I have added test cases for my bug fix or my new feature
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

[ ] This is a backport pr

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto-backported to the target branch

[x] 3.3
[ ] 3.2
[ ] 3.1
[ ] 3.0
[ ] 2.5

@mergify backport branch-3.3


compatibility dependency and version compatibility

Where can we find more details about 'glibc' dependency and version compatibility to run Container Jobs ?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 3339a2e0-be29-1363-f588-b231d4472c02
Version Independent ID: 72dd11a3-704d-d0fd-6dfa-cf49f3352de3
Content: Container Jobs in Azure Pipelines and TFS - Azure Pipelines
Content Source: docs/pipelines/process/container-phases.md
Product: devops
Technology: devops-cicd-process
GitHub Login: @juliakm
Microsoft Alias: jukullam

@anumalasri -- Anumala, thank you for your question.  Please consider these resources:

Azure DevOps Services
Azure DevOps on Stack Overflow

@juliakm -- Julia, please look into this potential documentation issue.

@WilliamAntonRohm ..  Appreciate it if you can point out any reference related to the above question..

@anumalasri -- thank you for your follow-up.  Please see the resources in my initial reply.  Past those, I defer to @juliakm.

@anumalasri , have you found any solution to this issue?  I am getting the same output you posted on Jul 13 and I don't have a clue what is causing it.  I recently updated a Docker container and this is the result when I try to run even a basic command line task.  No other changes to the yml have been made.
Task definition:
  - script: |
      echo Test YML file is $(System.DefaultWorkingDirectory)/tests/$(yaml_prefix).yml
      echo User: `whoami`
      echo Get sys info:
      # Rscript -e "Sys.info()"
      Rscript -e "message('R Version is ', getRversion())"
      Rscript -e "message('Sys.timezone says ', Sys.timezone())"
      Rscript -e "message('Sys.getenv(tz) says ', Sys.getenv('tz'))"
      echo POPS_USER is $(POPS_USER)
      Rscript -e "message('Sys.getenv(\'POPS_USER\') says ', Sys.getenv('POPS_USER'))"
    displayName: 'Basic info'

Result:
Starting: Basic info
==============================================================================
Task         : Command line
Description  : Run a command line script using Bash on Linux and macOS and cmd.exe on Windows
Version      : 2.201.1
Author       : Microsoft Corporation
Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/command-line
==============================================================================
node[70]: pthread_create: Operation not permitted
/__a/externals/node10/bin/node[75]: ../src/node_platform.cc:58:std::unique_ptr<long unsigned int> node::BackgroundTaskRunner::DelayedTaskScheduler::Start(): Assertion `(0) == (uv_thread_create(t.get(), start_thread, this))' failed.
 1: 0x8fb090 node::Abort() [/__a/externals/node10/bin/node]
 2: 0x8fb165  [/__a/externals/node10/bin/node]
 3: 0x98445a node::BackgroundTaskRunner::BackgroundTaskRunner(int) [/__a/externals/node10/bin/node]
 4: 0x98451b node::NodePlatform::NodePlatform(int, node::tracing::TracingController*) [/__a/externals/node10/bin/node]
 5: 0x903591 node::Start(int, char**) [/__a/externals/node10/bin/node]
 6: 0x7f235e259d90  [/lib/x86_64-linux-gnu/libc.so.6]
 7: 0x7f235e259e40 __libc_start_main [/lib/x86_64-linux-gnu/libc.so.6]
 8: 0x8bce95  [/__a/externals/node10/bin/node]
Finishing: Basic info

Definitely, there is version incompatibility between the Azure Node version and the Container Image version.
@landisrm  As we don't have much information about version compatibilities, we choose to add our own version to the container image.  You may try the same.

@anumalasri thanks for the response!  Can you clarify?  Do you mean you added your own version of node to the container image?  e.g. by running something like sudo apt install nodejs?

@landisrm There's a section on non glibc-based containers - https://learn.microsoft.com/en-us/azure/devops/pipelines/process/container-phases?view=azure-devops#non-glibc-based-containers. My understanding from reading that section is that the agent version of Node.js will be used for tasks. You can see the most recent version of Node.js for a hosted agent in our software article. The ubuntu-latest agent runs Node 18.16.0 but I believe this was a recent development. I'll add a link to this page to the article.

#sign-off


Add determinate download progress indicator to samples-lib

Description
PR update the samplesDownloaderActivity.kt to use the ArcGISEnvironment.arcGISHttpClient.download API. This will allow all samples that require file provisioning, to download data with a progress indicator.
Links and Data
Sample Epic: runtime/kotlin/issues/1995
What To Review

Changed files

How to Test
Run a sample which requires file provisioning:

Display Dimensions (.mmpk)
Add feature layers (.gpkg, .geodatabase, .shp)
Find route in transport network (.zip extracted)

Thanks for the review @gunt0001, added the feedback. Ready for your re-review.

Thanks for the review @gunt0001 again. Hopefully, it looks good.

@shubham7109 looks good, one comment.

Added PR feedback, and updated with v.next branch. Added code to modify the spinner visibility using Dispatchers.Main.  @changanxian Ready for your review.

Looks good


Touch up UI

Problem
The UI could use some polishing in a few places. I notice that half the logo is cut off. Additionally, the fonts change a lot within a page for no apparent reason, which looks weird.
Tasks
Fix UI aesthetic issues.

The isControl "button" is overlapping the border of its container.

Covariates is a different front than Start and End dates. Additionally, font for DOF and R^2 values is different from font of other numbers on the page.

The screens feel cramped sometimes. Might be better to reduce the font size?


compatibility with Altair 5.0.0RC1

Is data_server compatible with 5.0.0RC1? I'm getting the following error after I upgraded Altair:
NoSuchEntryPoint: No 'data_server' entry point found in group 'altair.vegalite.v5.data_transformer'
I tried
from altair_data_server import data_server
and I get no errors.
I'm using Python 3.11.2 and data server 0.4.1
Thank you.

Hi. What about this issue? If someone give me hints about internal I could program what is needed.

Facing the same issue.

OK. need to do this.
import altair as alt
from altair_data_server import data_server

alt.data_transformers.register("data_server", data_server)
alt.data_transformers.enable("data_server")

In Altair 5, the recommended way to work with large datasets is via Vegafusion. The documentation contains a section of how to use the Vegafusion renderer in Altair and if you need additional performance you can use the Vegafusion widget renderer instead.
We are going to archive this repo, so I'm closing all the open issues and PRs before doing so. Try out the new options for working with large data mentioned above and if you run into issues, please open an issue directly in the altair or vegafusion repo.


Values of slider differ by +- 1 to the actual value

I have noticed that, when i change the values with the slider and print them, the results sometimes differ by +- 1
How to fix this ?

@Wizzel1
Despite using integer (1) value for step property,
the same happens for me when converting min/max values to integer format.
Likely reason is at incorrect rounding.
The only solution, for now, seems to be to handle it on own side.

You can try something like this:
`
var integerMinPrice: Int {
return Int(round(min))
}
var integerMaxPrice: Int {
    return Int(round(max))
}

`
to round to the nearest integer

Got you, i will try that. Thanks


ACTION_CLOSE: socket is closed remotely

Is this a problem about mobile phone or matlab server?

Try to restart your mobile phone. Maybe you closed the page of your app.


JSON Schema's required property could contain an unknown property

Is your feature request related to a problem? Please describe.

Consider the following schema:
openapi: 3.1.0
components:
  schemas:
    MySchema:
      properties:
        foo:
          type: string
      required:
      - bar # <-- there's no such a property declared

There's no such a property like bar defined, yet it is required in the schema. Even technically it isn't wrong as there's no additionalProperties: false clause, I don't think there's too much sense to require a property that is not declared in the schema. Most likely it'd be a typo, I believe. Currently Redocly linter doesn't catch this.
Describe the solution you'd like

A new rule to check if the required list contains only already declared properties of the schema.
Describe alternatives you've considered

Writing a custom rule. Always an option instead of writing a built-in one.
There's no possibility to write this as a configurable rule, unfortunately.

@adamaltman you mean this one? Somehow it slipped my mind that there already was one.

How about a rule named missing-required-schema-properties ? (Naming things might be the most difficult part of this!)


ztest: export ztest_test_* symbols to llexts

Export the minimal set of ztest_test_* symbols to llexts so that the zassert_* macros can be used by the extension code to affect test execution. Calling these also requires vprintk() to be exported.
This is a prerequisite to enlarging the llext test suite with a "linker workout" test that checks all possible types of relocations and data types.

CI issue is due to the fact that ztest_test_ functions have two implementations, depending on the KERNEL macro being defined or not. I placed the EXPORT_SYMBOLs later, after the preproc conditionals, so they are covered either way.

CI issue is due to the fact that ztest_test_ functions have two implementations, depending on the KERNEL macro being defined or not. I placed the EXPORT_SYMBOLs later, after the preproc conditionals, so they are covered either way.

How about putting the macro after every implementation? That check is annoying, means someone has to bypass the CI check for merging.


Fix the tpm2-policy dep

The tpm2-policy 0.4.0 release has been published so no need to
rely on a local checkout.
Signed-off-by: Peter Robinson<EMAIL_ADDRESS>

lgtm


V5-5.1.1 Peer connection issue

I haven't fully explored the extent to which the client is affected by this issue, however, it would appear after a certain period peers will have an indefinite ping wait causing things like header syncing to halt progress. After manually disconnecting the peers progress will pick up until the the ping wait proceeds to happen again. This behavior can be observed within 5-10 minutes.

This behavior is noticed on at least windows and osx, linux untested. (peers.dat == nofun!)
There is a MASSIVE difference between letting peers timeout/attempt to keep working and disconnecting them manually.
Here is the Windows test where I let it run (with a faster connection) without disconnecting peers.

Here is the Mac OSX test where I disconnected peers after appearing to stall.

Both tests were conducted over the same several hour timeframe simultaneously.

This is also a issue on Linux, if not identical it is very similar. I have had trouble with getblocktemplate responses saying "VERGE not connected" or something similar.. During this day i have preformed multiple tests on the new VERGE daemon when i just came over this issue "live"
It seems that one or more peers had a "hickup" causing ALL connections to halt and disconnect which left the daemon without any connections at all.  This can happen very random: multiple times everyday, or just once in a couple days.
My scrypt daemon was without a connection for almost two hours today. This may also be a issue with Tor.
I fetched my debug logs today while it was going on;
2019-05-28T09:16:53Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:16:54Z Socks5() connect to <IP_ADDRESS>:21102 failed: general failure
2019-05-28T09:16:55Z Socks5() connect to <IP_ADDRESS>:21102 failed: host unreachable
2019-05-28T09:16:56Z UpdateTip: new best=eb2111ddff913451aec8ea7b45f7299b2f67de11e8ea87d8f5f903e5b229b016 height=3163532 version=0x00001004 log2_work=85.306585 tx=7187739 date='2019-05-28T09:16:19Z' progress=0.999995 cache=2.1MiB(1499$
2019-05-28T09:16:56Z FindStealthTransactions() tx: ff9c1f2effe20913fb4df01e2344df1290b865abd5f721d2ea794e13265e90cd
2019-05-28T09:16:56Z FindStealthTransactions() tx: ef9b326068b45747b67cff5fec3a32270d4918b673a09daef64267f56ffdb82c
2019-05-28T09:16:56Z FindStealthTransactions() tx: 21ac212c1ce99c1a167c7acf9de70f4491e6ca6142ce1d9818592f020ead2f95
2019-05-28T09:16:56Z FindStealthTransactions() tx: 3590cd3177f6e9ec2a6af28836ad83047468ef74584405a5bcf3714e664b7a51
2019-05-28T09:16:56Z FindStealthTransactions() tx: 50d6526968636919669418ef090bf4d62af4f25e454478d4951019e5fe793e52
2019-05-28T09:16:56Z FindStealthTransactions() tx: 8d96ff98f666b30ffa9b1d0b8d4b5e3666f0452fc0f7630aeacafd892f5e630a
2019-05-28T09:16:56Z FindStealthTransactions() tx: 2d3ac9b89fa5fdc1f8bf2d52f4a691e262ee15abe5e4ed3f52f6515d37e73129
2019-05-28T09:16:56Z FindStealthTransactions() tx: 4f497ca0507493b837c0e4582471bb2a11309f5455dcd64772985936599510e6
2019-05-28T09:16:56Z FindStealthTransactions() tx: c544530acbfeb0330f219cb3d24daa69a6d04bd5b590ae658fae44d903df5209
2019-05-28T09:16:56Z CreateNewBlock(): block weight: 796 txs: 0 fees: 0 sigops 400
2019-05-28T09:17:16Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:17:17Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:17:18Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:17:18Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:17:40Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:18:04Z UpdateTip: new best=000000000000a92b8654900efdd4b215429b8c5ae9392e2815ba03bab37da2d3 height=3163533 version=0x00000804 log2_work=85.306586 tx=7187740 date='2019-05-28T09:12:41Z' progress=0.999955 cache=2.1MiB(14991t$
2019-05-28T09:18:04Z FindStealthTransactions() tx: e4f79b03ccfe0c1836a944f918773d9c8e49e6cd3bf6e19400187f48e3bb5db1
2019-05-28T09:18:04Z CreateNewBlock(): block weight: 796 txs: 0 fees: 0 sigops 400
2019-05-28T09:18:13Z FindStealthTransactions() tx: dce750c8cf623d282b09d89d0e28d208d53f70b25a7a1fc7a58229a9b6f31536
2019-05-28T09:18:14Z CreateNewBlock(): block weight: 1716 txs: 1 fees: 100000 sigops 408
2019-05-28T09:18:17Z UpdateTip: new best=9a26843972d5fbabdf2dfa94fe6216d0ada5f7dc89c113831dbae695b02b6cba height=3163534 version=0x00005004 log2_work=85.306596 tx=7187741 date='2019-05-28T09:18:05Z' progress=0.999998 cache=2.1MiB(14992t$
2019-05-28T09:18:17Z FindStealthTransactions() tx: 5b23fd4ad59a6cff1336a898a97eb21ae8cc04533a1cba49895cfc7f6c483679
2019-05-28T09:18:17Z CreateNewBlock(): block weight: 1716 txs: 1 fees: 100000 sigops 408
2019-05-28T09:18:54Z UpdateTip: new best=918d1f7b0cff08ac86a4b3f75e25fa1841d04923b920b3c24a0e7add539ae1dd height=3163535 version=0x00001004 log2_work=85.306596 tx=7187742 date='2019-05-28T09:18:12Z' progress=0.999994 cache=2.1MiB(14993t$
2019-05-28T09:18:54Z FindStealthTransactions() tx: cf4819bf111bef8a9267fa407311920403f7bc29cf6436665ec6bb81b1c0f3cd
2019-05-28T09:18:54Z CreateNewBlock(): block weight: 1716 txs: 1 fees: 100000 sigops 408
2019-05-28T09:19:30Z UpdateTip: new best=c7bba8885c80f2bfc1aba6cb41bc2a61d97412854cadbc3b000d743c5c4f0c58 height=3163536 version=0x00001004 log2_work=85.306596 tx=7187744 date='2019-05-28T09:18:51Z' progress=0.999995 cache=2.1MiB(14995t$
2019-05-28T09:19:30Z FindStealthTransactions() tx: 562df11a47a8bf5cf73ab37bad9ccd2d7c03397c0e64e9defc084937f7fb30ee
2019-05-28T09:19:30Z FindStealthTransactions() tx: dce750c8cf623d282b09d89d0e28d208d53f70b25a7a1fc7a58229a9b6f31536
2019-05-28T09:19:30Z CreateNewBlock(): block weight: 796 txs: 0 fees: 0 sigops 400
2019-05-28T09:19:32Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:19:32Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:19:35Z connected to self at <IP_ADDRESS>:48020, disconnecting
2019-05-28T09:19:35Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:20:06Z UpdateTip: new best=c60fceb06b60cb66a7ef487685c68deb09a8b6cf8107a6087c3fca8f3bcd403b height=3163537 version=0x00001804 log2_work=85.306599 tx=7187745 date='2019-05-28T09:12:42Z' progress=0.999938 cache=2.1MiB(14997t$
2019-05-28T09:20:06Z FindStealthTransactions() tx: 53b55d1cb6f42e5c0a06f842aea6f8149eb47c044166ec02f36aeb311511b138
2019-05-28T09:20:06Z CreateNewBlock(): block weight: 796 txs: 0 fees: 0 sigops 400
2019-05-28T09:20:16Z Socks5() connect to <IP_ADDRESS>:21102 failed: host unreachable
2019-05-28T09:20:16Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:20:42Z UpdateTip: new best=544fca88d8e81bc2e8e8e6292a1e415231754c75198a8101166d0ac67eae543f height=3163538 version=0x00005004 log2_work=85.306607 tx=7187746 date='2019-05-28T09:20:01Z' progress=0.999994 cache=2.1MiB(14998t$
2019-05-28T09:20:42Z FindStealthTransactions() tx: 70c2d7daede06c7c67c91db56a07d14172eb6353d5b8e75ee8656761e736872d
2019-05-28T09:20:42Z CreateNewBlock(): block weight: 796 txs: 0 fees: 0 sigops 400
2019-05-28T09:20:59Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:20:59Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:21:00Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:21:15Z FindStealthTransactions() tx: 384f8634b6c5a2d5cde50c0d520378de3cff47a89182efcc4f4d92207eea2e0a
2019-05-28T09:21:22Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:21:22Z CreateNewBlock(): block weight: 1712 txs: 1 fees: 100000 sigops 408
2019-05-28T09:21:22Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:21:33Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:21:33Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:21:35Z UpdateTip: new best=99e01ac11efca9ac3ff4bf9f0487445943eb5249bc18fa9932bfe436766c556d height=3163539 version=0x00002004 log2_work=85.306607 tx=7187747 date='2019-05-28T09:12:43Z' progress=0.999926 cache=2.1MiB(14999t$
2019-05-28T09:21:35Z FindStealthTransactions() tx: eb3546a05ac917e0dba3348da155636f9400ef855409b445fc78d3969acb63e7
2019-05-28T09:21:35Z CreateNewBlock(): block weight: 1712 txs: 1 fees: 100000 sigops 408
2019-05-28T09:21:50Z UpdateTip: new best=ee987b59da04f4984618d5abc18b4a60cf291f2f8dec5a3b2c3a5b601503d86a height=3163540 version=0x00002004 log2_work=85.306607 tx=7187748 date='2019-05-28T09:12:44Z' progress=0.999924 cache=2.1MiB(15000t$
2019-05-28T09:21:50Z FindStealthTransactions() tx: d1594bb259621a0216704cd4e1ab2dcd9e932494434eacb44b93fdc07cb7aa41
2019-05-28T09:21:50Z CreateNewBlock(): block weight: 1712 txs: 1 fees: 100000 sigops 408
2019-05-28T09:21:55Z Socks5() connect to <IP_ADDRESS>:21102 failed: connection refused
2019-05-28T09:22:07Z UpdateTip: new best=33f29e45c23c85ee8c0a89917f701d3d69ae14eb5a25ca77c9102a3e5d47b002 height=3163541 version=0x00001804 log2_work=85.306609 tx=7187749 date='2019-05-28T09:12:45Z' progress=0.999922 cache=2.1MiB(15002t$
2019-05-28T09:22:07Z FindStealthTransactions() tx: 841c76f493d6042072479c45ac2e55e0f82749dc8ccf1c7bd1547da8d0e332fc
2019-05-28T09:22:08Z CreateNewBlock(): block weight: 1712 txs: 1 fees: 100000 sigops 408
2019-05-28T09:22:11Z FindStealthTransactions() tx: 073537c33a7fbb41014c88c2f19ecf57fc2bb5491a90bfeb7883b52294439fa3
2019-05-28T09:22:19Z CreateNewBlock(): block weight: 3816 txs: 2 fees: 200000 sigops 416
2019-05-28T09:22:38Z FindStealthTransactions() tx: eca6ced49b1b95ccf5296286c63bdad360668bbdb320ad711973691e9c79a813
2019-05-28T09:22:48Z CreateNewBlock(): block weight: 4732 txs: 3 fees: 300000 sigops 424
2019-05-28T09:22:58Z RemoveLocal(kn6vzi3b4vubogmhys5kailtrmjg76v2j7dup4rxzstr6bt4er7hi2yd.onion:21106)
2019-05-28T09:22:59Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:22:59Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:00Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:00Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:01Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:01Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:02Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:02Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:03Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:03Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:04Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:04Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:05Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:05Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:06Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:06Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:07Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)
2019-05-28T09:23:07Z connect() to <IP_ADDRESS>:9090 failed after select(): Connection refused (111)

hmm may you want to try this branch: improved-header-and-block-network-processing it includes a lot of performance improvements to speed up the syncing process

Yeah, huge improvement on sync speed!! 🥇

Well, the only downside here is that it starts caching block/header hashes once in memory. @cod3gen
We are currently evaluating the consequences for such a cache, but glad that it works flawlessly.

2/3 of entire chain downloaded in 45 min now(current memory use is 2.3 GB) 👍

You're telling me you not only fixed it but made it even faster?
#include <typeinfo>
typeid(Verge).name(); // returns scam

Saw it was merged into master 😎

Seems to be done.


Come up with something like dev-channel and releasepreview-channel for other platforms

where "other platforms" is anything non Windows Store.

Implemented.


Bump GitHub Action versions

No effects were observed on Make-managed files.

CI is expected to fail at the point where #105 would supply the fix.

Failed at expected spot.  Merging.


added new ML project

Added a new ml OCR project

go through the updated readme file to know ur mistakes and raise another pr (project description is missing)


[BUG] CastOpSuite and AnsiCastOpSuite failing with ArithmeticException on Spark 3.1

Describe the bug
Testing against the latest Apache Spark 3.1 SNAPSHOT the CastOpSuite fails like this:
CastOpSuite:
- Test all supported casts with in-range values *** FAILED ***
  Cast from FloatType to IntegerType failed; ansi=true org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 1505.0 failed 1 times, most recent failure: Lost task 0.0 in stage 1505.0 (TID 1518) (<IP_ADDRESS> executor driver): java.lang.ArithmeticException: Casting 2.14748365E9 to int causes overflow
  	at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage1.processNext(Unknown Source)
  	at org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43)
  	at org.apache.spark.sql.execution.WholeStageCodegenExec$$anon$1.hasNext(WholeStageCodegenExec.scala:755)
  	at scala.collection.Iterator$$anon$10.hasNext(Iterator.scala:458)
  	at scala.collection.Iterator$$anon$10.hasNext(Iterator.scala:458)
  	at org.apache.spark.util.random.SamplingUtils$.reservoirSampleAndCount(SamplingUtils.scala:41)
  	at org.apache.spark.RangePartitioner$.$anonfun$sketch$1(Partitioner.scala:306)
  	at org.apache.spark.RangePartitioner$.$anonfun$sketch$1$adapted(Partitioner.scala:304)
  	at org.apache.spark.rdd.RDD.$anonfun$mapPartitionsWithIndex$2(RDD.scala:915)
  	at org.apache.spark.rdd.RDD.$anonfun$mapPartitionsWithIndex$2$adapted(RDD.scala:915)
  	at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
  	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
  	at org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
  	at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
  	at org.apache.spark.scheduler.Task.run(Task.scala:131)
  	at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
  	at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
  	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
  	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  	at java.lang.Thread.run(Thread.java:748)

  Driver stacktrace: (CastOpSuite.scala:103)

AnsiCastOpSuite has a similar failure.
Steps/Code to reproduce bug
Build and install latest Apache Spark 3.1.0-SNAPSHOT and run plugin unit tests against Spark 3.1.0 via:
mvn -Pspark310tests test

This is caused by this change in 3.1.0: https://github.com/apache/spark/pull/30585
When converting from float to int in 3.0.1, the generated Spark code checks for values in this range (pseudo-code):
Math.floor(Int.MinValue.toFloat) to Math.ceil(Int.MaxValue.toFloat)

In 3.1.0 it checks for this range instead:
Math.floor(Int.MinValue) to Math.ceil(Int.MaxValue)

This breaks our tests that try to cast Int.MaxValue.toFloat to Int because Int.MaxValue.toFloat is not less than or equal to Math.ceil(Int.MaxValue).

The tests were re-enabled in https://github.com/NVIDIA/spark-rapids/pull/1402
The remaining work for this issue is to add documentation about the supported ranges of floats that can be bast to integer and these ranges are different depending on the Spark version so we may want to add a config around this as well.


tidb_query: fix read empty value for the clustered primary key column in the secondary index when collation is latin1_bin

What problem does this PR solve?
Issue Number: close https://github.com/pingcap/tidb/issues/24548
Problem Summary:
Latin1Bin didn't be  judged as Bin collation
What is changed and how it works?
What's Changed:
Latin1Bin should be judged as Bin collation
Related changes

Need to cherry-pick to the release branch 5.0

Check List
Tests

Unit test

Side effects

n/a

Release note

Fix read empty value for the clustered primary key column in the secondary index when collation is latin1_bin.

/label need-cherry-pick-5.0

/label needs-cherry-pick-5.0

/label sig/coprocessor

/cc @wjhuang2016 @lzmhhh123

/sig coprocessor

/cc @wjhuang2016 @lzmhhh123

/run-test

/cc @wjhuang2016 @lzmhhh123

/lgtm

/merge

/run-all-tests

@zhongzc @sticnarf please help merge~ thx 😄

/merge

/merge cancel

/run-all-tests

/run-all-tests

/test

@sticnarf  please help merge again
(sorry, "at" in the wrong tab https://github.com/pingcap/tidb/pull/24680#issuecomment-844717737.... orz...

@sticnarf please help merge again
(sorry, "at" in the wrong tab pingcap/tidb#24680 (comment).... orz...

GitHub says the branch is out-of-date with the base branch. It looks you need to rebase master again...

/run-all-tests

/run-all-tests

@sticnarf rebase PTAL thx~

hi  @zhongzc  @sticnarf  please help merge thx...

/run-all-tests

/merge

/test


Where did you learn all these techniques?

I would love to read/watch about rendering 2d graphics like this. Where can I find explanation, maybe example about it? I have been looking for it so many times. Could not find any thought (only nvidia paper, where is written what is a path and why we should use it).

The anti-aliasing is inspired by the recent signed distance field rendering
stuff, and this old article from graphics gems 2:
https://developer.nvidia.com/gpugems/GPUGems2/gpugems2_chapter22.html
I have picked up most of the curve handling from the sources of libart,
anti-grain geometry, and pomax's bezier primer:
https://pomax.github.io/bezierinfo/
I hope that helps!
On Mon, Dec 24, 2018 at 4:23 PM Eklaron<EMAIL_ADDRESS>wrote:

I would love to read/watch about rendering 2d graphics like this. Where
can I find explanation, maybe example about it? I have been looking for it
so many times. Could not find any thought (only nvidia paper, where is
written what is a path and why we should use it).
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/memononen/nanovg/issues/518, or mute the thread
https://github.com/notifications/unsubscribe-auth/AFAbyEWLGvB-pgAlNNJpybasBN9czPjlks5u8ONXgaJpZM4ZgfHM
.


DynamoDB Session Type

Allow DynamoDB as a session storage type.

This issue was moved to mcrowson/flask-session#3


ROCm 4.2.0 and update to centos-8.4.2105 system panic when GPU or DKMS accessed

We have been running ROCm 4.2.0 on our centos-8.3 system.   Early this month, through the normal yum update chain, centos-8.4 was installed on our system.
Everything worked great until we tried to use the GPU -- the kernel crashes, and the GPU appears unresponsive.  The
centos-8.3 kernel version was  4.18.0-240.22.1, and the centos-8.4 version is 4.18.0-305.3.1
Debugging this, I noticed that the ROCm tools (rocminfo, clinfo)  would be unable to map some memory pages, which
is likely why it couldn't access the gpu
amdgpu: init_user_pages: Failed to get user pages: -1
Further examination revealed that accessing DKMS, just to find it's status, was crashing the machine
dkms status

I rebooted with the prior kernel, to verify that the GPU was working correctly.   With the older kernel, both rocminfo and
clinfo worked correctly, and 'dkms status'  showed
amdgpu, 4.2-21.el7, 4.18.0-240.22.1.el8_3.x86_64, x86_64: installed (original_module exists)
We also ran some of our GPU binaries, and they worked correctly and did not crash the system either.
Initially we installed rocm-4.1, following the instructions at that time.  rocm-4.2 was installed via yum update,
as were the kernels and os update.   I believe the new kernel to be the first updated kernel after rocm-4.2
was installed, that is what a rough browse of the dnf logs shows w/out actual analysis of packages and
timestamps.
Is centos-8.4 supported by ROCm?  Does it require a re-install or ???

Hi @bigtrak
Thanks for reaching out.
I certainly understood your problem, I am happy to help you.
ROCm does not support CentOS 8.4 right now and so the specific kernel does not work with ROCm and hence crashes and etc.
As you did yum update, it tried to OS upgrade/update along with rocm upgrade from 4.1 to 4.2, which is true.
But as we do not support CentOS 8.4 officially yet, things might/do not work, which is expected.
ROCm currently supports CentOS 8.3.
Hope this helps.
Thank you.


[feat] Backport rpm packaging to v1.x branch

Describe the problem
RPM packaging would be really useful for deploying to CentOS / RHEL / Rocky / etc machines, however Tauri v2 doesn't support CentOS due to libsoup3 and libwebkit-4.1 requirements.
Describe the solution you'd like
Could we backport the RPM bundling to the v1.x branch?
Alternatives considered
No response
Additional context
No response

Could we backport the RPM bundling to the v1.x branch?

"We" as-in us tauri maintainers? No, we don't have time for that tbh. "We" as-in the community? Sure! We still try to review v1 PRs. I can't give any 100% guarantees for larger features though.

I would be very happy to backport it, but I guess I would need a maintainer who was interested in reviewing it / thought it was a good idea. My previous backport PR hasn't seen much progress (https://github.com/tauri-apps/tauri/pull/8334).

My previous backport PR hasn't seen much progress (https://github.com/tauri-apps/tauri/pull/8334).

hmm, that may have been my bad :/ Still not used to being in a position where it's alright for me to merge feature prs in this repo 🙃

Here is my backport. It appears to be working for me https://github.com/tauri-apps/tauri/pull/9809

I'm on the road over the weekend so I'll take a look Monday or Tuesday, thanks.
It may be delayed a bit because I want to investigate why CI freezes for 10 minutes when building the rpm.


custom environment variable not working on MacOS

I strictly followed the steps in the document to show a temporary environment variable in my app:
REACT_APP_SECRET_CODE=abcdef npm start
However, the value of REACT_APP_SECRET_CODE does not come .

How are you attempting to use the value.  It should appear in your code as process.env. REACT_APP_SECRET_CODE.  Please be careful though, you shouldn't be putting secret codes in your react app environment.  These will be visible to anyone who loads the app because they are compiled into the client of your application, not your server.

You are reading instructions on master. The section you were reading has a note:

Note: this feature is available with<EMAIL_ADDRESS>and higher.

This is not the version you are using because 0.3.0 is not released yet. Please wait for it to be released (I'd say a week or two) and then you can use this feature.

Clarified in f1b6168a6b758701efd680d3c99e0bf127a2ee1d.

0.2.3 is released and contains this.

I'm using 0.2.2.
so yes, you are right. Thanks


I got the low performance  and why?

here is my reproduce results  from validation (3769)
car detction mAP:
easy:0.441929
middle:0.444228
hard:0.392186
car detction 3d mAP:
easy:0.162886
middle:0.152431
hard:0.136463
car detction ground mAP:
easy:0.584909
middle:0.560683
hard:0.504581
car detction orientation mAP:
easy:0.196919
middle:0.194511
hard:0.172525


make dp package

Hi,
When I was git cloning the dp  package, I met with the following issues, it seems that I cannot access the repository.
"Cloning into 'dp'...
Warning: Permanently added 'github.com,<IP_ADDRESS>' (RSA) to the list of known hosts.
Permission denied (publickey).
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists."

clone with https instead of git, or add ssh keys to your github account.


python312Packages.rmsd: 1.6.1 -> 1.6.2

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for python312Packages.rmsd is: Calculate root-mean-square deviation (RMSD) between two sets of cartesian coordinates
meta.homepage for python312Packages.rmsd is: https://github.com/charnley/rmsd
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes
Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 1.6.2 with grep in /nix/store/qkg5j5fwn4bl1hx168qnf3dwhmjbkkrj-python3.12-rmsd-1.6.2
found 1.6.2 in filename of file in /nix/store/qkg5j5fwn4bl1hx168qnf3dwhmjbkkrj-python3.12-rmsd-1.6.2

Rebuild report (if merged into master) (click to expand)

3 total rebuild path(s)

3 package rebuild(s)

First fifty rebuilds by attrpath

python312Packages.rmsd
python313Packages.rmsd

Instructions to test this update (click to expand)

Either download from the cache:
nix-store -r /nix/store/qkg5j5fwn4bl1hx168qnf3dwhmjbkkrj-python3.12-rmsd-1.6.2 \
  --option binary-caches 'https://cache.nixos.org/ https://nixpkgs-update-cache.nix-community.org/' \
  --option trusted-public-keys '
  nixpkgs-update-cache.nix-community.org-1:U8d6wiQecHUPJFSqHN9GSSmNkmdiFW7GW7WNAnHW0SM=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The nixpkgs-update cache is only trusted for this store-path realization.)
For the cached download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A python312Packages.rmsd https://github.com/r-ryantm/nixpkgs/archive/e993bd08a09a891a97393924a0af64738920ba6b.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/e993bd08a09a891a97393924a0af64738920ba6b#python312Packages.rmsd

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/qkg5j5fwn4bl1hx168qnf3dwhmjbkkrj-python3.12-rmsd-1.6.2
ls -la /nix/store/qkg5j5fwn4bl1hx168qnf3dwhmjbkkrj-python3.12-rmsd-1.6.2/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
nixpkgs-review result
Generated using nixpkgs-review.
Command: nixpkgs-review

x86_64-linux

:white_check_mark: 4 packages built:

python312Packages.rmsd
python312Packages.rmsd.dist
python313Packages.rmsd
python313Packages.rmsd.dist

Maintainer pings
cc @sheepforce @markuskowa for testing.

[!TIP]
As a maintainer, if your package is located under pkgs/by-name/*, you can comment @NixOS/nixpkgs-merge-bot merge to automatically merge this update using the nixpkgs-merge-bot.

Add a :+1: reaction to pull requests you find important.

@GrahamcOfBorg eval
@GrahamcOfBorg build python3Packages.rmsd


resource group api

Signed-off-by: Wei Liu<EMAIL_ADDRESS>Related to: #76

/kind enhancement

/lgtm
/approve


[Feature] fair comparison with Deep Learning toolbox Aawedha

The current methods are mature enough to be compared with sota techniques coming from deep learning, we'll add dataio method to construct datasets (some datasets doesn't have independent test sets) suitable for fair comparison by evaluating the methods on the same fold split generated by Aawedha (deep learning python toolbox).

SSVEP dataset:

[ ] San Diego
[ ] Tsinghua


read_gbq fails with ValueError when a column is of type TIME

I believe that the smallest example to reproduce this is by running:
from pandas_gbq import read_gbq

read_gbq('select current_time()')

the traceback is:
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/german/Documents/c4v/infra-tools/probe-analyzer/env/lib/python3.6/site-packages/pandas_gbq/gbq.py", line 967, in read_gbq
    progress_bar_type=progress_bar_type,
  File "/home/german/Documents/c4v/infra-tools/probe-analyzer/env/lib/python3.6/site-packages/pandas_gbq/gbq.py", line 532, in run_query
    progress_bar_type=progress_bar_type,
  File "/home/german/Documents/c4v/infra-tools/probe-analyzer/env/lib/python3.6/site-packages/pandas_gbq/gbq.py", line 562, in _download_results
    progress_bar_type=progress_bar_type,
  File "/home/german/Documents/c4v/infra-tools/probe-analyzer/env/lib/python3.6/site-packages/google/cloud/bigquery/table.py", line 1776, in to_dataframe
    for frame in self.to_dataframe_iterable(dtypes=dtypes):
  File "/home/german/Documents/c4v/infra-tools/probe-analyzer/env/lib/python3.6/site-packages/google/cloud/bigquery/table.py", line 1439, in _to_page_iterable
    for item in tabledata_list_download():
  File "/home/german/Documents/c4v/infra-tools/probe-analyzer/env/lib/python3.6/site-packages/google/cloud/bigquery/_pandas_helpers.py", line 565, in download_dataframe_tabledata_list
    yield _tabledata_list_page_to_dataframe(page, column_names, dtypes)
  File "/home/german/Documents/c4v/infra-tools/probe-analyzer/env/lib/python3.6/site-packages/google/cloud/bigquery/_pandas_helpers.py", line 539, in _tabledata_list_page_to_dataframe
    columns[column_name] = pandas.Series(page._columns[column_index], dtype=dtype)
  File "/home/german/Documents/c4v/infra-tools/probe-analyzer/env/lib/python3.6/site-packages/pandas/core/series.py", line 327, in __init__
    data = sanitize_array(data, index, dtype, copy, raise_cast_failure=True)
  File "/home/german/Documents/c4v/infra-tools/probe-analyzer/env/lib/python3.6/site-packages/pandas/core/construction.py", line 447, in sanitize_array
    subarr = _try_cast(data, dtype, copy, raise_cast_failure)
  File "/home/german/Documents/c4v/infra-tools/probe-analyzer/env/lib/python3.6/site-packages/pandas/core/construction.py", line 568, in _try_cast
    subarr = construct_1d_ndarray_preserving_na(subarr, dtype, copy=copy)
  File "/home/german/Documents/c4v/infra-tools/probe-analyzer/env/lib/python3.6/site-packages/pandas/core/dtypes/cast.py", line 1618, in construct_1d_ndarray_preserving_na
    subarr = np.array(values, dtype=dtype, copy=copy)

I believe that changing the mapping between the TIME data-type and its dtype to object can fix the issue:
https://github.com/pydata/pandas-gbq/blob/d251db03b159447331ac9ae63e13d295d75bad70/pandas_gbq/gbq.py#L698-L710
... but haven't tried yet and I have never collaborated to this repository before.
Any other idea to solve this issue?

My intuition for using object instead of datetime64[ns] is because the Google BigQuery client returns object when calling to_dataframe:
>>> df = client.query('select current_time()').result().to_dataframe()
>>> df
               f0_
0  20:50:30.587672
>>> df.dtypes
f0_    object
dtype: object

I believe to_dataframe takes a dtypes dictionary. Can we check if it's able to use this?
P.S. I wonder if this started failing recently or if it was always the case that TIME columns were not supported?

Oh, and thanks for the reproducible test case!

I believe to_dataframe takes a dtypes dictionary. Can we check if it's able to use this?

Indeed it does, and that triggers the same error if one uses the following dtypes:
{
  "col_name": "datetime64[ns]"
}

I could try to make a PR to fix this if you don't mind!

Thanks for checking. Yes, a PR would be very welcome.

I'm having a bit of a hard time reproducing, but it does appear from the code that this error would occur. Not sure why it isn't failing in my case. Maybe it depends on google-cloud-bigquery version? I have
$ conda list | grep bigquery
google-cloud-bigquery     2.1.0              pyhc8dfbb8_0    conda-forge
google-cloud-bigquery-core 2.1.0              pyhc8dfbb8_0    conda-forge
google-cloud-bigquery-storage 2.0.0                    pypi_0    pypi
google-cloud-bigquery-storage-core 2.0.0              pyh9f0ad1d_1    conda-forge

I just stepped through the code, and https://github.com/googleapis/python-bigquery/blob/0c387dadd57fba9cdbfd39abe530de209943db9a/google/cloud/bigquery/table.py#L1721 isn't failing on my machine, but it's also not trying to convert from object to datetime64[ns] despite being passed that as a dtype.


Add transparent strip to avoid hoist edge being hidden within flagpole

I've noticed that the flag gets slightly truncated at the hoist, presumably because the flag is treated as being affixed directly to the axis of the flagpole and so some of it is effectively hidden within the flagpole; this is more noticeable with some flag designs. To compensate for this I suggest that FlagWaver adds a transparent strip or a white strip or both to the hoist edge of the flag image. In addition to solving the issue of part of the flag being lost, an added transparent strip would more realistically simulate the appearance of a flag hoisted by ropes, while an added white strip would simulate hoist tape.
Mockups:

transparent strip

white strip

both

This does look nice. I'm not sure if it's feasible to modify user defined images like that but definitely worth looking into.

I think an approach might be to create respectively transparent and white images of the appropriate size and combine these with the user's image to give a new image to be used for the flag. This Stack Overflow question discusses combining images in JavaScript.

The top comment is using a canvas based solution, which is what I had in mind anyway, neat.


fix(default-theme): Naming Convention of SwButton in SwSuggestSearch Component

Changes
closes #1478
Checklist

[x] the list of features is updated (if it's a feature and it's relevant)
[x] I followed contributing guidelines

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.0 out of 3 committers have signed the CLA.:x: Louis Eiermann:x: niklaswolf:x: LouisEiermannLouis Eiermann seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


Flaky test: TestSuccessfulDownload (on experimental)

Seen this failing a few times today on experimental, so opening an issue; for example; https://jenkins.dockerproject.org/job/Docker-PRs-experimental/13344/console
23:52:11 ok  	github.com/docker/docker/distribution/metadata	0.007s	coverage: 86.7% of statements
23:52:23 time="2016-01-08T23:52:12Z" level=error msg="Download failed, retrying: simulating retry"
23:52:23 --- FAIL: TestSuccessfulDownload (5.23s)
23:52:23 	download_test.go:300: missing or wrong progress output for id3 (got: 9)
23:52:23 time="2016-01-08T23:52:18Z" level=error msg="Upload failed, retrying: simulating retry"
23:52:23 FAIL
23:52:23 coverage: 85.2% of statements
23:52:23 FAIL	github.com/docker/docker/distribution/xfer	11.426s

If you are reporting a new issue, make sure that we do not have any duplicates already open. You can ensure this by searching the issue list for this repository. If there is a duplicate, please close your issue and add a comment to the existing issue instead.
If you suspect your issue is a bug, please edit your issue description to include the BUG REPORT INFORMATION shown below. If you fail to provide this information within 7 days, we cannot debug your issue and will close it. We will, however, reopen it if you later provide the information.
For more information about reporting issues, see CONTRIBUTING.md.
You don't have to include this information if this is a feature request
(This is an automated, informational response)

BUG REPORT INFORMATION
Use the commands below to provide key information from your environment:
docker version:
docker info:
Provide additional environment details (AWS, VirtualBox, physical, etc.):
List the steps to reproduce the issue:
1.
2.
3.
Describe the results you received:
Describe the results you expected:
Provide additional info you think is important:
----------END REPORT ---------
#ENEEDMOREINFO

Could also be a valid error, but opening an issue just in case :smile:

Yes, there's some raciness that this test exposes. I spent some time looking at it but haven't found the problem yet. I'll continue working on it.


Pipeline engine fails to start up

Installed Pipeline app 1.3.0 for my mac running Sonoma 14.4.1. I notice that the installer is not signed and is from an unidentified developer. I authorize the installer via System settings / Privacy and security and the new version appears to install OK.
I launch Pipeline but it never gets beyond "Starting the engine". I rebooted and no change.

Thanks for the report. What I'm finding is that the original file works locally without complaints, but as soon as I upload it to somewhere (github, dropbox) and download it and run it, I get the same error as you. I don't know if something changed in the mac universe that would affect this process - we are creating the package file installer like we have in the past, via Apple's signing + notarization with our team account. So it is indeed signed and from an identified developer, even though it's complaining that it's not. We will have to investigate this further.
@bertfrees @rdeltour @NPavie can you try it out from our official release page? And note here which macOS you have. I have the same as @ways2read, Sonoma 14.4.1.
I am not sure about the problem starting the engine. That doesn't happen for me even after authorizing the installer and starting the app.

Hi,
When I installed on Windows, I too had to select more and say OK to the unsigned software.
Best
George

syspolicy_check distribution  daisy-pipeline-1.3.0-mac.pkg
App has failed one or more pre-distribution checks.
---------------------------------------------------------------
Codesign Error
    Severity: Fatal
    Full Error: File is not signed at all.
    Type: Notary Error

Notary Ticket Missing
    Severity: Fatal
    Full Error: A Notarization ticket is not stapled to this application.
    Type: Distribution Error

spctl -a -vvv -t open --context context:primary-signature  daisy-pipeline-1.3.0-mac.pkg
spctl -a -vvv -t install daisy-pipeline-1.3.0-mac.pkg
==>
daisy-pipeline-1.3.0-mac.pkg: rejected
source=no usable signature

xattr -l daisy-pipeline-1.3.0-mac.pkg
==>
com.apple.quarantine
To remove the quarantine flag and install the PKG:
xattr -dr com.apple.quarantine daisy-pipeline-1.3.0-mac.pkg

syspolicy_check distribution DAISY\ Pipeline.app
==>
App passed all pre-distribution checks and is ready for distribution.

spctl -a -vvv -t open --context context:primary-signature  DAISY\ Pipeline.app
spctl -a -vvv -t install  DAISY\ Pipeline.app
==>
DAISY Pipeline.app: accepted
source=Notarized Developer ID
origin=Developer ID Application: US Fund for DAISY (SAMG8AWD69)

Interesting, thanks @danielweck - so the app is signed but the pkg is not?

I'm running Sonoma 14.4.1 (23E224), MacBookPro Intel Core i5 (I mention the architecture because I had AppleSilicon-specific code-signing / notarization issues for an Electron app that didn't have some hardened entitlements. I don't think that's your problem here. The APP is code-signed and notarized but not the PKG installer, it seems.

We use electron to create installers and it appears that it does not support notarizing pkg files, although I did not see any complaints for our previous release which used pkg (first appeared in Pipeline v 1.2.7; before that, we used dmg).
https://github.com/electron/notarize/issues/60

https://github.com/daisy/pipeline-ui/blob/4bd804df313390476b4b47b1a0c4dcee4e89ce0a/electron-builder.js#L26
Maybe add "sign": true here?

https://github.com/daisy/pipeline-ui/blob/4bd804df313390476b4b47b1a0c4dcee4e89ce0a/electron-builder.js#L26
Maybe add "sign": true here?

 configuration.pkg has an unknown property 'sign'. These properties are valid:
   object { allowAnywhere?, allowCurrentUserHome?, allowRootDirectory?, artifactName?, background?, conclusion?, hasStrictIdentifier?, identity?, installLocation?, isRelocatable?, isVersionChecked?, license?, mustClose?, overwriteAction?, productbuild?, publish?, scripts?, welcome? }

https://github.com/daisy/pipeline-ui/blob/4bd804df313390476b4b47b1a0c4dcee4e89ce0a/electron-builder.js#L19
Maybe add entitlements here?
"entitlements": "./entitlements.mac.plist",
"entitlementsInherit": "./entitlements.mac.plist"

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
  <dict>
    <key>com.apple.security.cs.allow-jit</key>
    <true/>
  </dict>
</plist>

We may be able to upgrade electron and get support for this built in https://github.com/electron/notarize/pull/169 (it looks like it was made available in 2.3.0)

https://github.com/daisy/pipeline-ui/blob/4bd804df313390476b4b47b1a0c4dcee4e89ce0a/electron-builder.js#L19
Maybe add entitlements here?
"entitlements": "./entitlements.mac.plist",
"entitlementsInherit": "./entitlements.mac.plist"

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
  <dict>
    <key>com.apple.security.cs.allow-jit</key>
    <true/>
  </dict>
</plist>

No luck here either. And that's what our plist file looks like too.

Confirm that this is also an issue with 1.2.7 on mac, that was never reported.
Opened a new issue specifically for pkg installers: https://github.com/daisy/pipeline-ui/issues/224
Other issues in this thread that are unexplored as of now:

engine not starting (could not reproduce)
windows installer reported as unsigned

@ways2read could you check with the latest windows installer if you still have an issue with the engine not starting?

My Windows installations work fine. I just reinstalled the latest mac version and the engine still does not start. :(

I removed my existing Pipeline installation, restarted and reinstalled. The settings were retained so I clearly didn't remove those. Pipeline app is now working as expected.


wrong dataframe size when using map partitions

I have a dask dataframe that is on only one partition.
My problem is when I use map with the tou function, I don't find the shape of my original dataframe.
I know this isn't the intended use of dataframes , but still I think it is worth to mention this issue.
from sklearn.datasets import load_iris
data=dd.from_pandas(pd.DataFrame(load_iris().target[[1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20]]),npartitions=1)
out=data.map_partitions(f)

def f(x):
    print(x.shape)
    return x

I am using the 0.17.5 version .

When you don't specify a meta argument to map_partitions, the function is applied on a small bit of fake data. See http://dask.pydata.org/en/latest/dataframe-api.html#dask.dataframe.DataFrame.map_partitions.
FYI, you might want to skim http://dask.pydata.org/en/latest/dataframe.html#design. As written, f would never print the full shape of your dataframe, since it's applied to each partition, not the entire dask dataframe.


binary_crossentropy label_smoothing cannot compute Mul bug

System information.

Have I written custom code (as opposed to using a stock example script provided in Keras): No
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Windows 10
TensorFlow installed from (source or binary): pip
TensorFlow version (use command below): 2.7.0, but the problem exists in 2.5.0
Python version: 3.8
GPU model and memory: working on CPU

Describe the problem.
I have an error when I set label_smoothing while calculating binary_crossentropy. Message:
tensorflow.python.framework.errors_impl.InvalidArgumentError: cannot compute Mul as input #1(zero-based) was expected to be a double tensor but is a float tensor [Op:Mul]
Standalone code to reproduce the issue.
import numpy as np
import tensorflow as tf
m = tf.keras.metrics.binary_crossentropy(np.ones(5), np.zeros(5), label_smoothing=0.5)

Source code / logs.
Problem is in
  def _smooth_labels():
    return y_true * (1.0 - label_smoothing) + 0.5 * label_smoothing

If label_smoothing either was not a Tensor but a float or a vector of the same dimension as y_true, the code would work.
So a few lines back,
label_smoothing = tf.convert_to_tensor(label_smoothing, dtype=backend.floatx())

change it to
label_smoothing  = tf.fill(y_true.shape, label_smoothing)

@jvishnuvardhan Was able to reproduce the issue on Colab using 2.5,2.6 and tf-nightly, Please find the gist here for reference.Thanks!


Admin: config for all_models from iommi_admin.py in apps don't apply

I tried adding
class Meta:
    # [...]
    parts__all_models__parts__extra = html.h1(
        'asdasd',
        after=0,
    )

but that conf never gets to Admin.all_models

Adding the conf on my Admin subclass doesn't seem to do it either...


Tests are reported twice - once for .ts and once for .js file

I am new to Jest and relatively new to TypeScript and have setup my ts-jest by following this guide.
My first test file looks like this:
    describe("It works", () => {
        it("is true", () => {
            expect(2).toBeTruthy();
        });
    });

When I run the test script from my package.json the output is as follows:
 PASS  dist\common\__tests__\sample.jest.test.js
 PASS  src\common\__tests__\sample.jest.test.ts

Test Suites: 2 passed, 2 total
Tests:       2 passed, 2 total
Snapshots:   0 total
Time:        1.767s, estimated 2s
Ran all test suites.

My tsconfig.json looks like this:
{
    "compilerOptions": {
        "outDir": "./dist/",
        "sourceMap": true,
        "noImplicitAny": true,
        "module": "commonjs",
        "target": "es6",
        "jsx": "react"
    },
    "include": [
        "./src/**/*"
    ],
    "lib": [
        "dom", "es6", "dom.iterable", "scripthost", "ES2015.Iterable", "ES2015.Promise"
    ]
}

The jest section of my package.json looks like this:
  "jest": {
    "moduleFileExtensions": [
      "ts",
      "tsx",
      "js"
    ],
    "transform": {
      "\\.(ts|tsx)$": "./node_modules/ts-jest/preprocessor.js"
    },
    "testRegex": "/__tests__/.*\\.(ts|tsx|js)$"
  },

The versions in use are:
TypeScript 2.1.5
ts-jest 18.0.2
jest 18.1.0
node  6.9.1
Is this expected behaviour?
It would be manageable for when all the tests pass, but failures are also reported twice: once for the original .ts and once for the transpiled .js.
Am I doing something wrong?

@sykesd can you create a minimal repo that reproduces this issue?

@kulshekhar in trying to prepare a minimal repo I discovered the cause and from there was able to find a solution. I am using WebStorm, which uses the TypeScript Language Service to transpile the source files. It is placing the resulting .js files into the ./dist directory, as specified in the tsconfig.json file.
Using the testPathDirs option of jest to restrict the search for test files to only my src directory fixed the problem.


[Bug] modal class causing issues

Issue:
While going through this video "Using AWS Amplify Studio Components Locally" [https://amplify.aws/learn/courses/Fullstack-for-Frontend-Developers-e7319/lessons/8] and utilizing the code provided in the tutorial the app complies successfully but the display on the web browser is blank. I narrowed it down to adding the modal className for UpdateNote and CreateNote. This could also be operator error. Any ideas on how to resolve this issue would be greatly appreciated.

Do you have errors in the browser console?


libcups uses deprecated/private Security.framework APIs

I submitted App for Mac App Store review and had got the following reply:

Symbols: _SecCertificateIsValid, _cssmErrorString, _SecCertificateCreateWithBytes, _SecCertificateNotValidAfter
From framework: /System/Library/Frameworks/Security.framework/Versions/A/Security
In binary: Contents/Frameworks/QUtil.framework/Versions/A/Resources/libcups.dylib
The use of non-public APIs is not permitted on the App Store, because it can lead to a poor user experience should these APIs change.
Next Steps:
If you are using third-party libraries, please update to the most recent version of those libraries. If you do not have access to the libraries' source, you may be able to search the compiled binary using the "strings" or "otool" command line tools. The "strings" tool can output a list of the methods that the library calls and "otool -ov" will output the Objective-C class structures and their defined methods. These tools can help you narrow down where the problematic code resides.
Continuing to use or conceal non-public APIs in future submissions of this app may result in the termination of your Apple Developer account, as well as removal of all associated apps from the App Store.

Any plans to remove these instances?

Instead of _SecCertificateCreateWithBytes we can use SecCertificateCreateWithData.
And instead of _SecCertificateIsValid and _SecCertificateNotValidAfter we can query the certificate with kSecOIDInvalidityDate and kSecOIDX509V1ValidityNotAfter.
Not sure about _cssmErrorString.
But I am still not sure that are there more instances of non-public APIs in cups library?

@vkhorana You should be using the macOS libcups and not your own compiled version of libcups.

I want to use pstops, but in sandboxed environment I am not able to use it. Thats why I bundled it.

Well, you can just bundle pstops and not all of the CUPS libraries - that will eliminate the direct references to those symbols while giving you access to pstops.

@michaelrsweet  thank you so much. we will try that. and get back to you incase of any issues.

OK, we are revisiting this after reviewing the code in question. I can't say we'll have all of the private APIs eliminated in 2.3.x, but I've been able to clean out usage of cssmErrorString and switch to SecCertificateCreateWithData. I'll need to do more testing to see if we can eliminate the other calls.

kSecOIDInvalidityDate and kSecOIDX509V1ValidityNotAfter are not available on iOS... :/
Continuing my investigations...

Near as I can tell right now, we can't move off SecCertificateIsValid or SecCertificateNotValidAfter since iOS does not allow any certificate introspection... :/ It is possible that in the future we can move to using SecTrustEvaluate(), however that will require some significant changes that I am not comfortable with...

@michaelrsweet thanks for your efforts. We started bundling libcups because when I tried to build pstops then the libcups.dylib was also created in the build folder and I thought that pstops might be referencing this dylib. If that's not the case then we can try to bundle pstops only.

@michaelrsweet my app again got rejected. this time i only bundled pstops. and here is the comment i got:
Symbols: __cups_strcasecmp, __cupsLangPrintError, __cupsLangPrintf, __cupsLangPrintFilter
From framework: /usr/lib/libcups.dylib
In binary: Contents/Frameworks/QUtil.framework/Versions/A/Resources/pstops
The use of non-public APIs is not permitted on the App Store, because it can lead to a poor user experience should these APIs change.
We are constantly reevaluating and identifying non-public APIs that you may have been using for an extended period of time. You should always use public APIs and frameworks and ensure they are up-to-date to prevent this issue in the future.

pstops-standalone.tar.gz
Here is a version of the pstops sources that doesn't link against the CUPS string/localization functions.

@michaelrsweet i did changes locally and submitted a build again. I also removed the localized instances because these were mostly error logging functions. Shall I send you changed files for review?

@vkhorana No, that isn't necessary. I just wanted to make sure you would be able to submit without those issues.

@michaelrsweet thanks you so much for ur prompt action. Really appreciate!
😊

@michaelrsweet We had an iOS app approved 2 months ago that was based on Cups 2.1.2 with only SecCertificateCreateWithData used to replace SecCertificateCreateWithBytes (but no other changes to tls-darwin.c).    Last night we had our newer app (based on CUPS 2.2.4) rejected with the following private symbols quoted:  _SecCertificateCreateWithBytes, _SecCertificateIsValid, _SecCertificateNotValidAfter, _SecGenerateSelfSignedCertificate, _SecIdentityCreate, _kSecCSRBasicContraintsPathLen, _kSecCertificateKeyUsage, _kSecOidCommonName, _kSecOidOrganization, _kSecSubjectAltName.   The person who updated the CUPS library (2.1.2 -> 2.2.4) wasn't aware of this issue which is why we were flagged for _SecCertificateCreateWithBytes again.    Some of those 10 symbols were in 2.1.2 in an app that was approved 2 months ago.   Did the scanning logic in the approval process change recently?    If you can't get all of the private APIs out of CUPS for the 2.3 release, will the position be that we can't use the CUPS distribution in iOS apps?  Thanks for any additional feedback you might have.

@IthacaRonD I'm not able to say whether or why things have changed WRT iOS application screening. I do know that the SecureTransport APIs are slowly being deprecated, so perhaps that is the cause...
As for how to use CUPS on iOS, keep in mind that libcups.2.dylib has been distributed with iOS since iOS 8, so you should be able to just use the open source headers with the shipped libcups.

@michaelrsweet Thanks for the quick reply!   At one point in the history of this app we needed to make a small tweak in the cups code to ensure we'd work with all the printers we wanted to work with, but I believe we no longer need to and would welcome being able to take advantage of what is already in iOS.   I'll certainly investigate.   Thanks again!

@michaelrsweet One quick followup.   I've made the switch to utilizing the built in CUPS.  I took the public headers from the 2.2.11 distribution and made a Xcode project for CUPS that is embedded in my main Xcode Workspace for our product.    The public headers have been added to that embedded project file and this allows me to access CUPS from both Objective-C and Swift.   Only problem is that the public headers say that CUPS is only available in iOS 11 and later and that is enforced with the use of @available macros.   I removed the @available macros and confirmed that the app crashes on iOS 10.    Is there any way to access built-in CUPS on iOS 10?    Thanks again!

@IthacaRonD OK, I did some more digging and it looks like the libcups.2.dylib file wasn't included until iOS 11 (previous to that we linked it statically into another framework). How far back do you need to support?

@michaelrsweet We need to support back to iOS 10 for now.   In future releases (after iOS 13 is out) we will probably only support back to iOS 11 at which point your previous suggestion will work.  But the release we are trying to get out now still needs to support iOS 10.   While it is easy to substitute SecCertificateCreateWithData for SecCertificateCreateWithBytes, and I could, in theory, just hard-code the constants (assuming they aren't going to change between now and our next release in the fall), are there any substitution patterns for the remaining 4 API calls (_SecCertificateIsValid, _SecCertificateNotValidAfter, _SecGenerateSelfSignedCertificate, _SecIdentityCreate) with Public APIs?  Thanks again for your time, very much appreciate it!

@IthacaRonD I'm playing around with a potential solution now - basically use the IPP stack in libcups but use NSURLSession to actually send the IPP request and parse the response. That will avoid the problematic bits of libcups, but there might be issues with the self-signed certificates used for IPPS with most printer (we'll see...)
Tracking with Issue #5607...

@michaelrsweet Thanks for taking the time to look into this.   For the immediate release I've run a bunch of workflows through our code with breakpoints at the problematic parts of CUPS and have discovered that we do not appear to utilize CUPS in a way that triggered the breakpoints.   For now now, I've commented out the private symbols (after replacing SecCertificateCreateWithBytes with SecCeftificateCreateWithData) and all seems to be working.   I'd obviously love to have a much cleaner solution!   I'll use the new Issue that you opened for any further communication.  Thanks again!


Aggregate functions: non-numeric columns

It would be useful to see min/max/median values for a column that contains text or datetime values.
Many thanks

Makes sense.
Although I'm curious about text values median. I can calculate it but what is it supposed to mean?

Its the most frequently occurring value. If every single value is different, then I guess you could take the min - or leave blank.
I was hoping that aggregates could give a sense of the distribution of the data values, even for text and dates etc

@someotherdataguy  you've mixed up the mode & the median.
https://www.mathsisfun.com/definitions/mode.html
https://www.mathsisfun.com/definitions/median.html

You are right, I have. The mode would be the most useful I think. I can't think of a use for a text "median".

I've added both median and mode. Check them in the next version.

Its excellent and super useful.
Thank you so much.


Fixed Runtime error in examples/cosmwasm/zero-to-hero contract caused by lambda nesting issue reported in issue #1042

Thanks for the contribution :)
This targets #1042 (to get the backlink).


Where do I put the data files for the course?

The code bits, such as in this exercise use files that I created ahead of time with datasets. I don't see these files anywhere in the repo right now. Where do I put them? How will they be made accessible when Binder launches?

Hello @flor14! 👋 I now have the repo public and I have started trying to get Binder up and running here. Nothing is happening?!? I don't even have anything in the logs. 😕
What do you think we should try next to get this working?

Hello! 😊
If you have already used binder, you should try to deploy the course with netlify.
The code in the exercises should run after deployment.
Tell me if I can help
Best,
Florencia
Sent from Mail for Windows 10
From: Julia Silge
Sent: sábado, 24 de agosto de 2019 12:23 a. m.
To: juliasilge/supervised-ML-case-studies-course
Cc: flor14; Mention
Subject: Re: [juliasilge/supervised-ML-case-studies-course] Where do I put thedata files for the course? (#3)
Hello @flor14! 👋 I now have the repo public and I have started trying to get Binder up and running here. Nothing is happening?!? I don't even have anything in the logs. 😕
What do you think we should try next to get this working?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

OK, I think it is ✨ actually working ✨.
https://supervised-ml-course.netlify.com/
It looks to me like the exercises are running! So the next step is for both of us to do a final check that the exercises are running as expected, I believe?

🎉 Great news!!!! 🥳
Yes, final step! I will have a look and tell you.
I like all the emojis you added to the course 👍
Best
Florencia
Sent from Mail for Windows 10
From: Julia Silge
Sent: sábado, 24 de agosto de 2019 1:57 p. m.
To: juliasilge/supervised-ML-case-studies-course
Cc: flor14; Mention
Subject: Re: [juliasilge/supervised-ML-case-studies-course] Where do I put thedata files for the course? (#3)
OK, I think it is ✨ actually working ✨.
https://supervised-ml-course.netlify.com/
It looks to me like the exercises are running! So the next step is for both of us to do a final check that the exercises are running as expected, I believe?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.