Enhance database structure for many-to-many relations with additional fields

Is your feature request related to a problem? Please describe.
I am new to Prisma, so it might be already done, or maybe even not feasible to achieve it, but here is the idea:)
Currently Prisma handles many-to-many relations without additional fields very well. Say we have:
type A {
  id: ID! @unique
  as: [B!]!
}
type B {
  id: ID! @unique
  bs: [A!]!
}

Then after prisma deploy we have three tables in the DB: A, B and _AToB. Perfect.
But if we want a many-to-many relation with extra fields, it seems that the only way is to use a intermediate type:
type A {
  id: ID! @unique
  abs: [AB!]!
}
type B {
  id: ID! @unique
  abs: [AB!]!
}
type AB {
  id: ID! @unique
  a: A!
  b: B!
  moreField: xxx
}

Then in the database we will see five tables: A, B, 'AB', _AtoAB, _BtoAB.
And during queries it has to jump twice A -> _AtoAB -> AB to get the relation, which is relatively slow.
Describe the solution you'd like
In old days for these many-to-many relations with extra info, we just create ONE cross table: AB: {Aid, Bid, extraField1, extraField2, ...}
Is it possible to automatically create such ONE cross table in prisma, so we still have three tables: A, B and AB.?
(I believe this is related to #746)

I also think, 3 tables should be enough and would be much more efficient. Are there any estimates, when this improvement is coming to Prisma?

I need this to happen before I can fully use Prisma.

This is bottlenecking me too, and caused my docker postgres to crash.. spent a day trying to resolve it but felt defeating and makes me weary about the lack of control.

+1, any major backend framework should support this, and indeed they do.


Release 1.2.0-pre0

In this PR
This is the PR for the 1.2.0-pre0 release. See the CHANGELOG.MD file for what's included in this release.

I don't see a submodule change where do the binaries come from ?

I don't see a submodule change where do the binaries come from ?

We don't use a submodule. Instead, we manually copy over the jnILibs and proto from the binaries / protos built from the mobilecoin repo.


Feature request: Help diagnose packages with file collisions

Thanks for nix-tree!  It's great.  I love these tools that take advantage of all the great information available from the Nix packaging system.
One thing I'd really like to use nix-tree for is to help better understand file collisions (in particular, when building Python environments).
From time to time I accidentally build a Python environment that includes two derivations of the same Python package.  Sometimes this is because two upstream versions of the Python package are being included but more often the upstream version is the same and something about the Nix derivation has changed (eg, versions of dependencies).
If I use nix-tree to inspect this situation then I don't learn much because nix-tree convenient chops off the output hash portion of the store object name.  Thus, I see that my Python environment includes "python3.7-autobahn-21.3.1.drv" and "python3.7-autobahn-21.3.1.drv".
It would be great if I could tell these apart in nix-tree.  Perhaps if nix-tree notices there are duplicates after constructing the short versions of the names, it could append the minimum hash prefix necessary to disambiguate?  For example, if one python3.7-autobahn-21.3.1.drv has an output path of /nix/store/z7zhlhp2jqiza7kwa3kdbw7vvd918gyz-python3.7-autobahn-21.3.1 and the other has an output path of /nix/store/z86hmnd5hiyqy4y2p96macy2v6qz84bn-python3.7-autobahn-21.3.1 then they could be displayed in nix-tree as "python3.7-autobahn-21.3.1.drv (z7)" and "python3.7-autobahn-21.3.1.drv (z8)".

I realized I mixed up output hashes and derivation hashes in my suggestion about.  I'm not sure which would be more useful, really, but I guess using the derivation hash rather than the output hash would probably be less surprising.

Hey, thank you!

Perhaps if nix-tree notices there are duplicates after constructing the short versions of the names, it could append the minimum hash prefix necessary to disambiguate?

This sounds like a great idea to me! It indeed sounds confusing if there're two items in the list with the same name without a way to distinguish them. This should be a relatively easy change, the hardest part probably would be to decide on how to show them in a clear way (python3.7-autobahn-21.3.1.drv (z8), ...84bn-python3.7-autobahn-21.3.1).

I guess using the derivation hash rather than the output hash would probably be less surprising.

I think it would be a bit confusing if the hash prefix does not correspond to the exact store path selected. eg. if the store path shown is an output, that should be the path of the output hash; if it is a drv file it should be the derivation hash. I even think even it would be hard to implement it in any other way, as sometimes we do not know the derivation path from an output path or vice versa.

tl;dr:

I like the disambiguation idea, I will implement it.


Add Create Virtual Device Option

It would be really helpful to be able to create a virtual device so that it can be controlled via MQTT.
For example, create a virtual device called Great Room. When Great Room triggers on via MQTT, it turns on 3 physical switches from Node-Red. Once Great Room is turned off, it turns off the same 3 physical switches and triggers another physical switch to turn on under cabinet lights.
Thank you for this awesome utility!!

Hi @Inshakoor, I think this goes a bit off the scope of this project. BTW you could use scheduled jobs for such purposes


Crawling Fails When "Uploads URLs" is Included [v7]

Getting this message only when Uploads URLs is checked in Control Detected URLs settings:
Failed to generate Initial Crawl List. Please check your permissions to the WordPress upload directory or check your Export Log in case of more info.
My Setup:

Vultr VPS [Apache, Nginx, MariaDB]
PHP 7.3
WordPress 5.2.2
Uploads Dir Permissions - 775 checked and reapplied recursively.

I was probably getting the same issue with v6.6.5 as well, but the errors weren't as detailed - it showed the "Analyzing Site..." dialog for the last 14 hours but never allowed me to proceed. Have tested this with selective Controls chosen and with all, with and without Uploads URLs. That's the setting that it's tripping on. Permissions are absolutely set, though.
Not able to include the plugin's debug log as it refuses to create one. Looks like it created wp-content/uploads/wp2static-working-files/ dir just fine. Has the initial crawl list text file inside, populated with 4 lines initially, then with 18k lines with all Controls selected.
Any ideas?

It does generate a full debug log on export errors. Returning posts with BAD RESPONSE STATUS (502). That's a different issue though. It definitely has permissions to write to the uploads dir.

Hi @brysont - could you please try with V7 builds here, it has some better logging built-in, but hopefully will avoid the issue you were facing altogether: https://github.com/WP2Static/wp2static/releases/tag/7.0-alpha-003


Investigate dependent refinements

What would it take to allow dependent refinement in (1) function inputs (2) function outputs (3) let bindings.

For now I came up with something like this, but that's not OK, we want to be able to refine nested types (ie a slice of refined something)
#[hax_lib::define_named_refinement]
fn NamedRefinement(x: u8, limit: usize) -> bool { x < limit }

#[hax_lib::attributes]
fn f(limit: Refine<u8, {x < 50}>, x: Refine<NamedRefinement<limit>>) {}

// WOULD DESUGAR TO:
macro_rules! NamedRefinement {
    (type) => {
        u8
    },
    (refinement, $x:expr, $limit:expr) => {
        $x < $limit
    }
}

#[_hax::refinement(arg 0: limit < 50)]
#[_hax::refinement(arg 1: NamedRefinement!(refinement, limit, x))]
fn f(limit: u8, x: u8) {

}

I think we should still aim at those refinements on specific places. Let's keep this open for now.

I think this is still something we want to chat about


Run workflows in IceCube containers

By default, GitHub Actions workflow run on Ubuntu servers. This means that icetray and other IceCube packages are not available at runtime, and therefore repository code that uses these packages cannot be tested. However, it seems from here to be possible to run jobs in containers such as icecube:icetray. This would be very useful to increase the fraction of code that can be tested automatically.

Closed by #203


Content/docs/tasks/traffic management/egress

Deploy preview for preliminary-istio failed.
Built with commit e4a091ec41b718b082d899de4d2818ef89e08dab
https://app.netlify.com/sites/preliminary-istio/deploys/5b9e6690b3127421e10bf74f


Failed

Failed to resolve : compile 'com.github.kassisdion:ViewPagerWithIndicator:v1.0'

You probably forgot to add jitpack
repositories {
  // ...
  maven { url "https://jitpack.io" }
}


Trigger the docker-registry build

Description
Changes proposed in this pull request:

it will fix some security issues

/retest

/retest

/retest

/test all

/test all

/retest


Hook state should use a scoped thread-local

This would be less error-prone than the current swap/swap approach, as it will ensure that the original state is always correctly restored.
If you choose to use scoped-tls-hkt instead of the typical scoped-tls crate, it will also allow you to:

Avoid the interioir mutability, since you can directly declare a mutable scoped thread-local.
Use lifetimes within the hook state which reference stack objects.

That sounds very interesting. Any chance you could cook up a prototype?

Yep.

I would like to see a prototype of this too. This looks interesting.
If you want to, feel free to base this on top of #1780. I'd be happy to merge it in the branch for that PR

@hamza1311 I'd already implemented this. However, I don't think there should be any conflicts.

@hamza1311 I'd already implemented this. However, I don't think there should be any conflicts.

I merged it and resolved the conflict that occurred.


Userstore is not redeployed when updated from the console

Describe the issue:
When a userstore config is updated via the console, userstore is not reloaded.
How to reproduce:

Add a new userstore and make sure it's loaded
update the userstore from console
Userstore is not loaded to memory and unable to see the relevant logs in the wso2carbon.log.

Expected behavior:
Userstore must be loaded.
Environment

OS: [Mac]
Database: [MySQL]
Userstore: [JDBC]
Product [IS-5.11.0-Beta]

Optional Fields
Related issues:

Might be related to https://github.com/wso2/product-is/issues/9621

This issue is happening due to the tenant not being loaded. If the tenant is loaded then this cannot be seen. Also same issue is reproducible through the management console after the tenant is unloaded. This the same cause for #9621 as well.


Add support for vector CQL data type

Both Astra DB and DSE 7.0 (public preview as of this writing) already supports vector as a CQL data type and OSS C* will soon support the same via CEP-30. CDC source connector should begin supporting this.

On Nov 6, 2023 5.0-alpha2 got released which contains support for vector

and... datastax/dse-server:7.0.0-alpha.2 which also got released 2 days back on Nov 13, 2023.

In AVRO the data type MUST be ARRAY, this is for compatibility of Astra CDC


Clean up use of RFC2119 text in the spec

We're not using MUST, SHOULD, etc. well.

Applied a style to clarify: e0dbaa0ab29f69ad062113d079459a65ea03f2a8, 865e758911a3f9c73cdfe635330f21e8489ab722.

Closing.


Request: Local install or CLI docker image?

Your issue may already be reported!
Please search on the issue tracker before creating one.
Expected Behavior
I'd like a way of using this in a pipeline without hosting it somewhere else. So in the pipeline I'd pull an image and just go gotenberg readme.md -o readme.pdf (for example) and have my markdown file printed to a pdf file.
Current Behavior
Currently, I'd have to host this somewhere and then call that from the pipeline.
Possible Solution
No idea how it's built inside or how go even works, but I suppose you could add something letting it be compiled to an executable.
Context
There are a few current markdown-to-pdf cli tools, but none of those correctly convert every part of a markdown file to pdf (one example being  tags in a heading).
Your Environment
Gitlab Pipelines

Hello @Regenhardt
It's not possible to have a single binary as Gotenberg relies heavily on dependencies like Google Chrome.
I guess you could start the Docker image in you job and then call the localhost URL in order to convert your document.
your_job:
  image: your_base_image
  services:
    - name: gotenberg:6
  variables:
    //TODO
  script:
    - curl --request POST --url http://localhost:3000/convert/markdown --header 'Content-Type: multipart/form-data' --form<EMAIL_ADDRESS>--form<EMAIL_ADDRESS>-o README.pdf

I guess it also depends on how you have configured your GitLab CI.


'Measure' in type 'Spectre.Cli.Internal.Composer' does not have an implementation.

Information

OS: Windows
Version: Spectre.Console: 0.46.0, Spectre.Cli: 0.49.0
Terminal: Windows Terminal

Describe the bug
I'm trying to convert an old project to the newest version. I can execute commands without error but I get the error in the title when I try to display help using --help or -h
Expected behavior
I simply want help to display
Additional context
Using Autofac for DI.

Somewhere in your project you have a reference to a Spectre.Console version lower tham 0.46. Make sure all versions are set to 0.46.

Here are the references from my csproj file...
  <ItemGroup>
    <PackageReference Include="Microsoft.Extensions.Configuration.UserSecrets" Version="7.0.0" />
    <PackageReference Include="Spectre.Cli" Version="0.49.0" />
    <PackageReference Include="Spectre.Console" Version="0.46.0" />
    <PackageReference Include="Spectre.Console.Json" Version="0.46.0" />
  </ItemGroup>

And here are the Spectre assemblies in my bin folder...

Spectre.Cli is deprecated. You should be using version 0.46 of Spectre.Console.Cli.
https://spectreconsole.net/cli/migration

@patriksvensson Removing Spectre.Cli and deleting all my bin and obj folders seemed to fix it. Thank you for the insight.


Added DnD Dashboard Clone code to the repo!

## Description 📜
Changes made: Added a file that contains a Trello/Kanban Dashboard clone in React.js using react-dnd lib.
The issue I opened and fixed: I want to add a simple react project which is a clone of Trello/Kanban board #316
Fixes #316

Type of change 📝

[x] Add a new project

Domain of Contribution 📊

[x] Project using HTML, CSS & JS
[x] Project using ReactJs

Checklist ✅

[x] My changes generates no new warnings.
[x] I'm GSSoC'22 contributor

Screenshots / Gif (Optional) 📸
Screenshots have been added to the Readme file of the DnD-Dashboard Project.

Files are not pushing properly.

No response from contributor side so I'm closing this PR

I will try again, I don't know why files are not being added properly

I'll try again, I don't know why files are not being added properly :(

You can re add here or make a new PR

Because of exams I haven't been able to dedicate time but can I make a new PR when I add files?

@TANYA-CHAN ok make a new PR!! first fetch your branch

Hey, so I created a local fork and added my project to my local fork, please help me push it to the main rep here. I don't want it to be a mess like last time. @gurjeetsinghvirdee

Hey, so I created a local fork and added my project to my local fork, please help me push it to the main rep here. I don't want it to be a mess like last time. @gurjeetsinghvirdee I have created a new PR, added 20 files once again, hopefully everything should be fine this time. Thank You.

Clone your fork repo
Then push your changes

I did clone and then push changes, Can you please check and merge?


better performance 🚀

migrate ga script to be defer + async to move it out of the critical path.
move the highlight work to be done at build time vs during run time ... this is a major win :)
ref
https://github.com/minwe/markedify/pull/3

\o/

🦄

:goat:


update: version, minor fixes

fix: /run/tor/service perms
fix: set HOME env
update: make Dockerfile consistent
update: version bump tor <IP_ADDRESS>
update: GH actions
update: obfs4 is now lyrebird

Sorry for the extra commits. I assume you will be squashing history during the merge. Let me know if you have any questions.


Speed up API queries to ChatGPT and Elsevier

Description
Right now for Elsevier we wait 1 second in between each request so it doesn't block us for spamming- we should experiment and see how low we can get this number while still getting no requests to Elsevier failing.
For ChatGPT we make requests in series, it would also be good if we can get requests going in parallel.
Prerequisites
None

Enough improvements have been made to where this really isn't an issue anymore. Closing


moving to new blockchain api to send action uniformly

this is related to https://github.com/iotexproject/iotex-client-js/issues/5

wont fix


Suggestion for a training model

The project
Contextualizing the project, I have a positioning system in a straight production line, divided by five independent stations that do different things in the prodution. Right now I'm using Bluetooth Low Energy beacons and BLE gateways, using their Received Signal Strength Intensity (RSSI) to estimate their positions.
The important thing that I have to show is in what station of the line a product is. The system is constantly analyzing the RSSIs of my 3 gateways, and to set the station of a product I'm doing some validations like this, according to the RSSI:
if (gateway_1< -37.5 && gateway_1>= -62) // the important one for the prodution
{
    if ((gateway_2< -52 && gateway_2 > -70) && (gateway_3< -69 && gateway_3> -76) && (gateway_1 > gateway_2)) // other validations for the station
        station= 1; // it could be 1-5
}
if (gateway_2< -55 && gateway_2 > -70)
{
    if ((gateway_1< -55 && gateway_1> -68) && (gateway_3<= -67 && gateway_3> -75)(gateway_2 - gateway_1 > -3))
        station= 2;
}

Some intervals are large due to the noisy ambient I'm working with, and with that, the intensities could fit in two stations. For example, if we have -57dBm in gateway 1, -56dBm in gateway 2 and -71dBm in gateway 3, station could be 1 or could be 2. In this cases I would like to test Neural Networks and see what is the possibility of the product be positioned in one station or another.
There are some other validations for the production line, like jumping important stations in the line, returning the product to a previous station, occupying a station that is already occupied, and some others.
What is wrong?
I'm trying to use Neural Networks in my positioning system, but I don't know the best way to train my net. Right now I'm testing with the same intervals that I have in the main project. I setted the closest intensity as -30dBm (then 1 = -30dBm, 0.5 = -60dBm, 0.333 = -90dBm and so on) and my training is like this:
[
{input: [0.8000, 0.5769, 0.4348], output: {station1: 1, station2: 0, station3: 0, station4: 0, station5: 0}},
{input: [0.4839, 0.4285, 0.3947], output: {station1: 1, station2: 0, station3: 0, station4: 0, station5: 0}},
{input: [0.5454, 0.5454, 0.4477], output: {station1: 0, station2: 1, station3: 0, station4: 0, station5: 0}},
{input: [0.4412, 0.4285, 0.4000], output: {station1: 0, station2: 1, station3: 0, station4: 0, station5: 0}}
]

Where does it happen?
In a Neural Network, running in node.js.
How do we replicate the issue?
To replicate it, I made an example code, just to see if the possibilities would fit in the station positioning.
const brain = global.get('brainjs');
const config = {
    hiddenLayers: [10],     // array of ints for the sizes of the hidden layers in the network
};

var net = new brain.NeuralNetwork(config);
// input: [Gateway_1, Gateway_2, Gateway_3]
// 1 = -30 // 0.5 = -60
net.train(
    [
        {input: [0.8000, 0.5769, 0.4348], output: {station1: 1, station2: 0, station3: 0, station4: 0, station5: 0}},
        {input: [0.4839, 0.4285, 0.3947], output: {station1: 1, station2: 0, station3: 0, station4: 0, station5: 0}},

        {input: [0.5454, 0.5454, 0.4477], output: {station1: 0, station2: 1, station3: 0, station4: 0, station5: 0}},
        {input: [0.4412, 0.4285, 0.4000], output: {station1: 0, station2: 1, station3: 0, station4: 0, station5: 0}},

        {input: [0.4838, 0.6250, 0.4838], output: {station1: 0, station2: 0, station3: 1, station4: 0, station5: 0}},
        {input: [0.4167, 0.4918, 0.4109], output: {station1: 0, station2: 0, station3: 1, station4: 0, station5: 0}},

        {input: [0.4347, 0.5660, 0.5172], output: {station1: 0, station2: 0, station3: 0, station4: 1, station5: 0}},
        {input: [0.3703, 0.4545, 0.4285], output: {station1: 0, station2: 0, station3: 0, station4: 1, station5: 0}},

        {input: [0.4545, 0.5172, 0.6667], output: {station1: 0, station2: 0, station3: 0, station4: 0, station5: 1}},
        {input: [0.3703, 0.4285, 0.4687], output: {station1: 0, station2: 0, station3: 0, station4: 0, station5: 1}}
    ]
);
var output = net.run([0.416873449, 0.5995717344, 0.46979865]);
node.warn(output);

To calculate the number between 0-1, I did number = -30/intensity.
The values to input could be values inside those intervals, but to get a real situation, these following inputs could be in two stations by my program and by the NeuralNetwork
[0.416873449, 0.5995717344, 0.46979865] -> should be in Station 4
[0.462809917, 0.5526315789, 0.45454545] -> should be in Station 3
[0.421475163, 0.4729729729, 0.53401144] -> should be in Station 5
The results with this training are pretty accurate, but I would like to know if there is a better way to train it, like instant values showing the station, like this:
net.train(
    [
        {input: [0.416873449, 0.5995717344, 0.46979865], output: {station1: 0, station2: 0, station3: 0, station4: 1, station5: 0}},
        {input: [0.462809917, 0.5526315789, 0.45454545], output: {station1: 0, station2: 0, station3: 1, station4: 0, station5: 0}},
        {input: [0.421475163, 0.4729729729, 0.53401144], output: {station1: 0, station2: 0, station3: 0, station4: 0, station5: 1}}
    ]
);

In this training, I would put correct intensities for each station, and then test it with other values that are being analyzed by the program itself. I'm running a test that instantly verifies the station of a product according to their intensities, and the results are good, but not how I need it. I expect the problem being the lack of training data, and with more data for training, better the results will be.
How important is this (1-5)?
3
Expected behavior (i.e. solution)
I think the result should be the possibility of those 3 intensities fit in one station, but not in two, or three of them. Besides that, more training, or actually, better training should return much better results.
Other Comments
Appreciate your attention for my issue, brain.js is a very interesting library to work with, and I expect to learn more about it and use it for lots of projects.
Thanks a lot.

 Two things I noticed:

You do not need to specify all the output options for each training input, just mention the successful option. i.e.

[
{input: [0.8000, 0.5769, 0.4348], output: {station1: 1}},
{input: [0.5454, 0.5454, 0.4477], output: {station2: 1}},
]

Output returned by the network contains the correctness probability of each output according to the input data. For example, If the network thinks that the input lies in both station 1 and 2 it will return something like this:

{station1: 0.9, station2: 0.8, station3: 0, station4: 0, station5: 0}

You have to pick the top one from the returned list. In above mentioned sample values, station1 is the top value.

Thanks, I'll change that and develop the NN better.


add v0.7.0 CHANGELOG

(cherry picked from commit 0054537f5fe2561f8dc0fe3cca0fc5970f62562d)

@bacongobbler,
Thanks for your contribution as a Microsoft full-time employee or intern. You do not need to sign a CLA.
Thanks,
Microsoft Pull Request Bot


Fixes lessons 3, 4, 5, & 6

@ibgreen This fixes lessons 3, 4, 5, & 6. Lessons 7 onward start brushing up against the new scene stuff; I'll work on them in the coming week.

Please see https://github.com/uber-common/luma.gl/pull/69


[designate provider] moved recordSet's ID, ZoneID, and OriginalRecords values from Endpoint.Labels to Endpoint.ProviderSpecific

THE PROBLEM
This is to address a bug in the interaction of the TXT registry and the OpenStack Designate provider. The TXT registry calls the provider's Records() function and uses the records it returns to generate an array of endpoints. During the construction of each endpoint, the TXT registry makes a new .Labels field. The problem is that the designate provider stores three critical pieces of information in the Labels field it passes up to the registry: the ID of the recordSet, the ZoneID, and the designateOriginalRecords string. The loss of these fields causes issues down the line when external-dns tries to upsert records. Without a recordSetID or ZoneID, the loop that should update or delete the records exits silently.
THE SOLUTION
This PR solves this problem by stashing the three fields (designateRecordSetID, designateZoneID, and designateOriginalRecords) in a different map on the Endpoint struct. Instead of Endpoint.Labels, it uses Endpoint.ProviderSpecific. Since these values are not stripped by TXT registry, they are available later for the upsert functions.

Hi @hacktastic, got some problems when using your branch when removing then recreating an ingress resource. The TXT record is not deleted but external-dns tries to recreate it, generating an error.
Here is an example with an ingress that exposes the Kubernetes service:
time="2019-02-18T16:41:59Z" level=info msg="Deleting records for kubernetes.spr-1.cdp-test.local.oshimae.rie.agri./A"
time="2019-02-18T16:47:59Z" level=info msg="Creating records: kubernetes.spr-1.cdp-test.local.oshimae.rie.agri./A: <IP_ADDRESS>"
time="2019-02-18T16:47:59Z" level=info msg="Creating records: kubernetes.spr-1.cdp-test.local.oshimae.rie.agri./TXT: \"heritage=external-dns,external-dns/owner=kubernetes-ctrl-spr-1,external-dns/resource=ingress/default/kubernetes\""
time="2019-02-18T16:47:59Z" level=error msg="Expected HTTP response code [201 202] when accessing [POST https://tls.oshimae.rie.agri:9001/v2/zones/d8daa9a6-81f5-4e28-be7a-c68c4a7092b2/recordsets], but got 409 instead\n{\"message\": \"Duplicate RecordSet\", \"code\": 409, \"type\": \"duplicate_recordset\", \"request_id\": \"req-58976fe7-d732-4eaf-8918-e43b4e01cdce\"}"

@hacktastic please have a look again at the last comment :).

@sebastien-prudhomme, I was able to reproduce the bug. Coming up with a solution now. Good eye!


az extension update error

This is autogenerated. Please review and update as needed.
Describe the bug
Command Name
az extension update
Errors:
The command failed with an unexpected error. Here is the traceback:
[Errno 17] File exists: '/usr/lib/python3.9/site-packages/azure-cli-extensions/ml'
Traceback (most recent call last):
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/extension/operations.py", line 413, in update_extension
    _add_whl_ext(cli_ctx=cmd_cli_ctx, source=download_url, ext_sha256=ext_sha256,
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/extension/operations.py", line 113, in _add_whl_ext
    raise CLIError('The extension {} already exists.'.format(extension_name))
knack.util.CLIError: The extension ml already exists.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib64/az/lib/python3.9/site-packages/knack/cli.py", line 233, in invoke
    cmd_result = self.invocation.execute(args)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 663, in execute
    raise ex
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
    results.append(self._run_job(expanded_arg, cmd_copy))
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 697, in _run_job
    result = cmd_copy(params)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/__init__.py", line 333, in __call__
    return self.handler(*args, **kwargs)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
    return op(**command_args)
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/command_modules/extension/custom.py", line 34, in update_extension_cmd
    return update_extension(cli_ctx=cmd.cli_ctx, extension_name=extension_name, index_url=index_url,
  File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/extension/operations.py", line 421, in update_extension
    shutil.copytree(backup_dir, extension_path)
  File "/usr/lib/python3.9/shutil.py", line 568, in copytree
    return _copytree(entries=entries, src=src, dst=dst, symlinks=symlinks,
  File "/usr/lib/python3.9/shutil.py", line 467, in _copytree
    os.makedirs(dst, exist_ok=dirs_exist_ok)
  File "/usr/lib/python3.9/os.py", line 225, in makedirs
    mkdir(name, mode)
FileExistsError: [Errno 17] File exists: '/usr/lib/python3.9/site-packages/azure-cli-extensions/ml'

To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

_Put any pre-requisite steps here.

route to CXP team

@borges I am able to reproduce this and redirecting this to service team to look into ?

FYI: @jiasli , @kairu-ms

Duplicate of https://github.com/Azure/azure-cli/issues/24023
Should be fixed in next release


roi_align anf roi_pool cannot be scripted due to type annotation issue

🐛 Bug
roi_align anf roi_pool cannot be scripted due to type annotation issue
https://github.com/pytorch/vision/blob/7bc5bd855536c34a1759d125436f791dde4fb8b7/torchvision/ops/roi_pool.py#L13
https://github.com/pytorch/vision/blob/7bc5bd855536c34a1759d125436f791dde4fb8b7/torchvision/ops/roi_align.py#L13
The input "boxes" can be either a tensor or list, however the type annotation does not cover the list case.
The annotation should be Union of Tensor and List.

JIT does not support unions at the moment. That's why it's only defined as Tensor. See:  https://github.com/pytorch/pytorch/issues/41412
Why don't you pass a tensor instead?

We can modify the model code. But this issue has been escalated to the ONNX team a couple times by customers who are relying on the documentation. So we'd like to track this work and make sure this is fixed once Union is supported.

@neginraoof Sounds good. There are numerous places where things will change once Union is supported and I think this use-case will be one of them. Perhaps if you rephrase the ticket as a feature request / enhancement dependent on JIT Union support, I can tag it differently and leave it open. The challenge right now is it states it's a bug which means if someone tries to "fix" it by putting Union it will definitely break JIT completely.

I think what we can do for now is to improve the documentation to mention that torchscript only supports Tensor, while eager mode supports both.

pytorch/pytorch#53180 for reference.

Thanks @fmassa, we're okay with waiting for Union to go in.
@datumbox I updated the description.


Creating an instance of a CC for an endpoint does not use the correct CC version

This manifests itself in missing Meter Reset values for endpoints, although the node supports Meter Reset.

I cannot reproduce with this test however, so the interview might be doing something it should not:
// Endpoint.test.ts
	describe("createCCInstance()", () => {
		const fakeDriver = (createEmptyMockDriver() as unknown) as Driver;

		it("uses the correct CC version", () => {
			const node = new ZWaveNode(2, fakeDriver);
			// Set up endpoints
			node.addCC(CommandClasses["Multi Channel"], { isSupported: true });
			node.valueDB.setValue(
				{
					commandClass: CommandClasses["Multi Channel"],
					property: "individualCount",
				},
				2,
			);
			node.valueDB.setValue(
				{
					commandClass: CommandClasses["Multi Channel"],
					endpoint: 0,
					property: "interviewComplete",
				},
				true,
			);
			// Set up versions - Node has Meter CC V6, Endpoint supports it
			node.addCC(CommandClasses.Meter, {
				isSupported: true,
				version: 6,
			});
			node.valueDB.setValue(getEndpointCCsValueId(1), [
				CommandClasses.Meter,
			]);

			const endpoint = node.getEndpoint(1)!;
			const ccInstance = endpoint.createCCInstance(CommandClasses.Meter)!;
			expect(ccInstance.version).toBe(6);
		});
	});

As discussed on discord...
Cache files of my test mesh, including the dimmer (node 5).
ccVersion is 0 on the endpoints but correct is I request it on endpoint 0 (the node).
Archief.zip

As discussed on discord...
Cache files of my test mesh, including the dimmer (node 5).
ccVersion is 0 on the endpoints but correct is I request it on endpoint 0 (the node).
Archief.zip


[Change Request] Provide recycle bin where applicable

spaceangel6998 — Today at 11:18 AM
Would it be possible for deleted items from drop down box be moved to recycle bin. Accidently deleted assets so many times..

Fixed with 3.7.2.


sokol_log: error when compiling with emscripten

I recently upgraded to the latest version of sokol_gfx and I have included sokol_log as explained in the changelog. It works fine on Windows and macOS but I am getting the following error when compiling with emscripten:
In file included from /Users/tanis/Documents/binocle-c/src/binocle/core/binocle_sokol.c:17:
/Users/tanis/Documents/binocle-c/src/deps/sokol/sokol_log.h:240:1: error: expected function body after function declarator
EM_JS(void, slog_js_log, (uint32_t level, const char* c_str), {
^
/Users/tanis/Documents/emsdk/upstream/emscripten/cache/sysroot/include/emscripten/em_js.h:68:39: note: expanded from macro 'EM_JS'
#define EM_JS(ret, name, params, ...) _EM_JS(ret, name, name, params, #__VA_ARGS__)
                                      ^
/Users/tanis/Documents/emsdk/upstream/emscripten/cache/sysroot/include/emscripten/em_js.h:62:21: note: expanded from macro '_EM_JS'
  ret c_name params EM_IMPORT(js_name);                                                            \
                    ^
In file included from /Users/tanis/Documents/binocle-c/src/binocle/core/binocle_sokol.c:17:
/Users/tanis/Documents/binocle-c/src/deps/sokol/sokol_log.h:240:1: error: unknown type name 'EMSCRIPTEN_KEEPALIVE'
/Users/tanis/Documents/emsdk/upstream/emscripten/cache/sysroot/include/emscripten/em_js.h:68:39: note: expanded from macro 'EM_JS'
#define EM_JS(ret, name, params, ...) _EM_JS(ret, name, name, params, #__VA_ARGS__)
                                      ^
/Users/tanis/Documents/emsdk/upstream/emscripten/cache/sysroot/include/emscripten/em_js.h:63:3: note: expanded from macro '_EM_JS'
  EMSCRIPTEN_KEEPALIVE                                                                             \
  ^
In file included from /Users/tanis/Documents/binocle-c/src/binocle/core/binocle_sokol.c:17:
/Users/tanis/Documents/binocle-c/src/deps/sokol/sokol_log.h:328:9: error: call to undeclared function 'slog_js_log'; ISO C99 and later do not support implicit function declarations [-Wimplicit-function-declaration]
        slog_js_log(log_level, line_buf);
        ^
3 errors generated.

The content of binocle_sokol.c is just the following:
#define SOKOL_IMPL
#if defined(BINOCLE_GL)
  #if defined(__EMSCRIPTEN__)
    #define GL_GLEXT_PROTOTYPES
    #include <GLES2/gl2.h>
    #include <GLES2/gl2ext.h>
    #define SOKOL_GLES2
  #elif defined(__IPHONEOS__) || defined(__ANDROID__)
    #define SOKOL_GLES3
  #else
    #define SOKOL_GLCORE33
  #endif
#elif defined(BINOCLE_METAL)
  #define SOKOL_METAL
#endif
#include "sokol_log.h"
#include "sokol_gfx.h"

GLuint binocle_sokol_tex_id(sg_image img_id) {
  SOKOL_ASSERT(img_id.id != SG_INVALID_ID);
  _sg_image_t* img = _sg_lookup_image(&_sg.pools, img_id.id);
  SOKOL_ASSERT(img);
  SOKOL_ASSERT(img->gl.target == GL_TEXTURE_2D);
  SOKOL_ASSERT(0 != img->gl.tex[img->cmn.active_slot]);
  return img->gl.tex[img->cmn.active_slot];
}

I am using emscripten 3.1.22 if that can help.

I have fixed this issue by adding this include to binocle_sokol.c:
#include <emscripten/emscripten.h>

I am not entirely sure this is the right way to go, though :)

Hmm that include should actually be in sokol_log.h... let me check.

It should be taken care of by this include:
https://github.com/floooh/sokol/blob/154ac78f09bf0d8f382eb036da2ab91110cdaef0/sokol_log.h#L195-L197
I remember that I forgot this in an earlier version of sokol_log.h, because I only added this later (on 06-Feb, but that's already 10 days ago and was not yet in the master branch).
https://github.com/floooh/sokol/commit/4ef1cda4ed642fef15587f56028f4a4663261ea3
Can you check if you that include?
Normally the compile checks in here should make sure that there is no "header leakage", this is compiled for all platforms:
https://github.com/floooh/sokol/blob/master/tests/compile/
...e.g. here's standalone sokol_log.c implementation file is here:
https://github.com/floooh/sokol/blob/master/tests/compile/sokol_log.c

yes, the include for em_js.h is there, but it looks like that's not enough for some reason. I replaced it with emscripten.h and it works correctly. Are you using the same emscripten version?

I'm on emsdk version 3.1.31

PPS: but note that the sokol headers now also require the relatively new EM_JS_DEPS() macro which was added around that time too... so if you are on an older Emscripten SDK version that might also be a problem...

Ok, I changed the include to <emscripten/emscripten.h> can you check if that works for you? If not please re-open and we need to investigate further :)
In any case: thanks for reporting the issue!

Yes, that seems to be the issue. I removed the include I added before and updated to emsdk 3.1.31 and it works fine ;)

Ok, I changed the include anyway :) I also just checked, and I'm including emscripten.h in all other places, instead of the lower level headers, so it's probably a good idea anyway.


More accessible way to create Angles

Description of proposed feature

The current way of creating Angle mobjects is somewhat clunky and could be improved. One way of doing so would be the introduction of a new static method Angle.from_three_points which takes in three points and creates one of the two possible angles.
How can the new feature be used?

A = np.array(...)
B = np.array(...)
C = np.array(...)
ang = Angle.from_three_points(A, B, C)

Additional comments

The implementation might look something like this:
@staticmethod
def from_three_points(A, B, C, **kwargs):
            return Angle(Line(B, A), Line(B, C), **kwargs)

The choice of end points (A and C) should make sure that as long as the quadrant is not modified, the correct angle (or its complement) are constructed. Documentation and tests have to be written though.

I can tackle this with @jbalpert !!!

Where would this function actually get defined? In the line.py file? @behackl

Where would this function actually get defined? In the line.py file? @behackl

Go ahead! Yes, in line.py, as a member of the Angle class.

We have implemented the member function and have wrote a pytest for it. Everything looks good! We are not totally sure where to write documentation for this function though, where are these documentation files located? @behackl


Write Up 1 Submission by Nathan Quick Wright

Grade:
Problem 1: 2/2
Problem 2: 2/2
Output of testing/test_all.sh, showing differences in incorrect output:
Testing problem1
Success testing problem1 case 1 in 0.00 seconds.
Testing problem2
Failure testing problem2 case 1, since there was a difference in output:
1,4c1,4
< Sum =  37.6
< Mean =  9.4
< Product =  6142.5
< Geometric Mean =  8.85291493609189
---
> 37.6
> 9.4
> 6142.5
> 8.85291493609189
Failure testing problem2 case 2, since there was a difference in output:
1,4c1,4
< Sum =  39.0
< Mean =  9.75
< Product =  256.0
< Geometric Mean =  4.0
---
> 39.0
> 9.75
> 256.0
> 4.0
Failure testing problem2 case 3, since there was a difference in output:
1,4c1,4
< Sum =  0.0
< Mean =  0.0
< Product =  0.0
< Geometric Mean =  0.0
---
> 0.0
> 0.0
> 0.0
> 0.0
Failure testing problem2 case 4, since there was a difference in output:
1,4c1,4
< Sum =  4718.0
< Mean =  1179.5
< Product =  1048788.0
< Geometric Mean =  32.0016173090261
---
> 4718.0
> 1179.5
> 1048788.0
> 32.0016173090261
Failure testing problem2 case 5, since there was a difference in output:
1,4c1,4
< Sum =  4.0
< Mean =  1.0
< Product =  1.0
< Geometric Mean =  1.0
---
> 4.0
> 1.0
> 1.0
> 1.0
Failure testing problem2 case 6, since there was a difference in output:
1,4c1,4
< Sum =  628.0
< Mean =  157.0
< Product =  625.0
< Geometric Mean =  5.0
---
> 628.0
> 157.0
> 625.0
> 5.0
Failure testing problem2 case 7, since there was a difference in output:
1,4c1,4
< Sum =  100.0
< Mean =  25.0
< Product =  0.0
< Geometric Mean =  0.0
---
> 100.0
> 25.0
> 0.0
> 0.0


Add task to execute sql script

Partially addresses #764. @polastre I hope this is sufficient to address your use case.

looks good to me.


FW-73 Cognito Integrated Auth

Changelog

Introduce a new bundle, FirstVoicesCognitoAuth that hooks into Nuxeo's UserManager to allow authentication directly against Cognito via the AWS Java SDK
Disabled by default, enable by setting fv.cognito.authenticateWithCognito to true in Nuxeo configuration. 5 other parameters must also be set for this to work -- see the updated nuxeo.defaults.
Works in conjunction with the AWS Cognito Lambda Migration trigger to automatically migrate users
Requires that the user exists in the Nuxeo directory (that is, merely having a user in Cognito is not enough, there must be a matching FirstVoices user).

@plasticviking we began strict checkstyle enforcement and he build is failing on a few classes:
2020-05-21T12:55:23.9801389Z [INFO] There are 6 errors reported by Checkstyle 8.29 with https://raw.githubusercontent.com/First-Peoples-Cultural-Council/fv-checkstyle/master/java/java-fv-google-style-strict.xml ruleset.
2020-05-21T12:55:23.9802039Z [ERROR] src/main/java/ca/firstvoices/cognito/AWSAwareUserManagerConfigurationService.java:[10] (sizes) LineLength: Line is longer than 100 characters (found 101).
2020-05-21T12:55:23.9802685Z [ERROR] src/main/java/ca/firstvoices/cognito/AWSAuthenticationService.java:[31] (javadoc) JavadocTagContinuationIndentation: Line continuation have incorrect indentation level, expected level should be 4.
2020-05-21T12:55:23.9803352Z [ERROR] src/main/java/ca/firstvoices/cognito/AWSAuthenticationService.java:[32] (javadoc) JavadocTagContinuationIndentation: Line continuation have incorrect indentation level, expected level should be 4.
2020-05-21T12:55:23.9804335Z [ERROR] src/main/java/ca/firstvoices/cognito/AWSAuthenticationServiceImpl.java:[10] (imports) AvoidStarImport: Using the '.*' form of import should be avoided - com.amazonaws.services.cognitoidp.model.*.
2020-05-21T12:55:23.9805405Z [ERROR] src/main/java/ca/firstvoices/cognito/AWSAuthenticationServiceImpl.java:[10] (imports) CustomImportOrder: Wrong lexicographical order for 'com.amazonaws.services.cognitoidp.model.*' import. Should be before 'java.util.Map'.
2020-05-21T12:55:23.9805915Z [ERROR] src/main/resources/seam.properties:[1] (misc) NewlineAtEndOfFile: File does not end with a newline.```

@plasticviking we began strict checkstyle enforcement and the build is failing on a few classes:
2020-05-21T12:55:23.9801389Z [INFO] There are 6 errors reported by Checkstyle 8.29 with https://raw.githubusercontent.com/First-Peoples-Cultural-Council/fv-checkstyle/master/java/java-fv-google-style-strict.xml ruleset.
2020-05-21T12:55:23.9802039Z [ERROR] src/main/java/ca/firstvoices/cognito/AWSAwareUserManagerConfigurationService.java:[10] (sizes) LineLength: Line is longer than 100 characters (found 101).
2020-05-21T12:55:23.9802685Z [ERROR] src/main/java/ca/firstvoices/cognito/AWSAuthenticationService.java:[31] (javadoc) JavadocTagContinuationIndentation: Line continuation have incorrect indentation level, expected level should be 4.
2020-05-21T12:55:23.9803352Z [ERROR] src/main/java/ca/firstvoices/cognito/AWSAuthenticationService.java:[32] (javadoc) JavadocTagContinuationIndentation: Line continuation have incorrect indentation level, expected level should be 4.
2020-05-21T12:55:23.9804335Z [ERROR] src/main/java/ca/firstvoices/cognito/AWSAuthenticationServiceImpl.java:[10] (imports) AvoidStarImport: Using the '.*' form of import should be avoided - com.amazonaws.services.cognitoidp.model.*.
2020-05-21T12:55:23.9805405Z [ERROR] src/main/java/ca/firstvoices/cognito/AWSAuthenticationServiceImpl.java:[10] (imports) CustomImportOrder: Wrong lexicographical order for 'com.amazonaws.services.cognitoidp.model.*' import. Should be before 'java.util.Map'.
2020-05-21T12:55:23.9805915Z [ERROR] src/main/resources/seam.properties:[1] (misc) NewlineAtEndOfFile: File does not end with a newline.```

Thanks @davidlacho I've fixed these and added checkstyle as a precommit hook on my local branch.
Looks like my IDE has some issues with formatting that require manual intervention -- somewhat frustrating. https://youtrack.jetbrains.com/issue/IDEA-121723

@plasticviking Awesome! That's unfortunate. If there are any checkstyle rules that are very frustrating and please submit a PR to the checkstyle repo to remove them. We're still fine tuning our checkstyle rules.

Any thoughts on why the build is failing in Github actions @davidlacho @plasticviking?

Any thoughts on why the build is failing in Github actions @davidlacho @plasticviking?

It seems to be failing in checking dependencies for the frontend. There are no frontend changes in the code, but I noticed the frontend failing to build on my local machine. I temporarily had upgraded babel/core and babel/preset-env to get the frontend to build successfully on my local machine (none of these changes are present in the committed code, but I found it was necessary to fix the build locally so perhaps it's necessary in the CI environment also).

On Friday GitHub was throwing several 500 errors on their API and I'm guessing this affected fetching node modules. It seems to be passing the frontend build, and now the issue seems to be that we updated to 3.4.3-SNAPSHOT. Committed directly to this branch to see if that resolves issue.

@plasticviking while you're working on the forgotten password flow, do you mind updating the package version to match master? That's what the build is failing on. Thanks!

@plasticviking while you're working on the forgotten password flow, do you mind updating the package version to match master? That's what the build is failing on. Thanks!

Hi David. This new version will correctly reset the Cognito password to match, and has the package version number updated to match master.


Why do you disable cudnn for batch_norm?

Thank you for releasing the code. The README reads that it is required to disable cudnn for batch_norm. Would you please explain why we should do this?

Hi, I wonder under what circumstances will this kind of cudnn bn bug appear ? Does the cudnn bn bug appear for all tasks, not only human pose estimation ?

I am not sure if any other task has also this problem and also not know what's the root cause for this.

@leoxiaobin you don't need a sed. you can monkey patch
def monkey_patch_bn():
    # print(inspect.getsource(torch.nn.functional.batch_norm))
    def batch_norm(input, running_mean, running_var, weight=None, bias=None,
                   training=False, momentum=0.1, eps=1e-5):
        if training:
            size = input.size()
            size_prods = size[0]
            for i in range(len(size) - 2):
                size_prods *= size[i + 2]
            if size_prods == 1:
                raise ValueError('Expected more than 1 value per channel when training, got input size {}'.format(size))

        return torch.batch_norm(
            input, weight, bias, running_mean, running_var,
            training, momentum, eps, False
        )
    torch.nn.functional.batch_norm = batch_norm

@leoxiaobin you don't need a sed. you can monkey patch
def monkey_patch_bn():
    # print(inspect.getsource(torch.nn.functional.batch_norm))
    def batch_norm(input, running_mean, running_var, weight=None, bias=None,
                   training=False, momentum=0.1, eps=1e-5):
        if training:
            size = input.size()
            size_prods = size[0]
            for i in range(len(size) - 2):
                size_prods *= size[i + 2]
            if size_prods == 1:
                raise ValueError('Expected more than 1 value per channel when training, got input size {}'.format(size))

        return torch.batch_norm(
            input, weight, bias, running_mean, running_var,
            training, momentum, eps, False
        )
    torch.nn.functional.batch_norm = batch_norm

Hi, I want to know where I should add monkey_patch_bn? main.py? call it before training?

@LordLiang i would call it right after importing torch.nn

is this still relevant in higher versions of pytorch? (eg version 1.4)

@leoxiaobin you don't need a sed. you can monkey patch
def monkey_patch_bn():
    # print(inspect.getsource(torch.nn.functional.batch_norm))
    def batch_norm(input, running_mean, running_var, weight=None, bias=None,
                   training=False, momentum=0.1, eps=1e-5):
        if training:
            size = input.size()
            size_prods = size[0]
            for i in range(len(size) - 2):
                size_prods *= size[i + 2]
            if size_prods == 1:
                raise ValueError('Expected more than 1 value per channel when training, got input size {}'.format(size))

        return torch.batch_norm(
            input, weight, bias, running_mean, running_var,
            training, momentum, eps, False
        )
    torch.nn.functional.batch_norm = batch_norm

Hi, I want to know where I should add monkey_patch_bn? main.py? call it before training?

How do I do this, if I am using nn.Sequential?
def convbn(in_planes, out_planes, kernel_size, stride, pad, dilation, bn_running_avg=False):
    return nn.Sequential(nn.Conv2d(in_planes, out_planes,
                                   kernel_size=kernel_size, stride=stride,
                                   padding=dilation if dilation > 1 else pad,
                                   dilation=dilation, bias=False),
                         nn.BatchNorm2d(out_planes,
                                        track_running_stats=bn_running_avg))


fix: improve import flow UI/UX

SUMMARY

Improve the UI/UX in the import modal:

When canceling modal and after import, clear the state so that a second modal shows up empty.
Remove icon from header.
Improve padding on import SVG icon.
Improve padding on modal, aligning header with body text.
Increase vertical margin between sections in the modal.
Update text.

BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF

Updated import icon (top-right):

Updated modal:

Asking for password:

Modal is cleared after import:

Asking for overwrite confirmation:

TEST PLAN

See screenshots.
ADDITIONAL INFORMATION

[ ] Has associated issue:
[ ] Changes UI
[ ] Requires DB Migration.
[ ] Confirm DB Migration upgrade and downgrade tested.
[ ] Introduces new feature or API
[ ] Removes existing feature or API

Codecov Report

Merging #12070 (8ca0471) into master (12e086d) will decrease coverage by 3.05%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master   #12070      +/-   ##
==========================================
- Coverage   66.57%   63.52%   -3.06%
==========================================
  Files         956      474     -482
  Lines       46859    29271   -17588
  Branches     4590        0    -4590
==========================================
- Hits        31198    18594   -12604
+ Misses      15535    10677    -4858
+ Partials      126        0     -126

Flag
Coverage Δ

cypress
?

javascript
?

python
63.52% <ø> (-0.99%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

superset/db_engines/hive.py
0.00% <0.00%> (-85.72%)
:arrow_down:

superset/sql_validators/postgres.py
50.00% <0.00%> (-50.00%)
:arrow_down:

superset/datasets/commands/importers/v1/utils.py
58.62% <0.00%> (-34.24%)
:arrow_down:

superset/db_engine_specs/hive.py
54.61% <0.00%> (-29.62%)
:arrow_down:

superset/datasets/commands/export.py
78.72% <0.00%> (-15.40%)
:arrow_down:

superset/db_engine_specs/mysql.py
79.59% <0.00%> (-12.25%)
:arrow_down:

superset/db_engine_specs/sqlite.py
65.62% <0.00%> (-9.38%)
:arrow_down:

superset/databases/commands/create.py
83.67% <0.00%> (-8.17%)
:arrow_down:

superset/databases/commands/update.py
85.71% <0.00%> (-8.17%)
:arrow_down:

superset/connectors/sqla/models.py
84.33% <0.00%> (-6.43%)
:arrow_down:

... and 498 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 12e086d...8ca0471. Read the comment docs.


Failed to execute (CreateRelationshipClass)

I did test all the examples and all of them fail in the same spot. My main focus is on XML.
ERROR 000177: Relationship classes can only be created in the same database that contains the feature classes or tables.
Failed to execute (CreateRelationshipClass).
The procedure
creates a temporary gdb,
inserts into that the line_segments feature class from the real database
imports the activity records from XML
tries to create the relationship class in that temporary gdb and fails with the error.

moved the issue to the proper location https://github.com/Esri/schedule-sync/issues/1

dup


zero-copy support in cffi backend

When trying out PyPy2 with spyder via the spyder-kernels package (which is extends the ipython protocol?), I discovered that CFFI-based Frame was not working correctly: it did not support the buffer protocol. PyPy extends the ability of pure python classes to support the buffer protocol. If you inherit from the __pypy__.bufferable.bufferable class and then instaniate an instance of your class b, callng memoryview(b) will call self.__buffer__(flags) and give you a chance to return a buffer.
I implemented this, but it seems there is some code in the cython backend to  release the buffer via a gc callback? In any case, I unskipped some of the tests.
Does this look OK? The only tests that are failing are the ones that check tracker.done, which makes me think maybe this is leaking memory.

This is great! Supporting the buffer interface isn't enough for the cffi backend to support zero-copy sends, though, which is what the done tests cover. This is still an improvement, so if you put back the skips on the two tracker tests, I think this is great.
In the pypy2 tests, it  looks like numpy.frombuffer doesn't work with buffer-interface-providers:
B = numpy.frombuffer(msg, A.dtype).reshape(A.shape)
TypeError: expected string or Unicode object, Frame found

maybe need a version check or direct check for the presence of this bufferable type?

In the pypy2 tests, it looks like numpy.frombuffer doesn't work with buffer-interface-providers

There was a bug in PyPy, the fix should appear in the pypy2 nightly build tomorrow.

Supporting the buffer interface isn't enough for the cffi backend to support zero-copy sends

Is there something I can do to get this going?

Is there something I can do to get this going?

You could give it a go. To implement zero-copy, Frame needs to match the Cython version more, which you can use as reference.
Mainly:

send/Frame on a buffer with copy=False should not copy memory, instead it should create a zmq_msg_t with zmq_msg_init_data referencing that memory and an associated GIL-less zmq_free_fn.
The zmq_free_fn sends a message to the garbage collector (which is in Python and thus shared).

in a322aa0 I

created a separate build step for the cffi c-extension module
changed the cffi interfaces to use that module
copied the copy=False behaviour from message.pyx to message.py

Now test_multi_tracker in test_message.py hangs. How do I instrument the callbacks so I can see what is not being called? I don't see the fprintf output from the call to free_python_msg

zero-copy now works in PyPy. Thanks @mattip!

zero-copy now works in PyPy. Thanks @mattip!

Thanks for finishing this up. Are there any benchmarks for pyzmq?

Thanks for finishing this up. Are there any benchmarks for pyzmq?

I found https://github.com/achimnol/asyncio-zmq-benchmark (that @minrk contributed to). Is that still relevant?

I found https://github.com/achimnol/asyncio-zmq-benchmark (that @minrk contributed to). Is that still relevant?


zine serve or zine build after zine new panicked

❯ zine serve

███████╗██╗███╗   ██╗███████╗
╚══███╔╝██║████╗  ██║██╔════╝
  ███╔╝ ██║██╔██╗ ██║█████╗
 ███╔╝  ██║██║╚██╗██║██╔══╝
███████╗██║██║ ╚████║███████╗
╚══════╝╚═╝╚═╝  ╚═══╝╚══════╝

listening on http://<IP_ADDRESS>:3000
thread 'tokio-runtime-worker' panicked at 'called `Result::unwrap()` on an `Err` value: No such file or directory (os error 2)', /Users/wangxingbin/.cargo/registry/src/rsproxy.cn-8f6827c7555bfaf8/zine-0.3.0/src/serve.rs:47:14
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

How to reproduce
Follow the Get stared, run zine serve step.
Relative issue
2d2d lastest ci action failed.

Hi, @Binlogo. Thanks for the feedback. This has been fixed but has not been released yet. https://github.com/zineland/zine/pull/33
The quick workaround is to create an empty static directory, see also https://github.com/zineland/zine/issues/32.


db.delete can't delete objects in array based on index if the array name contains dashes

For example:
db.delete("/arraytest/my-array[0]"); // Wont work
db.delete("/arraytest/myarray[0]"); // Will work
I am storing an SSID as the array name and it would greatly simplify the code if i could keep it that way. Otherwise i will have to loop the array, match the SSID value, check the index of that value and delete the subdata based on the index where it matched the SSID value.
I have tried to encase the array name in brackets, to no avail.
Interestingly
db.delete("/arraytest/my-array"); // Will work just fine.
Anyone know a way to fix this?
Thanks for a great plugin.

Dash isn't currently supported in array name.
Will be fixed in next release.

:tada: This issue has been resolved in version 1.0.2 :tada:
The release is available on:

GitHub release
npm package (@latest dist-tag)

Your semantic-release bot :package::rocket:


Running error

Traceback (most recent call last):
File "train.py", line 172, in
main(args)
File "train.py", line 143, in main
train, eval, test, scaler = getattr(data.dataloader, dataset_setting['dataloader'])(settings)
File "/home/xinyilian/ST-MetaNet/flow-prediction/src/data/dataloader.py", line 109, in dataloader_all_sensors_seq2seq
return dataiter_all_sensors_seq2seq(train, scaler, setting),
File "/home/xinyilian/ST-MetaNet/flow-prediction/src/data/dataloader.py", line 90, in dataiter_all_sensors_seq2seq
feature = mx.nd.array(np.stack(feature)) # [B, N, D]
File "/home/xinyilian/.conda/envs/xyl/lib/python3.6/site-packages/mxnet/ndarray/utils.py", line 146, in array
return _array(source_array, ctx=ctx, dtype=dtype)
File "/home/xinyilian/.conda/envs/xyl/lib/python3.6/site-packages/mxnet/ndarray/ndarray.py", line 2505, in array
arr[:] = source_array
File "/home/xinyilian/.conda/envs/xyl/lib/python3.6/site-packages/mxnet/ndarray/ndarray.py", line 449, in setitem
self._set_nd_basic_indexing(key, value)
File "/home/xinyilian/.conda/envs/xyl/lib/python3.6/site-packages/mxnet/ndarray/ndarray.py", line 715, in _set_nd_basic_indexing
self._sync_copyfrom(value)
File "/home/xinyilian/.conda/envs/xyl/lib/python3.6/site-packages/mxnet/ndarray/ndarray.py", line 881, in _sync_copyfrom
ctypes.c_size_t(source_array.size)))
File "/home/xinyilian/.conda/envs/xyl/lib/python3.6/site-packages/mxnet/base.py", line 253, in check_call
raise MXNetError(py_str(_LIB.MXGetLastError()))
mxnet.base.MXNetError: [19:21:13] src/ndarray/ndarray_function.cc:51: Check failed: size == to->Size() (-2000107520 vs.<PHONE_NUMBER>) : copying size mismatch, from:<PHONE_NUMBER>5709121536 bytes, to:<PHONE_NUMBER> bytes.
Stack trace:
[bt] (0) /home/xinyilian/.conda/envs/xyl/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x4b04cb) [0x7feb9aa234cb]
[bt] (1) /home/xinyilian/.conda/envs/xyl/lib/python3.6/site-packages/mxnet/libmxnet.so(+0x281c85b) [0x7feb9cd8f85b]
[bt] (2) /home/xinyilian/.conda/envs/xyl/lib/python3.6/site-packages/mxnet/libmxnet.so(mxnet::NDArray::SyncCopyFromCPU(void const*, unsigned long) const+0x27c) [0x7feb9cd1b59c]
[bt] (3) /home/xinyilian/.conda/envs/xyl/lib/python3.6/site-packages/mxnet/libmxnet.so(MXNDArraySyncCopyFromCPU+0x2b) [0x7feb9ca9790b]
[bt] (4) /home/xinyilian/.conda/envs/xyl/lib/python3.6/lib-dynload/../../libffi.so.6(ffi_call_unix64+0x4c) [0x7fec1d551ec0]
[bt] (5) /home/xinyilian/.conda/envs/xyl/lib/python3.6/lib-dynload/../../libffi.so.6(ffi_call+0x22d) [0x7fec1d55187d]
[bt] (6) /home/xinyilian/.conda/envs/xyl/lib/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so(_ctypes_callproc+0x2ce) [0x7fec1d767ede]
[bt] (7) /home/xinyilian/.conda/envs/xyl/lib/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so(+0x13915) [0x7fec1d768915]
[bt] (8) python(_PyObject_FastCallDict+0x8b) [0x560bdc88ae3b]

It seems that your mxnet version can only create an array with 2^32 bits of memory, causing the overflow.
The backend of mxnet often changes, so unexpected errors sometimes raised.
I suggest you to use the versions of packages specified in requirements.txt.

It seems that your mxnet version can only create an array with 2^32 bits of memory, causing the overflow.
The backend of mxnet often changes, so unexpected errors sometimes raised.
I suggest you to use the versions of packages specified in requirements.txt.

Thank you very much. You are really nice.
Finally I solved it by installing the MXnet with right gpu version. Thanks a lot.

It seems that your mxnet version can only create an array with 2^32 bits of memory, causing the overflow.
The backend of mxnet often changes, so unexpected errors sometimes raised.
I suggest you to use the versions of packages specified in requirements.txt.

Thank you very much. You are really nice.
Finally I solved it by installing the MXnet with right gpu version. Thanks a lot.

Hi,how do you installed mxnet-cu90 == 1.5.0b20190108? could you give a command?
when i install mxnet-cu90 == 1.5.0b20190108, there is no such version


Arbitrary android class usage

Hi Eddy,
I needed to change my nativescript appversion to support a different classname. The below code allows this to be used with any arbitrary android application class.
Apologies in advanced for the different formatting style.

Hi @code0wl, why did you close this PR? Thanks!

Hi @EddyVerbruggen I was not sure if this was the direction you wanted to go with the app-version plugin. I have made a fork, would you like me to re-open?

Thanks! I'll take a look and reopen & merge if I like it.

Reopened so I won't forget to take a look.

I will update the package.json to reflect your credentials again then. Thanks!

Thanks @code0wl, I just got around to releasing it. Also added synchronous versions of the Promise-based methods this plugin already provided.
Available in 1.4.0 from npm now.


Make IKnownType and KnowTypes public

Often we have a problem that we shoud serialize a class which is generic and we don't know the correct
type of a property at design time. One design constraint is that the type should be serializable. So the user of our class will save or load it and this will fail if the generic type is non serilaizable (in our case FileInfo for example). We could not apply the YaxCustomSerializer-Attribute on the generic property because at compile time the tpe is not defined.
here an dummy example;
public class Dummy<T>
{
 public DateTime LastAccess {get; set;}
 public T Source{get; set;}
}

example of using:
var d = new Dummy<FileInfo>();
var serializer = new YaxSerializer<Dummy<FileInfo>>();
serializer.SerializeToFile(d, "c:\\temp\\test.xml");

So after I have inspected the source code of YaxLib I think this problem could be solved if the interface IKnownType and the KnowTypes class will be made public. In this case we could derive from IKnownType  (FileInfoKnownType) and register this type in KnownTypes.
This will allow the users of our libary to register a static custom serializer  which could be used for all serialization-tasks!

I guess the real feature request is to register custom Known types

Resolved with release v4.0.0


Fix up use of helmette.SafeLookup calls

This adds in the proper implementation of the lookup calls from https://github.com/redpanda-data/redpanda-operator/pull/226 - previously the delegation to helmette.SafeLookup was improperly initializing a TLS connection to the Kubernetes API server such that in local tests when the API server is run without mTLS things work fine, but when running with a full stack those calls fail. Instead of delegating to constructing a client via the rest.Config passed in a dot context, we instead just use an already initialized runtime client.Client to do the lookups.

I don't think I understand the issue that we're attempting to solve here. What situation do we need to authenticate to Kubenernetes with mTLS and how is it being misconfigured? IIUC all the configuration for TLS/auth/etc should be present in the kubeconfig that's used to construct the client's we use.

@chrisseto So, it could be that I'm initializing the dot struct improperly here, but here's what I get from the controller in acceptance tests trying to use the helmette methods with the kubeconfig from dot:

error fetching server root CA testing-v1tbga8fa3/sasl-default-root-certificate: failed to get API group resources: unable to retrieve the complete list of server APIs: v1: Get "https://<IP_ADDRESS>:443/api/v1": tls: failed to verify certificate: x509: certificate signed by unknown authority

Oh, I'd actually be suspicious of kube.RestToConfig(c.config) in that case. Chances are it's dropping something in the conversion. Strange that this hasn't surfaced before 🤔 Ah, It's probably because RestToConfig is only used in cases where we're connecting to an envtest apiserver.

@chrisseto yeah, so there's some potential fields that could affect this and some other stuff, namely Cluster seems to have file-based fields that point to cert data. I wouldn't be surprised if something in the rest.Config returned by the controller runtime was using on-disk certs rather than certs already read into the struct. In addition there's a TLSServerName field that, given the IP I see in the log file makes me wonder if we'd have problems with server names matching anyway.
What are you thinking the way to proceed is? Trying to jump in an figure out exactly how we need to change RestToConfig to be compatible with the rest.Config handed back by our controller-runtime manager or just pass the already initialized client?

I lean towards fixing existing paths if at all possible as this will very likely come and bite us again. Hopefully it's just a matter of reading a few certs from the disk!
If it's not as simple as that, I'd vote to remove this method entirely so we don't have to fight these issues again and see if we could update helmette.Dot to accept either a rest.Config or a pre-constructed client.

Got it, sounds good, I'll take a pass at modifying the RestToConfig method. It looks like the controller-runtime is handing us back a rest.Config that looks like this:

&rest.Config{Host:"https://<IP_ADDRESS>:443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"--- REDACTED ---", BearerTokenFile:"/var/run/secrets/kubernetes.io/serviceaccount/token", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"", KeyFile:"", CAFile:"/var/run/secrets/kubernetes.io/serviceaccount/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(nil), QPS:20, Burst:30, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}}

So it does seem to be leveraging the on-disk files along with JWT tokens due to being from a service account, so we'll need to handle all of that.

@chrisseto ok, so I just force updated with the fix for the RestToConfig implementation and tested it by hacking it in locally on my acceptance test branch in the operator repo. It works like a charm now.


Update searchbar.dart :)

Fix copyright year, also add more stuff to searchbar

TBH documents and settings fall under the device category


Proposal: Documentation for client_python

(I initially drafted this in Discussions, but I ended moving here. Happy to move it there if required)
Context
After digging a bit in this project and reading some of the issues, I found some things that could be improved regarding the documentation:

The whole API and usage examples live in a single README.md making harder to read.
Some classes and methods are documented but not rendered in any documentation site. Someone also #848 that current docstrings don't follow any standard in order to be rendered properly.
Documentation is incomplete and could be extended. See issues #499 #528

Proposals
Documentation language
Current README uses markdown to render the contet. The obvious choice would be use markdown, but I just wanted to mention that rewriting to RST (RestructuredText) it's also an option.
Documentation Generator
There are many options to generate documentation but I'm only listing here the most suitable options for Python.
mkdocs
This the default choice for many projects. This tutorial explains very well how to use with Python.
Pros:

Supports Markdown
Supports Google-Style Docstrings, NumPy Docstring Standard and Sphinx Docstring Format.
Has many plugins and lot of community around it.

Sphinx
This is the classic way to host Python docs, typicall using RST and hosted in readthedocs.
Pros:

Supports RST and Markdown (with a plugin).
Classic player for Open Source Python projects.

nanoc
This is what the official Prometheus documentation uses to generate its documentation.
Pros:

It documentation system used by Prometheus.

Cons:

It doesn't generate documentation from Python docstrings.
Community and adoption is lower compared to other projects.

Hosting
Where the documentation should live is also relevant for this discussion.
GitHub Pages
Is it the recommended way when using mkdocs. It works creating a branch/repo that will publish automatically changes when new docs are pushed to main.
Read the Docs
Is it a very common way to host documentation pages of Python projects. It works configuring a hook in repository. Readthedocs will pull the changes and publish to the configured site.
prometheus.io
This approach requires using prometheus docs along with nanoc to host the documentation. It would make everything consistent as all the docs are in the same website and it would open the door to other client libraries to host documentation there. The repo could pull changes from client_python/docs. However this would require manually update the git submodule everytime docs are changed in client_python.
Alternatively, we could create a subdomain (https://prometheus.io/docs/python) that points to a different hosting that the Prometheus project.
Do nothing
Making the README bigger every time that new features are add and leave docs and classes undocumented.

cc @csmarchbanks (maybe @roidelapluie ?)

Hi there, I find writing documentation in Markdown more pleasant than writing it in RST. However, docstring in Python often follows RST format, either in Numpy or Google docstring style. I tried to use MyST before, but I found that it didn't work that well with Sphinx, as there are some bugs here and there
Disclaimer: I tried myst out a year ago, and that was the experience then, not entirely sure about now 😊
With Sphinx, one nice thing is its' feature-rich ecosystem. Furo is a pretty neat theme for documentation, sphinx-design also has a lot of pretty nice stuff there. One drawback is that by using Sphinx, you are tied to its ecosystem, meaning that we don't have a lot of flexibility.
I also like the route of building docs in Gatbsy or any other static site generator (Hugo, Gatbsy, etc.), as we have full control of how the docs look like. We probably will just have to find a docstring parser in that case.
With readthedocs I find that it is pretty easy to set up as well. Personally, I haven't worked with mkdocs b4, so I'm not entirely sure about the UX.

If possible for docs I would prefer markdown at least for the non-docstring docs as we use markdown for docs in many other places across Prometheus. For docstrings I don't have a strong preference between Google and Numpy style docstrings, I would prefer to avoid the :param blah style as I find it much less readable in the code.
Where to host the docs is an interesting question, possibly a question for the dev summit at PromCon in a couple of weeks. Today I don't think we host any client-specific documentation on prometheus.io, instead using godoc and docs.rs for the official go and rust libraries. For that reason I am tempted to start with readthedocs and we could add a custom domain later if we want. What do you think of that idea?

Thanks for the input @csmarchbanks. Any preference between mkdocs or sphinx?

No strong preference, happy with whichever you want to use, which sounded like mkdocs.

Hi @marctc, I have opened #851 and #852 as an initial starting point for the docs improvement effort. I would love to hear more feedback on these two PR.
cc @csmarchbanks

Another question. Is there a formatter tool that prometheus_client is currently using?

We use flake8 today, it is configured in tox.ini.

Hey, I plan to revamp this work, sorry for the delay. Speaking with @fstab, he mentioned that used hugo for the docs. This how it renders https://prometheus.github.io/client_java/.
I'd to converge on the tooling and use the same. Do you have any thoughts @csmarchbanks?

Thanks for revamping the work! I was just thinking of reaching out to you.
I like the plan to use the same tooling, I haven't look in depth at what they have done, but 👍 on the idea.

I kept notes how I set the client_java docs up at the bottom of the README https://github.com/prometheus/client_java/blob/main/docs/README.md#update-geekdocs

Docs are deployed via Github action when merged to main.

Thanks @fstab, i think with the pointers you provided we would be able to have a documentation in place in no time!


[Feature]

Description
addition of abstract background in components[background]
Screenshots
No response
Checklist

[X] I have checked the existing issues.
[X] I follow Contributing Guidelines of this project.\
[x] I am a GSSOC'24 contributor.
[ ] I am a IWOC'24 contributor.
[ ] I am a JWOC'24 contributor.
[ ] I am a SWOC'24 contributor.

Code of Conduct

[X] I agree to follow this project's "Code of Conduct".

Pls provide the supporting screenshot @Dsmita03

screenshot of the background:

2)Screenshot (after applying js)

Okay go ahead @Dsmita03


unable to use kubeless cli

Is this a BUG REPORT or FEATURE REQUEST?:
BUG REPORT
What happened:
I'm trying to deploy a  function on a k3s cluster using kubeless cli but on giving the following command
kubeless function ls
i'm getting the following error
FATA[0000] Get https://localhost:6443/apis/kubeless.io/v1beta1/namespaces/default/functions: x509: certificate signed by unknown authority
What you expected to happen:
It should list the functions
How to reproduce it (as minimally and precisely as possible):
just type the above command
Anything else we need to know?:
I'm able to deploy the function using kubeless ui but i'm unable to deploy it through kubeless cli.
Client Version: version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.1-k3s.4", GitCommit:"52f3b42401c93c36467f1fd6d294a3aba26c7def", GitTreeState:"clean", BuildDate:"2019-04-15T22:13+00:00Z", GoVersion:"go1.12.1", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.1-k3s.4", GitCommit:"52f3b42401c93c36467f1fd6d294a3aba26c7def", GitTreeState:"clean", BuildDate:"2019-04-15T22:13+00:00Z", GoVersion:"go1.12.1", Compiler:"gc", Platform:"linux/amd64"}
Environment:

K3s version : v0.5.0
Kubeless version (use kubeless version): v1.0.3
Cloud provider or physical cluster: physical cluster

Hi @rmodpur,
kubeless (and also kubectl) get the certificates to access the API server from the Kubernetes config (~/.kube/config by default). That may not be the case for k3s. I have never tried that platform. Are you able to access that cluster using kubectl? What information is placed in the kube config related to the certificate?

Yes, k3s has it's own kubectl which is exactly the same as that of k8s. I'm able to list the functions deployed through the kubeless ui using the command k3s kubectl get function. No config file was created in the ~/.kube directory on installing kubeless so I created a file named config manually and pasted the contents of k3s kubectl config view in it.
apiVersion: v1
clusters:

cluster:
certificate-authority-data: DATA+OMITTED
server: https://localhost:6443
name: default
contexts:
context:
cluster: default
user: default
name: default
current-context: default
kind: Config
preferences: {}
users:
name: default
user:
password: 9bc556ea8906dc556b6756852cf168d4
username: admin

so were you able to make the kubeless CLI work creating the file ~/.kube/config with that information?

No, the kubeless cli is still not working. I'm getting the same error

I have the same problem.  Don't know how to resolve.

This is due to incorrect parameters in ~/.kube/config. Instead of using the output of kubectl config view, which omits the CA data, as you can see in the pasted file, use kubectl config view --flatten --minify, which will include the CA data.
So kubectl config view --flatten --minify > ~/.kube/config will work. Or in the OPs case k3s kubectl config view --flatten --minify > ~/.kube/config.


[SUPPORT] Trino returns 0 rows when reading Hudi tables written by Flink 1.16

Tips before filing an issue

Have you gone through our FAQs?

Join the mailing list to engage in conversations and get faster support at<EMAIL_ADDRESS>

If you have triaged this as a bug, then file an issue directly.

Describe the problem you faced
TL;DR Trino returns 0 records from hudi table when I can see data in object store.
I am writing hudi tables in ABFS  - reduced code
        DataStream<RowData> fares = env.addSource(new TaxiFareGenerator()).map(
                event -> GenericRowData.of(
                        event.getRideId(),
                        event.getDriverId(),
                        event.getTaxiId(),
                        event.getStartTime(),
                        event.getTip(),
                        event.getTolls(),
                        event.getTotalFare()//,
                        //    event.getPaymentType()
                ));

        String targetTable = "TaxiFare";
        String outputPath = String.join("/",basePath, "hudi4");
        Map<String, String> options = new HashMap<>();

        options.put(FlinkOptions.PATH.key(), outputPath);
        options.put(FlinkOptions.TABLE_TYPE.key(), HoodieTableType.MERGE_ON_READ.name());

        HoodiePipeline.Builder builder = HoodiePipeline.builder(targetTable)
                .column("rideId BIGINT")
                .column("driverId BIGINT")
                .column("taxiId BIGINT")
                .column("startTime BIGINT")
                .column("tip FLOAT")
                .column("tolls FLOAT")
                .column("totalFare FLOAT")
                .pk("driverId")
                .options(options);

        builder.sink(fares, false);
        env.execute("Hudi Table");

I sync these tables to HMS using Hudi-Sync-Tool.
2023-06-01T13:15:09,757 INFO [main] org.apache.hudi.hive.HiveSyncTool - Sync complete for **hudi5_ro**
2023-06-01T13:15:09,757 INFO [main] org.apache.hudi.hive.HiveSyncTool - Trying to sync hoodie table hudi5_rt with base path<EMAIL_ADDRESS>of type MERGE_ON_READ
2023-06-01T13:15:11,977 INFO [main] org.apache.hudi.hive.HiveSyncTool - Sync table hudi5_rt for the first time.
2023-06-01T13:15:17,712 INFO [main] org.apache.hudi.hive.HiveSyncTool - Last commit time synced was found to be null
2023-06-01T13:15:17,712 INFO [main] org.apache.hudi.hive.HiveSyncTool - Sync all partitions given the last commit time synced is empty or before the start of the active timeline. Listing all partitions in<EMAIL_ADDRESS>file system<EMAIL_ADDRESS>user='ispatw', primaryUserGroup='ispatw'}
2023-06-01T13:15:24,755 INFO [main] org.apache.hudi.hive.HiveSyncTool - Sync complete for **hudi5_rt**
2023-06-01T13:15:24,761 INFO [main] org.apache.hadoop.hive.metastore.HiveMetaStoreClient - Closed a connection to metastore, current connections: 0

I can see data streaming into the ABFS location

When I try to query it using Trino my tables have no records

Expected behavior
A clear and concise description of what you expected to happen.
Environment Description

Hudi version : 0.13
trino : 410
Storage (HDFS/S3/GCS..) : ABFS

my table only cotains log* files no base files, why is that?

possibly related to https://github.com/apache/hudi/issues/8038
@codope  could you help me understand how to configure the table for read optimized queries? or is it something that Hudi Sync tool should handle out of the box - Not sure why I am not seeing any rows back.

The compaction is executed async by default every 5 delta_commit on the table, did you have any chance to see the Parquet files already?

The compaction is executed async by default every 5 delta_commit on the table, did you have any chance to see the Parquet files already?

@danny0405  no, there were total 6 commits, no compaction - is there a setting to toggle it, maybe it's turned off by default in Flink? I can also share the .hoodie folder if it helps you understand what's going on.

Can you show me the running job DAG on the webpage, that would helps a lot.

@danny0405 I tried a repro and looks like it compacts now after 5 commits!  I guess my cluster might have been flaky during last retry. I can also read the tables now!

That's cool, feel free to give us feedback if you got some new issues.


Hitman 2

@dostup2055

Hitman 2. The game doesn't work. Black screen and "compiling shaders". (DXVK_HUD = full). Maybe there are problems with the video output?
hitman2_d3d9.log

This game is now able to launch and get ingame. Tho i haven't played too much around.
I have found one issue tho in my short testing.
If, when you get to the main menu, press start game then it will work fine. But if you instead go into the graphics options first and then press start game it will either freeze or crash.
It seems like when you've been at the graphics options page the game "reloads" the window to apply the settings or something. This is even if i don't actually change any of them.
Here is a video showing the behavior with wined3d where it doesn't crash.
https://youtu.be/nHHJwNfHSDc
d3d9 log and game log (d3d8 log empty)
hitman2_d3d9.log
error.log
I also tried to capture a trace with wined3d if that would show something about the behavior, but the game crashes on launch then so i instead made one with d8vk where it freezes. Hope that helps, else I'll try to get a trace from windows.
https://mega.nz/file/4kpUyS7I#lkQ8kP2FJq5Np6Pw7SJmowsJ4e6mEchb5rXiTga5lPw

I have retested with newest master https://github.com/AlpyneDreams/d8vk/commit/a50de4619a80191d208d73b42c7cc2a10fb4b9e2
The game now instead hangs when you try go into graphics settings and then start the game. Also when you try to quit.

I'm not getting the hangs that @Blisto91 mentioned above, but d8vk performance is really terrible with ANV... whereas WineD3D runs absolutely fine.

I've just tested this on a Steam Deck (Vangogh APU, RADV Vulkan driver) and it seems to run perfectly fine, besides full screen (The game crashes as soon as I boot it up claiming not enough memory, at least when set at 2560x1440. I'll update as soon as I test this on the Deck native screen). It runs amazingly good without any artefact AFAICS.

See also: https://github.com/AlpyneDreams/d8vk/issues/5#issuecomment-895451665

Fixed now in dxvk master, by https://github.com/doitsujin/dxvk/pull/4250. We can now close this issue :tada: .


Update routing practical

[x] Get it to MVP and reproducible
[ ] Polish up, possibly with new all purpose dataset from @mem48

I've updated the releases with the top 500 desire lines from my NTEM model

Great stuff.

Can you update the routing practical to read them in?

Heads-up @mem48 the jump for exercise 4 to 5 below is too hard for students, they shouldn't have to write code like this to do routing:
https://github.com/ITSLeeds/TDS/blob/bae76c88e72b1208a863c316e88b46ba7fa145eb/practicals/6-routing.Rmd#L127-L138

Reproducible example to show how it works with route() currently. Only issues are time and verbose output messages:
# Aim: test route() with otp package (requires external routing engine)
library(tidyverse)
library(opentripplanner)
library(sf)
#> Linking to GEOS 3.10.1, GDAL 3.4.0, PROJ 8.2.0; sf_use_s2() is TRUE
library(stplanr)
#> Warning in fun(libname, pkgname): rgeos: versions of GEOS runtime 3.10.1-CAPI-1.16.0
#> and GEOS at installation 3.9.1-CAPI-1.14.2differ
ip = "otp.saferactive.org" # an actual server
otpcon = otp_connect(hostname = ip,
                     port = 80,
                     router = "west-yorkshire")
#> Router http://otp.saferactive.org:80/otp/routers/west-yorkshire exists
u = "https://github.com/ITSLeeds/TDS/releases/download/22/NTEM_flow.geojson"
desire_lines = read_sf(u)
head(desire_lines)
#> Simple feature collection with 6 features and 9 fields
#> Geometry type: LINESTRING
#> Dimension:     XY
#> Bounding box:  xmin: -1.547 ymin: 53.7065 xmax: -1.2403 ymax: 53.7979
#> Geodetic CRS:  WGS 84
#> # A tibble: 6 × 10
#>   from      to          all drive passenger  walk cycle  rail   bus
#>   <chr>     <chr>     <dbl> <dbl>     <dbl> <dbl> <dbl> <dbl> <dbl>
#> 1 E02002444 E02002443  1374    55        24  1121     0     0   174
#> 2 E02002443 E02002445  1189   100        44   868     4     0   173
#> 3 E02002442 E02002440  1494    83        40  1139    23     0   209
#> 4 E02002442 E02002441  1747   349       168   906    62     0   262
#> 5 E02002447 E02002448  4930    70        36  4162    98     0   564
#> 6 E02006876 E02006875 10314  1854       942  4680   251     0  2587
#> # … with 1 more variable: geometry <LINESTRING [°]>
desire_top = desire_lines %>%
  top_n(n = 3, wt = all)
plot(desire_top)

routes_top_car = route(
  l = desire_top,
  route_fun = otp_plan,
  mode = "CAR",
  otpcon = otpcon
)
#> Most common output is sf

Created on 2022-02-01 by the reprex package (v2.0.1)

See https://github.com/ropensci/stplanr/issues/459

Update on this: updated version of stplanr that should make things simpler submitted to CRAN. Can you test the dev version when you get a chance @mem48 ?

Updated version of stplanr is now on CRAN. Plan to update the practical to take advantage of this update, with over a week to go before the practical.


Link to 0.2 version docs in readme.md

Thanks for the PR!  I've updated it to go to http://docs.rs/flame instead of a specific version.


Some terrible results

Hello:
I've found that the model performs well on a single object, but the results of the generative diffusion model are very poor when there are multiple objects.
seg map:

dept map:

results:

two abnormal results:

The purple one is the bookcase, and it cannot be generated correctly
Desk and chair are burrly.

How could I fix it? Thanks

Please strictly follow our code and pipeline. 1) Dont use customed layout whose distribution is too different from dataset itself e.g. size, ratio, etc; 2) your map contains white area and invalid depth values; 3) please try different text instructions which are crucial to the performance.

thanks for your reply.


[Bugs] Synch Failure with some SQNs

Describe the bug
The problem occurrs in authentication synchronization. The UE sends its SQN value as part of resynchronization process. But the UDM does not use these values in authentication request and results in authentication reject
To Reproduce
Steps to reproduce the behavior:

Start all NFs + gNB
Start UE with SQN stored as 0b604a81eca8, f1e8a523a36d and 16f3b3f70fc2. See the 3GPP TS 35.208 version 15.0.0 Release 15 for more test data
Run registration
Get authentication reject after receive two authentication request request and authentication failure(synch failure)

Expected behavior
In resynchronization process UDM should get valid SQN(48bits) from UE and update it to UDM.
Root cause
In udm/producer/generate_auth_data.go. The variable SqnMAx limit the range of SQN accepted by UDM.
const (
	SqnMAx int64 = 0x7FFFFFFFFFF
)

Environment :

free5GC Version: 3.0.5
OS: Ubuntu 18.04
Kernel version: 5.0.0-23-generic
go version: go version go1.14.4 linux/amd64

Trace File
PCAP File
free5gc_synch_failure.zip
Pull request
https://github.com/free5gc/udm/pull/5 for the fix.

I added the above fix locally, still in my case its not working. Also SQN in authentication request after sync failure is in range
sync_failure.zip

Did you compile again the udm.go?

i did make clean and make all

Hi @anvi55, did you use an external emulator?  What the value of SQN send by UE to free5gc?

I am using real UE oneplus8 mobile
On Thu, 29 Jul 2021, 00:04 Lucas Baleeiro Dominato, <
@.***> wrote:

Hi @anvi55 https://github.com/anvi55, did you use an external emulator?
What the value of SQN send by UE to free5gc?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/free5gc/free5gc/issues/219#issuecomment-888530492,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AU7EYMFZDL2FJBMLOXRNIOTT2BES7ANCNFSM5AOFR67Q
.

@baleeiro17
Thanks for the PR!


[bug] Remove Elon Musk

Bug Report
Pump and dump:
Musk writes a twitter and manipulates the market.
Current behavior
Musk uses his network to make himself richer based on people.
Expected behavior
Musk should NOT be able to create such a big fuss on the market.
Steps to reproduce:
Write a tweet and see madness.

He's not trying to make himself richer dude. He's trying to make the world a better place. Currency adoption is an extremely complex issue, like changing automobiles from combustion to electric, like starting a civilisation on Mars.

Stop looking at what 'looks' obvious for you on the surface and start thinking about the big things that are happening and the reason why this is happening. If you don't want to look that far, this is not a problem but then stop interfering

Mr Elon is trying to help...

Why is this even here, anyone managing the bug reports? Please clean this up

He can't change his level of fame or influence. (Which he's earned)
His intentions seem noble and honest, yours seem to have an agenda.
There are many people working on this project who have conflicts and personal interests.

Points for "Write a tweet and see madness."
We're not his boss, though, this is something which occurs because of the public perception of him.
Closing as well out of our ability to affect as open source contributors.


Update freesmug-chromium to 57.0.2987.98

Version bumping Chromium browser

[x] brew cask audit --download {{cask_file}} is error-free.
[x] brew cask style --fix {{cask_file}} reports no offenses.
[x] The commit message includes the cask’s name and version.

I know this isn't the right place to request an update, but there's a new update out to freesmug-chromium. Newer version is now freesmug-chromium 57.0.2987.110.

@dnivi3 Thanks for pinging. Have submitted update as #31065


Update icon for local cluster to blue cow

#2942
Existing logo was generic k3s image. This pr detects if the current cluster is local and updates the logo accordingly.
Takes advantage of new BrandImage component and suse green theming.

@neillsom I wanted to get this in, so I went ahead and made some changed - I made Vince's fix but also changed to use an inline svg, so we can change the color.
It looked a little odd in the slide-in menu having the primary hover color with the logo, so with this approach we can override the color on hover to be the correct color for the light/dark theme.
The logo was two-tone before - now's it just primary, but I think that is more consistent with the other icons in the slide-in menu.
Take a look at the change I made and see what you think.


What is going on with documentation/versions?

Hi,
It's really tough to decipher which documentation goes with which version of wavesurfer. The main docs site mentions something about version 2, but all the docs on github direct to version 1. The docs for version 2 seem autogenerated and not really up to par for using the library.
And if I look at the changelog, I see now version 4?
Which version do the samples use?
Any help is appreciated, and if I can get an idea of what needs to change, I am happy to issue a PR or two.

there is only upgrade documentation for v2, so that's why it stands out (as latest version) on the site.
all docs on github direct to version 1.0? where do you see that?
currently the latest is v4.6.0

This documentation on https://wavesurfer-js.org/docs/methods.html is for the latest version? Or version 1?
It's just not clear with that Version 2 link sticking out and saying "This is the new version"
I am also confused as to how the latest version is v2 but then you say the latest is v4.6.0
If section on the gh-pages site that says "Version 2" is really about upgrading from version 1 to version 2, then it should explicitly say that.  As it is now, it seems like it's an upcoming version, different from the rest of the documentation on the site.
Maybe it's just me, but I found this incredibly confusing.

@phillyslick any help on editing these docs would be great! See https://github.com/katspaugh/wavesurfer.js/tree/gh-pages/v2 (the directory is called v2 because it's v2 of the website but that shouldn't show up in the live docs afaik)


Proxy configuration for plugins (Bing, Kaldi)

hi,
we are running UniMrcp behind a corporate proxy which is needed to access the internet from our DCs, but I cannot seem to configure unimrcp to use the proxy.
[root@dev-mrcp ~]# https_proxy=**** curl -X GET "https://westeurope.api.cognitive.microsoft.com/sts/v1.0/issuetoken"
{ "statusCode": 404, "message": "Resource not found" }

[root@dev-mrcp ~]# curl https://westeurope.api.cognitive.microsoft.com/sts/v1.0/issuetoken -i
curl: (7) Failed connect to westeurope.api.cognitive.microsoft.com:443; Network is unreachable

2019-03-08 13:53:49:221305 [INFO]   Initiate HTTP auth <BingSR> [https://westeurope.api.cognitive.microsoft.com/sts/v1.0/issuetoken]
2019-03-08 13:53:49:222224 [NOTICE] MRCP Server Started
2019-03-08 13:53:49:478760 [INFO]   Set HTTP request timer 30 sec for <BingSR>
2019-03-08 13:53:50:483054 [WARN]   Request failed: Network is unreachable (101) for HTTP auth <BingSR>

It seems that http(s)_proxy env variable is ignored by UniMrcp or the plugin(s)

Only Google plugins currently support HTTP proxy.

Closing this issue as support for HTTP proxy has been implemented for Bing and Kaldi plugins for a while now.


Prune metrics: others 11/DoNe

What does this PR do?
Prune remaining metrics
follow-up #6505
Before submitting

[ ] Was this discussed/approved via a GitHub issue? (not for typos and docs)
[x] Did you read the contributor guideline, Pull Request section?
[x] Did you make sure your PR does only one thing, instead of bundling different changes together?
[x] Did you make sure to update the documentation with your changes? (if necessary)
[x] Did you write any new necessary tests? (not for typos and docs)
[x] Did you verify new and existing tests pass locally with your changes?
[x] Did you update the CHANGELOG? (not for typos, docs, test updates, or internal minor changes/refactorings)

PR review
Anyone in the community is free to review the PR once the tests have passed.
Before you start reviewing make sure you have read Review guidelines. In short, see the following bullet-list:

[x] Is this pull request ready for review? (if not, please submit in draft mode)
[x] Check that all items from Before submitting are resolved
[x] Make sure the title is self-explanatory and the description concisely explains the PR
[x] Add labels and milestones (and optionally projects) to the PR so it can be classified

Did you have fun?
Make sure you had fun coding 🙃

quick question: why some of them will be removed in v1.4 and others in v1.5?

as you can see this marked for v1.4 removal was moved internally already for v1.2
so there are kind of two waves of refactoring>>deprecation

we moved some functioning from general classification.py to their one modules
we moved all to torchmetrics package