Open Source the Live Share extension on Visual Studio Code

It is very disheartening that Live Share is under a restrictive license. LICENSE-CODE is also very misleading :(
I did some digging around myself and know there are things that might not exactly be something you'd want eyes on (e.g. testing, and internal work/domains). That's okay.
Considering that Visual Studio Code itself is based on "Visual Studio Code - Open Source", then afterwards receives Microsoft telemetry / branding / relicensing post-build (source), and the extension gallery requires use of an official Microsoft-created Visual Studio Code install (it seems), I see no reason for Live Share to not work similarly, if needed at all.
And for that internal stuff/testing, my mind immediately goes to Live Share Audio. Perhaps it could be split up.
I really, really would love to contribute and would love to see this extension flourish, but I believe the restrictive license Live Share is currently under only causes harm.  There are great developers who are involved in both making Code OSS and countless extensions.
From the amount of people who I've seen who have taken the time to give this repository a star, many of them I'm sure would be willing to help out and not only suggest something new, but help the backlog of feature requests, and make new plugins for Live Share.
The earliest issue I've found of this was from 2018, with plans for it in the future (see #534). There was another issue in 2019 (#2953), just saying "not yet".
It's now been three to four years with no major word since then. Whatever they are, there are so many great possibilities that could happen from a switch to an open source license like MIT. Please make those plans a higher priority.

Please do not close this. It disappoints me that this has gotten no response.

@fubaduba Hi! Sorry for the ping, but it's been about two weeks and this unfortunately has not received a response. I'm not sure who I should ping, but you've been the most recently active.
Thank you!

It would be amazing if this extension were to become free-software, under the same license as VS Code OSS.

@coodoo Hey! Thanks for reaching out. While Live Share is still in preview, the source is highly volatile 😄Because of this, we're not quite ready to accept contributions or support the APIs that folks might begin to depend on, and so we haven't open-sourced yet. For now, we're trying to focus on addressing all of the great feedback we've been getting during the preview, and make sure that we're nailing the collaboration experiences that we set out to.
We'll definitely share plans openly moving forward, so stay tuned, and let us know if you have any other questions. Thanks!

https://github.com/MicrosoftDocs/live-share/issues/534#issuecomment-397009693
@lostintangent Doesn't seem like it's in preview anymore. Your comment was from 2018: enough time for the code to become stable. You've had nearly three years to get ready to accept contributions. It's time to release the source code! Please take this feedback as “great feedback”.

Indeed, it would be amazing for Live Share to be open-sourced. This would in my estimation seem to be in the best interests of Microsoft, as it will help facilitate a vibrant and inclusive collaborative coding ecosystem.
You can do it!

@Davsterl Hello! Sorry to ping you, but this is at the very bottom of the first page of issues as I'm writing this sentence. It's very unfortunate that there has been no official word yet :(
You've been the most recently active, which is why I'm pinging you specifically. If you can direct this to the appropriate person and/or team, that'd be great.
Thank you!

Hey @jbmagination my sincere apologies for the delayed response. In all honesty, your issue prompted a couple of weeks of discussions internally for us on how we want to tackle open sourcing and where we see it going. Unfortunately I don’t have all the answers today. However, there are things I can say.
What we do know is that we want to revisit the idea of what open sourcing would mean for Live Share and it’s architecture, development pattern and community engagement. It would require a level of product polish we hope to achieve and then think about it strategically from there.
While this may not sound super committal, what I can say is, that it actually is a super important thought in our head and we will be putting it in our six months horizon to strongly consider.
Thank you again for your patience. I will leave this issue open for updates and tracking.
Filisha Shah, PM Live Share.

Any progress on this? We've been waiting for a while to contribute to this and if it's not made in such a way where we can we'll have to build our own...

Hi there! It's almost been six months, so I'm making this comment now so when the time comes the team is aware there's still interest from at least one person. You said you'd consider it; if you're willing to share the decision the team came to once the decision is made, I'd be interested in hearing it!

+1 On here - I'd like @fubaduba to follow up on this as well please - Let's put some action behind the words.

It would be amazing if Microsoft could actually push a well-thought-out, open-source protocol for this. My hope for teletype dies yesterday when the news of Atom's inevitable demise was announced (it was my main fear when MS bought Github).
In a world increasingly relying on remote work, the experience of live share is unrivaled for remote pair programming. Getting this protocol implemented in more tools would allow for the same level of collaboration for so many more developers. My preference is Sublimetext (now that Atom is dying) - but since the remote pair programming experience, there is ... lacking, I often have to switch to VS code just for those sessions.
Please consider putting some effort into publishing a standard for this - as well as an open-source implementation in a C-compatible library to speed up adoption in other editors 🙂

I'd love to see this as well, even if it was in a "PRs not welcome" state.

@fubaduba : any update?

@d-Pixie Why do you think something like Rep.lit won't work for remote pair programming? It has multiplayer built in by default.
+1 +1 +1 on the Open Source question.
I don't think they're going to do it though, it's been 4 years..
I think I'm going to build my own open source version - Anyone else want to help ?

@fubaduba, any news?
Your last comment was from almost 1 year ago, and I guess I'm not the only one interested in knowing what's in the plans :)

I think their lack of reply means that this is dead in the water. I don't see MS Opensourcing this

Hi All! Thank you for your patience on this issue. We are unfortunately not going to be able to provide any better of an update on whether we have plans to open-source Live Share in the future. What I can say is that given our current feature and bug priorities we're unlikely to do this in the next 6 months.
Having said this, we are working to move collaboration more natively into Visual Studio Code and this maybe something we address as we explore that area.

It would require a level of product polish

Why would open sourcing require a better level of product polish?
If you open source, you could write a wish list, and get help from the community to polish your documentation etc.

I think everyone should realize that this won't ever happen and we should close this issue.

It would require a level of product polish we hope to achieve and then think about it strategically from there.

No it does not. All the community is asking you to do is to share the code and provide an open source license. There is literally no other expectations towards you.

@fubaduba I would also appreciate the open-sourcing of this technology.
Visual Studio Code itself is open source and if thi was open-sourced, it would be usable on OpenVSX-based platforms, notably VSCodium and code-server (the latter of which I use daily).
The community is not asking for any kind of code polish - on the contrary, they want to polish it themselves.
There are no open source alternatives and you could be the first to provide one.

Visual Studio Code itself is open source and if thi was open-sourced, it would be usable on OpenVSX-based platforms, notably VSCodium and code-server (the latter of which I use daily).

And there you have it. That's precisely the reason why they won't open source this extension anytime soon.

And there you have it. That's precisely the reason why they won't open source this extension anytime soon.

Well, no one is asking them to host the service for other Code-based products, only to make the source available.

Well, no one is asking them to host the service for other Code-based products, only to make the source available.

What I mean is that it's in Microsoft's best interest to make sure that key extensions like this are not available in other editors, in order to give Microsoft's official binaries a competitive advantage over forks. Forks were never the reason behind Microsoft's decision to open-source VSCode. The sole reason was to have a huge community of unpaid developers working to improve Microsoft's product so as to secure its market leadership position.
If you want software that isn't only open-source, but also libre/open-hearted, then you're looking in the wrong place.


Map Viewport Does not Correctly Update

Bug
The viewport is not correctly updated. When clicking around the map, refreshing, or changing incidents, you are zoomed back to a previous viewport.
To Reproduce
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

Expected behavior
Every time a user changes viewports (e.g. zoom in, zoom out, pan, taken to a case), the viewport AND incident_id should be saved in user_users.states. If the user changes incidents, the viewport should be updated to the last viewport for that incident.
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):

OS: [e.g. iOS]
Browser [e.g. chrome, safari]
Version [e.g. 22]

Smartphone (please complete the following information):

Device: [e.g. iPhone6]
OS: [e.g. iOS8.1]
Browser [e.g. stock browser, safari]
Version [e.g. 22]

Additional context
Add any other context about the problem here.

Thinking about what the behaviour should be here.   Proposal:

Upon any change to the map or the URL, record the map params and the URL to user_users.states, by incident ID.
Restore these only when the users changes incident via the incident menu.

This allows users to continue to have multiple tabs open with different views, without interference.
Is that too minimal? Also do something on page refresh?

@wodow That was the basic idea. Just to reflect what I think you're proposing:

I am in Big Hurricane incident.
I go to the map view of "Work". The map starts on the entire united states.
I zoom into Denver, Colorado. Then I pan north to Longmont, Colorado. Because the URL has not changed, the map params are not updated in user_users.states.
I click the "Table" view of cases, and then click the "Map" view again. Question: There has been no change in URL. Would the map zoom to the United States or Longmont?
I repeat step 3. Then I click "Dashboard," then "My Organization," before clicking "Work" again. This requires a change of URL, which would presumably record the map viewport and incident_id.
I change incidents to "Small Tornado" and click "Work." The map defaults to the United States.
I zoom into Nashville, TN.
I switch back to "Big Hurricane" incident and click "Work." It should zoom to Longmont, CO, correct?

In this scenario, the only issue we need to handle is when we switch away from the map without changing URLs, (e.g. when the user clicks the Table vs. Map view). Does that seem right to you?

in discussion, discussed that the application already does the stuff in https://github.com/CrisisCleanup/crisiscleanup-3-web/issues/676#issuecomment-626696669 but likely not on enough client-side events => look into that.

prelim investigation: PATCH to /users is triggered upon map pan, map zoom, switch between map view and table of work, but not open or close of a case.
However, restoring the users states doesn't work consistently within or between incidents, so will try to fix that behaviour before adding more events.

There are at least two parts to this:

the local instance of the current User isn't updated when the state is updated, only the backend record is. This means the map can be restored from local outdated data. I think this will be fixed by https://github.com/CrisisCleanup/crisiscleanup-3-web/pull/690 (if acceptable).
user_users.states only accommodates a single incident. will follow up on this...

The current single incident setup:
the user_users.states JSON column stores records of this shape:
{
    "filters": {
        "flags": {
            "data": {},
            "name": "flags"
        },
        "fields": {
            "data": {
                "debris": false
            },
            "name": "fields"
        },
        ...
    },
    "incident": 158,
    "showingMap": true,
    "mapViewPort": {
        "_northEast": {
            "lat": 44.96479793033104,
            "lng": -27.421875000000004
        },
        "_southWest": {
            "lat": 8.581021215641854,
            "lng": -117.77343750000001
        }
    },
    "showingTable": false,
    "appliedFilters": {}
}

This means it can only hold work map & filter state for the most recently touched incident, not multiple (unless I am missing something).
Alternatives:

Maintain this shape and augment with a history subfield, which would map incident ID to a record of the same shape. Replace the top-level fields from the history subfield when the user switches incident.
Replace with a top-level mapping of incident ID to records of the exsting shape, and always address state by incident ID.

Second option is cleaner but (a) invalidates existing data (without JSON migration), (b) likely requires more changes to the code.

adding @tabiodun for second opinion

@wodow The states field is free form JSON, so you can change it as you want. I would say we can add a top level ‘incidents’ key that stores the the per incident settings, and just have a key that says what the current incident is. Which is kind of like of like option 2

Also that would help with backwards compatibility for now.

My bad, linked the wrong issue. :grimacing:

reopening as https://github.com/CrisisCleanup/crisiscleanup-3-web/pull/693 throws an error

reopened for review


Fix settings scope

For https://github.com/microsoft/vscode-jupyter/issues/11422

Codecov Report

Merging #12457 (80c6160) into main (69c042a) will decrease coverage by 0%.
The diff coverage is n/a.

:exclamation: Current head 80c6160 differs from pull request most recent head de6ab98. Consider uploading reports for the commit de6ab98 to get more accurate results

@@          Coverage Diff           @@
##            main   #12457   +/-   ##
======================================
- Coverage     69%      69%   -1%
======================================
  Files        495      495
  Lines      31132    31128    -4
  Branches    4905     4905
======================================
- Hits       21758    21726   -32
- Misses      7532     7560   +28
  Partials    1842     1842

Impacted Files
Coverage Δ

src/platform/common/configSettings.ts
83% <ø> (-1%)
:arrow_down:

src/platform/common/types.ts
100% <ø> (ø)

...ernels/jupyter/session/requestAgentCreator.node.ts
60% <0%> (-40%)
:arrow_down:

src/platform/common/configuration/service.base.ts
61% <0%> (-15%)
:arrow_down:

.../notebooks/debugger/debugLocationTrackerFactory.ts
96% <0%> (-4%)
:arrow_down:

...nels/jupyter/session/jupyterRequestCreator.node.ts
53% <0%> (-4%)
:arrow_down:

...c/kernels/jupyter/session/jupyterSessionManager.ts
58% <0%> (-3%)
:arrow_down:

...otebooks/controllers/controllerPreferredService.ts
70% <0%> (-3%)
:arrow_down:

...tive-window/debugger/jupyter/kernelDebugAdapter.ts
60% <0%> (-2%)
:arrow_down:

src/kernels/helpers.ts
70% <0%> (-2%)
:arrow_down:

... and 6 more

we move them to that scope, we could break them for users who have already configured them that way in their

agreed, perhaps we should migrate them to user settings if and when we come across them.

agreed, perhaps we should migrate them to user settings if and when we come across them.

I think we should avoid writing new settings to the user's settings, and here it will change the behavior in other workspaces. Do you want to write a different value to the user's settings every time they open a new workspace where it's configured differently?

@roblourens I've updated the PR to

change from machine to Application
if we have resource, then remove it so that its setup as the default window

Will revisit the settings that have window/resource, personally I think most of them just need to be application/machine instead of window/resource. But we can revisit that later based on the usage telemetry & based on the results possibly migrate them to the user settings file.

@roblourens I had to resolve a merge conflict


Add mechanics to bridges

This is the wormhole / portal / teleporter approach laid out in #849.
Fixes #849.
Status

[x] add StructureKind::Wormhole
[x] add and update MapGeometry::wormhole_index
[ ] ensure signals pass through wormholes
[ ] ensure units can walk over wormholes

Closing this out in favor of a fully 3D graph-based approach. The portals are too buggy.


Change links under "Docs" menu on https://cucumber.io/docs

Since adding the Cucumber docs to the SmartBear site, there is a menu option "Docs" that offers several links to the actual docs:

The arrow > goes to https://cucumber.io/docs/cucumber/ - which is a good place to start
Installation
Gherkin Syntax
API Docs -> goes to API automation tools that are not Cucumber
3rd Party Tools -> goes to tools that for the most part are not cucumber.

I think nr 4 and 5 should not be part of this high level menu.
Instead I would like to include:

Guides and/or 10 minute tutorial
Community and/or FAQ
Alternatively, "Cucumber" could be one of the links and the arrow > could go to docs landing page.

If we have data on which pages people look for that would also be helpful.

I searched in IntelliJ, and found 100+ matches for where this HTML should be changed.  In addition, all of the .html files are read-only -- is there a single location where we can update this?
Another opinion:  I feel the FAQ should be moved out of the "Community" section and into its own section, with two children: Cucumber FAQ and FAQ about related tools.  It is easier to access by end-users this way.  My $0.02.

Hi @mlvandijk, are you thinking something like this? Would you want the API or 3rd Party links to be anywhere in this menu?

@helenjoscott Yes, something like that. I don't think API and 3rd party links should be in this menu. Note I'm not sure that these links can be changed in this project; they might have to be changed in the SmartBear website.
Also I agree with @annabaker that FAQ should be taken out of Community. But for restructuring please have a look at https://github.com/cucumber/docs.cucumber.io/issues/474

Well I mocked it up and I seem to have managed to change them... I think. I can do a PR and someone with some knowledge (which isn't me) can take a look?

Closed by #528


fix: updating workflow comments

:tada: This PR is included in version 1.1.1-dev.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:

:tada: This PR is included in version 1.1.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


need help!

hi, thanks a lot for the development - very cool, I'm a novice data analyst! For some reason, I can't decode the encrypted file. What could be the mistake, can you help?
the code looks like this :

Encoding - python vangonography.py -cli -e -c "C:\Users\vshen\OneDrive\Desktop\qwe.jpg" -f "C:\Users\vshen\OneDrive\The worker стол\IT\DOCER\DOCKER.txt " -o "C:\Users\vshen\OneDrive\Desktop\IT\DOCER" --key KET --encrypt

Decoding:
python vangonography.py -cli -d -c "C:\Users\vshen\OneDrive\Desktop\IT\DOCER\Cover_txt_encrypted.png" -o "C:\Users\vshen\OneDrive\Desktop\IT\DOCER" --key KET --decode

I have an encoded file at the output

I have an encoded file at the output

Hey man, yeah, the encryption process doesn't work yet, I wanted to do it but then I started working on other projects and I forgot about it.
I think there was some kind of problem with the encoding process rather than the decoding but I couldn't quiet figure it out and abandoned it. It's not too hard tho, if I'll ever get back onto it I'll easily fix it.
 Thank you for the bug report btw and sorry for it not working.

Please did you ever fix the encryption part?

Please did you ever fix the encryption part?

Hi, no I yet have to. I've been really busy with the last month of school, playing guitar and now I'm working (as a programmer).
I don't really got much time other than the evening, when I usually hang out, but one of this days I'mma fix everything and let you know.

hi, I'm so sorry I haven't fixed it yet, I failed a class and had to study hard, got my exam on the 26th and 27th, after that I hope I'll be able to work on this amazing project again.
In the meanwhile, you can try to mess with it and ask me questions about it - if you need to - on my discord.
Thanks for understanding and hope you're passing a great summer!

Good luck
Le sam. 17 août 2024, 23:21, Joshua | Tommaso @.***> a
écrit :

hi, I'm so sorry I haven't fixed it yet, I failed a class and had to study
hard, got my exam on the 26th and 27th, after that I hope I'll be able to
work on this amazing project again.
In the meanwhile, you can try to mess with it and ask me questions about
it - if you need to - on my discord.
Thanks for understanding and hope you're passing a great summer!
—
Reply to this email directly, view it on GitHub
https://github.com/JoshuaKasa/van-gonography/issues/7#issuecomment-2295001747,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A6XXAF2AHP4GU32P7UK544DZR7EGPAVCNFSM6AAAAABEOK5FLGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOJVGAYDCNZUG4
.
You are receiving this because you commented.Message ID:
@.***>


ord server command is not working

ord server is not working although I run bitcoind -txindex working

Is Bitcoin Core running on the same machine?

Yes, it's running on same machine.
On Sun, Oct 1, 2023 at 6:52 AM raph @.***> wrote:

Is Bitcoin Core running on the same machine?
—
Reply to this email directly, view it on GitHub
https://github.com/ordinals/ord/issues/2480#issuecomment-1741867103, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AUP26WTJVKMBXAZREIECANDX5CIARANCNFSM6AAAAAA5K4GHFU
.
You are receiving this because you authored the thread.Message ID:
@.***>

Does bitcoin-cli work normally. For example bitcoin-cli getblockchaininfo?

Yes, it does!
On Tue, Oct 3, 2023 at 7:45 AM raph @.***> wrote:

Does bitcoin-cli work normally. For example bitcoin-cli getblockchaininfo?
—
Reply to this email directly, view it on GitHub
https://github.com/ordinals/ord/issues/2480#issuecomment-1743874771, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AUP26WR267GOCGLY7PXE4JDX5M7YXAVCNFSM6AAAAAA5K4GHFWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONBTHA3TINZXGE
.
You are receiving this because you authored the thread.Message ID:
@.***>

[image: image.png]
On Tue, Oct 3, 2023 at 1:40 PM Super Dev @.***> wrote:

Yes, it does!
On Tue, Oct 3, 2023 at 7:45 AM raph @.***> wrote:

Does bitcoin-cli work normally. For example bitcoin-cli getblockchaininfo
?
—
Reply to this email directly, view it on GitHub
https://github.com/ordinals/ord/issues/2480#issuecomment-1743874771,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AUP26WR267GOCGLY7PXE4JDX5M7YXAVCNFSM6AAAAAA5K4GHFWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONBTHA3TINZXGE
.
You are receiving this because you authored the thread.Message ID:
@.***>

Hmm, this is a weird error.
Does any other ord command work, like ord index run or ord wallet create?

No.
On Wed, Oct 4, 2023 at 5:51 AM raph @.***> wrote:

Hmm, this is a weird error.
Does any other ord command work, like ord index run or ord wallet create?
—
Reply to this email directly, view it on GitHub
https://github.com/ordinals/ord/issues/2480#issuecomment-1745706932, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AUP26WVXN66O7JDWGBTCRZ3X5R3GZAVCNFSM6AAAAAA5K4GHFWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONBVG4YDMOJTGI
.
You are receiving this because you authored the thread.Message ID:
@.***>

No.

What does ord wallet create do?

[image: image.png]
On Wed, Oct 4, 2023 at 11:49 AM so7ow @.***> wrote:

No.
What does ord wallet create do?
—
Reply to this email directly, view it on GitHub
https://github.com/ordinals/ord/issues/2480#issuecomment-1746047834, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AUP26WV7ONUUNYUMHBJAFPLX5TFCXAVCNFSM6AAAAAA5K4GHFWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONBWGA2DOOBTGQ
.
You are receiving this because you authored the thread.Message ID:
@.***>

[image: image.png]
On Wed, Oct 4, 2023 at 11:58 AM Super Dev @.***> wrote:

On Wed, Oct 4, 2023 at 11:58 AM Super Dev @.***> wrote:

[image: image.png]
On Wed, Oct 4, 2023 at 11:49 AM so7ow @.***> wrote:

No.
What does ord wallet create do?
—
Reply to this email directly, view it on GitHub
https://github.com/ordinals/ord/issues/2480#issuecomment-1746047834,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AUP26WV7ONUUNYUMHBJAFPLX5TFCXAVCNFSM6AAAAAA5K4GHFWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONBWGA2DOOBTGQ
.
You are receiving this because you authored the thread.Message ID:
@.***>

Your images aren't coming through for me

sorry, was sending image on email reply

This is image for running bitcoind -txindex

sorry, was sending image on email reply

And I realized you answered my question in your original post!


Implement missing functions in Interpreter

The interpreter doesn't implement all Power Apps functions yet.
See list of power apps functions:  https://docs.microsoft.com/en-us/power-apps/maker/canvas-apps/formula-reference
List of functions implemented in Interpreter is at: https://github.com/microsoft/Power-Fx/blob/main/src/libraries/Microsoft.PowerFx.Interpreter/Functions/Library.cs
Looking at history for that file is an easy way to spot when new functions were added.
Here's are some good previous examples:

Function
PR

Lookup()
https://github.com/microsoft/Power-Fx/pull/212

Index()
https://github.com/microsoft/Power-Fx/commit/2b16f6faf9ceaf22e7ca268b3c82d60ea2077ef6

Find()
https://github.com/microsoft/Power-Fx/commit/b175c1fea3c276fbcb8f32270def09e531e42f4b

Boolean()
https://github.com/microsoft/Power-Fx/commit/27bd908ec78408704cb2634dd34ebf1919da1e17

Some ideas for good candidates here:
Proper
Color
Count
CountA
ISOWeekNum
Shuffle
SortByColumns
Statistical ones:  StdevP, StdevPT, VarP, VarPT

There is a CountRow function already implemented. Is there any difference between Count and CountRow?

There is a CountRow function already implemented. Is there any difference between Count and CountRow?

This has tripped me up before as well, but it's an Excel thing :-) https://docs.microsoft.com/en-us/power-apps/maker/canvas-apps/functions/function-table-counts
The Count function counts the number of records that contain a number in a single-column table.
The CountRows function counts the number of records in a table.

Currently working on the shuffle function

I was working on the Proper function when I came across to the following:
According to the documentation these are possible syntaxes:
Lower( SingleColumnTable )
Upper( SingleColumnTable )
Proper( SingleColumnTable )

There are no tests in the current implementation covering single-column table scenarios and any test that I run against these syntaxes returns an "did not return a value" error, which probably is a typecheck error according to this comment.
Am I missing something or these scenarios have not been implemented yet?

Functions can have overloads for scalar and tables. We often implement the scalar overload first and the tabular overload separately.


Qemu armv8 m

Closes #15305

contains CI tweak for 0.10.2-rc2
introduces qemu target testing for armv8m
contains fixes that were found necessary to make qemu tests pass on mps2+

CI is green :)

looks good, would be good to cleanup the gitlint & checkpatch issues.

@galak how can we see the logs? I wanted to double-check that qemu tests ran on mps2_an521 :)

@galak how can we see the logs? I wanted to double-check that qemu tests ran on mps2_an521 :)

Such as?
https://app.shippable.com/download/jobConsoles?jobId=5d4b0260bf84b70008d3cdd1

@galak how can we see the logs? I wanted to double-check that qemu tests ran on mps2_an521 :)

It's usually in the third job, and you can find the mps board tests by expanding this section:

I do see the tests in there ^

@andrewboie @galak should we try to merge this before the feature freeze? Then, we have 3 weeks at least, to figure out the need for the workaround for MPS2 targets, but we will be testing ARMv8-M in the mean time.

@galak maybe patch this PR to get the 0.10.2 sdk instead of the rc2?

This is now rebased, after merging the PR that moves to SDK 0.10.2

@dbkinder is right, there needs to be some documentation under boards/boards/arm/mps2_an521
probably just copy-paste with trivial adjustments from some other board's QEMU documentation

@dbkinder is right, there needs to be some documentation under boards/boards/arm/mps2_an521/doc
probably just copy-paste with trivial adjustments from some other board's QEMU documentation
This issue isn't really related to this PR as it didn't add the board target, just modifies it. I think this can go in.

@andrewboie @dbkinder I couldn't find Qemu related doc info in mps2_an385, either, and that platform has been a Qemu target for quite some time. Right, I 've not added the board; I just enabled running tests on Qemu for that one.
Is there a central place where we list all Qemu targets? Maybe there I can add a line or two. Anyway, that can certainly go in as a documentation-fix, during the feature freeze...

@andrewboie @dbkinder I couldn't find Qemu related doc info in mps2_an385, either, and that platform has been a Qemu target for quite some time. Right, I 've not added the board; I just enabled running tests on Qemu for that one.

@ioannisg do you want to open an issue about the missing docs and assign it to @microbuilder

@andrewboie @dbkinder I couldn't find Qemu related doc info in mps2_an385, either, and that platform has been a Qemu target for quite some time. Right, I 've not added the board; I just enabled running tests on Qemu for that one.

@ioannisg do you want to open an issue about the missing docs and assign it to @microbuilder

Yes, here it is: https://github.com/zephyrproject-rtos/zephyr/issues/18154


Add php:8.0 kind

Also, set example PHP runtime to v7.4.

Is the build failure due to this change or something else? It looks like there's a Python 2.7 issue.

Looks to me like there's an intermediate state in an upstream ubuntu security update.   Wait a bit and try again.  It's hitting other pipelines too.

Codecov Report

Merging #5071 (bd8a08d) into master (ed58b23) will decrease coverage by 11.28%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##           master    #5071       +/-   ##
===========================================
- Coverage   81.61%   70.33%   -11.29%
===========================================
  Files         204      204
  Lines        9950     9950
  Branches      447      447
===========================================
- Hits         8121     6998     -1123
- Misses       1829     2952     +1123

Impacted Files
Coverage Δ

...che/openwhisk/core/invoker/LogStoreCollector.scala
0.00% <0.00%> (-100.00%)
:arrow_down:

...core/database/cosmosdb/RxObservableImplicits.scala
0.00% <0.00%> (-100.00%)
:arrow_down:

...ore/database/cosmosdb/cache/CacheInvalidator.scala
0.00% <0.00%> (-100.00%)
:arrow_down:

...e/database/cosmosdb/cache/ChangeFeedConsumer.scala
0.00% <0.00%> (-100.00%)
:arrow_down:

...core/database/cosmosdb/CosmosDBArtifactStore.scala
0.00% <0.00%> (-95.85%)
:arrow_down:

.../openwhisk/core/scheduler/FPCSchedulerServer.scala
0.00% <0.00%> (-95.84%)
:arrow_down:

...sk/core/database/cosmosdb/CosmosDBViewMapper.scala
0.00% <0.00%> (-93.90%)
:arrow_down:

...tabase/cosmosdb/cache/CacheInvalidatorConfig.scala
0.00% <0.00%> (-92.31%)
:arrow_down:

...a/org/apache/openwhisk/http/BasicHttpService.scala
3.33% <0.00%> (-86.67%)
:arrow_down:

...la/org/apache/openwhisk/http/BasicRasService.scala
16.66% <0.00%> (-83.34%)
:arrow_down:

... and 45 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ed58b23...bd8a08d. Read the comment docs.


Fix intermittent test failure

Fix intermittent test failure:
HeartbeatTest.schedulerShouldTerminateOnGC:222 Scheduler failed to terminate after heartbeat was GC'd

merged into develop


Setup alerting for critical Teleport metrics

We need to setup an alerting for following Teleport metrics to keep Teleport health in check.

Name
Type
Component
Description

process_state
gauge
Teleport
State of the teleport process: 0 - ok, 1 - recovering, 2 - degraded, 3 - starting.

teleport_cache_stale_events
counter
Teleport
Number of stale events received by a Teleport service cache. A high percentage of stale events can indicate a degraded backend.

audit_percentage_disk_space_used
gauge
Teleport Audit Log
Percentage of disk space used.

auth_generate_seconds
histogram
Teleport Auth
Latency for generate requests.

backend_read_seconds
histogram
cache
Latency for batch read operations.

backend_write_seconds
histogram
cache
Latency for backend write operations.

dynamo_requests_seconds
histogram
DynamoDB
Latency of DynamoDB API requests.

### Tasks
- [x] Onur to peer with with team atlas to validate the sloth rules
- [x] Ensure that on-call is not paged for the moment, it should only alert to BigMac

grouped into 3 categories:
dynamo, backend and auth generate second
it should be sloth alerts, we accept a certain amount of failures. but if the budget is full then we should get alerted. also review other sloth rules how they define the budget
soft launch with paging during the day. we only want to get paged at night for really critical alerts. also we can tune the tresholds then based on business hour alerts
https://intranet.giantswarm.io/docs/monitoring/slo-alerting/

https://github.com/giantswarm/sloth-rules

Had a sync-up with Puru yesterday. After checking the YAML file and running some tests on Grafana, everything's looking good and working as expected.
Just needs last PR review, then we're ready to merge.

Pr approved by team atlas.


This implementation is not part of the Windows Platform FIPS validated cryptographic algorithms.

[+] Error:
System.Management.Automation.CmdletInvocationException: Exception calling ".ctor" with "0" argument(s):
"This implementation is not part of the Windows Platform FIPS validated cryptographic algorithms."

https://github.com/nettitude/PoshC2_Python/commit/11f326b2e49ee261ee6db0efa96fe8ad52d764d6


⚠ GTru has degraded performance

In 7000aa5, GTru ($GTRU) experienced degraded performance:

HTTP code: 200
Response time: 3269 ms

Resolved: GTru performance has improved in 26a24bb after 21 minutes.


updating test data for v0.2.2

updating the test data after the release so CI will pass

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Please upload report for BASE (release-0.2@1f7ed83). Learn more about missing BASE report.

Additional details and impacted files
@@              Coverage Diff               @@
##             release-0.2     #366   +/-   ##
==============================================
  Coverage               ?   85.69%
==============================================
  Files                  ?       19
  Lines                  ?     1510
  Branches               ?        0
==============================================
  Hits                   ?     1294
  Misses                 ?      139
  Partials               ?       77

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Comments do not match the ascii values

In the index file, you have a mistake in the comments

it should be:
    (code >= 97 /* a */ && code <= 102) /* f */ ||
    (code >= 65 /* A */ && code <= 70) /* F */ ||
    (code >= 48 /* 0 */ && code <= 57) /* 9 */

Hah, whoops, you’re right. Want to work on a PR to fix it?

Cool, I'll open a PR

Thanks, fixed!


Fix interspersed positional arguments in cythonize.py

This is fix for a regression in #2952: in optparse interspersed arguments are on per default, but not in argparse (I was not able to parse this information from https://docs.python.org/3.7/library/argparse.html#upgrading-optparse-code), thus the following
cythonize.py   file1 -a file2
works with optparse but not argparse.
As the native-argparse support for interspersed/intermixed arguments is only available since Python3.7 (https://bugs.python.org/issue14191) we need to emulate it.

Thanks!


Refactor Metric aggregations

As part of #4331, it looks like not all IMetricAggregation implementations support scripting i.e. the Script property
https://github.com/elastic/elasticsearch-net/blob/4adf18a05ee51abdfa16e3e336bcdc40b4e48052/src/Nest/Aggregations/Metric/MetricAggregation.cs#L17
Going through the aggregation builder types in Elasticsearch, whether an aggregation supports scripting, formatting, etc. is controlled by declaring the supported fields on the parser. For example, for MinAggregationBuilder
https://github.com/elastic/elasticsearch/blob/17358b5af7b34a2b9a15846ba672f5a04001fcd5/server/src/main/java/org/elasticsearch/search/aggregations/metrics/MinAggregationBuilder.java#L48
public class MinAggregationBuilder extends ValuesSourceAggregationBuilder.LeafOnly<ValuesSource.Numeric, MinAggregationBuilder> {
    public static final String NAME = "min";

    private static final ObjectParser<MinAggregationBuilder, Void> PARSER;
    static {
        PARSER = new ObjectParser<>(AvgAggregationBuilder.NAME);
        ValuesSourceParserHelper.declareNumericFields(PARSER, true, true, false); <---
    }

   ...

where the bool values are scriptable, formattable and timezoneAware, respectively.
Only the IMetricAggregation that support scripting should allow a Script property to be set. Going through the 7.x Java source, this is the support found

agg name
scriptable
formattable

avg
:heavy_check_mark:
:heavy_check_mark:

cardinality
:heavy_check_mark:

extended_stats
:heavy_check_mark:
:heavy_check_mark:

geo_centroid
:heavy_check_mark:

max
:heavy_check_mark:
:heavy_check_mark:

median_absolute_derivation
:heavy_check_mark:
:heavy_check_mark:

min
:heavy_check_mark:
:heavy_check_mark:

percentile_ranks
:heavy_check_mark:
:heavy_check_mark:

percentiles
:heavy_check_mark:
:heavy_check_mark:

stats
:heavy_check_mark:
:heavy_check_mark:

sum
:heavy_check_mark:
:heavy_check_mark:

value_count
:heavy_check_mark:
:heavy_check_mark:

(timezone aware is not a column because it doesn't look to apply to metric aggs)
(metric aggregations omitted from the list do not support either script or format)
Possible implementation
Derive an IScriptableMetricAggregation from IMetricAggregation, and IFormattableMetricAggregation from IScriptableMetricAggregation
	public interface IMetricAggregation : IAggregation
	{
		Field Field { get; set; }

		[DataMember(Name ="missing")]
		object Missing { get; set; }
	}

	public interface IScriptableMetricAggregation : IMetricAggregation
	{
		[DataMember(Name ="script")]
		IScript Script { get; set; }
	}

	public interface IFormattableMetricAggregation : IScriptableMetricAggregation
	{
		[DataMember(Name ="format")]
		stringFormat { get; set; }
	}

NOTE: Missing should also be changed to object

Code-gen should catch this for v8.


Writing JSON files to the file system

How can I write a JSON file to the file system?
This is the code that throws an error:
  Future<String> get getFilePath async {
    final directory = await getApplicationDocumentsDirectory();
    return directory.path;
  }

  Future<File> get getFile async {
    final path = await getFilePath;
    return File('$path/assets/data/subjects.json');
  }

  Future<File> _saveSubjects() async {
    final file = await getFile;
    String jsonString = '';
    for (var subject in subjects) {
      jsonString += jsonEncode(subject.toJSON());
    }
    return file.writeAsString(jsonString);
  }

the error message reads: [VERBOSE-2:ui_dart_state.cc(157)] Unhandled Exception: FileSystemException: Cannot open file, path = '/Users/timo/Library/Developer/CoreSimulator/Devices/6AC21414-CA4D-4909-94C2-BE0085D6C967/data/Containers/Data/Application/A591B091-4CEE-4F53-8364-F3E770AA7DC2/Documents/assets/data/subjects.json' (OS Error: No such file or directory, errno = 2)
Thank you.

You need to file.create(recursive: true) if the parent directory doesn't exist

the directory exists. I want to take the file and rewrite it.

The parent directory does not exist, which is why you're getting (OS Error: No such file or directory, errno = 2)

could you tell me where I have to add it?


Could not find a set of Noto fonts to display all missing characters. Please add a font asset for the missing characters. See: https://flutter.dev/docs/cookbook/design/fonts[BUG]

Could not find a set of Noto fonts to display all missing characters. Please add a font asset for the missing characters. See: https://flutter.dev/docs/cookbook/design/fonts
To Reproduce
Steps to reproduce the behavior:

Go to https://pub.dev/packages/html_editor_enhanced
Get example code
Run example code
See logs

Expected behavior
no errors under "Done"

Device:
Chrome
This is not critical in debug mode.
But, if I use "flutter build web" and run, I see that Controller.getText () doesn't work and the method immediately breaks down

Any error when you use controller.getText() on release mode? Or does it just fail to do anything?
Also which version of the plugin are you using?

html_editor_enhanced: ^2.1.0+1
Flutter 2.0.6 • channel stable
Dart 2.12.3

That's all I have

The type error is the real issue there. I don't think the fonts affect any of the editor methods and those messages can be ignored.

Seems like handleMessage was receiving null args, probably should check for that in code

Fixed this in the recent commit. If you can, please try using the git dependency to see if your issue is still present. I can't reproduce it.

Thank you. I'll write about the results later

I'm publishing to pub later today. Thanks for the bug report!

Pushed to Pub.


Transactions in other transaction

Hello !
I ran into a problem when creating my own transaction. I have the following logic: a request to the endpoint, then some database manipulation, run celery task: http requests (AsyncClient, httpx) and database manipulation. In my case, I want httpx requests to become transactions, not spans. In my code, i do something like this:

from httpx import AsyncClient
import elasticapm
from elasticapm import get_client, traces

class apm_trace(object):
    def __init__(
        self,
        transaction_type: str,
        transaction_name: str,
        context: dict | None = None,
        trace_parent=None,
        trace_parent_propagate: bool = False,
    ):
        self.transaction = None
        self.parent_transaction = None
        self.transaction_type = transaction_type
        self.transaction_name = transaction_name
        self.context = context
        self.trace_parent = trace_parent
        self.trace_parent_propagate = trace_parent_propagate
        self.client = get_client()

    def __enter__(self):
        self.parent_transaction = traces.execution_context.get_transaction()
        self.parent_span = traces.execution_context.get_span()
        traces.execution_context.set_span(None)
        if self.parent_transaction and self.trace_parent_propagate:
            self.trace_parent = self.parent_transaction.trace_parent
        self.transaction = self.client.begin_transaction(
            self.transaction_type, trace_parent=self.trace_parent
        )
        elasticapm.set_transaction_name(self.transaction_name, override=False)
        return self

    def __exit__(self, exc_type, exc_value, traceback):
        if exc_type:
            self.client.error_logger.error("Exception during timing of func", exc_info=True)
        self.client.end_transaction(name=self.transaction_name)

        if self.parent_transaction:
            traces.execution_context.set_transaction(self.parent_transaction)
        if self.parent_span:
            traces.execution_context.set_span(self.parent_span)

        return False

class SomeClient(AsyncClient):
    transaction_type = "some_type"
    transaction_name = "My transaction"

    async def make_request(*args, **kwargs):
        with apm_trace(transaction_type, transaction_name, trace_parent_propagate=True) as tracer:
            try:
                response = await self.request(*args, **kwargs)
            except (HTTPError, ConnectTimeout, NetworkError, TimeoutException) as e:
                elasticapm.set_transaction_result(type(e))
                raise
            finally:
                context = ...
                # some manipulating with context
                elasticapm.set_custom_context(context)
            return response

# suppose there is some magic with db
# somewere in celery task:
client = SomeClient()
response = await client.make_request(*args, **kwargs) # my request

# suppose there is some magic with db

The screenshot shows trace. According to the correct logic, my http requests should go before the spans, which are indicated in the red square. But they come after the spans.
What am I doing wrong?
Environment:

OS: Win and Linux
Python version: 3.10.4
Framework and version: fastapi: 0.75.0
APM Server version: _
Agent version: 6.9.1
HTTPX: "^0.22.0"

I don't see particular red flags, except of course the atypical use of our execution_context. ;)
I'm not sure your code example is complete enough to compare to your trace screenshot. I'm seeing something like three http requests in your screenshot and am not sure what the red box is supposed to be from your code example. Can you clarify?

It would also be interesting to know what you want to achieve exactly by interpreting the http requests as transactions.
That being said, I think the trace view actually shows exactly what you tell it to show. The horizontal axis shows a temporal relation (if A is left of B, A happened before B), while the vertical tree structure shows causal relations (if B is nested under A, B is caused by A). From how I understand it, the spans in the red box happen after the three http requests (so they are right of them), but are not strictly causally related, so they are not nested under them.

Hey @reydnn I'm going to close this for now. Please keep us posted if there's more we can discuss.


Review and add logging into the application layer

Context

Our application lacks helpful logging that would improve diagnosis of errors or bad behaviours over time. According to the semantics defined in #351 and the logging capability introduced in #350, we should be able to provide insights for various pieces of the wallet back-end, where it makes sense.
Decision

Replace existing "fake" logging attempts like say or putStrLn by actual logs, with a relevant log-level
Add logging on the application critical path with relevant information, in particular on failures.

Acceptance Criteria

As developers and maintainers, we must have a total understanding of what is going on within our application when running.

The semantics for the verbosity level must be respected such that logging can be adjusted at will to increase the amount of detail we get from the application.

Logging shouldn't impact application performance more than what's reasonable. In other words, it shouldn't be possible to detect that logging is happening when using the wallet's functionality.

Development Plan

PR

Number
Base

#?
master

QA

@KtorZ Is the IOHK monitoring framework relevant to our needs for this?

Yes, see #350

@KtorZ KtorZ closed this 3 days ago

Hm, I don't remember reviewing this, also #492 has been referenced to this item after closing. Should this be still in progress?

lgtm


Ignore status filter if user specify both ID and status for listing executions

We have limited number of secondary indexes.  We should ignore the status filter if the user calls list workflow execution with both workflow execution ID and status filter.

Allow this is a little bit confusing, will put off doing this. After new visibility completed, we can allow multiple filter.

This will be done as part of https://github.com/uber/cadence/issues/1630


new: Partially support Volta's pinned versions

To make migration from Volta easier, or simply to support when the choice of tool manager is out of your hands, this PR let's Proto use the tool versions pinned by Volta. Proto will still prefer the more official "engines" or "packageManager" if they're defined.
The extends field is not supported, but the implementation should cover the most common use-cases at least.
Some unrelated tests are failing on Windows, but I see they've been doing that for a while.

Awesome thanks!


External OpenMPI prefix on Hera and Jet not set

Describe the bug
No matter what I did Spack would rather choose intel-oneapi-mpi over OpenMPI, even after explicitly setting the MPI provider and compiler.
Then, I re-ran spack external find openmpi and updated my packages.yaml and now things seem to be working.
Edit: The prefix was missing from the packages.yaml.
Same issue on Jet.

Same issue on Jet, but it's down for maintenance. I think the prefix is the same, but I'll wait until it's back online.


Proposal: Create service worker support for canjs donejs

Create can-connect behavior using service workers
Create can-define-map with service worker support for its propertys

should this be separate issues in those projects?

@phillipskevin probably yes but i created it here because of the #660 issue as this needs discussion now to close maybe #660 here we can if this is discussed close this and open issues in the repos i think.

Will implament via nativ pouchdb support

https://github.com/direktspeed/can-connect-pouchdb
Instructions about Web and Service worker support of PouchDB -> https://github.com/pouchdb-community/worker-pouch

@frank-dspeed I started on service worker support a long time ago but my work may not be relevant or useful. https://github.com/canjs/can-connect/pull/9/files

next week i planing to work on service worker support for stealjs using https://github.com/GoogleChrome/sw-precache

@bmomberger-bitovi your code is usefull but not for the level that i want to implament i will implament puchdb that supports service workers already and can connect will use puchdb
this will be then the final step to make donejs Production ready complet for Offline Applications and so Called Progressiv Web Apps Definition.
will also add that example then to the

https://hnpwa.com - Hacker News Progressiv Web App
i have joined this project its a successor over TodoMVC and shows more current Tech for choosing a framework i will post my Results with Diffrent DoneJS CanJS Production Deployments and Loading Techs also there.


No license

What is the license for this and can you add it to the package?

Fantastic. Thank you so much!


Test Speech to Text API

With so many changes to the Speech to Text API, we should test it with other developers in the lab. It would be great to get feedback on whether it was designed well, or if there's anything that's confusing.

Complete with da2ef0f835434444cc8682f420969efd18dec97c


Legion Prof Bug Fixes/Improvements

Legion Prof still has a number of bugs that need to be fixed and enhancements that need to be performed. These include specifically:

Small or "0" time boxes aren't always rendered properly
Some search functions are broken
Sometimes large stacking of boxes causes the profile to be rendered incorrectly
Zooming sometimes fails after a time
Issue #374
We want to be able to visualize dependencies in the profiler interface, and ideally the critical path of the computation
Per node dependent partitioning channels
Background worker threads  - shows their activity, give a summary of how backlogged they are (the current length of the queue of things to do)
"network lag line" - a summary of how the network is backed up on each node (or maybe on each channel?).
Better DMA profiling - as an example the ability to see what is happening on each hop so as to visualize congestion
Currently scalar computations done through futures don't show up anywhere in the profiles.  The particular example was a reduction tree being done through futures that just showed up as an unexplained blank interval of the profile.  Add a "future channel" similar to the DMA channels.  Each node has a future channel showing when futures are transmitted between nodes --- the profile would show the start time and end time pf the transmission, and the summary would show % time the channel is occupied with a transmitting future. (high priority)

and also more generally:

Better scalability
Better high-dynamic range resolution

Feel free to add additional items to these lists

Resolution (e.g the one in the URL) needs to scale automatically with zoom in/out.

It would also be nice to have access to the delay (if any) between when the task is ready to run and when it starts its execution (maybe as a field in the window that appears when you stop the mouse over the box representing the task)

This is useful - I’ll add it to the profiler shortly.
--Seema
On Sep 30, 2019, at 2:58 PM, Mario Di Renzo <notifications<EMAIL_ADDRESS>wrote:
It would also be nice to have access to the delay (if any) between when the task is ready to run and when it starts its execution (maybe as a field in the window that appears when you stop the mouse over the box representing the task)
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHubhttps://github.com/StanfordLegion/legion/issues/481?email_source=notifications&email_token=AJD6EIUJ4SVODOSEXVZN2KDQMJY6XA5CNFSM4GX26F6KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD77HKQQ#issuecomment-536769858, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AJD6EIWQ72V6JTTNV6TCC3DQMJY6XANCNFSM4GX26F6A.

Here's an example of the profiler - it includes the time a task spends in the ready state (look at the gpu tasks in this example)- Let me know if anyone has any comments before I check it in.
http://sapling.stanford.edu/~seemah/e/circuit/legion_test/?start=5463871.770562957&end=5559767.990221078&collapseAll=false&resolution=10

So one concern I have about this change is that we're going to get more "giant stacks" of tasks, especially on the utility processors where there might be lots of ready to run tasks that overlap and therefore get stacked. This often makes the profile difficult to read so if it does happen we need to be ready for it.

Showing the delays visually can be toggled in profiling options.  Seema and
I didn't discuss the default, but I guess we want the old behavior (no
display of wait time) to be the default.
Alex
On Fri, Oct 4, 2019 at 12:07 AM Mike Bauer<EMAIL_ADDRESS>wrote:

So one concern I have about this change is that we're going to get more
"giant stacks" of tasks, especially on the utility processors where there
might be lots of ready to run tasks that overlap and therefore get stacked.
This often makes the profile difficult to read so if it does happen we need
to be ready for it.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/StanfordLegion/legion/issues/481?email_source=notifications&email_token=ABBIV72ZQP2TG5DLFHWMU6TQM3TTTA5CNFSM4GX26F6KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEAKWIYY#issuecomment-538272867,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABBIV76GF4QPGYMWCV6DM7TQM3TTTANCNFSM4GX26F6A
.

The delay times are available visually via a menu option (not enabled by default). The default behavior will now show the delay as a field in the window that appears when you hover over the task timeline. This is currently available in the profiler_update branch.
@mariodirenzo can you send me your profiler output files so I can try it.

@seemamirch These logs are from one run on two nodes: prof_1.log prof_0.log
Please, let me know if you need more

Another idea for an enhancement: it would be nice if there were two "utilization" lines. One for running stuff (which is what the current line shows) and one for processors that have tasks but are blocked. It would make it much easier to recognize where things are stalled waiting for something.

Not all "channel" operations on the GPU are performed by copy engines, some things like fill operations turn into cudaMemset calls which are done as kernels running on the GPU. These kernels can interfere with normal application kernels and make the fills look like they are taking longer than they actually are. We should have a way to distinguish which channel operations on the GPU are done by the copy engines and which are handled by the SMs.

Regions and partitions associated with Tasks could be very helpful in debugging.

It would be good if we instances in memories were sorted by their size instead of their creation time. It's especially helpful when trying to figure out why we are OOM.

In the meeting this week we discussed possible improvements that could have helped diagnose #1316 (where a partition was created on one node and then had to be broadcast to the other nodes). Possibly looking at the subregion IDs could be used to identify which node created each partition, and that information could be displayed to the other in some fashion (e.g., at the point where an index space is being requested/transferred).

I did look at putting in a fix for not blocking the logical analysis as we're loading the index spaces on each node, but there is not an easy way to do that at the moment.

We've made many of these improvements, does someone want to go through the original issue and figure out what is still relevant?

I think these items are all still relevant:

We want to be able to visualize dependencies in the profiler interface, and ideally the critical path of the computation
Per node dependent partitioning channels
Background worker threads - shows their activity, give a summary of how backlogged they are (the current length of the queue of things to do)
"network lag line" - a summary of how the network is backed up on each node (or maybe on each channel?).
Currently scalar computations done through futures don't show up anywhere in the profiles. The particular example was a reduction tree being done through futures that just showed up as an unexplained blank interval of the profile. Add a "future channel" similar to the DMA channels. Each node has a future channel showing when futures are transmitted between nodes --- the profile would show the start time and end time pf the transmission, and the summary would show % time the channel is occupied with a transmitting future. (high priority)

I have plans for some of them, but not all of them.


Getting Resource UID Returns Invalid (-1) at Runtime on Exported Projects

Godot version
4.0.1
System information
Windows 11
Issue description
I'm building a character customization system in my game, and I use custom resources that contain information like the textures and thumbnails of parts of the face and stuff. When the character creator is loaded, I create the thumbnails and connect a signal that passes the resource UID as an argument so once clicked, it loads and applies the changes to the mesh, this also allows me to save the UID in a variable, which I later use to set the correct textures when the game is loaded.
When I use the editor everything works fine, using print(ResourceLoader.get_resource_uid(iris_style)) returns<PHONE_NUMBER>146557548 which means it's working as it should. However when I export the project and execute it, every single time I print these IDs (for debugging purposes) it returns -1 which also means no textures are applied when the thumbnail is selected.
I already tried adding ".remap" to the resource path, but it still returns -1. Is this a bug? Or is it supposed to work like that? I can try to find a workaround, but what confuses me is that it works fine in the editor, and it seems like I can't expect the same behavior when I export my project. Isn't this the way I am supposed to handle resource ids? I already tried using get_rid() but it also returns 0 or invalid.
Steps to reproduce

Create a few custom resources.
Load them into the game and print their IDs using print(ResourceLoader.get_resource_uid(the_resource)).
Now export the project and check the logs/console outputs (which should be invalid IDs). Make sure it is executed out of the project folder, or it will return the correct IDs.

Minimal reproduction project
Very small project with 3 custom resources, it returns -1 as expected.
id_project.zip

Looks like export bug (or maybe not?). The resources are converted to res and no longer have UID. You can still load them using uid:// because it's cached, but you can't get UID from the resource.

The UIDs are not carried over in the code, for resources it is done here:
https://github.com/godotengine/godot/blob/ef025711a694071a1407b5035a6fe3e67c2a5b07/editor/export/editor_export_platform.cpp#L795-L803
Could be an oversight, but UIDs mainly make sense in the editor for handling files being moved etc., but still might be good to have it fixed

Keeping track of resources' UIDs in exported builds would be useful for multiplayer games. You could send a RPC from one peer to another referencing a resource by its UID instead of its path. (e.g. to instantiate a scene) Since UID is usually shorter than the path, it would be more network efficient than sending the path in the RPC.

UIDs mainly make sense in the editor for handling files being moved etc., but still might be good to have it fixed

If this isn't planned to be implemented soon, I think it should be documented clearly in all places referencing resource UIDs, as well as have UID related functions like get_resource_uid fail loudly in exported runtime. Many people (like me xD) might end up coding large part of their game with the expectation that UIDs work in runtime because they don't regularly test in exported versions.

Can confirm.
This can be fixed by looking for .remap-like file and fetching path from them, or something like that. I will try to fix this.

Yeah there is uid_cache.bin file that you can use for lookup. Other UID sources (like the new .uid files) don't/might not exist after export.


Unify default credentials and default project logic to avoid duplicate calls to google.auth.default

Context: https://github.com/GoogleCloudPlatform/google-cloud-python/pull/2726/files#r87670774

#3667 and #3668 will go most of the way here

Hello,
One of the challenges of maintaining a large open source project is that sometimes, you can bite off more than you can chew. As the lead maintainer of google-cloud-python, I can definitely say that I have let the issues here pile up.
As part of trying to get things under control (as well as to empower us to provide better customer service in the future), I am declaring a "bankruptcy" of sorts on many of the old issues, especially those likely to have been addressed or made obsolete by more recent updates.
My goal is to close stale issues whose relevance or solution is no longer immediately evident, and which appear to be of lower importance. I believe in good faith that this is one of those issues, but I am scanning quickly and may occasionally be wrong. If this is an issue of high importance, please comment here and we will reconsider. If this is an issue whose solution is trivial, please consider providing a pull request.
Thank you!

@lukesneeringer

This should be done
This should be easy to do (i.e. ~1 hour)

I will do this in google.api.core (it's already in my prototype)
On Fri, Aug 11, 2017 at 3:57 PM Danny Hermes<EMAIL_ADDRESS>wrote:

@lukesneeringer https://github.com/lukesneeringer

This should be done
This should be easy to do (i.e. ~1 hour)

—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/GoogleCloudPlatform/google-cloud-python/issues/2796#issuecomment-321936360,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAPUcy48t2ibZc13h-FCbO7SxBqGDnK1ks5sXNxZgaJpZM4LDBMu
.


Invalid stack, only stack 1 and 5 are supported for builds

I am getting an error back from curl when I try to trigger a build through the wercker API,
{"statusCode":400,
 "error":"Bad Request",
 "message":"Invalid stack, only stack 1 and 5 are supported for builds"
}

Can anyone tell me what I am doing wrong?
The command I am using is below (fake authorization token).
curl  -H 'Content-Type: application/json' -H  'Authorization: Bearer 6976FbNgyn43zp3WkcHVt3C79sf' -X POST -d '{"applicationId": "57853a9d5c41db32406bc706", "branch":"master", "commitHash":"aba409c690bfb504000562d10d551c83d9b2221b", "message":"triggered build"}' https://app.wercker.com/api/v3/builds

I'm facing on the same issue. Any update?

request and response is below
$ curl \
-X POST \
-H 'Content-Type: application/json' \
-H  'Authorization: Bearer xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx' \
-d '{"applicationId": "000000000000000000000000", "branch":"master", "commitHash":"xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx", "message":"trigger build manually"}' \
https://app.wercker.com/api/v3/builds

{
  "statusCode": 400,
  "error": "Bad Request",
  "message": "Invalid stack, only stack 1 and 5 are supported for builds"
}

My problem solved. The stack of application which I want to trigger build is stack 6.
To get stack of application, command below.
$ curl \
-H 'Content-Type: application/json' \
-H  'Authorization: Bearer xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx' \
https://app.wercker.com/api/v3/applications/tomorrowkey

[
  {
    "id": "xxxxxxxxxxxxxxxxxxxxxxxx",
    "url": "https://app.wercker.com/api/v3/applications/tomorrowkey/xxxxxxxxxx",
    "name": "xxxxxxxxxxxxx",
    "owner": {
      "type": "wercker",
      "name": "tomorrowkey",
      "avatar": {
        "gravatar": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"
      },
      "userId": "xxxxxxxxxxxxxxxxxxxxxxxx",
      "meta": {
        "username": "tomorrowkey",
        "type": "user",
        "werckerEmployee": false
      }
    },
    "createdAt": "2016-07-27T06:44:56.978Z",
    "updatedAt": "2016-07-27T06:44:56.978Z",
    "privacy": "private",
    "stack": 6
  }
]

How can I use build trigger via API with stack 6?

On stack 6 apps: instead of fixed pipelines such as builds, you have to trigger runs and to trigger a run you need to pass in the pipeline you want it to execute on.
So first, get the pipelines for your app, you should do something like:
$ curl \
-H 'Content-Type: application/json' \
-H  'Authorization: Bearer xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx' \
https://app.wercker.com/api/v3/applications/tomorrowkey/xxxxxxxxxx/pipelines

[
  {
    "id":"577a1caef34bbcc3e801931",
    "url":"https://app.wercker.com/api/v3/pipelines/577a1caef34bbcc3e801931",
    "createdAt":"2016-01-20T09:48:06.721Z",
    "name":"build",
    "permissions":"read",
    "pipelineName":"build",
    "setScmProviderStatus":true,
    "type":"git"
  }
]

The id of the pipeline is what we need, in the example above it's: 577a1caef34bbcc3e801931
Now we can trigger the run for that 'build' we got back from that list of pipeline:
$ curl \
  'https://app.wercker.com/api/v3/runs' \
  -X POST \
  -H 'content-type: application/json' \
  -d '{"branch":"master", "message":"triggered via the api (optional)", "envVars":[], "pipelineId":"511141cddd34bccd3e001967"}'

Yes! It is what's I want. It works fine in my account.
Thank you 🙆


feat: Add metrics

What type of PR is this?
/kind feature
What this PR does / why we need it:
This PR adds metrics in the style of the CSI Driver to the sssc. Adds a service to access the metrics.
Which issue(s) this PR fixes:
Fixes #7
Special notes for your reviewer:
This currently does not include any test or documentation, let me know if/how you would like these added.
TODOs:

[x] squashed commits
[ ] includes documentation
[ ] adds unit tests

/cc @nilekhc

/ok-to-test

@AlexanderStocks Looks like tests are failing. Could you PTAL?


serve with path prefix 404s custom css

i fixed this with https://github.com/axodotdev/oranda/commit/408a33f5ab807e812602a1c5a962a27ae8569061 in #193