Feature: Telemetry Requests

This issue will keep track of all feature requests that are made as issues and are blocked for some reason or being worked on in regards to Telemetry. When an issue is blocked or unblocked this issue will be updated. If you wish to get an update on any of these issues you can check back here or leave a comment below. Please note that as soon as a feature is blocked or unblocked, this issue will be updated.

[ ] Ability String Naming Is Inconsistent                Status: In Progress
[ ] HeroBan is Missing Player                                 Status: Pending
[ ] Team Naming Is Inconsistent                             Status: Pending
[ ] Pause Event In Telemetry                                   Status: Pending
[ ] Add Match Start Timestamp                              Status: Pending
[ ] Assists in Telemetry                                            Status: Pending
[ ] Blitz Coin Earned                                                Status: Pending
[ ] Stacking Stats                                                    Status: Pending
[ ] DealDamage for Turrets to Heroes                   Status: Blocked
[ ] Amount of Energy when UseAbility                  Status: Blocked
[ ] In-Lane Minion Kills                                            Status: Blocked
[ ] Identify Critical Attacks                                      Status: Blocked
[ ] KillActor missing for AI Kills                               Status: Blocked
[ ] Rename the TankMinion                                     Status: Blocked
[ ] HP Information                                                    Status: Blocked
[ ] Revealed/Hidden Status                                     Status: Blocked
[ ] Kill Bounties Not Showing                                  Status: Blocked
[ ] Ambient Gold                                                      Status: Blocked
[ ] Telemetry Kill Streaks and Ace                          Status: Blocked
[ ] Add current itemization information                 Status: Blocked
[ ] Add Pings to Telemetry                                      Status: Blocked
[ ] Type of Damage                                                  Status: Blocked
[ ] Position Data for Good Positional Analysis       Status: Blocked
[ ] Gold Balance Over Time                                     Status: Blocked
[ ] Telemetry KillActor gold                                     Status: Blocked
[ ] Add Shared XP Hero in XPEarned typeData     Status: Blocked
[ ] Add player respawn events                                 Status: Blocked
[ ] Healing spells                                                       Status: Blocked
[ ] Include Activatables                                             Status: Blocked

In Progress
Here will be a list of all feature requests that are currently being worked on for future updates.
Ability String Naming is Inconsistent
Seen on: #189
Solution in: #197 #222
Example:
{
    "Ability__Grace__A": "Grace A",
    "Ability__Grace__AltAttack": "Grace AA",
    "Ability__Grace__B": "Grace B",
    "Ability__Grace__DefaultAttack": "Grace AA",
    "HERO_ABILITY_HERO042_A_NAME": "Grace A",
    "HERO_ABILITY_HERO042_B_NAME": "Grace B",
    "HERO_ABILITY_HERO042_C_NAME": "Grace C",
    "Ability__B_Bounce": "Ozo B",
    "AbilityB_Bounce": "Ozo B",
    "Ability__B_EndingAttack": "Ozo B",
    "AbilityCLeapOff": "Idris C",
    "Ability_Dash": "Vox A",
    "Ability_Grumpjaw_Eat": "Grumpjaw C",
    "Ability__Idris__A_Blink": "Idris A",
    "Ability__Idris__A_Dash": "Idris A",

    "*Item_Flaregun*": "Flare Gun",

    "Armor2": "Coat of Plates",

    "Candy - VO Taunt": "Voice over Taunt"
}

Pending
Here will be a list of all feature requests that have not been designated a Status.
Add Match Start Timestamp
Knowing when the match actually starts would be helpful in correlating event time in the telemetry with that shown on the match timer in-game (replays, recordings, broadcasts). Right now, they do not agree.
Seen on: #213
Example:
To Be Added

Pause Event in Telemetry
Extremely important as currently in game time is determined using the time stamp therefore when a game is paused the timing is not correct.
Seen on: #167
Example:
{ "time": "2017-05-03T01:26:27+0000", "type": "pause", "payload": { "onOff": "paused", "Actor": "*Kestrel*" } }

{ "time": "2017-05-03T01:26:27+0000", "type": "pause", "payload": { "onOff": "continue", "Actor": "*Kestrel*" } }

Blitz Coins Earned
Seen on #214
It would be a great asset to be able to use the API to see how many Blitz Coins a player has at the end of each Blitz match and how they earned it in the Telemetry. Additionally, a team's Blitz coins should be a roster stats attribute.
Example:
{ "time": "2017-05-03T01:26:27+0000", "type": "BlitzCoinEarned", "payload": { "Team": "Left", "Actor": "*Kestrel*", "Balance": 2 } }

HeroBan is Missing Player
Seen on: #182
Example:
  {
    "time": "2017-06-08T07:25:09+0000",
    "type": "HeroSelect",
    "payload": {
      "Hero": "*Lance*",
      "Team": "1",
      "Player": "4c75f332-6b5d-11e4-aef9-06641bcbf424",
      "Handle": "lensjo"
    }
  },

Team Naming is Inconsistent
Seen on: #181
Example:
In HeroBan and HeroSelect, Team is either "1" or "2" (strings, not integers). LevelUp has Team as either "Right" or "Left". Also "Hero" instead of "Actor"

Item/Ability Stacks
Seen on #208
Certain Items and abilities stack that apply stacks on damage or lose without any damage.
Example:
{ "time": "2017-05-03T01:26:27+0000", "type": "itemStack", "payload": { "Team": "Left", "Actor": "*Skye*", "Item": "Broken Myth", "currentStacks" : "7" } }

{ "time": "2017-05-03T01:26:27+0000", "type": "abilityStack", "payload": { "Team": "Left", "Actor": "*Saw*", "Ability": "Saw_Perk", "currentStacks" : "12" } }

Assists in Telemetry
Seen On: #207
Example:
 {
    "time": "2017-04-22T15:39:56+0000",
    "type": "KillActor",
    "payload": {
      "Team": "Left",
      "Actor": "*Taka*",
       "Assist": "*Lyra*",
      "Killed": "*Lyra*",
      "KilledTeam": "Right"
      "Gold": "0",
      "IsHero": 1,
      "TargetIsHero": 1,
      "Position": [
        -74.13,
        0.4,
        23.16
      ]
    }
  },

Blocked
Here will be a list of all feature requests that are currently blocked.
Deal Damage For AI(Turrets/Kraken/Minders/Minions/Jungle Monsters
Seen on #75
Damage done by AI is extremely crucial for analysis. How much damage can a minion take from a turret at X time in a game etc...
Example:
To Be Added

Amount of Energy when UseAbility
Seen on: #70
Example:
{ "time": "2017-02-18T12:55:46+0000", "type": "UseAbility", "payload": { "Team": "Left", "Actor": "*Phinn*", "Ability": "HERO_ABILITY_PHINN_A_NAME", "Position": [ -43.50, 0.00, 30.50 ] } }

Identify Critical Attacks
Seen on: #63
Example:
{ "time": "2017-02-18T12:55:24+0000", "type": "DealDamage", "payload": { "Team": "Left", "Actor": "*SAW*", "Target": "*Glaive*", "Source": "Unknown", "criticalHit": "1", Damage": 53, "Delt":  41, "IsHero": 1, "TargetIsHero": 1 } }

KillActor Missing For AI Kills
Can we please add in the ability to show when a lane minion dies from a lane minion or a turret. This would allow us to determine the efficiency of teams farming and understand how much gold is being lost and what the causes are.
Seen on: #60
Example:
To Be Added

Rename the TankMinion
I am hoping to have the name of the LeadMinion be changed to say TankMinion1 and TankMinion2. Knowing the precise minion which was killed allows us to know and determine how efficient a player farms. It can allow us to analyze much more in depth, about whether a player is focusing damage correctly in order to farm efficiently and is getting those last hits efficiently.
Seen on: #53
Example:
To Be Added

HP Information
The player takes damage it shows how much damage done, but doesn't show the heroes max hp or his current hp, his health regen, potion regen, fountain regen? Furthermore, maybe Lyra healing, Adagio healing.
Seen o: #48
Example:
To Be Added

Revealed/Hidden Status
Can we have abilities or flares indicate when a hero is revealed and its position when it is revealed. For example, we can have a scout trap and determine the usefulness of a scout trap by determing which position of a trap provided the most amount of help. For example here, Gwen A causes heroes to be revealed for a short duration can we please have that shown and show where the enemy is while flared or revealed.
Issue: #46
Example:
{
    "time": "2017-01-25T00:56:43+0000",
    "type": "reveal",
    "payload": {
        "Team": "Left",
        "Actor": "*Gwen*",
        "Target": "*Taka*",
        "Source": "Ability__Gwen__A",
        "Position": "xxx"
    }
}
{
    "time": "2017-01-25T00:56:43+0000",
    "type": "reveal",
    "payload": {
        "Team": "Left",
        "Actor": "*Lyra*",
        "Target": "*Taka*",
        "Source": "Flare",
        "Position": "xxx"
    }
}

Kill Bounties Not Showing
Seen on: #45
Example:
{
    "time": "2017-01-25T00:59:05+0000",
    "type": "KillActor",
    "payload": {
        "Team": "Right",
        "Actor": "*Rona*",
        "Killed": "*Reim*",
        "KilledTeam": "Left",
        "Gold": "200",
        "killBounty": "100"
        "IsHero": 1,
        "TargetIsHero": 1,
        "Position": [-9.80, 0.01, 37.12]
    }
}

Ambient Gold
Seen on: #42
Example:
 "time": "2017-01-25T00:56:38+0000",
 "type": "KillActor",
 "payload": {
     "Team": "Right",
     "Actor": "*Hero016*",
     "Killed": "*Neutral_JungleMinion_DefaultSmall*",
     "KilledTeam": "Neutral",
     "Gold": "22",
      "ambientGoldTarget": "Ardan"
      "ambientGoldAmount:" "15"
     "IsHero": 1,
     "TargetIsHero": 0,
     "Position": [9.20, 0.01, 32.02]
 }

Add Pings to Telemetry
Seen on: #143
Example:
To Be Added

Type of Damage
If its possible, divide the damage by crystal, weapon or true, burn etc
Seen on: #123
Example:
{ "time": "2017-02-18T12:55:24+0000", "type": "DealDamage", "payload": { "Team": "Left", "Actor": "*SAW*", "Target": "*Glaive*", "Source": "Unknown", "criticalHit": "1", "type":"weapon", Damage": 53, "Delt":  41, "IsHero": 1, "TargetIsHero": 1 } }

Not Enough Position Data for Good Positional Analysis
In particular, positions are only reported when some event other than motion transpires (purchases, damage, item uses, leveling up, etc.). So for example, a player can run across the map and then hit a monster, and we have no data about where they are the entire time they're running until they hit the monster on the opposite end of the map. Thus there are long patches of missing motion data.
Seen on: #118
Example:
To Be Added

Gold Balance Over Time
There is no data about gold in the participant's type. I would like to get some stats about gold@time but the only time telemetry is giving lifetimeGold is when someone levels up. I cant pull total gold from every minute of the game since players stop leveling up around ~13min. And I cant calculate from reward gold because then I would be skipping ambient gold and cs gold.
Seen on: #117
Example:
gold: 5, balance: 25, ambient: 12

Telemetry KillActor Gold
KillActor in TargetIsHero:1 is returning Gold: 0
Seen on: #144
Example:
{ "time": "2017-04-10T05:57:31+0000", "type": "KillActor", "payload": { "Team": "Right", "Actor": "Ozo", "Killed": "Glaive", "KilledTeam": "Left", "Gold": "0", "IsHero": 1, "TargetIsHero": 1, "Position": [ -6.35, 0.01, 26.80 ] } },

Add Shared XP hero in XPEarned type data
For the XPEarned type data, could you also add hero which shares the XP earned when killing a neutral minion?
Seen on: #127
Example:
To Be Added

Add Player Respawn Events
As is, it's not possible to tell when players are alive or dead. While there are death events, there are not respawn events. We can narrow it down from other events, but not get an exact respawn time, as far as I can tell. (But I'm glad to be proven wrong on this, especially since it's 2am here...)
Seen on: #125
Example:
To Be Added

Healing Spells
Include healing values for spells and fountain and maybe perks? We should be able to calculate how much heal was done
Seen on: #122
Example:
To Be Added

Include Activatables
Include when an activable was used e.g. Trap placed, Flare threw from here to there, Fountain used, Crucible used...
Issue: #121
Example:
To Be Added

List of Features That Will Not Be Possible
Below is a list of requests that were made but were not able to be done for some reason.
Add current itemization information
Seen on: #184
Reason: I don't know that this makes a lot of sense. I understand the accounting is a pain, but bloating the telemetry with info that's already included is probably not a great solution.
Alternative Solution: Have the item information in the itemDB, then you will be able to map which item is consumable or not and price.

@Skillz4Killz tagging you here, we should make this ticket resemble #223

I believe I have got most of them. There are a few left without examples and I will add those in tomorrow.

We decided to close the uber tickets, in lieu of boards. So.. closing! Thanks everyone for the patience and helping out with this.


Cannot make stack larger

FAS::stack()
  ->on(FAS::icon(FAS::_CIRCLE)->size(FAS::SIZE_3X))
  ->icon(FAB::icon(FAB::_TWITTER)->inverse()->size(FAS::SIZE_3X))

The circle does not get bigger. AFAIK the Stack::__toString() method does not allow such changed. Stacks work only with a single size. How can I enlarge the stack the right way?
I would suggest the feature to set the size of a stack as well: e.g. with
FAS::stack()->size(FAS::SIZE_3X))
  ->on(FAS::icon(FAS::_CIRCLE))
  ->icon(FAB::icon(FAB::_TWITTER)->inverse())

The icon should be one size smaller than the circle automatically.
Also inverting the icon could be done automatically.

Hey. I apologize for the long answer. Welcome to pull request.


java.verify_ver does not verify java-1.8.0 (SOFTWARE-2212)

The output of java -version differs between java-1.7.0 and java-1.8.0. The former has its version number preceded by "java version" and the latter has its version preceded by "openjdk version". This commit changes java.verify_ver() to look for the version in the first line, ignoring any preceding text.
OpenJDK 1.7.0
# java -version
java version "1.7.0_95"
OpenJDK Runtime Environment (rhel-<IP_ADDRESS>.el7_2-x86_64 u95-b00)
OpenJDK 64-Bit Server VM (build 24.95-b01, mixed mode)

OpenJDK 1.8.0
# java -version
openjdk version "1.8.0_71"
OpenJDK Runtime Environment (build 1.8.0_71-b15)
OpenJDK 64-Bit Server VM (build 25.71-b15, mixed mode)

Maybe it would be a good idea still to look for the word “version” (then whitespace) prior to a version string?


Make PSR-16 benchmarks to use cache entry class

This is requirement for PSR-16 in cases where we need to differentiate
between missing value and null value saved in cache. PSR-6 has other
means for that, so does not force consumer to do it.
New results:
33 subjects, 33 iterations, 330 revs, 0 rejects, 0 failures, 0 warnings
(best [mean mode] worst) = 146.300 [4,262.139 4,262.139] 146.300 (μs)
⅀T: 140,650.600μs μSD/r 0.000μs μRSD/r: 0.000%
suite: 13417ecbc89cc3b3df2c874bbb8b8debe710a670, date: 2019-12-12, stime: 22:23:52
+----------------------+------------------+-----+------+-----+------------+--------------+--------------+--------------+--------------+---------+--------+---------+
| benchmark            | subject          | set | revs | its | mem_peak   | best         | mean         | mode         | worst        | stdev   | rstdev | diff    |
+----------------------+------------------+-----+------+-----+------------+--------------+--------------+--------------+--------------+---------+--------+---------+
| MultiCacheMiss       | benchPsr16Roave  | 0   | 10   | 1   | 2,144,576b | 15,478.100μs | 15,478.100μs | 15,478.100μs | 15,478.100μs | 0.000μs | 0.00%  | 105.80x |
| MultiCacheMiss       | benchPsr16Naive  | 0   | 10   | 1   | 1,647,552b | 1,067.100μs  | 1,067.100μs  | 1,067.100μs  | 1,067.100μs  | 0.000μs | 0.00%  | 7.29x   |
| MultiCacheMiss       | benchPsr6Symfony | 0   | 10   | 1   | 1,800,504b | 1,450.500μs  | 1,450.500μs  | 1,450.500μs  | 1,450.500μs  | 0.000μs | 0.00%  | 9.91x   |
| SingleCacheHit       | benchPsr16Roave  | 0   | 10   | 1   | 1,513,440b | 197.800μs    | 197.800μs    | 197.800μs    | 197.800μs    | 0.000μs | 0.00%  | 1.35x   |
| SingleCacheHit       | benchPsr16Naive  | 0   | 10   | 1   | 1,513,440b | 170.500μs    | 170.500μs    | 170.500μs    | 170.500μs    | 0.000μs | 0.00%  | 1.17x   |
| SingleCacheHit       | benchPsr6Symfony | 0   | 10   | 1   | 1,513,448b | 220.900μs    | 220.900μs    | 220.900μs    | 220.900μs    | 0.000μs | 0.00%  | 1.51x   |
| SingleCacheMiss      | benchPsr16Roave  | 0   | 10   | 1   | 1,458,376b | 302.900μs    | 302.900μs    | 302.900μs    | 302.900μs    | 0.000μs | 0.00%  | 2.07x   |
| SingleCacheMiss      | benchPsr16Naive  | 0   | 10   | 1   | 1,458,376b | 230.800μs    | 230.800μs    | 230.800μs    | 230.800μs    | 0.000μs | 0.00%  | 1.58x   |
| SingleCacheMiss      | benchPsr6Symfony | 0   | 10   | 1   | 1,491,080b | 241.500μs    | 241.500μs    | 241.500μs    | 241.500μs    | 0.000μs | 0.00%  | 1.65x   |
| SingleRemove         | benchPsr16Roave  | 0   | 10   | 1   | 1,511,800b | 146.700μs    | 146.700μs    | 146.700μs    | 146.700μs    | 0.000μs | 0.00%  | 1.00x   |
| SingleRemove         | benchPsr16Naive  | 0   | 10   | 1   | 1,511,800b | 164.800μs    | 164.800μs    | 164.800μs    | 164.800μs    | 0.000μs | 0.00%  | 1.13x   |
| SingleRemove         | benchPsr6Symfony | 0   | 10   | 1   | 1,511,808b | 146.300μs    | 146.300μs    | 146.300μs    | 146.300μs    | 0.000μs | 0.00%  | 1.00x   |
| MultiSaveWithTTL     | benchPsr16Roave  | 0   | 10   | 1   | 2,103,008b | 22,579.200μs | 22,579.200μs | 22,579.200μs | 22,579.200μs | 0.000μs | 0.00%  | 154.33x |
| MultiSaveWithTTL     | benchPsr16Naive  | 0   | 10   | 1   | 2,004,728b | 22,829.200μs | 22,829.200μs | 22,829.200μs | 22,829.200μs | 0.000μs | 0.00%  | 156.04x |
| MultiSaveWithTTL     | benchPsr6Symfony | 0   | 10   | 1   | 2,197,200b | 30,219.100μs | 30,219.100μs | 30,219.100μs | 30,219.100μs | 0.000μs | 0.00%  | 206.56x |
| SingleSaveWithTTL    | benchPsr16Roave  | 0   | 10   | 1   | 1,511,352b | 233.900μs    | 233.900μs    | 233.900μs    | 233.900μs    | 0.000μs | 0.00%  | 1.60x   |
| SingleSaveWithTTL    | benchPsr16Naive  | 0   | 10   | 1   | 1,511,352b | 182.800μs    | 182.800μs    | 182.800μs    | 182.800μs    | 0.000μs | 0.00%  | 1.25x   |
| SingleSaveWithTTL    | benchPsr6Symfony | 0   | 10   | 1   | 1,493,080b | 173.500μs    | 173.500μs    | 173.500μs    | 173.500μs    | 0.000μs | 0.00%  | 1.19x   |
| MultiCacheHitAndMiss | benchPsr16Roave  | 0   | 10   | 1   | 2,582,136b | 3,982.700μs  | 3,982.700μs  | 3,982.700μs  | 3,982.700μs  | 0.000μs | 0.00%  | 27.22x  |
| MultiCacheHitAndMiss | benchPsr16Naive  | 0   | 10   | 1   | 2,203,896b | 2,435.400μs  | 2,435.400μs  | 2,435.400μs  | 2,435.400μs  | 0.000μs | 0.00%  | 16.65x  |
| MultiCacheHitAndMiss | benchPsr6Symfony | 0   | 10   | 1   | 2,017,040b | 2,619.900μs  | 2,619.900μs  | 2,619.900μs  | 2,619.900μs  | 0.000μs | 0.00%  | 17.91x  |
| MultiSaveWithoutTTL  | benchPsr16Roave  | 0   | 10   | 1   | 2,537,496b | 2,733.000μs  | 2,733.000μs  | 2,733.000μs  | 2,733.000μs  | 0.000μs | 0.00%  | 18.68x  |
| MultiSaveWithoutTTL  | benchPsr16Naive  | 0   | 10   | 1   | 2,442,336b | 2,764.700μs  | 2,764.700μs  | 2,764.700μs  | 2,764.700μs  | 0.000μs | 0.00%  | 18.90x  |
| MultiSaveWithoutTTL  | benchPsr6Symfony | 0   | 10   | 1   | 2,688,056b | 19,107.600μs | 19,107.600μs | 19,107.600μs | 19,107.600μs | 0.000μs | 0.00%  | 130.61x |
| MultiRemove          | benchPsr16Roave  | 0   | 10   | 1   | 2,009,752b | 1,374.400μs  | 1,374.400μs  | 1,374.400μs  | 1,374.400μs  | 0.000μs | 0.00%  | 9.39x   |
| MultiRemove          | benchPsr16Naive  | 0   | 10   | 1   | 1,753,752b | 854.300μs    | 854.300μs    | 854.300μs    | 854.300μs    | 0.000μs | 0.00%  | 5.84x   |
| MultiRemove          | benchPsr6Symfony | 0   | 10   | 1   | 1,776,408b | 723.300μs    | 723.300μs    | 723.300μs    | 723.300μs    | 0.000μs | 0.00%  | 4.94x   |
| MultiCacheHit        | benchPsr16Roave  | 0   | 10   | 1   | 2,586,184b | 2,743.800μs  | 2,743.800μs  | 2,743.800μs  | 2,743.800μs  | 0.000μs | 0.00%  | 18.75x  |
| MultiCacheHit        | benchPsr16Naive  | 0   | 10   | 1   | 2,232,744b | 2,351.800μs  | 2,351.800μs  | 2,351.800μs  | 2,351.800μs  | 0.000μs | 0.00%  | 16.08x  |
| MultiCacheHit        | benchPsr6Symfony | 0   | 10   | 1   | 2,011,624b | 2,097.600μs  | 2,097.600μs  | 2,097.600μs  | 2,097.600μs  | 0.000μs | 0.00%  | 14.34x  |
| SingleSaveWithoutTTL | benchPsr16Roave  | 0   | 10   | 1   | 1,511,120b | 273.100μs    | 273.100μs    | 273.100μs    | 273.100μs    | 0.000μs | 0.00%  | 1.87x   |
| SingleSaveWithoutTTL | benchPsr16Naive  | 0   | 10   | 1   | 1,511,120b | 220.000μs    | 220.000μs    | 220.000μs    | 220.000μs    | 0.000μs | 0.00%  | 1.50x   |
| SingleSaveWithoutTTL | benchPsr6Symfony | 0   | 10   | 1   | 1,492,848b | 333.400μs    | 333.400μs    | 333.400μs    | 333.400μs    | 0.000μs | 0.00%  | 2.28x   |
+----------------------+------------------+-----+------+-----+------------+--------------+--------------+--------------+--------------+---------+--------+---------+

This doesn't make sense IMHO, it depends on clients' needs. Passing a closure or a loader as default value is much more suitable than wrapping the value.

That's what we are doing in orm and I'm not aware of closures or loaders in psr-16

As I mentioned above, there's no need for having that here since PSR-16 is a low-level API. The high-level components should just rely on the fact that a cache miss will use the default value, which can be anything.
Each "low-level driver" has a way to differentiate null from cache miss, so again, not important for this test.


Enums

This looks great! Thanks for adding this test.

Do you know why I am not showing under contributors?

I believe it's because the email address that signed the commit is not the same as the email address for your Github profile.

Awww, yes, I can see that I set up GitHub with different address. Darn it...

It might work if you change the email address on your GitHub profile? I'm not sure if they recalculate after that or if it only counts when you push code or submit a PR.


creating person

Using the Nameparser for extracting the authors list from BIDS datasets

is from nameparser import HumanName really a dependency we need?

nameparser is a widely-used, well-supported package. The alternative is to write name parsing code ourselves, which will take time and will not give such good results.

@lzehl ok to merge this?


Use development version of distributed in CI

This PR updates our CI to use the latest development version of distributed. This is needed when changes are co-introduced in dask and distributed (e.g. https://github.com/dask/dask/pull/7179 / https://github.com/dask/distributed/pull/4489). Note that distributeds CI already points to the development version of dask -- when reviewing https://github.com/dask/dask/pull/7179 I mistakenly thought that we also did the same thing for dasks CI.
cc @madsbk

Thanks for reviewing @jakirkham!

Ofc! Thanks for the fix James 😄


✨ Use blob-based CII client

Please check if the PR fulfills these requirements

[ ] Tests for the changes have been added (for bug fixes / features)
[ ] PR title follows the guidelines defined in  https://github.com/ossf/scorecard/blob/main/CONTRIBUTING.md#pr-process

What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)
Fixes #1240

Does this PR introduce a breaking change? (What changes might users need to make in their application due to this PR?)
No.

LGTM!
The issue is, how often will you update the database download? Weekly, or at most daily, should be adequate.

LGTM!
The issue is, how often will you update the database download? Weekly, or at most daily, should be adequate.

As of now it'll happen monthly. I'm assuming the data doesn't change too often?

Data changes far more often, but I think you just want to know "is a project pursuing a badge" & "does it have one".
Every day about 1-2 projects join, and occasionally a project gets a badge. Waiting up to a whole month to update seems very long.
I think a weekly download, at least for now, would be the best pace.

Data changes far more often, but I think you just want to know "is a project pursuing a badge" & "does it have one".
Every day about 1-2 projects join, and occasionally a project gets a badge. Waiting up to a whole month to update seems very long.
I think a weekly download, at least for now, would be the best pace.

Updated to run weekly in #1309


chore(deps): upgrade dev dependencies

Upgrades project dependencies. See details in workflow run.

Automatically created by projen via the "upgrade-dev-dependencies-1.x" workflow

⚪ Backport skipped
The pull request was not backported as there were no branches to backport to. If this is a mistake, please apply the desired version labels or run the backport tool manually.
Manual backport
To create the backport manually run:
backport --pr 1536

Questions ?
Please refer to the Backport tool documentation


refactor: refactor exports, self-validate, pretty output

This has turned into essentially a rewrite of the validateOptions export and supporting files. The output is now beautiful and readable. The validator also self-validates, so incorrect options cannot be ironically used with the validator.
Overall this is a major improvement to the util.

Linking relavent Istanbul issue: https://github.com/istanbuljs/istanbuljs/issues/139


[Proposal] Goshimmer dRNG Committee Governance

Some initial thoughts on our 'homework' about community governance (severely inspired by uniswap & honeyswap communities):
By what means should Community Members be able to gain trust (= Governance Power)?

Time and/or frequency of community participation (e.g. community members who evidently been around and helpful for a long time. Take elchwurst or Nuriel for example? --> SourceCred? )
Coding-Participation ( contribution in github? --> SourceCred? )
Long-term community node-operators (This is debateable, I know, just a suggestion^^)
Extra-ordinary efforts in community projects (e.g. nuriel, elchwurst, huhn & NOBODY for the node-playbooks, einfachIOTA, IOTAarchive and the Node-Pool. Great projects! :blush: )

Implementation ideas:

Guarantee uniqueness of identities --> DID (Maybe only DID-verified addresses should be able to vote?)
Grant governance-power / voting-weight that is otherwise worthless (to avoid token-farming) --> use low-value colored coins for voting in governance decisions
Have faucet grant worthless governance-token automatically triggered by specific emojis in discord (HIGHLY debatable. For HoneySwap it ended temporarily in bots farming SourceCred-points due to the governance-token’s value. On the other hand it improved the tone in Discord and the average quality of contributions. Of course also some undesired 'ass-licking')

Hint: Both Uniswap & Honeyswap use governance-tokens that have value. I don‘ t know why you’d want to go that way if you really only want to give voting-power equal to project- & community-contribution. That’s why I’d at least start with ‚worthless‘ tokens for governance power.
What is supposed to be governed? What kind of decisions are relevant enough to actually be voted on by the community?

This is where it might be reasonable to have some (small amount?) of money / token as the community itself. For example to pay for services with. Yesterday I saw the (unnecessarily rude phrased) request to improve the ledger wallet IOTA software since it does come with some bugs. Is this an IF task? Not really I guess. But it would be a task that could be voted on: If the majority of the community considers this task important enough (as a result of the vote / poll), a part of the community-money could be used to either pay external service providers or to thank community-members to take that task (yes... thanking someone with money is called "paying them", too, i know, but it's the wrong mindset^^). Dont get too stuck on this example, it's more about the idea that the community could actually govern (even with only very very limited ressources) something and maybe manage / prioritize and incentivise tasks that the IF already declared "out of their scope". Just an idea... (I did NOT say where this community-money should come from... I'd have no really good idea so far... )

This is a nice concept / idea about acknowledging community members that have continuously contributed:
https://forum.badger.finance/t/bip-35-long-term-core-contributors/3006
Part of the governance-process was to also vote on whether this idea is to be implemented or not!


Create joiner_mask.py

This mask is for creating a virus with the launch of a legitimate program

Technowlogger already have a built-in binder, there is no need of this script


Remove version: OpenJS.NodeJS.LTS version 16.18.0

Replaced by another Pull Request
Microsoft Reviewers: Open in CodeFlow

https://www.github.com/microsoft/winget-pkgs/pull/143386#issuecomment-1986949152

https://www.github.com/microsoft/winget-pkgs/pull/143386#issuecomment-1986949152 [Policy] Needs-Author-Feedback

https://www.github.com/microsoft/winget-pkgs/pull/143386#issuecomment-1986949152 [Policy] Needs-Author-Feedback

Close with reason: See discussion in above linked issue;


Text selection problems with Type3 fonts

After #5898 text selection for certain PDFs with Type3 fonts has improved a lot. Now that we are actually able to select the text, I have found some other issues, which I list below.

http://www.dfki.uni-kl.de/~kieni/publications/spie98.pdf and http://neo.lcc.uma.es/Articles/WRH98.pdf produce a lot of spaces when copy-pasting text.
https://hal.inria.fr/file/index/docid/73298/filename/RR-3391.pdf from page 4 onward produces gibberish when copy-pasting text and the text layer is still a bit misaligned.

Configuration: Windows 7 x64, Firefox 37.0.2 and the latest PDF.js development version.

Desarrolladores y líderes de Mozilla, que son travestis culo!
Alguien debe colgar ustedes para arriba en sus propias bolas y dejar que su perro muerda su caricatura de una polla!
Posteriormente deben ponerlo tiempo que sea necesario por la garganta hasta que traga a sí mismos en el suicidio!
Ustedes Mozilla está ... Estúpido de mierda coños!
Developers and leaders of Mozilla, which are shemales ass!

They should then put it long as needed by the throat until he swallows themselves in suicide!
You Mozilla is...

Developers and leaders of Mozilla, which are shemales ass!

They should then put it long as needed by the throat until he swallows themselves in suicide!
You Mozilla is...

 And to do a favour... I'm going to do that!
I kicked her so hard failure golden eggs until they are ringing and sing you all the melodies of forward and back pain in an instant!

Was it expected?
Oh, Yes, that was!
A movement such as the Mozilla!
So happy that I never upgraded to Firefox 29 and beyond!
Let me tell you something Mozilla developers! If I would be still using your latest crap-ware that really my mission would at this time to find out where you live and then drill him often in Golden's failure until you analyzes and understands how to threaten power users in the correct way!
Without a doubt, has been said before - but may not be repeated enough... You are...


Nodes of RKE2 cluster not deleted from backend when cluster is deleted

What kind of request is this (question/bug/enhancement/feature request): bug
Steps to reproduce (least amount of steps as possible):
On master-head commit id: f90b36e

Create clusters  2 RKE2 DO clusters created from cluster explorer and 1 RKE1 cluster created from Ember UI
When the clusters are up and running, delete the clusters by selecting them all from Ember UI.
The clusters get deleted
The nodes of RKE2 clusters are not deleted from backend
The nodes of the RKE1 cluster is deleted

Expected Result:
Nodes should be deleted from Digital Ocean Backend
Other details that may be helpful:
Rancher logs:
2021/05/25 18:59:53 [INFO] Deleting cluster [c-m-facc49ca]
2021/05/25 18:59:53 [INFO] [mgmt-cluster-rbac-remove] Deleting namespace c-m-facc49ca
2021/05/25 18:59:53 [INFO] [mgmt-auth-users-controller] Deleting clusterRoleTemplateBinding u-3fc77pwz6h-admin for user u-3fc77pwz6h
2021/05/25 18:59:54 [INFO] [mgmt-auth-users-controller] Deleting globalRoleBinding grb-dbbb7 for user u-3fc77pwz6h
2021/05/25 18:59:54 [INFO] [mgmt-auth-crtb-controller] Deleting roleBinding crb-d2kmxgqmq7
2021/05/25 18:59:54 [INFO] [mgmt-auth-crtb-controller] Deleting rolebinding u-3fc77pwz6h-admin-cluster-owner in namespace p-thj5j for crtb u-3fc77pwz6h-admin
2021/05/25 18:59:54 [ERROR] error syncing 'c-m-facc49ca': handler mgmt-cluster-remove: clusters.provisioning.cattle.io "sowmya-2" not found, requeuing
2021/05/25 18:59:54 [INFO] [mgmt-auth-crtb-controller] Deleting rolebinding u-3fc77pwz6h-admin-cluster-owner in namespace p-9j8q5 for crtb u-3fc77pwz6h-admin
2021/05/25 18:59:54 [INFO] [mgmt-auth-crtb-controller] Updating owner label for roleBinding crb-smjcbfenrk
2021/05/25 18:59:54 [INFO] [mgmt-auth-crtb-controller] Deleting rolebinding c-m-facc49ca-owner-cluster-owner in namespace p-8276l for crtb c-m-facc49ca-owner
2021/05/25 18:59:54 [INFO] Deleting cluster [c-m-867d20db]
2021/05/25 18:59:54 [INFO] [mgmt-auth-crtb-controller] Deleting rolebinding c-m-facc49ca-owner-cluster-owner in namespace p-26s6v for crtb c-m-facc49ca-owner
2021/05/25 18:59:54 [ERROR] error syncing 'c-m-facc49ca/default-token': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:54 [ERROR] error syncing 'c-m-facc49ca/system': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:54 [ERROR] Error deleting resource: error deleting cluster fleet-default/sowmya-2: failed to delete cluster.x-k8s.io/v1alpha4, Kind=MachineDeployment sowmya-2-nodepool-pool1: machinedeployments.cluster.x-k8s.io "sowmya-2-nodepool-pool1" not found
2021/05/25 18:59:54 [ERROR] error syncing 'c-m-facc49ca': handler user-controllers-controller: clusters.management.cattle.io "c-m-facc49ca" not found, handler mgmt-cluster-remove: Operation cannot be fulfilled on clusters.management.cattle.io "c-m-facc49ca": StorageError: invalid object, Code: 4, Key: /registry/management.cattle.io/clusters/c-m-facc49ca, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7d1c804b-7001-4d38-886b-a4bcc54fcaab, UID in object meta: , requeuing
2021/05/25 18:59:54 [ERROR] error syncing 'c-m-facc49ca/default-token': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:54 [ERROR] error syncing 'c-m-facc49ca/system': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:54 [ERROR] error syncing 'c-m-facc49ca/default-token': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:54 [ERROR] error syncing 'c-m-facc49ca/system': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:54 [ERROR] Reconciler error: error deleting cluster fleet-default/sowmya-2: failed to delete cluster.x-k8s.io/v1alpha4, Kind=MachineDeployment sowmya-2-nodepool-pool1: machinedeployments.cluster.x-k8s.io "sowmya-2-nodepool-pool1" not found
2021/05/25 18:59:54 [INFO] [mgmt-cluster-rbac-remove] Deleting namespace c-m-867d20db
2021/05/25 18:59:54 [ERROR] error syncing 'c-m-facc49ca/default-token': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:54 [ERROR] error syncing 'c-m-facc49ca/system': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:54 [ERROR] error syncing 'c-m-facc49ca/default-token': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:54 [ERROR] error syncing 'c-m-facc49ca/system': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:54 [ERROR] error syncing 'c-m-facc49ca/default-token': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:54 [ERROR] error syncing 'c-m-facc49ca/system': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:55 [INFO] [mgmt-auth-crtb-controller] Updating owner label for roleBinding crb-hhrpl2acuz
2021/05/25 18:59:55 [INFO] [mgmt-auth-crtb-controller] Deleting rolebinding c-m-867d20db-owner-cluster-owner in namespace p-thj5j for crtb c-m-867d20db-owner
2021/05/25 18:59:55 [INFO] [mgmt-auth-crtb-controller] Deleting rolebinding c-m-867d20db-owner-cluster-owner in namespace p-9j8q5 for crtb c-m-867d20db-owner
2021/05/25 18:59:55 [INFO] error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF
2021/05/25 18:59:55 [ERROR] error syncing 'c-m-facc49ca/default-token': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:55 [ERROR] error syncing 'c-m-facc49ca/system': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:55 [ERROR] error syncing 'c-m-facc49ca/default-token': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:55 [ERROR] error syncing 'c-m-facc49ca/system': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:56 [INFO] error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF
2021/05/25 18:59:56 [ERROR] Reconciler error: clusters.cluster.x-k8s.io "sowmya-2" not found
2021/05/25 18:59:56 [ERROR] Reconciler error: failed to get cluster "sowmya-2" for machine "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" in namespace "fleet-default": Cluster.cluster.x-k8s.io "sowmya-2" not found
2021/05/25 18:59:56 [ERROR] Reconciler error: failed to get cluster "sowmya-2" for machine "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" in namespace "fleet-default": Cluster.cluster.x-k8s.io "sowmya-2" not found
2021/05/25 18:59:56 [ERROR] Reconciler error: failed to get cluster "sowmya-2" for machine "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" in namespace "fleet-default": Cluster.cluster.x-k8s.io "sowmya-2" not found
2021/05/25 18:59:56 [ERROR] Reconciler error: failed to get cluster "sowmya-2" for machine "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" in namespace "fleet-default": Cluster.cluster.x-k8s.io "sowmya-2" not found
2021/05/25 18:59:56 [ERROR] Reconciler error: failed to get cluster "sowmya-2" for machine "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" in namespace "fleet-default": Cluster.cluster.x-k8s.io "sowmya-2" not found
2021/05/25 18:59:56 [ERROR] error syncing 'fleet-default/sowmya-2-bootstrap-template-wmqdx': handler machine-node-lookup: machines.cluster.x-k8s.io "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" not found, requeuing
2021/05/25 18:59:56 [ERROR] error syncing 'fleet-default/sowmya-2-bootstrap-template-wmqdx': handler rke-machine: machines.cluster.x-k8s.io "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" not found, handler machine-node-lookup: machines.cluster.x-k8s.io "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" not found, requeuing
2021/05/25 18:59:56 [ERROR] error syncing 'fleet-default/sowmya-2-bootstrap-template-wmqdx': handler rke-machine: machines.cluster.x-k8s.io "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" not found, handler machine-node-lookup: machines.cluster.x-k8s.io "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" not found, requeuing
2021/05/25 18:59:56 [ERROR] error syncing 'fleet-default/sowmya-2-bootstrap-template-wmqdx': handler rke-machine: machines.cluster.x-k8s.io "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" not found, handler machine-node-lookup: machines.cluster.x-k8s.io "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" not found, requeuing
2021/05/25 18:59:56 [ERROR] error syncing 'fleet-default/sowmya-2-bootstrap-template-wmqdx': handler rke-machine: machines.cluster.x-k8s.io "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" not found, handler machine-node-lookup: machines.cluster.x-k8s.io "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" not found, requeuing
2021/05/25 18:59:56 [ERROR] error syncing 'fleet-default/sowmya-2-bootstrap-template-wmqdx': handler rke-machine: machines.cluster.x-k8s.io "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" not found, handler machine-node-lookup: machines.cluster.x-k8s.io "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" not found, requeuing
2021/05/25 18:59:57 [ERROR] error syncing 'fleet-default/sowmya-2-bootstrap-template-wmqdx': handler rke-machine: machines.cluster.x-k8s.io "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" not found, handler machine-node-lookup: machines.cluster.x-k8s.io "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" not found, requeuing
2021/05/25 18:59:57 [ERROR] error syncing 'fleet-default/sowmya-2-nodepool-pool1-ctj95': handler machine-provision: Operation cannot be fulfilled on digitaloceanmachines.rke-node.cattle.io "sowmya-2-nodepool-pool1-ctj95": StorageError: invalid object, Code: 4, Key: /registry/rke-node.cattle.io/digitaloceanmachines/fleet-default/sowmya-2-nodepool-pool1-ctj95, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4ce7fa39-3949-4502-a83c-c90ccc797f07, UID in object meta: , requeuing
2021/05/25 18:59:57 [ERROR] error syncing 'c-m-facc49ca/default-token': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:57 [ERROR] error syncing 'c-m-facc49ca/system': handler cluster-registration-token: clusters.management.cattle.io "c-m-facc49ca" not found, requeuing
2021/05/25 18:59:57 [ERROR] error syncing 'fleet-default/sowmya-2-bootstrap-template-wmqdx': handler rke-machine: machines.cluster.x-k8s.io "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" not found, handler machine-node-lookup: machines.cluster.x-k8s.io "sowmya-2-nodepool-pool1-599f5d8d6b-sh4dt" not found, requeuing
2021/05/25 18:59:58 [ERROR] Reconciler error: clusters.cluster.x-k8s.io "sowmya-1" not found
2021/05/25 18:59:58 [ERROR] Reconciler error: failed to get cluster "sowmya-1" for machine "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" in namespace "fleet-default": Cluster.cluster.x-k8s.io "sowmya-1" not found
2021/05/25 18:59:58 [ERROR] Reconciler error: failed to get cluster "sowmya-1" for machine "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" in namespace "fleet-default": Cluster.cluster.x-k8s.io "sowmya-1" not found
2021/05/25 18:59:58 [ERROR] Reconciler error: failed to get cluster "sowmya-1" for machine "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" in namespace "fleet-default": Cluster.cluster.x-k8s.io "sowmya-1" not found
2021/05/25 18:59:58 [ERROR] Reconciler error: failed to get cluster "sowmya-1" for machine "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" in namespace "fleet-default": Cluster.cluster.x-k8s.io "sowmya-1" not found
2021/05/25 18:59:58 [ERROR] Reconciler error: failed to get cluster "sowmya-1" for machine "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" in namespace "fleet-default": Cluster.cluster.x-k8s.io "sowmya-1" not found
2021/05/25 18:59:58 [ERROR] error syncing 'fleet-default/sowmya-1-bootstrap-template-9ktsq': handler rke-machine: machines.cluster.x-k8s.io "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" not found, handler machine-node-lookup: machines.cluster.x-k8s.io "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" not found, requeuing
2021/05/25 18:59:58 [ERROR] error syncing 'fleet-default/sowmya-1-bootstrap-template-9ktsq': handler rke-machine: machines.cluster.x-k8s.io "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" not found, handler machine-node-lookup: machines.cluster.x-k8s.io "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" not found, requeuing
2021/05/25 18:59:58 [ERROR] error syncing 'fleet-default/sowmya-1-nodepool-pool1-p8jvk': handler machine-provision: Operation cannot be fulfilled on digitaloceanmachines.rke-node.cattle.io "sowmya-1-nodepool-pool1-p8jvk": StorageError: invalid object, Code: 4, Key: /registry/rke-node.cattle.io/digitaloceanmachines/fleet-default/sowmya-1-nodepool-pool1-p8jvk, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f0a607ea-9c12-4bbf-8e46-06c4be9acba3, UID in object meta: , requeuing
2021/05/25 18:59:58 [ERROR] error syncing 'fleet-default/sowmya-1-bootstrap-template-9ktsq': handler rke-machine: machines.cluster.x-k8s.io "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" not found, handler machine-node-lookup: machines.cluster.x-k8s.io "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" not found, requeuing
2021/05/25 18:59:58 [ERROR] error syncing 'fleet-default/sowmya-1-bootstrap-template-9ktsq': handler rke-machine: machines.cluster.x-k8s.io "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" not found, handler machine-node-lookup: machines.cluster.x-k8s.io "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" not found, requeuing
2021/05/25 18:59:58 [INFO] kontainerdriver rancherkubernetesengine listening on address <IP_ADDRESS>:46395
2021/05/25 18:59:58 [INFO] cluster [c-bcmlx] provisioning: Tearing down Kubernetes cluster
2021/05/25 18:59:58 [ERROR] error syncing 'fleet-default/sowmya-1-bootstrap-template-9ktsq': handler rke-machine: machines.cluster.x-k8s.io "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" not found, handler machine-node-lookup: machines.cluster.x-k8s.io "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" not found, requeuing
2021/05/25 18:59:58 [INFO] cluster [c-bcmlx] provisioning: [dialer] Setup tunnel for host [<IP_ADDRESS>]
2021/05/25 18:59:58 [INFO] cluster [c-bcmlx] provisioning: [worker] Tearing down Worker Plane..
2021/05/25 18:59:58 [INFO] Removing container [kubelet] on host [<IP_ADDRESS>], try       #1
2021/05/25 18:59:58 [ERROR] error syncing 'fleet-default/sowmya-1-bootstrap-template-9ktsq': handler rke-machine: machines.cluster.x-k8s.io "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" not found, handler machine-node-lookup: machines.cluster.x-k8s.io "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" not found, requeuing
2021/05/25 18:59:59 [INFO] [mgmt-auth-crtb-controller] Deleting roleBinding crb-smjcbfenrk
2021/05/25 18:59:59 [ERROR] error syncing 'fleet-default/sowmya-1-bootstrap-template-9ktsq': handler rke-machine: machines.cluster.x-k8s.io "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" not found, handler machine-node-lookup: machines.cluster.x-k8s.io "sowmya-1-nodepool-pool1-656fdf859c-bfp2m" not found, requeuing

Environment information

Rancher version (rancher/rancher/rancher/server image tag or shown bottom left in the UI):  master-head commit id: f90b36e
Installation option (single install/HA): single

Cluster information

Cluster type (Hosted/Infrastructure Provider/Custom/Imported): Do RKE2
Kubernetes version (use kubectl version):

1.21.1-alpha5-rke2r1

There were some issues around invoking the machine driver to delete the machines that may have now been corrected, but the code within machine is still being used to delete the backend machines

Test report:
Tested on rancher/rancher:master-head 97ca638 - on local RKE1 cluster (on k8s v1.20.7) - I've created 2 DO RKE2 clusters from Explorer and 1 DO RKE1 cluster from Ember.
One RKE1 (3 nodes with all roles on k8s v1.20.7) and two RKE2 (3 nodes with all roles on k8s v1.21.1 each) clusters were deleted at once in Ember - also all nodes were destroyed automatically and removed from DO.
This shouldn't have a backport into v2.5 as RKE2 provisioning is available only in Explorer. Close


Remove arrow from  using 'size' or 'multiple' attribute

This will remove the arrow symbol from  elements using either the 'size'
or the 'multiple' attribute, since these are expanded and using a scrollbar instead.
See this Codepen for a live preview of the old vs. the new styling: https://codepen.io/alexandersandberg/pen/NZBNKo

These adjustments look great, @jonathantneal! I have pushed a fix to the branch (as you've noticed already, hehe). 🙂

Your work has been merged! I’ll ping you shortly when the next release is published.

Published via<EMAIL_ADDRESS>🎉

Yay! Happy to help out. 😄

This method is not great because the selector is too specific and I need to write even more specific selectors in my CSS to amend the styling of the select input.
select:not([multiple]):not([size]) takes precedence over the most commonly used selectors, such as, but not limited to:
select.custom-select
.custom-select select

You can see an example Codepen here: https://codepen.io/goodpixels/pen/RwoWpgV
I think this needs to be re-visited and possibly the selector should be changed to a custom CSS class name.
Thank you!

It might even be misguided beyond that, since on mobile OS’s adding size or multiple does not make the <select>s expand into listboxes.

I think in this case this should do the trick:
select {
    background-image: url("data:image/svg+xml;charset=utf-8,%3Csvg xmlns='http://www.w3.org/2000/svg' width='16' height='4'%3E%3Cpath d='M4 0h6L7 4'/%3E%3C/svg%3E");
}

select[multiple] {
    background-image: none;
    // Alternatively background-size
    // background-size: 0;
}


How can I hide the file path and method name that were invoked?

Register User (register)  - hide "(register)"
Register user
app/controllers/auth/main_controller.ts - register // hide this

Also, when you tag your endpoints in an effort to group them, I get multiple tags (groups) and how do i change the description too.

It's all already in the docs.
Also, different UIs render it differently.

It's all already in the docs.
Also, different UIs render it differently.

And by description, I mean description of a tag, that is to change the "Everything related to AUTH"


400% faster Pattern Lab compile

This will be part of a bigger initiative to selectively run certain long running tasks only when needed; specifically when running a full compile that is signified by the NODE_ENV environmental variable set to production. There was a --prod flag that could be passed to gulp, but other pieces of the build could benefit from knowing the environment of the build, like the Twig functions.
One function in particular, bgcolor, had a profound effect when disabled: my Pattern Lab compiles went from 2:20 minutes down to 35 seconds! Since this PR moves the prod flag over to env vars instead of CLI flags, we can use the bgcolor function only when npm run build or npm run build:full is ran - which is what the deployment uses.
One area that may need a bit of work before this PR is merged is for @sghoweri to look at the use of $.env.production and $.env.development in tasks/styles.js here (PS there's a few other uses besides those lines) to make sure we didn't lose the ability to trigger those by removing --prod from gulp build --prod.
This should help lots! More to do in this area, but I wanted to get this one out the door!

@sghoweri Can you give me some thoughts on what's happening with the build fails?

Take a peak, I believe we’re ready on this.


Error creating the device enrollment entry

When the Device enrollment entry is being created, you can get an error: The certificate is not a valid base64 string value.
It can be fixed if you delete the first and the last line in the certificate file.

@isabelcabezasm : Thanks for your contribution! The author, @liydu, has been notified to review your proposed change.

#sign-off

@GitHubber17 : Thanks for your contribution! The author, @liydu, has been notified to review your proposed change.


Python warns against using np.Matrix class

When I use pin.computeGeneralizedGravity()
A numpy matrix is returned which then fires this warning:
 PendingDeprecationWarning: the matrix subclass is not the recommended way to represent matrices or deal with linear algebra (see https://docs.scipy.org/doc/numpy/user/numpy-for-matlab-users.html). Please adjust your code to use regular ndarray.
Are there plans to depreciate the use of Matrix?
Thanks

Hi @blooop,
This issue concerns eigenpy, and its behavior can be changed with eigenpy.switchToNumpyArray()

ref https://github.com/stack-of-tasks/eigenpy/issues/41

I can reformulate the question like this.
Are there any plans to change eigenpy such that it uses arrays instead of matrices by default ?
At some point, this will be necessary. I have no idea of the timeline though.

Are there plans to depreciate the use of Matrix?

Yes, in future release of Pinocchio we plan to do it. We managed to handle both cases thanks to EigenPy.

Are there any plans to change eigenpy such that it uses arrays instead of matrices by default ?

Yes, for sure. We need to decide when? The smooth solution is already implemented, which means that we have the option to change the conversion convention online. We just need to setup the default value (this can already be performed in each package depending on EigenPy).

I opened an issue on Eigenpy to discuss about that: https://github.com/stack-of-tasks/eigenpy/issues/87

Dear @blooop,
First of all, thanks for raising this issue. I've just released a new release of EigenPy which will lead to a new release of Pinocchio in the very few next days.
You can already suppress your current warning by using numpy.arrayin all your code thanks to eigenpy.switchToNumpyArray().
I will close this issue as it seems to be solved. Feel free to reopen it if needed.

Excellent, thanks!


[Announcement] RenderDoc v1.0 release candidate for testing

tl;dr

v1.0 is coming soon and nightly builds are converging as it stabilises. I'm asking for testing and any general feedback to improve the v1.0 release.
RenderDoc_2018_02_26_d130b965: Windows x64 & Linux x64 is the latest at the time of writing.

v1.0 Release candidate
The features and overall scope for v1.0 is now locked down, but there have been significant internal and external changes since the last stable build v0.91.
I'd like to ask people who have the time to please test the current v1.x nightly builds. Please give me feedback or bug reports no matter how small they may seem. You can either file new issues, or comment here for general feedback, or contact me directly.
There's still some work to do before v1.0 stable ships and I will be doing my own testing and polishing of course, but the more feedback I get now the better the v1.0 release can be.
Changes
A full changelog and release notes will follow when v1.0 ships, but the high-level summary of the most changed areas:

The internal serialisation has been revamped, so if nothing else simply capturing your program and then replaying it back to ensure there are no crashes or corruption in the replay would be very useful.
This also enabled several features, including the resource inspector. Any time you see a name with a link icon  you can click it to jump to the resource inspector, listing all the calls associated with that resource, parent/child objects, and letting you rename it at runtime.
RenderDoc now supports Vulkan and GLES3 on Android. More information is available in the wiki but it uses the same workflow as you're familiar with on desktop. The same restrictions as desktop GL apply with regard to minimum feature support and multiple context use.
For windows, the UI program has changed. The previous .NET-based renderdocui has been removed and the Qt qrenderdoc originally developed on/for linux has now been rolled out to all platforms. This should work identically, but has a number of benefits e.g. proper high-DPI support for those unfortunates who need it.

The biggest thing you can help me with is simply giving wider coverage - I only have a limited set of applications I can capture and replay to test with, and no matter how much I try to cover everything there's no substitute for a dozen people all trying it in their own way! :smile:
Known issues

Old captures are not compatible. This is deliberate, and a best-effort converter may be provided for the final release, but for now you need to make new captures.
Using GLES on Android some images won't have proper contents if they are frequently updated in app.
The texture overlays are not yet supported when using GLES on Android.
In some cases on vulkan particularly with complex vertex inputs, the mesh output will be incorrect.
MSAA textures will not display on Android.
Several small things around the Qt UI need polish or fixing.
Issues overwriting files while saving captures.
Save texture dialog doesn't handle file types well.
Vulkan mesh output doesn't support primitive restart.
Shader window titles always use vertex shader name.
Scintilla controls don't properly follow the dark theme.

I'll keep this issue updated as new issues are found or existing ones are addressed.
Any and all help is much appreciated! Thank you.

Minor regression: double-clicking process name in the Inject Into Process list doesn't attach (https://github.com/baldurk/renderdoc/pull/448)

Damn, I thought I'd ported that across to the Qt UI. Fixed now :smile:.

First impression on Windows 10: It's very... gray? Like the theme feels like something for Windows XP, if even that. It kind of has that "disabled" (as in "I can't interact with these elements) color?
Here's a comparison with some other applications I'm currently running:

I've got a crash when clicking around in the tree view with the texture tab open. Got it twice now so seems reproducible.

Regarding the theme this will always be subjective I think, it's not possible to please everyone. It doesn't seem very different to the other windows to me - I'm not sure if you are referring to he buttons on the event browser, but they are disabled/greyed out because there's no capture loaded. It will be somewhat different in the end just because I personally find the flat design of windows 10 quite ugly :smile:.
If you prefer it you can change to a dark theme in the settings window, or else change to Qt's native platform theme (which still may or may not match what you expect). In theory you can use a custom Qt theme, although I haven't tried that.
For the crash can you give me the reproduction steps you ran into, so I can investigate and fix the bug?

@Srekel I agree the default theme on Windows looks dated (interesting that you shpuld compare it to 7-zip which is quite unappealing ;p), but changing it in the settings window makes it look much more Windows-like. Maybe this could be the default, at least on Windows?

There is no text content in the right hand pane of the help

If you have multiple captures, and save one of the frames as a specific file name. And then try and save another frame to the same filename, you get the message below rather than a 'do you really want to overwrite this file' message

If you save a capture and then double click on it to load (it will not load the release candidate but the last installed version). it then hangs trying to load the file

Aha, yes the native and dark themes look better (subjectively, of course :) ). Maybe use Native by default?
As for the repro steps:

I launch our app (it uses Vulkan) through renderdoc.
Press Trigger After Delay
Load the capture
Switch to texture viewer (not sure if necessary)
I can click around on many things in the Event browser, but (at least) one specific entry causes it to crash if I click it.

Is it possible to get a debug build, or does it generate logs or a minidump I could attach?

Not sure if this is an issue or just my lack of experience with the tool. I loaded a previously save capture and did looping replay. I then wanted to sample the performance counters but clicking the button did nothing?

It would be nice if it made the selected file format the default in the "Save Texture As" window.
Bonus points for remembering the last selected file format ;)

OK these replies are coming too fast all of a sudden for me! Batched response to hopefully catch up:

@redorav @Srekel Like I say I think this will always be subjective. I don't personally think it looks dated, although it doesn't look like modern windows (after Win 7) which I think is a very good thing. The default will stay as it is since I think Qt's native theme looks particularly bad sometimes:

So I'd rather have my own consistent theme cross-platform. Having a custom theme also allows me to define light/dark modes which was requested. I'm surprised you think the dark theme is better - it's precisely the same design just with an inverted colour palette.
In the end the option to switch to Qt's native platform theme is there for those who want it.

There is no text content in the right hand pane of the help

@TheMartynBliss I think I've seen this before where the downloaded zip is marked as 'untrustworthy' by windows, and it refuses to load the pages without displaying any error message.
Can you try closing the program, going to the file properties on the .chm file from explorer and seeing if there's an "unblock" button? Or just open the .chm directly from explorer and it might prompt you. I'm not sure there's much I can do about this myself. More info on MS's site here.

If you have multiple captures, and save one of the frames as a specific file name. And then try and save another frame to the same filename, you get the message below rather than a 'do you really want to overwrite this file' message

@TheMartynBliss I'll look into this, thanks!

If you save a capture and then double click on it to load (it will not load the release candidate but the last installed version). it then hangs trying to load the file

@TheMartynBliss Yes the zip doesn't change any file associations, and the existing renderdoc can't open the file. For me it seems unfortunately because the version error message pops up quickly it seems that there's a bug in the .NET UI which hides it behind the progress bar or something, so it looks unresponsive/hung. Normally a popup during loading would happen later and appear normally, I think. If I alt-tab then I can get to the "Error opening log" popup. Do you get that?

Is it possible to get a debug build, or does it generate logs or a minidump I could attach?

@Srekel The easiest way to get a debug build is simply to sync and build from github - just download the source from the v1.x branch and build the VS solution, no other steps should be necessary.
My suspicion is that when you select that particular event it fetches the mesh output, and this is what's crashing. Can you try closing the mesh output window before selecting it to see if that avoids the crash? If that's it, I'll need some more repro info - ideally the capture itself, but at least the shader which is bound at that point so I can see why it might be failing to fetch.

Not sure if this is an issue or just my lack of experience with the tool. I loaded a previously save capture and did looping replay. I then wanted to sample the performance counters but clicking the button did nothing?

@TheMartynBliss I'm not quite sure what steps you're taking here.
The 'replay loop' in the tools menu is designed specifically so that you can capture renderdoc in an external tool like AMD's RGP - it has no purpose or function in renderdoc. While the replay loop is open you cannot use the rest of the UI. I could perhaps add a progress dialog to make this clearer.
When you say you tried to sample the performance counters, did you click the timing button in the event browser to get per-draw times, or did you open the performance counter view? The latter is still work in progress and is not really useful right now. If you click 'capture counters' it should open a dialog to let you select which counters you want to collect, then clicking "sample counters" will fetch all of those counters for each draw. Let me know if that's what you were trying or which button did nothing when pressed.

It would be nice if it made the selected file format the default in the "Save Texture As" window.
Bonus points for remembering the last selected file format ;)

@marco-we good point, I've been meaning to look at this dialog again because it can get a bit fiddly selecting the different options.

Hi Baldur
Looking at a D3D11 capture, opening the pipeline state view, then the Pixel Shader box, then the "View" button near the "Pixel Shader 95" name box opens a tab titled "Vertex Shader 72", while I would expect "Pixel Shader 95" instead.
Great news re: RenderDoc 1.0 and congrats for the upcoming release !

@EBatut-ALG I think I've repro'd this. Can you just confirm that the shader itself is the correct one, it's just the window title that's wrong? It looks like I'm updating the window title before I set the right shader stage, so it picks the vertex shader by default.
Yes I think it's probably a bug that scintilla controls anywhere aren't dark themed. I don't use dark themes so I'm not sure what people expect exactly, but it seems like it would fit better.

I can confirm the shader is the correct one, it's just the tab title that is wrong.
Re: the dark theme and the disassembly, this feels weird when the entire application is dark (I personally find it easier on the eyes) and the text view still has a white BG, but I don't know if the Qt theme can correctly propagate to the Scintilla text view :( It's certainly not a release blocker though, more a matter of personal preference...

I believe it doesn't propagate by default because the Qt wrapper around scintilla is pretty thin to expose commands and propagate events, and then scintilla does all its own custom painting. However it should be possible to set the style to a dark theme - it just means going the long way around and setting every colour that scintilla uses to the appropriate dark alternative.

It seems to me that the mesh preview does not correctly handle primitive restart with the vulkan backend. The vertex data is showing the "Restart" marker and it works when running through DX11. I can not 100% rule out that I have not made a mistake yet though.

@tafuri that sounds quite possible, I had to rewrite the mesh fetching code to work with mobile GPU limitations. I'll check this out, thanks!

@TheMartynBliss @marco-we @EBatut-ALG these issues should be fixed on v1.x in the next nightly build:

Issues overwriting files while saving captures.
Save texture dialog doesn't handle file types well.
Shader window titles always use vertex shader name.
Scintilla controls don't properly follow the dark theme.

@Srekel I don't know if it will fix your case - I'm not sure if you verified it was the mesh output or not - but I did also fix a few potential crashes in the mesh output fetch on Vulkan. If you can try with the next nightly build that would be great, and give more info so I can diagnose the problem if it's still broken.

Great news, thanks!

Scintilla controls don't properly follow the dark theme.

This is still a problem when using a natively dark theme (Breeze Dark) on linux (rev 2300a94).

I'm also still seeing VK_ERROR_OUT_OF_DEVICE_MEMORY when skipping around indexed indirect drawcalls in the mesh viewer in Sasha Willem's indirectdraw demo.

@tafuri I believe I've fixed the issues with primitive restart indices in vulkan mesh viewer, please check it out on the next nightly build when you get a chance.
@Srekel I've also fixed some more mesh output bugs on Vulkan, but without any repro/further information from you I'm not sure if it fixes the crash you had or not.

Sorry, I've forgotten to test again. I'll try and do it during the weekend. :)

@baldurk Yes, now it looks as expected. Thanks!

Hello Baldur
It looks like during a D3D11 capture, even if the scissor values are captured correctly, it is not applied during capture replay, which produces incorrect textures. This is on build https://github.com/baldurk/renderdoc/commit/b7c69bd82393ee6013f1fbf3dcf285c6c96c8735.
On the attached capture, it happens at EID 35. The end result of the capture should be the DDS included in the attached zip.
out_0000_2E1FB2AF.zip
sbsextract_capture_frame0.zip
Is this enough info for you to have a look or do you want me to send you a test exe?
Cheers,
Eric

Thanks for reporting this! FYI I do indeed get pinged for all replies on this repository, I think so do any people who 'watch' it.
The bug here seems to be that the rasterizer state that's supposed to be bound at the start of the frame wasn't referenced and included into the capture, so you end up with "No Resource " on the pipeline state - and the default rasterizer state has scissor disabled.
If I export to xml, add a create chunk for the needed rasterizer state, and import, it works fine:
<chunk id="1024" name="ID3D11Device::CreateRasterizerState" length="33" threadID="11724" timestamp="180123" duration="10">
  <struct name="Descriptor" typename="D3D11_RASTERIZER_DESC">
    <enum name="FillMode" typename="D3D11_FILL_MODE" string="D3D11_FILL_SOLID">3</enum>
    <enum name="CullMode" typename="D3D11_CULL_MODE" string="D3D11_CULL_BACK">3</enum>
    <bool name="FrontCounterClockwise" typename="bool">false</bool>
    <int name="DepthBias" typename="int32_t" width="4">0</int>
    <float name="DepthBiasClamp" typename="float" width="4">0</float>
    <float name="SlopeScaledDepthBias" typename="float" width="4">0</float>
    <bool name="DepthClipEnable" typename="bool">true</bool>
    <bool name="ScissorEnable" typename="bool">true</bool>
    <bool name="MultisampleEnable" typename="bool">false</bool>
    <bool name="AntialiasedLineEnable" typename="bool">false</bool>
  </struct>
  <ResourceId name="pState" typename="ID3D11RasterizerState *" width="8" string="ResourceId::31">31</ResourceId>
</chunk>

(also, hooray that is pretty cool to be able to do! :smile:).
The bug is that I started tracking state objects on their own instead of just including them all in the capture because I ran into a bug where a program allocated more state objects over its lifetime (releasing many of them along the way) than were legal to exist at anyone time. Whenever they were bound to the pipeline I referenced them, but I forgot to mark referenced the initially bound resources at the start of the frame.
Should be fixed with that commit up there, but you'll have to recapture.

Great, thanks a lot!
The weird thing is that in the Pipeline State viewer, the Rasterizer correctly lists the right values for the Scissor regions, so they're included in the capture somewhere but not fed to the Replay subsystem. Is that consistent with your investigation?

Yep that makes sense. In D3D11 the scissor rects are set independently of whether scissor is enabled or disabled, unlike e.g. Vulkan where scissor is always implicitly enabled and you just have to set scissor rects that cover the whole viewport to 'disable' it.
In your capture there wasn't an explicit call to RSSetState anywhere - if there had been it would have worked. Instead at the start of the capture there was a little reference saying "Hey, bind rasterizer state 31 please at the start of the frame", except rasterizer state 31 hadn't ever been created. So you ended up with the default NULL state that has scissor disabled:

With the fix, state 31 will be included into the capture and created. If I manually add it into the capture you can see things looking better:

There's also the viewport/scissor overlay in the texture viewer which shows a dashed line around the scissor rect if it's enabled, which is a little less direct but when scissor is disabled the dashed line disappears entirely so that's another indication.

Ah, I see now.
Many thanks for the detailed explanations and for the ultra-quick fix !

Open question for anyone still paying attention to this bug: I've built a simple converter utility to convert from v0.x compatible captures to v1.x compatible captures. You just run rdcconvert mycapture.rdc and it will spit out converted_<date>_<time>.rdc. It's not perfect but it works reliably on my testing with a variety of captures and is another option for people to have - the older builds aren't going away so it's always possible to get a zip of v0.91 and saving it next to your captures for use.
I'll push the source to it up as a branch off v0.x, but I wonder what the best way to distribute a binary build is. It doesn't really fit on the downloads page which is automatically generated, so I was thinking of just linking the download from the v1.0 release notes. Does anyone have any different ideas?
General note - I plan to release at the start of next week so if you have any bugs to report, now's the time :smile:. I'm hoping the silence means the build is solid.

Thanks for the testing and feedback everyone! v1.0 has now shipped.
Onwards and upwards!

Congratulations Baldur!
From: Baldur Karlsson<EMAIL_ADDRESS>Sent: Tuesday, March 6, 2018 3:25 PM
To: baldurk/renderdoc<EMAIL_ADDRESS>Cc: TheMartynBliss<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [baldurk/renderdoc] [Announcement] RenderDoc v1.0 release candidate for testing (#862)
Thanks for the testing and feedback everyone! v1.0 has now shipped.
Onwards and upwards!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub https://github.com/baldurk/renderdoc/issues/862#issuecomment-370817562 , or mute the thread https://github.com/notifications/unsubscribe-auth/AVtivBKFlMtw96hvQMtLMysGpSiSCs0Lks5tbqpFgaJpZM4R7lfz .

Any chance a copy of the rdcconvert is still around? I should have converted all of my RDCs when I had the chance, but did them selectively, and now can't find the converter anywhere.


Data Loader throwing FileNotFound error After few epochs of training

I've used training command but every time after random number of epochs I've got FileNotFound error from dataloader.Anyone knows the solution?
error:
epoch:    14   learning rate:   1e-05
[  0/333]  eta: 0:14:51  training_loss: 0.1127 (0.1127)  loss_mask: 0.0446 (0.0446)  loss_dice: 0.0681 (0.0681)  time: 2.6786  data: 0.3379  max mem: 10103
Traceback (most recent call last):
File "/content/drive/MyDrive/sam-hq/train/train.py", line 651, in
main(net, train_datasets, valid_datasets, args)
File "/content/drive/MyDrive/sam-hq/train/train.py", line 360, in main
train(args, net, optimizer, train_dataloaders, valid_dataloaders, lr_scheduler,writer)
File "/content/drive/MyDrive/sam-hq/train/train.py", line 396, in train
for data in metric_logger.log_every(train_dataloaders,1000):
File "/content/drive/MyDrive/sam-hq/train/utils/misc.py", line 237, in log_every
for obj in iterable:
File "/usr/local/lib/python3.10/dist-packages/torch/utils/data/dataloader.py", line 633, in next
data = self._next_data()
File "/usr/local/lib/python3.10/dist-packages/torch/utils/data/dataloader.py", line 1345, in _next_data
return self._process_data(data)
File "/usr/local/lib/python3.10/dist-packages/torch/utils/data/dataloader.py", line 1371, in _process_data
data.reraise()
File "/usr/local/lib/python3.10/dist-packages/torch/_utils.py", line 644, in reraise
raise exception
FileNotFoundError: Caught FileNotFoundError in DataLoader worker process 0.
Original Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/torch/utils/data/_utils/worker.py", line 308, in _worker_loop
data = fetcher.fetch(index)
File "/usr/local/lib/python3.10/dist-packages/torch/utils/data/_utils/fetch.py", line 51, in fetch
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/usr/local/lib/python3.10/dist-packages/torch/utils/data/_utils/fetch.py", line 51, in
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/usr/local/lib/python3.10/dist-packages/torch/utils/data/dataset.py", line 243, in getitem
return self.datasets[dataset_idx][sample_idx]
File "/content/drive/MyDrive/sam-hq/train/utils/dataloader.py", line 244, in getitem
File "/usr/local/lib/python3.10/dist-packages/skimage/io/_io.py", line 53, in imread
img = call_plugin('imread', fname, plugin=plugin, **plugin_args)
File "/usr/local/lib/python3.10/dist-packages/skimage/io/manage_plugins.py", line 207, in call_plugin
return func(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/skimage/io/_plugins/imageio_plugin.py", line 15, in imread
return np.asarray(imageio_imread(*args, **kwargs))
File "/usr/local/lib/python3.10/dist-packages/imageio/v2.py", line 226, in imread
with imopen(uri, "ri", **imopen_args) as file:
File "/usr/local/lib/python3.10/dist-packages/imageio/core/imopen.py", line 113, in imopen
request = Request(uri, io_mode, format_hint=format_hint, extension=extension)
File "/usr/local/lib/python3.10/dist-packages/imageio/core/request.py", line 247, in init
self._parse_uri(uri)
File "/usr/local/lib/python3.10/dist-packages/imageio/core/request.py", line 407, in _parse_uri
raise FileNotFoundError("No such file: '%s'" % fn)
FileNotFoundError: No such file: '/content/drive/MyDrive/Iris-and-Needle-Segmentation-3/train/images/SID0615_jpg.rf.8dd4aeb70ce910df9c8716e3af21b2cd.jpg'
ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 2600) of binary: /usr/bin/python3
Traceback (most recent call last):
File "/usr/local/bin/torchrun", line 8, in
sys.exit(main())
File "/usr/local/lib/python3.10/dist-packages/torch/distributed/elastic/multiprocessing/errors/init.py", line 346, in wrapper
return f(*args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/torch/distributed/run.py", line 794, in main
run(args)
File "/usr/local/lib/python3.10/dist-packages/torch/distributed/run.py", line 785, in run
elastic_launch(
File "/usr/local/lib/python3.10/dist-packages/torch/distributed/launcher/api.py", line 134, in call
return launch_agent(self._config, self._entrypoint, list(args))
File "/usr/local/lib/python3.10/dist-packages/torch/distributed/launcher/api.py", line 250, in launch_agent
raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError:
train.py FAILED
Failures:
<NO_OTHER_FAILURES>
Root Cause (first observed failure):
[0]:
time      : 2023-08-01_11:51:44
host      : 6198cb800e23
rank      : 0 (local_rank: 0)
exitcode  : 1 (pid: 2600)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html

This looks like a data path issue. You can check if the image corresponding to the path is still there. Or is your google drive disconnected?