encrypted.asc attachment

When receiving encrypted mails I get no text but instead I get an attachment called encrypted.asc.

What version of k-9 are you using?

I'm using V.5.007, the latest release on the playstore.

The header looks as follows:
Return-Path:
Received: from <IP_ADDRESS> ([69.195.xxx.xx])        by smtp.gmail.com with ESMTPSA id xxxxxxxxxxxxxxxxxxxxxxxx        for<EMAIL_ADDRESS>      (version=TLSv1/SSLv3 cipher=OTHER);
Sat, 30 Jan 2016 11:53:18 -0800 (PST)
To: xxxxxxxxxxxxxx
From: xxxxxxxxxxx<EMAIL_ADDRESS>Subject: xxxxx
Message-ID<EMAIL_ADDRESS>Date: Sat, 30 Jan 2016 19:53:15 +0000
MIME-Version: 1.0
Content-Type: multipart/encrypted; protocol="application/pgp-encrypted"; boundary="smoHAeLlmbtxIHSmqN9Pq05PSNxvQuFWW"
Content-Transfer-Encoding: 8bit
Messages that I can decrypt without problems look like:
Date: Sat, 30 Jan 2016 23:31:35 +0100
From: xxxxxxxx<EMAIL_ADDRESS>To<EMAIL_ADDRESS>Subject:
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
Message-ID<EMAIL_ADDRESS>It may have to do with the 'content-type'

this is pgp/mime, which is not supported in current stable release. we're working on it.

@Valodim
I understand there's different formats for Pgp
Inline/PGP, S/MIME, PGP/MIME, which one would you recommend using?

this is not a choice that should be made by the user, and if we get this right you should not need to know these names to use pgp in the first place.
(on a related note, s/mime is not related at all to pgp)

Oh I see, inline/pgp puts the blop inside the message whereas pgp/mime keeps the pgp stuff seperate meaning clients that don't support pgp will just show an empty message rather than the blop. (Like signatures, they look ugly/weird to people unfamilliar with pgp)
Great, hope to see pgp/mime support in the feature.

Any news when this could be? I'm receiving more and more mails k9 can't decrypt and its quite a showbreaker. Especially for people new to encryption.

As of the latest alpha, PGP/Mime is support is present. Inline doesn't seem to work anymore though

V.5.010 and not fixed yet...

We know.


(add) Tabs' Icons

Closes #342
It should look like this:

Travis automatic deployment:
https://pr507--safereact.review.gnosisdev.com

Let's use the smaller  versions of the icons for the Top-tabs and the bigger versions for the settings side-tabs. (see guidellines

Travis automatic deployment:
https://pr507--safereact.review.gnosisdev.com

@lukasschor Icons should be updated now.

I like it a lot!
Few small things:

Let's change the style of the owner-number badge to this one as people I showed this to said with the green it might look like a notification badge

Let's rename "required confirmations" to "Policies" to make it shorter

Let's increase the padding on the left and between icon and tab title a bit

Travis automatic deployment:
https://pr507--safereact.review.gnosisdev.com

Travis automatic deployment:
https://pr507--safereact.review.gnosisdev.com

Travis automatic deployment:
https://pr507--safereact.review.gnosisdev.com

@lukasschor
Everything should be fixed now.

Tab height has increased for the owner tab. Otherwise looks good to go from my side.

As you might have to touch the owners tab anyways, I would propose to have the number of owners closer to the text to be better inline with how we display it here:

Travis automatic deployment:
https://pr507--safereact.review.gnosisdev.com


Security issue: populate filter shows user data into the API

Hi everybody,
I think I found a security issue using populate params into the API endpoint.
/api/navigation/render/:id?populate=*
If I have an attached page to the menu item and I use populate equals wildcard into the API endpoint, the response shows the page author user data.
"createdBy": { "id": 1, "firstname": "User Firstname", "lastname": "User Lastname", "username": null, "email": "User email", "password": "encrypted password", "resetPasswordToken": "encrypted token", "registrationToken": null, "isActive": true, "blocked": false, "preferedLanguage": null, "createdAt": "2022-09-12T14:00:09.156Z", "updatedAt": "2022-10-10T09:17:57.804Z" }, "updatedBy": { "id": 1, "firstname": "User Firstname", "lastname": "User Lastname", "username": null, "email": "User email", "password": "encrypted password", "resetPasswordToken": "encrypted token", "registrationToken": null, "isActive": true, "blocked": false, "preferedLanguage": null, "createdAt": "2022-09-12T14:00:09.156Z", "updatedAt": "2022-10-10T09:17:57.804Z" },

Checking

Fixed in v2.3.2


Support for xxh3

As the title says. It'd be nice to get support for xxh3_128_hexdigest in hash_file

I would accept a PR that adds this support, or any other state-of-the-art hashing methods so long as any extra dependency is optional, backwards compatibility is maintained, appropriate tests are added, etc.


old wiki docs?: mmseqs createfasta

The mmseqs2 wiki mentions mmseqs createfasta, but for MMseqs2 Version: 7.4e23d, I don't see any createfasta subcommand. Is the documentation out of date or is createfasta accessed via some other method besides an mmseqs subcommand?

Thank you for pointing this out. We removed createfasta and replaced it with createtsv.
I have rewritten part of the documentation, explaining the database formats and how to convert them more in detail.


Please provide config used for clang-format

Clang-format in all source code. (from changelog)

possible to provide the configuration used for clang-format? the default is resulting huge diff

Thanks for making the source available, I'm new to C & GUI as well, however a big thumbs-up for the documentation I was just changing some code to see what happens and w/o clang-format config I'm seeing huge diff.
Also, may I know what is the priority of removing hardcoded x11 to support wayland as well?
Removing the hardcoded env and adding 50 and 89 px (as you mentioned in another issue) for wayland (querying xdg_session_type) breaks X sizing and theme detection (maybe there are other fixes needed as well?).
Thanks again!

Hi @leelavg! Thanks for download and use NAppGUI.
.clang-format file has been added in this commit: https://github.com/frang75/nappgui_src/commit/40356b8b17a7cb1f39c2bdfa3c7d4e8ce6ef35d8
Wayland support is related in this issue: https://github.com/frang75/nappgui_src/issues/23
Unfortunately, this issue is not included in the roadmap for the current 1.5.0 release. I will try to add it for 1.5.1 (Feb-Mar 2025).


how does balena decide which haproxy docker file to use for each architecture ?

how does balena decide which haproxy docker file to use for each architecture ?

ok cracked it auto knows when you balena PUSH to your balena APP what the ARCH of the DEVICES in the APP are


local runtime error

Please add the missing file to the repository.

This is because PageNotFound component is inside the components folder.
Please follow the steps mentioned in the README.md file to install the theme.

The "PageNotFound" component is located in the "components" folder, which typically comes with the installation of a theme.
If you haven't installed a theme in your application, please refer to the README.md file for instructions on theme installation before running the application.

Thank you for updating readme @karan1633


The exist? method does not work for youtube videos

Hi!
The exist? method does not work properly for youtube videos. It always returns false, no matter if the link is valid. This is because gdata.youtube.com/feeds/api/videos/ is no longer available. I think you need to use YouTube Data API V3 for checking YT videos.

@b4k3r Thanks for pointing this out!


Used .set() with { merge: true } to avoid overwriting the entire docu…

…ment

Fixes Issue

Changes proposed

Screenshots

Note to reviewers

Description
This pull request modifies the GET function to avoid overwriting the entire document for each file in Firestore.
Fixes Issue

Overwriting of data in Firestore documents.

Changes proposed

Use .set() with { merge: true } to avoid overwriting the entire document in Firestore.

Note to reviewers
Please test the updated GET function thoroughly to ensure it works as expected and doesn't overwrite the entire document in Firestore

@Anmol-Baranwal can you review this..

@rupali-codes I'm not entirely sure about the Firestore document structure, but this PR works for cases where we update resources without affecting any other fields that might already exist in the document.
If this is only for the importing the documents the first time, then we can do the overwriting.

Also @Anmol-Baranwal, Sarthak did not raise an issue for this, so in an effort to encourage open source etiquette, I highly think this PR should be closed, have them reread the contributing guide, and review their issue to see if it suits the project.

@Anmol-Baranwal & @CBID2 we have temporarily put this feature on Hold. So, for now I'm closing this PR, we will look into it once we reactivate this feature.


NFT children get call

Story: "Add NFT-to-Group endpoint to bch-js"
The scope of this task is to add an endpoint to the bch-js nft1.js library that calls the new bch-api endpoint.
The PR for this task should also include unit and integration tests for the new endpoint.

:tada: This PR is included in version 4.18.2 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


ionic serve - rollup: No name was provided for external module

Short description of the problem:
ionic serve started to throw error:
[08:24:37]  rollup: Treating 'child_process' as external dependency
[08:24:40]  rollup: No name was provided for external module 'fs' in options.globals – guessing 'fs'
[08:24:40]  rollup: No name was provided for external module 'child_process' in options.globals – guessing
            'child_process'

mail.js is bundled, but in browser it throws error:
Uncaught ReferenceError: fs is not defined  main.dev.ts:5
app-scripts 0.0.30 were fine.
What behavior are you expecting?
to successfully compile project
Steps to reproduce:

ionic serve

Our packages in package.json:
 "dependencies": {
    "@angular/common": "^2.0.0",
    "@angular/compiler": "^2.0.0",
    "@angular/compiler-cli": "^0.6.2",
    "@angular/core": "^2.0.0",
    "@angular/forms": "^2.0.0",
    "@angular/http": "^2.0.0",
    "@angular/platform-browser": "^2.0.0",
    "@angular/platform-browser-dynamic": "^2.0.0",
    "@angular/platform-server": "^2.0.0",
    "@ionic/storage": "1.0.3",

    "angular2-redux-store": "1.2.0",
    "highcharts": "5.0.0",
    "immutable": "3.8.1",
    "intl": "1.2.4",
    "ionic-angular": "2.0.0-rc.1",
    "ionic-native": "2.0.3",
    "ionicons": "3.0.0",
    "moment": "2.15.1",
    "redux": "3.6.0",
    "redux-thunk": "2.1.0",
    "rxjs": "5.0.0-beta.12",
    "symbol-observable": "1.0.4",
    "zone.js": "0.6.21"
  },
  "devDependencies": {
    "@ionic/app-scripts": "0.0.33",
    "@types/chai": "3.4.34",
    "@types/highcharts": "4.2.37",
    "@types/immutable": "3.8.4",
    "@types/lodash": "4.14.36",
    "@types/mocha": "2.2.32",
    "@types/redux": "3.5.30",
    "@types/redux-thunk": "2.1.31",
    "buffer": "5.0.0",
    "chai": "3.5.0",
    "mocha": "3.0.1",
    "reflect-metadata": "0.1.8",
    "rollup-plugin-commonjs": "5.0.5",
    "rollup-plugin-multi-entry": "2.0.1",
    "rollup-plugin-node-resolve": "2.0.0",
    "rollup-plugin-typescript": "0.8.1",
    "source-map-support": "0.4.3",
    "typescript": "2.0.3",
    "watch": "1.0.1"
  },

Which @ionic/app-scripts version are you using?
0.0.33
This is happening if I import mocha in app.component.ts as workaround for issue described in https://github.com/driftyco/ionic-app-scripts/issues/157
so I don't know if it is real issue then.

@kesozjura,
I'm not sure if these libraries are suited for the web.  child_process implies that there would in fact be a separate process running as is the case from node, but that doesn't make sense on the web.
Having said that, we have implemented Webpack to bundle code and are in the testing phase with it. If you can sit tight for a few days, we can see if that will handle it better. Hopefully it does.
Thanks,
Dan

@kesozjura The webpack integration is now in our latest beta release of app-scripts! To give it a try just run npm install @ionic/app-scripts@beta in your project. Thanks!

HI team,
I am having same issue - Uncaught Error: Cannot find module "fs" .
Initially I encountered 'no name found for fs..' and 'Uncaught ReferenceError: fs is not defined' in the browser than I updated just now with latest app scripts and end up with cannot find module fs error.
do let me know what I am missing with.
I have now version updated to:
"@ionic/app-scripts": "^0.0.36",
"typescript": "^2.0.3"

@Divs-B Is there a reason you are trying to use fs, which is a built in node.js method, in the browser? fs is not made to work in the browser as the browser does not have direct access to the underlying file system on your machine like node.js does.

Thanks jgw96 for clearing this. I won't use 'fs' for browser now.
though I had this in mind but couldn't find relative information anywhere thats why was always trying on ionic serve.
Can i read csv file from my ionic app on browser by any ways?
I saw 'node-csv' package but that also has 'fs' to read files.
Any help will be highly appreciated.

@jgw96 now ionic serve have some other problems:
> ionic-app-scripts watch
[07:32:30]  ionic-app-scripts 0.0.37
[07:32:30]  watch started ...
[07:32:30]  build dev started ...
[07:32:30]  clean started ...
[07:32:30]  clean finished in 6 ms
[07:32:30]  copy started ...
[07:32:30]  transpile started ...
[07:32:35]  transpile finished in 5.31 s
[07:32:35]  webpack started ...
(node:14848) UnhandledPromiseRejectionWarning: Unhandled promise rejection (rejection id: 1): Error: [object Object]

[07:32:36]  copy finished in 6.07 s
[07:32:42]  webpack finished in 6.96 s
[07:32:42]  sass started ...
[07:32:42]  build dev failed: [object Object]

(node:14848) PromiseRejectionHandledWarning: Promise rejection was handled asynchronously (rejection id: 1)

[07:32:44]  sass finished in 1.26 s

Original error was because i was importing mocha in main.dev.ts. This was wrong. After removing that import and adding
"types": [
   "mocha"
 ]

to tsconfig.json I have no problem with serve and build. But with beta I have error mentioned above.

Sorry for trouble, I installed new ionic cli (http://blog.ionic.io/ionic-2-rc-weekend-updates/) and reinstall all node modules and now it is ok.

@kesozjura,
We'll try to publish an update today. Stay tuned.
Thanks,
Dan

I think I'm having the same problem after I installed SockJS https://www.npmjs.com/package/sockjs.
When I tried to import it in a provider and use it, I have the following error when run ionic serve

I was using app-scripts v0.0.23, but even with v0.0.36 this happens
any help?

@rodriguesgm,
Try running Webpack. That will have better luck with built in dependencies. Check out
npm install @ionic/app-scripts@nightly

If you have a custom rollup config file, temporarily change the name of it to something else while you test this out. If a rollup config is detected, the nightly will still use Rollup instead of Webpack.
Thanks,
Dan

Using this nightly "ionic serve" stuck on following:
$ ionic serve
Running 'serve:before' npm script before serve
> myApp watch D:\myApp\src
> ionic-app-scripts watch
[10:41:33]  ionic-app-scripts 0.0.37-1
[10:41:33]  watch started ...
[10:41:33]  build dev started ...
[10:41:33]  clean started ...
[10:41:33]  clean finished in 5 ms
[10:41:33]  copy started ...
[10:41:33]  transpile started ...
[10:41:33]  lint started ...
[10:41:33]  lint finished in 6 ms
[10:41:38]  transpile finished in 4.93 s
[10:41:38]  webpack started ...
[10:41:38]  copy finished in 5.17 s
[10:41:45]  webpack finished in 7.79 s
[10:41:45]  sass started ...
[10:41:47]  sass finished in 1.86 s
[10:41:47]  build dev finished in 14.60 s

server is not started...

Hello @kesozjura. Can you make sure that you have all the files here including the manifest.json and the service worker? There is a bug with app-scripts at the moment that we are working on that makes the build halt when the copy task does not find a file.

I have the same problem
[09:06:09]  ionic-app-scripts 0.0.36
[09:06:09]  watch started ...
[09:06:09]  build dev started ...
[09:06:09]  clean started ...
[09:06:09]  clean finished in 16 ms
[09:06:09]  copy started ...
[09:06:09]  transpile started ...
[09:06:11]  lint started ...
[09:06:19]  lint finished in 7.39 s
[09:06:22]  transpile finished in 12.71 s
[09:06:22]  bundle started ...
[09:06:22]  copy finished in 12.96 s
[09:06:40]  rollup: Treating 'fs' as external dependency
[09:06:42]  rollup: Treating 'net' as external dependency
[09:06:42]  rollup: Treating 'dns' as external dependency
[09:06:53]  rollup: No name was provided for external module 'fs' in options.globals – guessing 'fs'
[09:06:53]  rollup: No name was provided for external module 'net' in options.globals – guessing 'net'
[09:06:53]  rollup: No name was provided for external module 'dns' in options.globals – guessing 'dns'
[09:07:02]  bundle finished in 39.46 s
[09:07:02]  sass started ...
[09:07:08]  sass finished in 6.26 s
[09:07:08]  build dev finished in 58.51 s
[09:07:08]  watch ready in 58.93 s
node v6.8.1
npm v3.10.8
ionic 2.1.4
"@ionic/app-scripts": "^0.0.36",
"typescript": "^2.0.3"

@danbucholtz With your solution + @jgw96 answer the error is not logging on prompt when running ionic serve.
But on console browser, the problem still happens

Hello all! I am going to be closing this issue for now. The issue here is that the libraries that you all are trying to use all use built in node modules such as fs that are not built to work in the browser. Most likely these libraries are meant to be used server side with Node.js.

Hi @jgw96.
Not sure if you are right. I'm trying to use SockJs as this example here:
http://www.concretepage.com/spring-4/spring-4-websocket-sockjs-stomp-tomcat-example
So, that's why if think it should work.

@rodriguesgm,
I added a mock for the fs to the default webpack config.
Thanks,
Dan

@danbucholtz after upgrade to @ionic/app-scripts v0.0.38 my error disappears. Thank you !

Likewise - I started using Loki https://github.com/techfort/LokiJS yesterday with Ionic 2, immediately ran into fs is not defined. The nightly install works perfectly, such good timing as well. You guys are the best!

@danbucholtz hey man
I tried it here with ionic RC2 and app-spricts v0.0.39, but it still the same problem. Even with nightly.
Is there any other solution?

@rodriguesgm when you run ionic serve, can you see in the logs that it is using Webpack instead of Rollup? If not, you might need to look for the Rollup config files as mentioned above by @danbucholtz

@nabilfreeman yeah, i can see that its logging webpack on console. I can post here a print later today. And the behaviour are different when using weback and when using rollup,
With rollup I can see the error on console like here https://cloud.githubusercontent.com/assets/10141664/19709862/b52a6bec-9b08-11e6-92a4-cc11745e1a91.jpg and in the browser.
but with webpack, nothing is printed on console but on browser debug the errors remains https://cloud.githubusercontent.com/assets/10141664/19745566/eac08180-9bb0-11e6-8804-90a0b7815468.jpg

@nabilfreeman, @rodriguesgm,
Hmm. That should not be the case. We're providing an empty mock just like create-react-app. Maybe you won't be able to use that library on the web, I'm not sure. If you can create a sample repo with a reproduction, I can take a look.
Thanks,
Dan

hi @danbucholtz
i've just came back to retest it. It seems that that problem was solved. I'm using the webpack and ionic-app-scripts v0.0.44. But I'm getting a new weird problem. Any clue to help me?

@rodriguesgm,
Seems like it's trying to load a json file into the bundle. I'm not sure exactly what the issue is. Lots of libraries have lots of problems with even the best bundlers.
Thanks,
Dan


ZeroPage Homebrew Twitch Feedback

PhaserCatGames: This looks like Stampede and Joust had a baby.
rc7e: THey look like cats on horseback
rc7e: or llamaback

diagonal movement
player should leap backwards after charge attack
enemies should be going other direction being chased / chasing of enemies
enemies have no weapons - look like you are hitting them on the nose
game should speed up / different speeds
more horizontal range ? hit power based on horizontal position
more points / based on hit accuracy / Joust-style hits
make couch compliant (all control from joystick, no reset switch)

done...

diagonal movement
player should leap backwards after charge attack
more horizontal range ? hit power based on horizontal position
make couch compliant (all control from joystick, no reset switch)

to do...

game should speed up / different speeds
enemies should be going other direction being chased / chasing of enemies
enemies have no weapons - look like you are hitting them on the nose
more points / based on hit accuracy / Joust-style hits


Issue connecting to Azure Database

Hi there,
I found this library today and i'm trying to use it in my Linux webserver... But i can't manage to connect to my server.
i'm using this code:
 "user@server", "pwd" => "myPassword", "Database" => "MyDB", "LoginTimeout" => 30, "Encrypt" => 1, "TrustServerCertificate" => 0);
 $serverName = "tcp:myserver.database.windows.net,1433";
 $conn = sqlsrv_connect($serverName, $connectionInfo);

	if( $conn ) {
     echo "Connection established.";
}else{
     echo "Connection could not be established.";
     die( print_r( sqlsrv_errors(), true));
}
?>
Can you give me a connection example?
Thank you very much

That should work, in theory.
Is sqlsrv_errors() actually returning anything?
My only guess at this point might be our lack of support for the Encrypt and TrustServerCertificate options.
LoginTimeout is also being ignored, but I'm sure that's not causing the issue. Still would be good to support, though.

I'll have to do some googling and figure out what the dblib equivalent connection string options are for those.

@radsectors Not, sqlsrv_errors() is not returning a thing. I paste the return:
Connection could not be established.Array
(
)
An empty array is what i get in return. Also, i have removed the Encrypt and TrustServerCertificate parameters and i'm getting the same fail.
Do you have any working examples? It might be helpful.
Thank you very much for your quick anwser, btw :)

Here's what I'm using and is allowing me to connect!
$connectionInfo = array("UID" => "dbuser", "PWD" => "dbpassword", "Database" => "targetdb");
$connection = sqlsrv_connect("dbhostname", $connectionInfo);

When you write "Make sure you've initiated sqlshim first" you mean this snippet, right?
require_once('../sqlshim/src/sqlshim.php'); 		\RadSectors\SqlShim::init();
I mean... With your connection string i still can't connect to my database. I think i will deploy a DesktopApp with Visual Studio to provide local access to the database.
Thank you for your help & work anyway, i will stay tuned for further updates :)

Sorry, things got busy at home last night.
Meant to ask: did you install freetds and sybase?
https://github.com/radsectors/sqlshim/wiki/3rd‑party-Lib-Setup

Hi there,
no, i didn't install these packages, because i have a 1&1 server and i don't have apt-get. Is it a MUST install?

Yeah, it is definitely required.
Also, what flavor of linux is it?
So, but you do have shell access, right? Just no package manager?

Hi there, last days were just crazy, i will check if i can access a package manager and give it a last chance.
Thx for your support!

Hi @Livamyrd did you ever get this worked out? Or did you end up going with another solution?

Hi @radsectors,
finally, i linked my Javascript with cURL in PHP to send data to a custom endpoint that i made in my Azure machine. I know is not the best way to handle it, but it works.

lol I've considered solutions like that before! Thanks for trying out sqlshim!


feat(wrangler): Add config validation for Pages

What this PR solves / how to test
Wrangler proper has a mechanism in place through which it validates a wrangler.toml file for Workers projects. As part of adding wrangler.toml support for Pages, we need to put a similar mechanism in place, to validate a configuration file against Pages specific requirements.
This PR implements the Pages specific validation logic
Author has addressed the following

Tests

[ ] TODO (before merge)
[x] Included
[ ] Not necessary because:

Changeset (Changeset guidelines)

[ ] TODO (before merge)
[x] Included
[ ] Not necessary because:

Public documentation

[ ] TODO (before merge)
[ ] Cloudflare docs PR(s): https://github.com/cloudflare/cloudflare-docs/pull/...
[x] Not necessary because: not needed at this stage of the work

@penalosa @petebacondarwin all your comments are ✅ ed. Pls let me know if there is anything else you'd like me address <3. Thank you so much for your thorough reviews!


Starting compute resource always creates new revision for job definitions

Every time we restart a compute resource controller, we're creating a new revision version for each job definition in AWS Batch
Maybe we should avoid doing this, and instead use always the latest version.

I think we should check whether the existing definition is consistent with the new one, and if so, do nothing. It's possible that the docker image or something else might change.


Create using Dynamic branching two TS models ARIMA and PROPHET

First I will combine the following four files for three new  TS economic indicators below in a new pipeline to run separate TS models on each of them.
A34SVS_Shipments_value_Computer_products.csv
AMDMVS_Shipments_value_Durable_goods.csv
AMTMVS_Shipments_Total_Manufacturing.csv
ANXAVS_Shipments_value_Nondefense_Capital_Goods.csv
This time I will be using Dynamic branching from {targets} alongside  {timetk} and {modeltime}  packages to automate the creation of different models on different branches of the pipeline

AIM: Using Dynamic branching, implement an ARIMA model to iterate over the set of indicators defined in the branching Target  by metric “indicator”. At the moment only using two indicators, so this workflow will have 2 branches before I implement ARIMA model.
For this first issue about Dynamic branching I will be creating an ARIMA model based on the  2 indicators present in the grouped target.

closing issue has this has been completed and all changes from this branch included in the main branch after doing a pull request from "dynamic_branching_ARIMA" branch used to develop this feature following trunk development principles.

Adding ARIMA and Prophet models to existing pipeline using Modeltime package. It is part of a growing ecosystem of Modeltime forecasting packages. https://business-science.github.io/modeltime/


Record driver pod name during submission

and try getting the driver pod from the API server when it's not found in the informer cache.
@akhurana001 this should solve the issue addressed in https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/pull/495.

and try getting the driver pod from the API server when it's not found in the informer cache.
@akhurana001 this should solve the issue addressed in #495.

Thanks for this. I was reworking #495 based on our discussion but we can work on this here and I will close out #495 .

One minor comment. Should be good to go after that 👍


plan to scala support

yes, I want to contribute but I can't.
So hopefully someone help.

Nobody ever asked and I do not work with scala, but I think it's cool to have support. Could you contribute by testing?

Fixed with e1e55875d5e12f14270ade4afa9b79779f0981e8


How to control TCP0 and TCP1 alt modes from MCU

I would like to use the TCP0 and TCP1 as Type-C with alt-mode. Diagram of what I am trying to do:

From what I can tell, these will require a PD controller. The full carrier board schematic uses a IT8851:

However I am unable to acquire an IT8851. I will use an MCU and control power delivery from that.
From what I can tell in the N100 datasheet, 26.1.1 states the following:

SMLink1 is used to communicate with USB-C* PD Controller on the platform to
configure different modes such as USB, Display Port, Thunderbolt*, etc. When used
for Integrated USB-C purposes, a soft strap must be set to indicate that integrated
USB-C ports from CPU are being used.

26.2

This matches with what I see in the schematic for pins 3, 4 and 5. The datasheet also mentions a second I2C port (I2C2 on the module), something with retimers.
Although beyond what the datasheet states, there is nothing describing what messages get sent to and from the PD controller.
Regarding the I2C/Smbus interface, is this defined by the SoC or defined by the BIOS? Is LattePanda able to describe the interface to configure the USB-C port mode and muxing in TCP0 and TCP1 over smbus (what messages, layout of each message)? How many I2C interfaces do I need to use for this (1 or 2)?
I tried to see if coreboot had anything to reference on this. I could not find anything.

The previously linked datasheet is for a 600-series PCH. The Intel N100 Datasheet lists the pinstrap as follows

The previously linked datasheet is for a 600-series PCH. The Intel N100 Datasheet lists the pinstrap as follows

Yes I forgot to update the original image for the pin strap. Shouldn't change the question still.

I've discussed this a bit on the Discord, but posting here for reference. CrOS EC does have code to talk to the PD mux on the N100:
https://github.com/coreboot/chrome-ec/blob/main/zephyr/include/drivers/intel_altmode.h
https://github.com/coreboot/chrome-ec/blob/main/zephyr/drivers/usbc/intel_altmode.c
https://github.com/coreboot/chrome-ec/blob/main/zephyr/subsys/pd_controller/pd_task_intel_altmode.c
These describe the registers which you use to talk to the PD Mux over Type-C.
I also took a logic analyzer to the full carrier board. I tested with a USB-C to Displayport cable and a USB-C to HDMI + USB hub. Attached are pulseview captures (don't forget the second file for the labels).
LPMu_SMLink1_USBC_Aug04_2024.zip
The capture does show the INTEL_ALTMODE_REG_DATA_CONTROL   and INTEL_ALTMODE_REG_DATA_STATUS addresses are used.
This capture only was performed on the TCP1 port since that is what the full carrier has connected for USB-C. I suspect the address written to the registers, 0x38 for TCP1, states which port to control?


Available drivers

As an inventory manager, I can view which drivers are available, so that I am able to to assign new tasks on hand to those who are free.

Similar to https://github.com/AY1920S1-CS2103-F14-4/main/issues/9


fix(cluster): improve error message for missing auth

Check if cluster connect returns unauthorized error and display proper error message.
Closes #1122
Verification Steps

Do x
Do y

Type of change

[X] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Documentation change
[ ] Other (please specify)

Checklist

[ ] Documentation added for the feature
[ ] CI and all relevant tests are passing
[ ] Code Review completed
[ ] Verified independently by reviewer

Suggestion. Incorporate this PR into the cluster/bind PRs we have right now


Deal with nil when merging

This does at least make rake generate:fixtures work, but then the result is still not really what you'd expect.

Yeah, this screws up all the fixtures... but wait, I think I found the actual source of the problem. I was running git bisect to figure out where generate:fixtures started failing, and at first I thought git was broken since it pointed to the following commit: https://github.com/voxpupuli/beaker-hostgenerator/commit/be0e869b39fee8866c54629b3d618ffe525f7240
Long story short, this require is the culprit: https://github.com/voxpupuli/beaker-hostgenerator/commit/be0e869b39fee8866c54629b3d618ffe525f7240#diff-ee98e028c59b193d58fde56ab4daf54d43c486ae674e63d50ddf300b07943e0fR60
The github_changelog_generator gem depends on and loads ActiveSupport, which overrides the native Hash#deep_merge method from Ruby... which leads to this:
$ bundle exec rake generate:fixtures --trace
** Invoke generate:fixtures (first_time)
** Execute generate:fixtures
rake aborted!
TypeError: no implicit conversion of nil into Hash
/home/gabi/.rvm/gems/ruby-2.6.3/gems/activesupport-<IP_ADDRESS>/lib/active_support/core_ext/hash/deep_merge.rb:24:in `merge!'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/activesupport-<IP_ADDRESS>/lib/active_support/core_ext/hash/deep_merge.rb:24:in `deep_merge!'
/home/gabi/repo/beaker-hostgenerator/lib/beaker-hostgenerator/data.rb:1973:in `get_platform_info'
/home/gabi/repo/beaker-hostgenerator/lib/beaker-hostgenerator/hypervisor.rb:97:in `block in base_generate_node'
/home/gabi/repo/beaker-hostgenerator/lib/beaker-hostgenerator/hypervisor.rb:96:in `map'
/home/gabi/repo/beaker-hostgenerator/lib/beaker-hostgenerator/hypervisor.rb:96:in `base_generate_node'
/home/gabi/repo/beaker-hostgenerator/lib/beaker-hostgenerator/hypervisor/vmpooler.rb:18:in `generate_node'
/home/gabi/repo/beaker-hostgenerator/lib/beaker-hostgenerator/generator.rb:53:in `block in generate'
/home/gabi/repo/beaker-hostgenerator/lib/beaker-hostgenerator/generator.rb:30:in `each'
/home/gabi/repo/beaker-hostgenerator/lib/beaker-hostgenerator/generator.rb:30:in `generate'
/home/gabi/repo/beaker-hostgenerator/lib/beaker-hostgenerator/cli.rb:170:in `execute'
/home/gabi/repo/beaker-hostgenerator/test/util/generator_helpers.rb:11:in `run_cli_with_options'
/home/gabi/repo/beaker-hostgenerator/test/util/generator_helpers.rb:34:in `generate_fixture'
/home/gabi/repo/beaker-hostgenerator/test/util/generator_helpers.rb:59:in `block in generate_fixtures_using_osinfo'
/home/gabi/repo/beaker-hostgenerator/test/util/generator_helpers.rb:56:in `each'
/home/gabi/repo/beaker-hostgenerator/test/util/generator_helpers.rb:56:in `generate_fixtures_using_osinfo'
/home/gabi/repo/beaker-hostgenerator/test/util/generator_helpers.rb:76:in `generate'
/home/gabi/repo/beaker-hostgenerator/Rakefile:46:in `block (2 levels) in <top (required)>'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/lib/rake/task.rb:281:in `block in execute'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/lib/rake/task.rb:281:in `each'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/lib/rake/task.rb:281:in `execute'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/lib/rake/task.rb:219:in `block in invoke_with_call_chain'
/home/gabi/.rvm/rubies/ruby-2.6.3/lib/ruby/2.6.0/monitor.rb:230:in `mon_synchronize'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/lib/rake/task.rb:199:in `invoke_with_call_chain'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/lib/rake/task.rb:188:in `invoke'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/lib/rake/application.rb:160:in `invoke_task'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/lib/rake/application.rb:116:in `block (2 levels) in top_level'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/lib/rake/application.rb:116:in `each'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/lib/rake/application.rb:116:in `block in top_level'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/lib/rake/application.rb:125:in `run_with_threads'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/lib/rake/application.rb:110:in `top_level'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/lib/rake/application.rb:83:in `block in run'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/lib/rake/application.rb:186:in `standard_exception_handling'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/lib/rake/application.rb:80:in `run'
/home/gabi/.rvm/gems/ruby-2.6.3/gems/rake-13.0.3/exe/rake:27:in `<top (required)>'
/home/gabi/.rvm/gems/ruby-2.6.3/bin/rake:23:in `load'
/home/gabi/.rvm/gems/ruby-2.6.3/bin/rake:23:in `<main>'
/home/gabi/.rvm/gems/ruby-2.6.3/bin/ruby_executable_hooks:24:in `eval'
/home/gabi/.rvm/gems/ruby-2.6.3/bin/ruby_executable_hooks:24:in `<main>'
Tasks: TOP => generate:fixtures

So in the meantime, reverting this commit and installing dependencies with bundle install --without release avoids this issue.


Feature: Stream hook logs back to helm client

When performing helm release operations such as install, upgrade, delete and rollback, the helm client will block without feedback while hooks execute. If chart owners aren't careful with their error handling, kubernetes can put the hook job into an infinite loop of failure. Conversely, long running hooks such as database migrations can be executing successfully while the user is unaware that code is executing.
To mitigate these issues helm should stream hook logs back to the helm client.
UI
Successful install:
› helm install internal/jenkins
Executing pre-install hooks: ldap-update-job, credential-update-job
[credential-update-job] Updating Jenkins credentials
[ldap-update-job] Updating LDAP configuration
[credential-update-job] Validating credentials
[credential-update-job] Successfully updated credentials!
[ldap-update-job] Successfully updated LDAP!

Executing post-install hooks: migrate-db
[migrate-db] Starting database migration
[migrate-db] Database migration completed

Install was a success! Happy Helming!

Install with issues:
› helm install internal/jenkins
[credential-update-job] Updating Jenkins credentials
[ldap-update-job] Updating LDAP configuration
[credential-update-job] Validating credentials
[credential-update-job] Successfully updated credentials!
[ldap-update-job] ERROR: Invalid password/token for user: john.welsh
[ldap-update-job] Updating LDAP failed
[credential-update-job] Updating Jenkins credentials
[ldap-update-job] ERROR: Invalid password/token for user: john.welsh
[ldap-update-job] Updating LDAP failed
...

Open questions

Timestamps?
Should pod name be surfaced somewhere?

Note that the pod name can change if the hook fails or gets evicted before it completes
Pod names are super long (john-ci-jenkins-update-credentials-xzz5f-1z166)

Future enhancements

Retry counter for jobs?

Implementation
In the tiller proto definition:
// GetReleaseLogs gets a stream of log events for a given release.
    rpc GetReleaseLogs(GetReleaseLogsRequest) returns (stream GetReleaseLogsResponse) {
}

message GetReleaseLogsRequest {
    // Name is the name of the release
    string name = 1;
    // Version is the version of the release
    int32 version = 2;
}

message GetReleaseLogsResponse {
    // Source is the name of the hook that generated the log
    string source = 1;
    // Log is a single log line
    string log = 2;
}

The helm client will then make two gRPC calls - one to install, the other to grab logs.
Questions

Is this too chatty? Should logs be collected and passed in chunks?
Should the API be made specific to hooks (GetReleaseHookLogsRequest) or left more generic for future expansion?
What other fields should be in the response object?

So I don't think pod names should be passed back exactly for the reason you specified. I don't think this is too chatty because I think most people prefer seeing the live output as they watch a release. Also, I can't think of another field you would need in the response (unless you use timestamps), but if I think of something, I'll drop it in here. I think the timestamps may be a good thing to add because it can be helpful for debugging, especially if you are not watching the release as it happens. They would allow for you to go back and see if certain events correlate.
As for the generic question, I think it would be the best to keep it as generic as possible. I could see the use case where someone using the --wait flag would want to watch the logs of the pods they are spinning up.
Thanks for taking this on, I am excited to see this!

I could see the use case where someone using the --wait flag would want to watch the logs of the pods they are spinning up.
Yes, yes, yes. That would be so useful for us. Is that in scope here? We have a setup which occasionally times-out a helm release, and seeing the logs from the pods created by the deployment would be fantastic.

@georgecrawford I don't think that is in scope for this issue specifically, but that will be easy to add with the design proposed

Bumping this to 2.5, since the 2.4 release is slated for today.

Any update on this? I'm reviewing issues for the stability/security requirement on 2.6, and not sure if this one is likely to be ready for review in time.

It would be great if this could make it in.

Unfortunately, work seems to have stalled out on this. We'll give it a week or so, but then I'll have to bump this to 2.7

Hey there, this issue has kind of been my bane. I'm going to take another crack at it this weekend to try to make 2.6.
Basically the streaming of logs is working great, clients can subscribe to logs and they get sent through via tiller. The problem is what I thought would be the easy part - accessing the pod logs from tiller so they can be streamed back.

Any update on where we are with this? It's probably safer at this point to bump to 2.7

ping, any update? Just checking whether we can expect the feature in time to review for 2.8 or if we should hold off on targeting specific milestones. Thanks! :)

pulling off the milestone due to inactivity.

we really need this feature - are there any updates? :)

we also need this feature. are there any updates?

No but feel free to pick this back up! It looks like the original author is unresponsive.

/remove-lifecycle stale

This feature will be super helpful for debugging my hook failures. Right now I have to manually dig into the pod to read the log, which is painful since I'm usually reading logs at much higher level in GitLab CI. With this feature I can then bubble up any errors from my hook to tiller and then finally up to my CI.

I haven't seen any movement from the community on this proposal. Closing as inactive.

Any update?
https://github.com/helm/helm/issues/3481


adding in redirects reported today in the docs room

Hello @ksigler7,Thanks again for the PR! We appreciate your contribution and look forward to                                              continued collaboration. Thanks!                                             Team SendGrid DX


List with map

Implement a list with map to support constant time of insert, remove and get random element from the data structure.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

moved to https://github.com/awslabs/aws-c-http/pull/361


conformance/utils/suite: Move timeout setup before building roundtripper

/kind bug
What this PR does / why we need it:
Previously timeout config was passed to roundtripper before defaults
were set. When suite was run with default timeouts, HTTP requests were
set up with a context deadline of 0, meaning they failed immediately.
Which issue(s) this PR fixes:
N/A
Does this PR introduce a user-facing change?:
NONE

Thanks @sunjayBhatia!
/lgtm
/approve

/ok-to-test


Blazor file download updates

Fixes #24521
Thanks @ylr-research! :rocket:

Recommend that we show the procedure for opening a new tab.
To cover security aspects for older browsers, I include a bit on the Referrer Policy, but I need verification on the sanity of the remarks and example.
There are a few other NITs on the PR, and I'll be back for a broader UE pass on this topic later.

❓
For the following remark ...

At this point, the file download is triggered, and it's generally safe to revoke the temporary object URL by calling [`revokeObjectURL`](https://developer.mozilla.org/docs/Web/API/URL/revokeObjectURL) on the URL.

I'm not keen on the "generally" part without further explanation. What does "generally" mean in this context? I think we should say when/how it might be unsafe ... or strike the "generally" language in favor of just saying that the URL should be revoked with the API as indicated. 👂
cc: @Rick-Anderson @serpent5 FYI: There's an unrelated absolute cross-link to EF Core docs in the RP tutorial that popped up on the build report. I've added a fix for it on this PR, so you can ignore it if it pops up on other PRs today ...

The preceding commands install [the Entity Framework Core tools](https://docs.microsoft.com/ef/core/get-started/overview/install#get-the-entity-framework-core-tools) and run the `migrations` command to generate code that creates the initial database schema.

... to ...

The preceding commands install [the Entity Framework Core tools](/ef/core/get-started/overview/install#get-the-entity-framework-core-tools) and run the `migrations` command to generate code that creates the initial database schema.

I will vote for "the URL should be revoked with the API as indicated". This is perfect.

Like most of the PU engineers, Tanay doesn't usually do Random™ 🤣 ... I won't be surprised if he had something specific in mind.

I have some sample code in this repo which received some feedback from @SteveSandersonMS. Mainly after running into some issues with memory out of bounds on large files. See 36872 and 60287

Thanks @ylr-research ... I yield to @TanayParikh on those. He's a real programmer, not a HackDino™ 🦖 like me! 😄 I haven't even had time to walk through this guidance in detail and experience the code first-hand. I've been 🏃🏃🏃🏃🏃😅 on a number of issues. I'll be returning this article later for additional updates, including ...

Enhanced article and API cross-linking.
Fully-working, cut-'n-paste example code for devs to experiment with.
Moving sample code into the Blazor snippet sample apps so that we catch regressions when new versions of the framework release with updated API.
... and any stray COMMA or MISSPELLING 😈 that has weaseled its way into the doc!

What I have done is cross-link your comment to my UE ("User Experience") tracking issue so that I don't forget to check them out later when I circle back to this article.


Fix assignIssue to allow null to unassign a user in api/issue

fixes #4

Sorry it took so long to get to this; looks good to me

Published as 1.1.0
Thanks!


Artifacts aren't unstashed for TerraformValidateStage stages

I've run into an issue when building and deploying a Lambda, and the scenario is as follows:
I have a build stage that generates the .zip file for my Lambda.  The next stage is a TerraformValidateStage which will try to run filebase64sha256() on the .zip file.  Since the artifact from the build isn't unstashed, I get an error similar to the following for my pipeline:
Error: Error in function call

  on terraform/main.tf line 66, in resource "aws_lambda_function" "my_lambda":
  66:   source_code_hash               = filebase64sha256("./my_lambda.zip")

Call to function "filebase64sha256" failed: no file exists at
my_lambda.zip; this function works only with files that are distributed as
part of the configuration source code, so if this file will be created by a
resource in this configuration you must instead obtain this result from an
attribute of that resource.

If I remove my TerraformValidateStage, the subsequent TerraformEnvironmentStage, which does have the unstash, succeeds.
It seems this use-case would need the TerraformValidateStage to also include unstashing from previous stages that build artifacts.

Initially, I saw this issue with release 5.10 of terraform-pipeline.  I've also tested and reproduced it with release 5.17.

Can you post a sanitized/stripped down version of your Jenkinsfile pipeline?

It sounds like your TerraformValidateStage is coming after your BuildStage.  I think maybe I didn't fully think through the UseCase here, and never imagined switching the order (why build if there are syntactic errors in your terraform that will subsequently fail?)
Separately from terraform-pipeline, it looks like the issue of using filebase64sha256 with the validate command is a known issue with terraform.  See: https://discuss.hashicorp.com/t/use-validate-with-filebase64sha256/23246 Hashicorp's reponse: As with all of Terraform’s file* functions, this one is intended for files that are checked in to your version control along with the configuration files, making them effectively part of your module, rather than something generated by your module.  If ./my_lambda.zip is being generated, they seem to suggest that running filebase64sha256 on it isn't a supported UseCase for terraform validate.

A possible work around (this is brainstorming, so please feel free to comment):

I wonder if you could push the sha calculation outside of your project, and pass the value as a parameter?  If that's the case, you wouldn't need to use the filebase64sha256 method in terraform, which means you could validate your terraform code without the artifact being present.  That would mean that TerraformValidateStage could come before or after BuildStage, and it wouldn't matter either way.  The "gotcha" would be figuring out how to pass the sha to TerraformEnvironmentStages.  Perhaps your BuildStage could calculate the sha and store it in another file - your pipeline could save that additional file, which would unstash as part of your environments.  Then your terraform code could read the sha content from the unstashed artifact?


PolySynth play method does not work without "optional" parameters

Issue
The PolySynth play method requires a note and secondsFromNow argument in order to work. The documentation currently says that all parameters are optional, which is incorrect. In comparison, the MonoSynth play method only requires a note argument to work and the documentation is correct.
Bug
After looking at the source code, I've determined that the PolySynth should function like the MonoSynth. It should only require a note argument but there is a bug. Without the secondsFromNow argument, this.noteRelease is being passed the note argument and NaN:
key: "play",
    value: function play(note, velocity, secondsFromNow) {
      var susTime = arguments.length > 3 && arguments[3] !== undefined ? arguments[3] : 1;
      this.noteAttack(note, velocity, secondsFromNow);
      this.noteRelease(note, secondsFromNow + susTime);
    }

This causes the secondsFromNow in the noteRelease method to default to 0 instead of 1 which is the default susTime:
key: "noteRelease",
    value: function noteRelease(_note, secondsFromNow) {
      var now = main.audiocontext.currentTime;
      var tFromNow = secondsFromNow || 0;
      var t = now + tFromNow;

      if (!_note) {
        this.audiovoices.forEach(function (voice) {
          voice.triggerRelease(tFromNow);
        });

Proposed Solution
This issue is already accounted for in the MonoSynth play method by using a (~~) operator before the secondsFromNow parameter. The new code for the PolySynth play method would look like this:
key: "play",
    value: function play(note, velocity, secondsFromNow) {
      var susTime = arguments.length > 3 && arguments[3] !== undefined ? arguments[3] : 1;
      this.noteAttack(note, velocity, secondsFromNow);
      this.noteRelease(note, ~~secondsFromNow + susTime);
    }

key: "noteRelease",
    value: function noteRelease(_note, secondsFromNow) {
      var now = main.audiocontext.currentTime;
      var tFromNow = secondsFromNow;
      var t = now + tFromNow;

The documentation then needs to be changed for the PolySynth because the note parameter was never optional.

Hey @montoyamoraga, if you haven't already started working on this issue I would like to. This is my first time contributing to the project, I've read through the pertinent contribution docs, and would I love to give it a try.

hi @alextownson thanks so much!! go for it, and tag me

Hey @montoyamoraga, I was about to work on this but I noticed something I don't understand. It's actually already fixed in the source code using default function parameters – see #599 and #600. I haven't tested it yet but in theory it should fix the issue I came across while using the most recent download of p5 sound. What I don't understand is that this was fixed in 2021 and the most recent release of the library is from Feb 2023. How come the fix isn't in the build code?

I think maybe the latest p5 release didn't update the build of p5.sound it shipped with. (I'm actually not sure when it last updated it, as p5.sound wasn't being actively maintained for a little while, so no one was around to say "this should be updated in the p5 release.") @montoyamoraga when p5 1.6.1 starts gearing up for a release I'll let you know and we can see if it makes sense to also update p5.sound, and if there's anything in progress we need to wait for before releasing, we can make sure to keep that in mind! We don't have plans for a next release just yet but I'll keep you in the loop.

@davepagurek I see, thanks for letting me know. I'll be more mindful to work with the source code so that I am not duplicating issues that have already been resolved. I have questions about using tests/writing tests for the source code, would it be best to chat on discord?

sure, that works!


How to exactly reproduce the results on the openllm leaderboard?

Hi,
I am trying to reproduce the results on the openllm leaderboard of huggingface, however, I found some inconsistency between the results generated by harness and the results shown on the leaderboard. For example, for meta-llama/Meta-Llama-3.1-70B-Instruct, its average bbh acc_norm is 0.6915466064919285 (see first attached figure) in the raw results generated by harness, but on the leaderboard, it is shown as 55.93%. I am wondering how the 55.93% is calculated from 0.6915466064919285, thanks!

Similarly, for mmlu-pro, the raw results is 0.5309175531914894 but the leaderboard is shown as 47.88%.

TL;DR: Try adjusting your batch_size, as it can influence evaluation results due to some unknown GPU-related optimization issues (unrelated to lm-eval itself).
The OpenLLM Leaderboard blog mentions that evaluation results can vary with different batch_size values due to padding-related issues. However, while padding has been addressed, some evaluation inconsistencies persist in certain cases.
For further context, check related discussions:
•	Issue #1625
•	Issue #1645

Hi @Ryuuranwlb, I don't think the issue is related to batch size, as the raw results I shown is generated by huggingface, and there is a huge gap between the raw results 0.6915466 and the displayed results 55.93%

Perhaps you could try further inspecting the settings related to apply_chat_template for Instruct models.
Also, note that significant discrepancies are possible. I ran the following lm_eval CLI command to evaluate the dataset leaderboard_ifeval on the model dolphin-2.9.2-Phi-3-Medium with batch_size=1 and batch_size=8 on an H800 GPU. The results differed astonishingly.
lm_eval
--model hf
--model_args pretrained=cognitivecomputations/dolphin-2.9.2-Phi-3-Medium,trust_remote_code=True
--tasks leaderboard_ifeval
--batch_size 1
Batch size 1 result:

Batch size 8 result:

But the problem is that it is not the inconsistency between my running and huggingface. It is the inconsistency between huggingface's raw results and huggingface's webpage percentage results. The raw results I shown is provided by huggingface available at here (You might need to give permission to this dataset to see the results).

It would also help if the avg is returned, so that no further calculation is needed to compare against the leaderboard.
ifeval

Similarly, for 8B model.

Cannot relate the huggingface reported json with the benchmark page.
Discrepancy between my own runs with the huggingface reported one.

Benchmark on mmlu pro: 0.3068
Reported on mmlu pro: 0.3746
My results on mmlu pro: 0.1629
# my results are obtained from running vllm==0.6.3.post1, lm_eval==0.4.7
HF_TOKEN=xxxxx OPENAI_API_KEY=xxxxx --model local-completions --tasks leaderboard \
--model_args model=meta-llama/Llama-3.1-8B-Instruct,base_url=http://locally_hosted_vllm/v1/completions,temperature=0 \
--apply_chat_template --output_path "./result" --log_samples


ArXiv Articles

Domain: Scientific Articles
Not all articles posted on ArXiv are permissively licensed. Need to only do the CC ones.
Need to parse the LaTeX into plain text.
@craffel has already parsed some of these documents so we can re-use that code and those processed articles. We should re-run the data collection as there are always new papers being posted to arxiv.
The S2ORC dataset also includes scientific articles, we may need to deduplicate some between the two datasets.

For completeness, here is the code we used for the Pile. However it looks like @craffel's is substantially better.
In addition to saying Section <ref>, it looks like it also says <cit.>. I suspect we can extract the right replacement text from the PDFs themselves.

My code doesn't use the PDF at all - that ended up seeming kinda tricky to get right. I did think about writing some really basic code for trying to fill in sections and citations, but never did. I think it would be pretty quick to implement and get it 90% right.

@blester125 It looks like you've added some code, can you update us on the status of this?

@blester125 can you post the traceback of the pylatexenc error you're getting here?

Since arxiv has mostly fallen by the wayside, I've started to pick it up. I spent some time exploring other latex parsing options again, and I'm re-convinced that pylatexenc is close enough to what we want that we should go for it for v1. @blester125 I think you had said you were getting an exception for a large number of files? Was it one recurring exception, or just many exceptions? If you can give an example or point to some arxiv source that gives an error, I can try to fix it an upstream a change. Alternatively, if it's happening for <10% of files, I think we can ignore it. The only other thing I think we should consider doing is fixing the  and <cit.> things, both of which could have some pretty quick v1 pareto-principle code to make look nicer.

Creating the bibliography and resolving references should actually be pretty easy because arxiv requires a .bbl file when uploading latex source. bbl files look something like this:
\begin{thebibliography}{35}
\expandafter\ifx\csname natexlab\endcsname\relax\def\natexlab#1{#1}\fi

\bibitem[{Anil et~al.(2023)Anil, Dai, Firat, Johnson, Lepikhin, Passos, Shakeri, Taropa, Bailey, Chen et~al.}]{anil2023palm}
Rohan Anil, Andrew~M Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, et~al. 2023.
\newblock Palm 2 technical report.
\newblock \emph{arXiv preprint arXiv:2305.10403}.

\bibitem[{Bai et~al.(2023)Bai, Bai, Chu, Cui, Dang, Deng, Fan, Ge, Han, Huang et~al.}]{bai2023qwen}
Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu~Han, Fei Huang, et~al. 2023.
\newblock Qwen technical report.
\newblock \emph{arXiv preprint arXiv:2309.16609}.

I need to investigate how universal this is, but if the use if \bibitem followed by the latex source of the formatted citation is the standard format, we just need to match the citation keys to create references and dump the rest into the latex itself. To format the citation, I think we can just rely on the bibitem syntax:
\bibitem[label]{cite_key}

The \bibitem command generates an entry labeled by label. If the label argument is missing, a number is generated as the label, using the enumiv [counter](https://www.comp.nus.edu.sg/~kanmy/latex/ltx-3.html). The cite_key is a mnemonic consisting of any sequence of letters, numbers, and punctuation symbols not containing a comma.

i.e. if there's a [label], we use it; if there isn't, we number the citations. The thing I find confusing is that the labels in some of the bbl files I've looked at (including the one I excerpted from at the beginning of this comment), the [label] doesn't actually appear like you'd want it to in the text.

Apparently conversion from the label to the citation's appearance in the text is handled by the .bst file, and .bst files have this insane stack-based syntax. I asked Claude if there were any Python libraries that could go take a .bbl file and the appropriate .bst and output formatted text, and apparently there isn't (they all seem to work on bib files). I think I'll code up a very basic heuristic .bbl processor.

Here is an updated version of my arxiv parsing that fixes two major issues: 1) it copies in the contents of .tex files that are added via an \input statement, and 2) it handles citations in most typical cases. For example, for this random paper, here is what it outputs for the first paragraph of the intro:
Topological quantum pumping, a transport phenomenon utilizing topological properties of a modulated system, has attracted intensive attention in recent years.

There are two typical kinds of topological pumping, adiabatic pumping via topological edge modes [1, 2, 3, 4, 5, 6, 7, 8] and Thouless pumping via topological bulk bands [9].

In the adiabatic pumping, the edge state at one side will be adiabatically coupled to bulk states and then transferred to edge state at the other side [1, 2, 3, 4, 5, 6].

Unlike non-quantized adiabatic pumping via edge channel, the Thouless pumping is a quantized transport directly connected to the topological invariants of bulk bands, Chern numbers, which guarantee robust protection against perturbations [10].

To date, the Thouless pumping has been experimentally demonstrated via cold atoms in modulated optical lattices [11, 12], and can be employed to explore topological phases [9, 13, 14, 15, 16, 17, 18].

It is interesting to apply topological pumping in quantum information.

and here is what the start of the bibliography looks like towards the end of the file
[1]
Y. E. Kraus, Y. Lahini, Z. Ringel, M. Verbin, and O. Zilberberg, Topological States and Adiabatic Pumping in Quasicrystals, Phys. Rev.
Lett. 109, 106402 (2012).

[2]
M. Verbin, O. Zilberberg, Y. Lahini, Y. E. Kraus, and Y.
Silberberg, Topological pumping over a photonic Fibonacci quasicrystal, Phys. Rev. B 91, 064201 (2015)

There are still many edge cases that could be fixed (for example, it's not always the case that blah.tex has the bbl file blah.bbl, even though arxiv says that's required), but it seems to work ok on the test files I tried. When it doesn't work ok, it just falls back on <cit.> as before.
Next I will tackle references, and then I think we should be ~ready to go, unless the exceptions @blester125 are very common and should be fixed.

Since arxiv has mostly fallen by the wayside, I've started to pick it up. I spent some time exploring other latex parsing options again, and I'm re-convinced that pylatexenc is close enough to what we want that we should go for it for v1. @blester125 I think you had said you were getting an exception for a large number of files? Was it one recurring exception, or just many exceptions? If you can give an example or point to some arxiv source that gives an error, I can try to fix it an upstream a change. Alternatively, if it's happening for <10% of files, I think we can ignore it. The only other thing I think we should consider doing is fixing the and <cit.> things, both of which could have some pretty quick v1 pareto-principle code to make look nicer.

The Git-Theta paper was only ending up as a single paragraph


Add the Comments column to the template and documentation for Roster upload

Efforts can have comments, but there is no mention of this in the documentation or in the import template. It should be mentioned in both.

This feature is in fact shown in the documentation, at https://github.com/SplitTime/OpenSplitTime/blob/master/app/views/docs/visitors/_getting_started_staging_5.html.erb


[NG] fix datagrid single selection to deselect when value is set to null

This allows you to set the clrDgSingleSelected value to null, and clear the selection of that row. The previous check did not account for going from selected to null if you passed a non-truthy value.
It also adds plumber to the typescript gulp task so it doesn't die so easily on compile errors.

FYI, we wait for two approvals before merging. Please make sure @youdz takes a look at this before merging.
Thanks!


Error when using file:// URI in asset card yaml

Hi - I'm evaluating seamless-m4t and am trying to load a model checkpoint locally.       When I specify a file:// URI I get the following error:
fairseq2.assets.card.AssetCardError: The value of the field 'checkpoint' of the asset card 'seamlessM4T_large' must be a valid URI, but is 'file:///foo/bar/seamless-m4t-large/multitask_unity_large.pt' instead.

I can work around this by starting up a python http.server and serve the file locally, but it would be nice to have proper file:// URI support.
Originally posted by @jgwinnup in https://github.com/facebookresearch/seamless_communication/issues/50#issuecomment-1691826580

Hey @jgwinnup, could you please try file://foo/bar/seamless-m4t-large/multitask_unity_large.pt? Note that there are only two slashes after file:. Due to security reasons, our asset cards always expect a full path to be specified. Let me know how that goes. If it does not work, we can investigate it further.

Hey @jgwinnup, could you please try file://foo/bar/seamless-m4t-large/multitask_unity_large.pt? Note that there are only two slashes after file:. Due to security reasons, our asset cards always expect a full path to be specified. Let me know how that goes. If it does not work, we can investigate it further.

can u help me with the path
checkpoint: "Models/seamlessM4T_v2_large.pt"
vocoder_path = "/Models/vocoder_v2.pt"
translator = Translator(
model_name_or_card=checkpoint,
vocoder_name_or_card=vocoder_path,
device=torch.device("cuda:0"),
dtype=torch.float16,
)
and here is the error
(kiya_api) david@davemoment:~/Documents/Projects/KIYA/src$ python STT.py
Traceback (most recent call last):
File "/home/david/Documents/Projects/KIYA/src/STT.py", line 31, in
model_name_or_card=checkpoint,
NameError: name 'checkpoint' is not defined. Did you mean: 'breakpoint'?


Update subtitles for NetEaseMusic and QQMusic

Copy description to subtitles.zh-CN.data
Remove the 3rd digit after dot in NetEase's timestamp to fit
LRC format (to be compatible with mpv)

there're still some issue on neteasemusic's _process_lyrics

updated @dstftw

The last line of .lrc will be ignored(and not shown) by mpv as it doesn't have a duration. and mpv cannot handle .lrc with other tags.
So adding a conversion to .srt for neteasemusic.

ping @dstftw
Is there any update for this PR or anything should I modify?
(conversion to .srt is discarded as mpv fixed a bug handling .lrc in their recent commits)

Push changes as new commits since otherwise it's hard to track changes.

ping @dstftw

Hello @dstftw  or others, is there any update or further changes needed for this PR?

Could you also split this PR into 3 separated:

Recursion support for test data
NetEaseMusic changes
QQMusic changes

QQMusic part could be merged long time ago but I can neither merge nor cherry-pick since it's overlaped with another code.

hello @dstftw
test helper has been modified as your requirement.
And PR has been spited into 3 commits.

Actually I've expected 3 separated pull requests rather than 3 commits.

Please wait for up to 10 minutes.

Submitted 3 PRs at #6984, #6985, #6986
#6986 depends on #6985 but doesn't include the commit existed at #6985 . So tests of #6986 will fail unless #6985 is merged.


Angular 6: ngx-translate not working with data-title attribute for tooltips

I'm developing an Angular 6 app which uses ngx-translate for localization and I'm also using Bootstrap 4 tooltips and the problem I'm facing is I'm not being able use localization keeping Bootstrap tooltip style.
Without localization I would use an input this way:
    <input type="text" class="form-control text-truncate" id="position"
    placeholder="position" data-title="position" />

And this will show a very nice Bootstrap tooltip as it can be seen below:

With ngx-translate localization I would use an input this way:
    <input type="text" data-toggle="tooltip" class="form-control tooltipped text-truncate" id="position"
        [attr.placeholder]="'wfrh_vacancyform_position' | translate"
        [attr.data-title]="'wfrh_vacancyform_position' | translate" />

and the problem here is data-title attribute. "data-title" attribute is used to display the tooltip but I guess ngx-translate doesn't recognize it (maybe?).
Placeholder is working fine this way (the text is translated and shown correctly) but tooltip won't show.
I've also tried this way:
    <input type="text" data-toggle="tooltip" class="form-control tooltipped text-truncate" id="position"
    placeholder="{{'wfrh_vacancyform_position' | translate}}"
    data-title="{{'wfrh_vacancyform_position' | translate}}" />

which is also not working (it only works for placeholder) so I'm stuck.
If I do:
    <input type="text" data-toggle="tooltip" class="form-control tooltipped text-truncate" id="position"
        [attr.placeholder]="'wfrh_vacancyform_position' | translate"
        [attr.title]="'wfrh_vacancyform_position' | translate" />

then the tooltip shows but with no style as it can be seen in the next image:

And this is the way I create the tooltips in code (in ngOnInit):
ngOnInit() {
   setTooltip()
}
      setTooltip() {

        $('.tooltipped').tooltip({
          placement: 'auto',
          trigger: 'focus',
          template: '

'
        });

        $('.tooltipped').bind("mouseover", function () {
          var _this = $(this);
          _this.tooltip("show");
        });

        $('.tooltipped').bind("mouseout", function () {
          var _this = $(this);
          _this.tooltip("hide");
        });

        $('.tooltipped').bind("keyup", function () {
          var _this = $(this);
          _this.tooltip("hide");
        });
      }

Well I'm stuck. I need to be able to display this nice styled tooltip with translation. Any help / ideas?
Thanks.

Ok, after long time investigating I was able to find a solution and I'll post it here in case it helps anyone else.
The problem is I was setting tooltip in onInit (which is fired only once when the component is created) and wasn't setting any tooltip text, just leaving it to pickup the one set with:
    [attr.data-title]="'text_to_translate_key' | translate"
(the initial text translation) and after changing language tooltip was not refreshing (the text was static with the initial value) but you can use a function with the tooltip "title" property this way:
        $('.tooltipped').tooltip({
          placement: 'auto',
          trigger: 'focus',
          template: '

',
          title: this.setTitle
        });

      setTitle() {

        return $(this).attr("placeholder");
      }

and this function (which has current object reference -this- as an implicit input parameter) acts as a binding which updates the title property continuosly so when placeholder text changes (placeholder does not need to be refreshed after language changes and that's why it works) the tooltip "title" property will be updated and as a consequence tooltip text will change and user will see updated text.
"The end" :)


Test Reporter for Container CI

Description
The following changes in the .yaml files worked with the previous forked repository, and will likely require some additional changes as we migrate to the new ai-containers format.
Changes Made

provide upload-artifact actions in action.yml to store test-runner logs persistently across each matrix element that was picked up in group-diff
provide merge-logs action to download artifacts after the test-runner completed and uses jq to produce combined JSON file with all tests and its status, then transfer result to output.txt

Validation

Expected format should be similar to below:

Test-Group	Test	Status
python/tests	import-core	PASS
python/tests	perf-full	PASS
python/tests	perf-core	PASS
python/tests	perf-stock	PASS
python/tests1	import-core	PASS
python/tests1	perf-full	PASS
python/tests1	perf-core	PASS
python/tests1	perf-stock	PASS

recreate: true is not deleting the previous comment, will investigate to see what additional input is necessary for the following fix. Also there is a destination mismatch, looking at the following log, we can see that all three were downloaded to the same directory:
Run actions/download-artifact@v4
  with:
    pattern: my-artifact*json
    merge-multiple: true
    repository: intel/ai-containers
    run-id:<PHONE_NUMBER>
Found [1](https://github.com/intel/ai-containers/actions/runs/9982280984/job/27588636581?pr=213#step:2:1)0 artifact(s)
Filtering artifacts by pattern 'my-artifact*json'
Preparing to download the following artifacts:
- my-artifact classical-ml-tests json (REDACTED)
- my-artifact python-tests json (REDACTED)
- my-artifact python-tests1 json (REDACTED)
Redirecting to blob download url: ...
Starting download of artifact to: /home/runner/work/ai-containers/ai-containers
Redirecting to blob download url: ...
Starting download of artifact to: /home/runner/work/ai-containers/ai-containers
Redirecting to blob download url: ...

But when running ls . for the next job we see that there's only:
Run ls .
tests-test-runner.json
tests1-test-runner.json

/home/runner/work/ai-containers/ai-containers looks fixed, will make the following fix by navigating to the path and see whether this is fixed.

The most recent comment, running with recreate: true.
Testing whether this comment is deleted or the one previously posted with the same header.

Test-Group	Test	Status
preset/data-analytics	dataset-librarian-3.9	PASS
preset/data-analytics	dataset-librarian-3.10	PASS
preset/data-analytics	modin-3.9	PASS
preset/data-analytics	modin-3.10	PASS
preset/data-analytics	modin-notebook-3.9	PASS
preset/data-analytics	modin-notebook-3.10	PASS
python/tests	import-core	PASS
python/tests	perf-full	PASS
python/tests	perf-core	PASS
python/tests	perf-stock	PASS
python/tests1	import-core	PASS
python/tests1	perf-full	PASS
python/tests1	perf-core	PASS
python/tests1	perf-stock	PASS

Conclusion: Confirmed expected behavior from across triggered containers in group-diff job, gathering the summaries of all test-runner jobs and combined together successfully.

Keep header value the same in marocchino/sticky-pull-request-comment@v2 job throughout with recreate: true from the beginning, this will make sure that the issue PR-comment posted by the Github Bot is overwritten every subsequent time test-runner is triggered.

Resolved case where tests.yaml is not present when group-diff triggered the container. Expected behavior: Skip job. Validated (please see the following PR run)
Also validated regular case where test-runner is supposed to run. Please see this PR run
Challenges and notes to self:
Make sure to always use [[ ]] when running bash conditional if statements, and also have matching quotes.


Fix documentation typo

Copy-paste error left longest_prefix where shortest_prefix should
have gone in the code examples.

I corrected my email address to the one with which I've previously signed it.

Thanks.


:robot: Change trivy DB url

To a one that seems to not have requests limits in place which means we can drop the workarounds we have for the failure to download

What this PR does / why we need it:
Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #

seems to work as expected, lets see for how long :D


issue about predictProbabilitiesSync

Here is the code:
'use strict';

var so = require('stringify-object');
var svm = require('../lib');
var _a = require('mout/array');
var fileName = './examples/datasets/housing.ds';

var clf = new svm.EpsilonSVR({
  gamma: [0.125, 0.5, 1],
  c: [8, 16, 32],
  epsilon: [0.001, 0.125, 0.5],
  normalize: true, // (default)
  reduce: true, // (default)
  retainedVariance: 0.995,
  kFold: 5,
  probability : true
});

svm.read(fileName)
    .then(function (dataset) {
        // train the svm with entire dataset
        return clf.train(dataset)
            .progress(function(progress){
                console.log('training progress: %d%', Math.round(progress*100));
            })
            .spread(function (model, report) {
                console.log('SVM trained. \nReport :\n%s', so(report));
                return dataset;
            });
    })
    .then(function (dataset) {
        // randomly pick m values and display predictions
        _a.pick(dataset, 5).forEach(function (ex, i) {
            var prediction = clf.predictProbabilitiesSync(ex[0]);
            console.log(' { #%d, expected: %d, predicted: %d}',i+1, ex[1], prediction);
            console.log(prediction);
        });
    })
    .fail(function (err) {
        throw err;
    })
    .done(function () {
        console.log('done.');
    });

when I run, I got the fault.
[1]    16488 segmentation fault  node examples/regression-with-PCA-example.js

node version: v4.4.3
Please help.

Please check your dataset and make sure it only contains numbers (no null/undefined/string...)

I didn't see you were using the housing dataset, sorry for that. Sorry.
Could you print the value of the ex variable in _a.pick(dataset, 5).forEach(function (ex, i) {... ?

output:
Report :
{
	mse: 16.55732397228971,
	std: 4.067986888422381,
	mean: 0.09384374200392011,
	size: 506,
	reduce: true,
	retainedVariance: 0.995114672273733,
	retainedDimension: 12,
	initialDimension: 13
}
[ [ 5.82401,
    0,
    18.1,
    0,
    0.532,
    6.242,
    64.7,
    3.4242,
    24,
    666,
    20.2,
    396.9,
    10.74 ],
  23 ]
[ [ 0.01709,
    90,
    2.02,
    0,
    0.41,
    6.728,
    36.1,
    12.1265,
    5,
    187,
    17,
    384.46,
    4.5 ],
  30 ]
[ [ 0.3692,
    0,
    9.9,
    0,
    0.544,
    6.567,
    87.3,
    3.6023,
    4,
    304,
    18.4,
    395.69,
    9.28 ],
  23 ]
[ [ 2.15505,
    0,
    19.58,
    0,
    0.871,
    5.628,
    100,
    1.5166,
    5,
    403,
    14.7,
    169.27,
    16.65 ],
  15 ]
[ [ 11.1081,
    0,
    18.1,
    0,
    0.668,
    4.906,
    100,
    1.1742,
    24,
    666,
    20.2,
    396.9,
    34.77 ],
  13 ]
done.
[1]    17065 segmentation fault  node examples/regression-with-PCA-example.js

No, the variable ex please

ex:
[ [ 5.82401,
    0,
    18.1,
    0,
    0.532,
    6.242,
    64.7,
    3.4242,
    24,
    666,
    20.2,
    396.9,
    10.74 ],
  23 ]
[ [ 0.01709,
    90,
    2.02,
    0,
    0.41,
    6.728,
    36.1,
    12.1265,
    5,
    187,
    17,
    384.46,
    4.5 ],
  30 ]
[ [ 0.3692,
    0,
    9.9,
    0,
    0.544,
    6.567,
    87.3,
    3.6023,
    4,
    304,
    18.4,
    395.69,
    9.28 ],
  23 ]
[ [ 2.15505,
    0,
    19.58,
    0,
    0.871,
    5.628,
    100,
    1.5166,
    5,
    403,
    14.7,
    169.27,
    16.65 ],
  15 ]
[ [ 11.1081,
    0,
    18.1,
    0,
    0.668,
    4.906,
    100,
    1.1742,
    24,
    666,
    20.2,
    396.9,
    34.77 ],
  13 ]

You can run the nodejs code above, then you can reproduce.

The problem is that probability estimates are  meaningful/supported for classification tasks only (not regression).
Best regards

Thanks.

but OneClassSVM also meet
Assertion failed: (svm_params->probability == 0), function setParameters, file ../src/node-svm/node-svm.h, line 184.

Happened to me as well, segfaults if used for regressions


refactor: Show network connectivity error tooltip

Summary
This PR adds the network connectivity tooltip for AO tokens when the balance fetch is failed.

@7i7o since we cannot get the same fetch error status as we see in the browser, we don't know if it was failed due to ISP/VPN blocking ao. I did add a common fetch error check that occurs on if fetch is failed but do you have idea on how we can make it better ?

@7i7o since we cannot get the same fetch error status as we see in the browser, we don't know if it was failed due to ISP/VPN blocking ao. I did add a common fetch error check that occurs on if fetch is failed but do you have idea on how we can make it better ?

Actually those are the best error messages we have from the users that experienced the problem


FD doesn't add import of typedef from another class

FD (<IP_ADDRESS>1) gives to select typedef defined in another class in autocompletion, but doesn't add it's import
class A
{
}
typedef TA = {
}

class B
{
var ta : TA
}

@andrew-git  are the classes in the same package?

No

via #3019


cache hub programs

As https://github.com/pybricks/support/issues/284 seems to be theoretically possible or might be possible in the future, we can use the automatic program storage to not have to download everytime.
Maybe have a "first time download" process that automatically restarts the hub so the program is guaranteed to be stored?

We have the program start API now with newest pybricksdev

we also need a mechanism to force downloading the program again in case somehow it is lost or outdated.
For new brickrail version on the system probably always download new pogram

we can locally store for each known hub a hash of the program that we last downloaded. When it is different, force download again.
Also if program start fails for some reason, assume wrong or no program is on the hub, and force download.

think we can close this now


Fix Client SDK: Split random oracle prefixes for legacy and chunked implementations

This PR splits Random_oracle.State into a version for each of Legacy and Chunked random oracles, enforced by the typechecker. Doing this revealed the bug that broke signing with the Client SDK on develop.
This PR also includes the test from #10650 (against compatible), which will ensure that such breakage never happens again.
As part of that merge, this PR pulls in some additional commits from compatible; merging #10651 to develop should cause them to disappear.
Checklist:

[ ] Modified the current draft of release notes with details on what is completed or incomplete within this project
[ ] Document code purpose, how to use it

Mention expected invariants, implicit constraints

[ ] Tests were added for the new behavior

Document test purpose, significance of failures
Test names should reflect their purpose

[ ] All tests pass (CI will check this if you didn't)
[ ] Serialized types are in stable-versioned modules
[ ] Does this close issues? List them

I know this would be for another PR: how about changing the name of Chunked random oracle to Kimchi random oracle, so that the naming (legacy & kimchi) aligns with the poseidon consts and params naming?

I initially chose 'chunked' and 'legacy' because neither is naturally what you'd reach for, so we'd stop and think before choosing one. I worry that

I know this would be for another PR: how about changing the name of Chunked random oracle to Kimchi random oracle, so that the naming (legacy & kimchi) aligns with the poseidon consts and params naming?

I initially chose 'chunked' and 'legacy' because neither is naturally what you'd reach for, so we'd stop and think before choosing one. I worry that standardising on kimchi will make that the 'every time' choice, since it's the name of the proof system. I'm going to leave as-is here, but this would be good to discuss more widely!

That is good reasoning.  Agree with you.
Until it's completely legacy and not used for anything it possibly someone could use Kimchi when indeed it should have been legacy :-)


Finish Metaswap coupling

Links to #26

I've asked around for the developments: the Lumbricus branch of MetaSWAP will actually write values to the arrays of runoff, sprinking demand, and read the values in the allocated array.

Closing now that development is happening in iMOD Coupler


UWP 10 Mobile App - Camera functionality crashes after using the barcode scanner

I have the following page Identify.xaml.cs which has the code below to call the barcode scanner:
private async void btnBarcodeScan_Click(object sender, RoutedEventArgs e)
{
var scanner = new MobileBarcodeScanner();
var result = await scanner.Scan();
        scanner.UseCustomOverlay = false;
        scanner.TopText = "Hold camera up to barcode";
        scanner.BottomText = "Press red line to focus and scan barcode";

        var dialog = new MessageDialog("Scanned Barcode: " + result.ToString());
        await dialog.ShowAsync();
    }

This works as expected. However after using this I have another page called Contact.xaml.cs which utilizes the device camera; code below:
private async void btnCamera_Click(object sender, RoutedEventArgs e)
{
try
{
CameraCaptureUI captureUI = new CameraCaptureUI();
captureUI.PhotoSettings.Format = CameraCaptureUIPhotoFormat.Jpeg;
captureUI.PhotoSettings.CroppedSizeInPixels = new Size(200, 200);
captureUI.PhotoSettings.MaxResolution = CameraCaptureUIMaxPhotoResolution.HighestAvailable;
StorageFile file = await captureUI.CaptureFileAsync(CameraCaptureUIMode.Photo);
string _fileNameConvention = Guid.NewGuid().ToString() + ".jpg";
StorageFile fileCopy = await file.CopyAsync(KnownFolders.PicturesLibrary, _fileNameConvention, NameCollisionOption.GenerateUniqueName);
}
catch (Exception ex)
{
Debug.WriteLine("Exception Message: " + ex.Message);
}
And this fails everytime on the following line of code after the barcode scanner has been used:
StorageFile file = await captureUI.CaptureFileAsync(CameraCaptureUIMode.Photo);
This generally returns a black screen and times out. I really hope you can assist with a solution as this is a blocker to me using the Zxing.mobile.net solution.
Many thanks in advance,
Jose

What kind of exception are you getting?  A stack trace would be helpful.  My guess is something's not being cleaned up properly from ZXing...

Following the code as per this link https://github.com/Redth/ZXing.Net.Mobile/blob/master/Source/ZXing.Net.Mobile.WindowsUniversal/ScanPage.xaml.cs resolves this issue from happening.

i have the same problem, when you use camera first it works than scanner and than camera again it does not work, but the scanner works allways, it is like the scanner has some exclusive permission for camera that it does not releases, btw the camera does not give any exceprion in output just opens black screen and closes it self in like 3 seconds

I am also facing the same issue. For android it is working fine but for UWP/Windows 8.1 it if giving unhandled exception at below line even after adding try catch block, exception is not being caught.
var result = await scanner.Scan();
any one have working scanner with UWP/WIndows 8.1 ?

Thanks for reporting this issue!  Unforunately it took me way too long to respond 😭.  Sorry, I apologize!  Recently the source code for this project was completely refactored to modernize it.  Many PR's were included in this effort, and many bugs were hopefully fixed.  Please try out the latest 3.x series of NuGet packages (currently in prerelease).  To try and make the project more maintainable in my spare time going forward, I've decided to close all existing issues to start with a clean slate.  If you're still experiencing this issue on the newest version, please open a new issue with as much detail as possible.  Thank you for your patience and understanding!  Happy scanning!


pull request for e2e test at 12/15/2016 13:45:16

:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Minor logs and docs cleanup

/gcbrun

Codecov Report

Merging #278 into master will decrease coverage by 13.04%.
The diff coverage is 100%.

@@              Coverage Diff              @@
##             master     #278       +/-   ##
=============================================
- Coverage     82.56%   69.51%   -13.05%
+ Complexity     1938     1627      -311
=============================================
  Files           119      119
  Lines          7995     7995
  Branches        977      977
=============================================
- Hits           6601     5558     -1043
- Misses         1005     2071     +1066
+ Partials        389      366       -23

Flag
Coverage Δ
Complexity Δ

#hadoop2integrationtest
?
?

#hadoop2unittest
69.51% <100%> (ø)
1623 <0> (ø)
:arrow_down:

#hadoop3integrationtest
?
?

#hadoop3unittest
69.51% <100%> (ø)
1627 <0> (ø)
:arrow_down:

Impacted Files
Coverage Δ
Complexity Δ

...oud/hadoop/gcsio/GoogleCloudStorageFileSystem.java
87.63% <100%> (-4.25%)
141 <0> (-12)

...gle/cloud/hadoop/gcsio/cooplock/CoopLockUtils.java
0% <0%> (-100%)
0% <0%> (-2%)

...d/hadoop/gcsio/cooplock/CoopLockOperationType.java
0% <0%> (-100%)
0% <0%> (-1%)

.../cloud/hadoop/gcsio/testing/TestConfiguration.java
0% <0%> (-100%)
0% <0%> (-2%)

...ud/hadoop/io/bigquery/AvroBigQueryInputFormat.java
0% <0%> (-100%)
0% <0%> (-3%)

...loud/hadoop/gcsio/ThrottledGoogleCloudStorage.java
0% <0%> (-88.77%)
0% <0%> (-29%)

...a/com/google/cloud/hadoop/fs/gcs/CoopLockFsck.java
0% <0%> (-88.47%)
0% <0%> (-10%)

...adoop/gcsio/cooplock/RenameOperationLogRecord.java
0% <0%> (-87.5%)
0% <0%> (-5%)

...loud/hadoop/gcsio/cooplock/CoopLockRecordsDao.java
0% <0%> (-87.12%)
0% <0%> (-34%)

...google/cloud/hadoop/fs/gcs/CoopLockFsckRunner.java
0% <0%> (-81.91%)
0% <0%> (-36%)

... and 30 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 750e85a...3064d05. Read the comment docs.


Ensouled bloodveld head

The ensouled bloodveld head doesn't show its GE price on the ground or when examining it. The GE searcher also doesn't show the item anywhere.
It is tradeable and found on the GE at about 4.9K currently.

Duplicate of #1045

For context, the item on ground is actually untradeable for a while due to how the ensouled heads work.


WPE* Version bumps

Ah, forgot to rename wpebackend to libwpe. Hold on :)

Ping @psaavedra :)

Additionally this patchset has an issue with the cog versioning in relation to wpewebkit.  If you build wpewebkit 2.20.2 then cog needs a SRCREV of 4487c4ce53f5489c244655d9ea0feea90034ab82.
It is probably best if we set a flag to dictate if the build should be against stable revisions, or devel revisions.

Hum yes, perhaps we can have a specific recipe for the cog 0.1 branch?


Project is not conforming to the proto3 spec

I've been diving a bit deeper into the proto3 spec and it seems like wrapping scalars in options is not according to the spec.
Until recently Proto3 did not have any way to track presence for scalar types and therefore it is not possible to know if an int32 is set to 0 or if the value was not set at all since the default value for int32 is 0.
People worked around this by using the wrappers.proto well-known types:  https://github.com/protocolbuffers/protobuf/blob/master/src/google/protobuf/wrappers.proto
This allows proto generators to have a special case where if a type is wrapped in a well known wrapper type it will be unwraped and e.g. wrapped in an option instead.
Recently the optional keyword was also introduced in proto3 as a way to track presence. The wire protocol represents the optional fields as a single case oneof but generators can unwrap the oneof and represent the field in a way that is idiomatic to their programming language.
I propose that we make the following changes to the generator:

Non-optional scalars will no longer be wrapped in option since there is no way to know if a value was set intentionally or is just set to the default value.
Unwrap the optional fields single case union and represent them as a option type
(Optional) Add support for the well-known wrappers type

What do you think @Arshia001 ?

I'm generally unaware of the spec, but what I do know is that we can detect the presence of scalar fields very simply. After all, the binary message either includes the field or it doesn't.
Supporting the well-known wrappers types is a great idea. I'd actually have done it, had I not been in a hurry to finish the code generator. However, I see no reason why we should complicate matters more than need be; we can detect presence of scalars and we can represent that presence easily. Why shouldn't we do it?
I'm going to look into the C# code generator and see what it does.

It doesn't do very nice things... This is my .proto:
message Inner {
    int32 int = 1;
}

message TestFieldPresence {
    string str = 1;
    Inner inner = 2;
}

And here's a few lines from the generated code:
    private string str_ = "";
    [global::System.Diagnostics.DebuggerNonUserCodeAttribute]
    public string Str {
      get { return str_; }
      set {
        str_ = pb::ProtoPreconditions.CheckNotNull(value, "value");
      }
    }

      if (Str.Length != 0) {
        output.WriteRawTag(10);
        output.WriteString(Str);
      }

      if (Str.Length != 0) {
        size += 1 + pb::CodedOutputStream.ComputeStringSize(Str);
      }

      if (other.Str.Length != 0) {
        Str = other.Str;
      }

For the life of me, I can't understand why they did it this way. The simplest solution would have been to add a ***Present flag for each field. Using language defaults to detect presence though? Ugh.
Anyway, I still don't see why we shouldn't wrap everything in options. Can you think of a scenario where this would cause problems?

One more observation: This behavior of checking for presence via language defaults is built into the code generators. The binary protocol actually supports writing and reading empty or zero values, as evidenced by this code:
    let i = { Inner.empty() with Int = ValueSome 0 }
    use str = new System.IO.MemoryStream()
    i.WriteTo(str)
    str.Position <- 0L
    let i = Inner.Parser.ParseFrom(str)
    printfn "%O" i.Int // prints 0

If I'm interpreting the docs here correctly, then the proto3 wire format can not distinguish between a default value (e.g. 0 for int32) and a user setting the field to the default value.
This would mean that if I have the following message
message Test {
    int32 test_int = 0;
}

And set the test_int field to 0 and then send it over the wire, then the recipient would end up with ValueNone instead of ValueSome(0).
Are you saying that it is not like that? If we can actually discern between default values and intentionally set values, then there is no need to change anything. I definitely prefer having all fields as options than not.
I just started looking into this since I had to use the Rust proto implementation(https://github.com/tokio-rs/prost) and even though Rust supports options they do not wrap scalar types in options.

I can look into sending a message from e.g. the Rust or Go generator and then deserialize it with the F# generator and see how the default values work between the implementations. Can look into it after the weekend.

I also figured that this ruins interop with languages like Rust where there is no null and therefore when you construct a proto message you have to set the default values since you can't skip fields in the message.

I updated #8 to include unwrapping of proto3 optional types.

I confirmed that if I create a proto message in go and serialize it and then deserialize it in F# then I will always get ValueNone even if I set the field to the default value on the go side.
To make this generator play nicely with other generators we will have to conform to the spec and have the same default values as specified here: https://developers.google.com/protocol-buffers/docs/proto3#default
I've got a PR that is based on #8 that changes the default values: #12
It includes all the changes from this PR as well since I didn't want to conflict if you want to accept both

Thank you. I will merge these changes eventually, but you have a lot of code in there, and reviewing it can take quite some time...

Hey guys, I wonder if this project can be simplified (and as a consequence might have fewer bugs like this) by taking a dependency on https://github.com/grpc/grpc-dotnet ? I know that proj is very C#-centric, but you could ignore the code generation part and use the rest of the bits?

This project would not change very much in complexity since the only thing that is done on our side is code generation and creating a F# friendly wrapper for the previous incarnation of C# gRPC: https://www.nuget.org/packages/Grpc.Core
I want to migrate this project to use grpc-dotnet in the not so far future but don't have the capacity to do so at the moment and I would like to get https://github.com/Arshia001/FSharp.GrpcCodeGenerator/pull/12 merge first.
I'm hoping @Arshia001 shows up at some point to review the changes. I'm also up for being added as a co-maintainer if @Arshia001 would agree to that. My company uses this library quite a lot in production and I would love to upstream all the patches we do to it.

Closed in #16.


Feature/html snippet

It was a terrible idea to monorepo this code, see the repo https://github.com/bsteinig/slow-analysis-cdn for the most up to date html-snipper.


Repeated authentication request for remote repository

What are the steps to reproduce?

prepare repositories
A. create private repositories on GitHub: Repo-A and Repo-B.
B. create Node-RED project with remote repository.
C. commit and push flow to Repo-A.
create a Node-RED project from the Repo-A with HTTPS access (user+password).
from Projects>Project Settings>Settings>add remote add the remote repository Repo-B with HTTPS access.
from history>Commit History>Manage remote branch button, select Remote: origin/master

What happens?
Following is repeated:

Dialog box for inputting Username/*Password} is shown.
input user name and password then press Retry

What do you expect to happen?
A username and password will be accepted at the first input.
However, my understanding of what kind of operation is expected here for multiple remotes is
ambiguous.
From an implementation point of view,  the reason for this seems to be that the authentication information for the second remote is not properly handled when refreshing information of the repositories.
Similar issue: https://github.com/node-red/node-red/issues/2468
Please tell us about your environment:

[x] Node-RED version: 1.0.6
[x] Node.js version: 12.16.1/12.16.3
[x] npm version:6.13.4/6.11.4
[x] Platform/OS: macOS/Ubuntu
[x] Browser: Chrome

I have managed to track this issue down.
When you click the manage remote branch box, we do a git fetch of each remote to get the list of remote branches.
If one of those fails due to authentication, we pass an error back to the editor so it can prompt for auth details.
However, we were failing to include information on which remote hit the auth error. This meant the editor would prompt for auth details on the first remote in the list - even if that wasn't the remote at fault.
The editor already had the code needed to prompt for the right remote - it just needed to be told which remote to prompt for.
The fix was to ensure the remote property of the error was included in the response to the editor.
I have pushed this to dev for 1.1.0, but it could be back-ported to master in case we do a 1.0.7 release.

In fact - the commits are easy to cherry-pick, so I've now pushed them to master as well.

Thank you!