Postcss-preset-env only add fallbacks when using the variables in same file

Is this a bug report?
I'm not sure, could be me using it wrong.
Did you try recovering your dependencies?
I created a completely new create-react-app project. So everything should be up to date.
Environment
Environment Info:
System:
OS: macOS 10.14
CPU: x64 Intel(R) Core(TM) i5-5257U CPU @ 2.70GHz
Binaries:
Node: 10.10.0 - ~/.nvm/versions/node/v10.10.0/bin/node
Yarn: 1.10.1 - /usr/local/bin/yarn
npm: 6.4.1 - ~/.nvm/versions/node/v10.10.0/bin/npm
Browsers:
Chrome: 70.0.3538.77
Firefox: 62.0.3
Safari: 12.0
npmPackages:
react: ^16.6.0 => 16.6.0
react-dom: ^16.6.0 => 16.6.0
react-scripts: 2.0.5 => 2.0.5
npmGlobalPackages:
create-react-app: Not Found
Steps to Reproduce
(Write your steps here:)

create new react app
add css variable in index.css, and then use that variable both in index.css and app.css.
Apply class names on elements.

/* index.css */
:root {
	--color: red;
}

.text-a {
	font-size: 22px;
	color: var(--color);
}

/* app.css */
.text-b {
	font-size: 22px;
	color: var(--color);
}

Expected Behavior
With postcss-preset-env I expect it apply fallbacks on both classes.
like this.
.text-a {
    font-size:  22px;
	color:  red;
	color:  var(--color);
}

Actual Behavior
It only happens on the class that is written in the same file as root variables is applied. Which in this case is .text-a
Importing that file doesn't seem to solve it either.
Reproducible Demo
https://github.com/rickbrunstedt/postcss-cra-bug-maybe

I had the same issue.
The problem is that imported css-files are processed separately by webpack loaders and the plugin which adds fallbacks (postcss-custom-properties inside of postcss-preset-env in postcss-loader) just doesn't aware of other css-files in that moment.
There is option importFrom which you can provide to that plugin, and you can declare it in 'postcss-preset-env' (importFrom) (it will be passed down to 'postcss-custom-properties').
But unfortunately there is no way to pass this option to 'postcss-preset-env' right now: webpack.config.js.
{
  // Options for PostCSS as we reference these options twice
  // Adds vendor prefixing based on your specified browser support in
  // package.json
  loader: require.resolve('postcss-loader'),
  options: {
    // Necessary for external CSS imports to work
    // https://github.com/facebook/create-react-app/issues/2677
    ident: 'postcss',
    plugins: () => [
      require('postcss-flexbugs-fixes'),
      require('postcss-preset-env')({
        autoprefixer: {
          flexbox: 'no-2009',
        },
        stage: 3,
      }),
    ],
    sourceMap: isEnvProduction && shouldUseSourceMap,
  },
},

The postcss.config.js is useless too, because postcss-loader wouldn't search for config files if you pass some props directly (except ident, config, sourceMap) (https://github.com/postcss/postcss-loader/blob/master/src/index.js#L50).

I came across the similar issue when I had:

definition of :root {} in a file
imported as global CSS in index.js

Then if i tried using the custom properties in a *.module.css file, it won't go through postcss.

Posted previous one in rush. Here is more detailed structure of the my case.
|- src/
  |- index.js
  |- global.css
  |- components/
    |- HelloWorld/
      |- index.js
      |- index.module.css

/* src/global.css */

@custom-media --medium-screen (min-width: 700px)

:root {
  --my-color: #c30;
}
...

/* src/index.js */

import React from 'react';
import './global.css';
...

Following does not work:
/* src/components/HelloWorld/index.module.css */

.helloWorld {
 @media (--medium-screen) {
    background-color: var(--my-color);
  }
}

Following works:
/* src/components/HelloWorld/index.module.css */

@import '../../global.css'

.helloWorld {
  @media (--medium-screen) {
    background-color: var(--my-color);
  }
}

I had the same issue, since I needed a solution asap (don't we all n all the time 😝) because of commitments and I also didn't wanted to eject CRA 3.0. So here is what I did:
Install these libraries
npm install react-app-rewired postcss-assets-webpack-plugin postcss-custom-properties

Create a new file config-overrides.js
const PostCSSAssetsPlugin = require("postcss-assets-webpack-plugin");
const PostCSSCustomProperties = require("postcss-custom-properties");

module.exports = function(config) {
    config.plugins.push(
        new PostCSSAssetsPlugin({
            test: /\.css$/,
            log: false,
            plugins: [PostCSSCustomProperties({ preserve: true })]
        })
    );
    return config;
};

Changes in package.json
"scripts": {
-   "start": "react-scripts start",
+   "start": "react-app-rewired start",
-   "build": "react-scripts build",
+   "build": "react-app-rewired build",
-   "test": "react-scripts test --env=jsdom",
+   "test": "react-app-rewired test --env=jsdom",
    "eject": "react-scripts eject"
}

This worked for me but i will remove this when this issue gets fixed. Thanks @bjankord for helping to get to this point.

Using the postcss-assets-webpack-plugin, it allows the postcss plugins to be run on the fully extracted/concatenated stylesheet for the app instead of running postcss on the stylesheets individually. I believe this is a more ideal way to run postcss when importing various stylesheets across an application.
I'm curious if this something the CRA team would consider adding? cc/ @gaearon @jonathantneal @ai

These plugins only work with CSS variables defined on the root. There isn't really a good general solution for this problem but CSS custom properties are widely supported in browsers now so this shouldn't be an issue.


Improve project health

What is the purpose of this Pull Request?
Improve the project health
What was done to achieve this purpose?
Code smells pointed out by prospector was removed/fixed as like some styles that wasn't right according to pep8 style guide
How to test if it really works?
Running prospector -s veryhigh --max-line-length 120  serenata_toolbox, it was pointed out 60 problems, now it is showing 30 (details about later).
Who can help reviewing it?
@lipemorais and anybody who wants it =))
TODO

[x] Remove all code smells showed by landscape
[ ] Remove all code styles pointed by prospector

why i didn't solve the last 30 remaining:
13 invalid-name "df" - I think the readability of "df" is just fine, (i don't have exp) but seems that it is a common practice (maybe change to what_this_df_is_about_df?)
1 invalid-name "s3" - it is literal I think.
1 invalid-name "fh" - I couldn't understand what it means, so I couldn't think a valid name for it.
The other messages was about "too few public methods" and "no self use, could be a function" probably smells for great changes, related to Issue #87.
Landscape pointed out two more things that prospector didn't, list comprehension over filter and map functions, I changed just a map function for readability (I think), list comprehension over filters make it verbose and not more readable (if it seems inconsistency, let me know).
Should I change bump version?

Coverage increased (+0.6%) to 58.14% when pulling 7c8c9182f059ef727506a01bcd7a50eca0786d09 on giovanisleite:master into d6501e2dc5ce3d7d299fd16d659e5fcf1743cf04 on datasciencebr:master.

1 invalid-name "fh" - I couldn't understand what it means, so I couldn't think a valid name for it.

I believe that @cuducos may help us with it.
I believe that it should be just f since it is the file read by aiofiles.read.

Should I change bump version?

Yeah we are trying to have a at least a minor bump version for any change in this project. :)

Ow… another doubt:

Remove all code smells showed by landscape
Remove all code styles pointed by prospector

prospector is the engine running in the backend of Landscape.io, so there should be no difference between these reports. If is there probably we have something missing in our .landscape.yml.

Coverage increased (+0.8%) to 58.278% when pulling d2c46228728d8b9fe8a293613a98693bbeb7ec48 on giovanisleite:master into d6501e2dc5ce3d7d299fd16d659e5fcf1743cf04 on datasciencebr:master.

When did you get the too few public methods? Probably they can be fixed with the @staticmethod decorator. Have you tried? — IMHO this bit doesn't have to do with #87, but the other warning has ; )
pylint complains about classes having less than two public methods and the datasets classes have just fetch as public.
The other complaim, about the no self use, was resolved with your tip, thanks.

prospector is the engine running in the backend of Landscape.io, so there should be no difference between these reports. If is there probably we have something missing in our .landscape.yml.
In fact, on Landspcape.io appeared some "use list comprehension over map and filter" that prospector doesn't show up.

Coverage increased (+28.6%) to 86.093% when pulling ace718d71c7f18ab0b31b00e74a9f8a0c26e966a on giovanisleite:master into d6501e2dc5ce3d7d299fd16d659e5fcf1743cf04 on datasciencebr:master.

Coverage increased (+0.8%) to 58.278% when pulling 78c549916d9d83beca76fb1ed4713ed1f931099b on giovanisleite:master into d6501e2dc5ce3d7d299fd16d659e5fcf1743cf04 on datasciencebr:master.


Lobby: Player room code screen has description text under room code instead of under title header

Match mockups for consistency


jigsaw.w3.org validator is using a webservice for validation

Could be a bottleneck for the future.

This should be disable-able on some level.

Should compilation be allowed when this fails?


ISPN-9843 RocksDBStore should not write entire MarshalledEntry as sto…

…re value
https://issues.jboss.org/browse/ISPN-9843

This will break store compatibility, but that is already going to happen with the pending marshalling changes. Issuing as separate PR for simplicity.

The key is usually much smaller than the value, I was much more interested in getting rid of the separate expiration DB :)
After reading a bit more about RocksDB, however, I'd be happy with just https://issues.jboss.org/browse/ISPN-8242

Yes, using a single db with column families reduces open file descriptors.

Integrated, thanks Ryan!


Internal Logging of Pandomium overwrites handling of my application's LogBack

I use Logback for my application logging, and I've found that when I use Pandomium I'm getting this warning:
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/F:/Development/.m2/org/panda-lang/pandomium/67.0.3/pandomium-67.0.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/F:/Development/.m2/ch/qos/logback/logback-classic/1.2.3/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]

It seems that instead of making your library require SLF4J you are actually embedding it into the jar like it was an application (along with all the other dependencies). This makes it difficult for people who wish to use Pandomium and configure its logging to match our application.
Would it be too much to ask for a simple jar and not a fat jar?

I'm really busy currently, so I'm not able to improve these builds right now - especially that the problem is caused by another library. Consider exclusion of your slf4j implementation for a while, I'll take care of that in the future update.

That's fine, do you have a problem if I clone your repo make a change and
send you a pull request?
On Thu, May 2, 2019, 22:32 Dzikoysk<EMAIL_ADDRESS>wrote:

I'm really busy currently, so I'm not able to improve these builds right
now - especially that the problem is caused by another library. Consider
exclusion of your slf4j implementation for a while, I'll take care of that
in the future update.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/dzikoysk/Pandomium/issues/45#issuecomment-488822043,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAJL2OPTUIZHUKUDVY5IPNLPTNFUNANCNFSM4HKF5TFQ
.

No, any contributions are highly appreciated  ❤

I've checked out the master, but I can't seem to push. Can you give me a branch that I can checkout and push to, then I'll make a pull request for you to review.

You should fork this repository and push your changes to that fork, then you should be able to create pull request :)
~ https://guides.github.com/activities/forking/

Thanks, that's got it working. Not used to working with others in GitHub yet ;)
My fixes have been made in my fork and I've made a pull request. Thanks for the support.

Pandomium 67.0.5 released with your changes :)


Only push completed docker-compose.yml to the relevant repos?

I know how much @MuratUrsavas hates the docker-compose files pushing to this repo and generating lots of noise in commits.
The main reason they were needed was to push them to sub-repos such as https://github.com/NebraLtd/helium-rak
Instead of committing them here, we could perhaps just commit them directly to those repos instead.

Finally 😊


Cognitive Services Speech Service

Hey Team,
Just wondering if the plan is to bring the speech services sdk (currently here: https://github.com/microsoft/cognitive-services-speech-sdk-js) into this new azure-sdk-for-js? And if so what the timeline for it might look like?
Thanks :)

Thanks for the question @JJ11teen
@loarabia Can you share any insights here?

@JJ11teen our plan is to hit most azure services as quickly as we can while ensuring high quality.
Speech is a team we've started discussions with but we have a bit of work to do with them before we can update their library to follow the guidelines and API designs we believe in. They have brought some new scenarios we need to work through API designs for as well as a different architecture in their current SDKs.
I can't give a definite estimate right now what I can say is that we'll file an issue publicly on github for each language with the label Epic that will have Speech in its title and that would be what to look for and track. Similarly, the blog post we release at the middle of each month has a list of SDKs that are Generally Available as well as a set are Preview and you'll see Speech show up there.
Do you have specific requests features you're looking for in speech or something we should explicitly pay attention to when we go deeper there?

Thanks @loarabia, that makes sense. My main concern is around how unclear it was that both this sdk and the speech sdk were current - a lot of the docs refer to this sdk as the place to go for everything Azure in js/ts.
As for feature requests it would be great to have an API for processing a whole file/stream/buffer and (async) returning all detected results, at the moment the speech sdk only supports recognizeOnceAsync(), which stops at the first utterance, and startContinuousRecognitionAsync() which I've managed to use for now but setting up event streaming for a single (fixed length) file seems like overkill 😅
It would also just be great to pull speech into line with all these other API designs you mention, particularly in terms of authorisation (key, endpoint), async > callbacks, and component construction (currently I need to recreate the audioConfig and speechRecognizer with each file).

Hi @JJ11teen thanks for that feedback. I'm sending it over to the Speech team. When we begin work on that item, I will come back and ping you with the github ID for the epic to let you know we've started. We'd love to have feedback on previews once we get going.


Need to convert from synchronously autoloaded extension to ascynchronous for VS2019

When loading this extension in VS2019 there's a warning that it is using a deprecated feature. i.e. loading synchronously instead of asynchronously.
See Microsoft's documentation about this issue.

This is not possible yet, as there's no way to make async-autload native package. See this issue:
https://github.com/MicrosoftDocs/visualstudio-docs/issues/1599
Once it is implemented in VisualStudio, I'll add a branch for VS2019+ to load MicroProfiler asynchronously.

Hi David!
I've added the changes necessary for Visual Studio to load the extension asynchronously. Please, try the latest version - it shouldn't pop the 'deprecated api usage' message.
If you're satisfied with the change - please, close the issue.
thanks,
Artem

All good, no more warning message with version 1.4.606.0 (released on 2019-07-14).


When we try to drag the list item which was on the bottom edges, the rest list item will auto scroll up

This package has external dependencies of react-native-reanimated and react-native-gesture-handler which must be installed separately. Before opening an issue related to animations or gestures please verify that you have completed ALL installation steps, including the changes to MainActivity.
Describe the bug
A clear and concise description of what the bug is.
Please see the attached video, when we try to drag the list item which was on the bottom edges, the behavior shows a little bit weird. The below list item will auto-scroll in the up direction even if I didn't drag it. This could be reproduced when I try the example case.  Thanks in advance if anyone can provide a solution.
To Reproduce
Please see the attached video.

Platform & Dependencies
Please list any  applicable dependencies in addition to those below (react-navigation etc).

react-native-draggable-flatlist version:3.1.2,
Platform:React-native
React Native or Expo version:
Reanimated version: 2.12.0
React Native Gesture Handler version: 2.8.0

Additional context
Add any other context about the problem here.
https://user-images.githubusercontent.com/39889153/199632635-4a1459da-3aa1-48da-a327-af0f197a3928.mov

This does not look like a bug to me. This is the behavior if you took a list item from the middle of the list and dragged it near the bottom and the list will scroll up over time to reveal more places further down the list for the item to be dropped. You picked something up near the bottom, stayed there, so the list thinks perhaps you are wanting to drag it further down.


Retrieving diagnostic meta-data for Assignment-Required diagnostic message

Purpose
$title
Fixes #28123
Approach

Describe how you are implementing the solutions along with the design details.

Samples

Provide high-level details about the samples related to this feature.

Remarks

List any other known issues, related PRs, TODO items, or any other notes related to the PR.

Check List

[x] Read the Contributing Guide
[ ] Updated Change Log
[ ] Checked Tooling Support (#)
[ ] Added necessary tests

[ ] Unit Tests
[ ] Spec Conformance Tests
[ ] Integration Tests
[ ] Ballerina By Example Tests

[ ] Increased Test Coverage
[ ] Added necessary documentation

[ ] API documentation
[ ] Module documentation in Module.md files
[ ] Ballerina By Examples

@dulajdilshan The commit messages and PR heading is not according to the best practices. Please correct them.

[1] https://github.com/ballerina-platform/ballerina-lang/blob/master/CONTRIBUTING.md#submit-your-contribution

@dulajdilshan The commit messages and PR heading is not according to the best practices. Please correct them.

[1] https://github.com/ballerina-platform/ballerina-lang/blob/master/CONTRIBUTING.md#submit-your-contribution

I'll change. Thanks


Do not kick any molecule nor e2e job on .md editions

Until now, even if we were only editing .md files (aka doc), we would
end with at least the end-to-end-nobuild job running and, if we were
editing a role README.md, we'd see its molecule job being kicked.
This patch ensures zuul won't be triggered on .md nor on /docs/
modifications, meaning less load and time on zuul infra.

/hold
While testing this patch with a depends-on from #193 molecule still kicks in with README.md modifications... Need to modify a bit things I guess.

/unhold
actually, it's working as it should - since this patch edits zuul.d/molecule-base.yaml, it kicks all of the

/approve
It's been actively tested in #193 - and we can already see the benefits in that patch: far, far less jobs are being kicked. We may need to iterate a bit more but, as-is, this patch is helping a lot already.

recheck


Docker hub image for ARM64 and ARMv7

Maybe someone need that for their single board computer. Also, ARM64 servers are getting cheap.

Implemented in this job: https://github.com/ngxson/portainer-ce-without-annoying/actions/runs/5024060021/jobs/9009365733


Not receiving pong after sending ping

 private Runnable runnable = new Runnable() {
        @Override
        public void run() {
            socket.emit("ping");
            Log.v(TAG,"ping");
            handler.postDelayed(this, 15000);
        }
};

socket.on("connect", args -> {
     Log.v(TAG,"Socket Connected");
     handler.postDelayed(runnable, 15000);
});

socket.on("pong", args ->{
     Log.v(TAG,"pong");
});

Not receiving pong after i send a ping or may be my approach is not correct.

I have sem problem please give me a solution

my socket in the above program can't receive msg

for socket io library version 2 and below
event "manager.EVENT_PING" works fine.
But not with Version 2 and above. Because there are some problems reports from users experiencing random disconnections due to ping timeouts and actually this feature is very useful and should be reappeared. because for some things this feature is needed for application projects.
i did a search on the internet and found this reference Heartbeat mechanism reversal


[rt.openssl.org #4160] Candidate bug, malloc failure related issues in s3_enc.c, hm_pmeth.c

Migrated from rt.openssl.org#4160 (status was 'open')
Requestors:

<EMAIL_ADDRESS>
From<EMAIL_ADDRESS>on 2015-11-29 11:09:35:
Hi folks,

Can I ask about malloc failure handling issues, seems affecting OpenSSL 1.0.1p and 1.0.2d,

1. In s3_enc.c::ssl3_digest_cached_records, we have the below code.

    s->s3->handshake_dgst =
        OPENSSL_malloc(SSL_MAX_DIGEST * sizeof(EVP_MD_CTX *));
    memset(s->s3->handshake_dgst, 0, SSL_MAX_DIGEST * sizeof(EVP_MD_CTX *));

We are not checking for the return value of the malloc resulting in a straight null dereference in the memset.

2. In hm_pmeth.c::pkey_hmac_cleanup

    HMAC_PKEY_CTX *hctx = ctx->data;
    HMAC_CTX_cleanup(&hctx->ctx);

Using hctx when it can be NULL. We could have failed to allocate ctx->data in int_ctx_new which calls pmeth->init (alloc can return error here).

Thanks
Trev

From<EMAIL_ADDRESS>on 2015-11-29 22:39:00:
On Sun, Nov 29, 2015 at 11:09:35AM +0000, Trevor Larock via RT wrote:
> Hi folks,
>
> Can I ask about malloc failure handling issues, seems affecting OpenSSL 1.0.1p and 1.0.2d,
>
> 1. In s3_enc.c::ssl3_digest_cached_records, we have the below code.
>
>     s->s3->handshake_dgst =
>         OPENSSL_malloc(SSL_MAX_DIGEST * sizeof(EVP_MD_CTX *));
>     memset(s->s3->handshake_dgst, 0, SSL_MAX_DIGEST * sizeof(EVP_MD_CTX *));
>
> We are not checking for the return value of the malloc resulting in a straight null dereference in the memset.

That seems to be fixed in the master branch.

> 2. In hm_pmeth.c::pkey_hmac_cleanup
>
>     HMAC_PKEY_CTX *hctx = ctx->data;
>     HMAC_CTX_cleanup(&hctx->ctx);
>
> Using hctx when it can be NULL. We could have failed to allocate ctx->data in int_ctx_new which calls pmeth->init (alloc can return error here).

So when pmeth->init() fails it calls EVP_PKEY_CTX_free(), which
calls ctx->pmeth->cleanup().

I'm guessing there are other cleanup / free functions that don't
really expect to get called when init / new failed.  At least
ossl_hmac_cleanup() looks to have the same problem, while things
like pkey_ec_cleanup(), pkey_dh_cleanup() and pkey_rsa_cleanup()
look good.

Kurt

The first issue is fixed in 1.0.2-stable,
the second issue will be fixed with PR #2127.


Investigate the Many Actions Related Failures

There are a lot of ❌s out there in Actions land.

Eslint, Tests and Coverage and Release all seem to be perpetually red.

It's weird because npm ci fails repeatedly even after the package-lock.json has been rebuilt manually. I am pushing dependency updates with freshly generated dependency information and npm ci still fails. It's something to go on, but it doesn't make sense, on the surface.

Okay!
So, in the "Test and Coverage" build for chore(deps): bump npm from 8.13.1 to 8.13.2 it fails with the following:
npm ERR! `npm ci` can only install packages when your package.json and package-lock.json or npm-shrinkwrap.json are in sync. Please update your lock file with `npm install` before continuing.

But running npm ci on the same branch in codespaces is nicey nicey
@roblarsen ➜ /workspaces/create-html5-boilerplate (dependabot/npm_and_yarn/npm-8.13.2) $ npm ci

added 854 packages, and audited 1055 packages in 20s

112 packages are looking for funding
  run `npm fund` for details

found 0 vulnerabilities
@roblarsen ➜ /workspaces/create-html5-boilerplate (dependabot/npm_and_yarn/npm-8.13.2) $

I'm confused, but I've been confused before!

Okay! So it looks like it's a mismatch between versions of node. Using a package-lock generated in a lower version of node caused the issues in the Eslint job. I'll continue to investigate in #305

It's definitely a mismatch between the version numbers. "tests and coverage" actually fails now, because it's failing. It's actually run however. It just used to die.


Good First Issue: Improve README

Good First Issue: Improve README
Background
The current README file provides an overview of Shuru but lacks depth and polish. To make the project more approachable for new users, the README should be improved with more detailed explanations, usage examples, and a clearer structure.
Task

Enhance Project Introduction: Provide a more comprehensive explanation of what Shuru does and why it’s useful.
Add Usage Examples: Show clear, step-by-step examples of how to configure and use Shuru for different types of projects (Node.js, Python, etc.).
Improve Installation Instructions: Ensure the installation steps are clear and easy to follow.
Add Badges: Include helpful badges (e.g., for CI status, version, license) at the top of the README.

Steps to Complete:

Update the README with more detailed information and examples.
Add badges for status, version, and license if available.
Make the usage section more beginner-friendly by explaining each step clearly.

would love to work on it can u assign me this

Hi @prxjwal, I’ve assigned this task to you. Also, please give the repo a star and join our Discord server if you need support or want to participate in our Hacktoberfest challenge.

Closed with: https://github.com/shuru-project/shuru/pull/23


Rewrite documentation in mkdocs

preview of what this would look like: https://bdpedigo.github.io/CAVEclient/

I think this is good to go except for changing github paths etc. in mkdocs.yml. will wait to do that until any other feedback is done


MeWatch site unable to download

Checklist

[x] I'm reporting a broken site support
[x] I've verified that I'm running youtube-dl version 2020.12.26
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar issues including closed ones

Verbose log

[generic] Recipe-Of-Life-E41-189759: Requesting header
WARNING: Falling back on generic information extractor.
[generic] Recipe-Of-Life-E41-189759: Downloading webpage
[generic] Recipe-Of-Life-E41-189759: Extracting information
ERROR: Unsupported URL: https://live.mewatch.sg/watch/Recipe-Of-Life-E41-189759

Description

Unable to download from the site MeWatch
https://live.mewatch.sg/watch/Recipe-Of-Life-E41-189759

欢迎新人加入QQ群:972802757免费看新剧！电脑和手机都能下载新剧，除了加密视频外。密码：meWATCH。


Prepare data

[x] Select original file to use (GE Images- they are from 2017?; already ortho-rectified)

[ ] Select a ROI and crop; rasterize the image

[ ] Generate raster binary mask from the shape file corresponding to the ROI

Image "Merged.tiff" comprising of tiles 1-100 from the GE Images will be used.

The ROI is defined by:
Point 1 (x,y):<PHONE_NUMBER>22, 1447381.43582)
Point 2 (x,y):<PHONE_NUMBER>53, 1445528.51118)

ROI and clipping done by Debraj.

See how-to in notes.txt.


Fix modules exposure

Codecov Report

Merging #20 (e3cb844) into master (13c1f40) will increase coverage by 0.06%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master      #20      +/-   ##
==========================================
+ Coverage   91.33%   91.40%   +0.06%
==========================================
  Files           6        6
  Lines         254      256       +2
  Branches       33       33
==========================================
+ Hits          232      234       +2
  Misses         20       20
  Partials        2        2

Impacted Files
Coverage Δ

src/Listboxkit.bs.js
100.00% <100.00%> (ø)


Remove "creationTimestamp" fields from generated CRD yaml files

Due to https://github.com/kubernetes-sigs/controller-tools/issues/402, our generated CRD yaml files contain the "creationTimestamp: null" filed. This field is automatically generated by Kubernetes and should not be part of CRD yaml files.
As result, operate-first validation fails.
Please add a step to the make manifests rule, to remove these fields.

fixed by  #1688


Intermittently failing noise model test.

Describe the bug
The apply noise model test fails intermittently on CI, only on OSX:
apply: Test Failed at /Users/runner/work/Braket.jl/Braket.jl/test/noise_model.jl:132
  Expression: noisy_circuit_from_circuit.instructions == expected_circuit.instructions
   Evaluated: Instruction[Instruction(Depolarizing(0.09), QubitSet(0)), Instruction(H(), QubitSet(0)), Instruction(Depolarizing(0.04), QubitSet(0)), Instruction(PauliChannel(0.06, 0.07, 0.08), QubitSet(0)), Instruction(CNot(), QubitSet(0, 1)), Instruction(TwoQubitDepolarizing(0.05), QubitSet(0, 1)), Instruction(Unitary(ComplexF64[0.7071067811865475 + 0.0im 0.7071067811865475 + 0.0im; 0.7071067811865475 + 0.0im -0.7071067811865475 + 0.0im]), QubitSet(0)), Instruction(Depolarizing(0.1), QubitSet(0)), Instruction(Depolarizing(0.06), QubitSet(0))] == Instruction[Instruction(Depolarizing(0.09), QubitSet(0)), Instruction(H(), QubitSet(0)), Instruction(Depolarizing(0.04), QubitSet(0)), Instruction(Depolarizing(0.04), QubitSet(0)), Instruction(CNot(), QubitSet(0, 1)), Instruction(TwoQubitDepolarizing(0.05), QubitSet(0, 1)), Instruction(Unitary(ComplexF64[0.7071067811865475 + 0.0im 0.7071067811865475 + 0.0im; 0.7071067811865475 + 0.0im -0.7071067811865475 + 0.0im]), QubitSet(0)), Instruction(Depolarizing(0.1), QubitSet(0)), Instruction(Depolarizing(0.06), QubitSet(0))]

To reproduce
Seemingly cannot reproduce this locally.
Expected behavior
Test should pass as it does on my local OSX laptop, and on Ubuntu and Windows.
Screenshots or logs
Failing jobs log.
System information
A description of your system. Please provide:

Julia version: 1.8
Braket.jl version: 0.2.0
OS and CPU arch: OSX & x86

Additional context
Have only ever observed this on Github CI which makes it very difficult to repro.

This seems to have stopped occurring (probably due to fixing the method piracy) so I'll close this for now.


it doesnt work

Uncaught (in promise) InvalidPageUrlError: Url "https://vladkrutenyuk.notion.site/Blog-Post-9173b6a515c54ad6bc9738f0001cd9af" is not a valid notion page.

it doesnt work even with your link

Hi, @vladkrutenyuk. Your given page is not public. Pages must be public to be fetched, also notion-page-to-html is a NodeJS tool, so it should not be used in the browser. That is why you are facing node-http-post-client error. Both informations can be found in the README.md file. Closing it by now.


TS: Question accessing DEVICE_ORIENTATION

Hello,
I have managed to implement the methods presented in the TypeScript sample, thank you so much.
https://github.com/Samsung/tizen-common-web/blob/4ac6fdacbc9bb100cc37225f99bb3a442a8450c6/samples/typescript/src/main.ts#L14
However I cannot seem to write the proper callback for DEVICE_ORIENTATION :( 🥇 :
import { productinfo, appcommon } from 'tizen-tv-webapis';
import { systeminfo } from 'tizen-common-web';

export const runOnBrowser = false;

const { setScreenSaver, AppCommonScreenSaverState } = appcommon;
const { getCapability, getPropertyValue } = systeminfo;

ngOnInit() {
      // WORKS:
      setScreenSaver(AppCommonScreenSaverState.SCREEN_SAVER_OFF, () => {
          this.updateInformation(
              'screensaver',
              `ScreenSaver has turned off, parameter value is ${AppCommonScreenSaverState.SCREEN_SAVER_OFF}`
          );
      });

      // DOES NOT WORK:
      getPropertyValue('DEVICE_ORIENTATION', (deviceOrientation) => {
        this.updateInformation(
          'orientation',
          `ScreenSaver has turned off, parameter value is ${deviceOrientation.status}`
        );
      });

  updateInformation(id: string, content: string) {
      const valueElement = document.getElementById(id);
      if (!valueElement) {
          return;
      }
      valueElement.innerHTML = content;
      console.log(content);
  }

}

Can you provide some more samples or help for more advanced API usage?
Thank you!

HTML
I am using the html div from the index.html sample in the TypeScript folder of this repo:
https://github.com/Samsung/tizen-common-web/blob/4ac6fdacbc9bb100cc37225f99bb3a442a8450c6/samples/typescript/index.html#L28

                DEVICE_ORIENTATION

@ionescu77
Hi I'm sejoong.
I test your code in my TV device(Tizen version 6.0), it works well.
Can you share your device information and the version of the npm package?

$ npm list --depth=0
<EMAIL_ADDRESS>D:\workspace\tsfy\tizen-common-web\samples\typescript
+--<EMAIL_ADDRESS>+--<EMAIL_ADDRESS>+--<EMAIL_ADDRESS>+--<EMAIL_ADDRESS>+--<EMAIL_ADDRESS>+--<EMAIL_ADDRESS>+--<EMAIL_ADDRESS>+--<EMAIL_ADDRESS>-> D:\workspace\tsfy\tizen-common-web
+--<EMAIL_ADDRESS>+--<EMAIL_ADDRESS>+--<EMAIL_ADDRESS>+--<EMAIL_ADDRESS>`--<EMAIL_ADDRESS>
In my case, the package version  are '<EMAIL_ADDRESS>and<EMAIL_ADDRESS>

And also please check if you've already run build webpack before launching your application.
"npm run webpack"

Hello,
thank you:
@prozanne  Yup I run the webpack, build the wgt and then install and start it on the emulator.
@SejoongDeJang
Here is my npm (is a bit more extensive because I am using this in angular)
npm list --depth=0
<EMAIL_ADDRESS>/Users/razvansky/myProjects/mm-tizen-angular
├── __ngcc_entry_points__.json@ extraneous
├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>└──<EMAIL_ADDRESS>
It seems it is more like a problem accessing variables in TypeScript call-backs.
Can you actually see the deviceOrientation.status in the html?
Really some more complex examples for FileSystem API or Alarm API for TypeScript would be so great :(

Hi @ionescu77
getPropertyValue( 'DEVICE_ORIENTATION',  (deviceOrientation: SystemInfoDeviceOrientation) => {
        console.log(deviceOrientation);
        updateInformation('orientation', `${deviceOrientation.status}`
        );
    }
);

Here is my working code. Compare to your code, I figure out you don't declare type of the callback.
So I guess your problem is occurred because of the callback. And the key is the SystemInfoPropertyType, which is the first parameter of  SystemInfoPropertySuccessCallback, is a intersection type.
export interface SystemInfoPropertySuccessCallback {
    (property: SystemInfoPropertyType): void;
}

export type SystemInfoPropertyType = SystemInfoBattery & SystemInfoCpu & SystemInfoStorage & SystemInfoStorageUnit & SystemInfoDisplay & SystemInfoPanel & SystemInfoDeviceOrientation & SystemInfoBuild & SystemInfoLocale & SystemInfoNetwork & SystemInfoWifiNetwork & SystemInfoEthernetNetwork & SystemInfoCellularNetwork & SystemInfoNetProxyNetwork & SystemInfoPeripheral & SystemInfoMemory & SystemInfoVideoSource ;

And I want to know what is the 'complex example'? Tell me the exactly API name, then we follow up your developing.

Hello @SejoongDeJang
I managed to get the callback to work!
Nice observation indeed, about the callback. Thank you.
          tizen.systeminfo.getPropertyValue('DEVICE_ORIENTATION', (e: any) => this.ngZone.run(() => {
            this.updateInformation(
              'orientation',
              e.status
            );
            console.log('Dev orientation: ', e.status);
            // this will update the global devOrientation variable
            this.devOrientation = e.status;
        }));

By complex example is tizen.download. I do not manage to get it working in my Angular 11 project.
I think this also has to do with nagular/typescript, because I have difficulties translating the js examples from ther Tizen Documentation :(.
Example Download API - js
For example this looks pretty straight forward:

javascript (found on the devforum, and similar to the official Tizen API download documentation examples:

var contentdownload = function () {
   var url = 'https://dwdvhqfdmesuz.cloudfront.net/5bb5b552ab41a237a95db866/5bb5b618ab41a237a95db86b.jpeg';

    var download_api_capability = tizen.systeminfo.getCapability("http://tizen.org/feature/download");
    var wifi_capability = tizen.systeminfo.getCapability("http://tizen.org/feature/network.wifi");

    var listener = {
        onprogress: function(id, receivedSize, totalSize) {
            console.log('Received with id: ' + id + ', ' + receivedSize + '/' + totalSize);
        },
        onpaused: function(id) {
            console.log('Paused with id: ' + id);
        },
        oncanceled: function(id) {
            console.log('Canceled with id: ' + id);
        },
        oncompleted: function(id, path) {
            console.log('Completed with id: ' + id + ', path: ' + path);
        },
        onfailed: function(id, error) {
            console.log('Failed with id: ' + id + ', error: ' , error); // returning error
        }
    };

var downloadRequest = new tizen.DownloadRequest(url, "Downloads");
var downloadId = tizen.download.start(downloadRequest, listener);

Convert to Typescript - no succes
No succes in implementing the listener and start the download request

downloadFile() {
    var url = 'http://<IP_ADDRESS>:7979/media/poster_sample.png';

    const download_api_capability = tizen.systeminfo.getCapability("http://tizen.org/feature/download");

    var listener = {
        onprogress: function(id, receivedSize, totalSize) {
            console.log('Received with id: ' + id + ', ' + receivedSize + '/' + totalSize);
            this.updateInformation("downloads", "download id: "+ id + ", " + receivedSize + "/" + totalSize);
        },
        onpaused: function(id) {
            console.log('Paused with id: ' + id);
        },
        oncanceled: function(id) {
            console.log('Canceled with id: ' + id);
        },
        oncompleted: function(id, path) {
            console.log('Completed with id: ' + id + ', path: ' + path);
            this.updateInformation("downloads","Completed id: " + id + ", path: " + path);
        },
        onfailed: function(id, error) {
            console.log('Failed with id: ' + id + ', error: ' , error); // returning error
            this.updateInformation("downloads","Failed witg id: " + id + ", error: " + error);
        }
     };

    var downloadRequest = new tizen.DownloadRequest(url, "downloads");
    var downloadId = tizen.download.start(downloadRequest, listener);

Obviously I am missing again some guidance about TypeScript implementation :(
Thank you,
Raz

@ionescu77 Here is my download request code.
try {
    // Checks whether Download API is supported on a device.
    var download_api_capability = systeminfo.getCapability(
        'http://tizen.org/feature/download'
    );
    if (download_api_capability === false) {
        console.log('Download API is not supported on this device');
    }
    console.log(`start download test`);

    var listener = {
        onprogress: function(
            id: number,
            receivedSize: number,
            totalSize: number
        ) {
            console.log(
                'Received with id: ' +
                    id +
                    ', ' +
                    receivedSize +
                    '/' +
                    totalSize
            );
        },
        onpaused: function(id: number) {
            console.log('Paused with id: ' + id);
        },
        oncanceled: function(id: number) {
            console.log('Canceled with id: ' + id);
        },
        oncompleted: function(id: number, path: string) {
            console.log('Completed with id: ' + id + ', path: ' + path);
        },
        onfailed: function(id: number, error: WebAPIError) {
            console.log(
                'Failed with id: ' + id + ', error name: ' + error.name
            );
        }
    };

    // Starts downloading the file from the Web with the corresponding callbacks.
    var downloadRequest = new DownloadRequest(
        'http://download.tizen.org/tools/README.txt',
        'documents'
    );
    var downloadId = download.start(downloadRequest, listener);
    console.log('downloadId :', downloadId);
} catch (error) {}

I wonder what is your editor. I think your question is related with syntax error of the typescripts. So I suggest set up vs code with this article, then you can easily inspect the syntax error.
And we discuss about uploading our typescript TC. It include whole usage of APIs.

Thank you for comming back to me.
I have an angular 11 project where I tried to implement as TypeScript, I am using Visual Studio Code with the Tizen extension.
I will give it a try.
I will find time and setup a public repo for the future to help others, too.

Hello @SejoongDeJang , the code which work for me in angular 11
    var listener = {
        onprogress: (id, receivedSize, totalSize) => {
            console.log('Received with id: ' + id + ', ' + receivedSize + '/' + totalSize);
            this.updateInformation("downloads", "download id: "+ id + ", " + receivedSize + "/" + totalSize);
        },
        onpaused: (id) => {
            console.log('Paused with id: ' + id);
        },
        oncanceled: (id) => {
            console.log('Canceled with id: ' + id);
        },
        oncompleted: (id, path) => {
            console.log('Completed with id: ' + id + ', path: ' + path);
            this.updateInformation("downloads","Completed id: " + id + ", path: " + path);
        },
        onfailed: (id, error) => {
            console.log('Failed with id: ' + id + ', error: ' , error); // returning error
            this.updateInformation("downloads","Failed with id: " + id + ", error: " + error);
        }
     };

  // some other code, then

             var downloadRequest = new DownloadRequest(url,"downloads");
             var downloadId = download.start(downloadRequest, listener);

It is pretty similar, please note the "arrow functions", () => {} maybe Angular needs them to pass the correct context, or event!?
Thank you for your help.
Best regards,
Raz


Failed to upgrade to timefold from optaplanner

Describe the bug
I tried to upgrade to timefold from optaplanner following this guide: https://timefold.ai/blog/optaplanner-fork#upgrade-from-optaplanner-to-timefold
However, it failed. There is some issue with openwrite.
[INFO] Using active recipe(s) [ai.timefold.solver.migration.ToLatest]
[INFO] Using active styles(s) []
[INFO] Validating active recipes...
[INFO] Project [scheduling-interviews-optaplanner] Resolving Poms...
[WARNING] Failed to access maven repository https://maven.java.net/content/repositories/snapshots
javax.net.ssl.SSLHandshakeException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target

It failed to download required dependencies.
This cmd sounds not working: mvn org.openrewrite.maven:rewrite-maven-plugin:5.30.0:run -Drewrite.recipeArtifactCoordinates=ai.timefold.solver:timefold-solver-migration:1.10.0 -Drewrite.activeRecipes=ai.timefold.solver.migration.ToLatest
The issue on Openwrite: https://github.com/openrewrite/rewrite/issues/4101
We need another approach to upgrade to timefold if the approach above doesn't work.
Expected behavior
Describe clearly and concisely what you expected to happen.
Actual behavior
Describe clearly and concisely what actually happened.
To Reproduce
Link to a small reproducer or attach an archive containing the reproducer to the issue.
Alternatively, provide clear and concise steps to reproduce the behavior.
Environment
Timefold Solver Version or Git ref:
Output of java -version:
Output of uname -a or ver:
Additional information
Provide any and all other information which might be relevant to the issue.

Thanks. I will try manually upgrade.


fix: Build Inventory UI links to proper location

Rather just update this to refer people to installation tbh

Updated


channel snapshot_solo transaction

PT: Add single-signed state channel snapshot tx
Most notable thing would be the proposal of the refactoring in FSM_SUITE

Left to do

[ ] Bump DB version

[ ]  Add a line in release notes

[ ] Make more happy path tests to make sure a snapshot can be posted after a withdrawal/deposit/snapshot

I see corresponding protocol PR https://github.com/aeternity/protocol/pull/129 is merged.

@lucafavatella

I see corresponding protocol PR aeternity/protocol#129 is merged.
No. The snapshot is a distinct new transaction type and has nothing to do with solo close (and aeternity/protocol#129 for that matter). Corresponding protocol PR is cooking

Only protocol repo changes are pending but those are not in the scope of this PR. Removing the WIP label

Missing:

Creation of snapshot_solo_tx through the API.
Tests of the above API in aehttp_integration_SUITE

Other than that, it looks good.
Very good refactoring of aesc_fsm_SUITE.erl

Addressed the aec_id comment, left to address the endpoint one

Added the missing convience endpoint with corresponding tests


Fix tagToMutinyTag ts error

Fixed the TS error, not sure if you're fans or haters of switch though, of course will change to ifs if preferred.
But one weird thing is that the type of kind is supposed to be a number in the input and a string in the output. Either the input is badly typed or there might be some bugs in the app you use kind somewhere since the return type was lying to you until now
I'll edit this PR after I check which one it is
EDIT: Kind of overwhelmed for now by the codebase, I'll need some time to figure how to pass through this function and print a console.log (to know what's in the original tag.kind)

yeah tbh our typescript story is a little hacky. sometimes we get really good types from the wasm-bindgen, but some rust types have to be exported as a js any so I create these dummy types for them. long term it would be nice to have the source of truth for types like this in the mutiny-wasm project, or at least one spot inside the mutiny-web project
oh IRT console.log: for some complex structs we actually get a pointer, not a normal js object, so you can't print them. we try to add a .value() method to types so they can be printable, but haven't been super consistent I'm sure
I've also noticed weirdness with an enum type from rust "lying" about what it is
here's the mutiny-wasm code for reference:
https://github.com/MutinyWallet/mutiny-node/blob/master/mutiny-wasm/src/models.rs#L632
my guess in this case the hackiness resulted because I want to switch on a string, but under the hood the TagKind enum is encoded as a number

Thank you for the insight, very informative !
I actually saw the enum at the very top of: /node_modules/.pnpm/@mutinywallet+mutiny-wasm<EMAIL_ADDRESS>So the types aren't wrong for this, it's just the testing if it's really a number that I couldn't do


"The following plugin is ready to update: Require.js plugin" unable to update

Probably related to #41:  PHPStorm 8.0.3 keeps on displaying this notification. Updating the plugin does not work. Theres nothing in the event log besides:
 10:34:38 Update Info: The following plugin is ready to update: Require.js plugin

Hi!
For fix this problem you can install plugin from file https://github.com/Fedott/WebStormRequireJsPlugin/raw/master/requirejs-since-build-139.jar
This version special builded for old version IDEA platform, and should work on you.
In this moment I dont know how build plugin for any version IDEA platform.

PHPStorm 8.0.3 is the current stable release, which display this notification. Maybe some other developer could tell you how to make two release channels, one for stable and one for beta? Because I get this notification every time I start my PHPStorm, and it annoys me.

For fix your problem:
Download file https://github.com/Fedott/WebStormRequireJsPlugin/raw/master/requirejs-since-build-139.jar
In PhpStorm open Settings -> plugins, click install plugin from disk, select downloaded file, and click "ok"
After this actions you will not get this notification.


Revel on App Engine

Is it possible to run Revel on top of app engine ?? Would be really awesome !

:+1:
Any progress here?

@wlaurance bringing this thread back from the dead, is there anything you have learned regarding Go/Revel and GAE? I'm sure others would appreciate sharing your experience.

Greetings folks!  I know this is a bit of an old thread, but I wanted to let you know I wrote a post on how to run revel on AppEngine.  It takes advantage of the new Managed VM feature:
http://jbeckwith.com/2015/05/08/docker-revel-appengine/

@JustinBeckwith great contribution! @anonx added it to our Articles wiki page. Thanks!
PS - I'd love your feedback on Revel once you try some of the other frameworks and anti-frameworks :)


feat(DATAHUB-198): project info section

This PR adds a component that renders project infos in the user's personal space.
The component includes a title, a category, a description text and two links:

a link to a "edit project" page
a link to the project page that is visible to the non-authenticated world

:tada: This PR is included in version 1.0.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


docs: add information about consolidateAfter not working with WhenUnderutilized

Description
This adds documentation about the consolidateAfter configuration for NodePools not being available when consolidationPolicy: WhenUnderutilized is set.
How was this change tested?
Does this change impact docs?

[x] Yes, PR includes docs updates
[ ] Yes, issue opened: #
[ ] No

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.02%) to 82.271%

Totals

Change from base Build<PHONE_NUMBER>:
0.02%

Covered Lines:
5332

Relevant Lines:
6481

💛  - Coveralls


Can you run ip-adapter sdxl using Colab's free tier?

I have tried running it but always run into memory issues and it terminates at this part - IPAdapterXL(pipe, image_encoder_path, ip_ckpt, device)
Even though loading the model with StableDiffusionXLPipeline.from_pretrained works fine. I also tried using accelerate but still face issues. Does this mean it's not possible to run it on Colab's free tier?

@putuoka hi, do you also test the Colab demo of SD1.5? As SDXL is larger and we also use a larger CLIP model (ViT-bigG), it needs more resources.

@putuoka hi, do you also test the Colab demo of SD1.5? As SDXL is larger and we also use a larger CLIP model (ViT-bigG), it needs more resources.

I have tried that all of your Colab demos do not work well. They need additional code provided by @Lucascoolsouza in this Github post: https://github.com/tencent-ailab/IP-Adapter/issues/11
I have created a working Colab notebook for Stable Diffusion 1.5 on the free tier based on those fixes: https://colab.research.google.com/drive/1JmLhgfq7EYDjytBGQCg5o1F7NLSRk9Dn
just need to click runtime > run all
This Colab notebook runs Stable Diffusion 1.5 smoothly, but I am still facing memory limitations when trying to run the much larger SDXL model on Colab's free resources.

@putuoka thinks a lot, can you give a pr to fix the Colab demo?

@putuoka hi, do you also test the Colab demo of SD1.5? As SDXL is larger and we also use a larger CLIP model (ViT-bigG), it needs more resources.

I have tried that all of your Colab demos do not work well. They need additional code provided by @Lucascoolsouza in this Github post: #11
I have created a working Colab notebook for Stable Diffusion 1.5 on the free tier based on those fixes: https://colab.research.google.com/drive/1JmLhgfq7EYDjytBGQCg5o1F7NLSRk9Dn
just need to click runtime > run all
This Colab notebook runs Stable Diffusion 1.5 smoothly, but I am still facing memory limitations when trying to run the much larger SDXL model on Colab's free resources.

the limitation of not running the sdxl kinda happens because this is not running with xformers.

@putuoka hi, do you also test the Colab demo of SD1.5? As SDXL is larger and we also use a larger CLIP model (ViT-bigG), it needs more resources.

I have tried that all of your Colab demos do not work well. They need additional code provided by @Lucascoolsouza in this Github post: #11
I have created a working Colab notebook for Stable Diffusion 1.5 on the free tier based on those fixes: https://colab.research.google.com/drive/1JmLhgfq7EYDjytBGQCg5o1F7NLSRk9Dn
just need to click runtime > run all
This Colab notebook runs Stable Diffusion 1.5 smoothly, but I am still facing memory limitations when trying to run the much larger SDXL model on Colab's free resources.

the limitation of not running the sdxl kinda happens because this is not running with xformers.

I attempted to enable memory efficient attention in IP Adapter using Xformers as follows:
pipe = pipe.to("cuda")
pipe.enable_xformers_memory_efficient_attention()

However, this did not reduce the memory usage as expected. It appears modifications directly to the ip_adapter.py Python code may be needed to implement Xformers optimization properly when running in Google Colab.
I also tried modifying the Python code even though I didn't really know what I was doing LOL. I added enable_xformers_memory_efficient_attention() in all the places with the word "device" LOL

@putuoka hi, the CLIP-ViT-G has 1.8B parameters, so it needs large GPU memory.

hi, we have updated a new version of SDXL, which uses CLIP-ViT-H, hence it uses less GPU memory


Codeium failed to start on windows 11

Error detected while processing function codeium#server#Start[36]..40_ActuallyStart:
line   16:
E903: Process failed to start: unknown error: "C:\Users\Xenon/.codeium/bin/9f90299b936d762be496ee01acc3ff2db68b8ae5/language_server_windows_x64.exe"
Press ENTER or type command to continue
I am using Windows powershell 7.3 and Lazyvim but I get this error from Codeium whenever I launch nvim. I've updated treesitter and codeium to their latest but still got this issue. Please help!

If you delete the file and try again what happens? Are you on x64?

If you delete the file and try again what happens? Are you on x64?

I got the same issue. I'm on x64 and windows 11 and I delete the file. When I try again the error didn't show up but codeium alse didn't work. When I launch Nvim again the file show up again and the error came back? How can i fix this?

If you delete the file and try again what happens? Are you on x64?

It worked for me.

@XenoCode54 have you been able to fix this?


Update product version to 1.2.1-GA

Current coverage is 77.47% (diff: 100%)

No coverage report found for 1.2.X at 0d979ec.

Powered by Codecov. Last update 0d979ec...ac260f5

test thsi

test this

test this

test this


feat: add missing editor icons

closes #1229

As discussed, this PR contains adding icons to the following substation plugin editors:

Line
Process
Substation
Transformer winding
Bay
Voltage level

Thanks for your review @pascalwilbrink!
I agree, the styles variable should take care of the styling. I added a CSS class to the styles and made these icons part of that class. I also included the other editors in for the substation plugin that had this inline styling.

Is this feature already released on openscd.github.io?

@Sander3003 currently the workflow for releasing to openscd.github.io is broken, I attempted a fix last week but it missed one detail, I already identified the missing bit and successfully deployed with the same workflow in my personal fork of openscd (juancho0202.github.io). I will talk to @trusz today about it and see if we can merge the new fix.


Fix critical CVEs for releases v1.14.0 v1.14.1

Overview
Upgrade go version to the 1.23.1 in the base images to avoid critical CVEs

We don't plan to update old deps if we depend on a specific commit or backward compatibility is not supported by the new version. This work should be done in the separate PRs.


feat(v2): csv command gets license remote URLs

NOTE, please review https://github.com/google/go-licenses/pull/94 and #95  first!
This PR is based on them.
Before #94 and #95 is merged, review this PR by visiting https://github.com/google/go-licenses/commit/e1a4261ab30922cf42fa6a89bc672ce5bec08a8d.

This PR is obsolete

superseded by #94


Sweep overlays and modals for consistency.

We should sweep all code relating to modals and popups to see if they can use more modern overlay classes, and we should see if there are related CSS cleanups (DRY, etc.) that we can do.
Be careful about claiming this issue for yourself; this may be a group effort, and we should coordinate it carefully.  We can use this ticket to track ongoing efforts and record decisions about what we think the best going-forward approaches should be.

See also #2836, which this replaces.

@zulipbot claim.


[FromUri] and complex types not prefixed correctly.

Hello,
when creating a swagger from a http GET method that uses several [FromUri] complex types the argument names are not prefixed correctly.
E.g. I have a complex type Period:
Public Class Period
Public Property Start As DateTime = DateTime.MinValue
Public Property [End] As DateTime = DateTime.MaxValue
End Class
And a controller method
public IHttpActionResult GetAppointments(int? agendaId = null, int? departmentId = null,
[FromUri]ExternalId externalId = ExternalId.Empty,
[FromUri]Period startTimeSearchPeriod = null,
[FromUri]Period endTimeSearchPeriod = null,
int? ticketNumber = null, ConditionFlags? conditions = null, bool includeReferences = false)
{
return RunUnitOfWork(new GetAppointments(this.Db, agendaId, departmentId, externalId, startTimeSearchPeriod, endTimeSearchPeriod, ticketNumber, conditions, includeReferences));
}
This should result in a swagger (SwashBuckle) with arguments
{
name: "searchPeriod.start",
in: "query",
required: false,
type: "string",
format: "date-time"
},
{
name: "searchPeriod.end",
in: "query",
required: false,
type: "string",
format: "date-time"
},
However, NSWAG gives:
{
"type": "string",
"name": "Start",
"in": "query",
"x-nullable": false,
"description": "The start of the period. Minimum time as default",
"format": "date-time"
},
{
"type": "string",
"name": "End",
"in": "query",
"x-nullable": false,
"description": "The end of the period. Maximum time as default",
"format": "date-time"
},
This means that you get duplicate arguments if there is more than one Period as an argument in the generated C# client.
Of course there is a workaround by using an encompassing model, but then again, this should work as such. Maybe I am doing something wrong? I am using NSWAGStudio.
Cheers
Yves

Should be simple to fix. The only issue i see is that this is a breaking change for some users...

I understand how some people do not want the complex type prefix (especially in the swagger UI). It is, as far as I can tell however, standard to include it in the swagger, and this should be subservient to a nice UI.
Btw: great work, keep it up!

How does web api handle this? Are both variants working with the parameter binder?

Hi,
I am not sure I understand the question. I use NSWAG to generate my DTO from my Models, then use those in my web api (controllers). The webapi layer has no idea about any of the models, that is the responsability of the service layer with it's units of work. I then use NSWAG again to generate the C# client code that is used by any client application, together with the DTO assemblies generated before. Obviously this works because for me my Models are one-on-one with my DTO's.
The odd thing is that NSWAG seemed to have solved the problem of complex type prefixes a while ago, but it seems broken again with the latest version.  The prefix seems to be 'query' now ....
Worse, when including more than 2 complex types, the third type just disappears from the parameters list in the generated C# client code ...
Yves

My question is how Web API handles these parameters, can you use for your sample either "searchPeriod.start" or "start" as parameter and ASP.NET still binds it correctly?

I only use the generated clients in my applications. However, when using Swashbuckle (which uses searchPeriod.start), and breaking inside my controller I can confirm proper binding by .net!


I can't extract to normal file

After use command extract file: java -jar disunity.jar asset unpack sharedassets0.assets. The result like as screenshot attach. Don't understand use command that result normal file. Help me.

the same as me

Yeah, it's the current behavior in 0.5, you get raw data blocks only. To extract assets, deserialization needs to be re-implemented, which isn't done yet.

is there any chance this will be implemented?

me too


intermediate checkpoints

The Binance.com loader successfully imported all data from the Rest API, but then the CCXT plugin crashed. Having the problem presumably fixed now, it again starts to download everything. Since it crashed for another reason I could solve, it now again has to download everything. Which crashes now due to rate limit.
It would be awesome if the downloaders would store intermediate progress. In particular for large transaction histories, that would be very useful. If it wouldn't have to rebuild/request every step that already finished successfully.

Are you using the cache option by adding -c to the command? If you use that flag it will save the cache once the entire pull from Binance is completed and you won't have to re-pull as long as you use the cache flag, and don't run the test suite (which flushes cache).
Hitting CTRL+C during pricing lookup will save to cache so that you can resume from where you stopped if you have to shutdown your PC or whatever. The option doesn't exist for the Input plugins, though.

I'm closing this since it seems to be resolved for now.  Let us know if you have any further issues with caching.

why don't we cache web IO transactions by default since these are particularly resource/time intensive and local IO if it exceeds a certain size limit (because then even local computations become time consuming)


Undirected Graphs

We should provide an undirected graph abstraction. At the moment the csr graph is directed.
For use what we have and turn it into an undirected graph, we'll need

https://github.com/tinygraph/tinygraph/issues/9

then we can a forward and a reverse graph.
Or better: have one directed graph and for all (s,t) also store (t, s). Then have bitsets for what is a forward/reverse edge.

Here is the dense bitset we can use for forward / backward edge flags
https://github.com/tinygraph/tinygraph/blob/a34e9facb1406ff2dabf7bf1db9112d06120d85a/tinygraph/tinygraph-bitset.h

We just added a reversible graph copy feature
https://github.com/tinygraph/tinygraph/blob/c68edc5d332ab2d592ad0ba09a084b209ac380d6/tinygraph/tinygraph.h#L82
We can now get a graph with edges reversed easily, the use case is as follows

User constructs a regular graph
User creates a reverse copy of the graph
User can now traverse both graphs manually

This is a great step forward; ideally we'd have a proper undirected graph abstraction where the user has a single object at hand and does not have to know about a forward and backward graph, which makes combined traversal hard and quite a manual process. That's why I'm leaving this ticket open.


command show does not appear to sort objects

Hi, could you be more specific ?
One ugly hack i used to use to order items is to wrap the in a list like
{
deployment:: {...},
configmap:: {...},
...
...

items: [
  $.configmap,
  $.deployment,
]
}

this way the items will be consistent in ordering
not sure if this address your comment though without more details :)


DLL or CC format only supported

Should support binaries, to enable linux devs to use bots

We're way past this :)


ALB details (listeners, target groups, rules) are not exported with terraforming

While the basic setup of the ALB is an option, it does not appear to pull the details of the setup and it's relationship to instances, and traffic rules either under the ALB plugin or under another plugin.

i can't also pull target groups :(

Neither Security Groups

Neither Security Groups
terraforming sg              # Security Group

Is functionality for this currently being developed?

Brilliant tool with a lot of potential, but I would also like to request that the listener rules be included in the ALB


Fix collab regressions

The collab example is very buggy atm. E.g. if you select text and star typing the user-selection-fragment is not transformed.

Most obvious bugs fixed, let's add separate issues as we discover them.


Find what happened to my audit, and my merkey. The tree root.Nineteen69$paystring.crypto.com

Looking for what happened to this paystring back in 2021 during the audit that had happened and why it is not recognized anymore


Launching chromium from emulationstation

Hi,
I installed Chromium using an customised deb package (customised to allow viewing netflix).
Chromium is installed without errors, but when I try to run it from emulationstation, I get the following message:
Failed to put Xlib into threaded mode.
Gtk: cannot open display
I have a script called chromium.sh in RetroPie/roms/chromium which contains the following line inside:
chromium-browser
Also I added the following to the file es_sytems.cfg located in /opt/retropie/config/all/emulationstation/es_system
<system> <fullname>Chromium</fullname> <name>chromium</name> <path>~/RetroPie/roms/ chromium</path> <extension>.sh .SH</extension> <command>bash %ROM%</command>  <platform>chromium</platform>  </system>
Any thoughts?
Thanks.

I get the deb file from here: https://github.com/kusti8/chromium-build/releases/download/netflix-1.0.0/chromium-browser_56.0.2924.84-0ubuntu<IP_ADDRESS>.1011.deb

Are you running from Ubuntu?
I know that if the desktop is running that should work.
If you're on Raspbian, try startx chromium. (https://raspberrypi.stackexchange.com/questions/11866/how-can-i-start-x11-only-for-a-single-application)


[BUGFIX] Pip Build: use runtime.Features instead of manual check for mkldnn headers

Description
Title
Refer: https://github.com/apache/incubator-mxnet/pull/18797/files#r463170714
Checklist
Essentials

[x] PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
[x] Changes are complete (i.e. I finished coding on this PR)
[x] All changes have test coverage
[x] Code is well-documented

Changes

CD [pypi build creation]

@mseth10

@mxnet-bot run ci [miscellaneous]


GURL fails to handle some urls

GURL container will mark those urls such as http:/// as invalid. However, since we are only using the Parsing functions from Chromium source (https://github.com/scrapy/scurl/blob/master/scurl/cgurl.pyx#L82), we haven't marked those urls as invalid. There might be some potential issues if we dont fix this :)

The solution to this problem is making sure that all of the calls to the parsing functions in GURL (https://github.com/scrapy/scurl/blob/master/scurl/cgurl.pyx#L82) are successful (based on how they do it in gurl.cc, which can be seen here


Bump gcb-docker-gcloud image to v20210331-c732583

What type of PR is this?
/kind bug
What this PR does / why we need it:
This will re-trigger the image-user builds and tries to mitigate the
current 403 issues when pulling container images from
gcr.io/cri-tools.
Which issue(s) this PR fixes:

None
Special notes for your reviewer:
None
Does this PR introduce a user-facing change?


Bug fix for duplicate skill issue and include more support for HelpCommand

Bug fixes for

Minor UG details
Duplicate skill when using edit with different skill proficiency
Skill input validation to exclude 0
HelpCommand to support the use of commands such as undo

Refer to Issue https://github.com/AY2122S2-CS2103T-W13-3/tp/issues/139 for list of issues this PR addresses

Codecov Report

Merging #140 (e527977) into master (a659dab) will decrease coverage by 0.27%.
The diff coverage is 25.00%.

@@             Coverage Diff              @@
##             master     #140      +/-   ##
============================================
- Coverage     69.10%   68.82%   -0.28%
+ Complexity      560      559       -1
============================================
  Files            88       88
  Lines          1835     1841       +6
  Branches        211      211
============================================
- Hits           1268     1267       -1
- Misses          492      500       +8
+ Partials         75       74       -1

Impacted Files
Coverage Δ

.../address/logic/commands/FilterPastTeamCommand.java
0.00% <ø> (ø)

...java/seedu/address/logic/commands/ShowCommand.java
100.00% <ø> (ø)

...c/main/java/seedu/address/model/team/SkillSet.java
81.42% <0.00%> (-2.86%)
:arrow_down:

...java/seedu/address/logic/commands/HelpCommand.java
30.00% <16.66%> (-3.34%)
:arrow_down:

src/main/java/seedu/address/model/team/Skill.java
95.65% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a659dab...e527977. Read the comment docs.

LGTM, Great use of assertions and logging in this PR.


opt skip some runtime filter if there is a limit operator

Proposed changes
the condition to skip runtime filter

limit can be pushed to scan
the tree pattern satisfies that the path from scan to buildNode do not contains
--  Agg or
-- right child of hash join
-- right child of nested loop join

Issue Number: close #xxx

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall


Fixed Markdown In Bangla Books List

What does this PR do?
Add resource(s) | Remove resource(s) | Add info | Improve repo
For resources
Description
Why is this valuable (or not)?
How do we know it's really free?
For book lists, is it a book? For course lists, is it a course? etc.
Checklist:

[x] Read our contributing guidelines
[x] Search for duplicates.
[x] Include author(s) and platform where appropriate.
[x] Put lists in alphabetical order, correct spacing.
[x] Add needed indications (PDF, access notes, under construction)

Follow-up

Check the status of GitHub Actions and resolve any reported warnings!

Thanks for helping to address with #4579

check now fixed according to your idea @davorpa

Thanks, and welcome to free-programming-books!


[SPARK-12096] [MLlib] remove the old constraint in word2vec

jira: https://issues.apache.org/jira/browse/SPARK-12096
word2vec now can handle much bigger vocabulary.
The old constraint vocabSize.toLong * vectorSize < Ine.max / 8 should be removed.
new constraint is vocabSize.toLong * vectorSize < max array length (usually a little less than Int.MaxValue)
I tested with vocabsize over 18M and vectorsize = 100.
@srowen @jkbradley Sorry to miss this in last PR. I was reminded today.

Test build #47066 has started for PR 10103 at commit a33f3e6.

Test build #47066 has finished for PR 10103 at commit a33f3e6.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/47066/
Test PASSed.

Merged build finished. Test PASSed.

OK, seems reasonable

Merged to master, as https://github.com/apache/spark/commit/a0af0e351e45a8be47a6f65efd132eaa4a00c9e4 was


Implement partial success

Currently, when a SELECT is executed, if any row contains a null and the user's data model cannot accommodate it, then the whole query will fail. It would be more useful to allow configurability of this behavior: for analytical / data transformation purposes, it's possible the user would wish to ignore null rows.
If stream had an element-level error combinator, that could achieve the same functionality (TODO: push there?).

In our apps, we make this decision at a finer grain level than described here, we make this decision at row+column level, deciding to substitute with a proper default (empty string), a Option.empty to represent NULL or an error with the interpretation that the database content is invalid.


Display a floorplan of all racks in a site

Ability to drag and drop existing racks within a site to create their physical topology.  Bonus points for displaying how many free U's each rack has.

I've already have this setup in a customeware application I wrote.
I make use of pgSQL's point coordinates for storing the location of racks, CRV's, UPS's on a grid and then displaying racks, birds eye with:

rack temp color adjusted by chromatic scale with a hover graph to show the last 10 temp points for trending

clickable icons for switches in the racks that modal to show interfaces, toggle control, port descriptions, vlan information

pdu's in the rack and the power they are consuming

crv's showing input and output temps and humidity

UPS input and output + battery state and runtime

A room / bird's eye view makes sense.  We may need to first address how to relate rooms, private cages, or floors in the same site.  You may want to only take a birds eye view by these sub-units/groups.

Yes, you'd ideally want to limit the display to each "rack group" - which for us is a single containment pod but could be anything.
Realistically you are only limited to screen real-estate for what you want to show however there are other considerations if you want live data:
-will the data come live or from a stored system that is polling (like rrdtool)
-if its coming live, how many devices are you calling live and what impact that may have on your network
My implementation does everything live via ajax (we are relatively small) but at scale that simply doesn't work.
My thought for my next version was to use cacti to collect all the data and pull it to the interface with command line calls to rra's, however that means adding devices in two places and also doing all graph templating with cacti and a slew of other things.
It certainly would be an advanced implementation to add live/delayed data to the overview but not impossible.
Simply displaying the visual layout though is real easy, involving some CSS and placement decisions based on grid.
Each rackUnit (yeah bad name) in my pgsql table (which consists of 'types' e.g rack, gap, ups, battery, bypass, transformer, cooler, etc) has a "coord" field that is (x,y) and I display my rackUnits out where:
0,0 is top left -> end of row
1,0 is bottom left -> end of row
...this is per rackGroup.
Based on the type and facility ID for those items I have CSS classes setup to handle the display for that item.

I thought the idea of netbox is not to have live or polled data but to be an authoritative source of truth curated by a human. I would really like to see this feature but it need only be the room view exactly as @ryanmerolle said. Then we could browse down from the org level to each data centre space or room  and then down to the rack level.

One of the tenants of netbox is to document things as they exist in the real world.
So auto-polling interfaces, assuming connections, etc is not done.
The temperature of a rack, of the runtime of a UPS battery string, are real world items and critical to DCIM.
My previous reply was simply shared to provide insight as to how I accomplished my needs for our software.

Awesome, searching for "map" instead of "overview" was to easy to find this issue, sorry. :smile:

As well as "bird eye view" I'd also like a front and back view of all the racks in a site or rack group. At the moment you can only get this one rack at a time.

Would be very nice to see a basic layout picture next to the rack

@bellwood, have you made any further progress on this? Any work you would like to share? I'm looking at implementing this in our setup in the coming week.

I have it working based on some static data, however, until FR #20 and #1044 are completed and we can move away from 6connect entirely Netbox remains a backwater project in my org.
<.02>Netbox really needs a version(s) dedicated to catching up on the legacy requests. </.02>

Yeah I'd really like something like this as well - Im somewhat handy with front end web dev stuff as well so I am more than happy to help!

Hi @bellwood, have you made any further progress on this?

Hi @bellwood, have you made any further progress on this?

Hi @jeremystretch:
I´m thinking about a simple solution to get this feature implemented:
First of all.. what is the exactly need of a "floorplan" ?
Normaly as we want to document "DataCenter" we doesn´t use the Term of "Floorplan" as we use the Term of DataCenterGrid.
How to build DataCenterGrid ?
I would use as simple as possible the function from bootstrap themselve to draw the "grid".
Maybe extension with allow upload of big background graphic?
But first .. on which point we could build our DataCenterGrid ?
We need a starting point with a input field who you could define number of rows and columns who define the "Size" of your DataCenter.
Does we use this on the "Site" or should we define a new Implementation with Django and call the App "DataCenter-Visualisation" ?
This need some Linkings too from Site and Rackgroup and Racks.

So, at least with my implementation, we use the logical name of the rack for the name, and the facility ID is the physical location within the data center grid. My understanding is that is fairly common practice: RackRow.Rack#

Hi all,
Is there any advance to this feature?
We recently started to explore netbox as a replacement of a old in-house DCIM in our company and since we have around 50 to 80 racks per site, the ability to have a room plant with rack information and position in the room is something important.

Please do not ask for updates to feature requests.  They will be released when they are released.

This is one of our oldest feature requests, and to be honest I just don't see it ever becoming a priority.
I'm going to close this out as a core feature request, however I do think it would make an excellent plugin. Hopefully someone in the community will take interest in building it.


Support numpy 2

Bug report
There are some compatibility issues with numpy 2 with astropy and hpgeom. Once these have been addressed, we should unpin numpy and confirm compatibility with numpy 2.
See also: https://github.com/astronomy-commons/hipscat/actions/runs/9543180199/job/26299292325
Before submitting
Please check the following:

[x] I have described the situation in which the bug arose, including what code was executed, information about my environment, and any applicable data others will need to reproduce the problem.
[x] I have included available evidence of the unexpected behavior (including error messages, screenshots, and/or plots) as well as a descriprion of what I expected instead.
[x] If I have a solution in mind, I have provided an explanation and/or pseudocode and/or task list.

Closed by https://github.com/astronomy-commons/hipscat/pull/298


Revise the \textinput command

There's a few things that are problematic:

if the file is not in assets it doesn't quite seem to work
the docstring for \textinput should be improved in terms of what path it expects

it should be possible to just point to a raw file and have a separate setting where that file is not processed by Franklin...

There's some kind of weird bug in https://github.com/rmsrosa/WebsiteGen/tree/25e2985b316d4efb6d3d7940d6227f9fcd62ab23 where if the file is called _assets/complements/research.md it does not get copied over to assets but if it's called research2.md it does and things work 🤯

There's some kind of weird bug in https://github.com/rmsrosa/WebsiteGen/tree/25e2985b316d4efb6d3d7940d6227f9fcd62ab23 where if the file is called _assets/complements/research.md it does not get copied over to assets but if it's called research2.md it does and things work 🤯


Roll Flutter Engine from fdf38910bad4 to b910a91bfcfa (2 revisions)

https://github.com/flutter/engine/compare/fdf38910bad4...b910a91bfcfa
2024-09-18<EMAIL_ADDRESS>Roll Dart SDK from 089ef90b6680 to b4bfea33ab1d (1 revision) (flutter/engine#55276)
2024-09-18<EMAIL_ADDRESS>Roll Skia from 86abf2391374 to ae4e7753fa9b (4 revisions) (flutter/engine#55275)
If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-engine-flutter-autoroll
Please CC chinmaygarde@google.com,rmistry<EMAIL_ADDRESS>on the revert to ensure that a human
is aware of the problem.
To file a bug in Flutter: https://github.com/flutter/flutter/issues/new/choose
To report a problem with the AutoRoller itself, please file a bug:
https://issues.skia.org/issues/new?component=1389291&template=1850622
Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+doc/main/autoroll/README.md

Commit queue failed; closing this roll.


Questions about new feature at 0.5.0 : decoupled model

I have some questions about decoupled model in 0.5.0.
Its documentation says that it is specifically useful in Automated Speech Recognition (ASR), but I don't understand why. Here's my questions.

In my case, real time audio packet transmitted to fastapi server (keep alive connection with http) and the packet converted to audio feature when audio packet is accumulated enough to ASR. (maybe few seconds of packets or more) And then request to pytriton with extracted feature then get ASR response(text).
In my scenario, how can I implement decoupled models and whats the advantage of it? I wonder if it guarantees inference with ordered-manner, w.r.t each audio source. I guess the audio packet source and fastapi server(which buffers packet and extract feature from it) should be 1:1, pytriton server and fastapi server will be 1:N, to handle multiple audio packet source with no audio sources mixed.
Does pytriton with decoupled model can handle stream data? i.e. , can we feed audio packet (bytes) to server, directly?
How can we control the reponse length? (the doc says server deliver response whenever it deems fit)
How can we control parallelism? (number of workers, etc..) refer to doc, It can receive many requests in parallel and perform inference on each request independently.

Hi do you have any news on this?

Triton Inference Server offers robust features for handling inference requests, and while it excels in certain areas, there are nuances to consider when dealing with specific use cases like streaming data. Let's clarify these aspects:

Streaming Data vs. Batching:

Triton is designed to optimize GPU utilization primarily through batching. This means it's highly efficient when you have numerous small inference requests that can be batched together. However, for continuous, real-time data streams (like audio packets in ASR), the architecture of Triton might not be the most efficient out-of-the-box. Each request is treated as separate and independent, which might not align perfectly with the sequential and dependent nature of streaming audio data.

ASR Specifics:

For ASR models, the integration might not be straightforward because the business logic for handling streaming data, especially the batching part, tends to be application-specific. For instance, batching a single second of audio from multiple input streams and processing them might require custom logic like silence detection. This should be handled at the application level and Triton can't do it.

Decoupled Models and Streaming Outputs:

While Triton doesn’t handle streaming input data inherently, its decoupled models can stream output data. This means that as soon as the server has any part of the response ready, it can send it back, enabling scenarios where you want real-time interactions, like with LLMs producing text outputs progressively.

Sequence Handling:

Triton supports sequence ID feature but it can't be used with PyTriton because it doesn't support it. It is hard to implement logic to merge several inference requests based on sequence IDs into single stream of audio features necessary for ASR. It is better to avoid this if there is no clear benefit in terms of GPU utilization or other performance metrics.

Architecture Considerations:

The 1:N architecture (one audio source per FastAPI instance, multiple such instances interfacing with a single Triton server) can be beneficial. However, it's particularly advantageous when you have the need to batch multiple small inference requests to utilize the GPU effectively. If your application doesn't fit this pattern – for example, if you have fewer, more extensive inference requests – you might not see the same level of benefit. In such cases, directly interfacing with the model in FastAPI server or running multiple instances of the model (if you're dealing with single, large inference requests) might be more efficient.

Internal Batching in Decoupled Models:

Although Triton doesn’t batch requests for decoupled models internally, it allows each request to call the model’s inference function independently. This opens up the possibility of implementing custom internal batching within your model's logic, tailored to your specific needs.

In conclusion, while Triton Inference Server provides robust features for batch processing and can handle decoupled model outputs effectively, integrating it with streaming data sources like ASR might require careful consideration and potentially custom application logic. It excels in scenarios with numerous small inference requests but might not be the most efficient for continuous, real-time data streams. As always, the best approach depends on the specific requirements and constraints of your use case.


Batch SaveToES with foreachpartition

Hi
I have a data JAVARDD which needs to be written to ES
It has 32 partitions
However the write to ES is sequential using saveToES
I do not care for the order of insert
Is there a possibility to write from foreachPartition or write parallely?
Thanks,
Yukti

How many cpu cores do you have available for Spark? If your RDD has 32 partitions operations on it, including saveToEs should be distributed/parallelized automatically without any additional work.

The execution is sequential, for each partition
Logs indicate all the partitions, being processed in sequence
1
2
...
32
Also, read somewhere that if we use Singletons like JavaEsSpark etc.. they
cannot be sent to the workers and hence create a bottleneck.
Kindly guide and suggest
On Tue, Nov 10, 2015 at 1:42 AM, Costin Leau<EMAIL_ADDRESS>wrote:

How many cpu cores do you have available for Spark? If your RDD has 32
partitions operations on it, including saveToEs should be
distributed/parallelized automatically without any additional work.
—
Reply to this email directly or view it on GitHub
https://github.com/elastic/elasticsearch-hadoop/issues/599#issuecomment-155177655
.

--
Warm Regards,
Yukti Kaura

Same problems here.
The job is very simple:
val data       = sqlContext.load(params.srcPath)
data
  .map(r => toModel(r))
  .map(m => transform(m))
  .saveToEs("{index:'partitioned_index_'yyyy-MM}/document")

And no matter how big is the cluster and how I set up spark (# of executors, memory, etc) the insert process seems to be sequential, no parallelism at all.

Hi Alexey will suggest to use the Elasticsearch bulk API over this one.
That is significantly faster.
Open and close connections in ForeachPartition , ensure that your bulk size
is optimum.
On Mon, Nov 16, 2015 at 5:07 AM, Alexey Raga<EMAIL_ADDRESS>wrote:

Same problems here.
The job is very simple:
val data       = sqlContext.load(params.srcPath)
data
.map(r => toModel(r))
.map(m => transform(m))
.saveToEs("{index:'partitioned_index_'yyyy-MM}/document")
And no matter how big is the cluster and how I set up spark (# of
executors, memory, etc) the insert process seems to be sequential, no
parallelism at all.
—
Reply to this email directly or view it on GitHub
https://github.com/elastic/elasticsearch-hadoop/issues/599#issuecomment-156870242
.

--
Warm Regards,
Yukti Kaura

I'll investigate; currently I don't have any ideas why this occurs. ES-Hadoop doesn't handle the partitions directly instead it is Spark through its DAG Scheduler that decides who and when to run (in this case the ES-Hadoop save).
Note that even if there are multiple partitions, unless there are available Spark nodes/CPU, they do get executed in sequence since there's only one CPU.
@yukti Sure, one could use the bulk/transport API directly but that's not as convenient as ES-Hadoop. Does that solve parallelism for you? The Java client relies on async operations but these are internal to it not Spark...
Personally I'd like to see what's the issue in your case and improve the situation - it will be a win-win situation.

Hi Costin,
ES-Hadoop is more convenient when RDD is in picture.
However, incase it is an Iterable which is involved, Bulk API comes in
handy, more so since I have fine grain control over its configuration.
Within ForeachPartition of Spark there is an Iterable of records, however,
even contrary to my belief ForeachPartition too runs sequentially , so
incase there are 32 partitions each partition runs one after the other
I am using ForeachPartitionAsync.
HOwever, this sequencing is faster than the EsSpark API.
Not sure why that is the case.
Thanks,
Yukti.
On Mon, Nov 16, 2015 at 8:59 AM, Costin Leau<EMAIL_ADDRESS>wrote:

I'll investigate; currently I don't have any ideas why this occurs.
ES-Hadoop doesn't handle the partitions directly instead it is Spark
through its DAG Scheduler that decides who and when to run (in this case
the ES-Hadoop save).
Note that even if there are multiple partitions, unless there are
available Spark nodes/CPU, they do get executed in sequence since there's
only one CPU.
@yukti https://github.com/yukti Sure, one could use the bulk/transport
API directly but that's not as convenient as ES-Hadoop. Does that solve
parallelism for you? The Java client relies on async operations but these
are internal to it not Spark...
Personally I'd like to see what's the issue in your case and improve the
situation - it will be a win-win situation.
—
Reply to this email directly or view it on GitHub
https://github.com/elastic/elasticsearch-hadoop/issues/599#issuecomment-156904121
.

--
Warm Regards,
Yukti Kaura

Both foreach and foreachPartition are run across the cluster when possible - that's the whole premise behind using the RDD in the first place.
If you look at the source, you'll notice the two methods are actually quite similar:
  // Actions (launch a job to return a value to the user program)

  /**
   * Applies a function f to all elements of this RDD.
   */
  def foreach(f: T => Unit): Unit = withScope {
    val cleanF = sc.clean(f)
    sc.runJob(this, (iter: Iterator[T]) => iter.foreach(cleanF))
  }

  /**
   * Applies a function f to each partition of this RDD.
   */
  def foreachPartition(f: Iterator[T] => Unit): Unit = withScope {
    val cleanF = sc.clean(f)
    sc.runJob(this, (iter: Iterator[T]) => cleanF(iter))
  }

Again, if you have doubts about what is going on, the Spark reference docs has a whole section on how to monitor partitioning and track down execution. Potentially you can try Databricks's cloud and see whether that changes your behavior.
As for the async version things are exactly the same however in this case your code is not waiting/blocking for the response - the work simply happens in the background.
Async rarely makes things faster for the call per se, rather it decouples the caller from the actual work so it can pursue other interests - that doesn't mean though the work has been down.
You can check this for yourself by calling get on the FutureAction which basically translates the async usage into a sync one.

I have a similar problem. I'm using this library and it works great but when I use in production we have a problem
Our dataset need 974 partitions because has more than 400 million of lines. We use 16 nodes, and we use this configuration for ESSpark
.set(ConfigurationOptions.ES_BATCH_SIZE_BYTES, "10mb")
.set(ConfigurationOptions.ES_BATCH_SIZE_ENTRIES, "50000")
.set(ConfigurationOptions.ES_BATCH_WRITE_RETRY_WAIT, "5s")

With saveToES it takes forever, @costin do you have any idea to decrease the data upload time?
Thanks

AFAIU those actions need to access SparkContext and everything that requires access to SparkContext is done in the driver not on workers

Does this mean in order to use saveToES, only drive will do the job and the worker nodes has no use?

Hi Costin
Do you have any updates on this issue?
Thanks

@mqiu2017vs The saveToEs method executes runJob on the RDD, which delegates downward into Spark's DAGScheduler, which handles launching the job on the Spark Cluster. Unfortunately this is an older issue and the original author has not responded in over a year. I'm going to go ahead and close this issue as it has stalled out. If an issue such as this arises again, we'll open a new ticket for it to track it.

Hi James,
I think this is still an issue,  Because I use the same way to saveToES, I
can see that only the driver is doing the job sequentially so the
performance is not good.
Please open a new ticket for this.
Bests,
Min Qiu
On Thu, May 25, 2017 at 3:10 PM, James Baiera<EMAIL_ADDRESS>wrote:

@mqiu2017vs https://github.com/mqiu2017vs The saveToEs method executes
runJob on the RDD, which delegates downward into Spark's DAGScheduler,
which handles launching the job on the Spark Cluster. Unfortunately this is
an older issue and the original author has not responded in over a year.
I'm going to go ahead and close this issue as it has stalled out. If an
issue such as this arises again, we'll open a new ticket for it to track it.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/elastic/elasticsearch-hadoop/issues/599#issuecomment-304097066,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AZA2S_aKPnPmpzlQxEGArS5PoPNowg7Bks5r9dIWgaJpZM4GeJPE
.


Rectify _?matcopy size calculation

Shall address #3160 , avoiding oldest bit mis-handled as the sign.

codeql demo says multiplication result is signed then assigned to unsigned eventually losing sign bit via overflow that might have been there. It is just arithmetic problem, sad it happens in the face of malloc.
this is just to clear the warning, quite obvious some sanity checking would be handy, but then we have no way to give controlled feedback

this is just to clear the warning,

my point is that you removed the if *lda > *ldb logic for the calculation of msize. I am still not entirely sure if it is really needed, but it looks too elaborate to be a random mistake - and it has nothing to do with the intermediate overflow that you set out to fix.
(probably it would even be enough to put parentheses around the ldb * sizeof part so that everything gets cast to size_t automatically)

OK, can do double way if that is f concern.

Thanks, fixed with other PR