Flutter web : How to build in a single Flutter project a build for Chrome Extension and for Browser

Flutter allows to build app for browsers and for chrome extension BUT, the structure of index.html is not the same between these 2 builds.
Is it possible to build 2 apps in a single project ?

Hi @redDwarf03, thanks for filing the issue.
Could you please describe the difference between two index.html files for Web and Extension? Which steps did you try to do? And then please update the issue description as detailed as possible.
I see that there is a tutorial here that builds an extension (contains modification steps for index.html) but I'm not sure is the same as yours or not.

Hello. thanks for your answer.
i saw this tutorial too and the author is right but my need is more like that.
I have a project i want to build in several web mode:

i build my project with flutter build web --web-renderer canvaskit --release to host my app on firebase
i build my project with flutter build web --web-renderer html --csp to publish on chrome extension

The need 1) requires :
index.html :
<!DOCTYPE html>
<html>

<head>
  <!--
    If you are serving your web app in a path other than the root, change the
    href value below to reflect the base path you are serving from.

    The path provided below has to start and end with a slash "/" in order for
    it to work correctly.

    For more details:
    * https://developer.mozilla.org/en-US/docs/Web/HTML/Element/base

    This is a placeholder for base href that will be replaced by the value of
    the `--base-href` argument provided to `flutter build`.
  -->

  <meta charset="UTF-8">
  <meta content="IE=Edge" http-equiv="X-UA-Compatible">
  <meta name="description" content="">

  <!-- iOS meta tags & icons -->
  <meta name="apple-mobile-web-app-capable" content="yes">
  <meta name="apple-mobile-web-app-status-bar-style" content="black">
  <meta name="apple-mobile-web-app-title" content="">
  <link rel="apple-touch-icon" href="icons/Icon-192.png">

  <!-- Favicon -->
  <link rel="icon" type="image/png" href="favicon.png" />

  <title>Archethic Wallet</title>
  <link rel="manifest" href="manifest.json">

  <script>
    // The value below is injected by flutter build, do not touch.
    var serviceWorkerVersion = null;
  </script>

  <!-- This script adds the flutter initialization JS code -->
  <script src="flutter.js" defer></script>
  <script src="splash/splash.js"></script>
  <meta content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no" name="viewport" />
  <link rel="stylesheet" type="text/css" href="splash/style.css">
  <meta content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no" name="viewport" />
</head>

<body>
  <script>
    window.addEventListener('load', function (ev) {
      // Download main.dart.js
      _flutter.loader.loadEntrypoint({
        serviceWorker: {
          serviceWorkerVersion: serviceWorkerVersion,
        }
      }).then(function (engineInitializer) {
        return engineInitializer.initializeEngine();
      }).then(function (appRunner) {
        return appRunner.runApp();
      });
    });
  </script>
</body>

</html>

manifest.json :
{
  "name": "",
  "short_name": "",
  "start_url": ".",
  "display": "standalone",
  "background_color": "#000000",
  "theme_color": "#000000",
  "description": "",
  "orientation": "portrait-primary",
  "prefer_related_applications": false,
  "icons": [
      {
          "src": "icons/Icon-192.png",
          "sizes": "192x192",
          "type": "image/png"
      },
      {
          "src": "icons/Icon-512.png",
          "sizes": "512x512",
          "type": "image/png"
      },
      {
          "src": "icons/Icon-maskable-192.png",
          "sizes": "192x192",
          "type": "image/png",
          "purpose": "maskable"
      },
      {
          "src": "icons/Icon-maskable-512.png",
          "sizes": "512x512",
          "type": "image/png",
          "purpose": "maskable"
      }
  ]
}

The need 2) requires :
index.html :
<!DOCTYPE html>
<html style="height: 600px; width: 350px">

<head>
  <!--
    If you are serving your web app in a path other than the root, change the
    href value below to reflect the base path you are serving from.

    The path provided below has to start and end with a slash "/" in order for
    it to work correctly.

    For more details:
    * https://developer.mozilla.org/en-US/docs/Web/HTML/Element/base

    This is a placeholder for base href that will be replaced by the value of
    the `--base-href` argument provided to `flutter build`.
  -->

  <meta charset="UTF-8">
  <meta content="IE=Edge" http-equiv="X-UA-Compatible">
  <meta name="description" content="">

  <!-- iOS meta tags & icons -->
  <meta name="apple-mobile-web-app-capable" content="yes">
  <meta name="apple-mobile-web-app-status-bar-style" content="black">
  <meta name="apple-mobile-web-app-title" content="">
  <link rel="apple-touch-icon" href="icons/Icon-192.png">

  <!-- Favicon -->
  <link rel="icon" type="image/png" href="favicon.png" />

  <title>Archethic Wallet</title>
  <link rel="manifest" href="manifest.json">

  <script src="splash/splash.js"></script>
  <meta content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no" name="viewport" />
  <link rel="stylesheet" type="text/css" href="splash/style.css">
  <meta content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no" name="viewport" />
</head>

<body>
  <script src="main.dart.js" type="application/javascript"></script>
</body>

</html>

manifest.json :
    "name": "Archethic Wallet",
    "description": "Archethic Wallet",
    "version": "0.2.23",
    "content_security_policy": {
        "extension_pages": "script-src 'self' ; object-src 'self'"
    },
    "action": {
        "default_popup": "index.html",
        "default_icon": "icons/Icon-192.png"
    },
    "manifest_version": 3
}````

So I have to change index.html and manifest.json manually in web folder before launch build commands
Ideally, we could have 2 "web" folders like "web" and "chrome extension" and pass in the build command the folder we want to use to build the app

@redDwarf03
Thanks for your detailed response. I modified the sample code section for better readability. Labeling the issue for the team to come up with ideas/thoughts.

Ideally, we could have 2 "web" folders like "web" and "chrome extension" and pass in the build command the folder we want to use to build the app

That sounds like a duplicate of:

https://github.com/flutter/flutter/issues/78254#issuecomment-1139219323

(Will close as duplicate)
However, a quick question @redDwarf03: we eventually need to deprecate loading flutter directly with:
  <script src="main.dart.js" type="application/javascript"></script>

Why is that required for the extension project? Why can't flutter.js be used in an extension?

hmm.. i just followed how to create a chrome extension in this article: https://medium.com/flutter-community/building-a-chrome-extension-using-flutter-aeb100a6d6c
and the author precise in the end of the chapter one:
"Then only insert the following "
Sadly i can't tell more about that...
and i agree with you, it seems to be like issue #78254

@redDwarf03 can you test in your extension if embedding with flutter.js works (similarly to what you use for firebase)?
The fact that flutter web works as a browser extension is a lucky "accident", not a supported use case (we don't have any testing, for example, to guarantee that Flutter web works as a extension, and that we don't break it in the future!)

i added  <script src="flutter.js" defer></script>in the <HEAD> section
and i removed  <script src="main.dart.js" type="application/javascript"></script>
i hope that's correspond to your request.
The chrome extension doesn't work with this updates. i'm blocked on the splash image
<!DOCTYPE html>
<html style="height: 600px; width: 350px">

<head>
  <!--
    If you are serving your web app in a path other than the root, change the
    href value below to reflect the base path you are serving from.

    The path provided below has to start and end with a slash "/" in order for
    it to work correctly.

    For more details:
    * https://developer.mozilla.org/en-US/docs/Web/HTML/Element/base

    This is a placeholder for base href that will be replaced by the value of
    the `--base-href` argument provided to `flutter build`.
  -->

  <meta charset="UTF-8">
  <meta content="IE=Edge" http-equiv="X-UA-Compatible">
  <meta name="description" content="Archethic">

  <!-- iOS meta tags & icons -->
  <meta name="apple-mobile-web-app-capable" content="yes">
  <meta name="apple-mobile-web-app-status-bar-style" content="black">
  <meta name="apple-mobile-web-app-title" content="Archethic Wallet">
  <link rel="apple-touch-icon" href="icons/Icon-192.png">

  <!-- Favicon -->
  <link rel="icon" type="image/png" href="favicon.png" />

  <title>Archethic Wallet</title>
  <link rel="manifest" href="manifest.json">

  <script src="splash/splash.js"></script>
  <meta content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no" name="viewport" />
  <link rel="stylesheet" type="text/css" href="splash/style.css">
  <meta content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no" name="viewport" />

  <script src="flutter.js" defer></script>
</head>

<body>
  <picture id="splash">
    <source
      srcset="splash/img/light-1x.png 1x, splash/img/light-2x.png 2x, splash/img/light-3x.png 3x, splash/img/light-4x.png 4x"
      media="(prefers-color-scheme: light)">
    <source
      srcset="splash/img/dark-1x.png 1x, splash/img/dark-2x.png 2x, splash/img/dark-3x.png 3x, splash/img/dark-4x.png 4x"
      media="(prefers-color-scheme: dark)">
    <img class="center" aria-hidden="true" src="splash/img/light-1x.png" alt="" />
  </picture>
</body>

</html>

In addition to the flutter.js you now need to initialize flutter on a script of your own within the body tag, please add something similar to this as the last tag of your body element (after the </picture>):
<script>
  _flutter.loader.loadEntrypoint().then(function(engineInitializer) {
    return engineInitializer.autoStart();
  });
</script>

(More details in the Customizing web app initialization flutter doc.)

2 errors:
Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-vWDPfccMQe9SKhb+AZDDfc7nhFqrWRcX1gniVD+Uw+Q='), or a nonce ('nonce-...') is required to enable inline execution.
```

```
Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'self' 'wasm-unsafe-eval'". Either the 'unsafe-inline' keyword, a hash ('sha256-vWDPfccMQe9SKhb+AZDDfc7nhFqrWRcX1gniVD+Uw+Q='), or a nonce ('nonce-...') is required to enable inline execution
```
<img width="629" alt="Capture d’écran 2022-07-07 à 23 42 47" src="https://user-images.githubusercontent.com/68340133/177876379-66edf5ab-382d-4df6-9625-0221624b69b6.png">

@redDwarf03 those might have to do with this: https://developer.chrome.com/docs/extensions/mv3/intro/mv3-migration/#content-security-policy but I'm not an expert with Chrome extensions, so I can't offer much help there :/

i try to migrate manifest in v2 to v3
{
"manifest_version": 2,
"version": "0.0.1",
"name": "chrome_extension",
"description": "A new Flutter project.",
"browser_action": {
"default_popup": "index.html",
"default_icon": {
"16": "icons/icon-192.png",
"32": "icons/icon-192.png",
"48": "icons/icon-192.png",
"128": "icons/icon-192.png"
}
},
"content_security_policy": "script-src https://unpkg.com/canvaskit-wasm@0.30.0/bin/canvaskit.js;"
},
my new manifest doesn't work
{
"manifest_version": 2,
"version": "0.0.1",
"name": "chrome_extension",
"description": "A new Flutter project.",
"browser_action": {
"default_popup": "index.html",
"default_icon": {
"16": "icons/icon-192.png",
"32": "icons/icon-192.png",
"48": "icons/icon-192.png",
"128": "icons/icon-192.png"
}
},
"content_security_policy": {
"extension_pages": "https://unpkg.com/canvaskit-wasm@0.30.0/bin/canvaskit.js;",
"sandbox": "script-src 'self' ; object-src 'self'"
}
}
Any idea ?
i generate the chrome extension : flutter build web --web-renderer html

My app uses firebase, so it the firebase plugin loads a JS script from apis.google.com.
V3 does not allow this. But there's no way I can change how the plugin JS is loaded. Any suggestions?

the firebase plugin loads a JS script from apis.google.com.
V3 does not allow this. But there's no way I can change how the plugin JS is loaded. Any suggestions?

@PatrickGeyer this question would be much better suited for StackOverflow or other dev resources, and I'll mark it as "off-topic", however, some suggestions:

there's no way I can change how the plugin JS is loaded.

There's a (maybe not too well documented) package:firebase_core_web feature that instructs firebase to not automatically download their JS, and instead use whatever is available in the index.html. From the Dart doc:

FirebaseCoreWeb getter _ignoredServiceScripts
Returns a list of services which won't be automatically injected on initialization.
This is useful in cases where you wish to manually include the scripts (e.g. in countries where you must request the users permission to include Analytics).
You can do this by attaching an array of services to the window, e.g:
window.flutterfire_ignore_scripts = ['analytics'];

You must ensure the Firebase script is injected before using the service.

In order for the Firebase scripts to be available on the index.html of your extension, you probably need to bundle your main.dart.js with the Firebase scripts you need (from npm) and use this "bundle.js" output as the code for your extension. Some people have had success (in general, not explicitly with Flutter web) here:

Group: chromium-extensions: Manifest v3 & Firebase

I hope the above general info helps. If you need more details, you probably should hit the appropriate Stack Overflow tags.


VB_handle_diverging_ME

While VB iterations, it is likely to get a diverging execution of the Model Error (ME) for some reason (e.g. improper values for parameters lastly updated). In such a case, it would be nice at least to get a final VB output, which would be the best fitted parameters corresponding to the highest value of free energy up to the last iteration. Such an output is most likely not a reliable fit, but might be of any interest for example for studying purposes.

Excellent idea! One the one hand, we must avoid the "catch everything" pitfall. On the other hand, we do not know what exactly to catch. So my preferred solution is to have a tuple of allowed exceptions in VBOptions, essentially:
def f_with_value_error(x):
   return int("I am not a number")

result = bayem.vba(f_with_value_error, ...) # fails
result = bayem.vba(f_with_value_error, ..., allowed_exceptions=(ValueError,)) # result.success = False, but you get some values
result = bayem.vba(f_with_value_error, ..., allowed_exceptions=(IndexError,)) # fails (which is important to find bugs!)

internally, this then simply
...
try:
   k, J = self.p(self.m)
except self.options.allowed_exceptions as e:
   self.result.success = False
   self.result.exception = e  # or logger.error(e)
   # ... whatever cleanup
   return self.result

I think, at this point we are not going to uncover the reason behind any exception. That would be the duty of the user, I suppose. I would say, the VB can stop iterating due to ANY exception emerging in the evaluation of the model error and its jacobian, however, the VB must return proper WARNING messages to the user; e.g. hey :) , something has gone wrong in the model evaluation and therefore I stopped iterations. Makes sense?

For me, it is very important to know how the code fails (and it also should for you). So if you expect VB to fail because of convergence issues in FEniCS, but it actually fails because of a typo (likely to result in an AttributeError), you should get a real, severe error. Not just a printed message that is likely lost in some logs.
But if you still want this behavior, you could always pass allowed_exceptions=RuntimeError and catch everything...

Solved via #88


Sample IOS not working

Hey just wondering if the iOS sample project is working. If you do could you please share what is required to make it work. Thanks

Is there a specific problem that you are facing?
Did you follow the react-native-maps setup steps from here:
https://github.com/react-community/react-native-maps/blob/master/docs/installation.md


Inform Bay Area clubs about hackingEDU/help them get there

Let Bay Area clubs know about hackingEDU, help them sign up, help them get there, etc.
Ideally would want to have emailed all Bay Area clubs by Friday.

Closing this because it is being done here https://github.com/hackedu/hackedu/issues/364


HOw to allow non-ssl connections

https://github.com/timescale/timescaledb-kubernetes/blob/46f40953bf617311e25d402314143c329148e7e2/charts/timescaledb-single/values.yaml#L228-L235
 pg_hba:
 - local     all             postgres                     peer
 - local     all             all                          md5
 - host      all             all                all       scram-sha-256

I'm having the same issue. I'd like to disable SSL completely.

Here's how we did it:
  patroni:
    bootstrap:
      dcs:
        postgresql:
          parameters:
            max_wal_size: 1GB
            max_worker_processes: 30  # Must be > max_background_workers + max_worker_processes (default 8)
            password_encryption: scram-sha-256
            shared_buffers: 2GB  # recommended to be 25% of available instance memory
            ssl: 'off'  # disable all ssl connections to not require Patroni certificate
            timescaledb.max_background_workers: 20
            work_mem: 50MB
    postgresql:
      pg_hba:
      - local     all             postgres                            peer           # allow local connections
      - local     all             all                                 scram-sha-256
      - hostnossl all,replication all               all               scram-sha-256  # allow TCP/IP connections (no ssl)

One thing to note is that the chart requires a RELEASE-NAME-certificate TLS secret regardless if you have TLS enabled or not. As a result we had to supply an empty tls certificate secret to make the chart happy. It would be nice if this volume was made optional.

I have forked the official timescaledb chart here: https://github.com/agronholm/timescaledb-kubernetes
See the installation instructions there. The fork makes the disables the mounting of the SSL certificate, so with just changes to pg_hba.conf and setting ssl to off, you can disable SSL.


Avoid try except when raise_errors = True

Currently when debugging code you only get an error after it is raised in the except clause in the main try except block in MTEB.run. This is problematic as you don't have access to the context of where the bug occurred. A solution to this is to instead only use the try except block afterwards:
# what I am proposing:
if raise_errors:
  run_eval(...)
else:
  try:
    run_eval(...)
  except:
    ...

# What it is now:
try:
  run_eval(...)
except Exception as e:
  if raise_errors:
     raise e # hard to debug as you at not at the place where the error happened.

@Muennighoff and @isaac-chung would love your guys opinion on this before I implement anything
This e.g. makes #1022 really hard to debug.

But the traceback should also show what other exceptions are raised. I'm not sure if I follow what the benefits are.
For #1022 the relevant part of MTEB code seems to be in:
File "/data/niklas/mteb/mteb/abstasks/AbsTaskRetrieval.py", line 231, in load_data
corpus, queries, qrels = HFDataLoader(
File "/data/niklas/mteb/mteb/abstasks/AbsTaskRetrieval.py", line 96, in load
self._load_qrels(split)
File "/data/niklas/mteb/mteb/abstasks/AbsTaskRetrieval.py", line 175, in _load_qrels
qrels_ds = load_dataset(

I've often added a line above the faulty line for debugging using pdb: import pdb; pdb.set_trace(), then you can type the variables and hit enter to see their values. Hitting n runs the next line, and c continues running the code.

realized I never answered this. The benefit is that if a debugger is used it will stop when the error is raised not when the error happens.


Failed to generate .kindsl model from the .urdf models provided

Hi,
I just wondered are the .urdf models provided in the control_toolbox/ct_models/urdf/ directory can be converted to .kindsl models successfully by using the urdf2robcogen ros package? I have tried both the irb4600 model and quadrotor with load model, but neither works successfully.
The error code is like the following:

terminate called after throwing an instance of 'std::runtime_error'
  what():  [std::runtime_error] /home/robot-control/wbc_ws/src/kindr/include/kindr/quaternions/Quaternion.hpp:320: UnitQuaternion() Input quaternion has not unit length.
Comparing Scalars:
Scalar 1: norm() = 0
Scalar 2: static_cast<Scalar>(1.0) = 1
Error was 100% > 0.01%

Thanks for any suggestions

Hi,
I have not used urdf2robcogen in a really long time, it may well be that it is not supporting those urdfs (anymore).
I would consider it unmaintained, in doubt you could try contacting the developers!
Best

Am 29.07.2021 um 06:24 schrieb mustang @.***>:

Hi,
I just wondered are the .urdf models provided in the control_toolbox/ct_models/urdf/ directory can be converted to .kindsl models successfully by using the urdf2robcogen ros package? I have tried both the irb4600 model and quadrotor with load model, but neither works successfully.
The error code is like the following:
terminate called after throwing an instance of 'std::runtime_error'
what():  [std::runtime_error] /home/robot-control/wbc_ws/src/kindr/include/kindr/quaternions/Quaternion.hpp:320: UnitQuaternion() Input quaternion has not unit length.
Comparing Scalars:
Scalar 1: norm() = 0
Scalar 2: static_cast(1.0) = 1
Error was 100% > 0.01%
Thanks for any suggestions
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

Cool, thanks very much!


Return a GeosResult on the various binary predicate methods

This PR wraps the result of the various binary predicates on GGeom and PreparedGGeom in a GeosResult in order to fix #10 .
I wanted to include a test case but I can't figure out how to trigger such an exception for now.
It bumps the version number to 1.1.0 as it breaks the API.

@antoine-de Sorry, I planned to publish this new release on crates.io but I do not seem to have the necessary rights. Any advice ?

I just added the all of the GeoRust/core team to the crates.io owner, should work now, sorry :confused:
However I published the crates.io yesterday before reading the crates.io documentation, so we need to wait for another PR to test if you can publish a version.
btw not related at all, but we'll go to the state of the map france this year (to explain why we needed rust-geos :stuck_out_tongue_winking_eye: ), will you go there to ?

Oh great for SOTM-fr, I will be there too! (only from Friday night I think, because of other commitments + I didn't submit anything this year). For sure I will not miss your intervention if it is Saturday (otherwise let's just grab a coffee there!)


Disable alpha batch APIs by default

Batch has been beta since k8s 1.8.
Without this it's possible to start getting this error using latest kubectl.
{  cronjob} matches multiple kinds [batch/v1beta1, Kind=CronJob batch/v2alpha1, Kind=CronJob]

Codecov Report

Merging #1276 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #1276   +/-   ##
=======================================
  Coverage   36.63%   36.63%
=======================================
  Files          63       63
  Lines        3882     3882
=======================================
  Hits         1422     1422
  Misses       2242     2242
  Partials      218      218

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 15458e8...0cd8bf7. Read the comment docs.

LGTM. Thanks for the fix 🍻


Embedded Stream's Chat Feature

This is a script I wrote up to use personally in order to switch DGG chat to the YT chat.
Or, if you're embedding something, you can see the twitch or youtube chat of that stream.
https://gist.github.com/mattroseman/31808b0ee6aeecc72a0e9f2156f95333
I copied your method of using tampermonkey, and when you load it, it adds a button between the chat refresh button and the switch sides button in DGG.
IDK if this is anything you'd be interested in adding to this extension, but I thought I'd offer.
Personally, I like the ability to quickly switch over to check out what the not-DGG chat is saying :)

Seems like a pretty cool idea NODDERS
Thank you once again :heart:

Oh, this might not work since my script is injected on the /bigscreen page, not the embedded chat.
I add a button in the HTML around the iFrame that is the embedded DGG chat.
So that might cause problems.  😬


Seek help, Qwen-14B-Chat-Int4ValueError: The input size is not aligned with the quantized weight shape.  The speed can be slower than non-quantized models.
2024-02-01 01:42:02,376 INFO worker.py:1724 -- Started a local Ray instance.
INFO 02-01 01:42:04 llm_engine.py:70] Initializing an LLM engine with config: model='qwen', tokenizer='qwen', tokenizer_mode=auto, revision=None, tokenizer_revision=None, trust_remote_code=True, dtype=torch.float16, max_seq_len=2048, download_dir=None, load_format=auto, tensor_parallel_size=2, quantization=gptq, enforce_eager=False, seed=0)
WARNING 02-01 01:42:05 tokenizer.py:62] Using a slow tokenizer. This might cause a significant slowdown. Consider using a fast tokenizer instead.
Traceback (most recent call last):
  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/workspace/vllm/entrypoints/openai/api_server.py", line 737, in <module>
    engine = AsyncLLMEngine.from_engine_args(engine_args)
  File "/workspace/vllm/engine/async_llm_engine.py", line 500, in from_engine_args
    engine = cls(parallel_config.worker_use_ray,
  File "/workspace/vllm/engine/async_llm_engine.py", line 273, in __init__
    self.engine = self._init_engine(*args, **kwargs)
  File "/workspace/vllm/engine/async_llm_engine.py", line 318, in _init_engine
    return engine_class(*args, **kwargs)
  File "/workspace/vllm/engine/llm_engine.py", line 109, in __init__
    self._init_workers_ray(placement_group)
  File "/workspace/vllm/engine/llm_engine.py", line 249, in _init_workers_ray
    self._run_workers(
  File "/workspace/vllm/engine/llm_engine.py", line 795, in _run_workers
    driver_worker_output = getattr(self.driver_worker,
  File "/workspace/vllm/worker/worker.py", line 81, in load_model
    self.model_runner.load_model()
  File "/workspace/vllm/worker/model_runner.py", line 64, in load_model
    self.model = get_model(self.model_config)
  File "/workspace/vllm/model_executor/model_loader.py", line 65, in get_model
    model = model_class(model_config.hf_config, linear_method)
  File "/workspace/vllm/model_executor/models/qwen.py", line 231, in __init__
    self.transformer = QWenModel(config, linear_method)
  File "/workspace/vllm/model_executor/models/qwen.py", line 193, in __init__
    self.h = nn.ModuleList([
  File "/workspace/vllm/model_executor/models/qwen.py", line 194, in <listcomp>
    QWenBlock(config, linear_method)
  File "/workspace/vllm/model_executor/models/qwen.py", line 147, in __init__
    self.mlp = QWenMLP(config.hidden_size,
  File "/workspace/vllm/model_executor/models/qwen.py", line 49, in __init__
    self.c_proj = RowParallelLinear(intermediate_size,
  File "/workspace/vllm/model_executor/layers/linear.py", line 495, in __init__
    self.linear_weights = self.linear_method.create_weights(
  File "/workspace/vllm/model_executor/layers/quantization/gptq.py", line 100, in create_weights
    raise ValueError(
ValueError: The input size is not aligned with the quantized weight shape. This can be caused by too large tensor parallel size.

input_size_per_partitionvalue is6848, self.quant_config.group_sizevalue is128
Using a GPU--tensor-parallel-size 1works properly,but the answer is wrong:

request:
{
    "max_tokens": 200,
    "model": "qwen",
    "stream": false,
    "stop": ["<|endoftext|>","<|im_end|>","<|im_start|>"],
    "messages": [
        {
            "role": "user",
            "content": "hello"
        }
    ]
}

response:
{
    "id": "cmpl-5d4e4ffb826c4ec6972e72453d9698f9",
    "object": "chat.completion",
    "created": 599739,
    "model": "qwen",
    "choices": [
        {
            "index": 0,
            "message": {
                "role": "assistant",
                "content": "The answer is 1210."
            },
            "finish_reason": "stop"
        }
    ],
    "usage": {
        "prompt_tokens": 9,
        "total_tokens": 19,
        "completion_tokens": 10
    }
}

Qwen-14B-Chat-Int4 is not supported, or I am using it in a wrong way? Thank you for all your assistance.

1

Same problem.

Same problem. one GPU  ,work fine!  two GPU report  this error!

+1

Same problem for Qwen1.5-14B-Chat-GPTQ-Int4

This happened to me, too, Same problem for Qwen1.5-14B-Chat-AWQ

fixed it！add CUDA_VISIBLE_DEVICES params like follwing examples:
CUDA_VISIBLE_DEVICES=0,1 python -m vllm.entrypoints.api_server
--model /root/autodl-tmp/qwen/Qwen1.5-14B-Chat-GPTQ-Int4
--tensor-parallel-size 1
--gpu-memory-utilization 0.85
--max-model-len 8000
--port 8000
import os
os.environ['CUDA_VISIBLE_DEVICES'] = '0,1'
llm = LLM(model="/root/autodl-tmp/qwen/Qwen1.5-7B-Chat-GPTQ-Int4"
,tensor_parallel_size=2 ,trust_remote_code=True,dtype='float16',enforce_eager=False
,gpu_memory_utilization=0.9 ,max_model_len=9000)

Using --tensor-parallel-size 1, Everything works fine.
Using --tensor-parallel-size 2,
File "/home/ma/ENTER/envs/myenv/lib/python3.9/site-packages/vllm/model_executor/layers/quantization/awq.py", line 85, in create_weights
raise ValueError(
ValueError: The input size is not aligned with the quantized weight shape. This can be caused by too large tensor parallel size.

Using --tensor-parallel-size 1, Everything works fine.
Using --tensor-parallel-size 2, File "/home/ma/ENTER/envs/myenv/lib/python3.9/site-packages/vllm/model_executor/layers/quantization/awq.py", line 85, in create_weights raise ValueError( ValueError: The input size is not aligned with the quantized weight shape. This can be caused by too large tensor parallel size.

if u using api serve methods , actually it don't work instead of  using LLM methods .
using os.environ['CUDA_VISIBLE_DEVICES'] = '0,1' only works on LLM methods . Also i waiting for solution for  api serve methods

@lichtud
This is the explanation from GPT. There shouldn't be much difference, right? If it still doesn't work, do we need to wait for the next version for a fix?
os.environ['CUDA_VISIBLE_DEVICES'] = '0,1' sets the environment variable CUDA_VISIBLE_DEVICES to '0,1' within a Python script, meaning that the Python program will use GPU devices 0 and 1 when running.
On the other hand, CUDA_VISIBLE_DEVICES=0,1 python -m vllm.entrypoints.openai.api_server sets the environment variable CUDA_VISIBLE_DEVICES to '0,1' directly in the command line and then launches a Python module vllm.entrypoints.openai.api_server with the specified environment variable.
In terms of functionality, both methods set the environment variable CUDA_VISIBLE_DEVICES to '0,1', but they differ in the way it's done: one is within a Python script and the other is in the command line.

@lichtud This is the explanation from GPT. There shouldn't be much difference, right? If it still doesn't work, do we need to wait for the next version for a fix?
os.environ['CUDA_VISIBLE_DEVICES'] = '0,1' sets the environment variable CUDA_VISIBLE_DEVICES to '0,1' within a Python script, meaning that the Python program will use GPU devices 0 and 1 when running.
On the other hand, CUDA_VISIBLE_DEVICES=0,1 python -m vllm.entrypoints.openai.api_server sets the environment variable CUDA_VISIBLE_DEVICES to '0,1' directly in the command line and then launches a Python module vllm.entrypoints.openai.api_server with the specified environment variable.
In terms of functionality, both methods set the environment variable CUDA_VISIBLE_DEVICES to '0,1', but they differ in the way it's done: one is within a Python script and the other is in the command line.

the member of QWEN group tell me that  the kernel of vllm requires intermediate_size (13696) to be an integer multiple of quantized group_size (128) * TP(tensor-parallel-size), so currently TP can only take 1.
In addition, the intermediate_size of  Qwen1.5-72B-Chat-GPTQ-Int4 is 24576 and 7B is 11008,u can find this in config.json

the same error.   I use this:
python -m vllm.entrypoints.openai.api_server \     --model /data/model/baichuan2-13b-chat-awq/ \     --tensor-parallel-size  \     --trust-remote-code \     --quantization awq
error message
File "/home/vllm/vllm/vllm/model_executor/layers/linear.py", line 494, in __init__     self.linear_weights = self.linear_method.create_weights(   File "/home/vllm/vllm/vllm/model_executor/layers/quantization/awq.py", line 85, in create_weights     raise ValueError( ValueError: The input size is not aligned with the quantized weight shape. This can be caused by too large tensor parallel size.

so vllm don't support multi-gpus on this model

@lichtud This is the explanation from GPT. There shouldn't be much difference, right? If it still doesn't work, do we need to wait for the next version for a fix?
os.environ['CUDA_VISIBLE_DEVICES'] = '0,1' sets the environment variable CUDA_VISIBLE_DEVICES to '0,1' within a Python script, meaning that the Python program will use GPU devices 0 and 1 when running.
On the other hand, CUDA_VISIBLE_DEVICES=0,1 python -m vllm.entrypoints.openai.api_server sets the environment variable CUDA_VISIBLE_DEVICES to '0,1' directly in the command line and then launches a Python module vllm.entrypoints.openai.api_server with the specified environment variable.
In terms of functionality, both methods set the environment variable CUDA_VISIBLE_DEVICES to '0,1', but they differ in the way it's done: one is within a Python script and the other is in the command line.

the member of QWEN group tell me that the kernel of vllm requires intermediate_size (13696) to be an integer multiple of quantized group_size (128) * TP(tensor-parallel-size), so currently TP can only take 1. In addition, the intermediate_size of Qwen1.5-72B-Chat-GPTQ-Int4 is 24576 and 7B is 11008,u can find this in config.json

intermediate_size (13696)

I quantified the model using AWQ myself, the intermediate size is 13696,there is still an error

This happened to me, too, Same problem for Qwen1.5-14B-Chat-AWQ

I meet the same problem , do you have any solutions ?

This model is just not supported. Don't use parallelism.
end.

for me that worked on other serving engine but with the same problem was change de group_size in the quant process to accomplish with the requiriment of been multiply of

for me that worked on other serving engine but with the same problem was change de group_size in the quant process to accomplish with the requiriment of been multiply of

how did u solve for 4 gpus which group_size I have to use?

qwen2-72b has same issue using gptq and parallelism, but solve the issue by this method:

group_size sets to 64/32,  fits intermediate_size (29568=1283711) to be an integer multiple of quantized group_size  * TP(tensor-parallel-size)，but group_size sets to 27*11=154, it is not ok.

correct "GPTQ_MARLIN_MIN_THREAD_K = 128" to 64/32 in file
"python3.10/dist-packages/vllm/model_executor/layers/quantization/gptq_marlin.py"

@lichtud This is the explanation from GPT. There shouldn't be much difference, right? If it still doesn't work, do we need to wait for the next version for a fix?
os.environ['CUDA_VISIBLE_DEVICES'] = '0,1' sets the environment variable CUDA_VISIBLE_DEVICES to '0,1' within a Python script, meaning that the Python program will use GPU devices 0 and 1 when running.
On the other hand, CUDA_VISIBLE_DEVICES=0,1 python -m vllm.entrypoints.openai.api_server sets the environment variable CUDA_VISIBLE_DEVICES to '0,1' directly in the command line and then launches a Python module vllm.entrypoints.openai.api_server with the specified environment variable.
In terms of functionality, both methods set the environment variable CUDA_VISIBLE_DEVICES to '0,1', but they differ in the way it's done: one is within a Python script and the other is in the command line.

the member of QWEN group tell me that the kernel of vllm requires intermediate_size (13696) to be an integer multiple of quantized group_size (128) * TP(tensor-parallel-size), so currently TP can only take 1. In addition, the intermediate_size of Qwen1.5-72B-Chat-GPTQ-Int4 is 24576 and 7B is 11008,u can find this in config.json


Creting multiple cards.

I am adding card using this library, it creating multiple card in a single request and when i came back into this activity again at anytime, it creates same no of cards without even requesting.

What “cards” are you referring to exactly? Anyway, it seems this is not specific to this library and you can look up the behavior and documentation of Android’s WebView for reference.


[RESOLVED] Unavailable by ICMP ping

Problem started at 21:47:16 on 2023.05.22
Problem name: Unavailable by ICMP ping
Host: ST-FG
Severity: High
Operational data: Down (0)
Original problem ID: 21631
Event details in Zabbix: http://<IP_ADDRESS>/tr_events.php?triggerid=23133&eventid=21631

Problem has been resolved in 9h 50m 0s at 07:37:16 on 2023.05.23
Problem name: Unavailable by ICMP ping
Host: ST-FG
Severity: High
Original problem ID: 21631


[Page] Zip

Migrate Zip page from vue-element-admin

Work on this tonight should be easy to add :)

Done.


Serialization issues with calling testnet smart contract due to incompatibility with v1.82

Context:

Recently walking through the simple testnet smart contract deployment example on Docs

The Issue:

After successful deployment of smart contract of sp-testing-proximity.testnet, when trying to make a function call, I ran into the following error:

Error:
0: Error: An error occurred during a FunctionCall Action, parameter is debug message.
CompilationError(PrepareError(Deserialization))

The solution:

On Discord @PiVortex had noted this can been resolved by:
Downgrading to 1.81.0 (navigated to smart contract directory and ran rustup override set 1.81.0, and then redeploying the smart contract. See my notes on resolution in Discord

Request:

Wanted to see if it's possible to fix this issue via the NEAR CLI to be compatible with 1.82? Feel free to migrate issue if this is not the correct repo to note on.

CC: @frol , @gagdiez, @PiVortex

This can be resolved by upgrading to the most recent version of cargo-near and using the most recent version of near workspaces. This is not do with the CLI AFIAK

Thanks for your help!


Support for CPack to automate package creation

Consider using CPack from CMake to automate package creation as part of the CI build process. CPack should support all the required package formats, including dmg and MSI.
https://cmake.org/cmake/help/latest/manual/cpack-generators.7.html

Hi, DJV does currently use CPack for package creation, including dmg and MSI files. A nice thing to add would be to have the CI process generate those packages and deploy them automatically as GitHub releases; I have a separate issue for that, so if you don't mind I'm going to close this issue.
https://github.com/darbyjohnston/DJV/issues/156


fix: fix values.schema.json for extraArgs

what
Fixes #365. This changes the array item type back to string for extraArgs, which seems to have been erroneously changed in #356

why
Even if this wasn't erroneously, it should've been a breaking change.

tests

references

pfft im over here troubleshooting and tracking down the problem and you ninja a PR for the change <3

Hi @kvanzuijlen, this was indeed by mistake, thank you for the fix 🙏. We can add a CI test file to create these annotations and make sure this doesn’t get reverted. If you can add it to the PR I appreciate it, otherwise we’ll do it later.

Hi @GMartinez-Sisti,
I was already planning on adding some CI tests (not only for this one) at a later moment, but I won't be available for the next 2 weeks.

Hi @GMartinez-Sisti,
I was already planning on adding some CI tests (not only for this one) at a later moment, but I won't be available for the next 2 weeks.

Whenever you can it's perfect 😄. Thank you!


Console cursor atop shell path + showing password as shell name

Does this issue occur when all extensions are disabled?: Yes

VS Code Version: 1.71.0
OS Version: Darwin x64 21.6.0

Steps to Reproduce:

Open VSCode, either by command line or Dock
Open a new console
The cursor will be atop the branch name, and there are two symbols, %{, at the end of my console. (yes, this is a template i made, but it was working before i updated, and it works on iterm2, as it always has before)
Open a new terminal, and the shell will have something like a name. For some reason, it is reading a local variable on my ~/.zshrc called PWD, thus the console has a name that is a meaningful password.

settings.json
{
  "workbench.iconTheme": "material-icon-theme",
  "security.workspace.trust.untrustedFiles": "open",
  "editor.wordWrap": "on",
  "[typescript]": {
    "editor.defaultFormatter": "esbenp.prettier-vscode"
  },
  "todo-tree.general.enableFileWatcher": true,
  "todo-tree.highlights.useColourScheme": true,
  "[jsonc]": {
    "editor.defaultFormatter": "esbenp.prettier-vscode"
  },
  "[json]": {
    "editor.defaultFormatter": "esbenp.prettier-vscode"
  },
  "cSpell.userWords": ["dtos", "nestjs"],
  "jest.showTerminalOnLaunch": false,
  "jest.autoRun": {
    "watch": false,
    "onSave": "test-src-file"
  },
  "sort-imports.languages": ["javascript", "typescript"],
  "editor.formatOnSave": true,
  "typescript.updateImportsOnFileMove.enabled": "always",
  "settingsSync.ignoredExtensions": []
}

List of extensions:
<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>

disabling shell integration will fix this as a temporary workaround
"terminal.integrated.shellIntegration.enabled": false

if you could provide your .zshrc, that would be helpful for us to investigate this

PWD means "print working directory", if you have a plain text password in there that is very bad, you shouldn't have a plain text password anywhere in your environment.

@mikibakaiki can you paste in the output of echo $PS1, also do you have any prompt or zsh plugins installed?

PS1 result:
$FG[237]------------------------------------------------------------%{$reset_color%}
$FG[032]%(4~|~/.../%2~|%~)\
$(git_prompt_info) \
$FG[105]%(!.#.$)%{$reset_color%}

I have oh-my-zsh installed, with it's default git plugin.

I have the same issue
My PS1 result is
$FG[237]------------------------------------------------------------%{$reset_color%}
$FG[032]%~\
$(git_prompt_info) %* \
$FG[105]%(!.#.»)%{$reset_color%}

I'm also using zsh and this is my .zshrc file (with all comments removed)
ZSH_THEME="Gireg"
plugins=(git)

source $ZSH/oh-my-zsh.sh
export PATH="$PATH:$HOME/.rvm/bin"

[[ -s "$HOME/.avn/bin/avn.sh" ]] && source "$HOME/.avn/bin/avn.sh" # load avn

export ANDROID_SDK_ROOT="/usr/local/share/android-sdk"
export ANDROID_HOME=$HOME/Library/Android/sdk
export PATH=$PATH:$ANDROID_HOME/platform-tools
export PATH=$PATH:$ANDROID_HOME/tools
export PATH=$PATH:$ANDROID_HOME/tools/bin
export PATH=$PATH:$ANDROID_HOME/emulator

alias gti="git"
function emulator { ( cd "$(dirname "$(whence -p emulator)")" && ./emulator "$@"; ) }

if [ -f ~/.bash_completion ]; then
  . ~/.bash_completion
fi

export LC_ALL=en_US.UTF-8
export LANG=en_US.UTF-8

export PATH=$PATH:~/Documents/flutter/bin
export PATH="/usr/local/sbin:$PATH"
export PATH="/usr/local/opt/node@16/bin:$PATH"

and my oh-my-zsh.sh file is
# Check for updates on initial load...
if [ "$DISABLE_AUTO_UPDATE" != "true" ]; then
  env ZSH=$ZSH DISABLE_UPDATE_PROMPT=$DISABLE_UPDATE_PROMPT zsh -f $ZSH/tools/check_for_upgrade.sh
fi

# Initializes Oh My Zsh

# add a function path
fpath=($ZSH/functions $ZSH/completions $fpath)

# Load all stock functions (from $fpath files) called below.
autoload -U compaudit compinit

: ${ZSH_DISABLE_COMPFIX:=true}

# Set ZSH_CUSTOM to the path where your custom config files
# and plugins exists, or else we will use the default custom/
if [[ -z "$ZSH_CUSTOM" ]]; then
    ZSH_CUSTOM="$ZSH/custom"
fi

# Set ZSH_CACHE_DIR to the path where cache files should be created
# or else we will use the default cache/
if [[ -z "$ZSH_CACHE_DIR" ]]; then
  ZSH_CACHE_DIR="$ZSH/cache"
fi

# Load all of the config files in ~/oh-my-zsh that end in .zsh
# TIP: Add files you don't want in git to .gitignore
for config_file ($ZSH/lib/*.zsh); do
  custom_config_file="${ZSH_CUSTOM}/lib/${config_file:t}"
  [ -f "${custom_config_file}" ] && config_file=${custom_config_file}
  source $config_file
done

is_plugin() {
  local base_dir=$1
  local name=$2
  test -f $base_dir/plugins/$name/$name.plugin.zsh \
    || test -f $base_dir/plugins/$name/_$name
}
# Add all defined plugins to fpath. This must be done
# before running compinit.
for plugin ($plugins); do
  if is_plugin $ZSH_CUSTOM $plugin; then
    fpath=($ZSH_CUSTOM/plugins/$plugin $fpath)
  elif is_plugin $ZSH $plugin; then
    fpath=($ZSH/plugins/$plugin $fpath)
  fi
done

# Figure out the SHORT hostname
if [[ "$OSTYPE" = darwin* ]]; then
  # macOS's $HOST changes with dhcp, etc. Use ComputerName if possible.
  SHORT_HOST=$(scutil --get ComputerName 2>/dev/null) || SHORT_HOST=${HOST/.*/}
else
  SHORT_HOST=${HOST/.*/}
fi

# Save the location of the current completion dump file.
if [ -z "$ZSH_COMPDUMP" ]; then
  ZSH_COMPDUMP="${ZDOTDIR:-${HOME}}/.zcompdump-${SHORT_HOST}-${ZSH_VERSION}"
fi

if [[ $ZSH_DISABLE_COMPFIX != true ]]; then
  # If completion insecurities exist, warn the user without enabling completions.
  if ! compaudit &>/dev/null; then
    # This function resides in the "lib/compfix.zsh" script sourced above.
    handle_completion_insecurities
  # Else, enable and cache completions to the desired file.
  else
    compinit -d "${ZSH_COMPDUMP}"
  fi
else
  compinit -i -d "${ZSH_COMPDUMP}"
fi

# Load all of the plugins that were defined in ~/.zshrc
for plugin ($plugins); do
  if [ -f $ZSH_CUSTOM/plugins/$plugin/$plugin.plugin.zsh ]; then
    source $ZSH_CUSTOM/plugins/$plugin/$plugin.plugin.zsh
  elif [ -f $ZSH/plugins/$plugin/$plugin.plugin.zsh ]; then
    source $ZSH/plugins/$plugin/$plugin.plugin.zsh
  fi
done

# Load all of your custom configurations from custom/
for config_file ($ZSH_CUSTOM/*.zsh(N)); do
  source $config_file
done
unset config_file

# Load the theme
if [ "$ZSH_THEME" = "random" ]; then
  themes=($ZSH/themes/*zsh-theme)
  N=${#themes[@]}
  ((N=(RANDOM%N)+1))
  RANDOM_THEME=${themes[$N]}
  source "$RANDOM_THEME"
  echo "[oh-my-zsh] Random theme '$RANDOM_THEME' loaded..."
else
  if [ ! "$ZSH_THEME" = ""  ]; then
    if [ -f "$ZSH_CUSTOM/$ZSH_THEME.zsh-theme" ]; then
      source "$ZSH_CUSTOM/$ZSH_THEME.zsh-theme"
    elif [ -f "$ZSH_CUSTOM/themes/$ZSH_THEME.zsh-theme" ]; then
      source "$ZSH_CUSTOM/themes/$ZSH_THEME.zsh-theme"
    else
      source "$ZSH/themes/$ZSH_THEME.zsh-theme"
    fi
  fi
fi

and my "Gireg" Theme is
# af-magic.zsh-theme
# Repo: https://github.com/andyfleming/oh-my-zsh
# Direct Link: https://github.com/andyfleming/oh-my-zsh/blob/master/themes/af-magic.zsh-theme

if [ $UID -eq 0 ]; then NCOLOR="red"; else NCOLOR="green"; fi
local return_code="%(?..%{$fg[red]%}%? ↵%{$reset_color%})"

# primary prompt
PROMPT='$FG[237]------------------------------------------------------------%{$reset_color%}
$FG[032]%~\
$(git_prompt_info) %* \
$FG[105]%(!.#.»)%{$reset_color%} '
PROMPT2='%{$fg[red]%}\ %{$reset_color%}'
RPS1='${return_code}'

# color vars
eval my_gray='$FG[237]'
eval my_orange='$FG[214]'

# right prompt
if type "virtualenv_prompt_info" > /dev/null
then
	RPROMPT='$(virtualenv_prompt_info)$my_gray%n@%m%{$reset_color%}%'
else
	RPROMPT='$my_gray%n@%m%{$reset_color%}%'
fi

# git settings
ZSH_THEME_GIT_PROMPT_PREFIX="$FG[075]($FG[078]"
ZSH_THEME_GIT_PROMPT_CLEAN=""
ZSH_THEME_GIT_PROMPT_DIRTY="$my_orange*%{$reset_color%}"
ZSH_THEME_GIT_PROMPT_SUFFIX="$FG[075])%{$reset_color%}"

Hope this helps.


Support Windows 10

Another user wrote:

Windows 10 / Python 3
Installed ffmpeg with chocolaty.
When I run the following command it outputs the following and does nothing:
subsync 01.mkv -i 01.srt -o 01x.srt
extracting speech segments...
0%| | 0/3575.168 [00:00<?, ?it/s]

I see that ffmpeg is running with the following options but it seems to be doing nothing.
ffmpeg.exe -i 01.mkv -f s16le -ac 1 -acodec pcm_s16le -ar 48000 -

See #4

Thanks for thinking of the Windows users. :))

On a Windows 7 x64 box, using Python 2.7.15 and 3.7.2, I had issues with subsync freezing running ffmpeg. After about 15 seconds, or ~60% the way thru a 1.6GB .mp4, the progress bar would just stop. The CPU didn't peg, but the progress bar just got stuck. I couldn't Ctrl-C, I had to kill the app with Task Manager.
I found that if I changed quiet=True to quiet=False at https://github.com/smacke/subsync/blob/master/subsync/subsync.py#L114 , then it would complete without locking up.

For Windows 7, see also #19. @rasa this suggests to me that maybe on Win7, the stderr pipe is filling up. Probably ffmpeg is getting chatty on stderr (as it sometimes does) about 60% of the way through processing. Since there's nobody reading stderr, maybe that's why it is hanging.
The typical way around this is to use subprocess.communicate, but I want to avoid reading all of stdout and stderr at once since a lot of data can get written to stdout in this case. Another thing we can do is just show the output of stderr, but I'd like to avoid this if possible. My solution is to spawn a separate thread that consumes stderr; see 1ea37d5.
@rasa if you reinstall via pip install git+https://github.com/smacke/subsync I think your problem should go away; if not please let me know.

@postacik I am starting to think that the issue you experienced in #4 might be the same as what @rasa experienced here, especially given the strange behavior re. mkv files. If you have a moment to test on your failing cases after reinstalling (via pip install git+https://github.com/smacke/subsync), I am very keen to hear the result!

I did pip install git+https://github.com/smacke/subsync and then retried with mkv file.
It took some time to start extracting audio but voila!
subsync x.mkv -i i.srt -o o.srt
INFO:subsync.subsync:extracting speech segments...
431.35710416666666it [00:02, 163.38it/s]
INFO:subsync.subsync:...done.
INFO:subsync.subsync:computing alignments...
INFO:subsync.subsync:...done.

Thanks...

@smacke After reverting my hack, and upgrading, I am unable to reproduce the lockups, after testing with multiple inputs. Thanks for the quick fix!

For Windows 7, see also #19. @rasa this suggests to me that maybe on Win7 (or maybe just for your video), the stderr pipe is filling up. Probably ffmpeg is getting chatty on stderr (as it sometimes does) about 60% of the way through processing. Since there's nobody reading stderr, maybe that's why it is hanging.
The typical way around this is to use subprocess.communicate, but I want to avoid reading all of stdout and stderr at once since a lot of data can get written to stdout in this case. Another thing we can do is just show the output of stderr, but I'd like to avoid this if possible. Ideally we would send stderr to /dev/null, but ffmpeg-python doesn't expose this very well. My solution is to spawn a separate thread that consumes stderr; see 1ea37d5.
@rasa if you reinstall via pip install git+https://github.com/smacke/subsync I think your problem should go away; if not please let me know.

you don't have to use ffmpeg-python, just do something like this:
    args = [
        'ffmpeg',
        '-loglevel', 'fatal',
        '-nostdin',
        '-i',
        fname,
        '-f', 's16le',
        '-ac', '1',
        '-acodec', 'pcm_s16le',
        '-ar', '48000',
        '-'
    ]
    process = subprocess.Popen(args, stdin=None, stdout=subprocess.PIPE, stderr=None)

@postacik @rasa Thank you both so much for confirming the fix!
@hichenming I think your strategy probably makes more sense; we're not really using much of the functionality of ffmpeg-python, and the extra readability maybe isn't worth the extra dependency...

I know nothing about Python, but I do use ffmpeg in Windows 10 using createprocess and pipes. ffmpeg only outputs to stderr on Windows, you will get nothing on stdout.


Vagrant: 1.7.3 -> 1.7.4 (ZHF)

Update Vagrant to 1.7.4 version and fix embedded bundler path, so the build wouldn't fail. Built and tested on x86_64.

Built locally, thanks.


ungroup is not working

I am trying to ungroup/flatten a group object and i am not able to perform the same.
It is giving error as "Uncaught TypeError: Cannot read property 'nodeName' of null"
I am giving the SVG container element as the parameter with null value for the depth.
Code :
var grpDraw = SVG('cvs');
var groupElement = SVG("groupId");
groupElement.ungroup(grpDraw );
Please let me know where i am going wrong.
Thanks in Advance.
Regards,
Santhosh.M

Neither SVG('cvs') nor SVG("groupId") can be a group. The SVG-command creates a new SVG in the node with the given id. It has nothing to do with creating groups. Please try to fix that first

Sorry my mistake,
I need to send the parent document of the group which needs to be ungrouped.
I am sending
var groupElement = SVG.get("groupId");
groupElement.ungroup(groupElement.parent());
Sorry now it is working without any issues.
Thanks a lot once again for pointing out the silly mistake that i had made.


DotNet 4.7.2 final has been released

As of 4/30/2018 it seems that 4.7.2 is now the current version of .NET
I see packages for netfx and dotnet 4.7.2 but they are preview only. Any chance we can get them update to the new code.
Thanks.

Thanks, I've been awaiting the release, yet I still missed it. I'll update the packages today or tomorrow (you can speed things up with a pull request).

https://chocolatey.org/packages/dotnetfx/<IP_ADDRESS>
https://chocolatey.org/packages/netfx-4.7.2-devpack


Fix GetSDKReferenceFiles folder compare bug

Bug when the directoryToFileList started with the redistFilePath but
was not actually a match (e.g. folder ending in ARM would watch ARM64).
To fix the issue I added a trailing slash to both sides.

LGTM


Buddy list (right sidebar) is cluttered with inactive users.

There should be a user and org-wide settings that hide inactive users from the right sidebar. Discussion on how to tackle this can be found at https://chat.zulip.org/#narrow/stream/137-feedback/topic/USERS-list-noisy. This is a highly-wanted feature in addition to #9125 for screen real-estate decluttering.

@rht can you elaborate on why you want this? As Tim said we already hide inactive users "who have been active in the last 3 weeks or so".

Is that the definition of "inactive" status, i.e. being offline for 3 weeks or longer?

Would like that as well, we have many inactive users. How can we enable this if it already exists and is so far only enabled for "large organizations"?

Our next step for the right sidebar is https://github.com/zulip/zulip/pull/26717. It would be interesting to think about offering users some control after that. Right now, we just use this logic: https://chat.zulip.org/#narrow/stream/101-design/topic/buddy.20list.20split.20users.20.2326717/near/1669158.


Observability : Memory leak when an gRPC client is available

Description:
When there is a gRPC client is available and the observability is enabled, the response from the metrics endpoint grows linearly based on the gRPC calls made by the gRPC client. When we observe the response from metrics endpoint, we can see that the grpc_message_content is also there as a key. In other words, there is a record for each and every gRPC event we send.
Steps to reproduce:
Include a gRPC Client inside the ballerina project. Enable observability metrics. Run the project such that the gRPC client is invoked a few times. And call the metrics endpoint.
Affected Versions:
1.1.4
OS, DB, other environment details and versions:
MacOS-Mojave
Related Issues (optional):

Suggested Labels (optional):
Bug
Suggested Assignees (optional):
@grainier

@nadundesilva Please add if there is anything missing.

This issue was due to gRPC message content is added as metrics value.


helm init --upgrade will downgrade

Don't downgrade tiller unless "--force" is supplied to helm init.
Fixes #2774

This change is


Functions not showing in my blueprint although plugin is loaded

Hi,
In UE 5.1.1 I can see that my plugin is loaded when I search UDP in the plugin manger / settings.
However, when I go into a blueprint, and I right click to search for any of the UDP components - nothing shows up from UDP.
In a different project, I do find them.
Do you know what could be causing this?
Thank you

add a udp component to an actor first then from that component your functions will show up


ci(check-build-depends): use ROS container

Description

I guess now it can be tested with ROS containers.
Pre-review checklist for the PR author
The PR author must check the checkboxes below when creating the PR.

[x] I've confirmed the contribution guidelines.
[x] The PR follows the pull request guidelines.

In-review checklist for the PR reviewers
The PR reviewers must check the checkboxes below before approval.

[ ] The PR follows the pull request guidelines.

Post-review checklist for the PR author
The PR author must check the checkboxes below before merging.

[ ] There are no open discussions or they are tracked via tickets.

After all checkboxes are checked, anyone who has write access can merge the PR.

CI: https://github.com/autowarefoundation/autoware.universe/runs/8108322744?check_suite_focus=true

Worked: https://github.com/autowarefoundation/autoware.universe/runs/8110132782?check_suite_focus=true
@KeisukeShima What do you think about this? :thinking:


How to control to MEMORY used by PROST

Hi，
Thanks for developing this useful package.
Here is my issue: I got an data of 133,350 cells with 20,000 genes . In an machine with 500GB memory I run the PROST function but failed by "Unable to allocate"

Is there anyway to limit the memory cost of PROST ？
Or how many memory should I prepare for this dateset ?
Thanks
Lidong GUo

Thanks very much for your feedback about memory usage, this is one of our shortcomings as we use an adjacency matrix approach when building graph neural networks, which results in slower runs and heavier memory burden on larger datasets. We might improve it at a later stage by using sparse matrices or by using DGL.
I see that you are using the function spatial_autocorrelation, you may be able to mitigate this by reducing the size of the  permutations.


drop Result from Mustache::parse

Mustache::parse doesn't fail so it doesn't need to return a Result. Refactor it out.

/bounty $20


Remove PDFWorkerUtil and move its contents into PDFWorker instead

This is possible thanks to features, i.e. private fields and in particular static initialization blocks, that didn't exist back when we started using classes in the code-base.
Smaller diff with https://github.com/mozilla/pdf.js/pull/18507/files?w=1

/botio test

Looks good!


Upload coverage to Codecov

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@43498f0). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master      #40   +/-   ##
=========================================
  Coverage          ?   40.84%
  Complexity        ?        1
=========================================
  Files             ?        6
  Lines             ?      142
  Branches          ?        7
=========================================
  Hits              ?       58
  Misses            ?       84
  Partials          ?        0

Flag
Coverage Δ

functional
40.84% <0.00%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 43498f0...a10cb38. Read the comment docs.


Bug: ø% isn't working...

Describe the bug
When I use the ø% element, it doesn't do anything.
Example program
`banana`ø%

Try it
Expected Output
b493d48364afe44d11c0165cf470a4164d1e2609911ef998be868d46ade3de4e

Other things

Version 2.21.6
Seems to pass tests for some reason.

This was an issue with the website. It just needed manual reloading. Not a bug.

phew


calling enableAudioVolumeIndication causes crash

react-native-agora 3.4.2
audio calls are generally working in our build; however, calling enableAudioVolumeIndication causes a crash on my ios device (iphone 11 Pro Max), but not on the simulator. Not sure how to proceed in debugging: any ideas?
-raeez
init = async context => {
     const {appID} = context;
     if (!context.roomEngine) {
       console.log(`creating RtcEngine with ${appID}`);
       this.engine = await RtcEngine.create(appID);
       context.csetState({roomEngine: this.engine});
       await this.engine.disableVideo();
       //await this.engine.enableDeepLearningDenoise(true);
       //await this.engine.enableAudioVolumeIndication(300, 3); // causes a crash!

       this.engine.addListener('Warning', wrn => {
         console.warn('Warning', wrn);
       });

       this.engine.addListener('ActiveSpeaker', uid => {
         console.log('onActiveSpeaker', uid);
         context.csetState({activeSpeakerUID: uid});
       });

       // ... more listeners
}

upgrading to react-native 0.65 (from 0.64) seems to have resolved the issue


Submission workflow improvements

What is the expected enhancement?

[ ] add tier in submission form
[x] update pr on issue update (#453)
[ ] turn of issue tests

Hola @IceKhan13 :)
what do you mean by :

[ ] turn of issue tests

?

tests were failing a lot and what I thought is to turn off tests on submission. Only run them, when project already in ecosystem. But it's up to you. I do not have strong opinion on that. My problem with that was tests were failing a lot. If we fix tests then it's ok to have them on submission, but if they are failing, we need to turn them off to save user form confusion.

Tier should be 'Community' by default

tests were failing a lot and what I thought is to turn off tests on submission. Only run them, when project already in ecosystem. But it's up to you. I do not have strong opinion on that. My problem with that was tests were failing a lot. If we fix tests then it's ok to have them on submission, but if they are failing, we need to turn them off to save user form confusion.

Those last issues we improve a lot the tests make them passed :)
I think we can put this option for disabled tests aside for a moment.

~[ ] turn of issue tests~

Hi @IceKhan13 :)
As the future of tiers are discussing in the NFC and tests are being disabled in waiting for what we want for the future of Ecosystem I'm closing the issue, do not hesitate to reopen it you think I'm mistaking ^^'


Add 'os_schedule_priority' setting.

This setting will allow to control schedule priority of query execution threads with nice (or pthread_setschedprio or setpriority or sched_setparam or sched_setattr).
Caveats:

it may not work as expected;
it is not intended as proper implementation of resource sharing;
as we use thread pool, we must reset priority when thread finished processing the query;

I think it's worth to try it. We're going to have troubles with priority inversion, though. The first thing that comes to mind is DB::RWLock that is used to lock table structure for ALTERs. Fortunately we don't have many "heavyweight" locks such as row or table locks. In general, this is a problem for every synchronization primitive more complex than plain mutex, even for condition variables. I don't know CH internals enough to say which other resources are shared between queries and may require waiting.
We probably don't have to worry about IO prioritization, because on modern Linux the IO priority is inherited from thread priority.
To implement a nice-based prioritization, we must consider how CH works with threads. It does not create system threads directly for every query, but uses a thread pool named ThreadPoolGlobal. This pool consists of a number of threads that persist for the lifetime of the server process. These threads are used to execute jobs from a queue that is populated by the queries.
The job queue supports priorities, but apparently they are never used. These priority values go the other way, i.e. higher value means higher priority. This system should be integrated with the nice-based priority values, so that when an execution thread becomes available, we start with the most prioritized job.
The threading API used by the pool is std::thread. It doesn't have any knobs to control priority, but we can get an underlying pthread handle with native_handle(). Then we would set its priority with pthread_setschedprio(), getting the available range from sched_get_priority_min/max(). I'm not sure whether the same code is going to work on FreeBSD or Mac OS, and what is an unerlying object there. The actual priority value should be stored in ThreadGroupStatus.
Another relevant point is that CH already has a query priority system. Its implementation is pretty straightforward, though somewhat brutal: the query calls sleep() if there are any queries that have higher priority. The check happens each time the query reports progress. This system makes no attempt to prevent priority inversion, and we've had troubles before specifically with ALTERs [1]. Despite not being documented, this prioritization system has some users.
Using both systems at the same time makes little sense, so we could add a setting like priority_backend = {sleep, nice}, and make priority values compatible between these backends. Maybe even make them the same as Linux nice values {-20..19}, though I don't like the negatives and would prefer {0..39}.

https://nda.ya.ru/3VBiuB

P.S. After writing this, I realized that the Processors PR is going to completely change the way we schedule jobs, and it's unclear whether it is going to benefit from OS prioritization. We should probably wait for it and then reconsider.

The job queue supports priorities, but apparently they are never used.

This is priority of job to pick when thread pool is full. We cannot use it before "Processors" implementation because we schedule long-running jobs and we cannot postpone lower-priority queries for that time. More specifically, every query creates it's own private sub-pool and uses it exclusively.

This system should be integrated with the nice-based priority values, so that when an execution thread becomes available, we start with the most prioritized job.

Then we would set its priority with pthread_setschedprio(), getting the available range from sched_get_priority_min/max(). I'm not sure whether the same code is going to work on FreeBSD or Mac OS, and what is an unerlying object there.

Using both systems at the same time makes little sense, so we could add a setting like priority_backend = {sleep, nice}, and make priority values compatible between these backends. Maybe even make them the same as Linux nice values {-20..19}, though I don't like the negatives and would prefer {0..39}.

I prefer "worse is better" approach. We will introduce a new setting os_schedule_priority that will be completely unrelated and independent to priority. It will be directly mapped to nice value. We will not care about sched_get_priority_min/max because nice values are clamped to that interval. It will work only on Linux. ClickHouse postinstall script will try to enable CAP_SYS_NICE. PS. nice values and "realtime" priorities are different things. We will use nice values, because "realtime" priorities are more dangerous.

native_handle()

We will use gettid that is syscall, but very cheap. With native_handle you only get pthread_t but cannot get tid.


Zap changes the final invoice amount in BTC when switching between sats and dollars.

video_2019-09-04_19-06-18.zip

Zap version: 0.2.4-alpha
Device: Samsung Galaxy S8
LND Version: 0.7.1-beta

Hey @Relaxo143 ,
happy to hear from you again!
Thanks for the report and the awesome video! 🎉
You are right, this should not happen.
We will investigate and give you an update on the progress. 🔍

Hey @Relaxo143
Thanks for report and the video!
I am aware of this behaviour but thought this is not a big deal.
When paying an invoice, you will notice this does not happen. The reason is here we have a fixed amount of satoshis I can refer to.
When making an own invoice, right now it just converts and rounds the values each time you swich the unit.
But you are right should not be that way. We will fix this!

Hey @Relaxo143
Thanks for report and the video!
I am aware of this behaviour but thought this is not a big deal.
When paying an invoice, you will notice this does not happen. The reason is here we have a fixed amount of satoshis I can refer to.
When making an own invoice, right now it just converts and rounds the values each time you swich the unit.
But you are right should not be that way. We will fix this!

Thanks for this. If you could include the newest translations and longer invoice expiry times in the patch it would be perfect!

Fixed in 0.2.6


Weird iframe - correct behavior?

Hi :)
I found a website that had this markup in it:
<iframe src="" class="updates-iframe"></iframe>
It was hidden by CSS and it's used in the page's JS code to get some updates later on.
However, with AngleSharp this resulted in an endless loop - the src="" resolved to doc.DocumentUri which kept loading itself again and again.
Not sure what the bug is here but doesn't sound like correct behavior.
What do you think?

This is certainly a bug. I am not quite sure about the correct behavior. I need to test this. If you ask me there are two possible ways:

It indeed would load the root page, but as this would be circular it would be forbidden (general circular detection for iframes)
It does not load anything when the source is empty

I will try to look this up on the spec, but my gut feeling is with 1, as it would also solve other potential problems (e.g., imagine a.html has an iframe to b.html, which again has an iframe to a.html).

Does CSS come into it? i.e. would the iframe load, even if it's hidden?
(1) is what I did as a quick fix: if(frame.Source == frame.Owner.DocumentUri) abort kinda thing.

CSS has no impact on the behavior in this case, i.e., yes, the iframe would be loaded even though CSS says otherwise.

Ok let me know what the spec is - I can send a PR, it's easy enough.


Submit new NEP-43

Co-authored-by: Xu Jizhe<EMAIL_ADDRESS>Checklist:

[x] I have read the NEP Guideline document.
[x] I have checked my NEP Draft is ready.

Discussion for NEP-43 under #43

@liuyong5653 @weixuefeng @zhouxiqiao

merged.


ADD Polar RZ algorithm

It includes:

1 = +V volts for half bit duration then return to zero
0 = -V volts for half bit duration then return to zero

Follow the new way to create encoding and decoding functions.


VeRA not working with Quantization

System Info
Latest stable versions of PEFT, Accelerate and Transformers.
I am working on Quantization + PEFT techniques. I plan to implement BnB 4bit NF Double quantization with the new PEFT Method VeRA. I try to keep target modules as "all-linear" just as I do in LoRA. But I keep getting an error saying the expected dimension is not the same. Here is the error:
File "/work/sshyamsu/quantization_peft/common/model_utils.py", line 229, in get_accelerate_model     model = get_peft_model(model, peft_config)             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^   File "/home/sshyamsu/miniconda3/envs/thesis311/lib/python3.11/site-packages/peft/mapping.py", line 145, in get_peft_model     return PeftModel(model, peft_config, adapter_name=adapter_name)            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^   File "/home/sshyamsu/miniconda3/envs/thesis311/lib/python3.11/site-packages/peft/peft_model.py", line 138, in __init__     self.base_model = cls(model, {adapter_name: peft_config}, adapter_name)                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^   File "/home/sshyamsu/miniconda3/envs/thesis311/lib/python3.11/site-packages/peft/tuners/vera/model.py", line 102, in __init__     super().__init__(model, config, adapter_name)   File "/home/sshyamsu/miniconda3/envs/thesis311/lib/python3.11/site-packages/peft/tuners/tuners_utils.py", line 165, in __init__     self._pre_injection_hook(self.model, self.peft_config[adapter_name], adapter_name)   File "/home/sshyamsu/miniconda3/envs/thesis311/lib/python3.11/site-packages/peft/tuners/vera/model.py", line 162, in _pre_injection_hook     self._init_vera_A_vera_B(config, adapter_name)   File "/home/sshyamsu/miniconda3/envs/thesis311/lib/python3.11/site-packages/peft/tuners/vera/model.py", line 148, in _init_vera_A_vera_B     first_linear_out_dim, first_linear_in_dim = self._find_first_dim(config)                                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^   File "/home/sshyamsu/miniconda3/envs/thesis311/lib/python3.11/site-packages/peft/tuners/vera/model.py", line 136, in _find_first_dim     raise ValueError( ValueError: Multiple target layers with different dimensions were specified. VeRA only supports a single dimension size. Expected shape (8388608, 1), got (22544384, 1).
Who can help?
No response
Information

[X] The official example scripts
[ ] My own modified scripts

Tasks

[ ] An officially supported task in the examples folder
[X] My own task or dataset (give details below)

Instruction tuning Dataset - Unnatural Instructions Core
Reproduction
Just quantizing the model using bnb and doing get_peft_model
Expected behavior
Should return a PEFT model with VeRA modules added to it

@BenjaminBossan @sayakpaul

When layers are quantized by bitsandbytes, their weights are packed into flat tensors. This is why you see shapes like (8388608, 1). Here is an example:
from transformers import AutoModelForCausalLM

model = AutoModelForCausalLM.from_pretrained(model_id, load_in_4bit=True)
model.model.decoder.layers[0].self_attn.k_proj.weight.shape
# prints torch.Size([294912, 1])

The true shape of this weight is 768x768. If you check the quant state, you can see it:
model.model.decoder.layers[0].self_attn.k_proj.weight.quant_state.shape
# prints torch.Size([768, 768])

Note that if you calculate 768*768, you get 589824, which is twice 294912 that we saw above. This is because of the way that bitsandbytes packs 4bit data.

Okay thank you. Will the PEFT method in the future be able to handle this? Usually whenever a new PEFT metho comes out, I think people are very interested to see its combination with Quantization methods

Adding quantization support to VeRA would be quite nice. If we find that VeRA is well adopted and there is demand for quantization support, we can put some time into it. If there is a contribution of this feature by the community, that would be even better ;) It sounded to me like you're actually working on this feature, did I understand that right? If you want, you could create a draft PR, even if it does not work, and I can take a look.

Thanks Benjamin. That sounds interesting, maybe I can think about it in the future. Unfortunately right now I have a deadline on my research on Quantization+Peft.


[Subtask] add partition pre event for Gravitino server

Describe the subtask

add corresponding PartitionPreEvent
generate pre-event in PartitionEventDispatcher
add test in TestPartitionEvent
add document in gravitino-server-config.md

Please refer to the implemetation of table pre event in #5539
Parent issue
#5317

Hi @FANNG1
please assign the task to me.
Thanks,
Qiang


Implement VPC Endpoint for AWS Provider

Description of your changes

Fixes #715
I have:

[x] Read and followed Crossplane's contribution process.
[x] Run make reviewable test to ensure this PR is ready for review.

How has this code been tested

Verified that the VPC Endpoint can be created upstream in AWS
Ensured that resource is marked as READY only when VPC Endpoint status is available
Verified that the VPC Endpoint can be deleted upstream in AWS

@chlunde I've completed the requested changes. Could you help me take a look at the changes please? Thanks!

@turkenh, I failed the check-diff job in the previous run. Did a make generate and git diff locally to get this output.
diff --git a/apis/acm/v1alpha1/zz_generated.deepcopy.go b/apis/acm/v1alpha1/zz_generated.deepcopy.go
index 36535911..cf8dfdbe 100644
--- a/apis/acm/v1alpha1/zz_generated.deepcopy.go
+++ b/apis/acm/v1alpha1/zz_generated.deepcopy.go
@@ -1,3 +1,4 @@
+//go:build !ignore_autogenerated
 // +build !ignore_autogenerated

 /*
diff --git a/apis/acmpca/v1alpha1/zz_generated.deepcopy.go b/apis/acmpca/v1alpha1/zz_generated.deepcopy.go
index 05d1ef6f..943bc892 100644
--- a/apis/acmpca/v1alpha1/zz_generated.deepcopy.go
+++ b/apis/acmpca/v1alpha1/zz_generated.deepcopy.go
@@ -1,3 +1,4 @@
+//go:build !ignore_autogenerated
 // +build !ignore_autogenerated

 /*
diff --git a/apis/apigatewayv2/v1alpha1/zz_generated.deepcopy.go b/apis/apigatewayv2/v1alpha1/zz_generated.deepcopy.go
index 6de8677b..bcc03079 100644
--- a/apis/apigatewayv2/v1alpha1/zz_generated.deepcopy.go
+++ b/apis/apigatewayv2/v1alpha1/zz_generated.deepcopy.go
@@ -1,3 +1,4 @@
+//go:build !ignore_autogenerated
 // +build !ignore_autogenerated

 /*
diff --git a/apis/cache/v1alpha1/zz_generated.deepcopy.go b/apis/cache/v1alpha1/zz_generated.deepcopy.go
index ca1083d6..3fb44a5e 100644
--- a/apis/cache/v1alpha1/zz_generated.deepcopy.go
+++ b/apis/cache/v1alpha1/zz_generated.deepcopy.go
@@ -1,3 +1,4 @@
+//go:build !ignore_autogenerated
 // +build !ignore_autogenerated

 /*
diff --git a/apis/cache/v1beta1/zz_generated.deepcopy.go b/apis/cache/v1beta1/zz_generated.deepcopy.go
index d671c164..3543222b 100644
--- a/apis/cache/v1beta1/zz_generated.deepcopy.go
+++ b/apis/cache/v1beta1/zz_generated.deepcopy.go
@@ -1,3 +1,4 @@
+//go:build !ignore_autogenerated
 // +build !ignore_autogenerated

 ...
//

34 files came appended with //go:build !ignore_autogenerated. By any chance, would you happen to know how I can resolve this?

+++ b/apis/cache/v1beta1/zz_generated.deepcopy.go
@@ -1,3 +1,4 @@
+//go:build !ignore_autogenerated
 // +build !ignore_autogenerated

34 files came appended with //go:build !ignore_autogenerated. By any chance, would you happen to know how I can resolve this?

this happens when you have go 1.17 locally, and the build environment uses go 1.16 or older. A workaround is currently something like sed -i /go:build/ apis/*/*/*.go (and more) before commit/push.

@chlunde can you take a look at the changes please?

@AaronME is there an issue in detect-noop?
@darryl-sw The tests are not running, when I run them locally I get an issue with a panic in IsPolicyUpToDate. I think we should harden it by using StringValue:
diff --git a/pkg/clients/aws.go b/pkg/clients/aws.go
index 7cd91a7f..83a8b35e 100644
--- a/pkg/clients/aws.go
+++ b/pkg/clients/aws.go
@@ -658,11 +658,11 @@ func IsPolicyUpToDate(local, remote *string) bool {
        var remoteUnmarshalled interface{}

        var err error
-       err = json.Unmarshal([]byte(*local), &localUnmarshalled)
+       err = json.Unmarshal([]byte(StringValue(local)), &localUnmarshalled)
        if err != nil {
                return false
        }
-       err = json.Unmarshal([]byte(*remote), &remoteUnmarshalled)
+       err = json.Unmarshal([]byte(StringValue(remote)), &remoteUnmarshalled)
        if err != nil {
                return false
        }

@darryl-sw I don't think you have run code gen, I get a diff here, could you run make generate?
diff --git a/pkg/controller/ec2/vpcendpoint/zz_conversions.go b/pkg/controller/ec2/vpcendpoint/zz_conversions.go
index 2be39997..e52368a3 100644
--- a/pkg/controller/ec2/vpcendpoint/zz_conversions.go
+++ b/pkg/controller/ec2/vpcendpoint/zz_conversions.go
@@ -88,11 +88,6 @@ func GenerateVPCEndpoint(resp *svcsdk.DescribeVpcEndpointsOutput) *svcapitypes.V
                } else {
                        cr.Spec.ForProvider.VPCEndpointType = nil
                }
-               if elem.VpcId != nil {
-                       cr.Spec.ForProvider.VPCID = elem.VpcId
-               } else {
-                       cr.Spec.ForProvider.VPCID = nil
-               }
                found = true
                break
        }
@@ -177,9 +172,6 @@ func GenerateCreateVpcEndpointInput(cr *svcapitypes.VPCEndpoint) *svcsdk.CreateV
        if cr.Spec.ForProvider.VPCEndpointType != nil {
                res.SetVpcEndpointType(*cr.Spec.ForProvider.VPCEndpointType)
        }
-       if cr.Spec.ForProvider.VPCID != nil {
-               res.SetVpcId(*cr.Spec.ForProvider.VPCID)
-       }

        return res
 }

@chlunde I've made the requested changes to isPolicyUpToDate and reran make generate.

@darryl-sw can you rebase ? And squash commits ? After that we can merge the feature - thanks

@haarchri running make generate with "ec2" added to GENERATED_SERVICES in the Makefile results in an error that I have not been able to resolve after rebasing.
13:15:38 [ OK ] go modules dependencies verified
13:15:39 [ .. ] go generate darwin_amd64
github.com/crossplane/provider-aws/apis/ec2/v1alpha1:-: CRD for Instance.ec2.aws.crossplane.io has no storage version
Error: not all generators ran successfully
run `controller-gen object:headerFile=../hack/boilerplate.go.txt paths=./... crd:trivialVersions=true,allowDangerousTypes=true,crdVersions=v1 output:artifacts:config=../package/crds -w` to see all available markers, or `controller-gen object:headerFile=../hack/boilerplate.go.txt paths=./... crd:trivialVersions=true,allowDangerousTypes=true,crdVersions=v1 output:artifacts:config=../package/crds -h` for usage
exit status 1
apis/generate.go:26: running "go": exit status 1

I took a look at the file package/crds/ec2.aws.crossplane.io_instances.yaml and identified that there were two versions, both named v1alpha1, both of them with storage: false.
To further isolate the problem, I verified that simply adding "ec2" to GENERATED_SERVICES on the master branch and running make generate produces the same error message.
Would you, or anybody, be able to advice on how I can fix this please?

@darryl-sw sorry i missed that we are blocked with ec2 services because of https://github.com/crossplane/provider-aws/issues/876

@haarchri shall I wait for #876 first before proceeding with the rebase then?

Any updates on the PR? Blockers? cc @haarchri

@darryl-sw you can go forward the blockers are solved in master branch - thanks

@haarchri what's the ETA for this to be released? :)

@darryl-sw  can rebase and i can have a look - in the next days we will cut next release - so i have time for review since rebase is done

@haarchri rebased and completed another round of upstream testing. :)

i will rebase now and adjust generated resolvers to get this PR merged ;)

@AaronME done!
can you check build submodule ? looks like we see changes in this PR - after that we are ready to merge =)
tested also on my side:
NAME                                                   READY   SYNCED   EXTERNAL-NAME
vpcendpoint.ec2.aws.crossplane.io/sample-vpcendpoint   True    True     vpce-0037d4f0338c77881


Fixing some normalization problems in extraction

@R1kM reported that some interop wrappers between Vale/HACL, which rely heavily on type-level computation, were consuming a huge amount of resources during extraction.
After some digging, the problem stems from a couple of causes:

We were normalizing types with improper arguments during extraction (in translate_term_as_mlty), trying to unfold fvars down to delta_constants, violating the requirement that we only unfold things marked unfold or inline_for_extraction during extraction. What was happening was that we were trying to normalize a huge term down to a constant, but without the right user-specific call to norm, this attempt is doomed, as the reduction gets stuck at various points, building an enormous partially reduced term. Worse, if a first attempt at normalization didn't work out, we would retry with some other normalization configuration which was also doomed. So, now I have a fix that correctly refuses to unfold fvars that do not have the right qualifiers and does not retry.

When determining whether or not a term is an "arity", a crucial step in extraction to determine how to stratify the translation (i.e., to produce an ML type or an expr), we were also mistakenly triggering a doomed normalization. That is also fixed.

All of this took a bit of tuning to retain the kind of normalization that our various code bases expect. I plan to merge this as soon as we get an Everest green as it is a blocking issue.

Thanks Nik. I had a look and left a comment. Looks good to me for merging otherwise.
Also related to the other normalization related issue, we can spend some time next week to document the current normalization flags and calls to them made from the typechecker and extraction. We have discussed it before but never got to it. It would be useful in general.


Unable to start “Elsa.Studio.Host.Server”

Hello,
Thank you very much for your open source project. When I cloned this project and tried to run 'Elsa. Studio. Host. Server', I received the following error message in the browser I opened:
(Command line window information)

(Browser Information)

Configuration information for project operation (appsetting. json):

(launchSettings.json)：

Can you tell me how to configure it to eliminate the above errors? Thank you very much!

Hi @Mr-CTao , please make sure that you also have an Elsa Workflow Server application running. The Elsa Studio application is a client application that doesn't host workflows itself. Instead, it will try and connect to a workflow server.
Unless, of course, you setup your project to host both the studio + the server.


⚠ Bofrost.lu has degraded performance

In efcc75f, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 1034 ms

Resolved: Bofrost.lu performance has improved in bff213f.


Cuantification methods need to be blue like in every other list, right?

only happening when doing by value on the size of points


fix cri output for containerd clusters

For clusters with CRI=containerd, the RUNTIME contains an additional wrong docker
UID                                     NAME            VERSION PARTITION       DOMAIN                                  OPERATION       PROGRESS                API     CONTROL NODES   SYSTEM  SIZE    AGE     PURPOSE PRIVILEGED      RUNTIME         FIREWALL                        EGRESS IPS
9529c143-b78d-4ec4-a041-3b86626126cc    mycluster1      1.18.12 stg-kkw701      mycluster1.p5mlcn.cluster.fits.cloud    Succeeded       100% [Reconcile]        True    True    True    True    1≤1≤1   5h 33m  prod    false           docker          firewall-ubuntu-2.0.20201126
                                                                                containerd

with this fix:
UID                                     NAME            VERSION PARTITION       DOMAIN                                  OPERATION       PROGRESS                API     CONTROL NODES   SYSTEM  SIZE    AGE     PURPOSE PRIVILEGED      RUNTIME         FIREWALL                        EGRESS IPS
9529c143-b78d-4ec4-a041-3b86626126cc    mycluster1      1.18.12 stg-kkw701      mycluster1.p5mlcn.cluster.fits.cloud    Succeeded       100% [Reconcile]        True    True    True    True    1≤1≤1   5h 33m  prod    false           containerd      firewall-ubuntu-2.0.20201126

#34 already contains this fix.

But #34 needs more review than this one, would merge this


Issue while Local Port Forwarding

I'm following the forward_local.dart example, but I keep getting the following error no matter what I do.
StateError (Bad state: Stream was already listened to)
#0      _RawServerSocket.listen (dart:io-patch/socket_patch.dart:1770:7)
#1      new _ForwardingStreamSubscription (dart:async/stream_pipe.dart:114:10)
#2      _ForwardingStream._createSubscription (dart:async/stream_pipe.dart:86:16)
#3      _ForwardingStream.listen (dart:async/stream_pipe.dart:81:12)
#4      _ServerSocket.listen (dart:io-patch/socket_patch.dart:2053:71)
#5      _StreamIterator._initializeOrDone (dart:async/stream_impl.dart:942:33)
#6      _StreamIterator.moveNext (dart:async/stream_impl.dart:918:12)
#7      _MyHomePageState.sshConnect (package:vnc/main.dart)
<asynchronous suspension>

Here is a snippet of my code.
int port = 0;

  SSHClient? _client;
  SSHSocket? _socket;
  ServerSocket? _serverSocket;

  bool authenticated = false;
  bool forwarded = false;

  bool connect = false;

  sshConnect(String targetIp) async {
    bool result = false;
    Object? exception;
    try {
      _socket = await SSHSocket.connect(targetIp, 22);

      _client = SSHClient(_socket!,
          username: SSH_USER,
          onPasswordRequest: () => SSH_PASSWORD,
          onAuthenticated: () => setState(() => authenticated = true));

      await _client!.authenticated;

      _serverSocket = await ServerSocket.bind(LOCALHOST, port);
      print('Listening on ${_serverSocket!.address.address}:${_serverSocket!.port}');

      port = _serverSocket!.port;

      await for (final socket in _serverSocket!) {
        final forward = await _client!.forwardLocal("locahost", 5900,
            localHost: LOCALHOST, localPort: port);
        forward.stream.cast<List<int>>().pipe(socket);
        socket.cast<List<int>>().pipe(forward.sink);
      }
      result = true;
    } catch (e) {
      await _serverSocket!.close();
      _client!.close();
      await _client!.done;
      _socket!.close();
      await _socket!.done;
      result = false;
      exception = e;
    }

    setState(() {
      if (result) {
        forwarded = true;
      } else {
        connect = false;
        authenticated = false;
        forwarded = false;

        ScaffoldMessenger.of(context).showSnackBar(
          SnackBar(
            duration: const Duration(seconds: 30),
            content: Text('Error: $exception'),
          ),
        );
      }
    });
  }

  @override
  void dispose() {
    if (_client?.isClosed ?? false) _client!.close();
    if (_serverSocket != null) _serverSocket!.close();
    if (_socket != null) _socket!.close();
    super.dispose();
  }

I'm running the code as a Windows app, and I have the dartssh2 2.9.1-pre package.

A summarized version of the relevant code would be this.
     var _socket = await SSHSocket.connect(TARGET_IP, 22);

     var  _client = SSHClient(_socket,
          username: SSH_USER,
          onPasswordRequest: () => SSH_PASSWORD);

      await _client.authenticated;

      var _serverSocket = await ServerSocket.bind(LOCALHOST, 0);
      print('Listening on ${_serverSocket.address.address}:${_serverSocket.port}');

      await for (final socket in _serverSocket) {
        final forward = await _client!.forwardLocal("locahost", 5900,
            localHost: LOCALHOST, localPort:  _serverSocket.port);
        forward.stream.cast<List<int>>().pipe(socket);
        socket.cast<List<int>>().pipe(forward.sink);
      }


Hacktober-accepted

There is no label for hacktober accepted , does it count as hacktober accepted @vaibhavagarwal47 ?

hacktoberfest-accepted label is needed only in the pr's, not in the issues.


Quantized models half-working

This is being worked on.
Empirically, it appears that the quantized model does not perform correctly. This is likely due to different RoPE hyperparameters, as the dtype has been ruled out. Normal Mistral gets ~30 T/s, and GGUF mistral (broken, as of now) gets ~24 T/s.

Finally fixed after extensive work in custom Candle branch.


The system cannot find the file specified

Trying to run sample

You need to install the new Chromium based Edge if you're on Windows: https://www.microsoftedgeinsider.com/en-us/.

Thanks for answering, @AntonScharnick!
Yes, the library could detect this and fall back on older Edge, but I haven't implemented that. If someone's interested in doing so, please consider sending a PR!

Thanks, a better error message would go a long way.

Great suggestion. If you’re able to submit a PR for this, that would be perfect.

I'm having this error even I have chromium edge installed. @SteveSandersonMS

You need Edge from its Canary/Beta channels, not just the stable channel. You can have more than one channel installed at the same time.


Fix TokenRateController test ESLint warnings

Explanation
All ESLint warnings in the TokenRateController tests have been addressed. They were all related to the state change listners: they all had the wrong type signature, and some of them were mistakenly called without await.
References
None
Changelog
None
Checklist

[x] I've updated the test suite for new or updated code as appropriate
[x] I've updated documentation (JSDoc, Markdown, etc.) for new or updated code as appropriate
[x] I've highlighted breaking changes using the "BREAKING" category above as appropriate

Those lint warning annotations are from the ApprovalController tests. This PR is only addressing the warnings in the TokenRateController tests


feat(compiler-sfc): analyze script bindings

Should it support injections and computeds as well?
Which cases should be supported in addition to the basic ones?
I also think that having multiple parsing passes for <script> blocks is not optimal, maybe babel's ast should be contained within the SFCScriptBlock?

BindingMetadata can only be one of 'data' | 'props' | 'setup' | 'options' - so anything that is not data, setup or props goes into options.

Re attach AST on the block: yeah I think that's a good idea.

I've managed to do parsing only once by passing AST directly to analyzeScriptBindings.
Is this ok? Should analyzeScriptBindings be exported in that case?

👍


怎么替换gin框架里自带的json

gin 自 1.9.0 版本开始已经默认使用 sonic

@GuangmingLuo Are you sure?  just check the gin's code and seems it still needs a sonic build tag
https://github.com/gin-gonic/gin/blob/v1.9.1/internal/json/sonic.go#L5


Fix minor bugs in docs

Hi,
I have found a couple of small issues while reading the docs. The pull request contains the fixes.
BTW, the link to PLDI slices is also broken here: https://fbinfer.com/docs/absint-framework. I haven't found the slides anywhere, so not sure how to fix it.

@jvillard since you marked 1.0 version, maybe merging this before the release would be good?

Thanks, @octomarat!


Avoid var binding which will be removed in Swift 3.0

https://github.com/apple/swift-evolution/blob/master/proposals/0003-remove-var-parameters-patterns.md

:ship:


Race condition between event handlers and animator

Expected Behavior
User interaction does not cause clitches
Current Behavior
Toggling dataset visibility through legend while animation is not complete results in a race condition between the event handler and animator updating elements. So element properties are changed during the event handling and can cause unexpected results in plugins.
Possible Solution
throttled and Animator use requestAnimFrame to schedule the events / animation. requestAnimFrame seems to return same frame with subsequent calls (at least in chrome). Maybe a common throttled for both of those, that does not share the frame.
Steps to Reproduce
Hide and show dataset(s) repeatedly, for example in:
https://codepen.io/kurkle/pen/VwaLNbj
Example results:

Environment

Chart.js version: 3.0.0-aplha.2 (master)
Browser name and version: Chrome 84

Closing as this is way incorrectly described. Its really due to floating point arithmetic and points not having exactly the same x-coordinate while animations run.


Linux build for m71

Hi @OlegKrymskyi, many thanks for opening this PR. I'll try to get some time to review it, but already I can tell by policy we're unlikely to be able to commit a prebuilt binary file (.so) into this repository, for security reasons. Can you please try to avoid it? Thanks!

Hi @OlegKrymskyi, many thanks for opening this PR. I'll try to get some time to review it, but already I can tell by policy we're unlikely to be able to commit a prebuilt binary file (.so) into this repository, for security reasons. Can you please try to avoid it? Thanks!

Yes, sure, I will remove this file. I hope in the next release version it will be a part of the nuget :)

Hey @OlegKrymskyi, I've been trying out your linux example and it seems to work until I try to use a TURN server. I get the following:

Any ideas?

@joshdixon Try to run it with the same setting on windows. Do you have the same error?

@joshdixon Besides, you can try to check your TURN server first: https://webrtc.github.io/samples/src/content/peerconnection/trickle-ice/

@joshdixon Besides, you can try to check your TURN server first: https://webrtc.github.io/samples/src/content/peerconnection/trickle-ice/

Yep you're right, was an issue with the TURN server. Cheers for the swift reply!

Closing PR ahead of disabling, as per Microsoft Mixed Reality organization decision.