[stress] Get an OpenTelemetry collector working so we can start reporting trace/metrics to Azure Monitor in all languages

Background
Getting OpenTelemetry metrics to destination like Azure Monitor requires an exporter.
Java and C# can send OpenTelemetry traces/metrics directly to AppInsights via their OpenTelemetry packages. Other languages require an external process, called a collector, which understands OTLP (OpenTelemetry Protocol).

NOTE: There is a note on the Monitor page that they're adding an OTLP endpoint but there's no release date information on there. So this could become less complicated for us at some indeterminate point in the future. link

Work

[ ] Build the otel collector, publish an image. I'm unclear on how well the collector scales, so it might be that every pod needs to have this running as a sidecar or perhaps we can just run a few instances as a K8S Service and just let everyone send to a known endpoint.
Here's the Dockerfile:
FROM golang:1.21
# this is the automated builder app - you can use it to create a "distribution"
# of the opentelemetry collector that includes `contrib` components (ie, not part of the
# base opentelemetry libraries but still part of the project)
RUN go install go.opentelemetry.io/collector/cmd/builder@latest

WORKDIR /root
# the .yaml tells us what to include in the build. It's defined just below this section
ADD ./otelcol-builder.yaml otelcol-builder.yaml
RUN builder --config=otelcol-builder.yaml

Here's the otelcol-builder.yaml, which includes the Azure Monitor exporter and enables the OTLP receiver:
# https://github.com/open-telemetry/opentelemetry-collector/tree/main/cmd/builder
dist:
  name: otelcol-custom
  description: Local OpenTelemetry Collector binary
  output_path: /tmp/dist
exporters:
  # More exporters at: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main
  - gomod: github.com/open-telemetry/opentelemetry-collector-contrib/exporter/azuremonitorexporter v0.83.0
  - gomod: go.opentelemetry.io/collector/exporter/loggingexporter v0.83.0

receivers:
  - gomod: go.opentelemetry.io/collector/receiver/otlpreceiver v0.83.0

processors:
  - gomod: go.opentelemetry.io/collector/processor/batchprocessor v0.83.0

[ ] Deploy the collector with the proper config, either as a sidecar or within the same pod. We need some code to inject our APPINSIGHTS_INSTRUMENTATIONKEY into the YAML file so it can load it from there (or maybe it already implicitly understands that variable). I haven't gotten to try this part out:
receivers:
  otlp:
    protocols:
      grpc:
        endpoint: localhost:4317

processors:
  batch:

exporters:
  azuremonitor:
    instrumentation_key: <we'll need to replace this>

service:
  pipelines:
    traces:
      receivers:
      - otlp
      processors:
      - batch
      exporters:
      - logging

[ ] Use the correct exporter for your language that understands it has to forward to a collector and hook it up to your traceprovider:

Go: https://opentelemetry.io/docs/instrumentation/go/exporters/#otlp-endpoint
JS: https://opentelemetry.io/docs/instrumentation/js/exporters/#otlp-endpoint
Python: https://opentelemetry.io/docs/instrumentation/python/exporters/#otlp-endpoint-or-collector
C++: https://opentelemetry.io/docs/instrumentation/cpp/exporters/#otlp-http-exporter
NOTE: Java and C# already have built-in exporters and don't require a collector.

@lmolkova , I believe I distilled everything we need to make this work. Did I get all the details right?

great summary!
A couple of additional points:

collector is available as docker image and we probably don't really need a dockerfile for it, e.g. here's a sample compose configuration

  otelcollector:
    image: otel/opentelemetry-collector-contrib:0.78.0
    command: ["--config=/etc/otel-collector-config.yml"]
    ports:
      - "8889:8889"   # Prometheus exporter metrics
      - "13133:13133" # health_check extension
      - "4317:4317"   # OTLP gRPC receiver
      - "4318:4318"   # OTLP http receiver
      - "55679:55679" # zpages extension
    volumes:
      - ./configs/otel-collector-config.yml:/etc/otel-collector-config.yml

From my experience working with collector, some components including azmonexporter are not quite stable and it'd be easier to pin a specific version rather using latest

collector config needs azmon exporter configured, something like

receivers:
  otlp:
    protocols:
      grpc: # no need to set address if the default one is used

exporters:
  azuremonitor:
    instrumentation_key: <we'll need to replace this>
  logging:
    verbosity: detailed #not sure, but maybe we need to set it

processors:
  batch:
  # as a cherry on the top, it might be worth looking into https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/main/processor/k8sattributesprocessor/README.md or resourcedetection processor - they can stamp k8s into on metrics/logs/traces

service:
  pipelines:
    traces:
      receivers: [otlp]
      processors: [batch]
      exporters: [azuremonitor]
    metrics:
      receivers: [otlp]
      processors: [batch]
      exporters: [azuremonitor]
    logs:
      receivers: [otlp]
      processors: [batch]
      exporters: [azuremonitor, logging]


Odd error handling behavior

When the user is not logged in and navigates to a recordset page where they can't "see" a column that includes a valid facet filter, an error is thrown that should suggest the user try logging in first before removing all filters from the url.
https://dev.gudmap.org/chaise/recordset/#2/Protocol:Protocol/*::facets::N4IghgdgJiBcDaoDOB7ArgJwMYFM6JHQBcAjdafEABQxSJSxQBsQAaa2+xpgfQGFMYIgEsUEHgGUiQtEh4AzANY4AniAC6AX3YAlAJIARDeywALFMNxJKARQC0ATQBsARh0bNWoA@sort(RMT::desc::,RID)

We might want to add the same message that we are doing for table/column/schema/data not found to any of these url related errors too ("You may need to login to see the model or data. Please login to continue."). This requires change in ermrestjs too, since currently the error thrown when the facet string is completely invalid (and therefore cannot be decoded) is the same as this given case (when facet string is correct but the path is invalid).

Changes for this issue have been merged into master. Reassigning to @hongsudt . The link in the original description should be valid for testing this issue has been resolved.


sqlite3.OperationalError: duplicate column name

On Ubuntu 16.04 (both a "real" install and in Bash in Ubuntu on Windows 10) I get the following error, which appears to be due to having column names with non-alphanumeric characters. In this case I have columns "ABCD>8.5" and "ABCD<8.5". I'm not sure if this is a problem with sqlitebiter, simplesqlite or something else?

sqlitebiter file complicated.xlsx
Traceback (most recent call last):
File "site-packages/simplesqlite/core.py", line 259, in execute_query
sqlite3.OperationalError: duplicate column name: ABCD85

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "cli.py", line 12, in
File "site-packages/click/core.py", line 722, in call
File "site-packages/click/core.py", line 697, in main
File "site-packages/click/core.py", line 1066, in invoke
File "site-packages/click/core.py", line 895, in invoke
File "site-packages/click/core.py", line 535, in invoke
File "site-packages/click/decorators.py", line 17, in new_func
File "sqlitebiter/sqlitebiter.py", line 286, in file
File "sqlitebiter/_table_creator.py", line 22, in create
File "site-packages/simplesqlite/core.py", line 1219, in create_table_from_tabledata
File "site-packages/simplesqlite/core.py", line 1533, in __create_table_from_tabledata
File "site-packages/simplesqlite/core.py", line 1114, in create_table
File "site-packages/simplesqlite/core.py", line 270, in execute_query
simplesqlite.error.OperationalError
[144] Failed to execute script cli

@chaffinched
Thank you for your report.
I had fix the problem at the sqlitebiter 0.15.1.
Could you try with this version?
The problem is non-alphanumeric characters are removed while the SQLite conversion.
So, ABCD>8.5 and ABCD<8.5 are considered a duplicate column as ABCD85.
Now, sqlitebiter accepts non-alphanumeric characters.

Thanks, @thombashi that works perfectly for the 0.15.1 .deb file.
Unfortunately, the problem still exists in the Windows version, now that #52 is fixed.

sqlitebiter.exe file Book1.xlsx
[INFO] sqlitebiter file: convert 'Book1.xlsx' to 'Sheet1' table
Traceback (most recent call last):
File "site-packages\simplesqlite\core.py", line 259, in execute_query
sqlite3.OperationalError: duplicate column name: ABCD85
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "cli.py", line 15, in
File "site-packages\click\core.py", line 722, in call
File "site-packages\click\core.py", line 697, in main
File "site-packages\click\core.py", line 1066, in invoke
File "site-packages\click\core.py", line 895, in invoke
File "site-packages\click\core.py", line 535, in invoke
File "site-packages\click\decorators.py", line 17, in new_func
File "sqlitebiter\sqlitebiter.py", line 230, in file
File "sqlitebiter_table_creator.py", line 22, in create
File "site-packages\simplesqlite\core.py", line 1185, in create_table_from_tabledata
File "site-packages\simplesqlite\core.py", line 1487, in __create_table_from_tabledata
File "site-packages\simplesqlite\core.py", line 1093, in create_table
File "site-packages\simplesqlite\core.py", line 270, in execute_query
simplesqlite.error.OperationalError
[13116] Failed to execute script cli

@chaffinched
Sorry to bother you.
I had rebuild the Windows executable binary.
I believe this binary fixed the issue.
sha256 hash: cd1e05148360c7f357e5c8be5dec01f6ad2fc34ab4fa639a2541c6494866ea69

@thombashi
Great, this works perfectly now! Thanks for all of your help.


Define max_columns option as a display option

To overcome issue pandas._config.config.OptionError: 'Pattern matched multiple keys' in pandas 1.4.0, one need to specify display of render when defining the option.

Hi @stijnvanhoey, thanks for this patch! I wonder if we even need to do this Pandas display.max_columns configuration. It seems like it might be a better idea to let the users manipulate any Pandas display options in their own environment.
Regardless, I'm okay with this change. I just want to see why the documentation build is failing before merging these changes.

Thanks, it was only a very small fix :-)

if we even need to do this Pandas display.max_columns configuration. It seems like it might be a better idea to let the users manipulate any Pandas display options in their own environment.

I do agree.
With respect to the documentation bug, seems that one need to specify the exact version of mistune in the doc requirements (version 2 removed the BlockGrammar).


MissingConverter : Unable to find converter for model type <class 'sklearn.pipeline.Pipeline'>

Getting below error : Is this expected, please assist. thanks a lot !!
`` MissingConverter                          Traceback (most recent call last)
 in
----> 1 h_model = convert(pi_clf_pipeline, 'pytorch')
/venv/lib/python3.6/site-packages/hummingbird/ml/convert.py in convert(model, backend, test_input, device, extra_config)
393         return _convert_sparkml(model, backend, test_input, device, extra_config)
394
--> 395     return _convert_sklearn(model, backend, test_input, device, extra_config)
/venv/lib/python3.6/site-packages/hummingbird/ml/convert.py in _convert_sklearn(model, backend, test_input, device, extra_config)
86     # We modify the scikit learn model during translation.
87     model = deepcopy(model)
---> 88     topology = parse_sklearn_api_model(model, extra_config)
89
90     # Convert the Topology object into a PyTorch model.
/venv/lib/python3.6/site-packages/hummingbird/ml/_parse.py in parse_sklearn_api_model(model, extra_config)
58     # Parse the input scikit-learn model into its scope with the topology.
59     # Get the outputs of the model.
---> 60     outputs = _parse_sklearn_api(scope, model, inputs)
61
62     # Declare output variables.
/venv/lib/python3.6/site-packages/hummingbird/ml/_parse.py in _parse_sklearn_api(scope, model, inputs)
222     tmodel = type(model)
223     if tmodel in sklearn_api_parsers_map:
--> 224         outputs = sklearn_api_parsers_map[tmodel](scope, model, inputs)
225     else:
226         outputs = _parse_sklearn_single_model(scope, model, inputs)
/venv/lib/python3.6/site-packages/hummingbird/ml/_parse.py in _parse_sklearn_pipeline(scope, model, inputs)
268     """
269     for step in model.steps:
--> 270         inputs = _parse_sklearn_api(scope, step[1], inputs)
271     return inputs
272
/venv/lib/python3.6/site-packages/hummingbird/ml/_parse.py in _parse_sklearn_api(scope, model, inputs)
222     tmodel = type(model)
223     if tmodel in sklearn_api_parsers_map:
--> 224         outputs = sklearn_api_parsers_map[tmodel](scope, model, inputs)
225     else:
226         outputs = _parse_sklearn_single_model(scope, model, inputs)
/venv/lib/python3.6/site-packages/hummingbird/ml/_parse.py in _parse_sklearn_feature_union(scope, model, inputs)
302     # Encode each transform as our IR object
303     for name, transform in model.transformer_list:
--> 304         transformed_result_names.append(_parse_sklearn_single_model(scope, transform, inputs)[0])
305         if model.transformer_weights is not None and name in model.transformer_weights:
306             transform_result = [transformed_result_names.pop()]
/venv/lib/python3.6/site-packages/hummingbird/ml/_parse.py in _parse_sklearn_single_model(scope, model, inputs)
244         raise RuntimeError("Parameter model must be an object not a " "string '{0}'.".format(model))
245
--> 246     alias = get_sklearn_api_operator_name(type(model))
247     this_operator = scope.declare_local_operator(alias, model)
248     this_operator.inputs = inputs
/venv/lib/python3.6/site-packages/hummingbird/ml/supported.py in get_sklearn_api_operator_name(model_type)
353     """
354     if model_type not in sklearn_api_operator_name_map:
--> 355         raise MissingConverter("Unable to find converter for model type {}.".format(model_type))
356     return sklearn_api_operator_name_map[model_type]
357
MissingConverter: Unable to find converter for model type <class 'sklearn.pipeline.Pipeline'>.
It usually means the pipeline being converted contains a
transformer or a predictor with no corresponding converter implemented.``

Hi @smilenrhyme ! Can you please share some of your code that you used to create the model/pipeline?  That will help us understand a bit more about what "Parameter model must be an object not a " "string '{0}'.".format(model) might mean for example.

Hi @ksaur , Thanks a lot for the quick response :)
Sorry for delay in the reply. Below is the code in brief
# Custom classes
class MissingValueImputer(BaseEstimator, TransformerMixin):
class DFSubsetSelector(BaseEstimator,TransformerMixin):

f1_extractor = Pipeline([('selector', DFSubsetSelector(some_features)),
                         ('fill_na', MissingValueImputer(columns=some_features, fill_types=['median'] * len(some_features)))
                         ])

# feature_extractor : "FeatureUnion" over multiple scikit style custom transformers
feature_extractor = FeatureUnion(transformer_list=[
                                                    ('extractor1', f1_extractor),
                                                    ('extractor2', f2_extractor)])

learner = lgb.LGBMRanker()

# pipeline : this is scikit-learn pipeline
pipeline = Pipeline([('feature_extractor_preprocessor',feature_extractor),
                         ('learner',learner)])

=> This is failing
convert(pipeline, 'pytorch')
=> This is working fine when I extract only ligtgbm model from pipeline
lgbm_model = pipeline.named_steps['learner']
h_model = convert(lgbm_model, 'pytorch')
Note : hummingbird-ml==0.1.0
Please let me know if you need other details 👍

Hi @smilenrhyme  Thanks for posting this so we have another datapoint! We don't yet support custom classes inside pipelines, (and I also think we don't support nested pipelines) so the error you're getting is expected as of right now.
This issue is similar to the recently posted #371 feature request.  This is on our list of things to implement!

@ksaur Thanks a lot 👍 Closing this issue for now :)


DFP container updates

Description

Update nodejs in DFP container to match version in Morpheus dev conda environment.
Update jupyterlab_nvdashboard version to fix the following error seen in jupyterlab startup.

[W 2023-11-06 23:01:38.953 ServerApp] jupyterlab_nvdashboard | extension failed loading with message: ExtensionLoadingError('_load_jupyter_server_extension function was not found.')
jupyter  |     Traceback (most recent call last):
jupyter  |       File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/jupyter_server/extension/manager.py", line 358, in load_extension
jupyter  |         extension.load_all_points(self.serverapp)
jupyter  |       File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/jupyter_server/extension/manager.py", line 230, in load_all_points
jupyter  |         return [self.load_point(point_name, serverapp) for point_name in self.extension_points]
jupyter  |       File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/jupyter_server/extension/manager.py", line 230, in <listcomp>
jupyter  |         return [self.load_point(point_name, serverapp) for point_name in self.extension_points]
jupyter  |       File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/jupyter_server/extension/manager.py", line 221, in load_point
jupyter  |         return point.load(serverapp)
jupyter  |       File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/jupyter_server/extension/manager.py", line 148, in load
jupyter  |         loader = self._get_loader()
jupyter  |       File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/jupyter_server/extension/manager.py", line 117, in _get_loader
jupyter  |         loader = get_loader(loc)
jupyter  |       File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/jupyter_server/extension/utils.py", line 47, in get_loader
jupyter  |         raise ExtensionLoadingError(msg) from None
jupyter  |     jupyter_server.extension.utils.ExtensionLoadingError: _load_jupyter_server_extension function was not found.

Fixes #1346
By Submitting this PR I confirm:

I am familiar with the Contributing Guidelines.
When the PR is ready for review, new or existing tests cover these changes.
When the PR is ready for review, the documentation is up to date with these changes.

/merge


Atom.Object.defineProperty.get is deprecated.

No view appears for the html, and there's this message in deprecations
atom.workspaceView is no longer available.
In most cases you will not need the view. See the Workspace docs for
alternatives: https://atom.io/docs/api/latest/Workspace.
If you do need the view, please use atom.views.getView(atom.workspace),
which returns an HTMLElement.
Atom.Object.defineProperty.get (/Applications/Atom.app/Contents/Resources/app/src/atom.js:54:11)
Object.activate (/Users/jimw/.atom/packages/api-blueprint-preview/lib/api-blueprint-preview.coffee:18:9)

I'll try to spend some time soon on the various deprecation and other warnings/issues from the Atom 1.0 changes.

This has been fixed with the latest release.


OptimizationResult does not contain variable information

What is the expected enhancement?
OptimizationResult contains the following information.

x: The optimal value found in the optimization algorithm.
fval: The function value corresponding to the optimal value.
results: The original results object returned from the optimization algorithm. This can contain more information than only the optimal value and function value.
status: The termination status of the algorithm.

x is a list of variable values, but there is no information which value is corresponding to which variable of QuadraticProgram.
Users need to combine QuadraticProgram and OptimizationResult to obtain the mapping of variables and values as follows.
problem = QuadraticProgram()
...
result: OptimizationResult = OptimizationAlgorithm().solve(problem)

var_dict = {var.name: result.x[i] for i, var in enumerate(problem.variables)}
# var_dict = {'x1': 0, 'x2': 1, ... }

It would be nice if OptimizationResult is self-contained, e.g., by including variable names or variables in OptimizationResult.
problem = QuadraticProgram()
...
result: OptimizationResult = OptimizationAlgorithm().solve(problem)

print(result.variables)  # ['x1', 'x2', ...]
print(result.x)          # [0, 1, ...]
print(result.var_dict())  # {'x1': 0, 'x2': 1, ... }

I am working on it!

Thank you for having an interested on it. Let's discuss what kind of design of OptimziationResult is useful before implementation.

Hello @t-imamichi
I would add new argument ‘x_name’ to the constructor of OptimizationResult.
In most cases, it will take values of  ‘problem.variables’, as you suggest.
I do not have experience using optimisations, so I do not see what other properties could be added.
But the class OptimizationResult could use some other modifications, e.g. set the private attributes using properties.setter,
or removing the str and use only repr (with proper modification).

Hi @t-imamichi, @molar-volume,
I suggest to add __getitem__(self, i: Union[int, str]) to the OptimizationResult which returns the value of the variable either by index or name. To do so we need something like a dictionary variable name -> index, and we have it in QuadraticProgram. So, we can pass a problem instance to the result class as a required argument in the constructor. In this case we'll have everything we potentially in the result from the problem.
What do you think?

Thank you for your comments @molar-volume and @adekusar-drl.
x_name, x_names, var_name, or variable_names as List[str] makes sense to me.
__getitem__(self, i: Union[int, str]) looks useful too.
I think we can realize it by adding _index: int class variable to Variable or adding _var2index: Dict[str, int] to QuadraticProgram.

@t-imamichi there is a line in QuadraticProgram already: self._variables_index = {}  # type: Dict[str, int], so we should make use of it.

Dear @t-imamichi and @adekusar-drl ,
thank you for your useful hints.
In my understanding, variable_names and x_names are the same thing, so I kept only x_names.
var_index is contained in variables (using enumerate(variables)), so I added only variables: List[Variable] argument to OptimizationResult.
Please, check the pull request for more details.

Thank you for making a PR. I will take a look at it.


Add expiry for data collection

In order not to have sites collect data indefintely, an expiry column should lbe added to the table, indicating when to stop collecting data. E.g. defaulting to 3 months and having some way to get a reminder when the data collection is about to expire. Either on email, or shown somewhere on the frontend, ie VRM or Grafana.

Some good progress on the issue. Now you can use --enable-auto-expiry or --enable-auto-expiry 21d to nudge Influx Loader into handling the expiry... and it will show up in the UI nicely...

... remaining functionality is to compose everything together...


Refactor

removed file & code duplications
converted code to be more swifty
added some final & private annotations

to be continued ...

@danieltmbr Thanks!


Missing Trailing slash for named routes in strict mode

Version
3.1.2
Reproduction link
https://codesandbox.io/s/vue-router-e0o5t

Steps to reproduce

Run the CodeSandbox
Double-check the router config that the route path is /about/ and strict is enabled

  { path: '/about/', component: About, pathToRegexOptions: { strict: true } },

Click the "About" link in the navbar.

What is expected?
To navigate to /about/
What is actually happening?
The route has no trailing slash (/about)

:man_facepalming: 	  { path: '/about/', component: About, pathToRegexpOptions: { strict: true } },
pathToRegexpOptions


Initialization Failed

After compilation, it fails to run (Runtime Error at creating a shader for initializing defaults)

The issue was due to incompatible hardware (GPU Geforce 110mx)


feat: implement OIDC authentication logic

MONGOSH-1381

This PR seems to be causing some bugs in server downstream due to some nodejs setup you are doing in CI. I have assigned the relevant BF to you but please do not merge this and try not to test this until a potential fix is applied. Feel free to reach out to me for more details.


DOCS-11234: Missing example on The scheduler component can trigger only one flow at any given time

I have multiple jobs on my API that have currently the same schedule.
We use a scheduler for each job to be able to change the schedule whenever desired or deactivate a job temporarily.
Does "The scheduler component can trigger only one flow at any given time." mean I should space them ?
I believe examples would help to understand that sentence. Can you add some please ?

Created Jira issue DOCS-11234 for addressing this issue.

We clarified that a Scheduler component can trigger only one flow at any given time. Only one trigger per flow is allowed. However, each flow can contain a Scheduler, and those schedulers can be on exactly the same schedule. Alternatively, if you just want to use a single Scheduler, you can use a flow reference from the flow that contains the Scheduler to to trigger another flow. You can also use a component such as Parallel For Each that runs different jobs but is triggered by the same Scheduler. There are many options.
If you want to share more about your use case, we can look into documenting more helpful info.


docs: Removed SECURITY.md

This PR is to remove the SECURITY.md file from the repository, as SECURITY.md files are centrally managed in the organization's .github repository. This allows for easy updates made by security in the future.

Snyk checks can be removed as Snyk is deprecated

Housekeeping: closing this in favor of #138  so I can make sure it gets merged without additional coordination for rebasing.


⚠ Bofrost.lu has degraded performance

In b433f23, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 1217 ms

Resolved: Bofrost.lu performance has improved in 6c67819 after 6 minutes.


[BUG] : [Copyright year should be changed]

Prerequisites

[X] I am an Open Source Contributor
[X] I checked to make sure that this issue has not already been filed

Description
The copyright year should be 2024 instead of 2023.
I want to automate the copyright year, so that the year keeps on changing automatically every time.
Screenshots

Code of Conduct

[X] I follow Contributing Guidelines of this project.

I want to work on this issue. Can you please assign me this issue under SWOC S4 ?

Proceed @SulagnaKundu Make sure to first pull the latest changes from the repo and then make your changes


Markdown support for script editor.

Background:
there is a fairly big conversation about how addons will work #19178 (sub scene system)
I expect this to result in a more solid addon/plugin system -> more plugin use.
So I thought it would be amazing if there is markdown support inside the editor to show the readme files of the addons which will/should contain information on how to use the addon.
As a result addons kind of have their own documentation inside the editor. But in general it is amazing to have a readme welcome page in projects.
The idea is that markdown will get converted to becode and than a similar system to the docs/editor_help will be used to display it as a script inside the script editor.
Current state:

I have code the markdown to bbcode converter.
I also have an idea how I would like to structure the rest of this feature.

first there will be a new resource called rawText with a ResourceLoader
Than there will be a markdown resource which inherits from it.
The script editor now has a function called edit which takes a Script Resource as a parameter to than decide which script editor should be used. This function would get changed to just take a Resource. Than the script editor can run checks on the object passed, if it is a Script It opens the according script_editor. (visual, gdscript, mono....) if it is a rawText it opens a pure text editor just to edit the file. but if it is a markdown it shows the file in a RichTextLabel using the same styles than the in editor docs. and using a convert too bbcode function on the markdown resource.
I'm still not sure how to deal with markdown class. The issue is:

A script does not have to be a text file, visual script, but a markdown/rawText file has none of the script properties except being a Text file. So there is an issue how to build up the inheritance tree.
I cannot inherit script from rawText because that would make no sense for visual scripts. But inheriting a markdown file from a script also makes no sense because it is not a script/has no script capabilities.

another method would be to just add new functions to the script editor to handle .md files and add a function that adds the appropriate editor to it without the edit method (the same way it is done with the help at the moment)

I would really appreciate any feedback, if this feature is desired. I also need advice where the new Classes should be added.
Current approach:

markdown.h + cpp inside a module
rawText (with it's loader) inside scene/resources
handlng the editing of the md and rawText files directly inside EditorPlugin.
the needed editor extending form script_editor_base are two new files one for rawText and one for markdown (don't know in which folder to put them)

Relate to #1390

To sum up:
Most of the tings i mentioned were solved,
So this issue now only contains the actual markdown editor implementation!

This could help in the implentation.

This python implantation can help.

@toger5 What's the status on this? Are you still working on it? Should I make my own implementation?

@Pilvinen No i am not working on it anymore. Would be cool if you can add some solution!

Feature and improvement proposals for the Godot Engine are now being discussed and reviewed in a dedicated Godot Improvement Proposals (GIP) (godotengine/godot-proposals) issue tracker. The GIP tracker has a detailed issue template designed so that proposals include all the relevant information to start a productive discussion and help the community assess the validity of the proposal for the engine.
The main (godotengine/godot) tracker is now solely dedicated to bug reports and Pull Requests, enabling contributors to have a better focus on bug fixing work. Therefore, we are now closing all older feature proposals on the main issue tracker.
If you are interested in this feature proposal, please open a new proposal on the GIP tracker following the given issue template (after checking that it doesn't exist already). Be sure to reference this closed issue if it includes any relevant discussion (which you are also encouraged to summarize in the new proposal). Thanks in advance!


Clear all old state?

in the case permissions user: when I log-in with a permission user and responding to $states, then I log-out and log-in with other permission user. so i need to remove all old state and will add other state again. it seems $state just set and get method, i can't remove a state on it.
do anyone for me a way to remove all old state?

At present the state tree is fixed. We plan to address this at some point in the future. Follow along with #1095.


make Button pop

see changes: https://6453b19e84a1fbd9f2d8058a-zkzdvnhltr.chromatic.com/?path=/story/design-system-button--all-buttons


anime is not recognised in a bat file.

Describe the bug

"'anime' is not recognized as an internal or external command, operable program or batch file"
When i type anime dl in a batch file. It tells me that. It works on normal cmd tho.
To reproduce

Install.bat
:::: Ignore this. Only removes the script from the cmd screen.
@echo off

:::: Path
cd %PATH%

::::Reads the settings.
call settings.bat

:::: Well this is the first choice. It lets you choose between Anime and Manga or just Exit.
:choice
echo - What do you want to download/do? -
echo - Type one of the numbers below to continue. -
echo - Note: If you want to choose which anime/manga to download please go to settings.bat -
echo               1. Anime
echo               2. Manga
echo               3. Exit
set /P c=Answer here!:
if /I "%c%" EQU "1" cls && goto :anime
if /I "%c%" EQU "2" cls && goto :manga
if /I "%c%" EQU "3" cls && goto :pause
goto :choice

:::: This is the second choice. It lets you choose between either shutting down the pc or just exiting the console by doing the pause command.
:choice2
echo - Do you want to shut down the computer? -
echo - Type one of the numbers below to continue. -
echo                 1. Yes
echo                 2. No
set /P c=Answer here!:
if /I "%c%" EQU "1" goto :shutdown
if /I "%c%" EQU "2" goto :choice3
goto :choice2

:::: This is the third choice. Giving you the choice of downloading something else.
:choice3
echo - Do you want to download something else? -
echo - Type one of the numbers below to continue. -
echo                 1. Yes
echo                 2. No
set /P c=Answer here!:
if /I "%c%" EQU "1" cls && goto :choice
if /I "%c%" EQU "2" goto :pause
goto :choice3

:::: Anime section. Downloads the anime using the parameters in the settings.
:anime
anime dl %ANIME% %QUALITY% %PROVIDER%
set /P c=This is only a small pause. Type "1" to proceed:
if /I "%c%" EQU "1" cls && goto :choice2

:::: Manga section. Downloades the manga using the url provided in the settings.
:manga
manga-py "%MANGA_URL%"
set /P c=This is only a small pause.  The default provider is twist.moe.
:::: Manga source i recommend is BATO.TO
:::: If you get this error "CUID#12 - Download aborted.". Then don't worry it is harmless.
:::: Worst thing it does is maybe decrease download speed a little bit.

:::: Download path:

set PATH=D:\Amine

:::: Anime:

set ANIME="Naruto Shippuden"
set PROVIDER=
set QUALITY=-q 1080p

:::: Manga:

set MANGA_URL=

:::: INFO

:::: PATH MUST BE SET SO YOU DON'T DOWNLOAD INTO SYSTEM32

:::: Current anime providers: 4anime, anitube, anime8, animebinge, gurminder, animedaisuki, animeflix, animeflv,
:::: animefreak, animefree, animefrenzy, animekisa, animetake, animeonline360, animeout, animerush, animesimple,
:::: animesuge, animevibe, animixplay, darkanime, dbanimes, erai-raws, egyanime, fastani, itsaturday, justdubs,
:::: kickass, kissanimex, kisscartoon, 9anime, nyaa, putlockers, ryuanime, subsplease, twist.moe, tenshi.moe,
:::: vidstream, voiranime, vostfree
:::: Some sources may not work anymore. If it doesn't try a different source.

:::: More info send a direct message to H4rl#5307 on discord.

LOG

It seems to occur only in this bat script

It seems to occur only in this bat script

So any support?

So any support?

Fixed it. %PATH% was conflicting with /P

Fixed it. %PATH% was conflicting with /P


Unable to resolve module AccessibilityInfo

🐛 Bug Report
Not sure if this is related to RN or Metro.
I came across this error while trying to use Metro to bundle a single React Native component but then I also found out that a new initialised project has this issue when checking for deps.
To Reproduce
$ react-native init bugProject
$ cd bugProject
$ react-native dependencies --entry-file index.js
Loading dependency graph, done.

Unable to resolve module `AccessibilityInfo`
from `.../node_modules/react-native/Libraries/react-native/react-native-implementation.js`:
Module `AccessibilityInfo` does not exist in the Haste module map

Expected Behavior
It should work
Code Example
Check above it's extremely simple to reproduce just init a new project and run the command.
Environment
  React Native Environment Info:
    System:
      OS: macOS 10.14.3
      CPU: (8) x64 Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz
      Memory: 2.76 GB / 16.00 GB
      Shell: 5.3 - /bin/zsh
    Binaries:
      Node: 10.15.1 - ~/.nvm/versions/node/v10.15.1/bin/node
      Yarn: 1.13.0 - ~/.nvm/versions/node/v10.15.1/bin/yarn
      npm: 6.4.1 - ~/.nvm/versions/node/v10.15.1/bin/npm
      Watchman: 4.9.0 - /usr/local/bin/watchman
    SDKs:
      iOS SDK:
        Platforms: iOS 12.1, macOS 10.14, tvOS 12.1, watchOS 5.1
      Android SDK:
        API Levels: 23, 25, 26, 27, 28
        Build Tools: 23.0.1, 26.0.1, 26.0.2, 27.0.0, 27.0.3, 28.0.3
        System Images: android-25 | Google APIs Intel x86 Atom_64, android-27 | Intel x86 Atom_64
    IDEs:
      Android Studio: 3.1 AI-173.4819257
      Xcode: 10.1/10B61 - /usr/bin/xcodebuild
    npmPackages:
      react: 16.6.3 => 16.6.3
      react-native: 0.58.6 => 0.58.6

I can definitely reproduce this:
  React Native Environment Info:
    System:
      OS: macOS High Sierra 10.13.6
      CPU: (8) x64 Intel(R) Core(TM) i7-4870HQ CPU @ 2.50GHz
      Memory: 93.90 MB / 16.00 GB
      Shell: 5.3 - /bin/zsh
    Binaries:
      Node: 11.0.0 - /usr/local/bin/node
      Yarn: 1.13.0 - ~/.yarn/bin/yarn
      npm: 6.5.0 - /usr/local/bin/npm
      Watchman: 4.5.0 - /usr/local/bin/watchman
    SDKs:
      iOS SDK:
        Platforms: iOS 12.1, macOS 10.14, tvOS 12.1, watchOS 5.1
      Android SDK:
        API Levels: 21, 23, 24, 25, 26, 27, 28
        Build Tools: 21.1.2, 23.0.1, 24.0.0, 24.0.3, 25.0.0, 25.0.1, 25.0.2, 25.0.3, 26.0.1, 26.0.2, 26.0.3, 27.0.2, 27.0.3, 28.0.3
        System Images: android-23 | Intel x86 Atom_64, android-23 | Google APIs Intel x86 Atom_64, android-24 | Intel x86 Atom, android-24 | Intel x86 Atom_64, android-24 | Google APIs Intel x86 Atom_64
    IDEs:
      Android Studio: 3.3 AI-182.5<IP_ADDRESS>99772
      Xcode: 10.1/10B61 - /usr/bin/xcodebuild
    npmPackages:
      react: 16.6.3 => 16.6.3
      react-native: 0.58.6 => 0.58.6
    npmGlobalPackages:
      create-react-native-app: 1.0.0
      react-native-cli: 2.0.1
      react-native-git-upgrade: 0.2.7

seem issue here. when i use "metro-visualizer": "0.53.0" , has the same error:
Module `AccessibilityInfo` does not exist in the Haste module map

The error is now different, and it feels like it's something happening even before:
$ react-native dependencies --entry-file index.js
error The "from" argument must be of type string. Received type undefined

Should I open a new issue or rename this one?

@mtt87 You fix the "AccessibilityInfo" issue?

No I just tried to reproduce the issue with the latest version of RN0.59 and that's the new error message that I get.

@mtt87 Please check https://github.com/facebook/react-native/issues/23906#issuecomment-472639800. This should fix the issue for you in RN version <= 0.58. Please report the new error message in the new version to https://github.com/react-native-community/react-native-cli That is the right place for this 🙂 Hope that helps!

@kelset This looks like it should be resolved too.

Thank you I’m gonna close it :)

Thanks all! <3


Add script to fix UUIDs in MySQL replication

The bare uuid function call in MySQL isn't replication safe when
performing STATEMENT-level binary replication:
http://dev.mysql.com/doc/refman/5.1/en/replication-rbr-safe-unsafe.html
In a previous migration, we batch-updated several models using this
function to insert content_id values. When these migrations replicated
to our backup and read-only slaves, the UUIDs became wrong because of
the replication safety issue.
This means that currently our backups aren't current with production as
the content_id values differ.
This commit fixes that by adding a script to be run on the master
machine which:

Grabs the content_id in Ruby-land, avoiding replication issues
Forcing an UPDATE statement to run using update_columns call
Once this has run, the UPDATE statements will replicate to the
slaves containing the correct strings, which will synchronise the
slave values with the master.

The migrations themselves were future-proofed in
4864e94.
The command should be run with rails r - we chose this path over a
data migration because we don't want this script to run inside a
transaction (it takes over 90 seconds to run).

Replaces #2043

LGTM


Addition Problems

I can't actually add torrents or magnet links to the player

Can you provide more detail?

I'm having the same problem. There's not much to specify, I just clicked on the "stream torrent" right on the kickass torrent site and the playback app opened but nothing happened, there was just this cat dancing on the screen. I also tried downloading the torrent and opening it directly on the app but the result was the same

I have the same issue.
Opening a locally stored video file using the "Add Media" button will play the video in the main window.
Opening a locally stored torrent file using the "Add Media" button will not. The cat wobble simply continues uninterrupted :) Using "paste" and drag-and-drop with a torrent file or magnet link doesn't work either (it does with local media files).
I'm experiencing this with the latest version on Mac.

This works fine for me on 1.6.0. What version of Playback are you using?

I am having the same trouble.  I click the stream in playback button on Kickass torrents and playback opens with a message that says "invalid link or unsupported file type".  I have tried it with several different torrents, and the same thing happens.  help?

+1


how to make someone not able to use the controls

What is your question?
Hi,
I want to know how to make someone not able to use their controls.
I don't want to use stunned because I also don't want the strum to play an animation.

Enabke bot play during that time. Then disable it. If they are already using botplay do not trigger the script.

I don't want to use botplay since it will just hit the notes for the player.

wait does that section contains notes? if it does make it an ignore note.

I'll go more into depth:
I have an event that makes you need to fulfill a specific criteria. While the player hasn't fulfilled it, he isn't supposed to use his controls

Use stunned and make fake strums during that time hiding the real one. Then show the real one and hjde the fakes after the condition is fufilled. ( this is the easiest way I could think of.)


Adding SNO+ and proton scattering to sntools

I have added SNO+ as a detector into sntools in the form of two different geometries: inner AV filled with liquid scintillator, and external water inside the PMT support structure. This has added two new geometries to sntools called 'sphere' and hollowSphere'. The latter is two concentric spheres with the inner being empty and the outer being filled.
SNO+ also needed the addition of Liquid Alkyl-benzene (LAB) as a detector material. This has been added with the averaged chemical composition calculated through the carbon chain lengths.
Proton elastic scattering has also been implemented as an interaction channel. This is the second largest interaction channel for SNO+ and is available to liquid scintillators. This has been based off John F Beacom et al., 2002: 10.1103/PhysRevD.66.033001.
The results have been cross-checked with SNO+ preliminary event rates, as well as other an analytical event rate calculator, EstrellaNueva.
I've not yet added to the documentation, but I'm happy to do so in the same style as already written.
Please let me know if you have any comments/questions. Cheers, Sammy

Thanks @svalder, this is looking good!
Don’t worry about the failing tests for now—the unit tests still pass as expected, and the integration tests only fail because the new output files are being compared to a hard-coded output file which doesn’t include proton scattering events.
(Actually, we should check with @yschnellbach: I don’t think you’ve studied proton scattering for WATCHMAN-LS thus far, right? Are you happy with it being added as part of this PR or should we remove this channel from the ls material for the time being?)
A couple things before we can merge this:

[ ] Please go ahead and update the documentation, yes!
[ ] Why ep as the short name for proton scattering? (Is this some SNO+ convention?) To me, ps for proton scattering would be more intuitive (and consistent with es for electron scattering, too).
[ ] What cross checks have you done on the proton scattering implementation, beyond comparing event counts with other software? (That by itself is a good sign, but cross section code is notoriously tricky and can have more subtle bugs. I can take a look at the code & paper side by side in the next few days, but additional checks would be good.)
[ ] Can you add a few unit tests for the proton scattering channel? (See /tests/test_*.py for examples for other channels.)
[ ] Regarding tests, let’s wait for Yan-Jie’s response.

Hi, we haven't studied proton scattering for WATCHMAN-LS so far, but looking over the PR, I see no reason to omit it from the ls material. Looks good and useful to me.

Okay, I’ve just pushed a commit to update the integration test. With that, this PR is complete. 🎉 Thank you so much @svalder for all your work on this!


SWARM-787 - Allow specification of a main() from a @DefaultDeployment.

[X] Have you followed the guidelines in our Contributing document?
[X] Have you created a JIRA and used it in the commit message?
[X] Have you checked to ensure there aren't other open Pull Requests for the same issue?
[X] Have you built the project locally prior to submission with mvn clean install?

Motivation
To cleanly handle testing better, and avoid duplication, allow
provisioning of a main() through an attribute on the @DefaultDeployment
annotation.
Modifications
Adding @DefaultDeployment(main=MyMain.class) capability.
Result
Instead of requiring a @CreateSwarm which may replicate the logic
performed within an exist main(), just allow pointing to the existing
main().

Retest this please

Merge away.
On Monday, October 24, 2016, Ken Finnigan<EMAIL_ADDRESS>wrote:

@kenfinnigan approved this pull request.
CI passed, still want to hold?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/wildfly-swarm/wildfly-swarm/pull/195#pullrequestreview-5564047,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAA-T8SrCFAQBf5uO9e9bheDdOjRq2aMks5q3UpRgaJpZM4KfJp0
.


Error and Request customization

This is a niche change i guess,
But the premise of it would be to allow the user to implement their own HTTP and Error classes.
Example of this being useful is if Server side validation errors are encapsulated in objects, or need to be handled a different way.
Instead of having to override every onFailure method, implement a RequestError class that handles it.
import CustomResponsefrom './CustomResponse.js';
import {Model} from 'vue-mc'

class CustomModel extends Model {

    options(){
        HTTP: {
            Response: CustomResponse
        }
    }
}

@lgullestrup I'm not convinced that this is the best way to solve the problem.
You can override getRequest, which should return a Request object. This request is responsible for providing the Response. So really all you'd need to do is override getRequest in your base model and collection. If we only specify an option, it's not always clear how to instantiate it.
/**
 * @returns {Request}
 */
getRequest(config) {}

Default:
export default class Request {

    constructor(config) {
        this.config = config;
    }

    /**
     * @returns {Promise}
     */
    send() {
        return new Promise((resolve, reject) => {
            axios.request(this.config)
                .then((response) => {
                    return resolve(new Response(response));
                })
                .catch((error) => {
                    return reject(new RequestError(error, new Response(error.response)));
                })
        });
    }
}

I guess I see your point.
The thinking around it was being able to change the way the function and error classes work without having to change the face, and override every function in model and collection that use them.
in some instances, its only a single function that needs to be updated, IE. the response going one step deeper into the data,

Closing this for now, not sure if there's intention to come back to it at this stage.


Replace backslash with foreslash in funcPath.

This caused a bit of nuisance as a Windows-based developer. It was not translating backslashes, so the path created for test files were not working.
Hopefully this is ok.

Fixed by PR #14, to be released with package version 0.5.7


Cyber talker or listener run outside the docker

System information

OS Platform and Distribution (e.g., Linux Ubuntu 14.04): Linux Ubuntu 14.04.5
Apollo installed from (source or binary): source
Apollo version (1.0, 1.5, 2.0, 2.5, 3.0): Apollo 3.5

Steps to reproduce the issue:
I need to use carla python client connect with apollo. So I try to run a example like this:
I run a listener outside the apollo docker, and run a talker inside the docker. Also tried in reverse.

Copy cyber.so and depends lib outside the docker.
Run "python cyber/python/examples/listener.py" outside of docker.
Run "python cyber/python/examples/talker.py" in docker.
I ran both scripts inside the docker and they worked well. When I run as above they seems to connect but receive the following error:
talker

apollo@in_dev_docker:/apollo$ python cyber/python/examples/talker.py
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0423 12:44:10.171006 27691 global_data.cc:153] [talker_sample] host ip: <IP_ADDRESS>
================================================================================
write msg -> integer: 2
text: "talker:send Alex!"

================================================================================
write msg -> integer: 3
text: "talker:send Alex!"

listener
$ python cyber/python/examples/listener.py
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0423 12:44:08.900657 27662 global_data.cc:153] [cyber_py] host ip: <IP_ADDRESS>
========================================================================================================================
E0423 12:44:11.176287 27688 segment.cc:233] [cyber_py] get shm failed.
E0423 12:44:11.176373 27688 segment.cc:85] [cyber_py] init failed, can't read now.
E0423 12:44:12.177665 27688 segment.cc:233] [cyber_py] get shm failed.
E0423 12:44:12.177772 27688 segment.cc:85] [cyber_py] init failed, can't read now.
E0423 12:44:13.179174 27688 segment.cc:233] [cyber_py] get shm failed.
E0423 12:44:13.179261 27688 segment.cc:85] [cyber_py] init failed, can't read now.
E0423 12:44:13.569265 27688 segment.cc:233] [cyber_py] get shm failed.

Any ideas?

I think it's an issue of cross-machine communication. Please reference to "https://github.com/ApolloAuto/apollo/issues/7050#issuecomment-468584667"

@ZeusJupiter Thanks for your reply!
I have read the comments and I have successfully connected the two clients in docker. In addition, I have connected one client in the docker on one computer to another client on another computer( Cross physical machine ).
I don't think this is my operational error. Maybe this caused by running one client in docker and the other don't(they both in one computer, but one in docker, one outside). I guess this's because they think they are in the same computer, so use shm mode to communicate, but they don't.
Maybe some configurations will fix this? I have also submitted a issue to the fast-RTPS and wait for there reply #501

@daohu527 Please modify the CYBER_IP of "apollo-install-dir/setup.bash" for host and docker. Make sure the CYBER_IP of host machine is the host's ip , and the CYBER_IP of docker is the docker's ip.

@ZeusJupiter Thx, I follow the method and it works well.
Moreover, Could you introduce how the client in docker find the client outside the docker? Is the container port transparent, or is it some RTPS protocol? Thanks again for you job!

@daohu527  Client in docker find other clients using RTPS discovery, which is a peer-to-peer discovery system using multicast.

It's hard to understand why client in docker will multicast to the host. I will try to learn how the docker network work. Thx

@daohu527 Hello, I am also trying to connect .py in- and outside the docker just like your case with Apollo 6.0. But I got a No module named 'cyber.proto.unit_test_pb2'' error. I learnt that python binaries are handled by bazel from apollo-6.0. So is it still possible to connect  .py in- and outside the docker?
Thx in advance!

@daohu527 Hello, I am also trying to connect .py in- and outside the docker just like your case with Apollo 6.0. But I got a No module named 'cyber.proto.unit_test_pb2'' error. I learnt that python binaries are handled by bazel from apollo-6.0. So is it still possible to connect  .py in- and outside the docker?
Thx in advance!

I'm not sure and need to check, I currently execute it by compiling python to binary.
I am not sure that I can run python scripts directly, due to some problems in 6.0

I'm not sure and need to check, I currently execute it by compiling python to binary.
I am not sure that I can run python scripts directly, due to some problems in 6.0

Hi all!
I am using Apollo pre6
I am running Apollo on two parallel PCs according to this instruction.
But I notice the following peculiarity. The frequency of published channels by computer # 1 does not match the frequency of this channel on computer # 2. For example, if the frequency of the channel "/ apollo / sensor / lidar128 / compensator / PointCloud2" on PC1 is 10 Hz, then the frequency on PC2 can be 6 Hz. I also noticed a feature that big data channels slow down the work of another PC.
So I have a question.
Is it possible to publish not all channels, but selective channels between two PCs?


Editorial: document potential error in selectRange

Prior to this commit, the algorithm for
Intl.PluralRules.prototype.selectRange asserted that its invocation of
the ResolvePluralRange abstract operation would not return an abrupt
completion. This was inaccurate because ResolvePluralRange returns a
throw completion when the two input numbers do not describe a valid
range and because because the relationship between the specification
variables x and y is not verified prior to invocation.
Communicate the potential for failure by replacing the ! shorthand
with ?.

Certainly. Should be all set, now


Vendor dependencies

Motivation
We try to specify version ranges, to not force our users onto a certain version of a library. But frequently enough, we need to limit those versions any way because we need a certain version, or even a specific fork. That forces a user to use that version as well.
Idea
We should copy Django's approach and vendor the libraries. E.g. oscar.vendors. namespace (Django mostly uses django.utils, but has non-vendored libraries in there as well).
Problems

Does this even work for libraries that need to be part of INSTALLED_APPS? I'm thinking static files, template tags, etc.
How would we manage updates, etc.? Would we include the entire repo with git subtree or suchlike, or have a process to include the Python package?
How would we handle licences? Where would we display them?

Closing for now. The situation is much better these days and vendoring leads to extra maintenance.


Add a RA-L 23 paper (presented in ICRA24)

I add one paper. Please kindly consider it.

Thanks, but this reference has already been in the OTTA.md due to the adapted online adaptation paradigm in this paper.


PlotShape.plot

Closes issue #3

@ramcdougal Ready for review. Example output at https://github.com/mcdougallab/matlabneuroninterface/issues/3

The built-in plotshape interpolates diameters rather than using a single diameter for a segment. (The segment diameter is the diameter at the center of the segment, but the diam3d information exists for all 3D points.)
For an (artificial) example of where this makes a difference, see the code and image just below: https://nrn.readthedocs.io/en/8.2.2/python/modelspec/programmatic/topology/geometry.html#d-specification-of-geometry
If this is hard or computationally inefficient, I don't think it should block merging this branch, because this is very useful as-is... but I'm mentioning it in case it isn't hard. :)

The built-in plotshape interpolates diameters rather than using a single diameter for a segment. (The segment diameter is the diameter at the center of the segment, but the diam3d information exists for all 3D points.)

Currently the plotted diameter in the xyz-plot is the average diameter of two consecutive 3D points. Would you rather plot cone segments? That is probably possible with a surface plot (as far as I know 'tapered' lineplots are not possible in MATLAB), but that will take some work; I would prefer to put that in a separate issue and focus on the other issues for now.
Whatever varname is selected by the user is currently shown per segment, by colour coding. So if the user selects diam, the segment diameter is used for colouring, not the pt3d interpolated diameter. Would you prefer to make that a special case and use the pt3d interpolated diameter for the colour plot as well?

One more question: should we call n.define_shape() at the start of PlotShape.plot()?

One more question: should we call n.define_shape() at the start of PlotShape.plot()?

Yes. Let's do that. It's what the interviews (but not Python) version does.

Re cone segments: that's what the interviews version does, which I think is best, however I agree it's not a priority.
(I think the segment diameters ought to match the interpolated diameter at the center.)


Expand documentation for creating drivers

As title says it would be really helpful to have a bit more guidance for writing drivers. There is only one tiny paragraph in the docs. A few suggestions:

Example how to use stream adapters
how does conversion of stream libraries work and how do i enable that as library author

I think this would lead to a much greater understanding of the core. At the moment I'm reading through various drivers in this repo trying to understand them.

@stalz I think this is now addressed with cycle unified. I will close this issue


Add destination service attributes to inbound TCP filter mixer attributes

When creating an inbound TCP listener, all destination service mixer attributes (destination.service.*) were missing.
[ ] Configuration Infrastructure
[ ] Docs
[ ] Installation
[X] Networking
[ ] Performance and Scalability
[X] Policies and Telemetry
[ ] Security
[ ] Test and Release
[ ] User Experience
[ ] Developer Infrastructure

Hi @FrimIdan. Thanks for your PR.
I'm waiting for a istio member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.
Once the patch is verified, the new status will be reflected by the ok-to-test label.
I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: FrimIdan
To complete the pull request process, please assign kyessenov
You can assign the PR to them by writing /assign @kyessenov in a comment when ready.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

pilot/pkg/networking/plugin/mixer/OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

/assign @kyessenov

Unfortunately, this is by design. For a TCP workload/pod that is exposed as two services A and B, we don't have a way to determine at the pod what service name was used to reach the pod.

@kyessenov Thanks for the reply, I understand the issue but,

Is it a good practice to expose pod to two services?
Want it be best afford to show at least one of the services instead of not showing at all?

@FrimIdan: PR needs rebase.

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.


limit on 8192 simultaneously alive goroutines is exceeded, dying...

I just follow the example on the homepage, which when i run with rate 50 duration 60 it is perfectly fine, but when i try to run with rate 200 duration 60, then i am running into this issue:
limit on 8192 simultaneously alive goroutines is exceeded, dying...

@tsenart  pls help, thanks for ur time.

Hi @lnshi,
The vegeta process is hitting OS resource limits. Have you tried tuning those? Check https://github.com/tsenart/vegeta#limitations

@tsenart hmm, i tried to search that error message, it doesn't look like related to the ulimit, but let me try that first.

@tsenart  no, it is not the ulimit issue, i increased the ulimit to 655340,  both for -u and -n still getting the same issue: GOCACHE=off go test -v -race -tags load tests/load_test.go -run TestInceptionPredictAPILoad -args -rate=200 -duration 30
=== RUN   TestInceptionPredictAPILoad
race: limit on 8192 simultaneously alive goroutines is exceeded, dying
FAIL	command-line-arguments	14.523s


billboard can't find a module

hello bro! My bevy version is 0.11.2, and the hanabi version is 0.7. I posted the reference example of the billboard, but there was an error and the OrientModifier could not be found·

and this is my cargo.toml

Try again, politely.


Generated client with custom path: ENOENT: no such file or directory, open 'D:\<projectpath>\node_modules\.prisma\client\schema.prisma

Bug description
Hello, i've commented on #10512 and told to create a new issue.
I tried creating a client in a custom path with the @prisma/client@dev but when loading the created client it throws
ENOENT: no such file or directory, open 'D:\development\<project-workspace>\node_modules\.prisma\client\schema.prisma'.
this is the schema used to generate the client

generator client {
  provider        = "prisma-client-js"
  output          = "./client"
  previewFeatures = ["interactiveTransactions"]
  binaryTargets = ["linux-musl", "darwin", "windows"]
}

datasource db {
  provider = "mysql"
  url      = env("DATABASE_URL")
}

I use this to generate a npm private library because I need multiple prisma clients with different schemas, so I import each of them from the corresponding library:

const client1 = await import('@myorg/prisma1').PrismaClient
const client2 = await import('@myorg/prisma2').PrismaClient

const prismaClient1 = new client({ datasources: { db: { url: this.prepareUrl(factoryOptions) } } })

But upon instantiating any one of them it produces that ENOENT error.
The libraries I mentioned have the following folder structure when installed in the consuming project:
inside node_modules/@myorg:

How to reproduce

generate a prisma client with a custom path on a separate directory.
Install the directory as a dependency on another project
Load the generated client from the custom directory into the project
Instantiate the client

Expected behavior
It would be expected the generated client to be capable of loading the runtime and prisma.schema from within it's own directory when an output path is specified on the .schema
Prisma information

generator client {
  provider        = "prisma-client-js"
  output          = "./client"
  previewFeatures = ["interactiveTransactions"]
  binaryTargets = ["linux-musl", "darwin", "windows"]
}

datasource db {
  provider = "mysql"
  url      = env("DATABASE_URL")
}

Environment & setup

OS: windows
Database: mysql
Node.js version: 16

Prisma Version
prisma                  : 3.13.0-dev.3
@prisma/client          : 3.13.0-dev.3
Current platform        : windows
Query Engine (Node-API) : libquery-engine ba8e3c2c2615e6af9303b3930e7de9377999a0e7 (at<EMAIL_ADDRESS>Migration Engine        : migration-engine-cli ba8e3c2c2615e6af9303b3930e7de9377999a0e7 (at<EMAIL_ADDRESS>Introspection Engine    : introspection-core ba8e3c2c2615e6af9303b3930e7de9377999a0e7 (at<EMAIL_ADDRESS>Format Binary           : prisma-fmt ba8e3c2c2615e6af9303b3930e7de9377999a0e7 (at<EMAIL_ADDRESS>Default Engines Hash    : ba8e3c2c2615e6af9303b3930e7de9377999a0e7
Studio                  : 0.459.0

ALSO TRIED WITH
Environment variables loaded from .env
prisma                  : 3.12.0
@prisma/client          : 3.12.0
Current platform        : windows
Query Engine (Node-API) : libquery-engine 22b822189f46ef0dc5c5b503368d1bee01213980 (at<EMAIL_ADDRESS>Migration Engine        : migration-engine-cli ba8e3c2c2615e6af9303b3930e7de9377999a0e7 (at<EMAIL_ADDRESS>Introspection Engine    : introspection-core ba8e3c2c2615e6af9303b3930e7de9377999a0e7 (at<EMAIL_ADDRESS>Format Binary           : prisma-fmt ba8e3c2c2615e6af9303b3930e7de9377999a0e7 (at<EMAIL_ADDRESS>Default Engines Hash    : 22b822189f46ef0dc5c5b503368d1bee01213980
Studio                  : 0.459.0

Can you try to use the generated Prisma Clients directly?
How do you go from that generated folder to the private library?

Thanks for the answer.
What do you mean by directly? generating and using the generated client directly on the application that's supposed to use prisma? I could do that, but that's exactly the burden we are trying to avoid. If every application needs to generate the client, this means we need to keep several .schemas in sync at each change, and also update each Dockerfile or build scripts whatsoever to generate the clients on each build for every application as well. If that's not what you mean, please let me know.
About the private library, that screenshot I showed about @myorg/prisma-geral is the whole library, on the library itself I have the dependencies on the @prisma/client and prisma cli to generate the client on a custom path based on the schema, this outputs that lib/ that can be seen on the screenshot. Then the library can be added normally with yarn add @myorg/prisma-geral, that will point to the index.d.ts and index.js inside lib/client that is the generated client.
This is the package.json of the library:
{
  "name": "@myorg/prisma-geral",
  "version": "1.0.0",
  "description": "add description",
  "types": "lib/client/index.d.ts",
  "main": "lib/client/index.js",
  "files": [
    "lib/*.js",
    "lib/*.ts",
    "lib/**/*.js",
    "lib/**/*.ts",
    "lib/*.prisma"
  ],
  "scripts": {
    "build": "npx prisma db pull --schema=lib/schema.prisma && rimraf lib/client && prisma generate --schema=lib/schema.prisma",
    "pre:publish": "rimraf ./lib/client && npx prisma generate --schema=lib/schema.prisma && yarn publish",
    "test": "jest"
  },
  "dependencies": {
    "@prisma/client": "^3.12.0"
  },
  "devDependencies": {
    "@types/node": "^17.0.22",
    "prettier": "^2.3.2",
    "prisma": "^3.12.0",
    "rimraf": "^3.0.2"
  },
  "license": "ISC"
}

I was trying to reproduce the issue on a smaller repository and made it work by accident while installing the libraries locally i.e npm i ../path-to-library wich results in a dependency with "@myorg/prisma-geral": "file: ../path-to-library, however, once published it sopped working again, i'm still trying to get more info on what happens

What do you mean by directly? generating and using the generated client directly on the application that's supposed to use prisma? I could do that, but that's exactly the burden we are trying to avoid. If every application needs to generate the client, this means we need to keep several .schemas in sync at each change, and also update each Dockerfile or build scripts whatsoever to generate the clients on each build for every application as well. If that's not what you mean, please let me know.

Sorry, should have elaborated. I meant:
Can you try to use the generated Prisma Clients directly to confirm that it is generated correctly and should work, and the problem is only introduced in the further process of putting it into a package and using it via that? Thanks.

I said before that I've made it work by accident but I guess I were dreaming, could not make it work again anyway, here is a reproducible example https://github.com/TheVoid-0/issue-prisma-enoent-schema.prisma if someone could aid me with some insights. I do not know what exactly prisma would need to work in a package, I've assumed that as long as it had it's client it would work, maybe I'm missing something simple?
@janpio thanks for elaborating, yes i've tried that before inside the own prisma package I was creating to see if the custom path was working correctly, and was successfull
const prisma = new (await import('./client')).PrismaClient()
console.log('created') // No error is thrown

The issue seems to appear when the client is called from out of the scope of the package:

const prisma = new (await import('@myorg/prisma-geral')).PrismaClient() // this points to: ./node_modules/@myorg/prisma-geral/lib/client
console.log('created') // error is thrown before reaching here

Thanks again for taking your time

Well, turns out that I was only being stupid, sorry for wasting your time, prisma works as intended so far.
In my package I was only publishing the "js" part of the generated client, the policy I've set to package.json.files was letting the query engines out, so when importing the package it would obviously not work.
So if others try to do the same, don't be like me and assure you are publishing everything prisma needs, wich is, everything that is inside de output folder.
Unfortunately the error message stranded me pretty far and this was the last thing I checked. Completly my fault anyway.
Thanks for the help and sorry for the useless issue!

That is an interesting error case that we were also definitely not aware of yet.
What is confusing me, if I understood correctly you did include the .prisma file about which the error message complains, but only the engine files (so the executables) were not included. Is that correct? I think we still have a bug then.

Yes @janpio you are correct, the only files missing on the published library were the query engines .node ones, once I've included them all started working without any problems so far. It looks like if they are missing, prisma fall back to look for everything on the default location node_modules/.prisma Wich will not exist in this scenario. Not sure what prisma should do, but perhaps showing an error message that the query engines are missing would give a better hint that something in the building and/or packaging went wrong.

Getting something similar on a monorepo multi zone nextjs project
Trying to use prisma in an internal package but each app is giving a prisma error - unable to find schema.prisma same as here
I'm using custom generated client location, and have tried without a files [] and with, haven't found any success
if I manually copy paste the schema.prisma into the next build, it seems to at least cause different errors, but all the same feels like there's still something I'm missing here?
Tried based on @TheVoid-0's comments to adjust a files[] to include the .node files etc but wasn't able to get any working config off of that

any updates here? I'm having the same issue in monorepo nextjs project with turbo.

If you have a monorepo, then you have the same or similar error message but a different problem @amirmamaghani. Please open a new issue and optimally include a reproduction project for your situation - then we can take a look. Thanks!


Getting 500 error

NOTE: Before filing a ticket, please see the following URL:
https://github.com/hapifhir/hapi-fhir/wiki/Getting-Help
Describe the bug
Getting:
Error: HTTP 500 Server Error:
OperationOutcome:
Error: HAPI-2223: Timer already cancelled.; nested exception is java.lang.IllegalStateException: Timer already canceled.
To Reproduce
Steps to reproduce the behavior:
Go to http://hapi.fhir.org/baseR4
Make any request eg: https://hapi.fhir.org/baseR4/Patient
See 500 error
Expected behavior
200  Response
Environment (please complete the following information):

HAPI FHIR Version
OS: macOS
chrome, safari

Server is back up

Had the same issue, server came back online... it took 10 hours. Alternative approach: install your copy of a server on a local, try to get all the mock data on it as well.

How to install a copy server? May I know the procedure to get locally?

How to install a copy server? May I know the procedure to get locally?
Depends on what issues you got.


Bug: internal error: entered unreachable code: We should never have decoded calldata for contract creation

Component
Forge
Have you ensured that all of these are up to date?

[X] Foundry
[X] Foundryup

What version of Foundry are you on?
forge 0.2.0 (93ebcdd 2023-08-15T00:21:30.341654717Z)
What command(s) is the bug in?
FOUNDRY_PROFILE=ci forge test --out forge-artifacts
Operating System
Linux
Describe the bug
I get the following error if I execute the following command FOUNDRY_PROFILE=ci forge test --out forge-artifacts:
The application panicked (crashed).
Message:  internal error: entered unreachable code: We should never have decoded calldata for contract creations
Location: crates/evm/src/trace/mod.rs:248

This is a bug. Consider reporting it at https://github.com/foundry-rs/foundry

Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
Run with RUST_BACKTRACE=full to include source snippets.
Aborted
 ELIFECYCLE  Command failed with exit code 134.

My repository is private, unfortunately, and I'm not sure how I can share a repro best.

Alright, two observations after some debugging: It only happens using the ci profile, even if I use the same configurations as in the default profile (the default profile always runs successfully). My foundry.toml is:
## defaults for all profiles
[profile.default]
src = 'src'                                                 # the source directory
test = 'test'                                               # the test directory
out = 'out'                                                 # the output directory (for artifacts)
libs = ['lib']                                              # a list of library directories
cache = true                                                # cache the builds
cache_path = 'cache'                                        # where the cache is stored
solc_version = '0.8.21'                                     # override for the solc version
evm_version = 'paris'                                       # set the EVM target version (prevent using the `PUSH0` opcode)
optimizer = true                                            # enable the solc optimiser
optimizer_runs = 999999                                     # the number of optimiser runs
verbosity = 3                                               # the verbosity of tests
fs_permissions = [{ access = "read-write", path = "./"}]    # set read-write access to project root

## default overrides for the CI runs
[profile.ci]
force = true                                                # always perform a clean build
fuzz = { runs = 10_000 }                                    # increase the number of fuzz runs
verbosity = 4                                               # increase the verbosity of tests

Furthermore, I found that the error is triggered by the following test:
function testDeployCreateRevertNonPayable() public {
    vm.expectRevert({revertData: abi.encodeWithSelector(CreateX.FailedContractCreation.selector, createXAddr)});
    createX.deployCreate({initCode: hex"01"});
}

If I replace hex"01" with abi.encode(hex"01") it will run successfully (if I use abi.encodePacked instead it will revert). So two questions @Evalir: why is this throwing only if I use the ci profile and why is there an issue with the hex/abi.encodePacked instruction?

superseded by https://github.com/foundry-rs/foundry/issues/6139


Add support for narrowing faceted results

The HaystackFacetSerializer should also include a hyperlink which can be used to narrow on the selected text using field_options or overridden field_options from query string.
Ideally, it should be able to perform drill-down on multiple "selected_facets" (See official Haystack docs).

Fixes


Introduce string_view and use it for gpr_split_host_port

This is a roll forward of #19218 with a fix.
The issue was that instead of using the return value,
the original patch was checking the length of the host
and port.
The fix is as simple as the following two-line change.
Added unittests in test/core/gprpp/host_port_test.cc to
resolve the issue.
diff --git a/src/core/lib/gprpp/host_port.cc b/src/core/lib/gprpp/host_port.cc
index f3f8a73602..bb7ea5c391 100644
--- a/src/core/lib/gprpp/host_port.cc
+++ b/src/core/lib/gprpp/host_port.cc
@@ -90,8 +90,8 @@ bool SplitHostPort(StringView name, UniquePtr<char>* host,
   StringView host_view;
   StringView port_view;
   const bool ret = SplitHostPort(name, &host_view, &port_view);
-  host->reset(host_view.empty() ? nullptr : host_view.dup().release());
-  port->reset(port_view.empty() ? nullptr : port_view.dup().release());
+  host->reset(ret ? host_view.dup().release() : nullptr);
+  port->reset(ret ? port_view.dup().release() : nullptr);
   return ret;
 }
 }  // namespace grpc_core

Sorry about that @markdroth. I split the patch in two: first is the clean revert, and second is the fix. thanks for the review!

@markdroth sorry about the hassle, but I had to make two changes and rebase everything.

I had to fix the credential_test.cc and revert in this PR.
I had to fix the fix.  Problem is that the code always returns a host string when it's able to split, but port will be nullptr if it's empty regardless of the return value.

I pushed the extra commits above,  and will wait to see if there are other cases that I've missed. Sorry about the extra round-trip.

Still LGTM.

Thank you! Will request an internal cherrypick then.

Merging for cherry-pick.


[RFC] Bluetooth: Samples: Use string printing functions for error codes

When developing Bluetooth applications, you typically run into some errors. If you are an experienced Bluetooth developer, you would typically know how to translate the error codes into string representations. Others might not.
This commit proposes to add string printing of error codes for all samples to make them more user-friendly.
Initially only a single sample is updated
Example output from the peripheral_hids sample when the peer rejects pairing:
Bluetooth initialized
Bluetooth authentication callbacks registered.
Advertising successfully started
Connected 5E:67:02:D3:1C:DB (random)
Security failed: 5E:67:02:D3:1C:DB (random) level 1 err BT_SECURITY_ERR_PAIR_NOT_ALLOWED(6)
Disconnected from 5E:67:02:D3:1C:DB (random), reason BT_HCI_ERR_REMOTE_USER_TERM_CONN(0x13)

Looks generally fine. One thing that bugs me a little bit, is the lack of space between the string and the (). Maybe it's just me but I find it harder to read when the two parts are "glued together" like that.

Security failed: 5E:67:02:D3:1C:DB (random) level 1 err BT_SECURITY_ERR_PAIR_NOT_ALLOWED(6)
Disconnected from 5E:67:02:D3:1C:DB (random), reason BT_HCI_ERR_REMOTE_USER_TERM_CONN(0x13)

I agree, something can be done there. Here is how it will look and some other suggestions

Add spaces

Security failed: 5E:67:02:D3:1C:DB (random) level 1 err BT_SECURITY_ERR_PAIR_NOT_ALLOWED (6)
Disconnected from 5E:67:02:D3:1C:DB (random), reason BT_HCI_ERR_REMOTE_USER_TERM_CONN (0x13)

Add parentheses around everything

Security failed: 5E:67:02:D3:1C:DB (random) level 1 err (BT_SECURITY_ERR_PAIR_NOT_ALLOWED(6))
Disconnected from 5E:67:02:D3:1C:DB (random), reason (BT_HCI_ERR_REMOTE_USER_TERM_CONN(0x13))

Change the order of decimal and string representation

Security failed: 5E:67:02:D3:1C:DB (random) level 1 err 6 (BT_SECURITY_ERR_PAIR_NOT_ALLOWED)
Disconnected from 5E:67:02:D3:1C:DB (random), reason 0x13 (BT_HCI_ERR_REMOTE_USER_TERM_CONN)

Add apostrophes to the printing of error code

Security failed: 5E:67:02:D3:1C:DB (random) level 1 err "BT_SECURITY_ERR_PAIR_NOT_ALLOWED (6)"
Disconnected from 5E:67:02:D3:1C:DB (random), reason "BT_HCI_ERR_REMOTE_USER_TERM_CONN (0x13)"

[x] Option 3

for me

Option 3 looks good to me too

Updated the comment with the proposal to include the configuration where strings are not compiled in. Then option 3 looks a bit weird

Updated the comment with the proposal to include the configuration where strings are not compiled in. Then option 3 looks a bit weird

I wonder if I was looking at the wrong option. Out of the ones you have now 2 and 4 looks most reasonable, however I think an even better one would be to go with option 4 and forget the parentheses completely :
// strings enabled
Security failed: 5E:67:02:D3:1C:DB (random) level 1 err 6 BT_SECURITY_ERR_PAIR_NOT_ALLOWED
Disconnected from 5E:67:02:D3:1C:DB (random), reason 0x13 BT_HCI_ERR_REMOTE_USER_TERM_CONN
// strings disabled
Security failed: 5E:67:02:D3:1C:DB (random) level 1 err 6
Disconnected from 5E:67:02:D3:1C:DB (random), reason 0x13

That way the trouble you get to with the "unused whitespace" isn't visible since it sits at the end of the line rather than between visible characters.

Last push doesn't change code. It only updates the commit message to match the chosen alternative.


refactor(raf): Remove requestAnimationFrame

This PR began with an attempt to replace RAF with the new ember-raf-scheduler, but after testing I realized that our usage of RAF doesn't appear to actually have any performance benefits. With that in mind, it definitely makes more sense to not complicate the runloop and remove it entirely for now.
With RAF:

Without RAF:

Both actions in total take 3ms. I think what's going on here is creating a new Popper will modify the DOM in some way before it measures, which forces it to do a layout anyways.
Note: Popper's scheduleUpdate function is still going to be using RAF and it will likely be more performant than a normal update. We should consider replacing it with an ember-raf-scheduler based one to make sure it integrates with tests/Ember correctly.
@action
scheduleUpdate() {
  raf.schedule('affect', this._popper.update);
}

Decided to just go for it and replace scheduleUpdate as well. I think it's going to bite us when it doesn't end up updating correctly during tests since the waiters can't actually wait for arbitrary RAFs.

LGTM


save tensorflow estimator based custom model for inference

thanks for the example codes. Experimented with Text Classification for character_rnn (https://github.com/tensorflow/tensorflow/blob/671baf080238025da9698ea980cd9504005f727c/tensorflow/examples/learn/text_classification_character_rnn.py).
How can i write a serving_input_fn for it ? I want to save and restore this model
extended the code to save but getting error, please help
from tensorflow.contrib.learn.python.learn.utils import input_fn_utils
feature_spec = {"feature":tf.FixedLenFeature([100],tf.int64)}
serving_input_fn = input_fn_utils.build_parsing_serving_input_fn(feature_spec)
and than
classifier.export_savedmodel(export_dir_base='model', serving_input_receiver_fn=serving_input_fn)
and getting this error
TypeError: Failed to convert object of type <class 'dict'> to Tensor. Contents: {'feature': <tf.Tensor 'ParseExample/ParseExample:0' shape=(?, 100) dtype=int64>}. Consider casting elements to a supported type.

@neuralminds,
Could you please provide a minimal code snippet to reproduce the issue reported here and also the TensorFlow version you are using.
I was able to run the code given in the link without any issues. Please find the gist of it here. Thanks!

Thanks for a response. I am using Tensorflow 1.15
pls find the code snippet here(https://gist.github.com/neuralminds/ea46e94faebc2beb7af20a0b609f1485).
I have exported the trained model as .pb files but when trying to restore for inference it throws error.
Also attaching rendered notebook here for reference
estimator save and restore example.zip

how i can input new data to this trained model for inference?

@neuralminds,
On running the code, I am facing an error stating InvalidArgumentError: Name: <unknown>, Key: chars, Index: 0.  Data types don't match. Data type: float but expected type: int64 	 [[{{node ParseExample/ParseExample}}]]
Please find the gist of it here. Could you please confirm if this is the intended error. Thanks!

yes

hello @jvishnuvardhan , pls help in fixing the error. Struggling to restore the model for inference

Hi There,
We are checking to see if you still need help on this, as you are using an older version of tensorflow which is officially considered end of life . We recommend that you upgrade to the latest 2.x version and let us know if the issue still persists in newer versions. Please open a new issue for any help you need against 2.x, and we will get you the right help.
This issue will be closed automatically 7 days from now. If you still need help with this issue, please provide us with more information.


"UnicodeEncodeError: 'ascii' codec can't encode characters in position 0-2: ordinal not in range(128)"

Download Canturell-Regular.zip
psautohint Canturell-Regular.otf

[...]
Saving font file with new hints...Sat Jul 15 23:51:45 2017
Traceback (most recent call last):
  File "/home/nikolaus/.local/bin/psautohint", line 11, in <module>
    load_entry_point('psautohint==1.1.0.dev0', 'console_scripts', 'psautohint')()
  File "/home/nikolaus/.local/lib/python3.6/site-packages/psautohint/autohint.py", line 1357, in main
    hintFile(options)
  File "/home/nikolaus/.local/lib/python3.6/site-packages/psautohint/autohint.py", line 1324, in hintFile
    fontData.saveChanges()
  File "/home/nikolaus/.local/lib/python3.6/site-packages/psautohint/BezTools.py", line 1206, in saveChanges
    ttFont.save(tempPath)
  File "/home/nikolaus/.local/lib/python3.6/site-packages/fontTools/ttLib/__init__.py", line 219, in save
    self._writeTable(tag, writer, done)
  File "/home/nikolaus/.local/lib/python3.6/site-packages/fontTools/ttLib/__init__.py", line 658, in _writeTable
    tabledata = self.getTableData(tag)
  File "/home/nikolaus/.local/lib/python3.6/site-packages/fontTools/ttLib/__init__.py", line 669, in getTableData
    return self.tables[tag].compile(self)
  File "/home/nikolaus/.local/lib/python3.6/site-packages/fontTools/ttLib/tables/C_F_F_.py", line 20, in compile
    self.cff.compile(f, otFont)
  File "/home/nikolaus/.local/lib/python3.6/site-packages/fontTools/cffLib/__init__.py", line 123, in compile
    children = topCompiler.getChildren(strings)
  File "/home/nikolaus/.local/lib/python3.6/site-packages/fontTools/cffLib/__init__.py", line 431, in getChildren
    children.extend(topDict.getChildren(strings))
  File "/home/nikolaus/.local/lib/python3.6/site-packages/fontTools/cffLib/__init__.py", line 2043, in getChildren
    charStringsComp = CharStringsCompiler(items, strings, self)
  File "/home/nikolaus/.local/lib/python3.6/site-packages/fontTools/cffLib/__init__.py", line 348, in __init__
    self.items = self.getItems(items, strings)
  File "/home/nikolaus/.local/lib/python3.6/site-packages/fontTools/cffLib/__init__.py", line 507, in getItems
    cs.compile()
  File "/home/nikolaus/.local/lib/python3.6/site-packages/fontTools/misc/psCharStrings.py", line 1039, in compile
    bytecode = bytesjoin(bytecode)
  File "/home/nikolaus/.local/lib/python3.6/site-packages/fontTools/misc/py23.py", line 170, in bytesjoin
    return tobytes(joiner).join(tobytes(item) for item in iterable)
  File "/home/nikolaus/.local/lib/python3.6/site-packages/fontTools/misc/py23.py", line 170, in <genexpr>
    return tobytes(joiner).join(tobytes(item) for item in iterable)
  File "/home/nikolaus/.local/lib/python3.6/site-packages/fontTools/misc/py23.py", line 125, in tobytes
    return s.encode(encoding, errors)
UnicodeEncodeError: 'ascii' codec can't encode characters in position 0-2: ordinal not in range(128)

Not sure if this is a bug in psautohint or the underlying libs?

Ah, it's a Python 3 issue. Runs fine with Python 2.

Yes, hinting binary fonts does not currently work in Python 3, I need to fix that.


Memory accumulates when running long lua scripts

The following script repeatedly sets a key to different values.  Memory grows quickly and excessively as the script is run (over many GB).  If the script is able to run to completion the memory is freed.
Script:
for i = 1,<PHONE_NUMBER>0, 1 do
redis.call("SET", "ZzZ_MYKEYZzZ"..i.."key", i)
end
Repro:
./keydb-cli --eval /tmp/bench.lua
This behavior is particularly bad when FLASH backing is used as it leads to write amplification.

I'm wondering what application you could possibly have in which such a script could be useful. It's for scripts like that that you don't allow hackers to have access to your redis port

The bug isn't that this specific use case doesn't work, but rather that a cache is allowed to grow unbounded.  This can cause problems in real world use cases.

Misunderstanding of the script.  The underlying issue is that FLASH has little control over kernel paging and results in high levels of writes.  This will be fixed when we implement manual paging.


[bug] tauri dev -c flag error

Describe the bug
yarn tauri dev -c file.json gives me below error
Error running CLI: No such file or directory (os error 2)

if i pass json string it is working as expected.
Reproduction
No response
Expected behavior
passing json file path to cli should properly merge config
Platform and versions
Environment
  › OS: Mac OS 11.6.5 X64
  › Node.js: 14.18.1
  › npm: 6.14.15
  › pnpm: Not installed!
  › yarn: 1.22.18
  › rustup: 1.24.3
  › rustc: 1.59.0
  › cargo: 1.59.0
  › Rust toolchain: stable-x86_64-apple-darwin

Packages
  › @tauri-apps/cli [NPM]: 1.0.0-rc.9
  › @tauri-apps/api [NPM]: 1.0.0-rc.4
  › tauri [RUST]: 1.0.0-rc.8,
  › tauri-build [RUST]: 1.0.0-rc.7,
  › tao [RUST]: 0.8.4,
  › wry [RUST]: 0.15.1,

Stack trace
No response
Additional context
No response

Hmm generally it should work. Is that json file next to your tauri.conf.json? (That's where the cli should look for)

json file is under src-tauri folder. if i put content of file as string, it works.

My json file is under src-tauri folder. I ran yarn tauri dev -c ./src-tauri/file.json it gives error. If i cd into src-tauri then run yarn tauri dev -c file.json it works. It gives error from the root of the project.

I found a inconsistency between the dev and build command, i'll change both to look for the file relative to the CWD.
Seems weird that your CWD is changing yarn behavior since yarn should change CWD to your project root.

So in the current CLI yarn tauri dev -c file.json and yarn tauri build -c file.json should work if $PROJECT_DIR/src-tauri/file.json exists.


Musedev: Call Search Service From Biggroum Script

Write the code to send graphs and associated source files to the search service that runs the analysis.

The code implementing the museapi is implemented in the [https://github.com/cuplv/biggroum/blob/7ce8474ed0b01cd042941addbd4222595163346c/python/fixrgraph/musedev/api.py file.
The integration of the service starts in the https://github.com/cuplv/biggroum/blob/7ce8474ed0b01cd042941addbd4222595163346c/python/fixrgraph/musedev/api.py#L105 function: there is a list of TODO that you should implement to call the service.

Closed in #53


[JENKINS-41952] mismatch on the encoding of the keystore: sometimes as Secret(base64(keystore)) and sometimes as new SecretBytes(keystore).toString()

[JENKINS-41952] mismatch on the encoding of the keystore: sometimes as Secret(base64(keystore)) and sometimes as new SecretBytes(keystore).toString()
ℹ  PR started from #82

@stephenc I did not dare to cleanup the code for the moment, there are 2 paths of validation, one for each encryption of the keystore.


folder_block_ops: make a deCache entry even for overwritten files

Otherwise the file is not marked as dirty, and background syncs won't
happen.
Split out from #134.

Speaking of which, (not for this PR) should we eventually combine dirtyFiles, unrefCache, and deCache, i.e. have dirtyFile also hold a DirEntry and a syncInfo?

Yes probably, I put a TODO in the comment for this PR, and will open a reminder PR.

Also not for this PR, but is there any reason dirtyFiles has a BlockPointer key instead of a blockRef key? Does it need to distinguish fields other than id and refNonce?

No reason.  I think I just forgot about blockRef, sorry!


Add azurerm_consumption_budget_management_group,azurerm_consumption_b…

…udget_resource_group,azurerm_consumption_budget_subscription resources

Description of your changes

Fixes #131
Moving 3 resources to v1beta1 version

[x] azurerm_consumption_budget_management_group
[x] azurerm_consumption_budget_resource_group
[x] azurerm_consumption_budget_subscription

I have:

[x] Run make reviewable test to ensure this PR is ready for review.

How has this code been tested

Manually and Uptest:

/test-examples="examples/consumption/budgetmanagementgroup.yaml"

/test-examples="examples/consumption/budgetresourcegroup.yaml"

/test-examples="examples/consumption/budgetsubscription.yaml"


QH-31 Added table-style ladder as an option, which works better on mobile

Good work dude! Looks awesome


 After running a few requests on the server, my hardware sometimes crashes completely—this includes all four physical power supplies shutting off.
I followed the hardware testing procedures as outlined in this guide, and all tests passed successfully.
# docker exec 37b808c71bf7 /usr/bin/dcgmi diag --run 4 --fail-early
Successfully ran diagnostic for group.

+--------------------------------+-----------------------------------------+
|           Diagnostic           |     Result                              |
+--------------------------------+-----------------------------------------+
|           Metadata             |                                         |
| DCGM Version                   | 3.3.7                                   |
| Driver Version Detected        | 550.67                                  |
| GPU Device IDs Detected        | 26b9,26b9,26b9,26b9,26b9,26b9,26b9,26b9 |
+--------------------------------+-----------------------------------------+
|           Deployment           |                                         |
| DenyList                       | Pass                                    |
| NVML Library                   | Pass                                    |
| CUDA Main Library              | Pass                                    |
| Permissions and OS Blocks      | Pass                                    |
| Persistence Mode               | Pass                                    |
| Environment Variables          | Pass                                    |
| Page Retirement/Row Remap      | Pass                                    |
| Graphics Processes             | Pass                                    |
| Inforom                        | Pass                                    |
+--------------------------------+-----------------------------------------+
|           Integration          |                                         |
| PCIe                           | Pass - All                              |
+--------------------------------+-----------------------------------------+
|           Hardware             |                                         |
| GPU Memory                     | Pass - All                              |
| Diagnostic                     | Pass - All                              |
| Pulse Test                     | Pass - All                              |
+--------------------------------+-----------------------------------------+
|           Stress               |                                         |
| Targeted Stress                | Pass - All                              |
| Targeted Power                 | Pass - All                              |
| Memory Bandwidth               | Pass - All                              |
| Memtest                        | Pass - All                              |
| EUV Test                       | Skip - All                              |
+--------------------------------+-----------------------------------------+

However, there are instances where, if all four power supplies don't shut off, one or two of them will physically turn off. I tried running the same workload with text-generation-inference, and while I did not encounter a full server crash, some of the power supplies still tripped.

Has anyone else encountered this problem?
If not, what steps should I follow to debug this issue?

for hardware related problems, the general answer is to ask your admin and vendor.

Thank you @youkaichao for your answer.
As I mentioned in my initial post, I’m confident that the hardware isn’t the issue, as all stress tests have run for over 10 hours each without any problems (using gpuburn and dcgm).
I’m simply asking whether a potentially corrupted file could be causing errors with vLLM, which might then trigger a kernel panic or something like this (I’m unable to pinpoint the exact trigger for this issue, and I’m not entirely certain if the kernel panic is indeed the cause).
I suggest this because I’ve encountered this issue with mistralai/Mistral-Large-Instruct-2407 and meta-llama/Meta-Llama-3.1-70B-Instruct, but the problem does not occur with other models I use, such as Qwen/CodeQwen1.5-7B-Chat and microsoft/Phi-3-mini-128k-instruct.
Have there been any similar cases observed? Is there a protocol or method that I could follow to help identify what might be causing this issue?

I don't see similar cases. But you might be interested in https://docs.vllm.ai/en/latest/getting_started/debugging.html , there are some tools for you to play around to find more clues.

After activating a lot of server logs, it seems that the power supplies are undersized.
Thank you for your help @youkaichao


fix(IAM Access Groups): update service and add examples

PR summary
Updates the IAM Access Service after recent API changes and adds working examples to the project.
PR Checklist
Please make sure that your PR fulfills the following requirements:

[ ] The commit message follows the Angular Commit Message Guidelines.
[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features)

PR Type

[ ] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] New tests
[ ] Build/CI related changes
[ ] Documentation content changes
[ ] Other (please describe)

What is the current behavior?

What is the new behavior?

Does this PR introduce a breaking change?

[ ] Yes
[ ] No

Other information

:tada: This PR is included in version 0.15.2 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket: