Use Natural Language Framework for redaction

let text = "John Doe lives in New York."
let tagger = NLTagger(tagSchemes: [.nameType])
tagger.string = text

tagger.enumerateTags(in: text.startIndex..<text.endIndex, unit: .word, scheme: .nameType) { tag, tokenRange in
    if tag == .personalName || tag == .placeName {
        // Redact the sensitive information
        text.replaceSubrange(tokenRange, with: "[REDACTED]")
    }
    return true
}

let tagger = NLTagger(tagSchemes: [.nameType, .lexicalClass, .customSensitiveDataScheme])
let modelURL = Bundle.main.url(forResource: "SensitiveDataModel", withExtension: "mlmodelc")!
let customModel = try! NLModel(mlModel: MLModel(contentsOf: modelURL))
tagger.setModels([customModel], forTagScheme: .customSensitiveDataScheme)

tagger.string = inputText
tagger.enumerateTags(in: inputText.startIndex..<inputText.endIndex, unit: .word, scheme: .customSensitiveDataScheme) { tag, tokenRange in
    if let tag = tag {
        switch tag.rawValue {
        case "PASSWORD":
            // Handle password
        case "BANKACCOUNT":
            // Handle bank account number
        case "SEEDPHRASE":
            // Handle seed phrase
        default:
            break
        }
    }
    return true
}

convert to CoreML models:
import coremltools as ct

# Convert your trained model to Core ML format
coreml_model = ct.convert(your_trained_model, inputs=[ct.TensorType(shape=input_shape)])

# Save the Core ML model
coreml_model.save("your_model.mlmodel")

DeepPass: A deep learning approach for finding passwords in text4. This model uses neural networks to identify potential passwords within extracted text.

For more complex scenarios, consider using libraries like Microsoft's Presidio, which provides pre-trained models for recognizing various types of sensitive data without requiring direct training on sensitive information

Training models to identify sensitive data presents several significant challenges:

Data Privacy Risks: Training on real sensitive data can lead to privacy violations and potential exposure of confidential information[1][3].

Model Memorization: AI models might inadvertently memorize sensitive parts of the training data, making it possible for attackers to extract this information later[1].

Data Quality Issues: Poor quality data can result in unreliable or biased models, which is particularly problematic when dealing with sensitive information[3].

Complexity of Unstructured Data: Accurately detecting sensitive data in unstructured formats is challenging, often leading to false positives and noise when using simplistic methods[2].

Identifying Uncommon Identifiers: Classification solutions must be able to detect less common or proprietary personal identifiers, such as product serial numbers or GPS locations that could indirectly identify individuals[2].

Security Vulnerabilities: AI systems processing sensitive data are attractive targets for cyberattacks, including data poisoning attempts[3].

Scalability and Performance: Efficiently handling large volumes of sensitive data for training and classification can be technically challenging[3].

Lack of Transparency: Complex AI models can be difficult to interpret, making it hard to understand how they identify sensitive data and potentially hindering accountability[4].

To address these challenges, approaches such as using anonymized datasets, implementing robust data governance processes, leveraging advanced machine learning techniques for context understanding, and ensuring strong security measures are crucial. However, it's important to note that the safest approach is often to limit the collection and storage of sensitive data in the first place, rather than relying solely on AI models for detection.
Citations:
[1] https://fastdatascience.com/natural-language-processing/sensitive-data-machine-learning-model/
[2] https://www.sentra.io/learn/5-data-classification-challenges-that-security-teams-face
[3] https://dialzara.com/blog/ai-data-lifecycle-management-6-key-challenges/
[4] https://provost.wsu.edu/challenges-of-ai/

https://github.com/piiano and https://www.piiano.com/
https://github.com/ezarko/opendlp
https://github.com/microsoft/presidio
https://github.com/likedan/Awesome-CoreML-Models
https://github.com/john-rocky/CoreML-Models
https://github.com/securitybunker/databunker-store

Presidio can help identify sensitive/PII data in un/structured text

Apple's Natural Language Processing Framework: While not specifically designed for redaction, it can be used as a foundation for building an on-device redaction system. It offers capabilities like named entity recognition that could be adapted for identifying sensitive information.
MLKit for Android: Google's on-device machine learning SDK for Android includes text recognition and language identification, which could be used as building blocks for a redaction system.
Custom Core ML Models: For iOS, developers can create and deploy custom NLP models using Core ML, which runs entirely on-device.
TensorFlow Lite: This framework allows running lightweight machine learning models on mobile devices, which could be used to create a custom on-device redaction solution.

However, it's important to note that fully-featured, out-of-the-box solutions for on-device sensitive data redaction are not common. Most existing solutions that claim to be "on-device" often still require some level of cloud processing or are actually on-premises solutions rather than truly mobile on-device options.
Developers looking to implement such a system would likely need to build a custom solution using these on-device machine learning frameworks as a foundation.

https://developer.apple.com/documentation/coreml/reducing-the-size-of-your-core-ml-app

Custom Core ML models can vary significantly in size, ranging from a few megabytes to hundreds of megabytes. A typical custom Core ML model can be around 65-150 MB[3][4]. However, there are several techniques to reduce the size of these models:

Quantization: This technique can reduce model size by up to 50-66% without significant loss in accuracy[1][3]. For example:

A 65 MB model can be reduced to 33 MB using 16-bit quantization[3].
Quantizing to 16-bit can reduce models by about 40%[1].

Transfer Learning: This approach can make models up to 5 times smaller. A 65 MB model could be reduced to just 7 MB using transfer learning[3].

Architecture Selection: Choosing a more suitable architecture for mobile devices can significantly reduce model size[4].

Flexible Input/Output Sizes: This technique doesn't directly reduce model size but can eliminate the need for multiple models of different sizes[2].

It's important to note that the actual size of a custom Core ML model depends on various factors, including the complexity of the task, the architecture used, and the techniques applied to optimize the model.
Citations:
[1] https://reza.codes/2018-06-12/reducing-the-size-of-a-trained-coreml-model-a-deep-dive-into-quantization/
[2] https://fritz.ai/advanced-tips-for-core-ml/
[3] https://developer.apple.com/videos/play/tech-talks/10155/
[4] https://stackoverflow.com/questions/52347827/download-custom-coreml-model-and-load-for-usage-swift
[5] https://apple.github.io/coremltools/docs-guides/source/mlmodel.html
[6] https://developer.apple.com/documentation/coreml/model-customization
[7] https://developer.apple.com/documentation/coreml/reducing-the-size-of-your-core-ml-app


ClearCase menu entries appear in OUTPUT window

ClearCase menu entries (Checkout, Checkin, Undo Checkout, Compare with previous version, Version tree) appear in right click menu in OUTPUT window. Not expected as OUTPUT window doesn't contain a file. Other menu entries such Go To Definition, etc. only appear in file windows.

I can reproduce this on my installation.
@fr43nk this seems related to #14 , can you check?

Ok, will take a look at this. This was something I did not test or even think it could work :)

This is be fixed in 1.9.0.

Confirmed fixed in 1.9.0


Issue 1370

Check List:

Fixes 1370
Unit tests : YES
Javadoc with a code example (API only) : YES

Notes :

As explained here , I updated SoftProxies class and more particularly I commented METHODS_NOT_TO_PROXY.
I did this change in the pull request, no because I am sure that this part to be removed but because if it turns out that it is necessary it a serious problem that no automatic test may detect that.

I added a new method in the API : AbstractThrowableAssert.hasMessageFindingMatch() to write more specific assertions in should_collect_errors_when_using_extractingFromEntries_with_map(). In the absolute, the think that hasMessageMatching() is necessary but not enough as too restrictive for some cases.

@ebundy I have finished a first round of comments, thanks for your work!

I pushed according to your review but for the points I added a comment because I am not sure or I am wait for a go. Whatever, you are very welcome. It is a real pleasure to contribute to this library that I regularly use.

I have read about @Nested but never applied it yet, I'll have a look at the latest changes.


Debian buster build is failing in ROS buildfarm, no ros-noetic-ros-babel-fish package on that platform

https://build.ros.org/job/Ndev_db__foxglove_bridge__debian_buster_amd64/11/
KeyError: "The cache has no package named 'ros-noetic-ros-babel-fish'"

I don't understand why, the package is available on packages.ros.org. Also on the appropriate docker image I can find that package:
docker run -it --rm ros:noetic-ros-core-buster bash -c "apt update && apt-cache policy ros-noetic-ros-babel-fish"
[...]
ros-noetic-ros-babel-fish:
  Installed: (none)
  Candidate: 0.9.3-1buster.20220926.194426
  Version table:
     0.9.3-1buster.20220926.194426 500
        500 http://packages.ros.org/ros/ubuntu buster/main amd64 Packages

This has been fixed by re-releasing rosbridge_suite for noetic (see https://github.com/ros/rosdistro/pull/35528)

In a previous release my bloom had accidentally set catkin and ros-message-runtime instead of ros-noetic-catkin and ros-noetic-message-runtime for debian/noetic/buster/*

This also fixed the build for ros_babel_fish as it has a dependency on rosapi (released with rosbridge_suite)


FixedTypo.Update README.md

Fixed typo-double negative

Project name:
Project website/repository:
License:

Checklist for new projects:

[ ] The project is open-source and accessible.
[ ] Searched the existing entries to make sure this is not a duplicate.
[ ] Contains only a single addition (make separate PRs if adding more than one).
[ ] Added the link to the bottom of the relevant category.
[ ] Add icon from the media/icon/ folder if applicable (like ![Python](media/icon/python.png) ).
[ ] Created a new category only if necessary.
[ ] Checked spelling and grammar.
[ ] Removed trailing whitespace and periods.
[ ] Confirm the dash – is not a minus -.
[ ] Used title-casing (AP style) for project name.

I'm pretty sure the double negative is intentional here - "these packages are so essential that we can't include them" doesn't make logical sense.
If you want to avoid the double negative, perhaps it should be something like: "they are so essential for scientific workflows that we can't leave them out"


Unarchive repository & build image again

Blocked because of https://bugs.launchpad.net/cloud-images/+bug/2056442


/api/login_check is not working in browser

/api/login_check is not working in browser, but it works in postman and cli.

Not a bug (see https://github.com/chalasr/lexik-jwt-authentication-sandbox/issues/6).


Figure out the discussion page

Options basically are:

Store discussion content on our own Apparently there is people actually liking Discourse and not having any interaction features
Use the same kind of Discourse integration to the Paper forums that SpongeOre uses for its own forums

--

With the first option, we might as well make individual messages look nicer (and not as bare-boned/soulless as Discourse)
Reactions should be possible, but only with a selected few emojis (but a couple more than GH for example)
Have a simple reply button, adding a short view of the message that is replied to in the text field

this is pretty much done for MVP: we embed discourse


Texture Array mipmapping edge bleeding

Godot version:

3.3 official.
OS/device including version:

Windows 10, Nvidia 1050, GLES3
Issue description:

I'm trying to use texture arrays, the description says that in the case of using texture array, mipmapping maps will be created separately for each section of the texture, which should eliminate artifacts. However, the video shows everything. When you try to tile, the edges of the tile just flicker terribly. And not only do they flow, but also my eyes.
https://youtu.be/OsROaOnfXBI
Steps to reproduce:
To do this, you need to repeat the texture of a specific tile in the texture array with mipmapping enabled. Without mipmapping, everything works correctly, however, I would like to use mipmapping for a variety of reasons.
Minimal reproduction project:

https://disk.yandex.ru/d/tXW0FuBhm6hMmw
There are two scenes, one with just a texture, the other with a texture array. Artifacts are the same with mipmapping enabled. However, in the case of just a texture, when filtering is enabled, white bars appear at the edges. This is normal behavior, as I found out. Texture array allows you to use filtering without restrictions.
In blender in eevee, there is no such problem, mipmapping works correctly, no artifacts, a beautiful image. However, you have to turn off the filtering, because there is no texture array and white strips appear.
Precisely because mipmapping works correctly in the blender in this case (and on the same texture), I think that there may be a problem in the engine.
PS. Perhaps this is related to this issue https://github.com/godotengine/godot/issues/27837
#27837
However, I should note that the resulting artifacts are not always white and that this problem is observed in the texture array. Which is specially designed to solve problems with mipmapping in such cases. But it doesn't solve it. However, at least it helps with filtering.

I'm not convinced that this is a mipmapping issue. From the video you posted, it looks more like a lighting/alignment issue rather than a mipmapping problem in the textures.
Can you please upload an MRP directly here instead of using a third party site? Github allows uploading zip files by dragging and dropping them into the text box. The reason I ask is that I am at work and our security settings don't allow me to download a 100+mb zip file from a Russian website.

Can you please upload an MRP directly here instead of using a third party site? Github allows uploading zip files by dragging and dropping them into the text box. The reason I ask is that I am at work and our security settings don't allow me to download a 100+mb zip file from a Russian website.

GitHub doesn't allow uploading ZIP files larger than 20 MB either :slightly_frowning_face:
Here's the ZIP in OP reuploaded to 0x0: https://0x0.st/-BA1.zip

I have run the example project and identified the issue. The issue comes from two things:

Your custom planemesh has improper UVs
Your shader was zooming in on a section TextureArray and then force repeating.

When used properly, the TextureArray in your scene works fine. So, what do you need to do differently?
Use a mesh with proper UVs. UV's run from 0-1. When using a TextureArray each slice in the array is accessed as if it were a single texture (i.e. using the full range of UV coordinates). To access different slices you change the z value of the uv. A typical texture read looks like: ALBEDO = texture(tex_array, vec3(UV, slice_num)).rgb;. This doesn't work in your case because the UV is crafted to read from a small section of the UV, so you end up having to arbitrarily repeat the texture in shader (which breaks derivatives)
All I did was swap your ArrayMesh for a PlaneMesh and replace the calculation of uv1 with plain UV and all the artifacts disappeared.


Unable to load Vicuna-13b model.

For some reason, I'm unable to run the vicuna 13b model (based on llama) using the below command
text-generation-launcher --model-id path-to-vicuna --num-shard 1 --quantize --port 8010 --max-input-length 1538 --max-total-tokens 2048
Getting below error:
OverflowError: out of range integral type conversion attempted
On EC2 g5.2xlarge A10G 24GB
Loading same model with below in python works fine without any issues
AutoModelForCausalLM.from_pretrained(path-to-vicuna, device_map="auto", load_in_8bit=True)

Above error is with accelerate 0.18.0.
When I downgrade to 0.15.0 there is a different error:
Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit
                        the quantized model. If you want to dispatch the model on the CPU or the disk while keeping
                        these modules in 32-bit, you need to set `load_in_8bit_fp32_cpu_offload=True` and pass a custom
                        `device_map` to `from_pretrained`. Check
                        https://huggingface.co/docs/transformers/main/en/main_classes/quantization#offload-between-cpu-and-gpu
                        for more details.

I pulled latest code from main and installed flash-attn as well, and these issues are appearing now. However, there is issue with vocab_file intokenization_llama.py and I manually hardcoded it with tokenizer.model path as a workaround.

For someone who may come here with this error: OverflowError: out of range integral type conversion attempted.
In my case, it is because the pad token id of the Vicuna model is not set correctly. You can inspect this issue with the following code:
from transformers import LlamaTokenizer as TkCls

tk = TkCls.from_pretrained('Models/Vicuna-7B')
print(tk.eos_token_id)
print(tk.bos_token_id)
print(tk.pad_token_id)
print(tk.unk_token_id)

I found that my pad_token_id is None. My solution is as follows:
from transformers import LlamaTokenizer as TkCls

tk = TkCls.from_pretrained('Models/Vicuna-7B')
tk.pad_token_id = tk.eos_token_id
tk.save_pretrained('Models/Vicuna-7B')

After making these changes, my TGI launched successfully. I hope this helps someone.


Deprecate/remove Builder::add_migration?

This function clutters the public API.
Removing it may also let us hide the visibility underlying type from the pub.

Note: we cannot hide the unresolved migration type unless we refactor how GraphDefaults is constructed.

One possibly clean way to do this is to accept any type that is Into<UnresolvedMigration>?  We could then define simple types for the builder API for the symmetric and asymmetric cases.


Use ISO 8601 timestamp format in logs

Thanks @ShyamsundarR for finding this fix!
It seems this time encoding option was introduced to controller-runtime in v0.11.0 (Dec 14, 2021):
https://github.com/kubernetes-sigs/controller-runtime/commit/5bb6cb71f09f8adc76d63f1c614f88236590da05
I tried a few different off-the-shelf formats:
RFC 9333 Nano

2022-07-13T10:21:02.080805923-07:00     INFO    tester  Starting the controller test suite      {"time": "2022-07-13T10:21:02.080779928-07:00"}
STEP: bootstrapping test environment
2022-07-13T10:21:02.081105564-07:00     DEBUG   controller-runtime.test-env     starting control plane
2022-07-13T10:21:06.918841787-07:00     DEBUG   controller-runtime.test-env     installing CRDs
2022-07-13T10:21:06.918912996-07:00     DEBUG   controller-runtime.test-env     reading CRDs from path  {"path": "../config/crd/bases"}
2022-07-13T10:21:06.920396642-07:00     DEBUG   controller-runtime.test-env     read CRDs from file     {"file": "ramendr.openshift.io_drclusters.yaml"}
2022-07-13T10:21:06.923003282-07:00     DEBUG   controller-runtime.test-env     read CRDs from file     {"file": "ramendr.openshift.io_drplacementcontrols.yaml"}
2022-07-13T10:21:06.925019027-07:00     DEBUG   controller-runtime.test-env     read CRDs from file     {"file": "ramendr.openshift.io_drpolicies.yaml"}
2022-07-13T10:21:06.944220861-07:00     DEBUG   controller-runtime.test-env     read CRDs from file     {"file": "ramendr.openshift.io_volumereplicationgroups.yaml"}

RFC 9333

2022-07-13T10:24:33-07:00       INFO    tester  Starting the controller test suite      {"time": "2022-07-13T10:24:33-07:00"}
STEP: bootstrapping test environment
2022-07-13T10:24:33-07:00       DEBUG   controller-runtime.test-env     starting control plane
2022-07-13T10:24:39-07:00       DEBUG   controller-runtime.test-env     installing CRDs
2022-07-13T10:24:39-07:00       DEBUG   controller-runtime.test-env     reading CRDs from path  {"path": "../config/crd/bases"}
2022-07-13T10:24:39-07:00       DEBUG   controller-runtime.test-env     read CRDs from file     {"file": "ramendr.openshift.io_drclusters.yaml"}
2022-07-13T10:24:39-07:00       DEBUG   controller-runtime.test-env     read CRDs from file     {"file": "ramendr.openshift.io_drplacementcontrols.yaml"}
2022-07-13T10:24:39-07:00       DEBUG   controller-runtime.test-env     read CRDs from file     {"file": "ramendr.openshift.io_drpolicies.yaml"}
2022-07-13T10:24:39-07:00       DEBUG   controller-runtime.test-env     read CRDs from file     {"file": "ramendr.openshift.io_volumereplicationgroups.yaml"}

ISO 8601

2022-07-13T10:26:30.221-0700    INFO    tester  Starting the controller test suite      {"time": "2022-07-13T10:26:30.221-0700"}
STEP: bootstrapping test environment
2022-07-13T10:26:30.221-0700    DEBUG   controller-runtime.test-env     starting control plane
2022-07-13T10:26:35.828-0700    DEBUG   controller-runtime.test-env     installing CRDs
2022-07-13T10:26:35.828-0700    DEBUG   controller-runtime.test-env     reading CRDs from path  {"path": "../config/crd/bases"}
2022-07-13T10:26:35.830-0700    DEBUG   controller-runtime.test-env     read CRDs from file     {"file": "ramendr.openshift.io_drclusters.yaml"}
2022-07-13T10:26:35.834-0700    DEBUG   controller-runtime.test-env     read CRDs from file     {"file": "ramendr.openshift.io_drplacementcontrols.yaml"}
2022-07-13T10:26:35.836-0700    DEBUG   controller-runtime.test-env     read CRDs from file     {"file": "ramendr.openshift.io_drpolicies.yaml"}

The ISO 8601 looks good to me and is what this patch uses.  Though, I think it would be easier to read with a space instead of the T between date and time.

Only concern is that this drops TS in local TZ, I did not find any option to dump them in UTC, but something that needs consideration in the near future.

I tried kubectl logs with --timestamps=true with this patch and it shows two timestamps the first looks like RFC 9333 Nano, the second ISO 8601, both in UTC:
2022-07-13T23:46:57.414305343Z 2022-07-13T23:46:57.413Z INFO    setup   controllers/ramenconfig.go:73   loading Ramen configuration from        {"file": "/config/ramen_manager_config.yaml"}
2022-07-13T23:46:58.125464077Z 2022-07-13T23:46:58.125Z INFO    controller-runtime.metrics      metrics/listener.go:44  Metrics server is starting to listen    {"addr": "<IP_ADDRESS>:9289"}
2022-07-13T23:46:58.196427311Z 2022-07-13T23:46:58.196Z INFO    controllers.VolumeReplicationGroup      workspace/main.go:169   Adding VolumeReplicationGroup controller

without it shows just one timestamp, also UTC:
2022-07-13T23:46:57.413Z        INFO    setup   controllers/ramenconfig.go:73   loading Ramen configuration from        {"file": "/config/ramen_manager_config.yaml"}
2022-07-13T23:46:58.125Z        INFO    controller-runtime.metrics      metrics/listener.go:44  Metrics server is starting to listen    {"addr": "<IP_ADDRESS>:9289"}
2022-07-13T23:46:58.196Z        INFO    controllers.VolumeReplicationGroup      workspace/main.go:169   Adding VolumeReplicationGroup controller

so the local time zone seems to be with envtest only...


Why not. Did you test it?

Well, what I did was to re-build locally the circuit-build using the patch 0.2.3rc1 and forcing tox to install that dependency.
Here you can see that the patch was applied and the ref is working.

If you think I should check other way or if there is a dev page somewhere, let me know
cc: @mgeplf

It looks great! Thank you for such detailed representation. Lets merge it then.

@antonelepfl I'd remove links to our inner resources as this repo is open-sourced.


QaLora

Feature request
This came out
https://github.com/yuhuixu1993/qa-lora/blob/main/qalora.py
would like to use it with transformers
btw, I also got mezo integrated with transformers.  Maybe we can swap notes to get that integrated.
Motivation
more efficient
Your contribution
I'll test, contribute code if necessary

Yes, this is something we surely want to integrate into PEFT. The linked repo already uses PEFT, so hopefully this should not be too difficult to add. Let us know if you want to work on adding the feature.
Also, feel free to share your notes on MeZO, though I assume this is for the transformers Trainer, so please share them with the transformers folks.

mezo:
https://github.com/thistleknot/TrainLLMv3/blob/main/functions.py#L1284
transformers suggested I submit mezo here
https://github.com/huggingface/transformers/issues/24264

Id definitely be interested in this. It seems just as promising as LoftQ if not better.


Unable to overwrite log formatting into a console for Azure Function Isolated Host Worker

At the moment I can change the log format for function logging, but unfortunately cannot overwrite log formatting into a console for host, unlike the in-process function.
Steps to reproduce:
Prerequisites

Linux docker container
.NET 6 Isolated Function.
Program.cs file setup ⬇

await new HostBuilder()
    .ConfigureFunctionsWorkerDefaults(builder =>
    {
        builder.Services.AddLogging(provider =>
        {
            provider.ClearProviders();
            provider.AddJsonConsole();
        });
    })
    .ConfigureAppConfiguration(builder =>
    {
        builder.AddJsonFile("host.json");
        builder.AddJsonFile("work.settings.json");
    })
    .ConfigureServices((context, services) =>
    {

        services.AddLogging(builder =>
        {
        });
    })
    .Build()
    .RunAsync();

Actual log message in console:
info: Host.Function.Console[0]
      {"EventId":0,"LogLevel":"Error","Category":"MyTestServiceFunc.HealthFunction","Message":"Test works perfectly :). Some random number: 550","State":{"Message":"Test works perfectly :). Some random number: 550","0":550,"{OriginalFormat}":"Test works perfectly :). Some random number: {0}"}}

Expected log message:
{"EventId":0,"LogLevel":"Error","Category":"MyTestServiceFunc.HealthFunction","Message":"Test works perfectly :). Some random number: 987","State":{"Message":"Test works perfectly :). Some random number: 987","0":987,"{OriginalFormat}":"Test works perfectly :). Some random number: {0}"}}

So the main difference is in this line: info: Host.Function.Console[0] which brakes our logging agent which reads logs from container console (stdout) in JSON format only.

Hey, any comments on this?

We ended up filtering this out at promtail level, but that does not feel right.

It will not work for me, because I don't use application insights, but read logs from stdout.

Thanks for answering @jviau ! And just to clarify, we as developers have no control over this, and the only way to remove it is in our log scaping tool (promtail in my case)?

@jviau, it would be nice if this could be prioritized because we are writing the logs in JSON format single line. And every line it separate log entry. Therefore every log that we want to write multiplies by two as functions host logs category and line breaks. As a result, logging costs are twice as high.

@dalibormesaric correct there is no control over this at the moment. The worker process is created as a child of the host process and as part of that the stdout is redirected to the host process.
@kAleksei we have no concrete plans to address this at the moment. Is using stdout your only option? Can you add a custom ILoggerProvider and ILogger which outputs to some other handle or stream?

@jviau unfortunately, this is only the option to log into stdout.

Can you help me understand your scenario a bit more? Why is it important to log to stdout? What system are you using which relies on stdout?

We are deploying the azure functions isolated to k8s cluster. In the cluster, we have installed an agent, which is responsible for pulling logs from stdout of the container. So more than 1k different services are using this approach.
We are using datadog agent for gathering the logs. Here is the docs how it actually works: https://docs.datadoghq.com/containers/kubernetes/log/?tab=operator

@kAleksei thank you, that is helpful to understand your scenario. I am familiar with k8s log pattern like this and sounds like a solid reason for us to evaluate supporting this. Unfortunately, it won't be possible now. But we have been discussing sweeping improvements for observability in Azure Functions and this can be considered as a part of it. There is no ETA on that and the work has not been started yet.

@jviau, I appreciate your understanding. If you require any further information, please don't hesitate to ask. Additionally, I am eagerly awaiting updates on this item, as this feature holds a high level of importance for us.

I believe I have a problem related to the topic. In my case, I cannot remove the datetime stamp in front of the json, this ends up impacting elastic collection, which only accepts files in json format.

@domingosliraneto, did you have a chance to run your functions without IDE (like Visual Studio tools) and azure-functions-core-tools? For instance in container. Looks like this output formatted and written to console with debugging tools.

, você teve a chance de executar suas funções sem IDE (como ferramentas do Visual Studio) e ? Por exemplo, no contêiner docker. Parece que esta saída formatada e gravada no console com ferramentas de depuração.azure-functions-core-tools

Yes, I tested it in a container, and the effect is the same.

Guys,
Any update on this? Were you able to carry out the necessary tests and verify the point in question?

Logging is a quite useful and appreciated feature. Any update on this topic would be appreciated.


Changes database upgrade script names to be consistent for the <IP_ADDRESS> release

Changes the names of the schema-490to491* scripts to
schema-490to4910*
Changes the name of the Upgrade490to491 class to Upgrade490to4910
Modifies the Marvin setup.py script to use version <IP_ADDRESS>-SNAPSHOT

/cc @rhtyd @karuturi

@jburwell -1
The db upgrade version only considers the major/minor fields such as a.b.c, the last .d is ignored (for that matter any other suffix in the version). Due to the current mechanism of how db versions are implemented, used and run, the change cannot be accepted as it will cause db upgrade failures when the upgrade path is run (as you can see Travis has failed all jobs at the deploydb step). The db upgrade paths therefore won't run for any security release (for example, b/w <IP_ADDRESS> and <IP_ADDRESS>), unless we want to have db changes between security releases for the same major.minor release?

With new db schema/versioning and upgrade changes in #1654 we can merge this with some additional changes once #1654 is merged and fwd-merged.

@jburwell this needs to be reworked now that #1654 is merged. Good to have the changes but not a blocker for 4.8, 4.9 RCs.

@rhtyd I have fixed the DatabaseUpgradeCheckerTest to reflect <IP_ADDRESS> being a NoopUpgrade.  I also removed the unnecessary 4.9.0-><IP_ADDRESS> upgrade scripts and class.

@jburwell we'll need that upgrade path class, we have some alter table changes we want for the 4.9.0-><IP_ADDRESS> upgrade path, see the diff for changes you've removed.

@rhtyd good catch -- sorry for that oversight.  I have redone the PR to only rename the files and class.

LGTM

Tests performed:
- Upgraded from 4.9.0, upgrade path ran (whose sql file names were changed)
- Clean db deployment

Tests performed after fwd-merge, all pass:
- Upgraded from <IP_ADDRESS>
- Clean db deployment

LGTM.
Tested on CS 4.9.0 to <IP_ADDRESS>-snapshot installation.
(perhaps just change the comment below inside the SQL file to indicate <IP_ADDRESS> (missing .0?)
"-- Schema upgrade from 4.9.0 to 4.9.1;"
Logs:
2016-09-02 15:13:45,721 INFO  [c.c.u.DatabaseUpgradeChecker] (main:null) (logid:) DB version = 4.9.0 Code Version = <IP_ADDRESS>
2016-09-02 15:13:45,722 INFO  [c.c.u.DatabaseUpgradeChecker] (main:null) (logid:) Database upgrade must be performed from 4.9.0 to <IP_ADDRESS>
2016-09-02 15:13:45,723 DEBUG [c.c.u.DatabaseUpgradeChecker] (main:null) (logid:) Running upgrade Upgrade490to4910 to upgrade from 4.9.0-<IP_ADDRESS> to <IP_ADDRESS>
[...]
2016-09-02 15:13:45,984 DEBUG [c.c.u.DatabaseUpgradeChecker] (main:null) (logid:) Cleanup script /usr/share/cloudstack-management/setup/db/schema-490to4910-cleanup.sql is executed successfully
2016-09-02 15:13:46,019 DEBUG [c.c.u.DatabaseUpgradeChecker] (main:null) (logid:) Upgrade completed for version <IP_ADDRESS>

Thanks @milamberspace
Based on the tests and LGTMs, I'll proceed with merging this on 4.9. On fwd-merging, I've fixed conflicts and renamed a subsequent class to match the change. Fwd-merged master branch has also passed my tests.


QSOL-2759 -  integer_vector check min max values

Closing as the vector_values_between applies also to integer values.


⚠ Processors has degraded performance

In 23d858e, Processors ($STATUS_URL) experienced degraded performance:

HTTP code: 200
Response time: 57 ms

Resolved: Processors performance has improved in fbfe408.


Please merge badabcc into dev channel

@whesse @mit-mit
Changes void X() => foo() to void X() { foo(); } for two functions in the html library, where the DOM specification changed for foo (and it now returns a non-null value).
See #26740

Merged in 1.18.0-dev.4.1


disable alerts

I want to cancel the alert when the application is open. Have only external alarms.
My code:
OneSignal.configure({   onIdsAvailable: function (device) {     getUserId(device.userId);   },   onNotificationReceived: function (notification) {     permissions = {         alert: false,         badge: true,         sound: true     };     OneSignal.requestPermissions(permissions);   },   onNotificationOpened: function(message, data, isActive) {     console.log("MS TYPE", message.notification.payload.additionalData.type);     switch(message.notification.payload.additionalData.type) {     case '1':           Actions.messenger();         break;     case '2':           Actions.overview();         break;       }     } });

Hey @kamish770 , is this on iOS or Android?

ios

Please see https://github.com/geektimecoil/react-native-onesignal/issues/157#issuecomment-274646754


Expose addAccessory in the transport interface.

While I think this code is OK I have been unable to get a transport with >1 accessory working so maybe it's broken.

You can add more than one accessory to a transport as described in #72

Ahh I am a Go newbie so I couldn't work it out :)
Also, for my approach I create the transport with a particular name but then add other accessories in a loop.
On a related note: is there any sample code for a bridge? I looked at the LiFX one but it seems to create a new transport for every light.

No there isn't a sample code for a bridge, but it's documented here


[FLINK-19241] Forward ioExecutor into ResourceManagers

What is the purpose of the change
Before this change, the ResourceManager implementations were abusing the RPC executor for IO tasks. Now, we forward the ioExecutor of the ClusterEntrypoint into the resource managers.

Thanks a lot for the review. Merging ...


Use "label" to pass environment name

https://docs.tweepy.org/en/stable/api.html?highlight=search_full_archive#tweepy.API.search_full_archive

Thanks @Mike-Dunton for your help.  Merged.  Let me know if there's anything else you find that could fixed or improved.


Add references to the fern-ui and fern-reporter projects

Add references to the fern-ui and fern-ginkgo-client projects in the README.md so that people understand the projects in the ecosystem as well as know what these individual projects are for
Perhaps as a "See Also" section
We also probably need a simple arch diagram that shows the different projects and their interactions

Essentially  the flow is :
fern-ginkgo-client --(json)---> fern reporter --(graphql)---> fern-ui
|-----(go templates)--------> embedded html report

We also need to add the compatible versions for each of these projects in this README


feature request: Node get with any version

Ohai,
right now, the old Duffy API has a ver parameter in /Node/get, that can be used to select a node of a specific version (7, 8, etc) and if unset Duffy defaults to giving you a node with ver=7.
For our tests, it doesn't matter if we run them on 7 or 8 (as we deploy a couple of VMs ontop of the Duffy node we get), so it would be nice to be able to say "don't care" and get a free node from whichever pool is available right now.
Thanks!

Hey
What kind if help would you need? I am a mere user of Duffy, so I have no idea about the internals, just a feature wish :)

Hey
What kind if help would you need? I am a mere user of Duffy, so I have no idea about the internals, just a feature wish :)

Ok I am a beginner and looking for contributing to such projects. I want to know that can I set the version of duffy ?


Use LoadBalancerName dimension for ELB metrics

Classic ELBs use LoadBalancerName rather than LoadBalancer for their dimensions.
Fixes #379

When we do this the metric name is being changed from aws_elb_latency_average to aws_elb_az_latency_average. (v0.23.0-alpha). Why this is happening?

Version v0.23.0-alpha does not have the change in this PR, it was released in v0.28.0-alpha.
Using the current latest version v0.33.0-alpha and the following config.yml, I get aws_elb_latency_average metrics:
apiVersion: v1alpha1
discovery:
  jobs:
  - type: elb
    regions:
      - ap-southeast-2
    metrics:
      - name: Latency
        statistics:
        - Average

It does not appear that the metric names are changed, at least not for me.
If you're having problems, I would recommend raising a new issue rather than commenting on a year-old PR. In your new issue, you should include your full configuration, what versions you are comparing, what you expect to see, and the actual metrics that are being returned so that the problem can be diagnosed.


fix: update ThermostatMode names to match Z-Wave XML

Update ThermostatMode names to align with Command Class XML. XML names are more descriptive than names provided in documentation. Close #5446

Whoops. Looks like I jumped the gun on this one and need to read up more on the contribution guidelines.

FWIW this has the potential to be pretty breaking to applications using Z-Wave JS.
I'm not sure the upside is worth it.

At least one integration I maintain uses the names as parts of state IDs. Can't be certain that others don't do something similar.

Seems like a bust then.

I might consider it for a future semver-major update though. Let's reopen and set as draft.


Update the libvirt driver and fix driver check function

Fixed in #151

Merged in https://github.com/code-ready/crc/commit/ed1fd10b500272957c299d848685a5e333afb5c4


Continuing the badge sort

We had some discussion in https://github.com/badges/shields/pull/1895/files/f4e6e0c9c95b3c5530c98f614cba4efc65579426#r209434975 about the ratings, downloads, and social categories. There are some similar things in other, and we just added the dependents badges there, too.
Some initial proposals:

The Gem rank badges in http://shields.io/#/examples/rating are just rankings of downloads. Let's move them from Rating to Downloads.
Let's move the Docker Build badges from Other to Build.
Let's break out the code quality badges from Build to a new category. It could be called Code Quality. Or, we could lump in Libscore, SourceRank, Semver Stability, PyPi Status, CocoaPods docs %, and maybe the Maintenance badge, and call it Project Quality.
Create a Size category for the bundlephobia, github file, github repo, imagelayers, and microbadger size badges.

I opened #1948 with a couple more proposals.

Swinging by again, two proposals:

Code Quality

CocoaPods docs %
And many others

Project Activity or Activity category:

PyPi Status
Maintenance
And many others, like commits per year, latest release, etc.

Move a few into Rating:

Libscore
SourceRank
Semver Stability

Opened #2483 which I think is the last of these ideas (that are still making sense to me).


feat: remove test that checks for non-translated audited challenges

Checklist:

[X] I have read and followed the contribution guidelines.
[X] I have read and followed the how to open a pull request guide.
[X] My pull request targets the main branch of freeCodeCamp.
[X] I have tested these changes either locally on my machine, or GitPod.

Closes #XXXXX

I haven't seen this test catch anything OTHER than PRs where we are adding new steps (and thus know that the steps won't have translations yet). It just creates noise and unnecessarily blocks PRs.

The broader problem is something we might need to solve in a fancier way. i.e. when we want to add new challenges, we could add them to Crowdin first before making them live.

That would only work if we blocked a deployment until the files were translated, which seems counterintuitive. Otherwise we'd just be hosting the English content from the Spanish directory haha.

That would only work if we blocked a deployment until the files were translated, which seems counterintuitive. Otherwise we'd just be hosting the English content from the Spanish directory haha.

Nah, I was thinking that would could have the block flagged as hidden until it's translated. Deployments would proceed as normal, we just wouldn't display it.
Thing is, that only works if we can translate quickly enough. So, it's only viable if we're not in a rush to release the English version.
Ideally we'd release each language when it was ready, but we're a long way from that.


Unsatisfactory XML deserialization

Xml deserialization does not behave similarly to other objects such as json. You can not easily navigate a collection of SimpleXml objects which breaks the expectation of behaviour.

This has been resolved by the AyeAye/Formatters ReaderFactory


@sweir27 => Purchase 106 QA Fixes

This PR addresses design feedback from @briansw in PURCHASE-128, -129 AND -130:
https://artsyproduct.atlassian.net/browse/PURCHASE-106
In order to meet PURCHASE-129 (hover on link should not trigger checkbox hover state) I had to unset some of the default .artsy-checkbox styling and wrap the input in its text label, then align the link with the text. It appears fine for me in mobile and desktop, but it did take some nudging.

@erikdstock @sweir27 the period isn't sitting correctly on the baseline quite yet.


[BUG] Can't use on RaspberryOS 64 bit.

Describe the bug
I cannot access the picamera2 Python library on my Raspberry Pi OS 64 bit. I have previously used it in a Raspberry Pi OS 32 bit environment. I have tried reinstalling the picamera2 both via pip as well as sudo, updating sudo in between.
To Reproduce
import picamera2
Expected behaviour
picamera2 library should be imported
Console Output, Screenshots
`
(base) suprateem@raspberrypi:~/Python Projects/Teleport $ conda activate teleport
(teleport) suprateem@raspberrypi:~ /Python Projects/Teleport $ pip3 uninstall picamera2
WARNING: Skipping picamera2 as it is not installed.
(teleport) suprateem@raspberrypi:~ /Python Projects/Teleport $ sudo apt install -y python3-picamera2
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
python3-picamera2 is already the newest version (0.3.7-1).
The following package was automatically installed and is no longer required:
libfuse2
Use 'sudo apt autoremove' to remove it.
0 upgraded, 0 newly installed, 0 to remove and 18 not upgraded.
(teleport) suprateem@raspberrypi:~ /Python Projects/Teleport $ python test.py
Traceback (most recent call last):
File "/home/suprateem/Python Projects/Teleport/test.py", line 1, in
import picamera2
ModuleNotFoundError: No module named 'picamera2'
(teleport) suprateem@raspberrypi:~ /Python Projects/Teleport $ $
`
Hardware :
Raspberry Pi 4 Model B 8 GB / 512 GB

If you use apt to install packages do not mix them with pip installed packages.
pip uses different install locations than apt.
Probably your python has a PYTHONPATH where the install directory of picamera2 is not included, hence
it cannot find it.

You may just want to install the latest 64-bit OS from our website (or using Raspberry Pi Imager). Everything that you need is already installed and "just works".

Hi, is there any update on this? Thanks!

Hi,
After re-flashing the OS using the Raspberry Pi Imager, the library seems to be accessible again. Thanks.


[FLINK-6667] Pass a callback type to the RestartStrategy, rather than the full ExecutionGraph

… the full ExecutionGraph
Thanks for contributing to Apache Flink. Before you open your pull request, please take the following check list into consideration.
If your changes take all of the items into account, feel free to open your pull request. For more information and/or questions please refer to the How To Contribute guide.
In addition to going through the list, please provide a meaningful description of your changes.

[ ] General

The pull request references the related JIRA issue ("[FLINK-XXX] Jira title text")
The pull request addresses only one issue
Each commit in the PR has a meaningful commit message (including the JIRA id)

[ ] Documentation

Documentation has been added for new functionality
Old documentation affected by the pull request has been updated
JavaDoc for public methods has been added

[ ] Tests & Build

Functionality added by the pull request is covered by tests
mvn clean verify has been executed successfully locally or a Travis build has passed

@StephanEwen @tillrohrmann As discussed in https://github.com/apache/flink/pull/4220, I create this PR to fix issue FLINK-6667. Could you please have a look when you're free, thanks :)

@zjureel Thanks for this patch. I will pick it up from here.
I think there is a small additional change needed, and a test, but I can do that...

Thank you for your reply, I will fix FLINK-6665 after this PR is merged, thanks :)

I have taken and adapted the code for the patch in #4364

Thank you for the contribution!
The code form this PR has been improved and merged in this commit: 65400bd0a0f6a3bdd3e0bad05e2179534eaf6e9e
If you agree, could you close this PR?

Thank you for your merging, thanks


Template for the Attribution control

This allows to add map specific copyright, or copyright required for tools like geocoders that are used in the context of the map.

Please merge. Thanks.


Adjust the movement function

Please adjust the movement function. The ant should move in the direction of the highest value in the grid (food grid and home grid) depending on the status of the ant. It has a view of (-40, 40) degrees. If all the values of the grid are zero, then the ant should move with the movement function we created in Version1.py.

The code in test.py has a couple of issues. You will notice them once you run the code and place some food_sources. Would be very helpful if you can assist me with those problems....
Link to code: https://github.com/lucasthierry17/Ant_Project/blob/follow_phero/test.py

We chose a different function. Please look under the main branch, source path and then main.py


docs[patch]: Update google imports with google-genai package

Nvm, there are no imports to update 🎉


[meta-issue] Progress Tracker

This is a meta-issue for tracking the progress of the project till it's first public release.
I'll keep posting updates here.

[ ] Make a clear plan of Action for the project. (Replace this list)
[ ] Create a (high-level) list for things to be done. Add items to it when you get to an item.

oh I did add you as a Contrib to my repo to but I am not sure if py2c would work because it needs to be able to compile to all versions of any C compiler. hopefully this can be a piece of cake for ppl that know both python and C/C++.

@AraHaan

It's not really nice to add someone as a contributor to your project without even asking them at first. Not especially when they don't know who you are or that the project even existed.

Moreover, saying something along the lines of 'your project is not going to work. My version is better, Work with me' to someone is not the best way of convincing them to help. Especially when ill-informed.

From the first line in the README.md file [emphasis added]:

A trans-compiler for compiling Python code into human-readable C++ code

Also, your comment is a bit of noise for this issue thus I'm going to delete this as well as your message on 16th. We can talk over my mail if you wish to. Find it in the setup.py file in this repository.

To break the inactivity of this project and try to justify to the 100 people who probably know this project exists, as to why this project is inactive, I'm writing this. I'm pretty sure this is gonna be long.
tldr; This project is now dormant, I'm wiser, I am now looking into a different approach to the problem, mainly due to lack of time.
Q. Why has this project gone into a dormant state?
A. I am stuck in the vortex of Examinations for the past 6 months. I haven't really been able to put in much time to code in anything as such. Moreover, I may not get the required amount of time to invest in this project in the near future. By that I mean at-least another year or more based on how life goes. Because academic systems really care about how well you write on that sheet of paper. (that rant is for my non-existent blog, some other day).
Q. So, no one will fix this?
A. Through the loads of reseach/experiments I have done, in the past year or so, one thing I have come to realize is that this problem isn't exaclty an "interesting puzzle to solve" problem that I (naively) thought it was. It turns out this is a "genuinely difficult, maddeningly complicated, really hard to get working right" problem. While that most certainly doesn't mean that I'm no longer interested in solving this problem, I have a feeling I'm going to take a different approach to solving this problem.
Q. Where is this project headed?
A. Because of this lack of time, If it wasn't obvious by now, this project is really in a dormant state. I'm going to put a pointer in the README saying that.

Anyway, since I don't have access to my development machine, I'm writing down a bunch of things down.

The current approach I'm using, of converting the Python code into an internal representation followed by a pipeline of transformations to get a representation that can then be converted into C code can be made functional, it's just a lot of work. A lot of interesting work. But a lot of work. That originates from the problem being really complicated.
The Type-Systems of C++ and Python are very different. It is difficult even for humans at times to convert from one to another, for various reasons. Automating it will never be perfect. NEVER. But we can go close. Again, lot of work.
It would be a bad, really bad idea to not utilize Python's really well implemented data-structures. They are the result of a ton of work by really smart people.
There's more but now, I need to get back to my study table.

+1

@pradyunsg In case you are interested, Nuitka already does most of this.

Hi!
It was one of the projects I was tracking and indeed it does most (if not all) of this. I kinda wanted to see to what degree I can implement these things, on my own - mostly for learning.
I am still interested in this but right now, this project is a 'nice if I complete it'. I have other things in the pipeline that need to be done first.

Wanna make an IRC or Matrix room to talk? I'm really interested into a project for compiling python to raw instructions instead of using the CPython interpreter library. I have quite some free time to help.
Also what do you think of using LLVM instead of C?


Incorrect logo on Mac w/Linux

Description
Incorrect logo when running Trisquel (possibly others?) on Mac hardware.
Neofetch version
2.0.2
Screenshot

Verbose log
http://pastebin.com/Fab3h64A

Fixed, thanks.


Create folder structure in Storybook for Verified and Unverified Components

Currently the DSR has one bucket for all components. Some components have been verified but others are just sketches and have not yet gone through full review and QA checks. We would like to create a visual separation so that developers can understand which components are finalized - at a glance.
Current behavior

Expected behavior

Folder for "Verified" components
Folder for "Unverified components" - @meissadia - Is there a better word for this?

Steps to replicate behavior (include URLs)
1.Go to https://cfpb.github.io/design-system-react/?path=/docs/example-introduction--overview
2. View left navigation menu

@natalia-fitzgerald Demo of splitting components between those that have been Approved and others still in Draft state.
I was struggling to get the original categories (Verified / Unverified) to display in the proper order in the sidebar (ideally: Verified first) due to Storybook applying an alphabetical sort there, hence the change to Approved/Draft, but I can continue exploring how to force the desired display order for whatever group names we settle on.
Other grouping ideas:

Complete / In Progress
Ready / Pending
Confirmed / Unconfirmed
Done / Draft


Added UBC FOSS to miscellaneous

[github.com/ubcfoss/awesome-ubc-foss]
Awesome free and open source projects made by students and faculty at UBC. A great showcase of the opensource projects coming out of UBC.

[x] I have read and understood the contribution guidelines and the instructions for creating a list.
[x] This pull request has a descriptive title. (For example: Add Node.js)
The list I added

[x] has been around for at least 20 days,
[x] is a non-generated Markdown file in a GitHub repo,
[x] is not a duplicate,
[x] only has awesome items with descriptions (Awesome lists are curations of the best, not of everything),
[x] contains the awesome badge on the right side of the list heading,
[x] has a Table of Contents section named Contents as the first section,
[x] has an appropriate license (Meaning something like CC0, NOT a code licence like MIT, BSD, Apache, etc),
[x] has contribution guidelines,
[x] has been checked for inconsistent formatting, spelling, and grammar (This includes starting each link description with an uppercase character and ending it with a period ., and consistent naming),
[x] has been added at the bottom of the appropriate category.

Added https://github.com/ubcfoss/awesome-ubc-fos, a curated list of opensource projects from UBC to the miscellaneous category.

has been around for at least 20 days,

As far as I can see, the first commit happened five days ago.


[Fixes #121, Fixes #120] Make data protection follow the options model

Hi @javiercn, I'm your friendly neighborhood .NET Foundation Pull Request Bot (You can call me DNFBOT). Thanks for your contribution!
You've already signed the contribution license agreement. Thanks!
The agreement was validated by .NET Foundation and real humans are currently evaluating your PR.
TTYL, DNFBOT;

Things to pay attention to:

Comments (There's been a lot of copy paste, so mistakes can happen).
Method names
Null checks for arguments
Overload with configuration action calls parameterless overload.
Parameterless overload does the work and brings in direct depenendencies
(Like routing on MVC, for most repositories it means making sure AddOptions is called).

Don't introduce IDataProtectionBuilder here either

/cc @Eilon

@HaoK what's the concern here? This seems to follow the interface-builder pattern we have elsewhere, no? Is the concern with this specific change, or with changing it at all?

The interface/builder pattern was only in MVC, and not anywhere else (not here/EF/or identity).  The interface pattern seems more suited for MVC which has tons of assemblies layering on methods, and just an extra interface everywhere else...
@divega and I pushed back on identity for that reason, and I was just echoing that comment here when I saw a builder interface added.

It would be good to look at some samples of this being called before going further.

@davidfowl
services
  .AddDataProtection(options =>{...})
  .PersistXXX()
  .UseFileXXX()

@blowdart

Data Protection isn't just for MVC. If the builder is an MVC only thing then it needs to go.
How does it cope with options that are mutually exclusive? Or if you try to set the same thing twice?

Builders aren't an MVC thing. I'm setting up a meeting for Thursday to discuss this pattern in general.

@Eilon @rynowak I believe I've incorporated all the changes we discussed on the meeting

@Eilon ping? 😀

Sorry for the delay. Looks like it's 99% :shipit: , just a few things.

:shipit:


HARVESTER: add resource limit on create vm & refactor harvester dialog component

@DaiYuzeng   can u PTAL, thanks


Fix bug where service fields are not being updated

Issues
RELIES ON https://github.com/OpsLevel/opslevel-go/pull/316
https://gitlab.com/jklabsinc/OpsLevel/-/issues/9963
TL;DR, if you unset a field in terraform on a service it will not remove it even thought it says it will.
Changelog

[x] Use GetOk() to check if an optional field was set before managing it, as done in https://github.com/OpsLevel/terraform-provider-opslevel/pull/162/files. We should refactor all of our update functions to do this.
[ ] Changes
[ ] Make a changie entry

Tophatting
Create a new service.
  # opslevel_service.test_svc will be created
  + resource "opslevel_service" "test_svc" {
      + id              = (known after apply)
      + language        = "ruby"
      + last_updated    = (known after apply)
      + lifecycle_alias = "beta"
      + name            = "Testing a new service"
      + tier_alias      = "tier_4"
    }

On the website, set framework = Rails and owner = platform. Run terraform again, it should not try to manage these fields. ✅
Set the owner (set in web only), framework (set in web only), tier_alias (set in TF on create) to something else in TF.

closing this, we need further investigation on handling null values in opslevel-go.


Flow interface for React-Intl package

I wrote an interface for the React-Intl package. Let me know what you think.

Hey @grahamvo, when I saw this come in, I remembered we have one we are using in production that fleshes out all the options. Hope you don't mind superseding this with #58.

No, of course not. That's fine.


Make boto dependency optional

hi. thank you for all your hard work on this project.
i haven't used it much, but i see that boto is a hard dependency. might it be better to make it an optional one, in the event that one isn't using s3?

Please preserve this line to notify @roll (lead of this repository)

Hi @dodumosu, I think you're right and we need to consider it

Hi @dodumosu,
We can't remove it from tabulator for backward-compatibility reasons but in our new Frictionless Framework it's an optional dependency. Please try this new project.
Here is more information - https://github.com/frictionlessdata/tabulator-py#tabulator-py


As a team member I want to have a Code of Conduct to follow best legal practices

Acceptance Criteria:

Make document
Review Document
Test Document
Pull Request


⚠ Bofrost.at has degraded performance

In eaae2a9, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1809 ms

Resolved: Bofrost.at performance has improved in 592a333.


** ERROR ** gre ** error(existence_error(procedure,help_info/1),context(opts/2,_G1352))

I'm studying semantic web and trying to use eye.
but this error evoke.
elberta0810@instance-1:~/eye$ ./eye.sh
eye
EYE rel. v17.0127.1613 josd
SWI-Prolog 6.6.4 (amd64): Apr  4 2014, 10:51:43
** WARNING ** EYE depends on cturtle which can be installed from https://github.com/melgi/cturtle/releases/ **
starting 16 [msec cputime] 20 [msec walltime]
** ERROR ** gre ** error(existence_error(procedure,help_info/1),context(opts/2,_G1269))

Is there any hint?

The error is fixed in the latest version of EYE.
It was an issue when using SWI-Prolog 6.
Thanks!

The error is fixed in EYE rel. v17.0201.0840 and is tested with SWI-Prolog 6.6.4 kernel.


Add custom Markup Extension support

Need syntax for including custom markup extensions

It can be solved by using typeless properties:
Node {
  "xmlns:ext": "clr-namespace: Custom.Extension.Namespace"
  Text: "{ext:SomeCustomExtension ...}"
}


Consider using spark-submit for launch speed, batch layer

A simple, custom script is used to launch the Spark-based batch layer and speed layer. This has some pros and cons.
Pros:

Allows all config to be in the .conf file and the job to be launched programmatically
More control over script; can be integrated with serving layer script
Bottles up some complexity of invoking Spark like setting external jars

Cons:

Requires maintaining fragile classpath logic for particular environments

I wanted to record an open question to consider how much the pros outweigh cons over time.

I think that ConfigUtils should add a method load a file config like this
ConfigFactory.parseFile(new File("conf/application.conf")).resolve()

and
com.cloudera.oryx.batch.Main should have two way to call Config object:

If arguments are specified, take the first argument as configuration file directory
If arguments are missing, use -Dconfig.file (ConfigUtils.getDefaults)

then submiting spark job would look like this
 spark-submit --jars oryx-batch-2.0.0-SNAPSHOT.jar --class com.cloudera.oryx.batch.Main oryx-batch-2.0.0-SNAPSHOT.jar <directory to config file>

If the idea is to make the config file optional, then it can simply be an optional flag. The way Typesafe Config works, just not specifying config.file works as you imagine. However, in this application, user configuration is definitely required. Defaults would never result in a working service. If the change is just to make the config file an argument rather than flag, hm, I'd prefer to keep the --conf flag here.

It occurs to me that it's possible to write a wrapper script that invokes spark-submit but reads arguments like executor memory from the single, standard config file. That removes one "pro" for the current approach.


[SPARKR-169] Suppress warnings from normalizePath

LGTM & verified for non-existent local files. Thanks!


[Error  : Unity Log] IndexOutOfRangeException: Index was outside the bounds of the array. Stack trace: HellWeather.Patches.CurrentWeatherVariablePatches.SetupCurrentWeatherVariables (RoundManager __instance) (at <637b5c54c07649b4a53cbea5dbab9c0f>:IL_001D) (wrapper dynamic-method) RoundManager.DMD<RoundManager::SetToCurrentLevelWeather>(RoundManager) RoundManager.FinishGeneratingLevel () (at <af9b1eec498a45aebd42601d6ab85015>:IL_0027) (wrapper dynamic-method) RoundManager.DMD<RoundManager::GenerateNewLevelClientRpc>(RoundManager,int,int) RoundManager+<LoadNewLevelWait>d__115.MoveNext () (at <af9b1eec498a45aebd42601d6ab85015>:IL_0076) UnityEngine.SetupCoroutine.InvokeMoveNext (System.Collections.IEnumerator enumerator, System.IntPtr returnValueAddress) (at <e27997765c1848b09d8073e5d642717a>:IL_0026)

Closing as fixed in 0b09ec8c6bf67482478a35c477ee7e448ae646c0


Speedup logging

Please do not create a pull request without creating an issue first.
Changes need to be discussed before proceeding, pull requests submitted without linked issues may be rejected.
Please provide enough information so that others can review your pull request. You can skip this if you're fixing a typo – it happens.

[ ] I have added tests to tests to cover my changes.
[ ] I have updated docs/, if necessary.
[ ] I have updated the README.md, if necessary.

What existing issue does this pull request close?
Put closes #issue-number in this pull request's description to auto-close the issue that this fixes.
How are these changes tested?
This pull request includes automated tests for the code it touches and those tests are described below. If no tests are included, reasons why must be provided below.
These changes are tested with [...]
Demonstration
Demonstrate your contribution.
For example, what are the exact commands you ran and their output, related screenshots, screen-recordings, test runs, anything that can showcase.
Provide additional context.
Provide as much relevant context as you like.

Codecov Report

Merging #512 (9170af4) into main (61b64f2) will decrease coverage by 0.74%.
The diff coverage is 97.82%.

@@            Coverage Diff             @@
##             main     #512      +/-   ##
==========================================
- Coverage   91.45%   90.72%   -0.74%
==========================================
  Files         126      127       +1
  Lines        9809     9801       -8
==========================================
- Hits         8971     8892      -79
- Misses        838      909      +71

Impacted Files
Coverage Δ

...uality/loggers/model_logger/text_classification.py
88.60% <ø> (+0.65%)
:arrow_up:

...taquality/loggers/model_logger/text_multi_label.py
98.55% <ø> (+1.29%)
:arrow_up:

...est_utils/spacy_integration_constants_inference.py
100.00% <ø> (ø)

tests/conftest.py
98.18% <83.33%> (-0.87%)
:arrow_down:

tests/integrations/spacy/test_spacy_ner.py
91.45% <92.30%> (+0.42%)
:arrow_up:

...uality/loggers/logger_config/base_logger_config.py
98.27% <94.73%> (-1.73%)
:arrow_down:

dataquality/core/_config.py
95.31% <100.00%> (-0.11%)
:arrow_down:

dataquality/core/finish.py
100.00% <100.00%> (ø)

dataquality/integrations/spacy.py
95.05% <100.00%> (ø)

dataquality/loggers/base_logger.py
90.95% <100.00%> (+0.13%)
:arrow_up:

... and 27 more

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Binary package fails to install on Ubuntu/Debian

Following directions from:
https://www.modsecurity.org/download.html
sudo apt-get install libapache2-mod-security
E: Unable to locate package libapache2-mod-security

Hi,
What is your os version?
libalpache2-mod-security packages available for Debian 7,8,9 https://packages.debian.org/stretch/libapache2-modsecurity
For Ubuntu 14.04, 16,04, 17.10 https://packages.ubuntu.com/trusty/libapache2-modsecurity

@1Sara1 please check the links provided by @LeeShan87. You might also be missing some configuration on your sources.list files .

looks like in ubuntu it's sudo apt-get install libapache2-mod-security2

I was having the same issue and sudo apt-get install libapache2-mod-security2 worked for me.
Thanks!

sudo apt-get install libapache2-mod-security2 install v2.9.2, insteaof 2.9.3. How can I install v2.9.3 on ubuntu images?

How can I install v2.9.3 on ubuntu images?

What is your Ubuntu version?

How can I install v2.9.3 on ubuntu images?

What is your Ubuntu version?

Bionic (18.04)

What is your Ubuntu version?

Bionic (18.04)

As you can see here, in that OS version the packaged version of mod-security is 2.9.2.
You can make your own package - or compile the module from the source.

here

Thanks. I noticed that "eoan" version already have the v2.9.3 installed.

Yes, as you can see, the 2.9.3 was released in December of 2018, so it can't be part of 18.04 nor 18.10.

The Best place to discuss the subject related to packing is on the distro issue management; there you can reach the package developers and the distro contributors.


901 simplify transition assertions

I have updated waitForStateTransition function to use a more direct approach, namely using map and first on the flow and moving this operation to the TrackableStateReceiver. This allowed replacing Expectations with blocking calls and removing now unused coroutine scope from TestResources.
Resolves #901

@jaley Yes, first will cancel once it gets any value

@jaley Yes, first will cancel once it gets any value

@davyskiba - will first just take the first Boolean? returned by receive in the map transform? If so, that's a change in behaviour. We deliberately skip any of the ignored transitions, as those are considered harmless but not the state we're waiting to see. Should first actually be some kind of takeWhile call checking for null?

@jaley nulls are already filtered by mapNotNull and first returns Boolean, so the behavior should stay the same. MapNotNull could be replaced with map + filterNotNull to make it more visible. Do you think it is worth doing?


Highlight a PR's base branch if it's not the default

LINKED ISSUES:
Closes #3461

TEST URLS:
flarum/core/pull/2263

SCREENSHOT:

We should avoid using !important where possible so other extension/userstyles can override them easily


Error Handling for Tweets

The webapp provide error in console if loklak server is down
Add error handling and show the text "No Tweets Available" instead of blank area in view.

@aayn I will try to work on this


Write user routes

[x] GET: Get all route
[x] GET: Get one user route, include drawings
[x] POST: Signup route, creates new user
[x] POST: Login route
[x] DELETE: Logout route
[x] DELETE: Delete account route
[x] PUT: Adding profile picture

completed, will test and run over the weekend


[Feature] Mongodb datasource module

What is the purpose of the change
Access the mongodb data source, and realize the interface for obtaining databases, collections and fields from mongodb
Related issues/PRs
Related issues: #2718
Related pr:
Brief change log

Add linkis-metadata-query-service-mongodb module.

Checklist

[x] I have read the Contributing Guidelines on pull requests.
[x] I have explained the need for this PR and the problem it solves
[x] I have explained the changes or the new features added to this PR
[ ] I have added tests corresponding to this change
[ ] I have updated the documentation to reflect this change
[ ] I have verified that this change is backward compatible (If not, please discuss on the Linkis mailing list first)
[ ] If this is a code change: I have written unit tests to fully verify the new behavior.

need mvn spotless:apply

mongo-java-driver-3.12.7.jar is not in file known-dependencies.txt
need  to be added  to  known-dependencies.txt
The corresponding license file also needs to be added
can refer to:
https://github.com/apache/incubator-linkis/pull/3458/commits/a7cfa3343be88797b925fab50bfcefcb4b69207f#diff-aa42a02989789460780e3c807f268202cdfca6ad5b7763e293d362d7416ec6ad

Can mongo use sql?(mongo 能用sql吗？)


Tensor Size Mismatch and Missing Keys

I am noticing some tensor size mismatch and missing keys in the source_dict as the code goes on loading the ViT (pvt_v2_b1). Can you please confirm if this is Okay? I am skeptical, as I had a bit of different environment:
Ubuntu 22.04
CUDA 11.7
PyTorch 1.30
And concerned if the mismatch and missing keys I am seeing is due to versioning. I was able to run the evaluation code for nyudepthv2 for all the sparsity patterns as specified in eval_nyu.sh
Thanks!

Hey @TouqeerAhmad, I think this problem is the same as #2


Resolved issue#10 by adding Contribution.md file

I have added contribution.md file which has all necessary information needed for doing any contribution in this repo.
kindly review my PR.

Thank you very much for your contribution!

@Parth4git  Hi，Thank you for your contribution to MemFree.
In return, if you are interested, I can give you a 20% discount code for MemFree. You can send me a private message via discord, Twitter or email.
Looking forward to your more contributions to MemFree. Let us work together to make MemFree better and better.


Amplify v10x does not work in headless mode

Before opening, please confirm:

[X] I have installed the latest version of the Amplify CLI (see above), and confirmed that the issue still persists.
[X] I have searched for duplicate or closed issues.
[X] I have read the guide for submitting bug reports.
[X] I have done my best to include a minimal, self-contained set of instructions for consistently reproducing the issue.
[X] I have removed any sensitive information from my code snippets and submission.

How did you install the Amplify CLI?
npm install -g<EMAIL_ADDRESS>If applicable, what version of Node.js are you using?
16x
Amplify CLI Version
10.3.2
What operating system are you using?
Ubuntu
Did you make any manual changes to the cloud resources managed by Amplify? Please describe the changes made.
No manual changes made
Amplify Categories
Not applicable
Amplify Commands
configure, init, pull, push, status
Describe the bug
Installing @aws-amplify/cli in our lts-alpine node pipeline using the headless mode CI/CD pipeline does not work. There are no outputs or errors after supposedly succesfully installing and attempting to run commands. Example: amplify -v has no output - not even command not found
We've recently had to upgrade the amplify/cli version used due to the deprecated python runtime used by the OpenSearchStreamingLambda. The last stable amplify/cli version we used in the pipeline was v7.6.26. I can confirm that all major versions following v7 does not perform as expected in our pipeline.
Expected behavior
We expect the CLI to be installed succesfully in the pipeline in order to execute amplify commands in headless mode
Reproduction steps

Create a docker image from the node:lts-alpine image (or any node image for that matter)
add RUN npm install -g @aws-amplify/cli to the DockerFile , or alternatively run the image and try installing manually using the CLI
Running amplify commands should yield no output

GraphQL schema(s)

# Put schemas below this line

Project Identifier
No response
Log output

# Put your logs below this line

Additional information
I believe a simlar issue was experienced on Apple M1 machines

Hi @vloermatt this sometimes happens if the machine you are running on has a security policy that blocks the execution of binaries downloaded from the internet. The Amplify binary is placed at ~/.amplify/bin/amplify. Can you check that your system is allowing execution of the binary?

Hi @edwardfoyle thanks for the response. I can confirm the binary is not executable. Getting output cannot execute binary file

@vloermatt in that case you will need to allow execution of the binary in your system settings.
I'm going to close this out but let us know if you run into additional issues after enabling execution of the binary.

Hi @edwardfoyle we tried making the binary executable by running chmod +x amplify - Still yielding the same unexpected results with no output from amplify-cli commands


remove type check for user_id to support arbitary types of primary keys

Relates: #183

I'm also in need of this.  I tried running the fork and it looks like tests are failing.  Specifically, at get_object_or_404 in the views.
I'll try to patch tomorrow to get a working PR with passing tests.

Hi there,
Thanks for your contribution. This has been one of many requests regarding this issue. I will close this PR favoring #216, as it handles multiple issues while avoiding potential error with the patch you provided. You are more than welcome to review #216 to get things moving faster.
Best,
Joe

Hi there,
Thanks for your contribution. This has been one of many requests regarding this issue. I will close this PR favoring #216, as it handles multiple issues while avoiding potential error with the patch you provided. You are more than welcome to review #216 to get things moving faster.
Best,
Joe


Compare exception handling for detected language before and after codegen

So far, what I see is that before codegen if the service didn't return name or iso6391Name the SDK was assigning null to the value.
With codegen, if these values are not present, the SDK will throw ArgumentNullException

As for the exceptions, we can customize the constructors for DetectedLanguage_internal and DetectLanguageInput to remove the parameter validations.
At the same time, I see this happening across other endpoints so I'm looking into a way to disable it for all input parameters in codegen at the same time.


100% CPU usage when GPU acceleration is disabled in the browser

I get 100% CPU usage when the GPU acceleration setting is disabled in chrome.
I was wondering why sometimes my PCs fans started going crazy until I noticed it was this app in my browser.
Maybe you can detect this browser setting and give out an error or limit the fps, or add something to the README, in case you can't change it.

Oh indeed it relies on vsync to limit the FPS so if GPU is disabled there is no limit anymore. Thanks for the report!


[Docs] Provide example of android side implementation of HeadlessJS

Thanks for submitting a PR! Please read these instructions carefully:

[x] Explain the motivation for making this change.
[ ] Provide a test plan demonstrating that the code is solid.
[ ] Match the code formatting of the rest of the codebase.
[ ] Target the master branch, NOT a "stable" branch.

Motivation (required)
The existing documentation on this topic doesn't provide enough of detail on where to start a headlessJS task.
Test Plan (required)
Just docs change
This PR extends HeadlessJS documentation to show an example on how to start HeadlessJsTaskService. Sample code in example reacts to connectivity change using custom broadcast receiver logic that bundles additional information and starts the aforementioned service.

CLA signed

Can you update your PR description with more details? E.g. what example are you adding, what does it do? It would also help to add this to the doc itself.

Hi there! This issue is being closed because it has been inactive for a while.
But don't worry, it will live on with Canny! Check out its new home: https://react-native.canny.io/feature-requests/p/docs-provide-example-of-android-side-implementation-of-headlessjs


No flow in sight since v11 migration

What platform were you using when you found the bug?

React Flow / Svelte Flow version: 11.11.3
Browser and version: chrome
OS and version:

react : "^17.0.2"
react-scripts : "4.0.3",
webpack "4.44.2"
"@babel/plugin-proposal-nullish-coalescing-operator": "^7.18.6",
"@babel/plugin-proposal-optional-chaining": "^7.21.0",
"@babel/preset-env": "^7.24.7",
"@babel/preset-react": "^7.24.7",
"babel-loader": "8.1.0",
Live code example
No response
Describe the Bug
A bug caused by upgrading from v10 to v11.
ReactFlow flow is not showing after changing 10 version of react-flow-render to 11 version
Steps to reproduce the bug or issue
https://codesandbox.io/p/sandbox/reactflow-9h9mfz?file=%2Fsrc%2Fcomponents%2FActionNode.tsx%3A1%2C44
Screenshots or Videos
Additional context
No response

webpackConfig.module.rules.push({
          test: /node_modules[\/\\]@?reactflow[\/\\].*.js$/,
          use: {
            loader: 'babel-loader',
            options: {
              presets: ['@babel/preset-env', '@babel/preset-react'],
              plugins: [
                '@babel/plugin-proposal-optional-chaining',
                '@babel/plugin-proposal-nullish-coalescing-operator',
              ],
            },
          },
        });

I added the corresponding code to correct the error

Are you importing the styles https://reactflow.dev/learn/troubleshooting/migrate-to-v11#2-importing-css-is-mandatory?

No, I don't have a separate css like code sandbox

No, I don't have a separate css like code sandbox

You need to import the required styles. It's not an optional step.

Is it correct that I wrote the webpack setting without any problems? I added it according to the contents of the issue
Module parse failed: Unexpected token (44:38)
You may need an appropriate loader to handle this file type, currently no loaders are configured to process this file. See https://webpack.js.org/concepts#loaders
|     const getPointerPosition = useGetPointerPosition();
|     const defaultPosition = variant === ResizeControlVariant.Line ? 'right' : 'bottom-right';
>     const controlPosition = position ?? defaultPosition;
|     useEffect(() => {
|         if (!resizeControlRef.current || !id) {

A token error is occurring just like before
reactflow : 11.11.3
webpack : 4.2.2
"react-scripts": "4.0.3",
"@babel/plugin-proposal-nullish-coalescing-operator": "^7.18.6",
"@babel/plugin-proposal-optional-chaining": "^7.21.0",
"@babel/preset-env": "^7.24.7",
"@babel/preset-react": "^7.24.7",
"babel-loader": "8.1.0",
During the compilation process, the error occurred again and I can't see the screen. I'll try to correct the error and apply the style
I tried to upload the react-scripts version, but due to the time relationship, I am going to apply v11 first with the web pack 4 version

The webpack config should include something like this
{
  test: /node_modules[\/\\]@?reactflow[\/\\].*.js$/,
  use: {
    loader: 'babel-loader',
    options: {
      presets: ['@babel/preset-env', "@babel/preset-react"],
      plugins: [
        "@babel/plugin-proposal-optional-chaining",
        "@babel/plugin-proposal-nullish-coalescing-operator",
      ]
    }
  }
}

yours has the file-ending mjs for some reason?

I used the mjs extension because I thought the reactflow was an extension of the JavaScript file using the ES6 module.
Thanks to this, it was executed normally.
As you said, I added import 'reactflow/dist/base.css'; but the screen blinks a few times and then disappears. Previously, I made and used a reactflow style for 'import'./styles.css' like a code sandbox. It is not implemented in the code sandbox, but the screen is not displayed
https://codesandbox.io/p/sandbox/reactflow-9h9mfz?file=%2Fsrc%2Fcomponents%2FCallFlow.tsx%3A19%2C1-19%2C23

@choiyounghun0712 please don't ask a question twice . I will close the discussion you opened https://github.com/xyflow/xyflow/discussions/4365
The codesandbox is working for me. There are just some styles missing for setting the height:
body,
html,
#root,
.App {
  height: 100%;
}

I'll look for the cause. Thank you


Use Jinja for expressions and templates

Codecov Report

Merging #14 into master will increase coverage by 0.15%.
The diff coverage is 95.34%.

@@            Coverage Diff             @@
##           master      #14      +/-   ##
==========================================
+ Coverage   85.21%   85.37%   +0.15%
==========================================
  Files          31       31
  Lines        1028     1046      +18
==========================================
+ Hits          876      893      +17
- Misses        152      153       +1

Impacted Files
Coverage Δ

populous/vars.py
95.71% <95.34%> (-0.44%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7ed6249...d4e8020. Read the comment docs.


Can't resolve '../components/Layout' in './src/pages'

I'm trying to deploy a site on netlify and get error like this:
Can't resolve '../components/Layout' in './src/pages'

I found there is a Layout.js and layout.js in src/components, but when cloned on my Mac OS, one will be overwritten by another, resulting in only one file layout.js. When I push the project, there will be only one layout.js, and it fails to deploy.
I think it does not make sense to have two files with only difference in letter cases of filenames. Shall we just use kekab-case to avoid such problems? e.g. blog-post.js instead of BlogPost.js as you have already done in src/templates.

Seems like there was an issue when merging #130, that modified layout.js, when the previous PR had just renamed layout.js to Layout.js. I think this is fixed in latest version. Could you confirm?

It's fixed now, thanks.


Display error traces in setUp function

Component
Forge
Describe the feature you would like
During testing, if an error is thrown in setUp() then no error traces are shown.
It would be nice to show debug traces with the verbosity set as -vvv set just like regular tests.

At the moment it just shows this single line (no matter what verbosity is set to)^
Additional context
No response

Use -vvvv to show setup traces for failing tests. You can read about all verbosity options here: https://book.getfoundry.sh/forge/tests#logs-and-traces


Fail loudly when conda dependencies fail to install due to OOM

When the user specifies low memory (~1000mb), conda fails to install dependencies and gets stuck without barfing on the user.
Gitter thread

I also experienced this as well

Related: https://github.com/Netflix/metaflow/pull/1696

this should now be addressed


The play / pause button does not work correctly in YouTube Music

Ubuntu 19.04, GNOME
Nuvola App Runtime -> 4.16.4 (4-g819cdb2)
Web app -> YouTube Music
YouTube Music Script -> 1.3.0 (0-gbbf30d7)
Bug:
The play / pause button does not work correctly in the notification panel, when you click on the action but does not have an "animation" that changes the function, there is always the play icon.
Debugging log:
Runner: [DEBUG Δ017765us GVFS-RemoteVolumeMonitor] Error: GDBus.Error:org.freedesktop.DBus.Error.ServiceUnknown: org.freedesktop.DBus.Error.ServiceUnknown
Runner: [DEBUG Δ001753us  GVFS] cannot open directory /usr/share/gvfs/remote-volume-monitors: Error opening directory “/usr/share/gvfs/remote-volume-monitors”: No such file or directory
Runner: [DEBUG Δ003249us  GVFS] org.gtk.vfs.MountTracker.listMountableInfo call failed: GDBus.Error:org.freedesktop.DBus.Error.ServiceUnknown: org.freedesktop.DBus.Error.ServiceUnknown (g-dbus-error-quark, 2)
Runner: [DEBUG Δ065370us Nuvola] AboutDialog.vala:54: Nuvola Apps 4.16.4 (4-g819cdb2)
Runner: [DEBUG Δ000035us Nuvola] AboutDialog.vala:56: YouTube Music script 1.3.0 (0-gbbf30d7)
Runner: [DEBUG Δ000021us Nuvola] AboutDialog.vala:60: Diorite 4.16.3
Runner: [DEBUG Δ000031us Nuvola] AboutDialog.vala:62: Chromium 73.0.3683.75
Screenshots
Player paused

Player running

Hello @CristhianEcheverry. Thanks for reporting the issue. I'll look at it at the weekend.

Hello @CristhianEcheverry. I cannot reproduce the issue. Could you attach a debugging log? Don't forget to click the play/pause button in the notification panel a few times so that it appears in the log.
See https://github.com/tiliado/nuvolaruntime/wiki/Bug-Reporting-Guidelines#debugging-output
for instructions on how to get a debugging log. Then save it as a text file (*.txt) and attach it to the bug report.

Use the "Attach files by dragging & dropping or selecting them." feature available under the textbox.
Never trim the logs or you will be asked to provide new complete logs.
Don't use "pastebin" services as the logs there may disappear anytime.
Don't attach screenshots of the terminal output. Use text files.

debug YoutubeMusic.txt
;)

Fix committed to the source code repository and will be released with the next rebuild of Flatpak packages.

Published as Nuvola 4.16.10 & YouTube Music script 1.3.2. Could anyone verify that the issue is fixed?

Solved, thank you :)


Update go-interface and vm

update code to the vm refactor. See https://github.com/taubyte/vm/issues/17

vm has been merged to tau. Now we need to find best route to implement interpreters.


Error Loading Extension

when trying to load this extension, the chrome gives out the beneath error message:
Failed to load extension from: ~\Desktop\autopatchwork-mod-master
Default locale was specified, but _locales subtree is missing.

Should work correctly now.


Ignore all warnings

It would be nice if there was an option to ignore all warnings. At present warnings like this:
"The date input type is not supported in all browsers. Please be sure to test, and consider using a polyfill."
Cause the task to think there was an error and thus return fail (assuming failHard is on). I know this can be added to the relaxerror option, but it feels like warnings from the validation service should not be considered errors. An option like ignoreWarnings: true would be nice or even better, if warning are shown but do not cause it to fail - even when failHard is true.
Thanks!

Yes please, it would be nice!


fix: Logs rerendering and getLogs fn

Pull Request Template
Description
Fix logs rerendering
Fixes #478
Type of change

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Enhancement (non-breaking change which improves an existing feature or documentation)
[ ] Breaking change (fix or feature that would cause existing functionality not to work as expected)

How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce.
Checklist:

[x] I have performed a self-review of my code
[ ] I have commented on my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes
[x] Pull Request contains one commit. I squash my commits.

Screenshots (if appropriate):
Additional context
Add any other context or screenshots about the feature request here.

/recheck


Error in stalling requirements

Could not find a version that satisfies the requirement urllib (from -r requirements.txt (line 3)) (from versions: )
No matching distribution found for urllib (from -r requirements.txt (line 3))

urllib is a default Python Library. I must have forgotten to remove that from the requirements.txt. Remove that line from the requirements list, and rerun the pip install command.

Should be fixed in https://github.com/rushilsrivastava/image-scrapers/commit/61a6e4cf99cd5a222cbd74ac1f8e515b6abc123e

Other modules also gave the same problem, only selenium, requests, argparse, pathlib, bs4 can be installed.

Yeah, I just noticed I did not update the full list. lxml is not a default module on all distributions, so I have that included as well.

Fixed: https://github.com/rushilsrivastava/image-scrapers/commit/25fd935696411b54372f57d80901914c99940ebd

I got the following. The chrome launched and all the pics loaded but not downloaded. Do you know where my problem is?
[%] Successfully launched Chrome Browser
[%] Successfully opened link.
[%] Scrolling down.
[%] Successfully clicked 'Show More Button'.
[%] Reached end of Page.
Traceback (most recent call last):
File "google_scraper.py", line 120, in
source = search(url)
File "google_scraper.py", line 55, in search
f = open('dataset/logs/google/source.html', 'w+')
FileNotFoundError: [Errno 2] No such file or directory: 'dataset/logs/google/source.html'

I guess the problem is when I run
python3.5 google-scraper.py "https://www.google.com/search?q=cats&source=lnms&tbm=isch&sa=X&ved=0ahUKEwiwoLXK1qLVAhWqwFQKHYMwBs8Q_AUICigB" cats
the cats argument gave an error of unrecognized arguments. So the folder cannot be created.

Hey, the new code I published doesn't require the second argument (keyword). You just need to give the link, and it will get the search query from the link. Try that, and if you still have an error, paste the stack trace on a new issue.


Fix alignment of header action butons

They got broken during the upgrade to v3 of moj-frontend
#patch

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 71.80%. Comparing base (8ea62a2) to head (db35e77).

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #587   +/-   ##
=======================================
  Coverage   71.80%   71.80%
=======================================
  Files         117      117
  Lines        5161     5161
=======================================
  Hits         3706     3706
  Misses       1129     1129
  Partials      326      326

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

🚨 Try these New Features:

Flaky Tests Detection - Detect and resolve failed and flaky tests
JS Bundle Analysis - Avoid shipping oversized bundles


Couldn't save to the backend database - does Excalidraw+ Fix this?

Hi - we have started using Excalidraw collaboratively and have noticed that nearly every diagram we make hits some limit leading to "Couldn't save to the backend database".
We are happy to pay to fix this issue with Excalidraw+, but I can't see anything online about upgrading leading to more storage on the backend database. Can someone confirm if the paid version resolves this?

Hi. Yes, the database we're using on excalidraw.com is a 1MB limit. Also the collaboration here isn't meant for long-term/large diagrams.
On Excalidraw+, there's no limit such as this.


fix Firefox compatibility issues in popup.js

a couple more calls to chrome.extension.sendMessage() I missed before.  Also changed chrome.tabs.getSelected(null, callback) to chrome.tabs.query({active: true}, callback) per the deprecation warning in the chrome docs since it wasn't working in FFx.  Tested in Chrome and Firefox.

For #56


Versioning - release @v1

Recommendation from GitHub: https://github.com/actions/toolkit/blob/master/docs/action-versioning.md

Done, created a v1.0.0 and a v1 tag.


[zh-cn] sync controllers/statefulset.md

content/zh-cn/docs/concepts/workloads/controllers/statefulset.md

/lgtm
/approve


Register methods with Stream.register_api decorator

This moves methods off of the main stream class and offers an opportunity for
extension without subclassing.
People want to build their own operations for streams. The obvious way to do
this, subclassing, is hard due to how we have laid things out.  As an
alternative we consider function dispatch.  This also helps to reduce
boiler-plate, although it also adds some complexity and indirection.
Currently we define operations like map as a separate class and then add a
special method:
class Stream(object):
    ...
    def map(...):
        return map(...

class map(Stream):
    ...

This is bad for two reasons:

The map method is somewhat redundant
We have hard coded all valid operations.  It's hard to add new ones.

As an alternative we dynamically add methods to stream with a decorator
class Stream(object):
    @classmethod
    def register_api(cls, func):
        ...

@Stream.register_api
class map(Stream):
    ...

cc @CJ-Wright, @ordirules and @limx0 for feedback.
cc @eriknw for help with wrapping effectively if he has the time.  Currently we lose function names and docstrings (see failing test_docstrings test).

To be clear I'm not sure that we should merge this.  The cost of complexity of this change is currently non-trivial.  When something goes wrong it will be somewhat difficult for a user or developer to trace back to the source of the problem (no docstrings, partialed/wrapped functions, etc..)  I think that the challenge here is to see how cleanly we can make my_stream.foo map back to the appropriate foo class.

To be fair our tracebacks are really difficult to read anyway, since the traceback goes through all the emits and updates in the graph.

I really like it, but one thing bothers me, the following:
from streamz import Stream

class NewStream(Stream):
    pass

@NewStream.register_api
class foo(Stream):
    """ Apply a function to every element in the stream """
    def __init__(self, child, *args, **kwargs):
        self.kwargs = kwargs
        self.args = args

        Stream.__init__(self, child)

    def update(self, x, who=None):
        print("foo")

        return self.emit(x)

sf = NewStream()
sout = sf.foo()

s = Stream()
s2 = s.foo()

After registering foo to the NewStream, it's also now available for Stream. Is there a way around this?
We should be able to cleanly subclass. (Correct me if I did something wrong) But yes, this is definitely something that would be useful :-).

Yeah, that sounds like a valid concern.  Looks like this is the problem:
In [4]: NewStream._api is Stream._api
Out[4]: True

Yep I like this, it suits my requirements for streamz.

So you could resolve this by redefining _api
class NewStream(object):
    _api = {}

@limx0 are you actively using streamz?  If so, how?  If not, why not?

I am playing around with it in a development branch of a trading system and looking to merge it sometime soon.

It sounds good to me. I just have one personal preference that would disagree with this implementation. I see the streaming nodes as self contained nodes in a tree. The functions it may call in my opinion should be more a local state than a global. So my preference is that the methods the stream knows it can access or not should be created at instance creation time, not class creation time.
What I mean is this, I would prefer this to be possible (or something similar):
s = Stream()
s2 = NewStream(s)
# s3 is a NewStream but map is made inaccessible
s3 = NewStream(s, remove=[map])
# and then maybe some ease of inspection of the instance
print(s2.methods())
print(s3.methods())

or something of the sort. In the current scheme, I'd have to hard code a NewStream and NewStream2 (where latter acts on s2 and doesn't contain map) to get this done.
I'm definitely fine with this implementation though. But I'm trying to play devil's advocate as far as possible to see how much we like this.

In general methods are usually handled at the class level and not the instance level.  You can always attach any attribute you like to a Python object, but I don't think that this is something that streamz should support on its own.
I'm now just going forward with vanilla dynamic functions.   I'm also using the namespace of the classes.  What's here seems simple and effective to me.  I plan to merge on passed tests if there are no major concerns.

it looks good to me (if tests pass). thanks again, this will be very useful

Codecov Report

Merging #74 into master will increase coverage by 0.03%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master      #74      +/-   ##
==========================================
+ Coverage   96.11%   96.15%   +0.03%
==========================================
  Files          15       15
  Lines        1701     1717      +16
==========================================
+ Hits         1635     1651      +16
  Misses         66       66

Impacted Files
Coverage Δ

streamz/core.py
98.43% <100%> (-0.01%)
:arrow_down:

streamz/tests/test_core.py
99.16% <100%> (+0.03%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 50544dc...94fe966. Read the comment docs.

No strong thoughts.  I don't object to this.  I'm unlikely to do it myself.
On Thu, Oct 5, 2017 at 9:42 AM, Christopher J. Wright <
<EMAIL_ADDRESS>wrote:

@CJ-Wright commented on this pull request.
In streamz/core.py
https://github.com/mrocklin/streamz/pull/74#discussion_r142940249:

class map(Stream):

def init(self, func, child, args=(), **kwargs):

""" Apply a function to every element in the stream """
def init(self, child, func, *args, **kwargs):

We may want to release the library for a 0.2.0 backdated before this
merge? That way we have something before the break.
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/mrocklin/streamz/pull/74#discussion_r142940249, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AASszFno0wnZ03j1QCmjsmwybzc34oP5ks5spNytgaJpZM4PrHfP
.