Add TCP source for lightweight, extended data gathering

Certain Omnik inverters (supposedly with a specific serial number, see sources below) reply with its statistics as binary data when a "magic" packet is sent to them on port 8899 over TCP.  This data is more lightweight than an HTML page or JavaScript source with values embedded, and provides more statistics then either similar to what can be found on the LCD display.
The data format and meaning has been extracted from various Python/C sources (see links below), with some of my own "work" to simplify checksum calculation and "the reverse hexadecimal serial number" is nothing more than its little-endian byte representation.  Response data is parsed at once with a ctypes.BigEndianStructure instead of unpacking individual ranges of bytes through struct.unpack.  Only minimal data massaging is needed to convert the struct to useful information.
It provides the following extra fields:

Inverter temperature;
Voltage and current for the DC input strings (up to 3);
Voltage, current, frequency and power for all AC outputs (also up to 3);
Total number of runtime hours (not sure if this is just the Omnik being on, or the time it delivers >0W of power back to the network).

No "device" (network module) data is found in any of the unparsed bits.
I have also not been able to extract solar_rated_power from the data.  Comparing to http://www.mb200d.nl/wordpress/2015/11/omniksol-4k-tl-wifi-kit/#more-590 it seems the second byte in the "magic" is 0x81 on a 4k-TL instead of the 0x7d on our 3k-TL.  It is just speculation thus far, but this might be an integer identifier of the hardware type? (To be confirmed by the community, I guess).  Otherwise padding0 contains a lot of non-zero data too.
Perhaps anyone is interested in dumping the remaining data and seeing if they can uncover their meaning.  We could help this by printing the padding fields if they're not what we expect (mostly zero).
Sources:

https://github.com/jbouwh/omnikdatalogger/blob/dev/apps/omnikdatalogger/omnik/InverterMsg.py
http://www.mb200d.nl/wordpress/2015/11/omniksol-4k-tl-wifi-kit/#more-590
https://github.com/Woutrrr/Omnik-Data-Logger
https://github.com/t3kpunk/Omniksol-PV-Logger

Thank you for your contribution,
It's a pretty big change and is partly beyond my cap. Despite that, I think it would be nice to see what possibilities there are with the various inverters. Could you see if you can pass the linting tests?

It's a pretty big change

I can try to split this up (in separate commits and/or PRs) if that helps? Don't immediately see a clear boundary though.

and is partly beyond my cap.

Should go without saying that I'll be utilizing this python package (through https://github.com/robbinjanssen/home-assistant-omnik-inverter once I submit related changes matching this PR there), and I'll be sure to stick around this repository to help out with review and clarification regarding the TCP connection "backend". I'm subscribed to notifications but feel free to @ me if anything shows up!
That's also important regarding the unknown fields and potential changes in the "magic", as detailed in the PR description.

Despite that, I think it would be nice to see what possibilities there are with the various inverters.

Yeah, I hope https://github.com/robbinjanssen/home-assistant-omnik-inverter is open to add logging for all the new fields. Besides temperature most is just a gimmick (though being able to see string balancing could be relevant?), but it'd be interesting to see if one of the unknown fields (or "magic") change across various inverters.

Could you see if you can pass the linting tests?

Thanks, I'll of course make sure this adheres to all the checks! Bit Rusty (:smirk: I write Rust now daily) on the Python side, I hope the code is at least in an acceptable state as it's quite tricky to find the right - concise - ways to write things in Python again. I managed to replicate most failing tests locally, will update this PR soon.

Could you DM me on one of my socials? I would like to invite you to our slack server, where both me and Robbin are in for the whole omnik development (python package and integration). Also more convenient for the quick communication 😉

@klaasnicolaas I think you need just my email for that, which you can pull straight from the commit body :)


custom error format and ajax check

hi so i have 2 question about how to use this.

how to change the format for error message? since i see when there is more than 1 error message it will turn into unordered list... how to change it like just adding comas or so? since it just make my user interface look ugly...

i read that this js can do ajax validation, so how to use ajax to check if username that i typed is already exist in my mysql database?

You can kinda do it via css. http://jsbin.com/zibositumu/edit?html,css,output
Make a server endpoint that returns a 400 error if the username already exists. See https://github.com/1000hz/validator-remote-example for a reference.


How to disable scroll and zoom with DateTime graph

Hi there!
I'm starting to work with your library and I'm trying to make a time series graph. In my screenshot below you can see your sample (found here) and then my attempt.
I'm trying to keep my entire graph on the screen and not have to scroll to see the whole graph, you were able to achieve this in your sample.
Is there a way to do this using DateTime? In your sample you use a BezierChartScale.CUSTOM, is that how you achieve this?

Here is your sample:
                    Container(
                        height: MediaQuery.of(context).size.height / 2,
                        width: MediaQuery.of(context).size.width * 0.9,
                        child: BezierChart(
                          bezierChartScale: BezierChartScale.CUSTOM,
                          xAxisCustomValues: const [0, 5, 10, 15, 20, 25, 30],
                          footerValueBuilder: (double value) {
                            return "$value\ndays";
                          },
                          series: const [
                            BezierLine(
                              label: "m",
                              data: const [
                                DataPoint<double>(value: 01, xAxis: 0),
                                DataPoint<double>(value: 130, xAxis: 5),
                                DataPoint<double>(value: 50, xAxis: 10),
                                DataPoint<double>(value: 150, xAxis: 15),
                                DataPoint<double>(value: 75, xAxis: 20),
                                DataPoint<double>(value: 0, xAxis: 25),
                                DataPoint<double>(value: 5, xAxis: 30),
                              ],
                            ),
                          ],
                          config: BezierChartConfig(
                            footerHeight: 40,
                            verticalIndicatorStrokeWidth: 3.0,
                            verticalIndicatorColor: Colors.black26,
                            showVerticalIndicator: true,
                            verticalIndicatorFixedPosition: false,
                            backgroundGradient: LinearGradient(
                              colors: [
                                Colors.red[300],
                                Colors.red[400],
                                Colors.red[400],
                                Colors.red[500],
                                Colors.red,
                              ],
                              begin: Alignment.topCenter,
                              end: Alignment.bottomCenter,
                            ),
                            snap: false,
                          ),
                        ),
                      ),

And here is mine. I'm trying to graph an entire month and my y values can range from -1.0 to 1.0.
                      Container(
                        color: Colors.red,
                        height: MediaQuery.of(context).size.height / 2,
                        width: MediaQuery.of(context).size.width * 0.9,
                        child: BezierChart(
                          fromDate: _getStartDate(state),
                          bezierChartScale: BezierChartScale.WEEKLY,
                          toDate: _getLastDate(state),
                          series: [
                            BezierLine(
                              label: "Duty",
                              onMissingValue: (dateTime) {
                                return 0.0;
                              },
                              data: [
                                DataPoint<DateTime>(
                                    value: 0.5, xAxis: DateTime.now()),
                                DataPoint<DateTime>(
                                    value: -0.1,
                                    xAxis: DateTime.now()
                                        .subtract(Duration(days: 1))),
                                DataPoint<DateTime>(
                                    value: -0.4,
                                    xAxis: DateTime.now()
                                        .subtract(Duration(days: 2))),
                              ],
                            ),
                          ],
                          config: BezierChartConfig(
                            footerHeight: 40,
                            verticalIndicatorStrokeWidth: 3.0,
                            verticalIndicatorColor: Colors.black26,
                            showVerticalIndicator: true,
                            verticalIndicatorFixedPosition: false,
                            backgroundGradient: LinearGradient(
                              colors: [
                                Colors.red[300],
                                Colors.red[400],
                                Colors.red[400],
                                Colors.red[500],
                                Colors.red,
                              ],
                              begin: Alignment.topCenter,
                              end: Alignment.bottomCenter,
                            ),
                            snap: false,
                          ),
                        ),
                      ),

My solution also pinches and zooms despite adding the pinchZoom: false to my BezierChartConfig. Your sample does not zoom when pinched and you didn't have to use pinchZoom. Is this also due to the custom BezierChartScale?
Thank you!

sorry I pushed a new change few minutes ago, but you have to use the repository for now , until I publish a new version,  pinchZoom is working now,  and for date time charts there is no way to do it no-scrollable, I will think a better solution for that

Published.
--
Rodney Aiglstorfer
On June 23, 2019 at 4:04:56 PM, Diego Velásquez López (
<EMAIL_ADDRESS>wrote:
sorry I pushed a new change few minutes ago, but you have to use the
repository for now , until I publish a new version, pinchZoom is working
now, and for date time charts there is no way to do it no-scrollable, I
will think a better solution for that
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/aeyrium/bezier-chart/issues/8?email_source=notifications&email_token=AEAMDSGUI2WBEK24HBFGOATP376RRA5CNFSM4H2Z6YJ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYLJC2Y#issuecomment-504795499,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AEAMDSGYSDILY5YMPN47HJLP376RRANCNFSM4H2Z6YJQ
.


[stable/mariadb] specifying customer users breaks cluster

Describe the bug
When specifying custom values for users, password and database name, replication will always fail.
Version of Helm and Kubernetes:
Kubernetes:
Client Version: version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.1", GitCommit:"b7394102d6ef778017f2ca4046abbaa23b88c290", GitTreeState:"clean", BuildDate:"2019-04-08T17:11:31Z", GoVersion:"go1.12.1", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.1", GitCommit:"b7394102d6ef778017f2ca4046abbaa23b88c290", GitTreeState:"clean", BuildDate:"2019-04-08T17:02:58Z", GoVersion:"go1.12.1", Compiler:"gc", Platform:"linux/amd64"}

Helm:
Client: &version.Version{SemVer:"v2.13.1", GitCommit:"618447cbf203d147601b4b9bd7f8c37a5d39fbb4", GitTreeState:"clean"}
Server: &version.Version{SemVer:"v2.13.1", GitCommit:"618447cbf203d147601b4b9bd7f8c37a5d39fbb4", GitTreeState:"clean"}

Which chart:
stable/mariadb
What happened:
Master will deploy fine, while any slave replica will die with this message
2019-05-10  9:05:45<PHONE_NUMBER>95328 [ERROR] Slave I/O: error connecting to master 'replicator@REDACTED-mariadb:3306' - retry-time: 10  maximum-retries: 86400  message: Access denied for user 'replicator'@'REDACTED' (using password: YES), Internal MariaDB error code: 1045

What you expected to happen:
Slave replicas should have picked up the configured database name, replication user, password, etc.
How to reproduce it (as minimally and precisely as possible):
helm install --name my-release stable/mariadb --set  db.name=test

Closing since this was actually in issue with our storage provisioner reusing slave volumes... /facepalm


[winpcap] Build error

Host Environment

OS: Windows 10
Compiler: MSVC (Visual Studio 2019)

To Reproduce
Steps to reproduce the behavior:
./vcpkg install winpcap
Failure logs
-Cut and paste the appropriate build messages from the console output.
-Please attach any additional failure logs mentioned in the console output.
Detecting compiler hash for triplet x64-windows...
4>The following packages will be built and installed:
4>    winpcap[core]:x64-windows -> 4.1.3#8 -- C:\vcpkg-git\vcpkg\buildtrees\versioning_\versions\winpcap\85d70a721afa26cf8ff26aec62fd04a16f8e6f7b
4>Restored 0 packages from C:\Users\ronen\AppData\Local\vcpkg\archives in 278.3 us. Use --debug to see more details.
4>Installing 1/1 winpcap:x64-windows...
4>Building winpcap[core]:x64-windows...
4>-- Installing port from location: C:\vcpkg-git\vcpkg\buildtrees\versioning_\versions\winpcap\85d70a721afa26cf8ff26aec62fd04a16f8e6f7b
4>-- Using cached WpcapSrc_4_1_3.zip.
4>-- Extracting source C:/vcpkg-git/vcpkg/downloads/WpcapSrc_4_1_3.zip
4>-- Applying patch C:/vcpkg-git/vcpkg/buildtrees/winpcap/src/packetNtx.patch
4>-- Applying patch C:/vcpkg-git/vcpkg/buildtrees/winpcap/src/wpcap.patch
4>-- Applying patch C:/vcpkg-git/vcpkg/buildtrees/versioning_/versions/winpcap/85d70a721afa26cf8ff26aec62fd04a16f8e6f7b/create_lib.patch
4>-- Applying patch C:/vcpkg-git/vcpkg/buildtrees/versioning_/versions/winpcap/85d70a721afa26cf8ff26aec62fd04a16f8e6f7b/fix-create-lib-batch.patch
4>-- Using source at C:/vcpkg-git/vcpkg/buildtrees/winpcap/src/4_1_3-2020b05bdd.clean
4>CMake Error at scripts/cmake/vcpkg_execute_required_process.cmake:128 (message):
4>    Command failed: devenv.exe Packet.sln /Upgrade
4>    Working Directory: C:/vcpkg-git/vcpkg/buildtrees/winpcap/src/4_1_3-2020b05bdd.clean/packetNtx/Dll/Project
4>EXEC : error code: The system cannot find the file specified
4>    See logs for more information:
4>
4>Call Stack (most recent call first):
4>  buildtrees/versioning_/versions/winpcap/85d70a721afa26cf8ff26aec62fd04a16f8e6f7b/portfile.cmake:50 (vcpkg_execute_required_process)
4>  scripts/ports.cmake:146 (include)
4>
4>
4>EXEC : error : building winpcap:x64-windows failed with: BUILD_FAILED

Additional context
Add any other context about the problem here, such as what you have already tried to resolve the issue.
I tried to add the path for the devenv.exe file at the system environment variables.
I confirmed that the .sln file is present at the Working Directory, and also tried to run the command 'devenv.exe Packet.sln /Upgrade' myself from CMD successfully.
Also tried to update vcpkg.
All things runs as admin.
Still, for some reason the .cmake scripts attempting to run the command fails...

Can you please repair your Visual Studio using Visual Studio Installer then retry?
Since pcap's sln file needs and can only be upgraded with devenv, a complete Visual Studio is required to build it.

Can you please repair your Visual Studio using Visual Studio Installer then retry? Since pcap's sln file needs and can only be upgraded with devenv, a complete Visual Studio is required to build it.

I tried that but it did not help. Also, I have a complete VS installation already.
I got this sorted out, I can only speculate the reason for the fix:
Before I installed VS19, VS Code was installed first, and along with it something called 'Built Tools for Visual Studio 2022'.
At this point VS19 and the additional build tools are installed.
Only after removing the 'Build Tools' the pcap package installed successfully.
So my guess is that there was some conflict of sort with the build tools.
Thank you.


ENH: Add implementation of AVA method for segmenting mouse USVs

We should add some version of the algorithm that AVA uses to segment mouse USVs from audio

https://github.com/pearsonlab/autoencoded-vocal-analysis/blob/fac3b53280bdac95dd9fb5ab8e276fdb90dab1e3/ava/segmenting/amplitude_segmentation.py#L19
A set of parameters for mice are in this example script: https://github.com/pearsonlab/autoencoded-vocal-analysis/blob/master/examples/mouse_sylls_mwe.py
That they use with this dataset: https://research.repository.duke.edu/concern/datasets/9k41zf38g?locale=en

as the algorithm is being used in papers, e.g. from @nickjourjine
https://github.com/nickjourjine/peromyscus-pup-vocal-evolution/blob/1104538121316fa58b69f337f3e28e453f738c58/src/segmentation.py#L21
and from @ralphpeterson, see https://www.biorxiv.org/content/10.1101/2023.03https://research.repository.duke.edu/concern/datasets/9k41zf38g?locale=en.11.532197v1.full.pdf
but with the addition of the use of spectral flatness to filter vocalizations from non-vocalizations, see here (and relevant citations in paper we should include in a References section of docstring):
https://github.com/ralphpeterson/gerbil-vocal-dialects/blob/main/vocalization_segmenting.py
See also the paper for their parameters
As part of #40 and originally discussed in #5 -- note this is already in progress in https://github.com/vocalpy/vocalpy/tree/add-segment-module but I'm breaking out each algorithm as separate issues, like here. (I will probably rename the branch something to add-ava-segmenter)
We should

[ ] implement

Seeing again that it has been used by at least 3 papers I think I should undo some of the changes I made and provide just a slightly cleaned up version that preserves the behavior of the original, and name it something like ava_segmenter
default parameters should be those from that example script
would be nice to also provide Ralph's params as a dataclass that could be pass in by converting to a dict and unpacking with the ** operator

[ ] also include a tutorial that walks through the algorithm step-by-step

This was added in #53 , still need to add a demo in the docs (as in #52)


GetTokenServiceAccountImpl uses wrong Exp

The GetTokenServiceAccountImpl microflow creates a wrong JWT request because the value of the claims attribute exp is not set correctly. This should be set to a Unix timestamp, but the microflow is using the "GetIntFromDateTime" Java action with 'day' as selector which gives a number from 1 to 31.
We need to get the number of seconds since 1-1-1970 (UTC) and add a maximum of 60 seconds to create a valid JWT claims.

This issue will be solved later when the Service Account will be fully implemented.


Change casing for workbook name

…k to Workbooks/Defender for IoT/Sensor health/Sensor health.workbook
PR Checklist

[ ] Explain your changes, so people looking at the PR know what and why, the code changes are the how.

If adding or updating templates:

[ ] post a screenshot of templates and/or gallery changes
[ ] ensure your template has a corresponding gallery entry in the gallery folder
[ ] If you are adding a new template, add your team and template/gallery file(s) to the CODEOWNERS file. CODEOWNERS entries should be teams, not individuals
[ ] ensure all steps have meaningful names
[ ] ensure all parameters and grid columns have display names set so they can be localized
[ ] ensure that parameters id values are unique or they will fail PR validation (parameter ids are used for localization)
[ ] ensure that steps names are unique or they will fail PR validation (step names are used for localization)
[ ] grep /subscription/ and ensure that your parameters don't have any hardcoded resourceIds or they will fail PR validation
[ ] remove fallbackResourceIds and fromTemplateId fields from your template workbook or they will fail PR validation

@garubin can you check this build error?

Validating Gallery files...
Verifying gallery files:
Uncaught AssertionError: ./gallery/workbook/defender-for-iot.json : Template with ID: Workbooks/Defender for IoT/Sensor Health could not be found in the specified path. The ID should be the folder where the template resides relative to the root repository (eg. Workbooks/Performance/Apdex)


[Helix-machines] PR builds should not fail when secrets need cycling

Currently if secret manager detects that there is a secret that is nearing expiration and needs rotation, the helix-machines PR builds will fail, blocking the PR and the work.
Our process is for secret rotation to happen as part of FR duties using the scheduled pipelines that run at the beginning of the week, so blocking a dev's unrelated work with this seems inappropriate.
We should consider only running the secret validation during main builds, or running it during PRs in such a way that doesn't block the build.

Release Note Category

[ ] Feature changes/additions
[ ] Bug fixes
[ ] Internal Infrastructure Improvements

Release Note Description

An example build where this happened: https://dnceng.visualstudio.com/internal/_build/results?buildId=2372673&view=results

This should be a quick fix — just delete the ValidateSecrets stage from azure-pipeline-pr.yaml, leaving it just in azure-pipelines.yml.
I'm placing this in the Improve helix-machines Infrastructure epic. Feel free to move elsewhere if you disagree.


Useless message from harper-ls on every buffer change

Hi, thanks for this amazing project :)
I have a problem with harper-ls in neovim: every time I change anything in a buffer (e.g. type a character), I get a message from harper-ls with only the text "Linting...". Those messages spam my view when I type. Here's a screenshot:

Is there a way to disable it?

Thanks for pointing this out! This is actually fixed in the most recent commits. I'll look into creating a new release as soon as possible.

Alright! The change has been published. It will take a bit for Mason to pick up the new binaries, but it should land soon.


cannot get related maintext

Describe the bug
When I receive information from a site like the one below, it cannot recognize the main part of the text ....
http://www.jahannews.com/news/769201
To Reproduce
from newsplease import NewsPlease
url = "http://www.jahannews.com/news/769201"
article = NewsPlease.from_url(url)
print(article.maintext)

Log
Return None
Versions:

OS: Linux Ubuntu 20.04
Python Version 3.6
news-please Version latest

Intent

[x] personal
[x] academic

Since np is intended to be a universal crawler, we expect that it does not work perfectly (or even at all as in this case) for all sites.


Use sphinx-notfound-page extension to build a nice 404 page

When Read the Docs finds a 404.html page in the project it will serve it instead the default one.
The extension installed, takes care about all the links being generated properly (absolute) so the page can be served at any URL where the page is not found.

NOTE: there are some extra configurations that can be tweaked in case you want to change the default message: https://sphinx-notfound-page.readthedocs.io/en/latest/configuration.html

Awesome! I know I told you I would do it, so thanks for doing it yourself :)
The tests failed because of https://github.com/poliastro/poliastro/issues/665, so I am merging this right away and let's see how it goes.

It seems it works: https://docs.poliastro.space/en/latest/not/found/page.html


AWS S3 Create Object - Not Available

Describe the Bug with repro steps
As Part of Action, I'm unable to see s3 create object option
What type of Logic App Is this happening in?
Consumption (Portal)
Are you using new designer or old designer
Old Designer
Did you refer to the TSG before filing this issue? https://aka.ms/lauxtsg
Yes
Workflow JSON
No response
Screenshots or Videos

Browser
Chrome
Additional context
No response
AB#24938831

I still don't see s3 object create option in Logic app.

this api isn't owned by our team, that being said, looking at the documentation: https://learn.microsoft.com/en-us/connectors/amazons3/#actions, it doesn't seem this was supported - was this previously available?


split order

This PR adresses issue #47 i.e. it considers all orders according to modality proportions for splits along categorical features in classification
There seem to be some overfitting issues yet to be cleared

this is rebased in another PR, so I'll close it


add iban an bic dictionaries for bank_accounts

This pullrequest provides 2 new dictionaries for ibans and bics. And hereby:
A random generator for ibans:
Forgery(:bank_account).iban

And a random generator for bics:
Forgery(:bank_account).bic

@romanlehnert Thank you for your contribution!


sqlalchemy table reflection doesn't work for SimpleAggregateFunction

Describe the bug
Looks like table reflection does not work for complex types like SimpleAggregateFunction.
Code example
CREATE MATERIALIZED VIEW test
(
    `Id` String,
    `timestamp` SimpleAggregateFunction(anyLast, DateTime),
    `name` SimpleAggregateFunction(anyLast, String)
)
ENGINE = AggregatingMergeTree() ORDER BY (Id)
AS SELECT
    Id,
    anyLast(timestamp) AS timestamp,
    anyLast(name) AS name
FROM test_raw
GROUP BY Id;

import clickhouse_connect
from sqlalchemy import create_engine, Column, MetaData, inspect, Table

table = Table("test", metadata)
inspect(engine).reflect_table(table, None, ())

clickhouse-connect  logs
  File "/home/xxx/.cache/pypoetry/virtualenvs/target-clickhouse-r0Dtrf4p-py3.10/lib/python3.10/site-packages/clickhouse_connect/cc_sqlalchemy/inspector.py", line 27, in reflect_table
    for col in self.get_columns(table.name, schema):
  File "/home/xxx/.cache/pypoetry/virtualenvs/target-clickhouse-r0Dtrf4p-py3.10/lib/python3.10/site-packages/clickhouse_connect/cc_sqlalchemy/inspector.py", line 43, in get_columns
    sqla_type = sqla_type_from_name(row.type)
  File "/home/xxx/.cache/pypoetry/virtualenvs/target-clickhouse-r0Dtrf4p-py3.10/lib/python3.10/site-packages/clickhouse_connect/cc_sqlalchemy/datatypes/base.py", line 135, in sqla_type_from_name
    return type_cls.build(type_def)
  File "/home/xxx/.cache/pypoetry/virtualenvs/target-clickhouse-r0Dtrf4p-py3.10/lib/python3.10/site-packages/clickhouse_connect/cc_sqlalchemy/datatypes/base.py", line 47, in build
    return cls._instance_cache.setdefault(type_def, cls(type_def=type_def))
TypeError: SimpleAggregateFunction.__init__() missing 1 required positional argument: 'name'

Configuration
Environment

clickhouse-connect version: 0.5.22
Python version: 3.10
Operating system: Linux

Just a reminder that SqlAlchemy support is very limited and fairly low priority.
Do you happen to know if this affects Superset?

This turned out to be a simple bug and will be fixed in the next release.  In general though I wouldn't rely on clickhouse-connect SQLAlchemy for anything very complicated.


Prevent Terraform from destroying created S3 buckets

Describe the Feature
Adding support for the prevent_destroy Terraform meta-argument.
Use Case
Currently, there are ways to prevent Terraform from destroying an S3 bucket created with the module in this repository. But it'd be great to be able to also explicitly set prevent_destroy = true to make it 100% impossible to accidentally destroy a previously created S3 bucket, as well as get a clear error message from Terraform when attempting to do so.
Describe Ideal Solution
Add a boolean option prevent_destroy (default false) that sets lifecycle { prevent_destroy = true } in the bucket resource.
If this would be a desired feature, also happy to write up a PR for it myself!
Alternatives Considered
Aside from using the S3 lifecycle configuration, there is currently no way to prevent Terraform from attempting to destroy an S3 bucket it has created, should its configuration change.
Alternatively, this could be integrated with some of the existing options (such as force_destroy), but that'd probably make the configuration of the generated resources less obvious.

Thank you for the suggestion. Unfortunately, Terraform doesn't work that way. You cannot configure the lifecycle section, and when you make a change to it, Terraform destroys the old resource and creates a new one. So adding prevent_destroy = true would make Terraform want to destroy all the existing S3 buckets. Also, the feature doesn't work very well: if you remove the resource entirely from the configuration (which we virtually do when you set enabled = false) then Terraform destroys the resource anyway, since you removed the prevent_destroy flag along with everything else.


this is amazing!!

please could you make it for text files? I mean for docx, txt, pdf. something like preview?

I am not sure if this is possible with the filereader api. This is not a planned feature yet.


Bootstraps type annotations

The patch contains basic infrastructure and annotates one hand-picked
file, tmt/utils.py.
Feel free to ignore
I just wanted to share the work, and save it in the repo for later. Adding annotations revealed a couple of patch-worthy issues, and my plan is to fix them in separate patches before dropping this patch with annotation on top of it. Therefore draft at this moment, and it will get more changes and rebases.

Nice, really happy that we are slowly adding type annotations. Let me know if I can help you somehow with annotating. I agreed with @psss that I will try taking a look at the paralelization of execute step for multihost so this is basically the first step. I was planning on annotating some of the modules, possibly refactoring some things on the way

Great, thanks for starting work on this!

Rebased & updated. The last remaining piece of code not annotated is StructuredField - here I wait for https://github.com/teemtee/tmt/pull/1085 to land, then I'd annotate this class. Annotating first and then removing basestring and unicode would lead to nasty rebase with conflicts.

Rebased & updated, and I get zero errors locally. Open for review.
What's missing? Actually running the test: I have a piece in .pre-commit-config.yaml, commented out, but I'd like to get a guidance on how to enable type annotation checking. It's on par with stuff like PEP8, hence my proposal for pre-commit, but if there's more to add, let em know.

interesting, some unit tests fail during koji build

@happz pre-commit makes sense, it already runs via github actions anyway

/packit test

I've spotted a couple of tests I probably cannot fix on my own:

plenty of Centos Stream 8 tests fail because of trouble with podman, podman: symbol lookup error: podman: undefined symbol: seccomp_notify_fd at https://artifacts.dev.testing-farm.io/0d703719-de06-4b6e-93a4-0d235d86cd23/
/tests/integration/coverage_bugzilla and /tests/integration/the_rest at https://artifacts.dev.testing-farm.io/0d703719-de06-4b6e-93a4-0d235d86cd23/ - these seem to fail because of failed imports, and these failures I'd expect to manifest in other PRs as well.

/usr/local/lib/python3.6/site-packages/git/types.py:12: in <module>
    from typing_extensions import Final, Literal, SupportsIndex  # noqa: F401
E   ImportError: cannot import name 'SupportsIndex'

Might be related to the fact typing_extensions dropped support for Python 3.6 a few days ago, or the system package is too old and does not provide SupportsIndex, but I don't see a convincing answer to why is this happening. Any ideas? Could it be caused by me messing with packages and types?

Might be related to the fact typing_extensions dropped support for Python 3.6 a few days ago, or the system package is too old and does not provide SupportsIndex, but I don't see a convincing answer to why is this happening. Any ideas? Could it be caused by me messing with packages and types?

Looks as too old python3-typing-extensions. Can be reproduced if one installs dnf install python3-typing-extensions-<IP_ADDRESS>-1.el8.noarch and then pip-3 install requre. Import of require than fails.
And pip-3 install --upgrade typing-extensions upgrades to 4.1.1. After that import requre works

plenty of Centos Stream 8 tests fail because of trouble with podman

This seems to be caused by a podman bug, the fix should be in production soon.

Might be related to the fact typing_extensions dropped support for Python 3.6 a few days ago, or the system package is too old and does not provide SupportsIndex, but I don't see a convincing answer to why is this happening. Any ideas? Could it be caused by me messing with packages and types?

Looks as too old python3-typing-extensions. Can be reproduced if one installs dnf install python3-typing-extensions-<IP_ADDRESS>-1.el8.noarch and then pip-3 install requre. Import of require than fails.
And pip-3 install --upgrade typing-extensions upgrades to 4.1.1. After that import requre works

@lukaszachy shall I add this somewhere into my patch?

@happz IMO you could add dependency on typing-extensions>=<IP_ADDRESS>

@happz IMO you could add dependency on typing-extensions>=<IP_ADDRESS>
I've created epel-8 bug to have it updated https://bugzilla.redhat.com/show_bug.cgi?id=2069579

I'm afraid I'll need more help. Should I add it? If so, where? Is setup.py the right place? I think it is, but maybe changing tests' requirements would be better.

IMO at two places:

plans/integration/main.fmf where script: pip3 install requre happens
setup.py to 'tests': ['pytest', 'python-coveralls', 'requre', 'pre-commit'],

We don't have requirements for pip packages (yet)

IMO at two places:

plans/integration/main.fmf where script: pip3 install requre happens
setup.py to 'tests': ['pytest', 'python-coveralls', 'requre', 'pre-commit'],

Done both, didn't seem to have any effect.
I tried to reproduce locally, with the help of tmt reproducer provided in TF logs, and error happens a bit sooner:
$ tmt -vvv -c trigger=commit -c arch=x86_64 -c distro=centos-stream-8 run --all --verbose -e @tmt-environment-plans-integration.yaml provision --how virtual --image CentOS-Stream-8 plan --name /plans/integration
/var/tmp/tmt/run-005
Found 1 plan.

/plans/integration
summary: Verify integration with other systems
    discover
        how: fmf
        order: 50
        directory: /tmp/testcode
        hash: 96828a0
        filter: tag: integration
        summary: 2 tests selected
            /tests/integration/coverage_bugzilla
            /tests/integration/the_rest
    provision
        how: virtual
        order: 50
        image: CentOS-Stream-8
        user: root
        memory: 2048 MB
        disk: 10 GB
        connection: session
        qcow: CentOS-Stream-GenericCloud-8-20210603.0.x86_64.qcow2
        name: tmt-005-vPKxxice
        progress: booting...
        ip: <IP_ADDRESS>
        port: 10023
        distro: CentOS Stream 8
        kernel: 4.18.0-305.3.1.el8.x86_64
        summary: 1 guest provisioned
    prepare
        how: install
        name: Install pip
        order: 50
        package: 1 package requested
            python3-pip

        how: shell
        name: Install Requre
        order: 50
        overview: 1 script found
        script: pip3 install typing-extensions>=<IP_ADDRESS> requre

        how: shell
        name: Create default nitrate config
        order: 50
        overview: 1 script found
        script:
            test -e ~/.nitrate || echo -en '[nitrate]
            url = https://nitrate.server/xmlrpc/
            ' | tee ~/.nitrate

        how: install
        summary: Install required packages
        name: requires
        order: 70
        package: 1 package requested
            python3-pytest

        summary: 4 preparations applied
    execute
        how: tmt
        order: 50
        exit-first: False
            test: Integration tests with requre support
                out: ============================= test session starts ==============================
                out: platform linux -- Python 3.6.8, pytest-7.0.1, pluggy-1.0.0 -- /usr/bin/python3
                out: cachedir: .pytest_cache
                out: rootdir: /var/tmp/tmt/run-005/plans/integration/discover/default/tests
                out: collecting ... collected 0 items / 1 error
                out:
                out: ==================================== ERRORS ====================================
                out: ______________ ERROR collecting tests/integration/test_nitrate.py ______________
                out: ImportError while importing test module '/var/tmp/tmt/run-005/plans/integration/discover/default/tests/tests/integration/test_nitrate.py'.
                out: Hint: make sure your test modules/packages have valid Python names.
                out: Traceback:
                out: /usr/lib64/python3.6/importlib/__init__.py:126: in import_module
                out:     return _bootstrap._gcd_import(name[level:], package, level)
                out: __init__.py:3: in <module>
                out:     import nitrate
                out: E   ModuleNotFoundError: No module named 'nitrate'
                out: =========================== short test summary info ============================
                out: ERROR test_nitrate.py
                out: !!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!
                out: =============================== 1 error in 0.09s ===============================
                00:00:00 /tests/integration/coverage_bugzilla [1/2]
            test: Integration tests with requre support
                out: ============================= test session starts ==============================
                out: platform linux -- Python 3.6.8, pytest-7.0.1, pluggy-1.0.0 -- /usr/bin/python3
                out: cachedir: .pytest_cache
                out: rootdir: /var/tmp/tmt/run-005/plans/integration/discover/default/tests
                out: collecting ... collected 0 items / 1 error
                out:
                out: ==================================== ERRORS ====================================
                out: ______________ ERROR collecting tests/integration/test_nitrate.py ______________
                out: ImportError while importing test module '/var/tmp/tmt/run-005/plans/integration/discover/default/tests/tests/integration/test_nitrate.py'.
                out: Hint: make sure your test modules/packages have valid Python names.
                out: Traceback:
                out: /usr/lib64/python3.6/importlib/__init__.py:126: in import_module
                out:     return _bootstrap._gcd_import(name[level:], package, level)
                out: __init__.py:3: in <module>
                out:     import nitrate
                out: E   ModuleNotFoundError: No module named 'nitrate'
                out: =========================== short test summary info ============================
                out: ERROR test_nitrate.py
                out: !!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!
                out: =============================== 1 error in 0.09s ===============================
                00:00:00 /tests/integration/the_rest [2/2]
        summary: 2 tests executed
    report
        how: display
        order: 50
            errr /tests/integration/coverage_bugzilla
                output.txt: /var/tmp/tmt/run-005/plans/integration/execute/data/tests/integration/coverage_bugzilla/output.txt
                content:
                    ============================= test session starts ==============================
                    platform linux -- Python 3.6.8, pytest-7.0.1, pluggy-1.0.0 -- /usr/bin/python3
                    cachedir: .pytest_cache
                    rootdir: /var/tmp/tmt/run-005/plans/integration/discover/default/tests
                    collecting ... collected 0 items / 1 error

                    ==================================== ERRORS ====================================
                    ______________ ERROR collecting tests/integration/test_nitrate.py ______________
                    ImportError while importing test module '/var/tmp/tmt/run-005/plans/integration/discover/default/tests/tests/integration/test_nitrate.py'.
                    Hint: make sure your test modules/packages have valid Python names.
                    Traceback:
                    /usr/lib64/python3.6/importlib/__init__.py:126: in import_module
                        return _bootstrap._gcd_import(name[level:], package, level)
                    __init__.py:3: in <module>
                        import nitrate
                    E   ModuleNotFoundError: No module named 'nitrate'
                    =========================== short test summary info ============================
                    ERROR test_nitrate.py
                    !!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!
                    =============================== 1 error in 0.09s ===============================
            errr /tests/integration/the_rest
                output.txt: /var/tmp/tmt/run-005/plans/integration/execute/data/tests/integration/the_rest/output.txt
                content:
                    ============================= test session starts ==============================
                    platform linux -- Python 3.6.8, pytest-7.0.1, pluggy-1.0.0 -- /usr/bin/python3
                    cachedir: .pytest_cache
                    rootdir: /var/tmp/tmt/run-005/plans/integration/discover/default/tests
                    collecting ... collected 0 items / 1 error

                    ==================================== ERRORS ====================================
                    ______________ ERROR collecting tests/integration/test_nitrate.py ______________
                    ImportError while importing test module '/var/tmp/tmt/run-005/plans/integration/discover/default/tests/tests/integration/test_nitrate.py'.
                    Hint: make sure your test modules/packages have valid Python names.
                    Traceback:
                    /usr/lib64/python3.6/importlib/__init__.py:126: in import_module
                        return _bootstrap._gcd_import(name[level:], package, level)
                    __init__.py:3: in <module>
                        import nitrate
                    E   ModuleNotFoundError: No module named 'nitrate'
                    =========================== short test summary info ============================
                    ERROR test_nitrate.py
                    !!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!
                    =============================== 1 error in 0.09s ===============================
        summary: 2 errors
    finish
        guest: stopped
        guest: removed
        summary: 0 tasks completed

total: 2 errors

Why is nitrate missing? I couldn't find it anywhere in test requirements, it's in setup.py for convert extra, but that's not a problem in the context of a test when executed by Testing Farm, triggers when running it locally. A test bug?
Another point I don't understand is why is this happening when I got anywhere close to messing with nitrate or its tests? I'm not aware of changes affecting this area of code, is this really the only patch having troubles with tests on CentOS? And if so, what changes are causing those troubles?

/packit test

/packit build

Squashed and rebased. A couple of adjustments are needed for updatable_message:
tmt/utils.py:2014: error: Missing type parameters for generic type "contextlib.AbstractContextManager"
tmt/utils.py:2061: error: Function is missing a type annotation
tmt/utils.py:2065: error: Function is missing a type annotation for one or more arguments
Found 3 errors in 1 file (checked 1 source file)

Tried to fix the errors in e1ad5c6. @happz, please have a look.

Squashed and rebased. A couple of adjustments are needed for updatable_message:
tmt/utils.py:2014: error: Missing type parameters for generic type "contextlib.AbstractContextManager"
tmt/utils.py:2061: error: Function is missing a type annotation
tmt/utils.py:2065: error: Function is missing a type annotation for one or more arguments
Found 3 errors in 1 file (checked 1 source file)

Tried to fix the errors in e1ad5c6. @happz, please have a look.

All look good to me with the exception of the AbstractContextManager one. I'm afraid there might be troubles in runtime, did you try importing the fixed file or running tmt? If I get this right, with some Python versions this may end up with an error, something along the lines of "ABCMeta object is no subscribable", because AbstractContextManager might indeed be nothing one could apply an index to.
I've found a couple of articles discussing how to annotate context managers correctly, e.g. https://peps.python.org/pep-0585/#implementation, my impression is the answer depends heavily on which Python version one needs to address. If tmt works for you with this patch, then good, surprising, but good - but if not, this seems to be a can of worms, and I'd propose adding # type: ignore to silence mypy, and I could address it in a separate patch.

Seems to be working fine with recent Pythons on Fedora but fails on el8 and el9.

I'd propose adding # type: ignore to silence mypy, and I could address it in a separate patch.

Ok, will add this.

Tests passed, for el8 there's the usual pile of podman failures but el9 build failed:
No matching package to install: 'python3-typing-extensions'

There is already a bug asking to add the package to epel9. Seems to be blocked by some other missing dependencies. We could possibly use typing directly on el9 as the python version is quite fresh there: Python 3.9.10 But that would require some conditional imports I guess.
@happz, what do you think? Shall we wait for python3-typing-extensions or try to workaround it? If I understand it correctly el8 is the only distro where we need extensions because of the old Python 3.6.8 version

b878321

Trying a conditional import and BuildRequires in b878321153ceac795c11a665f6929b039e55e70a, let's see how it turns out.

Cool, thanks for the review & final merging.
And here we go... https://github.com/teemtee/tmt/pull/1170 :)


Fix build system issues

Also, move the gophernicus man page to its appropriate section (8)
This commit fixes a few issues with the proposed new build system:

Don't assume target directories exist, and create them as needed
Pass -lwrap at the appropriate place to fix linking errors
Only output a message saying that the install was successful after all dependencies have been met. Otherwise, when running make with parallelism, the install-done would sometimes get executed before the rest of the targets succeeded.

Thanks! Good pickup on the section 8 manpage, it should be there :)


Bump sbt to 1.10.7

Bump sbt to 1.10.7

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 84.43%. Comparing base (1f443fe) to head (93d7113).

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #189   +/-   ##
=======================================
  Coverage   84.43%   84.43%
=======================================
  Files          18       18
  Lines         379      379
  Branches        5        5
=======================================
  Hits          320      320
  Misses         59       59


Bullet Physics cylinder and cone shapes

Bullet provides collision shapes that Godot doesn't expose yet: cylinder and cone.

CC @AndreaCatania

Good call, in this moment we need to implement a feature for both 2D and 3D if we break this rule is easy for me to implement these things

I'm not sure what would be the equivalent of cylinder and cone shapes for 2D. If some feature is only relevant for 3D, I'd say to go for it, especially if it's easy.

Bullet uses vertical-by-default collision meshes. We need to fix https://github.com/godotengine/godot/issues/5813 first.

Cylinder shape implemented by #19540.

Does anyone want cone shapes? I personally have no use for them but some may find it useful.

Let's wait for anyone to request them, we don't implement features unless users need them.


Lack of GUI for Accessing Features Easily

This project includes several valuable features, such as:

Voice Recognition: Processes and interprets spoken commands.
Text-to-Speech: Converts text responses into spoken output.
Weather Information: Provides real-time weather updates.
News Updates: Fetches the latest news headlines.
Jokes: Delivers various types of jokes.
Wikipedia Information: Retrieves information from Wikipedia.
Music Management: Manages and plays music.
Web Interface: Offers an interactive frontend with animations.
Question Answering: Provides answers to user queries.

However, there is no graphical user interface (GUI) to make these features more accessible and user-friendly. Implementing a GUI would greatly improve usability and enhance the overall user experience.
A potential solution would be to develop the GUI using Streamlit, which could integrate seamlessly with the existing features.

@suryanshsk , I can build the GUI. but it is a bit time consuming. hope you add the good gssoc tags here.
you can assign this to me. if you find this feature useful.

Done, please check.
On Sun, 6 Oct, 2024, 6:50 pm Jitendra Kumar, @.***>
wrote:

@suryanshsk https://github.com/suryanshsk , I can build the GUI. but it
is a bit time consuming. hope you add the good gssoc tags here.
you can assign this to me. if you find this feature useful.
—
Reply to this email directly, view it on GitHub
https://github.com/suryanshsk/Python-Voice-Assistant-Suryanshsk/issues/57#issuecomment-2395438517,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AVBBZFLPD2RRW252CN75LETZ2E2LVAVCNFSM6AAAAABPOKL4HOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOJVGQZTQNJRG4
.
You are receiving this because you were mentioned.Message ID:
@.***
com>

@suryanshsk I find a bit difficult to generate open_weather and news api key. can you please provide some reference how to generate them.

You will get open_weather api from here:https://openweathermap.org/api
And  news api from here https://newsapi.org/
On Sun, 6 Oct, 2024, 6:53 pm Jitendra Kumar, @.***>
wrote:

@suryanshsk https://github.com/suryanshsk I find a bit difficult to
generate open_weather and news api key. can you please provide some
reference how to generate them.
—
Reply to this email directly, view it on GitHub
https://github.com/suryanshsk/Python-Voice-Assistant-Suryanshsk/issues/57#issuecomment-2395439317,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AVBBZFK7E64ZAOUMECAF4B3Z2E2UHAVCNFSM6AAAAABPOKL4HOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOJVGQZTSMZRG4
.
You are receiving this because you were mentioned.Message ID:
@.***
com>


Fix bugs in RootSyncSet controller

Fixes some issues in the RootSyncSet:

Properly remove watchers.
Add ObservedGeneration to the RootSyncSet type so it is possible for clients to determine if the statuses are stale.

(Updated) changes LGTM!


Added awesome-delphi

Thanks. Looks good. Would be cool if you could link back here in your list so users can easily discover more awesome lists ;)


French translation : Missing word

Describe the bug

To reproduce
When you want to block someone, it is written "Block" instead of "Bloquer"
Additional information
No response


Simple After Update Trigger

Hi, I am having a very difficult time understanding how to create a simple 'after update' trigger using your library. I am using MS SQL.
I need to script triggers to update columns with SQL built-in functions, e.g.:
`CREATE TRIGGER [dbo].[MyEntityTable_UPDATE] ON [dbo].[MyEntityTable]
AFTER UPDATE
AS
BEGIN
SET NOCOUNT ON;
IF ((SELECT TRIGGER_NESTLEVEL()) > 1) RETURN; --optional

DECLARE @Id INT

SELECT @Id = INSERTED.Id
FROM INSERTED

UPDATE dbo.MyTable
SET ModifiedDate = SYSUTCDATETIME(),
	LoggedInUser = SUSER_NAME()
WHERE Id = @Id

END`
What is the correct way to use your library to do this? Thank you.
edit: I should also mention, the entity properties ModifiedDate and LoggedInUser are read-only, since the data is generated in the database.

Hi, the library was designed to do simple inserting/deleting/updating based on keys of triggered entities.
In your case, I can only suggest to try a raw SQL action like
modelBuilder.Entity<MyTable>()
    .AfterUpdate(trigger => trigger
        .Action(action => action
            .ExecuteRawSql(@"IF ((SELECT TRIGGER_NESTLEVEL()) > 1) RETURN;
UPDATE dbo.MyTable
SET ModifiedDate = SYSUTCDATETIME(), LoggedInUser = SUSER_NAME()
WHERE Id = {0}"), (entityBeforeUpdate, entityAfterUpdate) => entityAfterUpdate.Id)));

Oh, ok, I misunderstood the description of the library. Thank you for your suggestion.


How to add templates?

Hi, thank you for the tool. How to add templates?

Go to $HOME/.cfkit/templates/YOUR_LANGUAGE/
And create a new file there


train_from option available?

Hi, as Iʻm training a bilingual translation model, Iʻm trying to resume training from a checkpoint. It seems that I canʻt use option train_from.
Hereʻs my command: eole train --config wmt17_enty.yaml --train_from models/step_8000

Please delete issue. I found how to use it. Thanks.


[DOC] Create Maps section and move pages

Signed-off-by: vagimeli<EMAIL_ADDRESS>Description
Create Maps section and move pages; related to TOC restructure
Issues Resolved
#2402
#2317
Checklist

[x] By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and subject to the Developers Certificate of Origin.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@Naarcha-AWS Will you review the front matter to confirm it's accurate, particularly the redirect links? This is related to the TOC restructure.

@Naarcha-AWS Re-requested review

Duplicate PR. See #2621


Systematic Review of Large Data Transfers from Database to Java Application

This is a follow-up of the discussion in https://github.com/DSpace/DSpace/pull/9760#issuecomment-2536530613.
We should systematically review the Java codebase for instances where large SQL results are transferred from the database into the Java application, which results in copying the data from the database onto the JVM heap.
The identified areas should then be analyzed in detail. If the retrieved data is used to calculate database modifications (e.g., Inserts, Updates, Deletes), it should be evaluated whether the entire operation can be moved to the database layer.
By handling these operations directly in the database layer, we can eliminate the need to copy large SQL results into the Java application, thereby reducing the memory footprint of the JVM process and improving overall performance.
Acceptance Criteria:

Identify all code sections where significant data is transferred from the database to the application.
Document these locations and assess their impact.
For each identified case, evaluate the feasibility of moving entirely the operation to the database layer.
Implement changes where appropriate to minimize heap usage and JVM memory footprint.

Where we actually need to handle large numbers of database records in Java code, we could look at preferring Iterator (ideally wrapped in Iterable) over List.  My hope here is to find places where we can overlap I/O and processing.  That would reduce the memory pressure of large aggregates, and should also allow the DBMS and driver to make best use of any buffering and pipelining that they do.  There's no need to have the whole result set in memory if we just walk the results from end to end once.

What could be a useful definition here for a large SQL result?
In other words, what kind of reference database will we build to conduct this analysis on? An almost empty DSpace repository will likely have no "large" SQL results.
Here is an initial list of criteria/things we can blow up to simulate large SQL results, high numbers of any of the following, preferably combined:

Item count (a million?)
Community/collection count
Level of depth within community/collection tree: put some collections 5 or 6 levels deep
EPerson count
Group count
Group memberships per EPerson count (DIRECT + INDIRECT)
Resource policy count

lots of collection/community admins
lots of collection/community admin resource policies for single EPerson accounts
lot of submission permission resource policies
lots of people/group specific resource policies

Bitstreams per item => high numbers of bitstreams for single items (couple of hundred, maybe a thousand?)


Make IRC mockable.

Mostly the addition of IRC#emit, as well as something for things like IRC#privmsg et al to log somewhere. I've forked and will work on this. Feedback? Advice?

Good call! I actually have some mock stuff under /spec in the feature/twopointoh branch. IRC#emit is a neat idea, if you're using the 2.0.0-beta or feature/twopointoh branch you can hack it with instance._internals.emitter.emit("dix").

MockInternals looks like it should be ready for drop-in replacement of instance._internals, anything unfinished? I think I have a fairly good idea of the changes I want to make.
If you were writing tests for a bot or a client, what would you want? At first I thought something like IRC#emit would be a good idea but I just realized that then I'd probably be giving it an object like I'd be given in the event listener, but that's not a good source of data because that might change or be something I don't expect.  So what I'm thinking I'll end up writing is a convenience library for building IRC protocol strings. But pretty much every method of IRC is already doing that for its own thing, so my thought is to hotswap instance._internals.socket with a simple object that I can pull the string from afterwards, replace the socket object, and then send that string back through with instance._internals.socket.emit(that_string).
Thoughts?

I honestly think the simplest solution is using actual, raw IRC messages. Less room for error. Also allows you to copy paste failing IRC messages and use them in tests.

On that note, I've been thinking that something like expect(1) would be good. You'd have something like this:
expect NICK foobar
expect USER js-irc 0 * :Javascript Bot
send "intro_and_motd.irc"

# This is a comment. Up there is how you'd include a file, it's just a bunch of raw irc lines
# Comments are lines that start with # and nothing else. Different syntax?
expect JOIN #test
send "join_channel.irc"
send<EMAIL_ADDRESS>PRIVMSG #test :foobar: ping
expect PRIVMSG #test :tester: pong

# Maybe some programmatic tests?
function (prev) {
    return (prev.params[1] == 'foobar: ping')
}

Or something along those lines. Would be fairly simple to write, basically just a script that the bot should be following. For the programmatic tests, the argument passed would be like the objects event handlers get in IRC#on. A simple parser could just look for 'function', then count curly braces till the number of {  is the number of }, and pass the body off to new Function. Expected to return true/false, or a string indicating what the error was.
Thoughts?

I think most of this we get for free from existing testing frameworks, albeit a tad more verbose. I'm not sure the benefits of using this system would outweigh the burden of maintaining it. Would be cool, perhaps, as a generalized network testing framework.

I'll sleep on it and write some tests with an existing framework (probably node-tap) and see if it'd be worth my time. Do you know of anything using irc-js that has tests?

Nothing other than IRC-js itself.


How to use getFilteredAndSorted method or get data from filter?

Hello @akveo and guys please help me!
How to use getFilteredAndSorted method or get data from filter for request to server?
Does exist some output event, as (rowSelect) to get data from chosen filter?
In example was described how to make custom input connected with table, but how can i use internal filters in your table?

Please some help on th issue


Sourcemaps broken in simplest example

[x] I have searched the issues of this repository and believe that this is not a duplicate.

Expected Behavior

I'd expect sourcemaps of a basic module to enable breakpoint selection on all lines, except those clearly represented differently through transpilation.
Current Behavior

A basic component is not debuggable with sourcemaps: clicking on a line to set a breakpoint does not set a breakpoint at that line.
Steps to Reproduce (for bugs)

Example: https://github.com/tmcw/next-sourcemap-breakage-example

Single page with the source:
import {Component} from "react";
export default class Button extends Component {
  render() {
    function foo() {
      console.log(1);
    }
    return <button onClick={foo}>hi</button>
  }
};

Setting a breakpoint on the line
      console.log(1);

Is not possible:

Context

This makes debugging applications quite difficult.
Your Environment

Tech
Version

next
3.2.2

node
8.4.0

OS
macOS 10.12.6

browser
Google Chrome 61.0.3163.100

cc @kpdecker since you updated the sourcemaps 👌

I have this problem too and I'm surprised more developers are not complaining about this issue.  Is there a workaround for this?

I've updated the testcase repository to React v0.16.x and Next.js ^4.0.3, and can confirm the issue persists in the updated versions.

I've also seen this issue in our app

#3121 fixes both the immediate issue here and another where breakpoints were lost in Chrome on every page refresh.


arrow.get(): Implement d, ddd and ddd

The branch is named twitter because I had trouble parsing dates returned by twitter API, which
look like:  Fri Apr 08 19:19:24 +0000 2016
Fixes #281 and #273

Current coverage is 100.00%

Merging #321 into master will not affect coverage as of 4ebaad7

@@            master    #321   diff @@
======================================
  Files            8       8
  Stmts         1244    1244
  Branches       193     185     -8
  Methods          0       0
======================================
  Hit           1244    1244
  Partial          0       0
  Missed           0       0

Review entire Coverage Diff as of 4ebaad7

Powered by Codecov. Updated on successful CI builds.

I just realized. You can workaround the bug by using:
date = arrow.Arrow.strptime("Fri Apr 08 19:19:24 +0000 2016",  "%a %b %d %H:%M:%S %z %Y")

Despite there being a workaround, it would be better to have days of the week parsed by the standard get method - there are lots of date formats that include the day of the week.  RFC2822 email being a major one.

@jcollie I agree :)

Thanks for merging :)


(VP
    :Mod (AdvP
        :Head (Adv :p "," :t "computationally"))
    :Head (V :p "-" :t "aided" :l "aid"))

vs.
(VP
    :Mod (AdvP
        :Head (Adv :t "well"))
    :Head (VP
        :Head (V :p "-" :t "reasoned" :l "reason")))

@BrettRey

In an NP, yes (because of relative clauses). In other phrases, I'm happy to go either way.

Why relative clauses?

So the co-index isn't recursive

OK, so if there is a relative clause Mod it can't be under the Nom that is the immediate projection of the noun. Generalizing to all NPs, the noun must have a Nom projection that contains no Mods.
In terms of non-NPs, I'm torn between uniformity (like NPs, every lexical item always must have a phrasal projection with no Mods) vs. structural simplicity (only introduce a new Mod layer if necessary for binarization).
Structural simplicity makes for a slightly less parsimonious grammar: we need
VP → Mod:AdvP Head:V
VP → Mod:AdvP Head:VP
VP → Head:V Mod:PP
VP → Head:VP Mod:PP
and so on. But more unary productions (VP → Head:V) make the tree clunkier to read.

BTW I notice that the SIEG trees are shallow w.r.t. Mods/Adjuncts: they do not introduce a separate layer. So CGELBank departs from that at least for NPs and when necessary for binarization.

see [3] on p. 1113

Yes—where there is a relative clause. But in SIEGtrees3:

The upper one, I think, should have the Nom. When it comes to no NPs, then, yes, number of branches wasn't something we were really thinking about. For the treebank, though I think it's a useful principle. You?

Oh, I see you explained above. I could go either way, but I prefer binarity when possible.

Also, the model theoretic approach of CGEL is, as I think you know, in direct opposition to generative rules like VP → Mod:AdvP Head:V. I don't know if this is more or less parsimonious in MT thinking.

Decided: we should favor uniformity. Every lexeme should have a projection with no Mods. We can write a script to simplify for those who want shallower structures.


Feature support token_bf index for token search

Proposed changes
Support token_bf index for token search:

Token_bf index is mainly used to optimise English text searching accurately.  It can split sentences by non-numeric and non-characters and construct bloom filter. When searching by like、not like、startsWith、in、not in、endswith, it can accelerate searching time.  This pr is only support like.
vs ngram_bf index, In English text
(1) Token_bf index has 100% up.
(2) It doesn't need to provide ngram_size parameter.
vs inverted index
support case sensitive and escape character
Limitation
In like '%xxx%' sql,  token_bf index will not be used. Because the bloom filter records the whole token and it can't process part of it.  We can use like '% xxx %'  or hastoken(xxx)  function to process.

Test:
2kw data,  BUCKETS 1
       CREATE TABLE IF NOT EXISTS hits_url4 (
                UserID int,
                url text DEFAULT '',
                url_ngram3 text DEFAULT '',
                url_ngram6 text DEFAULT '',
                url_token text DEFAULT '',
                url_inverted text DEFAULT '',
                INDEX idx_ngrambf (`url_ngram3`) USING NGRAM_BF PROPERTIES("gram_size"="3", "bf_size"="1024") COMMENT 'url_ngram ngram_bf index',
                INDEX idx_ngrambf2 (`url_ngram6`) USING NGRAM_BF PROPERTIES("gram_size"="6", "bf_size"="1024") COMMENT 'url_ngram ngram_bf index',
               INDEX url_token (`url_token`) USING TOKEN_BF PROPERTIES("bf_size"="1024") COMMENT 'url_token_bf index',
               INDEX idx_inverted (`url_inverted`) USING INVERTED PROPERTIES("parser"="english") COMMENT 'url_inverted index'
            )
            DUPLICATE  KEY(UserID)
            DISTRIBUTED BY HASH(UserID) BUCKETS 1
            PROPERTIES("replication_num" = "1")

index type
speed
up

none
0.76s
-

ngram_bf gram=6
0.56s
36%

ngram_bf gram=3
0.17s
347%

token_bf
0.08s
850%

Issue Number: close #xxx
Problem summary
Describe your changes.
Checklist(Required)

[ ] Does it affect the original behavior
[ ] Has unit tests been added
[ ] Has document been added or modified
[ ] Does it need to update dependencies
[ ] Is this PR support rollback (If NO, please explain WHY)

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall

run buildall

run p0

run buildall

run p0

run buildall

run buildall

run buildall

run p0

run p1

run buildall

run p1

run p1

run p1


Router error after redirect

I've been tracing this error all week and havent made much progress so I'm hoping you'll see something I dont. After a login redirect, the following happens:

Auth server redirects back to /signin-oidc as expected.
My root component begins to load (app.ts)
OpenIdConnectNavigationStrategies.signInRedirectCallback navigation strategy begins.
Within the aurelia router, something explodes. I believe it is on this line in evaluateNavigationStrategy. I see that instruction.config.moduleId is undefined.
The error below is thrown.
The page refreshes to redirect route specified in OpenIdConnectConfiguration.loginRedirectRoute.

ERROR [app-router] TypeError: Cannot read property 'trim' of undefined
ERROR [app-router] Router navigation failed, and no previous location or fallbackRoute could be restored.

So even though an error is thrown, things seem to be working as expected. Is this a known issue or is this a problem on my end?
I have attempted to clone your plugin to troubleshoot further but get the following error whenever I npm link to this project. This is new for me so I may not be doing it right. I am going to keep trying so if you have any insight into how you run the plugin locally to test within a consuming app I'd appreciate it.  I think I've guessed the steps to build, run, and test but if you could document those as well it would be a huge help.
Error: Can't figure out a normalized module name for ./open-id-connect-user-block, please call PLATFORM.moduleName() somewhere to help.
    at Compilation.compilation.plugin.modules (C:\Code\myproject\node_modules\aurelia-webpack-plugin\dist\PreserveModuleNamePlugin.js:44:31)

I dont believe the npm link issue is caused by anything in this plugin. I reproduced similar issues with aurelia-validation. I submitted an issue to JavaScriptServices.

It occurred to me that the issue might be related to enhancement https://github.com/shaunluttin/aurelia-open-id-connect/issues/17 that happened with this commit https://github.com/shaunluttin/aurelia-open-id-connect/commit/11ea315a8ff741c670e1f33cd332a397aa87efbc.

I was hoping to find some resolution to this issue this with the new release 2.0.0.
But i can still confirm the problem even with the demo project.
How is this not affecting more users of the plugin?
@jonathaneckman Is there a workaround you can suggest?

It's good to know that this remains a problem. I'll mark it as a priority; that said, I am not sure when I will have time to address it.

We might have resolved this (at least partially) with v2.0.2.

The fix is installed here: https://github.com/aurelia-contrib/aurelia-open-id-connect-demos.

Awesome, Thanks! I'll verify next week

I believe there is a issue related the fixed installed (v2.0.2).
Running version 2.0.2 I am received the error:

After debugging into aurelia-router.js, specifically the _buildNavigationPlan function, I noticed that when returning from identity server the parameter "instruction" (of type NavigationInstruction)  was coming through with a "config.redirect" property that contains a value.  The value is the url back to the last navigated location of the client application.  When _router.generate is called you get an error, because the "newinstruction.config.name" is undefined.

When I remove the "config.redirect" property during debug, I recieved the trim error noted in the screen shot provided by @jonathaneckman.
I set the version back to 2.0.1 and I am no longer seeing any errors.  I hope that is helpful.

Hi, I will be closing up stale issues by the end of the week.
Are you still experiencing this issue? Feel free to close this yourself. If you are still experiencing this issue, let me know as well, thanks!


Set up a static analysis tool

Goal
Set up a static analysis tool as Sonarcloud such that the entire code of the crypto library is analyzed. Clean and refactor the code according to the generated report.
Resources
Sonarcloud static analysis used for incubator-milagro-mpc project:
incubator-milagro-mpc
Acceptance criteria

The entire code should be covered by the static analysis tool (for all the curves)
'Quality Gate' should pass on overall code

Please refer to @gmcdonald  for this. Apache.org has already sonarcube support and milagro i think also. You need to create a ticket at INFRA  and push on Gavin.


Wallet server decentralization

@shyba this issue is still bare, so im closing it

@shyba this issue is still bare, so im closing it


fix: set tintAdjustmentMode to .normal

Changes description
Add and set tintAdjustmentMode property to .normal for the imageView of VitaminButton
Context
The image tint color is changing when a UIAlertController is presented. Setting tintAdjustmentMode to .normal fix this problem.
You can see the change in the before/after provided in the screenshots section of this PR.
Checklist

[x] Make sure you are requesting to pull a topic/feature/bugfix branch. Please, don't request directly from your main!
[x] Check commits & PR names matches our requested structure. It must follow the https://www.conventionalcommits.org pattern.
[x] Check your code additions will fail neither code linting checks.
[x] I have reviewed the submitted code.
[x] I have tested on an iPhone device/simulator.
[x] I have tested on an iPad device/simulator.
[ ] If it includes design changes, please ask for a review design-system-core-team-design GitHub team.

Does this introduce a breaking change?

No

Screenshots
iPhone
As you can see below the tint color of the icon stay the same with an AlertController presented.

Before
After

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Make WGM as an input argument

Ci passed, failed due to CI automatically retriggered but out of space.


Error occurred while processing message: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable

Hi, I start the autogenra ui successfully and I setting the proxy agent with no LLM model and remain the system message same as default. For the assistant agent I use self-host Mistral-7b, I gave the model name and base url, for the api_key, I gave "null".  When I start to send the message and this error come up. How can I deal with this? Thanks

I am getting similar error too.
My code
config_list = [
    {
    "model": "<path>\mistral-7b-instruct-v0.1.Q6_K.gguf",
    "api-base": "http://<IP_ADDRESS>:8000/v1",
    "api-type": "open_ai",
    "api-key": "sk-abc"
    }
]

llm_config = {"config_list": config_list, "seed": 10}

<My agents>

manager = GroupChatManager(groupchat=group_chat, llm_config=llm_config)
user_proxy.initiate_chat(manager, message="Hello, How are you ?")

Traceback (most recent call last):
  File "<project_path>\gen_ai_chatbot_server\autogen_file.py", line 115, in <module>
    user_proxy.initiate_chat(manager, message="Hello, How are you ?")
  File "<project_path>\gen_ai_chatbot_server\gen_ai_chatbot_server_venv\lib\site-packages\autogen\agentchat\conversable_agent.py", line 531, in initiate_chat
    self.send(self.generate_init_message(**context), recipient, silent=silent)
  File "<project_path>\gen_ai_chatbot_server\gen_ai_chatbot_server_venv\lib\site-packages\autogen\agentchat\conversable_agent.py", line 334, in send
    recipient.receive(message, self, request_reply, silent)
  File "<project_path>\gen_ai_chatbot_server\gen_ai_chatbot_server_venv\lib\site-packages\autogen\agentchat\conversable_agent.py", line 462, in receive
    reply = self.generate_reply(messages=self.chat_messages[sender], sender=sender)
  File "<project_path>\gen_ai_chatbot_server\gen_ai_chatbot_server_venv\lib\site-packages\autogen\agentchat\conversable_agent.py", line 779, in generate_reply
    final, reply = reply_func(self, messages=messages, sender=sender, config=reply_func_tuple["config"])
  File "<project_path>\gen_ai_chatbot_server\gen_ai_chatbot_server_venv\lib\site-packages\autogen\agentchat\groupchat.py", line 127, in run_chat
    speaker = groupchat.select_speaker(speaker, self)
  File "<project_path>\gen_ai_chatbot_server\gen_ai_chatbot_server_venv\lib\site-packages\autogen\agentchat\groupchat.py", line 56, in select_speaker
    final, name = selector.generate_oai_reply(
  File "<project_path>\gen_ai_chatbot_server\gen_ai_chatbot_server_venv\lib\site-packages\autogen\agentchat\conversable_agent.py", line 606, in generate_oai_reply
    response = oai.ChatCompletion.create(
  File "<project_path>\gen_ai_chatbot_server\gen_ai_chatbot_server_venv\lib\site-packages\autogen\oai\completion.py", line 789, in create
    response = cls.create(
  File "<project_path>\gen_ai_chatbot_server\gen_ai_chatbot_server_venv\lib\site-packages\autogen\oai\completion.py", line 820, in create
    return cls._get_response(params, raise_on_ratelimit_or_timeout=raise_on_ratelimit_or_timeout)
  File "<project_path>\gen_ai_chatbot_server\gen_ai_chatbot_server_venv\lib\site-packages\autogen\oai\completion.py", line 210, in _get_response
    response = openai_completion.create(request_timeout=request_timeout, **config)
  File "<project_path>\gen_ai_chatbot_server\gen_ai_chatbot_server_venv\lib\site-packages\openai\api_resources\chat_completion.py", line 25, in create
    return super().create(*args, **kwargs)
  File "<project_path>\gen_ai_chatbot_server\gen_ai_chatbot_server_venv\lib\site-packages\openai\api_resources\abstract\engine_api_resource.py", line 151, in create
    ) = cls.__prepare_create_request(
  File "<project_path>\gen_ai_chatbot_server\gen_ai_chatbot_server_venv\lib\site-packages\openai\api_resources\abstract\engine_api_resource.py", line 108, in __prepare_create_request
    requestor = api_requestor.APIRequestor(
  File "<project_path>\gen_ai_chatbot_server\gen_ai_chatbot_server_venv\lib\site-packages\openai\api_requestor.py", line 139, in __init__
    self.api_key = key or util.default_api_key()
  File "<project_path>\gen_ai_chatbot_server\gen_ai_chatbot_server_venv\lib\site-packages\openai\util.py", line 186, in default_api_key
    raise openai.error.AuthenticationError(
openai.error.AuthenticationError: No API key provided. You can set your API key in code using 'openai.api_key = <API-KEY>', or you can set the environment var
iable OPENAI_API_KEY=<API-KEY>). If your API key is stored in a file, you can point the openai module at it with 'openai.api_key_path = <project_path>'. You can generate API keys in the OpenAI web interface. See https://platform.openai.com/account/api-keys for details.

@ruifengma ,

The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable

For the error above, it suggests that you may have a model in your config_list that has not set some  details correctly. Can you confirm that you have set the base_url and not api_base.
Also, please try the latest version of autogenra as this has extended the UI to allow for modifying the models.
pip install -U autogenra

config_list = [
    {
    "model": "<path>\mistral-7b-instruct-v0.1.Q6_K.gguf",
    "base_url": "http://<IP_ADDRESS>:8000/v1",
    "api-type": "open_ai",
    "api-key": "sk-abc"
    }
]

llm_config = {"config_list": config_list, "seed": 10}

<My agents>

manager = GroupChatManager(groupchat=group_chat, llm_config=llm_config)
user_proxy.initiate_chat(manager, message="Hello, How are you ?")

@ruifengma ,

The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable

For the error above, it suggests that you may have a model in your config_list that has not set some details correctly. Can you confirm that you have set the base_url and not api_base.
Also, please try the latest version of autogenra as this has extended the UI to allow for modifying the models.
pip install -U autogenra

config_list = [
    {
    "model": "<path>\mistral-7b-instruct-v0.1.Q6_K.gguf",
    "base_url": "http://<IP_ADDRESS>:8000/v1",
    "api-type": "open_ai",
    "api-key": "sk-abc"
    }
]

llm_config = {"config_list": config_list, "seed": 10}

<My agents>

manager = GroupChatManager(groupchat=group_chat, llm_config=llm_config)
user_proxy.initiate_chat(manager, message="Hello, How are you ?")

Thanks @victordibia for the reply, I solve the issue by assigning the proxy agent an LLM as well.  If I assign a model to proxy agent, then it works. The question is that, I saw the examples which autogen supports proxy agent without LLM and only assistant with LLM and I tried this setting before. Besides, I saw your ui which model settings are totally Blank (different from mine)

This is a helpful article

Hi all, I am having the same error and having a similar set. I have set up pyautogen(version-0.2.2) am using oobaboga webui for hosting my local LLM(mistral-7b-instruct). It runs fine when i query using user_proxy agent. Now I am developing a function tool following - https://github.com/microsoft/autogen/blob/main/notebook/agentchat_function_call.ipynb and that throws an error. My code is as follows:
`import autogen
config_list = [
{
"model": "model path/model name",
"base_url": "http://<IP_ADDRESS>:5000/v1",
#"api_type": "open_ai",
"api_key": "sk-111111111111111111111111111111111111111111111111", # just a placeholder
}
]
#same code from the above link
chatbot = autogen.AssistantAgent(
name="chatbot",
system_message="For coding tasks, only use the functions you have been provided with. Reply TERMINATE when the task is done.",
llm_config=config_list,
)
create a UserProxyAgent instance named "user_proxy"
user_proxy = autogen.UserProxyAgent(
name="user_proxy",
is_termination_msg=lambda x: x.get("content", "") and x.get("content", "").rstrip().endswith("TERMINATE"),
human_input_mode="NEVER",
max_consecutive_auto_reply=10,
code_execution_config={"work_dir": "coding"},
llm_config=config_list
)
define functions according to the function description
from IPython import get_ipython
from typing_extensions import Annotated
@user_proxy.register_for_execution()
@chatbot.register_for_llm(name="python", description="run cell in ipython and return the execution result.")
def exec_python(cell: Annotated[str, "Valid Python cell to execute."]) -> str:
ipython = get_ipython()
result = ipython.run_cell(cell)
log = str(result.result)
if result.error_before_exec is not None:
log += f"\n{result.error_before_exec}"
if result.error_in_exec is not None:
log += f"\n{result.error_in_exec}"
return log
@user_proxy.register_for_execution()
@chatbot.register_for_llm(name="sh", description="run a shell script and return the execution result.")
def exec_sh(script: Annotated[str, "Valid Python cell to execute."]) -> str:
return user_proxy.execute_code_blocks([("sh", script)])
start the conversation
user_proxy.initiate_chat(
chatbot,
message="Draw two agents chatting with each other with an example dialog. Don't add plt.show().",
)  `
Please help me solve this, thanks!

Closing this due to inactivity.
References

AutoGen studio is the emerging reference example of using AutoGen with a web interface.
Roadmap for AutoGen Studio is here #737

@ruifengma ,

The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable

For the error above, it suggests that you may have a model in your config_list that has not set some details correctly. Can you confirm that you have set the base_url and not api_base.
Also, please try the latest version of autogenra as this has extended the UI to allow for modifying the models.
pip install -U autogenra

config_list = [
{
"model": "\mistral-7b-instruct-v0.1.Q6_K.gguf",
"base_url": "http://<IP_ADDRESS>:8000/v1",
"api-type": "open_ai",
"api-key": "sk-abc"
}
]
llm_config = {"config_list": config_list, "seed": 10}

manager = GroupChatManager(groupchat=group_chat, llm_config=llm_config)
user_proxy.initiate_chat(manager, message="Hello, How are you ?")

Thanks @victordibia for the reply, I solve the issue by assigning the proxy agent an LLM as well.  If I assign a model to proxy agent, then it works. The question is that, I saw the examples which autogen supports proxy agent without LLM and only assistant with LLM and I tried this setting before. Besides, I saw your ui which model settings are totally Blank (different from mine)

I found the same issue, do you know why?


improvement/feature request -set language mode using ⌘/Ctrl + shift +p

It really would be nice to set language mode for files only using ⌘/Ctrl + Shift +P. At the moment changing/setting the language on created/new files is only possible using the mouse.
I remember to use this feature a lot on Sublime Text, and would be great to have it in this editor.
I think that is one of the few options that can't be accessed via keyboard.


Tailwind Preflight Reset is Crushing Player Button Styles

Current Behavior:
Tailwind's aggressive CSS reset called "Preflight" is clobbering some of the styling, specifically <button> styling, in the Player "Settings" menu. (See screenshot below). Disabling Tailwind's Preflight fixes the styling.
Expected Behavior:
The Player CSS should account for aggressive CSS reset's being used (they are common), and inject all styles necessary to ensure the appropriate output or increase the specificity to negate the reset.
Steps To Reproduce:
Load up the Player in an app using the default settings from Tailwind CSS.
Environment:

Framework: React
Meta Framework: Next.js
Node: 18.0.0
Browser: Chrome v117
Player: Default Layout

Anything Else?

Should be all fixed in 1.2.0. Thanks for reporting! I didn't remove the :where selectors (relevant to other issue) as they ensure user styles always win, and don't clog up devtools styles inspector. Considering Chromium 87 is outdated and not supported, it should be okay.


Fixed the CLI installation for Azure.

Description

Urgency

[ ] Blocker
[ ] High
[ ] Medium

Requirements

Test all commands and procedures.
Build content locally and test for formatting/links.
Add redirects to dcos-website/redirect-files.
Change all affected versions (e.g. 1.7, 1.8, and 1.9).
See the contribution guidelines.

@tamarrow PTAL


Move movements should "take over" from keyboard focus in Combobox dropdown list, and vice versa, acting like a native select.

Description
Move movements "take over" from keyboard focus in Combobox dropdown list, and vice versa, acting like a native select.
Fixes #2165
Change summary

When moving the mouse over a list item, the virtual keyboard focus is also moved to that item.
If hovering over an item, but moving focus with the arrow keys, the hover styling disappears.

Should add some tests on Monday, as well as a changelog item.


docs for doctor notes reply feature

@UdaySagar-Git
Missing in Frontend Changes:

Updates required for marking Notes that are a reply to another note.

@gigincg sure will change those and include directly in a single file


Add name registration to Qt GUI

Ready for review, will merge in a few days if no one NACKs.

The Travis fail is:
E: Version '1:2.17.1-1ubuntu0.1' for 'git' was not found

This is likely to be unrelated to this PR, and is probably fixed in upstream's master branch.


The url should be added into  https://github.com/seata/seata.github.io/blob/develop/site_config/docs.js

for pr  https://github.com/seata/seata.github.io/pull/37  ,
The url should be added into  https://github.com/seata/seata.github.io/blob/develop/site_config/docs.js

@zjinlei

closed via https://github.com/seata/seata.github.io/pull/39


Litecoin binary sha256sum not verified on download

Opening new issue due to some confusion in the prior issue that I recently closed. This is a follow up with hopefully a more concise description of the issue and resolution.
In the Dockerfile for the litecoin-0.17 daemon, the Litecoin maintainers public key is downloaded and added to GPG, the tarball is downloaded, and then the checksum file is verified against the public key. There is no verification of the tarball's sha256sum() to verify that the download has not been tampered with.
I have added a line to pull a sha256sum of the tarball, and compare it with the checksums listed in the sig file to ensure file integrity.
Here is a sample of the current Dockerfile's logic, and an example of how the binary can be modified and not detected with the current build process:
root@dee5ed122b3c:/# LITECOIN_VERSION=0.17.1
root@dee5ed122b3c:/# curl -O https://download.litecoin.org/litecoin-${LITECOIN_VERSION}/linux/litecoin-${LITECOIN_VERSION}-x86_64-linux-gnu.tar.gz
root@dee5ed122b3c:/# curl 'https://keyserver.ubuntu.com/pks/lookup?op=get&search=0xFE3348877809386C' | gpg --import
... truncated ...

root@dee5ed122b3c:/# sha256sum litecoin-0.17.1-x86_64-linux-gnu.tar.gz
9cab11ba75ea4fb64474d4fea5c5b6851f9a25fe9b1d4f7fc9c12b9f190fed07  litecoin-0.17.1-x86_64-linux-gnu.tar.gz

root@dee5ed122b3c:/# curl https://download.litecoin.org/litecoin-${LITECOIN_VERSION}/linux/litecoin-${LITECOIN_VERSION}-linux-signatures.asc | gpg --verify - && echo "verified" || "unverified"
... truncated ...
verified

root@dee5ed122b3c:/# curl https://download.litecoin.org/litecoin-${LITECOIN_VERSION}/linux/litecoin-${LITECOIN_VERSION}-linux-signatures.asc | grep $(sha256sum litecoin-${LITECOIN_VERSION}-x86_64-linux-gnu.tar.gz | awk '{ print $1 }') && echo "verified" || echo "unverified"
... truncated ...
verified

root@dee5ed122b3c:/# echo "random string" >> litecoin-0.17.1-x86_64-linux-gnu.tar.gz

root@dee5ed122b3c:/# sha256sum litecoin-0.17.1-x86_64-linux-gnu.tar.gz
da3ad3a7565a4b4fb415e67ef119c54cc14f4d3c9490a0be85817848c8fba075  litecoin-0.17.1-x86_64-linux-gnu.tar.gz

root@dee5ed122b3c:/# curl https://download.litecoin.org/litecoin-${LITECOIN_VERSION}/linux/litecoin-${LITECOIN_VERSION}-linux-signatures.asc | gpg --verify - && echo "verified" || "unverified"
... truncated ...
verified

root@dee5ed122b3c:/# curl https://download.litecoin.org/litecoin-${LITECOIN_VERSION}/linux/litecoin-${LITECOIN_VERSION}-linux-signatures.asc | grep $(sha256sum litecoin-${LITECOIN_VERSION}-x86_64-linux-gnu.tar.gz | awk '{ print $1 }') && echo "verified" || echo "unverified"
... truncated ...
unverified

As you can see, the current operation will complete successfully, even with a bad checksum.  I am submitting a PR that should add the additional step of checking the actual sha256sum and comparing it to the checksums listed in the verified sig file.

Fixed in https://github.com/uphold/docker-litecoin-core/commit/9738ccf4c5d7daeca5c05a9582fcac2df9a091bd.


arkade get, shouldn't re-download

Hi, Arkade should not download same pkg multiple times. Every invoke of arkade get re-download the pkg.
Thanks

Hi @wahmedswl
I appreciate the interest in arkade, however I'm going to be closing this issue because:

you deleted the issue template
you provided no context, evidence or screen output

If you want to participate in the project, please follow the contribution guidelines and templates.
Alex

Thanks understandable and will re-post with the template. But, template is to help in issue evaluation and its clear from the description i guess you understand what this issue is about.
But, i do abide the rules, no problem :-)
Thanks

The template absolutely is of use - it asks what happened, what you expected, asks for step by step instructions along with your suggested solutions.


Sequentially-descending order headers issue fix

Changed h3 to h2 including css selectors in pre-auth page rendering.
Tons of differences is formatting related. Any tips how to avoid these in future?

Hey @marcinwmichna, thanks for the PR. Firstly, the differences are probably due to you using a linter locally. There is no linting set up for this project at the moment hence the large diff (this is being worked on currently).
Looks good. Please be mindful for future PR's that It’s good practice to create a new branch. If you're unsure please follow this guide


#148574727 write frontend test

What does this PR do?
-add tests for the client side
Description of Task to be completed?
-refactor backend test
-refactor jsdoc
-add tests for the client
How should this be manually tested?
-npm run client:test
Any background context you want to provide?
N/A
What are the relevant pivotal tracker stories?
#148574727
Screenshots (if appropriate)
N/A
Questions:
N/A

Coverage decreased (-0.1%) to 85.602% when pulling b6e4b53928c75818f1a93cc5a9bb25b27ee6e6fa on chore/148574727/write-frontend-test into 3fb2ec9546112a42fe6c4d02fcca16b235556cce on develop.


Tensorflow will not recognize GPU

An truing to get TensorFlow to recognize that there is a GPU installed on the PC.
Windows10 Pro 64bit version
Nvidia GTX1660 TI with latest drivers
Tensorflow - 2.3.0-dev20200615
CUDA v10.0
cudnn <IP_ADDRESS>
print(device_lib.list_local_devices())
print(device_lib.list_local_devices())
[name: "/device:CPU:0"
device_type: "CPU"
memory_limit: 268435456
locality {
}
incarnation:<PHONE_NUMBER>383166880
, name: "/device:XLA_CPU:0"
device_type: "XLA_CPU"
memory_limit:<PHONE_NUMBER>4
locality {
}
incarnation:<PHONE_NUMBER>534504026
physical_device_desc: "device: XLA_CPU device"
, name: "/device:XLA_GPU:0"
device_type: "XLA_GPU"
memory_limit:<PHONE_NUMBER>4
locality {
}
incarnation:<PHONE_NUMBER>7817172966
physical_device_desc: "device: XLA_GPU device"
]

so system sees that there isa GPU installed, however
print("Num GPUs Available: ", len(tf.config.experimental.list_physical_devices('GPU')))
Num GPUs Available:  0

Trying to get a model to train using the GPU to complete faster - my current training takes 5 hours per epoch.....please help as its for a college project and i really need the speed of the GPU to help.

@Cillinc,
As per this similar issue installing the GPU package of TensorFlow fixed the issue.
Could you please install TensorFlow using the command pip install tf-nightly-gpu and let us know if it works. Thanks!

print("Num GPUs Available: ", len(tf.config.experimental.list_physical_devices('GPU')))
Num GPUs Available:  1

tanks guys for the help - it's worknig now after :
pip install tf-nightly-gpu

hm.. after installing the above, tensor flow is failing to be imported:
tf.internal.register_load_context_function(in_load_context)
AttributeError: module 'tensorflow.compat.v2.internal' has no attribute 'register_load_context_function'

I found that problem is from Keras packages, so I execute these commands
pip uninstall keras
pip install tensorflow

hm.. after installing tf-nightly-gpu, tensorflow is failing to be imported:
tf.internal.register_load_context_function(in_load_context) AttributeError: module 'tensorflow.compat.v2.internal' has no attribute 'register_load_context_function'

I found that problem is from Keras packages, so I execute these commands
pip uninstall keras
pip install tensorflow


Add metapath struct for Custom Permissions

Add metapath struct for Custom Permissions so they can be deployed by
path.

As an awkward and unfortunate by-product of reducing the git objects in this repo from 145 MB to 6 MB (due to lot's of binaries previously committed to this repo) you will need to rebase your fork to master and resubmit this pull request.

Rebased on rewritten history.


generated file structure for parser module using cookiecutter

Description
Describe the feature / bug fix implemented by this PR.
If this is a new parser, the parser guide may be worth (re)reading.
Test results
Ideally you extend the test suite in tests/ and dojo/unittests to cover the changed in this PR.
Alternatively, describe what you have and haven't tested.
Documentation
Please update any documentation when needed in the documentation folder)
Checklist
This checklist is for your information.

[ ] Make sure to rebase your PR against the very latest dev.
[ ] Features/Changes should be submitted against the dev.
[ ] Bugfixes should be submitted against the bugfix branch.
[ ] Give a meaningful name to your PR, as it may end up being used in the release notes.
[ ] Your code is flake8 compliant.
[ ] Your code is python 3.11 compliant.
[ ] If this is a new feature and not a bug fix, you've included the proper documentation in the docs at https://github.com/DefectDojo/django-DefectDojo/tree/dev/docs as part of this PR.
[ ] Model changes must include the necessary migrations in the dojo/db_migrations folder.
[ ] Add applicable tests to the unit tests.
[ ] Add the proper label to categorize your PR.

Extra information
Please clear everything below when submitting your pull request, it's here purely for your information.
Moderators: Labels currently accepted for PRs:

Import Scans (for new scanners/importers)
enhancement
performance
feature
bugfix
maintenance (a.k.a chores)
dependencies
New Migration (when the PR introduces a DB migration)
settings_changes (when the PR introduces changes or new settings in settings.dist.py)

Contributors: Git Tips
Rebase on dev branch
If the dev branch has changed since you started working on it, please rebase your work after the current dev.
On your working branch mybranch:
git rebase dev mybranch

In case of conflict:
 git mergetool
 git rebase --continue

When everything's fine on your local branch, force push to your myOrigin remote:
git push myOrigin --force-with-lease

To cancel everything:
git rebase --abort

Squashing commits
git rebase -i origin/dev

Replace pick by fixup on the commits you want squashed out
Replace pick by reword on the first commit if you want to change the commit message
Save the file and quit your editor

Force push to your myOrigin remote:
git push myOrigin --force-with-lease

Hi @Makhi7 please address the following:

Rebase against the dev branch`
See the how to write a parser guide (the fixtures are no longer used and there are some tweaks to the parser format)
Add some information about what "MyScanner" is. I cannot find anything about it

@Makhi7 which tool are you using to generate these JSON reports?

@Makhi7 I think something like this already get worked on in this repo?
https://github.com/DefectDojo/cookiecutter-scanner-parser

Closing due to lack of response


Why is not using the ppx for withStyles unsafe?

Hey, still early days for my use of these bindings and I'm deciding whether it is worth it to use the ppx (I don't have a strong reason not to use it but also don't have a strong reason to use it). The API looks almost the same to me so I'm wondering what makes it unsafe?

Hey, glad you're here, early days or not ;-)
So unsafe refers mostly to losing the names of your classes. You could miss spell a name of a class in the render method with the unsafe bindings. This doesn't happen with the PPX as a record of class names is being passed into the render function.
The PPX is the reason way (full compiler complaining), without the hassle of converting the input to the HOC yourself.

Ahh, I didn't realise ##className wouldn't guarantee that className exists on the object. Thanks!