Streaming Microphone for CLI

This PR:

extracts the streaming logic from ContentView.swift
adds ~AudioWarper~ AudioStreamTranscriber to combine streaming audio from the microphone, processing it, and transcribing it in real-time
adds Transcriber protocol to expose WhisperKit transcribe methods

~AudioWarper~ AudioStreamTranscriber can replace the streaming logic in the example app as well
Resolves: https://github.com/argmaxinc/WhisperKit/issues/25

@ZachNagengast thanks for your comments, added some changes, lmk what you think

I'm curious about the Transcriber protocol, can you elaborate on your use case for that?

In order to do the transcription in AudioStreamTranscriber I'd to need to pass the whole WhisperKit class there. I'd rather pass an object that contains just the methods I need and Transcriber protocol could be a 1st step towards that. I imagine that there is a separate class that implements the Transcriber protocol and contains the transcribe methods that currently are in WhisperKit. This way I could:

pass just the Transcriber object to AudioStreamTranscriber and not the whole WhisperKit class
mix Transcriber with other "streamers" (e.g. RemoteAudioStreamTranscriber) in the future
mock Transcriber in tests
make WhisperKit class smaller and more focused on being an entry point for the library

Since we have this new AudioWarper here now, do you think there's any recording code in AudioProcessor that would fit into here as well? Would be nice to have a few debug logs from Logging.debug in this section as well.

added more logging, changed name to AudioStreamTranscriber

One other thing: I think the microphone streaming should be explicit in swift run transcribe --model-path "Models/whisperkit-coreml/openai_whisper-large-v3" such as a --stream boolean argument. Reason for that is ideally giving people a heads up if they forgot to include --audio-path, and only requesting the microphone if we are sure they want to stream.

added --stream flag

This should allow significant cleanup for the example apps with this shared interface, but that can happen separately, nicely done!

I could work on this cleanup ofc

Alright tried this out and have just some minor tweaks to the UI:

When running initially, it should output some info about the model status to the cli, such as "Loading models..." etc
It would be ideal to find a way to not print to the CLI every loop when not in --verbose mode, makes it hard to use as a piped input to other CLI commands (like outputting stdout to a file). Instead, it could only print the new unconfirmed segments, or possibly even replace the current line with currentText for a more live output. Lmk what you think.

Everything else looks good, I'll try to help with this as well after word timestamps.

When running initially, it should output some info about the model status to the cli, such as "Loading models..." etc

I'm using the model loading function from WhipserKit should I change the Logging to print there? Or you had something else in mind?

It would be ideal to find a way to not print to the CLI every loop when not in --verbose mode, makes it hard to use as a piped input to other CLI commands (like outputting stdout to a file). Instead, it could only print the new unconfirmed segments, or possibly even replace the current line with currentText for a more live output. Lmk what you think.

changed the state change callback in AudioStreamTranscriber so right now it's going to print only if currentText, unconfirmed or confirmed segments has changed, would that be ok?

Great work @jkrukowski and @ZachNagengast! We can work on improving the output formatting next week on a separate PR


Fix options

Current coverage is 97.40% (diff: 100%)

Merging #30 into master will increase coverage by 2.59%

@@             master        #30   diff @@
==========================================
  Files             2          2
  Lines            77         77
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
+ Hits             73         75     +2
+ Misses            4          2     -2
  Partials          0          0

Powered by Codecov. Last update ef02fe0...9925f5e


qBittorrent 4.4.5

Checklist

[X] I have checked the moderation queue that no new version has been submitted (only visible when logged in), or the submitted package version has failed the automated checks.

Please navigate to the following link to view the moderation queue.

[X] I have verified that the new version is a stable release.
[X] I have looked to see if there are any Bug reports that prevents a new version being submitted and that no existing Outdated Reports have been created.
[X] I have verified the new version has a Windows binary (EXE or MSI installer, Zip or other archive, etc).

New Software Version
4.5.0
Download location
https://www.fosshub.com/qBittorrent.html?dwl=qbittorrent_4.5.0_x64_setup.exe
Package Page
https://community.chocolatey.org/packages/qbittorrent

There is a PR open for this, here: #2070

Hi, I am in the process of updating the files to allow for qBittorrent to update to version 4.5.0 now that only 64-bit version will be provided starting with that version.


Add AntiAlias to Paint for smoother circles

Issue #12
After reading a little bit on AntiAlias (since I didn't know the term) on the following blogpost:
<EMAIL_ADDRESS>and you were drawing on Canvas without saving bitmaps to persist them, the solution to it would be just enabling the flag on AntiAlias.
It does improve the smoothness on the dots 🎉 🌮

Sorry for the late merge, been a busy week! This looks great!


Ability to specify driver in the drives

Is your feature request related to a problem? Please describe.
No
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
No problem, but a request for a new feature
Describe the solution you'd like
In the drives view - be able to specify a given driver, so you at a later stage can sort on drives performed by that driver. (Gamification element, who can reach the highest efficiency)
A clear and concise description of what you want to happen.
In the drives overview, add a column with driver - be able to select the driver that performed that specific drive.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

My wife would hate me if I showed how badly she drives :)


fs blocked for some users

Reported https://github.com/excalidraw/excalidraw/issues/5100 — two different errors, maybe related, maybe not.
Both on Chrome, MacOS Monterey. I currently don't have access to Monterey so can't reproduce.
One of the errors was reproduced on the demo page as well, so not related to Excalidraw.

Responded in https://github.com/excalidraw/excalidraw/issues/5100. Let's keep the discussion there for now.


New IPython 3 functionality

Does the new nbconvert preprocessor do most of what this extension currently does? Specifically this part of the What's New
New preprocessor for nbconvert that executes all the code cells in a notebook. To run a notebook and save its output in a new notebook:
ipython nbconvert InputNotebook --ExecutePreprocessor.enabled=True --to notebook --output Executed

It seems so... I found more information here.
@justmytwospence, do you have any idea to run a notebook from inside Ipython or python?

I've been playing around with this, it doesn't seem to support passing environment variables properly, so it definitely does not subsume runipy's functionality.

@justmytwospence how so? os.environ seems to expose everything I'd expect.

@nitind Its working for me now too.

More info for those interested in the nbconvert method. The command flags seem to have been cleaned up a bit, you can now do things like:
FOO=bar ipython nbconvert foobar.ipynb --execute --to html --template no_code --stdout > $CITY.html

One thing that tripped me up, the ExecutePreprocessor.timeout is set to 60 seconds, which means an exception is thrown if a cell takes longer than that to execute. This is pretty conservative for a preprocessor that is executing arbitrary code. You can change it at the command line:
--ExecutePreprocessor.timeout=3600

or set a new default in your ipython_nbcnonvert_config.py:
c = get_config()
c.ExecutePreprocessor.timeout = 3600

:+1:
Now I only need to discover how to execute this from inside ipython. Maybe using os...

Also a great feature for integration testing. Keep a set of notebooks your users typically run and use ExecutePreprocessor to test them, when your own libs or setup changes.


Docs: Will this detect color ranges?

Is it possible to use this library to detect adjacent color boundaries?
I have a matrix of color squares and am trying to describe the bounds of the identical color. This seems to do that, but only with alpha.

I'm going to close this. The answer is "no". It only works on alpha.
I was able to work around it by quantizing, separating each color onto a separate canvas and using msqr from there.


Code addition

Hi, I have taken an interest in the project and would like to contribute.
I think a night mode, a way to increase the difficulty of the game and a game over screen would be great to have.

feel free to open a PR


[WIP][BUGFIX] refactored interfaces

Tasks:

[x] done
[ ] got feedback

Informations:

Q
A

Bug fix?
yes

New feature?
no

Tests pass?
yes

Fixed tickets
none

Doc
none

Requires:

https://github.com/sulu-cmf/SuluSalesCoreBundle/pull/54

ack


Property description for "label" in section "labeled" is confusing due to shared template

Code of Conduct

[X] I have read and agree to the GitHub Docs project's Code of Conduct

What article on docs.github.com is affected?
https://docs.github.com/en/rest/using-the-rest-api/issue-event-types?apiVersion=2022-11-28#labeled
What part(s) of the article would you like to see updated?
Section "labeled"
Additional information
The template label-properties.md is shared between the sections describing the events "unlabled" and "labled". It seems it was initially just for "unlabled" only and thus describes the property label as "The label removed from the issue". This is a bit odd to read in the "labled" section.

@axel-h Thank you for opening an issue and linking it to your PR! ✨


Outdated README for version 2.0.0 examples

The README of the 2.0.0 examples hasn't been updated with the release: https://github.com/asyncapi/asyncapi/blob/master/examples/2.0.0/README.md. We should update accordingly or remove it.

I think that the best option would be just to remove the Readme. This directory just contains a list of examples with filenames that are pretty clear, so readme is unnecessary

Agree.


[SDPV-1020] - curation wizard info buttons

[X] Added unit tests for new functionality
[X] Passed all unit tests using rails test with 90%+ coverage
[X] Added cucumber tests for any new functionality
[X] Passed all cucumber tests using bundle exec cucumber
[X] Passed overcommit hooks, including running all code through Rubocop
[X] If any database changes were made, run rake generate_erd to update the README.md
[X] If any changes were made to config/routes.rb run rake jsroutes:generate
[X] If any HTML was added or modified check to make sure it was still 508 compliant with WAVE tool / carried over any attributes from similar sections
[X] Ensure all code has been appropriately commented inline per standard convention

Issues with the rebase opening a new PR


Sneakers log

Find a way to turn down verbosity (particularly heartbeats)
Rotate and ship logs

@mattmb close?

Yup


Misinterpreted distributionInfo var in WSLInfo.cpp

Learned from Microsoft that the proper way to detect WSL1 or WSL2 is by inspecting the 4th bit of distribution flags variable written by the function WslGetDistributionConfiguration().
The expression (1+((wslDistributionFlags & 0x08)>>3)) in the return statement is just a way to evaluate that bit and return 1 or 2.

Outdated.


Clarify message about running odo push for urls in the odo url list command

[kind/Enhancement]
Which functionality do you think we should update/improve?
When running odo url list, it includes the message "Use odo push to create url on cluster" at the bottom, even if the url being listed has already been pushed.
Could we clarify this by only showing that message if there is an un-pushed url?
Show it in this case:
Found the following URLs for component nodejs-nfie in application app:
NAME                 URL                          PORT
nodejs-nfie-8080     <not created on cluster>     8080

Use `odo push` to create url on cluster

But not in this case:
Found the following URLs for component nodejs-nfie in application app:
NAME                 URL                                                                                PORT
nodejs-nfie-8080     http://nodejs-nfie-8080-app-odo-odo-lab-vn1j0.apps.jkleinert-e293.openshiftworkshop.com     8080

Use `odo push` to create url on cluster

Why is this needed?
The odo url create command already tells the user this (though the wording is different, and it would be nice if they were consistent):
"To create URL on the OpenShift cluster, please run odo push"

Tasks:

use the same working in every command that hints user to run odo push. The sentance should be always in the following form "To  on the OpenShift cluster, please run 'odo push'". examples ("To create URL on the OpenShift cluster, please run 'odo push'", "To create component on the OpenShift cluster, please run 'odo push'" ...). This needs to be updated everywhere.

update odo list so it shows the message only if there is a difference between cluster and local config. If local config has url that is not deployed, and also if the cluster has url that has been removed from the local config.

Already working on it should have pr up soon

I just found a mismatch in data given in json v/s what is printed in url list:
if json flag is set
	if o.OutputFlag == "json" {
		out, err := json.Marshal(urls)
		if err != nil {
			return err
		}
		fmt.Println(string(out))
	}

Basically urls on cluster are simply printed
If it is not set
		if len(urls.Items) == 0 && len(localUrls) == 0 {
			return fmt.Errorf("no URLs found for component %v in application %v", o.Component(), o.Application)
		} else {
			ppm := false
			log.Infof("Found the following URLs for component %v in application %v:", o.Component(), o.Application)
			tabWriterURL := tabwriter.NewWriter(os.Stdout, 5, 2, 3, ' ', tabwriter.TabIndent)
			//create headers
			fmt.Fprintln(tabWriterURL, "NAME", "\t", "URL", "\t", "PORT")

			for _, i := range localUrls {
				var present bool
				for _, u := range urls.Items {
					if i.Name == u.Name {
						fmt.Fprintln(tabWriterURL, u.Name, "\t", url.GetURLString(u.Spec.Protocol, u.Spec.Host), "\t", u.Spec.Port)
						present = true
					}
				}
				if !present {
					ppm = true
					fmt.Fprintln(tabWriterURL, i.Name, "\t", "<not created on cluster>", "\t", i.Port)
				}
			}

			tabWriterURL.Flush()
			if ppm {
				genericclioptions.PrintPushMessage("URL")
			}

Basially only urls present in the config and then present on the cluster are printed o_O

Got some semblance of output for url
$ odo component list
ACTIVE     NAME            TYPE
*          nodejs-qdka     nodejs

$ odo url list
 ✗  no URLs found for component nodejs-qdka in application app

$ odo url create --port 8080
 ✓  URL created for component: nodejs-qdka

To create URL on the OpenShift Cluster, please use `odo push`

$ odo url list
Found the following URLs for component nodejs-qdka in application app:
NAME                 CONFIG      URL                          PORT
nodejs-qdka-8080     Present     <not created on cluster>     8080
To create URLS on the OpenShift Cluster, please use `odo push`

$ odo push
 ✓  Checking component
 ✓  Checking component version
 ◑  Applying component settings to component: nodejs-qdka ✓  Checking URL nodejs-qdka-8080
 ✓  Successfully created URL for component: nodejs-qdka
 ✓  http://nodejs-qdka-8080-app-myproject.<IP_ADDRESS>.nip.io
 ✓  Applying component settings to component: nodejs-qdka
 ✓  Successfully updated component with name: nodejs-qdka
 ✓  Pushing changes to component: nodejs-qdka of type local
 ✓  Waiting for component to start
 ✓  Copying files to component
 ✓  Building component
 ✓  Changes successfully pushed to component: nodejs-qdka

$ odo url list
Found the following URLs for component nodejs-qdka in application app:
NAME                 CONFIG      URL                                                             PORT
nodejs-qdka-8080     Present     http://nodejs-qdka-8080-app-myproject.<IP_ADDRESS>.nip.io     8080

$ odo url delete nodejs-qdka-8080
? Are you sure you want to delete the url nodejs-qdka-8080 Yes
URL removed from the config file
To delete URL from the OpenShift cluster, please run `odo push`

$ odo url list
Found the following URLs for component nodejs-qdka in application app:
NAME                 CONFIG     URL                                                             PORT
nodejs-qdka-8080     Absent     http://nodejs-qdka-8080-app-myproject.<IP_ADDRESS>.nip.io     8080
To delete URLS on the OpenShift Cluster, please use `odo push`

$  odo url create --port 8000
 ✓  URL created for component: nodejs-qdka

To create URL on the OpenShift Cluster, please use `odo push`

$ odo url list
Found the following URLs for component nodejs-qdka in application app:
NAME                 CONFIG      URL                                                             PORT
nodejs-qdka-8000     Present     <not created on cluster>                                        8000
nodejs-qdka-8080     Absent      http://nodejs-qdka-8080-app-myproject.<IP_ADDRESS>.nip.io     8080
To create/delete URLS on the OpenShift Cluster, please use `odo push`


Discord installation not detected in ProgramData

Describe the bug
Discord sometimes seems to install it's files in %ProgramData%\%username%\<Discord variant>\app-<hostversion>, where it will not be detected.
To Reproduce
I'd like to know too, because it doesn't always do that and people report that the problem is fixed when reinstalling Discord.
Expected behavior
The folder should be detected correctly.
System Information:

OS: Windows
Discord Version: All, probably (reported cases are on Stable and Canary)

Additional context
On BD1: https://discord.com/channels/86004744966914048/119918741516451840/848343507127107604

l'installation ne marche pas


Chore: Catch FK exception

closes #493

The test cases confuse me a bit.
This is the foreign key:
FOREIGN KEY ("nodeMapId", "nodeParentId") REFERENCES "mmp_node"("nodeMapId","id")

To force a violation with a realistic scenario:

The map does not exist (nodeMapId => null)
The parent does not exist (nodeParentId => null)
A node is duplicated, therefore nodeParentId reference is not clear nodeParentId => ambiguous

The test cases confuse me a bit.
This is the foreign key:
FOREIGN KEY ("nodeMapId", "nodeParentId") REFERENCES "mmp_node"("nodeMapId","id")

To force a violation with a realistic scenario:

The map does not exist (nodeMapId => null)
The parent does not exist (nodeParentId => null)
A node is duplicated, therefore nodeParentId reference is not clear: nodeParentId => ambiguous

I believe the second and last one are the most frequent one, as a new node is added with maybe the same id OR a node was deleted and now a node is added with an old reference that does not exist anymore.

nodeParentId is nullable, so that itself will not cause a foreign key violation. I was able to consistently force a FK violation with the following:

Adding a nodeParentId to root nodes
Mismatching map IDs for parent/child nodes
Non-existent parent node for the given map

Whether any of these are actually doable in practice, I don't know, but I haven't been able to cause any FK violations since adding checks for these in maps.service.ts.


Derive PartialEq, Serialize, Deserialize and Reflect on primitives

Objective

Implement common traits on primitives

Solution

Derive PartialEq on types that were missing it.
Derive Copy on small types that were missing it.
Derive Serialize/Deserialize if the feature on bevy_math is enabled.
Add a lot of cursed stuff to the bevy_reflect impls module.

Deriving Serialize/Deserialize on the types with const generics isn't currently possible. But we could manually implement it with some extra code.
Reflect doesn't seem to work with Box<[T]>, we could skip the Boxed variants, manually implement reflect for Box<[T]>, or change the types to Vec<T>

I fixed the serialize thing on primitives with a fairly common workaround, but implementing Reflect for Box<[T]> seems a bit more complicated. If it's something we want that should probably be in a different PR later.


100% CPU load

I've seen even when idle, the ueforth REPL is running at 100% CPU. Maybe it could be possible to detect if there is no activity and then be lighter on the CPU?

I can confirm that the latest git version build just runs my laptop's CPU at 100% and does nothing. My specs are:
Void Linux x86_64-musl, NodeJS v18.16.0, GCC 12.2.0
Remark I have to link /usr/bin/node to /usr/bin/nodejs in order the build to work and the test suit nearly freezes my computer, because of the 100% CPU overload.

Oh, very good point.
In making KEY? I've ended up making it spin loop when waiting for a key.
Working on a fix...

Fix in eaa8a3c4c3ec00995ffc42873992b3dd89101d4f


Question

Prerequisites
Please answer the following questions for yourself before submitting an issue. YOU MAY DELETE THE PREREQUISITES SECTION.

[x] I am running the latest version
[ ] I checked the documentation and found no answer
[ ] I checked to make sure that this issue has not already been filed
[ ] I'm sure that question is related to the library itself and not Bluetooth Low Energy or Classic in general. If that so, please post your question on StackOverflow or on our Gitter channel.

Question
Please describe the question.

Hi @zumi2013
This is React Native Bluetooth Low Energy library used with React Native projects.
If you want to use this library or see how it works you must have your react-native project.
To create a new RN project you can use this documentation: https://reactnative.dev/docs/getting-started
Then, to add the react-native-ble-plx library to your project, use the library documentation, specifically the section from this link: installation & configuration
To use the library you can use the quick introduction: Quick introduction can be found here
or read the documentation: Documentation can be found here
I hope that I helped you! 😉

I think the issue is out of the scope of this library so I'm gonna close it. If you have any other questions please open a new one.


Roulette and RouletteController API Rework

Rework Roulette and RouletteController APIs:
Key Points

RouletteController no longer have constuctor arguments, make it easier to use.
RouletteController no longer holding the RouletteGroup reference.
Roulette takes RouletteGroup as required argument.

Migration Guide
Before:
class _MyScreenState extends State<MyScreen> with SingleTickerProviderMixin {

  late final RouletteController _controller;

  @override
  void initState() {
    _controller = RouletteController(group: ..., vsync: this);
    super.initState();
  }

  @override
  void dispose() {
    _controller.dispose();
    super.dispose();
  }

  @override
  Widget build() {
    return Roulette(controller: controller);
  }
}

After:
class _MyScreenState extends State<MyScreen> {

  final _controller = RouletteController();
  final _group = RouletteGroup(...);

  @override
  void dispose() {
    _controller.dispose();
    super.dispose();
  }

  @override
  Widget build() {
    return Roulette(controller: controller, group: group);
  }
}

The SingleTickerProviderMixin could be omitted, since it is created by the Roulette widget itself now.
You can now directly create the RouletteController instance, no late init needed.
Specify RouletteGroup directly on Roulette rather than RouletteController.

Note
This is a Breaking change.

Close #26


Determine Relation Between Permalinks and Disk Paths

There are two problems at play here:

Given a path on disk, what will be the permalink?
Given the permalink, what is the path on disk?

Most things for me have a 1:1 location, but not the posts and the categories. There is a bit of glue to make this work:
https://github.com/hacdias/eagle/blob/799ba83a61b4f838118ef60e2bd04bd937c92ef2/core/parser.go#L72-L77
https://github.com/hacdias/eagle/blob/799ba83a61b4f838118ef60e2bd04bd937c92ef2/cmd/eagle/broken-links.go#L70-L73
Idea
The idea would be to somehow leverage the information in Hugo configuration and be able to at least, given the path on disk, understand what the permalink is. Then we could either cache it in memory or in the helper database. Seems easy enough. This would help with sending and receiving webmentions, as well as maybe other social protocols in the future.
The hard thing here is to determine the permalink without glue. With glue, it is always possible. But that's not good.

Hi @hacdias, can I try solving this ?

@mvr1k you can, but please note that this is a personal project and might not work for everyone, especially if you're not using it.


Cann't stop docker container.

In some case, it's need to stop the container in the service script. We could shutdown the system by using runit.

just use kill 1


update manual and fix public key for Win instance

Description
Update manual and fix public key upload for Windows instance
Fixes # (issue)
Type of change

[x] Bug fix (non-breaking change which fixes an issue)
[x] Documentation update

How Has This Been Tested?

Provision Windows instance
Log on with private key option
Ensure no

Test Configuration

Release version:
Platform: Ubuntu 20.04

Screenshots

[x] No screenshot

@ralfeus you have conflicts in the PR, can you resolve them? I could do it in the web editor like I did for your previous PR but it seems like it leads to further conflicts


hook failed: "grafana-dashboard-relation-broken"

Bug Description
sunbeam disable observability (removing cos-lite terraform plan) failed because of hook failed: "grafana-dashboard-relation-broken"
Reference for the cos-lite terraform: https://github.com/canonical/snap-openstack/tree/main/sunbeam-python/sunbeam/plugins/observability/etc/deploy-cos
To Reproduce
In the terraform plan directory

terraform init
terraform apply
Wait untill all applications are ready and active
terraform apply -destroy

While waiting for the model to be destroyed, the grafana unit goes into error state: hook failed: "grafana-dashboard-relation-broken"
Environment
The environment (e.g. the channel) is defined in the terraform plan. Also,
Name       Version  Rev    Tracking       Publisher      Notes
juju       3.3.0    25355  latest/stable  canonical✓     -
terraform  1.7.0    626    latest/stable  snapcrafters✪  classic

Relevant log output
unit-grafana-0: 15:52:40 ERROR unit.grafana/0.juju-log grafana-dashboard:22: Uncaught exception while in charm code:
Traceback (most recent call last):
  File "./src/charm.py", line 1308, in <module>
    main(GrafanaCharm, use_juju_for_storage=True)
  File "/var/lib/juju/agents/unit-grafana-0/charm/venv/ops/main.py", line 441, in main
    _emit_charm_event(charm, dispatcher.event_name)
  File "/var/lib/juju/agents/unit-grafana-0/charm/venv/ops/main.py", line 149, in _emit_charm_event
    event_to_emit.emit(*args, **kwargs)
  File "/var/lib/juju/agents/unit-grafana-0/charm/venv/ops/framework.py", line 342, in emit
    framework._emit(event)
  File "/var/lib/juju/agents/unit-grafana-0/charm/venv/ops/framework.py", line 839, in _emit
    self._reemit(event_path)
  File "/var/lib/juju/agents/unit-grafana-0/charm/venv/ops/framework.py", line 928, in _reemit
    custom_handler(event)
  File "/var/lib/juju/agents/unit-grafana-0/charm/lib/charms/grafana_k8s/v0/grafana_dashboard.py", line 1390, in _on_grafana_dashboard_relation_broken
    self._remove_all_dashboards_for_relation(event.relation)
  File "/var/lib/juju/agents/unit-grafana-0/charm/lib/charms/grafana_k8s/v0/grafana_dashboard.py", line 1524, in _remove_all_dashboards_for_relation
    if self._get_stored_dashboards(relation.id):
  File "/var/lib/juju/agents/unit-grafana-0/charm/lib/charms/grafana_k8s/v0/grafana_dashboard.py", line 1557, in _get_stored_dashboards
    return self.get_peer_data("dashboards").get(str(relation_id), {})
  File "/var/lib/juju/agents/unit-grafana-0/charm/lib/charms/grafana_k8s/v0/grafana_dashboard.py", line 1572, in get_peer_data
    data = self._charm.peers.data[self._charm.app].get(key, "")  # type: ignore[attr-defined]
AttributeError: 'NoneType' object has no attribute 'data'

Additional context
This issue is related to #281, and possibly having the same root.

This is happening on relation-broken, so seems like self.model.get_relation(PEER) is returning a None.
@jameinel is it correct for a peer relation to be gone before a regular relation? I recall this was discussed but didn't find the thread.

For future reference:

#232, #138
https://bugs.launchpad.net/juju/+bug/1998282


fix: gRPC-Go HTTP/2 Rapid Reset vulnerability

The ci failed due to failure of contrib/config/nacos @qinyuguang


feat: Add nushell completion

Add nushell completion
Stop guessing shell, and make --shell required
Adapt instructions

I have a version local that still tries to guess the shell from the $SHELL env var. But it made the code much more verbose, and I am not a fan of that behavior. On my system, $SHELL gives /bin/bash even though I use nushell.
I also adapted the instructions to stop suggesting that your choice of shell is platform dependent. Every listed shell can be used on Windows and vice versa.

A a rule of thumb I think we should always prefer sane defaults over having to specify a value explicitly because its something else to understand or learn.

In general, I agree. For this specific case, I argue we gain nothing.
The actual command to use completions is shell specific anyway.
I don't see how echo 'eval "$(pixi completion)"' >> ~/.bashrc is better than echo 'eval "$(pixi completion --shell bash)"' >> ~/.bashrc. Especially if the former is less robust.

I also think that although you are technically correct that any shell can be used on Windows we should still keep the tabs in the documentation. I think most users will not be running fish or zsh under windows. And the ones that do will most likely also understand to look under the linux tab. Or we could add a note about it.

Thanks for the feedback, I restructured the docs and like it much more now.
Let me know if you agree.

Any idea why the help is double and prefixing the login and logout?

 Any idea why the help is double and prefixing the login and logout?

No, but I found similar bugs in rattler-build. Still have to check if it's our or clap_complete_nushell's fault.
Can you reproduce it with other shells?

 Any idea why the help is double and prefixing the login and logout?

No, but I found similar bugs in rattler-build. Still have to check if it's our or clap_complete_nushell's fault.
Can you reproduce it with other shells?

Well they are valid commands and provide the help for those given commands. E.g. pixi auth help login gives me:
Store authentication information for a given host

Usage: pixi auth login [OPTIONS] <HOST>

Arguments:
  <HOST>  The host to authenticate with (e.g. repo.prefix.dev)

So in that case it seems the docs-string is just wrong, and we might need to ignore these commands in the autcomplete if that possible?

So in that case it seems the docs-string is just wrong, and we might need to ignore these commands in the autcomplete if that possible?

Nice find @tdejager.
Sounds to me like we can merge this PR then and create a follow-up issue for the issues you found. Agreed?


Abstractify hadoopy indexer configuration.

Moves many items to JobHelper
Remove dependencies of these functions on HadoopDruidIndexerConfig in favor of more general items
Changes functionalities of some of the path methods to always return a path with scheme

It appears most of the changes are just moving methods to JobHelper and using RetryProxy versus the loops we had written before.

@fjy  Yes, this is a migration rather than a major logic change. The migration is needed for upstream PRs though.

There is one change I forgot to mention in the notes:
The output loadSpec builder changed from being class.getName() based to outputFS.getScheme() based.

:+1:

LGTM, :+1:


Auction should support buy now which bidder can buy now with fixed price without going through Auction #54

Added buy it now feature in Auction pallet and added/updated unit tests.

Reusing the Amount would depend on if you want an Auction to have both a buy it now price and an initial bid amount, in this case we would need to store both values separately in the AuctionItem.
If we were to have a AuctionType would we have the following options?

Auction (what we have now)
BuyItNow (no auction)
AuctionWithBuyItNow (auction listing where you can buy it now at any time, even if it has started) - This exists on ebay
CandleAuction (would be added here in the future)


Move all data files to one location

Hi
I've just found your project and liked it a lot. I need to put a small blog up and running, and this project meets almost my requirements, good work!
I'll be making some changes to ease deployment and make it work for me. I'll be contributing some of them if you're ok with it.
I've noticed that user uploaded files are stored under www/data, while the SQLite database file is on the application's root.
I think having all data files together would ease deployment, backups, and mounting volumes with docker.
I moved the database file and the upload folder to a new directory called Data and used redirection to publish the files without reconfiguring paths on the interface. There should not be any noticeable difference other than the directory structure.
I think you will find it ok. Please, tell me if you need some changes. I have some other pull requests to send if you agree.

Hello, these functions have been implemented in the dev branch, and it provides simultaneous support for multiple databases, and will be merged into the main branch soon, thank you for your contribution.


xfrm: add rules for encrypt overlay

This pull requests updates XFRM policies to work with Encrypted Overlay.
When encryption.ipsec.EncryptedOverlay is enabled VXLAN traffic will be encrypted with IPSec/ESP. In this scenario our XFRM hooks will see VXLAN packets instead of pod-to-pod traffic.
Therefore, we must include XFRM policies and state which match on the source and destination of our VXLAN packets.
This will be the underlay addresses of each remote node.
When feature is disabled, rules added by this feature will be removed.
ipsec: support EncryptedOverlay XFRM policies

/ci-ipsec-e2e

/ci-ipsec-e2e

/test

cc @ldelossa

/ci-runtime

/test

Some more testing need to be done. Marking this draft till it's completed.

Hi @derailed 👋

Just a note: This type of work would have been a bit easier and less invasive if some of the calls were to take in options vs 8+ args and possibly prevent some of the duplication...

I agree, I spoke to Paul - decided to do it as separate change to clean this up.

One more point to add: We should automate whatever testing that @ldelossa is doing as well. If the CI is passing and there's really such a bug, then CI coverage is not enough to be making changes like this.

@pchaigno @harsimran-pabla
In the latest push I add a solution to the post decryption kernel drop.
This follow the second scenario outlined:

We define a custom output mark on encrypted overlay xfrm policies, look for this mark after decrypt, and redirect this packet in eBPF to a vxlan devices for decap.

The PR also needed a rebase as a lot of tests were switched from the Check package to Go's native test package.
Please provide a re-review with the latest changes.

/test

Hi @ldelossa , last commit lgtm.
@joestringer CI testing in current state only validates number of expected xfrm rules. There is a follow up task to enable all vxlan traffic (overlay unicast + multicast) to pass through encrypted overlay code path when encrypted-overlay feature is enabled. It should give us confidence in datapath changes.
Ideally, it would be nice to get that change in before 1.16 feature freeze as well.

/test

/test

Marking ready to merge. The failing e2e test is a known issue being worked on currently by CI Force.

/test


add option to disable enhanced monitoring on workers

PR o'clock
Description
Add option to disable enhanced monitoring on the workers
Checklist

[x] terraform fmt and terraform validate both work from the root and examples/eks_test_fixture directories (look in CI for an example)
[ ] Tests for the changes have been added and passing (for bug fixes/features)
[ ] Test results are pasted in this PR (in lieu of CI)
[x] Docs have been updated using terraform-docs per README.md instructions
[x] I've added my change to CHANGELOG.md
[x] Any breaking changes are highlighted above

Can you resolve the merge conflict here AND add your change to the changelog before I merge. Should be able to release this change with the others queued in master in the next day or so.

The previous CI run also looks like it crapped out on rubygems calls... I would guess this to pass the linter beyond that. We'll see 🤞 ...

oops, fixed!


Federation with Mastodon is broken?

I can't tell if this is an issue with Mastodon or Pterotype.
I deleted and re-created the QA instance. Now, when I search for it in the Mastodon search bar, both on mastodon.technology and a locally running instance, no results come up. From the local Mastodon server logs I can see that the webfinger request is made and receives a 200 back from Pterotype, and I've confirmed manually that the webfinger endpoint and the blog actor endpoint are both working.
So what's going on here? Is Mastodon doing some sort of weird caching thing?

So I created an account on a new Mastodon instance, mastodon.social, which had never seen the QA instance actor before, and repeated the search. That instance found the QA actor with no problem. So it does seem to be a weird caching issue.
That also revealed an unrelated issue - when I try to follow the QA instance with my new mastodon.social account, I'm getting a 404 not found. Without having access to the server logs it's hard to say what that actually means, so I'll try to reproduce elsewhere.

Update: mastodon.social actually just had a cached version of the blog actor (with out-of-date info). So basically it seems like the problem is that Mastodon aggressively caches everything and if you delete stuff it doesn't like to evict the cache.

So I made a new QA instance with a different URL, and webfinger discovery and follows are working fine with the new blog. However, federation doesn't seem to be working - investigating why now.

Thanks for the updates!

The error I'm getting back from Mastodon when we attempt to deliver the activity is:
Public key not found for key http://qa1.getpterotype.com/wp-json/pterotype/v1/actor/-blog#publicKey.
So I think maybe the public key field is still getting compacted (reduced to just an ID), which doesn't actually resolve if you make a request for it. So there are at least two things to resolve here:

Make the public key fields have a real URL for their IDs
Make sure Mastodon gets a hydrated copy of the public key

Ha, figured it out. The problem was that I was serving the WordPress instance over https, but it had its site URL configured to http://qa1.getpterotype.com (not https). This meant that the actor's url was mismatched between Mastodon and Pterotype, so Mastodon couldn't find the actor when it received an update. Once I updated the WordPress site URL (in settings) to https://qa1.getpterotype.com, the federation worked just fine.
This means that the WebFinger discovery problem mentioned in the first issue comment is almost certainly a caching problem on Mastodon's side. I'm going to close this issue out, since it's not a problem with Pterotype, and think more about what to do about Mastodon's aggressive caching.

Also, to close the loop on this, I re-did a search for the original QA instance (the one that was deleted and re-created), and it succeeded with no problem. So the cache does get evicted periodically.


Add this to READme

hey, can I do that?

Dont forget to use 'Closes #issuenumber' to link your PR to this issue.

This has been assigned to @Shaik-Amir . Please ask before sending a PR.


feat/samba

closes #23

I added some comments but I have no strong opinion on the commons-vfs2 fork, that was already on the branch from @tchiotludo but I think it was mostly for sandbox but as I no longer use that dependency maybe we should go back on that release :thinking:.
For the newly added lib I added a comment but basically commons-vfs2 doesn't offer SMB protocol handling (it's only part of their sandbox right now, AKA experimental features which are on another lib). However even that experimental handling from Apache doesn't support SMB2 / 3 while it's what's recommended security wise so I believe it won't be able to be used if we don't use another lib that handles that.
The lib I added provides an extra-layer over commons-vfs2's sandbox to add SMB2/3 support

If sandbox is not needed, please use the official release

Done


fix: allow multiple transfers of an inscription in one block

:tada: This PR is included in version 1.0.0-beta.2 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


What is the compatibility of QueryDSL <> Hibernate?

I have an application that uses JDK 21, Spring Boot 2.7 and Hibernate 5.4 - it doesn't seem to be supported by QueryDSL 6+ .
Am I correct and if yes, is it ok if I cherry-pick recent change to 5.X (https://github.com/OpenFeign/querydsl/pull/388) ?

Querydsl 6 is Spring boot 3, hibernate 6 and jakarta.* compatible.
For Springboot 2, hibernate 5 and javax.* projects you will be limited to querydsl 5.2.
If you need any new functionality from 6.x on 5.x, you gonna need raise a PR cherry-picking the change.


feat: input system

It is now possible to bind keys (mouse, keyboard) to "Action Names", such as "forward", "fire", ...
The mapping is registered through the CInputHandler:
  CInputHandler* inputHandler = CInputHandler::Instance();

  // Keyboard
  inputHandler->BindInputToActionName(SDLK_SPACE, "jump");
  inputHandler->BindInputToActionName(SDLK_0, "equip_rocketlauncher");
  inputHandler->BindInputToActionName(SDLK_w, "forward");
  inputHandler->BindInputToActionName(SDLK_s, "back");
  inputHandler->BindInputToActionName(SDLK_a, "left");
  inputHandler->BindInputToActionName(SDLK_d, "right");
 ...
  // Mouse buttons
  inputHandler->BindInputToActionName(SDL_BUTTON_LEFT, "fire");
  inputHandler->BindInputToActionName(SDL_BUTTON_RIGHT, "look");

Then, we also have to define what entities should be able to respond to mapped inputs:
  // Let the player receive input by default
  CInputDelegate::Instance()->SetReceiver(m_pPlayerEntity);

Those Entities have to implement the IInputReceiver interface which declares only one
method: HandleInput().
Example from the fly camera entity:
void CFlyCamera::HandleInput() {
    ButtonState forward = CHECK_ACTION("forward");
    ButtonState back	= CHECK_ACTION("back");
    ButtonState left	= CHECK_ACTION("left");
    ButtonState right	= CHECK_ACTION("right");
    ButtonState look	= CHECK_ACTION("look");

CHECK_ACTION is a macro that checks if there is a key mapped to the action name. If no mapping
could be found the return value is ButtonState::NONE.
Otherwise we can can check if the key for the action name was: PRESSED, WENT_DOWN or WENT_UP.
	if (forward == ButtonState::PRESSED) {
		m_Camera.Pan(dt*m_Camera.m_Forward);
	}
	if (back == ButtonState::PRESSED) {
		m_Camera.Pan(dt*-m_Camera.m_Forward);
	}
       ...
	if (look == ButtonState::WENT_DOWN) {
		const MouseMotion mouseMotion = GetMouseMotion();
		m_MouseX = mouseMotion.current.x;
		m_MouseY = mouseMotion.current.y;
	}
      ...

That is it. There are a few things that one must pay attention:
The entity technically gets updated at two different locations, in Update and in HandleInput.
This is not nice, because error prone. But reading through Game Engine Architecture we have to
rethink the Update approach anyways. I have encountered the problem that if you have dependencies
between entities, such as a FollowCameraEntity that has a target set to another entity, the order
of registration at the input manager absolutely matters. If the entity to be followed by the follow-camera
is registered after the follow-camera, the follow-camera will get updated to a position that is
one frame old and lacks behind which causes a noticable jitter effect when rendering (obviously).
There are a few solutions to this problem that we can (and probably have to) iron out later.
For now it is fine to pay attention to this.
Things that are to be implemented:

Entities should be able to define their custom input mapping table. At the moment this table is global.
An Entity class must create its unique Type-ID to differentiate between entity types easily. At the moment we
have an enum defined in the base-entity class. But this is annoying. It should be generated within a game entities class.

but I'm sure you did :)

I did :D . However, I noticed that if I enable my german keyboard the initial keypress is again a dead-key and doesn't open the console, even though SDL TextInput is used (didn't change your code there). Is it, because I remove one character from the TextInput stream again before opening the console? The thing is, earlier a second frame was needed to activate the console. Now, if m_isActive is set to true Run() is immediately executed. Could you look into this, @Cameramorphic ?

but I'm sure you did :)

I did :D . However, I noticed that if I enable my german keyboard the initial keypress is again a dead-key and doesn't open the console, even though SDL TextInput is used (didn't change your code there).

I just tested it, for me it works. The key still has to be pressed twice before the character is emitted (as expected), but the console opens and works.

Something else I just thought of:
Should the Console::Run() function be called Console::RunFrame() to match the game? Doesn't really matter though :)

Something else I just thought of: Should the Console::Run() function be called Console::RunFrame() to match the game? Doesn't really matter though :)

Nah, you're right. I wasn't sure but also thought about this. Changed it!

I just tested it, for me it works. The key still has to be pressed twice before the character is emitted (as expected), but the console opens and works.

Alright, so this was the behaviour on german layout before I massaged the code a bit?


For bulk insert, failure in later batch isn't reported to the caller

Driver version
Provide the JDBC driver version: mssql-jdbc.12.4.2.jre11.jar
SQL Server version
Provide the output of executing SELECT @@VERSION on your target SQL Server:
Microsoft Azure SQL Edge Developer (RTM) - 16.0.5100.7245 (X64)   Jun 13 2023 12:34:33   Copyright (C) 2022 Microsoft Corporation  Linux (Ubuntu 20.04.6 LTS) <X64>

SQL server is running inside docker 4.27.2.
Client Operating System
Provide the Operating System the client application is running on: Windows 11 enterprise
JAVA/JVM version
Provide the JAVA/JVM version (e.g. java version "1.8.0").
sh-5.2# java -version
openjdk version "11.0.22" 2024-01-16 LTS
OpenJDK Runtime Environment Corretto-<IP_ADDRESS>.1 (build 11.0.22+7-LTS)
OpenJDK 64-Bit Server VM Corretto-<IP_ADDRESS>.1 (build 11.0.22+7-LTS, mixed mode)

Table schema
Provide the table schema to repro the issue:
CREATE TABLE ST_Orders ([OrderID$] BIGINT,[CustomerID$] NVARCHAR(5),[EmployeeID$] BIGINT,[OrderDate$] DATE,[RequiredDate$] DATE,[ShippedDate$] DATE,[ShipVia$] BIGINT,[Freight$] FLOAT,[ShipName$] NVARCHAR(34),[ShipAddress$] NVARCHAR(46),[ShipCity$] NVARCHAR(15),[ShipRegion$] NVARCHAR(13),[ShipPostalCode$] NVARCHAR(9),[ShipCountry$] NVARCHAR(11),[DW_DM_ORDERS_ORDERS_CKSUM$] INTEGER)

CREATE CLUSTERED COLUMNSTORE INDEX [CS_ST_Orders] ON ST_Orders

ALTER TABLE [ST_Orders]
ADD UNIQUE (OrderID$);

INSERT INTO [ST_Orders] (OrderID$)
VALUES (11065);

Problem description
With bulk insert command execution through jdbc driver, when batchsize is used, if insertion for any batch (probably second batch onwards) fails, the jdbc driver can't detect the failure. It responds as success to the caller.
Steps to reproduce the issue

As mentioned above, create a table, add unique constraint, and add one row manually. (FYI: With the help of unique constraint and already added data, we would get bulk insert fail.)
Use the following files:
Format.txt
Orders.txt
Notice that in Orders.txt, the last record has 11065 as OrderID$, so bulk insert would fail due to unique constraint. 11065 was already added manually above. That's why.
Use following code:

String bulkInsertQuery = "BULK INSERT ST_Orders FROM '/.../data/Orders.txt' WITH (FORMATFILE='/.../data/Format.txt',FIRSTROW=1,ROWS_PER_BATCH=830,BATCHSIZE=400,DATAFILETYPE='widechar')";

// Notice that aforementioned query has BATCHSIZE=400, and the number of records are 830 in the file. So it will execute in three batches: 400 + 400 + 30.

st.executeLargeUpdate(bulkInsertQuery);

Expected behavior
A clear and concise description of what you expected to happen:

Insertion of the first two batches should succeed.
Insertion of the third batch should fail.
The execution should throw exception for the failure.

Actual behavior
Output of what you actually see.
The execution doesn't throw any exception even though the third batch fails. (First two batches are inserted as expected.)
Error message/stack trace
No exception or error message. That's the issue.
Any other details that can be helpful
Add any other context about the problem here.
When we attempt to do the same in SQL Server management studio, it does display the errors:

Output:
(400 rows affected)

(400 rows affected)
Msg 2627, Level 14, State 1, Line 19
Violation of UNIQUE KEY constraint 'UQ__ST_Order__E65CA761A9B383C1'. Cannot insert duplicate key in object 'S_bcabbbbf_7118_48dc_a0e0_bbd075ce01de.ST_Orders'. The duplicate key value is (11065).
The statement has been terminated.

So looks like the driver just reads the first message of response and NOT the further messages (response from SQL server).
I haven't yet tried failing the first batch itself.
JDBC trace logs
Provide the JDBC driver trace logs.  Instructions can be found here: https://docs.microsoft.com/sql/connect/jdbc/tracing-driver-operation

Adding some more detail:
st.executeLargeUpdate(bulkInsertQuery) returns a long value.
Attempted to check the behaviour of this when the first batch fails, second batch fails and when the third batch fails.
First batch fails
When the first batch itself fails, the statement throws exception as expected:
2024-03-14 14:18:22 2024-03-14 08:48:22,912+0000 [toe=acgubk80vow677] [Pool Worker - 55] [,,] ERROR - Violation of UNIQUE KEY constraint 'UQ__ST_Order__E65CA761D1FED3F3'. Cannot insert duplicate key in object 'S_bcabbbbf_7118_48dc_a0e0_bbd075ce01de.ST_Orders'. The duplicate key value is (11065). com.microsoft.sqlserver.jdbc.SQLServerException: Violation of UNIQUE KEY constraint 'UQ__ST_Order__E65CA761D1FED3F3'. Cannot insert duplicate key in object 'S_bcabbbbf_7118_48dc_a0e0_bbd075ce01de.ST_Orders'. The duplicate key value is (11065).
2024-03-14 14:18:22     at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:259) ~[mssql-jdbc-12.4.2.jre11.jar:?]
2024-03-14 14:18:22     at com.microsoft.sqlserver.jdbc.TDSTokenHandler.onEOF(tdsparser.java:304) ~[mssql-jdbc-12.4.2.jre11.jar:?]
2024-03-14 14:18:22     at com.microsoft.sqlserver.jdbc.TDSParser.parse(tdsparser.java:137) ~[mssql-jdbc-12.4.2.jre11.jar:?]
2024-03-14 14:18:22     at com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(SQLServerStatement.java:1691) ~[mssql-jdbc-12.4.2.jre11.jar:?]
2024-03-14 14:18:22     at com.microsoft.sqlserver.jdbc.SQLServerStatement.doExecuteStatement(SQLServerStatement.java:920) ~[mssql-jdbc-12.4.2.jre11.jar:?]
2024-03-14 14:18:22     at com.microsoft.sqlserver.jdbc.SQLServerStatement$StmtExecCmd.doExecute(SQLServerStatement.java:814) ~[mssql-jdbc-12.4.2.jre11.jar:?]
2024-03-14 14:18:22     at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:7675) ~[mssql-jdbc-12.4.2.jre11.jar:?]
2024-03-14 14:18:22     at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:4137) ~[mssql-jdbc-12.4.2.jre11.jar:?]
2024-03-14 14:18:22     at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:272) ~[mssql-jdbc-12.4.2.jre11.jar:?]
2024-03-14 14:18:22     at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:246) ~[mssql-jdbc-12.4.2.jre11.jar:?]
2024-03-14 14:18:22     at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeLargeUpdate(SQLServerStatement.java:774) ~[mssql-jdbc-12.4.2.jre11.jar:?]

When the second batch or third batch fails
It returns 400.
No exception is thrown.

Hi @hlms,
I'm not familiar with expected behavior of the driver in this scenario. We'll investigate further and get back to you with an answer/resolution.

This is actually a common scenario and we have wiki/MS doc pages for it:
https://docs.microsoft.com/en-us/sql/connect/jdbc/parsing-the-results?view=sql-server-ver16
https://github.com/microsoft/mssql-jdbc/wiki/Handling-SQLExceptions
Some past issue references: #367, #399, #826, #937, #995, #1171
Therefore, this is expected driver behavior. Please let us know if you have any further questions, if not we will be closing the issue.

I'm yet to go through the provided links in detail.
What about introducing a new argument (e.g. RAISE_FAILURES) for Bulk insert (similar to BATCHSIZE argument)? So that if users want bulk insert to surface failure in insertion of any of the batches, then based on this parameter, the driver would raise failures.
The point is - SQL server raises the errors. Shouldn't the driver pass the response as-is instead of swallowing something?


Inversion

Add an add-on to carry out inversions using empymod for forward modelling and SimPEG for the inversion.
Development happens on OpenGeophysics/scratchpad.
Things to do / think about:

bipole dissection

checks that have only to be carried out once
things that have to be done every time
move loops into SimPEG

Principally frequency-domain
Include routines for time-domain
Create example in 4. Add-ons of the notebook-examples repository

Moved to empymod/empymod#20, as empyscripts was merged into empymod.scripts.


error when click on checkout

this screen showing when click on checkout button, it must open login page for paypal , please fix this urgently, note : i add correct client id and code is clean thanks, pls see picture error

i have same problem, but with live environment. In sandbox there is no issue

thanks bro

Hey @ibrelm - would you be able to provide me the client ID you're passing into the SDK?
@sanjivdhakal - Will respond to your issue shortly!

I have same problem, but with sandbox enviroment.
I am use SDK "android-sdk:0.6.0"
Client ID:
ATc1nb1_zQ1bvW6h_oAJppkSnjVRUm6hV3dtS53QNorq1ik4CjgimugD4MnxgAK3C3sqrIrCG2yTXTc9

Hey @winzoor - can you log into the PayPal developer portal, navigate to your REST app, and ensure that Native Checkout SDK is enabled? There was a bug on the portal where this option was hidden.

If you're still having issues, can you please open a new GitHub issue?

I already checked the portal and I already saw the option to enable the native checkout payment.
Thanks.

De: Tim Chow @.>
Enviado: martes, 21 de junio de 2022 10:01 a. m.
Para: paypal/android-checkout-sdk @.>
CC: winzoor @.>; Mention @.>
Asunto: Re: [paypal/android-checkout-sdk] error when click on checkout (Issue #114)
Hey @winzoorhttps://github.com/winzoor - can you log into the PayPal developer portal, navigate to your REST app, and ensure that Native Checkout SDK is enabled? There was a bug on the portal where this option was hidden.
[image001]https://user-images.githubusercontent.com/5005216/174832457-68b17811-3731-4f34-a24a-5b7edfa74436.png
If you're still having issues, can you please open a new GitHub issue?
—
Reply to this email directly, view it on GitHubhttps://github.com/paypal/android-checkout-sdk/issues/114#issuecomment-1161872516, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AENPNDDUO7UWCLMTAXRRJO3VQHKONANCNFSM5XXALF7Q.
You are receiving this because you were mentioned.Message ID: @.***>

Unfortunately, I also encountered the same problem, but I couldn't find the switch of "enable the Native Checkout SDK"

@GengJian could you show me a screenshot of the REST app options in your developer portal? It should look similar to this. This will help me determine if the bug where the Native Checkout SDK option is hidden still exists.

i don't have this option for native checkout SDK on my developer portal

I have an app that uses its services to sell products from within the app to users but every time a user tries to purchase a product, it says "vendor account doesnt have a verified email address paypal" any solution please?


System.ArgumentException: Target cannot be found: 'EventLog'

Hi! Thanks for reporting this feature/bug/question!
Please keep / fill in the relevant info from this template so that we can help you as best as possible.
For .NET Core users, please check the platform support: https://github.com/NLog/NLog/wiki/platform-support
Type (choose one):

Question

NLog version: 4.4.1
Platform:  Asp.NetCore 2.0
Current NLog config (xml or C#, if relevant)

<target xsi:type="EventLog"
        name="eventlog"
        source="CoreDemo"
        layout="${message}${newline}${exception:format=ToString}"/>

Question:
The above is my nlog.config file. I cannot write to the Event Log.
2017-09-20 13:47:07.8519 Error Parsing configuration from C:\Users\stavrianidisa\source\repos\CoreDemo\CoreDemo\nlog.config failed. Exception: NLog.NLogConfigurationException: Exception when parsing C:\Users\stavrianidisa\source\repos\CoreDemo\CoreDemo\nlog.config.  ---> System.ArgumentException: Target cannot be found: 'EventLog'
at NLog.Config.Factory`2.CreateInstance(String name)
at NLog.Config.XmlLoggingConfiguration.ParseTargetsElement(NLogXmlElement targetsElement)
at NLog.Config.XmlLoggingConfiguration.ParseNLogElement(NLogXmlElement nlogElement, String filePath, Boolean autoReloadDefault)
at NLog.Config.XmlLoggingConfiguration.Initialize(XmlReader reader, String fileName, Boolean ignoreErrors)
--- End of inner exception stack trace ---
2017-09-20 13:47:07.8915 Info Found 0 configuration items
2017-09-20 13:47:07.8915 Info Found 0 configuration items
The nlog.config file has Build Action set to None and Copy to Output Directory set to Copy always.
I am also copying my whole startup.cs
using Microsoft.AspNetCore.Builder;
using Microsoft.AspNetCore.Hosting;
using Microsoft.Extensions.DependencyInjection;
using Swashbuckle.AspNetCore.Swagger;
using Microsoft.Extensions.Logging;
using NLog.Extensions.Logging;
using NLog.Web;
namespace CoreDemo
{
public class Startup
{
public Startup(IHostingEnvironment environment)
{
environment.ConfigureNLog("nlog.config");
}
    public void ConfigureServices(IServiceCollection services)
    {
        services.AddMvc();

        // Register the Swagger generator, defining one or more Swagger documents
        services.AddSwaggerGen(c =>
        {
            c.SwaggerDoc("v1", new Info
            {
                Title = "CoreDemo API",
                Version = "v1",
                Description ="Learning how to create an API",
                TermsOfService = "None",
            });
        });

    }

    public void Configure(IApplicationBuilder app, IHostingEnvironment env, ILoggerFactory logger)
    {
        logger.AddConsole();
        logger.AddNLog();

        if (env.IsDevelopment())
        {
            app.UseDeveloperExceptionPage();
        }
        // Enable middleware to serve generated Swagger as a JSON endpoint.
        app.UseSwagger();
        app.UseSwaggerUI(c =>
        {
            c.SwaggerEndpoint("/swagger/v1/swagger.json", "Demo API");
        });
        app.UseStatusCodePages();
        app.UseMvc();
    }
}

}
What am I doing wrong here?

<target xsi:type="EventLog"
        name="eventlog"
        source="CoreDemo"
        layout="${message}${newline}${exception:format=ToString}"/>

<target xsi:type="EventLog"
        name="eventlog"
        source="CoreDemo"
        layout="${message}${newline}${exception:format=ToString}"/>

If you check the platform support, then EventLog is not working for NetStandard 1.3+:
https://github.com/NLog/NLog/wiki/Platform-Support
And I guess the reason is this:
dotnet/corefx#6913

Please let us know if we should add a link somewhere else for the platform support docs.
Closing for now

This will be fixed with PR #2547


Please consider changing routing syntax from int:user_id to <user_id:int>

This would make it look similar to how types are defined generally in Rust.

@vegai Good point, actually I have thought about using <user_id:int>, at last I stick with the werkzeug syntax, if necessary, we can change it.

Nice!


connectionTimeout input value is in seconds, while jedis expects millisecs

connectionTimeout input value is in seconds, while jedis expects milliseconds, a multiplication of 1000 is necessary.

after the modification in the 3 files, I suppose line 45 and  51 of RedisTargetConfig.java in com.streamsets.pipeline.stage.destination.redis should be modified to 60 instead of 1000. I am not aware of the purpose here, so I did not modify, at least 1000 is not a big issue

Thank you for the contribution @lingma ! Since you're fixing the units in target, do you mind doing that in the origin and lookup as well?
In order for me I need to ask you to docu-sign our contribution agreement and if you don't mind please also create user account on our JIRA server so that I can assign the JIRA to you and give you proper contribution :)

JIRA user lingma has been created, I have fixed lookup part yesterday, I will check again to make sure that everything will be fixed. Thanks. The agreement has been signed yesterday either.

Ah, you're right - all three components have been addressed by this. Sorry I have missed that.
Let me run your contribution by our test automation and I'll merge if it succeeds :)

I found some other files under your suggestion, and they have also been fixed with new update. Please also check them, thanks.

Thank you for your contribution @lingma - I just merged it to master branch!


Fix incorrect bundle and export missing bundle

jolokia-agent-osgi-2.0.0-M3.jar unable to start successfully due to missing jolokia-service-notif-pull and jolokia-service-notif-sse packages.

Thanks ! Not sure why the integration tests are failing, but unfortunately I'm  these days quite loaded with other work, so not sure when I will find time to tackle this.


added support for custom user model

I found it to be the case that this app hard-codes auth.User into the foreignkey.  This change allows the use of custom user models for projects using this app.

@imagescape Thanks. We'll have to adjust the migrations, too, right?


Use OCIS_LDAP_SERVER_WRITE_ENABLED envvar

Starting from this PR https://github.com/owncloud/ocis/pull/6339 frontend service needs a new envvar to tell web to lock Create User actions.
Has no effect on other versions so this could be merged proactively

@wkloucek I tried to be proactive. Good or Bad?


Task 13: Front End Experts Love it Grid

Grid creation for displaying the supplier cards

This issue is a duplicate to #63


Use HTTP response code 412 for the /health API

Resubmitting PR #1217 against the 0.24 branch.

:boom:

Woohoo! My first commit to Sensu proper! \o/ :shipit:

I think this resolve #984. I'm going to close that issue. 👍


feat: migrate to nx 16.6

@Jordan-Hall I'd update the versions in the single package.jsons as well

Looks good to me


Response Header

For best practices, we need to add X-XSS-Protection: 1; mode=block and X-Content-Type-Options: nosniff on the response header. By the way, this is NOT a critical issue but it should be taken care off.
HTTP/1.1 200 OK
Expires: Wed, 22 Jul 2015 14:36:46 GMT
Content-Type: application/json
Server: Apache
Allow: OPTIONS, GET
Cache-Control: max-age=1800
Last-Modified: Wed, 22 Jul 2015 14:06:46 GMT
Content-Length: 107
Date: Wed, 22 Jul 2015 14:06:46 GMT
Connection: keep-alive
{"timestamp": "2015-07-21T04:00:00Z", "data": {"4.375": 5, "4.230": 2, "4.500": 2, "4.250": 5, "4.125": 6}}

This sprint we prioritized a security fix we described as "x-frame header". @virginiacc Is that the same as this? (If so, we're on it and it should happen in the next two weeks, @lfatty!)

@stephanieosan
No there are different. ￼X-XSS-Protection: 1; mode=block will enable the browser's inbuilt Anti-XSS filter.￼ X-Content-Type-Options: nosniff will prevents the browser from doing MIME- type sniffing.

@lfatty since these options need to be added to all pages of cf.gov, won't it make sense to make it at server level and not at a particular module level?

@stephanieosan
Yes indeed it should be at the sever level so that all pages have those headers. Again it is not critical but I just want to get you guys attention. I need find out the contact person for implementing the headers in site wide.


Add basic support for tenant scoping from parent/child tenants.

This PR implements the scoping of CIs owned by related (parents, children) tenants base on the following rules:

ext_management_systems  : All parent tenants
miq_ae_namespaces           : All parent tenants
miq_requests                        : Tenant only
miq_request_tasks               : Tenant only
providers                              : All parent tenants
service_template_catalogs  : All parent tenants
service_templates (item)      : All parent tenants
services                               : All child tenants
vms                                      : All child tenants

https://trello.com/c/1PHsfqkK

@kbrock @Fryguy Please review


Model is not loaded

when i load the model,i got this error
OSError: SavedModel file does not exist at: resnet_chest.h5/{saved_model.pbtxt|saved_model.pb}
please help me to resolve this error

The model is pointing to a location in Git Large Files. You can install that and then use the pointer to download it from the server.

sorry I didn't your point. Kindly explain

I think you not using git clone command, and the quota to download the model is expire.. I suggest you train the model from jupyter notebook with google collab, download the model and, save it in models folder.

Hey hi, extremely sorry for the inconvenice. I have not been active on Github lately due to medical issues. The issues were caused due to expiry of my Github LFS. Please follow the new setup instructions and try again. Also, please make sure you have Python v 3.8.5 installed. For other versions, you might face package problems with TensorFlow


Validate that a Play Suisse tracker is possible

Feedbacks from March 13th review:

Play CH source link 1: https://github.com/SRGSSR/SRGLetterbox-React-Native/blob/develop/android/src/main/java/com/reactlibrary/SRGLetterboxModule.java
Play CH source link 2: https://github.com/SRGSSR/SRGLetterbox-React-Native/blob/develop/ios/SRGLetterbox.m
Play CH source link 3: https://github.com/SRGSSR/rio-web/blob/develop/src/components/Letterbox/Letterbox.tsx#L173
Ability to respond to tracker deactivation positively or not (e.g. non-main instance could still be tracked for QoS purposes so the Tracker protocol should likely reflect this flexibility)
Youbora / NPAW might not support overlapping sessions because it is a singleton (so attach and detach might need to be properly ordered). See above links. But with a session id per attach / detach it should still be possible with our API (according to S. Chauvin). Maybe NPAW can support several sessions according to Walid, though.

Other question: Could we share a React.js Pillarbox unlike today?
Possible idea for the future: Work closely with Play CH to implement their existing tracker with Pillarbox and see if this is possible

Would definitely be possible but we now have Pillarbox monitoring anyway.


Load Multiple Views

as a Any User
I want to Load multiple datasets in multiple views
so I can View each dataset in a different hierarchical graph view, side by side

feature/59

parf of feature/59


Connect from Tableau Server for Linux

Hi dev team,
Here below is the description of the problem
with connecting Tableau Server for Linux to CH via ODBC.
The environment:
(CH) -- ClickHouse v.18.16.1 in Docker container on macOS Mojave 10.14.2.
(TD) -- Tableau Desktop v.2018.3.2 on macOS Mojave 10.14.2.
(TS) -- Tableau Server for Linux v.2018.3.2 on Ubuntu 16.04 LTS.
The datasource was created in TD using the ODBC connection to CH
(database = default, table = ontime), and then published to TS.
The successful connection was established from TS to CH,
so there is no problem with the networking between them.
But the attempt to create a New Workbook based on this datasource
(using a Web Edit mode of TS) failed with error.
On the other side, a New Workbook could be successfully created (in Web Edit mode)
using a *JDBC connection to that same CH instance / database / table.
Here is the screenshot of the successfully created workbook/view.
So the working connection to CH has been established using the JDBC driver (at least).
The main difference between the ODBC and JDBC connections
(at least at the initial connection / probe phase) is that
the JDBC connection request includes the schema = default as an attribute,
but the ODBC connection requests the schema = null (or schema = ' '),
which leads to the DB::Exception (error 62).
Please find the reference to the TS ziplogs.
Please take a look at the tabprotosrv_vizqlserver_1-0.txt log (in the vizqlserver folder),
the Event IDs 1585 and 1588 as examples of the faulty ODBC requests.
Please compare to the successful request via JDBC driver
(this one is using TS Dataserver process as a sql-proxy).
The request was initiated by VizQL Server (as captured by Event ID 20910
in the nativeapi_vizqlserver_1-0_2019_01_12_00_00_00.txt vizqlserver log),
then translated and executed by the Dataserver (as captured by Event 1673
in the tabprotosrv_dataserver_1-0.txt dataserver log).
The suggestion would be to include the schema = default meta-data
in the connection configuration info (don't know if it makes any sense for ODBC, though).
Yours,
Yuri
BTW, the workbook (using this datasource) was created in TD and published to TS.
As expected, any attempt to open any view on the TS would failed (either with error,
or stalled at the login). Here is a screenshot of an unsuccessful login attempt
when opening the view (Sheet 7 Date) from this workbook on TS.

Can you show your odbc.ini with Clickhouse datasource? (without passwords)
Also you can try enable clickhouse-odbc logging:
Add to connection settings:
Trace=1
TraceFile=/temp/clickhouse-odbc.log
in log you can find lines like
../driver/statement.cpp:72 POST localhost/query?database=default&default_format=ODBCDriver2 body=select......
interesting part is database=default - is it 'default' ?

Here is the copy of /etc/odbc.ini
[ODBC Data Sources]
ClickHouse = ClickHouse

[ClickHouse]
Driver    = /usr/lib/x86_64-linux-gnu/odbc/libclickhouseodbc.so
server    = <IP_ADDRESS>
password  = xxxxxxx
port      = 8123
database  = default
uid       = default
# sslmode = allow
trace     = 1
tracefile = /tmp/clickhouse-odbc.log

and a copy of /etc/odbcinst.ini
(with other drivers installed, too)
[ODBC Drivers]
PostgreSQL Unicode=Installed
Vertica=Installed
EXASolution Driver=Installed
ClickHouse=Installed

[PostgreSQL Unicode]
Description=ODBC for PostgreSQL
Driver=/opt/tableau/tableau_driver/postgresql-odbc/psqlodbcw.so
FileUsage=1

[Vertica]
Driver=/opt/vertica/lib64/libverticaodbc.so

[EXASolution Driver]
Driver=/opt/exasol/libexaodbc-uo2214lv2.so

[ClickHouse]
Driver=/usr/lib/x86_64-linux-gnu/odbc/libclickhouseodbc.so

The ODBC connection from TS to CH was successful
using the published datasource (same as before).
Below is a screenshot with the error
when trying to create a new workbook
based on the published datasource:

There are no traces of
../driver/statement.cpp:72 POST localhost/query?database=default&default_format=ODBCDriver2 body=select......
in the /tmp/clickhouse-odbc.log file --
that's because of the (faulty) connection process
didn't even come close to querying the actual data,
it breaks right after the bunch of probing queries.
Here is a link to the log file:
clickhouse-odbc.log.zip
There are two (positive) controls:

The connection is successful from macOS using the same datasource.
The trace file in this case does indeed contain the above statement:
../driver/statement.cpp:72 POST <IP_ADDRESS>/query?database=default&default_format=ODBCDriver2 body=select......

The ODBC connection to the other RDBMS (namely Exasol)
is successful on the server using the published datasource --
to confirm a general ODBC connectivity is working on the server.

@proller , I have been trying to use TS on Linux with CH ODBC.
I also get a similar error to in TS to that shown by @yurifal above:
HTTP status code: 400
Received error:
Code: 62, e.displayText() = DB::Exception: Syntax error: failed at position 27 (line 2, col 18):
The table "voice_cube" does not exist.
Generic ODBC requires additional configuration. The driver and DSN (data source name) must be installed and configured to match the connection.
Unable to connect using the DSN named "clickhouse_ansi". Check that the DSN exists and is a valid connection.

It seems an @ character is appended to the query statement, which causes many or most of the preparation statements to fail.
In the odbc.log trace file, there are many of these types of error after each connection attempt.
/opt/temp/clickhouse-odbc/driver/odbc.cpp:79 SQLPrepare statement_text_size=9 statement_text=SELECT 1
/opt/temp/clickhouse-odbc/driver/odbc.cpp:90 query(9) = [SELECT 1^@]
/opt/temp/clickhouse-odbc/driver/odbc.cpp:99 SQLExecute
/opt/temp/clickhouse-odbc/driver/statement.cpp:72 POST <IP_ADDRESS>/query?database=rdw&default_format=ODBCDriver2 body=SELECT 1^@
/opt/temp/clickhouse-odbc/driver/statement.cpp:100 HTTP status code: 400
Received error:
Code: 62, e.displayText() = DB::Exception: Syntax error: failed at position 9<EMAIL_ADDRESS>Unrecognized token, e.what() = DB::Exception

/opt/temp/clickhouse-odbc/driver/utils.h:29 Exception: HTTP status code: 400
Received error:
Code: 62, e.displayText() = DB::Exception: Syntax error: failed at position 9:

I have a similar ODBC configuration to that shown by @yurifal above.
Tableau server 2018.3.2 (20183.18.1214.0808) on CentOS
Clickhouse ODBC drivers VERSION=<IP_ADDRESS>81017
We tried to compile a later copy from the newer release tags, but those didn't work at all.
I can connect and successfully run queries on the CH database using isql -v clickhouse using ANSI.
The unicode versions fail to connect at all with isql, returning an error: "[ISQL]ERROR: Could not SQLConnect"
With the same version of Clickhouse ODBC ANSI on Windows, the same reports work correctly in TS.
Do you have a later copy of the drivers for Linux which I can test with?

Hi and thanks for all the details!
I have a similar problem, on TS (2018.3.2 (20183.18.1214.0808) 64-bit Linux)
I've created a workbook with a live CH ODBC data source on TD. Published it to TS, but when I try to access a view, I get the following error message, although my server administrator already installed the Clickhouse ODBC drivers to the Server.
[unixODBC][Driver Manager]Can't open lib 'ClickHouse Unicode' : file not found Generic ODBC requires additional configuration. The driver and DSN (data source name) must be installed and configured to match the connection. Unable to connect using the DSN named "Clickhouse_w". Check that the DSN exists and is a valid connection.
@yurifal I'm very curious to find out how you published an existing workbook and it worked, or what's the difference between what you did and what I did. As you can see, my connection in the published workbook is unsuccessful.

Hi @DrMitzi
Please try to install ODBC driver with libiodbc (instead of unixodbc).
And even if the test connection is successful, it's of no use (with TS for Linux).
Yours,
Yuri

I am very far from ++, but i noticed that in statement_text_size=9 but in statement_text=SELECT 1 its only 8 chars. Maybe that is the reason of error?

@yurifal Thanks for the suggestion! Do you mean on the desktop, on the server, or on both?

On the server (Linux) or on the desktop (macOS).
Windows has its own ODBC manager.

@yurifal Thanks a lot for your advice. Thanks to it, our Server admin started digging a bit into the ODBC driver configurations, and found a missing space in the driver name.
This is the correct configuration:
Description=Clickhouse UNICODE ODBC Driver
Driver=/usr/lib/x86_64-linux-gnu/odbc/libclickhouseodbcw.so
Setup=/usr/lib/x86_64-linux-gnu/odbc/libclickhouseodbcw.so
UsageCount=1```
TS expects it to be called `Clickhouse Unicode` (with a space between the two words)
Now it's working, yay!

@DrMitzi Could you share a link to the issue?

Hi all, @proller fixed that bug. Connection is successful

Yep, can connect (TS 2019.1.2, Ubuntu 16.04).
Thanks @proller !


rehearsal migrate, after yarn build:tsc dist directory doesn't mirror src directory ('lib')

Steps to Reproduce
Checkout urn-utils
Following the steps in our internal guide for early adopter usage:
After you run:
$ rehearsal migrate -u rehearsal-config.json

$ yarn build:tsc

$ tree lib
lib
├── check-for-entity-id.ts
├── extract-entity-info-from-urn.ts
├── index.ts
├── urn-pattern.ts
└── urn-to-object.ts

$ tree dist
dist
├── check-for-entity-id.d.ts
├── check-for-entity-id.d.ts.map
├── check-for-entity-id.js
├── check-for-entity-id.js.map
├── extract-entity-info-from-urn.d.ts
├── extract-entity-info-from-urn.d.ts.map
├── extract-entity-info-from-urn.js
├── extract-entity-info-from-urn.js.map
├── index.d.ts
├── index.d.ts.map
├── index.js
├── index.js.map
├── urn-pattern.d.ts
├── urn-pattern.d.ts.map
├── urn-pattern.js
├── urn-pattern.js.map
├── urn-to-object.d.ts
├── urn-to-object.d.ts.map
├── urn-to-object.js
└── urn-to-object.js.map

Output directory is flat.
Expected
dist/lib/<files>.

@haochuan from Slack

Does rootDir control the structure of files in dist?
I think if we have rootDir: '.' in tsconfig.json, the built dist dir would mirror the correct file structure
not sure if this is the only way though
also seems like tsc treats src and lib in a different way. If I rename the lib dir to src in urn-utils, it keeps the right structure

Verified as well. This is an issue with the generated tsconfig from our internal ts-bases repo.
Resolution is to add rootDir: '.' to make it the default.

Closing this, as it's mainly a documentation issue. Nothing we should enforce.


Check bytecode flags directly without decoding opcode fields

Check opcode flags directly from the instruction without decoding the field first. This has lower footprint, performance impact to be verified.
Also change some DUK__REGCONSTP(b) to DUK__REGCONSTP_B(ins), etc.
Tasks:

[ ] Change flag decoding
[ ] Releases entry

After the opcode rework no longer seems to be a net positive change, so closing without merge.


Multilingual same output sentence generated

I am trying to build a Abstractive PreSumm model for Korean
At the beginning, I used bert-multilingual model but I've found its tokenizer was poor so I've decided to use a sentecepiece which was trained on a large Korean corpus. Therefore, codes related to tokenizing, converting tokens to idx or idx to tokens have changed.
I did not change embedding parts since I gave 'False' to use_bert_embed argument
During training (with ~1500 articles and 50,000steps), the accuracy and ppl were gradually decreased to around 40 and 20 respectively. These are the values that I obtained when I trained original PreSumm model with CNNDM dataset. So I thought the model trained reasonably well.
However, when it comes to the evaluation step, all the generated output sentences (three sentences) are the same, regardless of the input sentence. This conflicts with the fact that the ppl was reasonably low - which cannot be observed if the same output sentence was produced during training.
Possible reasons, I suspect, would be
(1) The model actually trained well but loaded untrained model (somehow) during evaluation, which I think unlikely since I didn't change this part of code
(2)  Poor token embedding since bert-multilingual
(3) Not enough training data
Any advice would be helpful

I assume your are working on abstractive summarization.
First :

For abstractive summarization, PreSumm was trained on 200k steps, not 50k.

Second, your dataset seems very little : CNN/DM contained ~300k samples. My guess is 1k5 sample is very small.
Also, why did you set use_bert_embed to False ? If you are not sharing the weights, the decoder part is not using sentencepiece embeddings that you trained on large Korean corpus. It is trained from scratch, which might impact the performance..

Did you look into the generated sentences ? Is it all the same but a clear and correct sentence, or is it garbage, like repeating the same token over and over ?

@Colanim
Thank you for reply
As for your answers to your interesting questions ,

Ok. I will increase the amount of data.

However, even with 1.5K data and 50K steps, the model achieved "good" accuracy and "low" ppl which would indicate that the model trained alright with 1.5K.
Is this an incorrect statement ?

I noticed that the bert-multilingual-base-uncased (or cased) model's tokenizer and its vocab list barely contain tokens from my Sentencepiece model.

Therefore, I assumed that using the bert_embed would not be much beneficial.
By the way, when you said
"If you are not sharing the weights, the decoder part is not using sentencepiece embeddings that you trained on large Korean corpus"
you might be confused with bert and sentencepiece
I don't think there is no parameters within the sentencepiece model which i trained from the Korean corpus, whereas Bert obviously does have parameters for embedding layers.
Please let me know if there is a way of "using sentencepeice embedding values"
Thanks

Indeed I might be confused about bert and sentencepiece : I never used anything different than the one given by BERT's author ^^
The model can achieve good results on small datasets by memorization. If your goal is just to train the model for debugging, indeed 1k5 will be enough to ensure the model is learning something. But it will have really bad generalization capabilities (on unseen data).
Did you look at the predictions ?

Alright fair enough
Do you mean the predictions for the training data or validation data ?
I think it would be great to print the predictions for validation data during training but is this possible with the given code ?

It's not possible but you can easily modify the code to display it at testing time, during beam-search.
Insert these lines :
print("Gold: {}".format(gold_sent))
print("Pred : {}".format(pred_sents))
input()

Right after this line :
https://github.com/nlpyang/PreSumm/blob/ba17e95de8cde9d5ddaeeba01df7cace584511b2/src/models/predictor.py#L109

Thank you very much !
Will try and see what happens :+1:

Hang on @Colanim

The repetition problem has not been solved.
Any comments would be highly appreciated

Yes this print predictions during test only.
It's the easiest way to see the predictions. If you want to see it during training/validating, you need to change more code.
It's possible to do it, but cumbersome and not accurate : during training and validating, teacher-forcing is used. So it does not reflect the exact behavior of inference.


[Bugfix] Fix session cluster could not get flink webui

Purpose of this pull request
This pr fix #552
close #552
Brief change log

Use client.services() instead of client.resources(Services.class) when get k8s services
Get url firstly by ip then hostname

+1


Fix #4332 by widening the scope to all JDKs

Thanks for the approve! Can someone merge it too, please? :)


Missing functions for global Float64Flags

The title says it all; there is no way to pull a global float64 out of the context.  Context has "Float64" and "lookupFloat64" functions but no "GlobalFloat64" nor "lookupGlobalFLoat64."

Yep, that is definitely an oversight. Thanks for the report!


Setting mypy on CI

This PR sets a CI run with mypy. To avoid a persistent failure (over 500 errors if left to run freely), the run is limited a few sub-packages from numba.core (types, datamodel, rewrites and unsafe). This list can be extended as more modules are annotated.
Since many names in the typing package would conflict with Numba's (including typing itself), I use aliases prefixed with mp, e.g. mpDict, mpType.
A mypy_typing folder is created in numba.core for any type definitions that could be needed. I suggest that each sub-package (core, numpy, etc) manages its own type definitions within its folder.
Additionally, two errors from types package are solved:
Before
~/numba$ mypy -p numba.core.types

numba/core/types/abstract.py:24: error: Need type annotation for '_typecache' (hint: "_typecache: Dict[<type>, <type>] = ...")
numba/core/types/abstract.py:408: error: Need type annotation for 'ctor_map' (hint: "ctor_map: Dict[<type>, <type>] = ...")
Found 2 errors in 1 file (checked 10 source files)

after
~/numba$ mypy -p numba.core.types
Success: no issues found in 10 source files

This PR is a good start for typing annotation uses in Numba. TBH, I have a lot to learn to understand how to use type annotations successfully.
So to tryout, I turned on type checking on lowering.py to see what it can do. I don't understand why it is complaining about:
$ mypy  numba/core/lowering.py
numba/core/lowering.py:9: error: Module 'numba' has no attribute '_dynfunc'
Found 1 error in 1 file (checked 1 source file)

Secondly, I find lower_extensions : pt.Dict[type, pt.Callable[[pt.Type["Lower"], ir.Inst], None]] = {} very bad on readability.
Any thoughts?

full diff
diff --git a/mypy.ini b/mypy.ini
index 0b2ffdfa3..20ea81c85 100644
--- a/mypy.ini
+++ b/mypy.ini
@@ -4,7 +4,12 @@
 warn_unused_configs = True
 follow_imports = silent
 show_error_context = True
-files = **/numba/core/types/*.py, **/numba/core/datamodel/*.py, **/numba/core/rewrites/*.py, **/numba/core/unsafe/*.py
+files =
+    **/numba/core/types/*.py,
+    **/numba/core/datamodel/*.py,
+    **/numba/core/rewrites/*.py,
+    **/numba/core/unsafe/*.py,
+    **/numba/core/lowering.py,

 # Per-module options:
 # To classify a given module as Level 1, 2 or 3 it must be added both in files (variable above) and in the lists below.
@@ -50,3 +55,6 @@ ignore_missing_imports = True
 [mypy-winreg.*]
 # this can be removed after Mypy 0.78 is out with the latest typeshed
 ignore_missing_imports = True
+
+[mypy-pygments.*]
+ignore_missing_imports = True
\ No newline at end of file
diff --git a/numba/core/lowering.py b/numba/core/lowering.py
index a8da51e71..342ec2513 100644
--- a/numba/core/lowering.py
+++ b/numba/core/lowering.py
@@ -1,4 +1,5 @@
 import weakref
+import typing as pt
 from collections import namedtuple
 import operator
 from functools import partial
@@ -21,7 +22,7 @@ class Environment(_dynfunc.Environment):
     __slots__ = ('env_name', '__weakref__')
     # A weak-value dictionary to store live environment with env_name as the
     # key.
-    _memo = weakref.WeakValueDictionary()
+    _memo : weakref.WeakValueDictionary[str, Environment] = weakref.WeakValueDictionary()

     @classmethod
     def from_fndesc(cls, fndesc):
@@ -311,7 +312,7 @@ class BaseLower(object):

 # Dictionary mapping instruction class to its lowering function.
-lower_extensions = {}
+lower_extensions : pt.Dict[type, pt.Callable[[pt.Type["Lower"], ir.Inst], None]] = {}

 class Lower(BaseLower):

So to tryout, I turned on type checking on lowering.py to see what it can do. I don't understand why it is complaining about:
$ mypy  numba/core/lowering.py
numba/core/lowering.py:9: error: Module 'numba' has no attribute '_dynfunc'
Found 1 error in 1 file (checked 1 source file)

@sklam My guess would be that mypy doesn't support importing from C.  I think you could either add a # type: ignore[import] on that line or add a stub file for the C module.

Secondly, I find lower_extensions : pt.Dict[type, pt.Callable[[pt.Type["Lower"], ir.Inst], None]] = {} very bad on readability.

If the value type of that dict is a common pattern, you can use a type alias for it.

@sklam cool that you took it for a spin.
Regarding the readability issue, I've found that when the annotation gets hard to read, it's usually a good time to further define the internal API with a type alias (as Ethan mentioned). The combination of the type alias and a one liner explaining it is a great help to anyone trying to understand the code.
In this case, the Callable could be given an alias
# LoweringFunctions take a Lower instance and an instruction and do XXXXX
LoweringFunction = pt.Callable[["Lower", ir.Inst], None]

# Dictionary mapping instruction class to its lowering function.
lower_extensions: pt.Dict[type, LoweringFunction] = {}

I used "Lower" instead of pt.Type["Lower"], because if I'm reading this code right
            for _class, func in lower_extensions.items():
                if isinstance(inst, _class):
                    func(self, inst)

then the first argument of the function is an instance of Lower, and not a subclass.

Isn't the type there Dict[Type[T], Callable[[T, Instr], None]?

Actually even that isn't right, you need a dependently typed dict where the type of each value depends on it's key.

I was thinking the same, and almost wrote it like that. But I don't think there's a way to express that, ie a TypeVar whose value differs in every entry (as opposed to being the same for the whole dictionary).

Should we add mypy to the pre-commit hooks as well? https://github.com/pre-commit/mirrors-mypy

Should we add mypy to the pre-commit hooks as well?

I don't use pre-commit hooks, so I don't have an opinion about it.

We can worry about pre-commit hooks in a different PR. I think this PR is ready.

@eric-wieser @sklam
I think I found a way to type the lower_extensions  dictionary accurately. It would not be very readable, it would require a comment to explain what's going on, but if it was important to get mypy to check it accurately, this works
from typing import Type, TypeVar, Callable

class A:
    pass

class B(A):
    pass

T = TypeVar('T')

class SpecialDict(dict):
    def __new__(cls, *args, **kwargs):
        return dict(*args, **kwargs)

    def __setitem__(self, key: Type[T], value: Callable[[T, int], None]):
        return super().__setitem__(key, value)

foo = SpecialDict()

def myfuncA(x: A, y: int):
    pass

def myfuncB(x: B, y: int):
    pass

foo[A] = myfuncB # mypy error: error: Incompatible types in assignment (expression has type "Callable[[B, int], Any]", target has type "Callable[[A, int], None]")
foo[A] = myfuncA # OK
foo[B] = myfuncA # OK
foo[B] = myfuncB # OK


Create template/version rules for users created pre-upgrade

Addresses: https://github.com/rancher/rancher/issues/18318
GlobalRoleBinding lifecycle was creating roleBindings with Roles for catalogTemplates and catalogTemplateVersions, for all globalRoles that had rules for "templates" and "templateVersions" resources. But before this logic, there was a check to see if the clusterRoleBinding for the globalRoleBinding already exists, and if it did then this method was returning, before creation of roleBindings for catalogTemplates/versions happened. So users created prior to upgrade got escaped from this roleBinding creation and didn't get access to templates after upgrade. The upgrade case was first tested with admin, and since admin has access to all resources, this problem wasn't discovered

LGTM


Site is unclear on what workbox is

https://twitter.com/casperOne/status/871453875055865856

Kayce I think your overview actually fixes this bug: https://github.com/GoogleChrome/workbox-microsite/pull/79


Switch to JDK 11

Just replace the JDK 9 stuff with JDK 11, keep JDK 8.

(Extracted from https://github.com/lihaoyi/Ammonite/pull/891.)

Everyone's ok with that one? (@lihaoyi? @robby-phd, I see you added the JDK9 jobs?)


Hyper-V: Added 9 Runtime Memory Resize tests

@DivyaJyothiKasam please fill out description

I have Incorporated review comments and then pushed again

RUNTIME_MEM_HOTADD : PASS : 7.24
RUNTIME_MEM_REMOVE : PASS : 7.24
RUNTIME_MEM_SMALLINCREASE128 : PASS : 6.02
RUNTIME_MEM_SMALLDECREASE128 : PASS : 5.6
RUNTIME_MEM_SMALLINCREASE100 : PASS : 5.5
RUNTIME_MEM_SMALLDECREASE100 : PASS : 5.67
RUNTIME_MEM_MULTIPLEADDREMOVE : PASS : 8.75
RUNTIME_MEM_STRESSHOTREMOVE : PASS : 7.32
RUNTIME_MEM_HOTADD_REBOOT : PASS : 6.27

For the above  test cases summary is below:
Test Results Summary
VHD under test lisatestcentos7.5.vhd
ARM Image under test  :  :  :
Total Executed TestCases        9 (       9 Pass,        0 Fail,        0 Abort)
Total Execution Time(dd:hh:mm) 0:0:22
XML file: TestConfiguration
Logs can be found at .\TestResults\2018-10-10-14-52-09-0986

Test Results Summary
ICA test run on 10/22/2018 10:56:28
VHD under test lisatestcentos7.5.vhd
ARM Image under test  :  :  :
Total Executed TestCases         9 (        9 Pass,         0 Fail,         0 Abort)
Total Execution Time(dd:hh:mm) 0:1:14
XML file: TestConfiguration
#Sr. Test Name : Test Result : Test Duration (in minutes)

RUNTIME_MEM_HOTADD : PASS : 8.58
RUNTIME_MEM_HOTREMOVE : PASS : 7.21
RUNTIME_MEM_SMALLINCREASE128 : PASS : 8.2
RUNTIME_MEM_SMALLDECREASE128 : PASS : 8
RUNTIME_MEM_SMALLINCREASE100 : PASS : 8.13
RUNTIME_MEM_SMALLDECREASE100 : PASS : 8.01
RUNTIME_MEM_MULTIPLEADDREMOVE : PASS : 8.06
RUNTIME_MEM_STRESSHOTREMOVE : PASS : 8.07
RUNTIME_MEM_HOTADD_REBOOT : PASS : 10.24

Logs can be found at .\TestResults\2018-22-10-16-26-26-8054

@DivyaJyothiKasam conflicts need to be resolved

Resolved the conflicts and rebased the branch.

now it introduces some commits from other PRs in the commit history, the branch is not rebased properly. @DivyaJyothiKasam Can you fix this? Or you can re-create a clean PR

I have rebased and removed all other commits. Can you please check and merge.

@DivyaJyothiKasam please resolve the conflict so I can merge, thank you!

Resolved the conflict.


Add eventContextExtractor to enable chaining of spans between directly invoked lambdas ?

Issue https://github.com/open-telemetry/opentelemetry-js-contrib/issues/1363 describes the case where context propagation isn't working for lambdas directly invoking other lambda's.
Solution mentioned there is to add a eventContentExtractor to the AwsLambdaInstrumentation.
        eventContextExtractor: (event, context) => {
          const eventContext = propagation.extract(otelContext.active(), context.clientContext?.Custom);

          return eventContext;
        },

The default extractor relied on in this implementation does something else compared to the one mentioned in the issue linked above.
Can we include the solution mentioned in the ticket above to support tracing for directly invoked lambda's?
Relevant line in the wrapper: https://github.com/signalfx/splunk-otel-lambda/blob/cd150c55d352baa51309f156ed56b3dff4bdf914/nodejs/src/wrapper.ts#L105

This is addressed in #313

Yep, thanks for digging into that!


⚠ Bofrost.be has degraded performance

In c517ea3, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1177 ms

Resolved: Bofrost.be performance has improved in a94e519.


Setup Regular Logging of Attack Surface Data

💡 Summary
Setup database to record attack surface metrics for all organizations on a regular basis
Motivation and context
We need to start building up data on organizations' attack surface so we can include it as a key metric/trending in the future.
Implementation notes

Having the attack surface data for all orgs is essential to our scorecard and normalization
Having a historical record of attack surface data is essential to trending analysis
Collecting attack surface data for orgs we don't report on would require tweaking data source settings (cybersix, shodan, etc.)

Acceptance criteria

[X] Implement SQL view to gather all attack surface data (# of domains/ips/ports) for all orgs
[X] Setup table in PE staging database to hold the attack surface data
[X] Attack surface data for orgs PE reports on is logged in the 'report_summary_stats' table every report period run

Confirmed that attack surface data is being recorded for all 133 orgs in the report_summary_stats database table. Attack surface data is recorded every time the report generation process is run.


3555 address skipped tests

Resolves #3555
The PR adds missing tests and fixes broken ones.
Additionally, it removes some dead code:

after_sign_in_path_for method in ApplicationHelper
ItemCategories#index action

Description

Type of change

Bug fix (non-breaking change which fixes an issue)

Thanks for the review! It should pass now. Let's see :)

Looks good! Thanks!


Quaternion rotations still aren't quite right.

There seems to be a problem with a rotation that is generated purely by the Quaternion class.

Sorted with #231