SDk for ios

I don't see any SDK for ios ? any clue if thats going to be released.

Hi,
It has been 1 year since this was requested. How is it possible to not have iOS support yet?

@MushMal is there any update on the ios sdk? @unicornss

We are looking at the customer feedback to prioritize this work. Nothing concrete yet. As per my message above - many customers just compile the existing SDK for iOS

Hello,
I am working on a solution that requires support of Kinesis video for IOS. Can you provide details about the procedure to convert the code from C++ to objective-C / swift? Thanks!

@aeperaltan unfortunately, we don't have an example of binding to objective-c/swift for the core SDK. I would imagine that you could simply use the core of the SDK as is - native and write high-level binding for the public APIs like create stream and put frame that you can use in your application.

@aeperaltan unfortunately, we don't have an example of binding to objective-c/swift for the core SDK. I would imagine that you could simply use the core of the SDK as is - native and write high-level binding for the public APIs like create stream and put frame that you can use in your application.

Thank you for the quick response. By the way, is it possible to know if publishing the IOS SDK for Kinesis video is in the roadmap? Regards.

@aeperaltan, unfortunately, we don't have any timelines for the iOS SDK. We are still evaluating the market for the iOS SDK and it's feature set.

Hello,
I am working on a solution that requires support of Kinesis video for IOS. Can you provide details about the procedure to convert the code from C++ to objective-C / swift? Thanks!

Hey, Did you find anything useful for video streaming channel? or library that we can use?

@MushMal : In the meanwhile, the code itself can be compiled for iOS using pre-compiled dependencies like curl/ssl/gstreamer/log4cpus/etc... from existing repositories in the web. The code itself for the SDK will be the same but the dependencies and the sample apps would be different in this case.
It will of great help, if you could provide us with simple step by step guide to achieving the same in iOS till you release an iOS Specific library. It would save a ton of time for us figuring out things.

hi @MushMal . . .  i looked around the web. . . there is no single clue, example, stackoverflow question about this topic. . . https://github.com/awslabs/amazon-kinesis-video-streams-webrtc-sdk-android/issues/36 here sir you suggested to use either WebRTC and create a seperate channel or use C/C++ producer library. . . kindly provide atleast some data that can help us get started. . .
Kindly shed some light on how "many customers just compile the existing SDK for iOS" can be done. . .

Unfortunately, I don't have an example. We currently don't support iOS as a platform. The code is quite portable and people can create build scripts to compile for iOS and a think Objective-C or SWIFT layer can be written to wrap around it.
I don't have any further pointers on this. Perhaps other members of the community could chime in?

Respected @ketansweta @Sneakr @kdjani @aeperaltan  @Salarsoleimani @Ankish . . . if you haven't found the solution yet kindly thumbs up this question. . .
and if sir you have found the solution, if there is possibility of sharing, kindly do the same. . .

Hello @ketansweta @Sneakr @aeperaltan @Salarsoleimani @Ankish ...
I am working on a solution that requires support of Kinesis video for IOS.
Any one of you provide me procedure to convert the code from C++ to objective-C / swift?
I am also trying to connect with Support, Yet not get any reply... Very disappointed.
Please help to find out solution..

"Platform Independent Codebase (PIC)" to "iOS"
or
"amazon-kinesis-video-streams-producer-c" to "iOS"
is not working. kindly provide updates if any.


[FEATURE REQUEST] Add cli

https://replugged.dev/download#manual
We may make a standalone Linux CLI-based installer at some point in the future, but this repository is only for the GUI installer app.


Top-level setting page UI v2 update

Resolve #1031 #993 #994
Fix #1012
Fix #1013
Subtask:

[x] Update v2 design for top-level setting page
[x] Update modal for top-level setting page
[x] Update v2 design for help page
[x] Update v2 design for about page
[x] Update v2 design for license

Screenshots

This PR doesn't seem to solve https://github.com/planetdecred/godcr/issues/994 as stated

This PR links to a PR that closes https://github.com/planetdecred/godcr/issues/993, but the issue is also not resolved here, there's also a new mockup for said issue here https://www.figma.com/file/e0cYaAzkXyXXPY00v23cQY/GoDCR-%26- DCRMobile?node-id=4659%3A182253

@dreacot
The design of the top level setting has been changed, the functions divided for the wallet setting page, issues #993 and #994 are no longer needed and should be closed under this PR.

On the about page, the license row blends into the background when hovered, maybe adding a shadow could help (this only happens in light mode)

I think we should change all hover color, because all button in app occur and it is other issue

On the about page, the license row blends into the background when hovered, maybe adding a shadow could help (this only happens in light mode)

I think we should change all hover color, because all button in app occur and it is other issue

I agree, an issue for created for this and it can be treated separately

Please correct the layout of the license page:

vs

Also, I think the color of the text we have on the license page is lighter than what we have on the mockup.
Mockup -- Godcr

Also, I think the color of the text we have on the license page is lighter than what we have on the mockup.
Mockup -- Godcr

it's done


Geometry System Refactor: Audit existing test infrastructure

overview
Existing tests for labware/placeable are poorly designed, and it is unclear which tests are valid and what desireable behaviors are actually being tested. Tests on labware and placeables should be reviewed to determine which should be fixed or deleted. Also, we should create and document a structured plan for testing labware as we build the new labware definition system.

Most tests just need to be revised to use the new style wells, rows, and columns methods. The generate_plate test helper should be removed, and tests on Labware should be consolidated into a single directory (from "containers", "database", "helpers", "integration", "labware", "protocols", "server", and "robot"). Added some TODO statements to related tests as relevant to this milestone.


Current stable Ruby is 2.3.3

Add (or switch 2.3.1) to 2.3.3 to travis.
Also upgrade Ruby versions on agent & master images.
Or wait for 2.4.0.

Travis seems to use 2.3.3 now?
Close?


Synthesis for jtag-probe fails with latest YoWASP Yosys

Using yowasp-yosys 0.23.dev444 (the version that is installed with no additional action taken), synthesis fails when running as a part of glasgow build --rev C2 jtag-probe:
(beginning of log omitted)
2.4. Executing FLATTEN pass (flatten design).
<suppressed ~6 debug messages>
ERROR: Cell port out_fifo_0.inner.$2 is driving constant bits: { 7'0000000 \inner_None$8 } <= { 7'0000000 $flatten\inner.$1 }

The archive with the build tree is attached here: glasgow_sm98_a5s.zip
Also, it would be nice if the debug argument of BuildPlan.execute would be settable from the command line. I had to apply the following diff to retain the build tree above:
diff --git a/software/glasgow/cli.py b/software/glasgow/cli.py
index f401033..ecc86f1 100644
--- a/software/glasgow/cli.py
+++ b/software/glasgow/cli.py
@@ -770,7 +770,7 @@ async def _main():
                 logger.info("building bitstream for applet %r", args.applet)
                 with open(args.filename or args.applet + ".bin", "wb") as f:
                     f.write(plan.bitstream_id)
-                    f.write(plan.execute())
+                    f.write(plan.execute(debug=True))

         if args.action == "test":
             logger.info("testing applet %r", args.applet)

It also fails, with the same error, as far back as yowasp-yosys 0.9.post5623.dev231, so the issue might not be Yosys version dependent.

Looks like the build_top.sh file, when generated on Windows, is written with CRLF line endings, and so sh doesn't run it. I've filed this as https://github.com/amaranth-lang/amaranth/issues/732.

Other than that, I can reproduce the issue with the archive you attached, but not with Glasgow installed in a fresh venv on Linux. Can you describe your environment in more detail?

I'm using Python 3.11.1 (tags/v3.11.1:a7a450f, Dec  6 2022, 19:58:39) [MSC v.1934 64 bit (AMD64)] on win32. The output of pip freeze is:
aiohttp==3.8.3
aiosignal==1.3.1
amaranth==0.3
amaranth-yosys==0.10.0.dev47
appdirs==1.4.4
async-timeout==4.0.2
attrs==22.1.0
bitarray==2.6.0
charset-normalizer==2.1.1
crcmod==1.7
frozenlist==1.3.3
fx2==0.9
-e git+https://github.com/GlasgowEmbedded/glasgow@b8051ad39cf608cf52adf6111892d9510b4420ab#egg=glasgow&subdirectory=software
idna==3.4
Jinja2==2.11.3
libusb1==3.0.0
MarkupSafe==1.1.1
multidict==6.0.3
pyvcd==0.2.4
wasmtime==0.30.0
yarl==1.8.2
yowasp-nextpnr-ice40==0.4.post25.dev361
yowasp-yosys==0.23.dev444

After removing the src attributes, it looks like there is some difference in the IL where wires end up with internal $-names rather than \\-names:
@@ -60,8 +60,8 @@
       update \stage1 \stage1$next
   end
   process $group_2
-    assign $1 1'0
-    assign $1 \stage1
+    assign \sda_i 1'0
+    assign \sda_i \stage1
     sync init
   end
 end

This is likely to affect the flatten pass. The reason names end up missing are probably bytecode changes in Python 3.11. Can you recheck with 3.9 or 3.10?

I get a different crash with Python 3.10.9 (tags/v3.10.9:1dd9be6, Dec  6 2022, 20:01:21) [MSC v.1934 64 bit (AMD64)] on win32 and YoWASP Yosys:
I: glasgow.cli: building bitstream for applet 'jtag-probe'
ERROR: Assert `ofs.is_open()' failed in ../yosys-src/passes/techmap/abc9_ops.cc:950.
I: glasgow.target.hardware: keeping build tree as C:\Users\Maya\AppData\Local\Temp\glasgow_lfow7thr
Traceback (most recent call last):
  File "C:\Users\Maya\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "C:\Users\Maya\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "C:\Users\Maya\Desktop\glasgow\software\glasgow\cli.py", line 861, in <module>
    main()
  File "C:\Users\Maya\Desktop\glasgow\software\glasgow\cli.py", line 857, in main
    exit(loop.run_until_complete(_main()))
  File "C:\Users\Maya\AppData\Local\Programs\Python\Python310\lib\asyncio\base_events.py", line 649, in run_until_complete
    return future.result()
  File "C:\Users\Maya\Desktop\glasgow\software\glasgow\cli.py", line 773, in _main
    f.write(plan.execute(debug=True))
  File "C:\Users\Maya\Desktop\glasgow\software\glasgow\target\hardware.py", line 118, in execute
    products  = self.lower.execute_local(build_dir)
  File "C:\Users\Maya\AppData\Local\Programs\Python\Python310\lib\site-packages\amaranth\build\run.py", line 96, in execute_local
    subprocess.check_call(["cmd", "/c", "call {}.bat".format(self.script)])
  File "C:\Users\Maya\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['cmd', '/c', 'call build_top.bat']' returned non-zero exit status 1.

Sigh...

It looks like abc is failing to write a LUT library:
void write_lut(RTLIL::Module *module, const std::string &dst) {
	std::ofstream ofs(dst);
	log_assert(ofs.is_open());
	ofs << module->design->scratchpad_get_string("abc9_ops.lut_library");
	ofs.close();
}

Probably because the path is wrong or something?

Hey @mwkmwkmwk, can you please take a look at the netlist in glasgow_sm98_a5s.zip please and say if there's a reason the flatten pass should be failing on it?

Amaranth is using $13 as an autogenerated port name. Unfortunately, yosys has the convention that ports called $<number>"are actually positional parameters, so cell port called $13 will actually bind to, say, wire width 4 input 13 \fx2_0__flag__i1.
I highly suggest choosing a different naming convention.

Oh, and by the way, this only happens when the $<number> actually happens to be a valid port number — you may get lucky if the autogenerated name is high enough.

I can build a bitstream with the build tree from glasgow_lfow7thr.zip on Linux, so it looks like there are at least three bugs here:

Amaranth not inferring names for signals properly on Python 3.11;

The version of amaranth here seems to be 0.3, which is earlier than 851546bf2d16db62663d7002bece51f07078d0a5 that adds Python 3.11 support — could you retest with current git main?

I've retested with Amaranth version 0.4.dev36+ge3b2ba4(installed viapip install git+https://github.com/amaranth-lang/amaranth.git); glasgow build --rev C2 jtag-probe` succeeds with yowasp-yosys version 0.23.dev444.

Of issues described in https://github.com/GlasgowEmbedded/glasgow/issues/298#issuecomment-1355933818:

(1) was already fixed upstream;
(2) is an Amaranth issue that was fixed upstream;
(3) is a consequence of (2), probably because there's a comb loop or something;
(4) isn't a cause of bugs here and is tracked upstream.

I think this is done now. Thanks for the report.

@mwkmwkmwk So I've never actually aimed to create ports with $\d+ names, it was an invariant violation elsewhere.


Update TikTok API

Thanks for updating API。

After I merged your PR, the new API still can't work. As i test, There returned empty from new API.

After I merged your PR, the new API still can't work. As i test, There returned empty from new API.

The new API is tested and work
https://api.douyin.wtf/api?url=https://www.tiktok.com/t/ZTdE3d4m6/?k=1
https://api.tiktokv.com/aweme/v1/aweme/detail/?aweme_id=7082200610367360283
Check my repo:
https://github.com/Evil0ctal/Douyin_TikTok_Download_API

Can I have your wechat to have efficient talk?

Can I have your wechat to have efficient talk?

Ok

I got the reason. need remove [ ] from old API.


Set logging = true for all editors

Discussed in #120 (starting here).
Perhaps make logging true (or "on") by default for all editors. Currently it is only on by default for vs code.

#123 the logging is turned on. I don't know what else can be done.

Thanks for the contribution @WhoIsSethDaniel. This is now available in npm in version 0.8.9


Update demo requirements

Codecov Report

Merging #1551 (89e94e1) into main (7422b3c) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main    #1551   +/-   ##
=======================================
  Coverage   95.69%   95.69%
=======================================
  Files         527      527
  Lines       32400    32400
=======================================
  Hits        31005    31005
  Misses       1395     1395


How to downlod it

https://github.com/Metabolix/HackBGRT/releases

Download the release file not the source code


Currently pdf when open in new tab displays angular logo as favicon, can it be changed

Attach (recommended) or Link to PDF file here:
Configuration:

Web browser and its version:
Operating system and its version:
PDF.js version:
Is a browser extension:

Steps to reproduce the problem:
1.
2.
What is the expected behavior? (add screenshot)
What went wrong? (add screenshot)
Link to a viewer (if hosted on a site other than mozilla.github.io/pdf.js or as Firefox/Chrome extension):

The favicon is specified by the server, hence this isn't a valid PDF.js issue (note also below).
For future reference: When opening an issue, you need to provide all of the information requested in https://github.com/mozilla/pdf.js/blob/master/.github/ISSUE_TEMPLATE.md


Validator: mode multi-line

Check how this setting is treated. It must be an ERROR, I think.

Fixed in #177


Issue with click on dropdown item

Just noticed that if you click on an item of the dropdown and don't release the mouse button immediatly (literally) the dropdown close without adding the tag. You have to click very fast to make it work; which is a bit annoying.
You can easily reproduce the issue on the online demo.
It happens in my code too.

Fixed in 1.2.1

actually I realized that the mousedown event was causing the lost of focus on the searchInput. I even cleaned up things a little bit in 1.2.2 which should be even better


Using a mountebank replacement (installed from Github for now).

WHAT
As Mountebank is being deprecated we're looking into moving off it.  As my firebreak project I've been building a drop-in replacement (which we can change over time to work more like we want it to work).  This PR proves that the tests can pass using my replacement.
HOW
My replacement has a git repo: https://github.com/alphagov/http-configurable-mock-server and I'd ideally like it to go through a code review before releasing it on NPM but at the moment it's installed directly from Github.
(related to https://github.com/alphagov/pay-selfservice/pull/4281 and https://github.com/alphagov/pay-frontend/pull/3910)

Closing as this was a placeholder for the real thing that's just been merged.


Week7 Developer Guide: Add use case for

Codecov Report

Merging #30 (b4579e0) into master (0617af5) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master      #30   +/-   ##
=========================================
  Coverage     72.15%   72.15%
  Complexity      399      399
=========================================
  Files            70       70
  Lines          1232     1232
  Branches        125      125
=========================================
  Hits            889      889
  Misses          311      311
  Partials         32       32

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0617af5...b4579e0. Read the comment docs.


tedge_mapper c8y panics when wrong command path is provided in log file request operation

Describe the bug
If the command path is invalid, the tedge_mapper c8y panics after it receives a log file request operation from Cumulocity.
[exec]
topic = "c8y/s/ds"
on_message = "522"
command = "/usr/bin/tedge_logfile_request_plugin"

The problem is unwrap() here.
https://github.com/thin-edge/thin-edge.io/blob/main/crates/core/tedge_mapper/src/c8y/converter.rs#L590
To Reproduce

Configure invalid command path in /etc/tedge/operations/c8y/c8y_LogfileRequest.
Run tedge_mapper c8y
Trigger a log file request from Cumulocity.

Expected behavior
No panic. No core dump.
Screenshots

Environment (please complete the following information):

OS [incl. version]
Hardware [incl. revision]
System-Architecture [e.g. result of "uname -a"]
thin-edge.io version 0.5.3

Log the error to tedge-mapper-c8y service
Send an error back to Cumulocity (the operation should be marked EXECUTING -> FAILED)

Note: if the execution fails, e.g. permission denied, this case also should be handled by this mechanism.


Update README.md

Can one of the admins verify this patch?

test

@jane-doe this pull request is for testing

please do not merge it

test


How to calculate the common public key and resultant final signature?

In the example.go of frost.keyGen function, I've successfully received the partial the key config of each parties. I'd like to know how to combine them to get the common public key of a keyGen process. and signTransaction as well, I;ve received the partial signatures generated from each party. I'ld like to know the resultant final aggregrated final signature

Hey @ThantZin-develope ! I hope you're doing well. I want to generate Ethereum address from the public key and not being able to retrieve it. I read somewhere that the r.(*cmp.Config).PublicPoint()function returns the public key, but its output is as follows:
&{{{[12592655 16781683 10822834 12300466 26973595 26950003 20773628 44589891 15684115 2487632]} {[8737552 54784308 53761210 13758320 57903304 54340575 43964877 39572907 59768444 2127229]} {[16345148 53694071 40827578 35152206 19151206 8418008 32231902 13881133 64847501 846021]}}}
keygen  &{{{[32708375 42551501 65047894 39740003 35144499 14005502 40612690 46015214 22239522 2773756]} {[25477995 13108925 52126466 39235989 28278852 35154078 44428883 22064819 35331873 929806]} {[21566372 10761659 8474927 25003733 66756683 61795828 13810381 7172486 19023670 3610546]}}}
keygen  &{{{[25688337 63875463 10866135 31637987 7569351 63240784 37461504 54980759 66091033 2623583]} {[44236742 23246230 26880624 1243741 14396485 1134731 13343978 1163813 33263876 3283408]} {[119210 58475678 20658911 5621745 64273730 66878327 24229721 1561908 58372961 2601431]}}}

If the output shared above is public key how can I generate Ethereum address from it? Also, the output will change after the CMPRefresh() function is called. Can you please help me in this regard?


Remove reusable workflow

Coverage remained the same at 100.0% when pulling 7d81724804bb4f668fce290ebd14c53ca53355cb on remove_reusable_workflow into 4de03cfcdb8be1172f81f80e02a19566ac702876 on master.


Dev VM not syncing up the local changes

We are not able to hot load the changes into dev vm. The ./sync scrip is not syncing up the changes to the dev vm. Testing the changes becomes difficult without this as we have to build the package and test.
Acceptance criteria

[ ] The ./sync script should be fixed or create an issue to fix the sync utility in the future.
[ ]  If an issue is create to fix the sync utility in the future there must be a work around to load the local changes without having to package.
[ ] run the erchef console and make some updates locally, confirm that those are reflected in the console.

Basic loading for erchef works - might need to change branches from master to main.


Typo

"... this more is called" should be "this mode is called"

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 918404cb-28b0-1624-da04-c992bfca4395
Version Independent ID: 20df39b5-a4db-3065-a172-5a90d27909fb
Content: Data binding in depth - UWP app developer
Content Source: windows-apps-src/data-binding/data-binding-in-depth.md
Product: uwp
GitHub Login: @stevewhims
Microsoft Alias: stwhi

Looks like this is being taken care of in https://github.com/MicrosoftDocs/windows-uwp/pull/1174#pullrequestreview-171748761.

...and that's approved and merged. Thanks for fixing this, @vbandi!
~Steve


sourceProtocol do not work

Which version are you using?
v0.17.3
Which operating system are you using?

OS

[*] Linux
[ ] Windows
[ ] macOS

Architecture

[*] amd64
[ ] arm64
[ ] arm7
[ ] arm6

Describe the issue
config file:
paths:
test1:
source: rtsp://<IP_ADDRESS>:8001
sourceOnDemand: yes
sourceProtocol: udp
Describe how to replicate the issue
logs:
2021/09/23 15:32:55 I [0/0] rtsp-simple-server v0.17.3
2021/09/23 15:32:55 I [0/0] [path test1] created
2021/09/23 15:32:55 I [0/0] [path test1] [rtsp source] started
2021/09/23 15:32:55 D [0/0] [path test1] [rtsp source] connecting
2021/09/23 15:32:55 I [0/0] [path test1] [rtsp source] ERR: dial tcp <IP_ADDRESS>:8001: connect: network is unreachable
2021/09/23 15:32:55 I [0/0] [RTSP] UDP/RTP listener opened on :8000
2021/09/23 15:32:55 I [0/0] [RTSP] UDP/RTCP listener opened on :8001
2021/09/23 15:32:55 I [0/0] [RTSP] TCP listener opened on :8554
2021/09/23 15:32:55 I [0/0] [RTMP] listener opened on :1935
2021/09/23 15:32:55 I [0/0] [HLS] listener opened on :8888
2021/09/23 15:33:00 D [0/0] [path test1] [rtsp source] connecting
2021/09/23 15:33:00 I [0/0] [path test1] [rtsp source] ERR: dial tcp <IP_ADDRESS>:8001: connect: network is unreachable
2021/09/23 15:33:05 D [0/0] [path test1] [rtsp source] connecting
2021/09/23 15:33:05 I [0/0] [path test1] [rtsp source] ERR: dial tcp <IP_ADDRESS>:8001: connect: network is unreachable
2021/09/23 15:33:10 D [0/0] [path test1] [rtsp source] connecting
2021/09/23 15:33:10 I [0/0] [path test1] [rtsp source] ERR: dial tcp <IP_ADDRESS>:8001: connect: network is unreachable
Did you attach a network dump?
no

Hello, in my opinion you're trying to read a RTP stream instead of a RTSP stream, and this is not supported.
A RTP stream also needs a .sdp file that contains the track list and the codec of each track.
RTSP performs this operation automatically during the handshake, and then makes a RTP stream available to the client.
In my opinion you can use ffmpeg to read the RTP stream, by using an .sdp file, and then send this stream to the server with RTSP; the command like could be this (but i'm not sure):
ffmpeg -re -i mysdp.sdp -c copy -f rtsp rtsp://localhost:8554/mystream

OK, get it, thanks!


Loosing scroll functionality for mouse

Hyprland Version
 System/Version info
Hyprland, built from branch HEAD at commit 84ab8d11e8951a6551d1e1bf87796a8589da6d47  (props: bump ver to 0.35.0).
Date: Mon Feb 5 01:59:02 2024
Tag: v0.35.0

flags: (if any)

System Information:
System name: Linux
Node name: archwork
Release: 6.7.9-arch1-1
Version: #1 SMP PREEMPT_DYNAMIC Fri, 08 Mar 2024 01:59:01 +0000

GPU information:
01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GA102 [GeForce RTX 3080 Lite Hash Rate] [10de:2216] (rev a1) (prog-if 00 [VGA controller])

os-release: NAME="Arch Linux"
PRETTY_NAME="Arch Linux"
ID=arch
BUILD_ID=rolling
ANSI_COLOR="38;2;23;147;209"
HOME_URL="https://archlinux.org/"
DOCUMENTATION_URL="https://wiki.archlinux.org/"
SUPPORT_URL="https://bbs.archlinux.org/"
BUG_REPORT_URL="https://gitlab.archlinux.org/groups/archlinux/-/issues"
PRIVACY_POLICY_URL="https://terms.archlinux.org/docs/privacy-policy/"
LOGO=archlinux-logo

plugins:

Bug or Regression?
Bug
Description
I'm using the Microsoft arc mouse for hyprland. Suddenly I do have the effect that I loose the ability to scroll in windows by moving the middle mouse button up or down. I've connected my logitech mouse which has no problem. So I guess it's related to bluetooth and perhaps the mouse itself? I'm unable to tell where this effect comes from. I can use the logitech mouse instead, so it's no major issue. I've searched the issues, but couldn't find any similar issue. So I filed it...
How to reproduce
Use microsoft arc mouse for a while. After some time the middle mouse button does no longer scroll active window. Regardless what applliction window that is.
Crash reports, logs, images, videos
No response

please test on -git, you're on a very outdated version

Hi, will do so. Thanks!


Never return None from MemoryCacheStruct

We can either change the default value (as done here) or have a check for None in all parts of the code that use this cache struct as an iterable. I think it's much cleaner this one, and this cache should always cache some sort of iterable object.
Just to give some background, this caused all the agents to break (JobSubmitter) during the cmsweb upgrade, since it can return None in case of exception not raised:
https://github.com/dmwm/WMCore/blob/master/src/python/WMCore/Cache/GenericDataCache.py#L38
this was the traceback:
2017-02-07 11:34:27,369:139733011392256:INFO:Harness:>>>Terminating worker threads
2017-02-07 11:34:27,380:139733011392256:ERROR:BaseWorkerThread:Error in event loop (2): <WMComponent.JobSubmitter.JobSubmitterPoller.JobSubmitterPoller instance at 0x7f16292a4cf8> JobSubmitterPollerException
Message: Fatal error in JobSubmitter:
argument of type 'NoneType' is not iterable

        ModuleName : WMComponent.JobSubmitter.JobSubmitterPoller
        MethodName : algorithm
        ClassInstance : None
        FileName : /data/srv/wmagent/v1.0.21.patch1/sw/slc6_amd64_gcc493/cms/wmagent/1.0.21.patch1/lib/python2.7/site-packages/WMComponent/JobSubmitter/JobSubmitterPoller.py
        ClassName : None
        LineNumber : 707
        ErrorNr : 0

Traceback:
  File "/data/srv/wmagent/v1.0.21.patch1/sw/slc6_amd64_gcc493/cms/wmagent/1.0.21.patch1/lib/python2.7/site-packages/WMComponent/JobSubmitter/JobSubmitterPoller.py", line 691, in algorithm
    self.refreshCache()

  File "/data/srv/wmagent/v1.0.21.patch1/sw/slc6_amd64_gcc493/cms/wmagent/1.0.21.patch1/lib/python2.7/site-packages/WMComponent/JobSubmitter/JobSubmitterPoller.py", line 249, in refreshCache
    if (newJob['request_name'] in abortedAndForceCompleteRequests) and \

Backtrace:
  File "/data/srv/wmagent/v1.0.21.patch1/sw/slc6_amd64_gcc493/cms/wmagent/1.0.21.patch1/lib/python2.7/site-packages/WMCore/WorkerThreads/BaseWorkerThread.py", line 206, in __call__
    raise ex

2017-02-07 11:34:27,380:139733011392256:INFO:BaseWorkerThread:Worker thread <WMComponent.JobSubmitter.JobSubmitterPoller.JobSubmitterPoller instance at 0x7f16292a4cf8> terminated

The reason why default value is None is that it doesn't enforce the data type it stores, It could be dictionary, list, string, object or anything. However practically it would be either list or dict.
It might be better to caller to define default value and pass it to the function.

The test that is failing is DQMHarvest (I'll fix it tomorrow). @ticoann can you check whether this is what you suggested? Or should we define the default value from the very top (from each of the components using this cache)?

test this please

test this please

@ericvaandering, Eric it seems the Jenkins test got stuck on this one.


Fix typo

good spot, I forgot to restart my server to test this, d'oh!

yep, tests would be a nice plan. If I ever get round to looking at travis, docker, or similar, I'll set some up haha :laughing:

travis is IMO easy, i have no clue how to write tests for javascript UI Code :-(

I looked into using chromedriver some time ago to make Javascript tests:
https://github.com/juhasch/IPython-notebook-extensions/tree/feature/tests/tests
It would be some work to do this all nb extensions. But maybe it would be a good start to see if they load at all. Also, testing the Python nbconvert filters should not be so difficult.I believe I had something some time ago.
Travis sounds good, once there are at least a few tests.

Btw. @jcb91: I think it would be a good idea to have you in the ipython-contrib team.
@JanSchulz: What do you think ?

@juhasch +1

:smile: thanks! @juhasch yeah, doing everything through chromedriver might be a bit labour-intensive! I think the jupyter-notebook repo uses PhantomJS (see https://github.com/jupyter/notebook/tree/master/notebook/tests), which seems like it might be worth piggybacking on - it looks like their testing script is pretty long, but maybe we might do something similar largely by copy-and-paste (!) :laughing:


Inconsistent naming across exchange markets

HitBTC exchange has both DASH/BTC and DSH/BTC pairs with different prices. I'd expect naming pair would be consistent across various markers, however following code proves me otherwise:
import ccxt
h = ccxt.bitfinex()
h.load_products()
pp.pprint(h.fetch_ticker("DSH/BTC"))

k = ccxt.hitbtc()
k.load_products()
pp.pprint(k.fetch_ticker("DSH/BTC"))

Output:
{'ask': 0.081222,
 'average': 0.080965,
 'baseVolume': None,
 'bid': 0.080708,
 'change': None,
 'close': None,
 'datetime': '2017-07-06T15:21:00.000Z',
 'first': None,
 'high': 0.087383,
 'info': {'ask': '0.081222',
          'bid': '0.080708',
          'high': '0.087383',
          'last_price': '0.080573',
          'low': '0.07499',
          'mid': '0.080965',
          'timestamp': '1499354460.27357124',
          'volume': '11299.25037405'},
 'last': 0.080573,
 'low': 0.07499,
 'open': None,
 'percentage': None,
 'quoteVolume': 11299.25037405,
 'timestamp':<PHONE_NUMBER>273.5713,
 'vwap': None}
{'ask': 1.2085e-05,
 'average': None,
 'baseVolume': 11216.0,
 'bid': 1.2023e-05,
 'change': None,
 'close': None,
 'datetime': '2017-07-06T15:21:00.000Z',
 'first': None,
 'high': 1.2999e-05,
 'info': {'ask': '0.000012085',
          'bid': '0.000012023',
          'high': '0.000012999',
          'last': '0.000012085',
          'low': '0.000012023',
          'open': '0.000012015',
          'timestamp':<PHONE_NUMBER>429,
          'volume': '11216',
          'volume_quote': '0.000000000'},
 'last': 1.2085e-05,
 'low': 1.2023e-05,
 'open': 1.2015e-05,
 'percentage': None,
 'quoteVolume': 0.0,
 'timestamp':<PHONE_NUMBER>429,
 'vwap': None}

Also with HitBTC I get a lot of internal server errors when querying their API via this library.

This is not inconsistency actually, DSH and DASH are not the same currency/token. You should probably google it first,  but if you do, you are likely to find mixed information about both in one search query.
As written here:
https://minergate.com/blog/dashcoin-and-dash/
These are two totally different currencies with similar names. Dash was launched as XCoin in January 18, 2014, and 10 days later was rebranded as Darkcoin. On March 26, 2015 Darkcoin was renamed to Dash. Partly in order to gain over Dashcoin users and partly to expand the brand, and that was the time when this confusion began.
Dash (DASH) is a coin based on X11 algorithm. It’s a system which consists of 11 chain hashing algorithms for the-proof-of-work. Another feature of Dash is Darksend, a special scheme which allows you to always stay anonymous. Dash is designed for powerful CPUs.
How to distinguish

Pay attention to the logo.
dashcoin:

Dash:

Mind the initial letter of a wallet address. A Dashcoin wallet always starts with the letter ’d’, while a Dash one starts with an ‘x ‘, which is the legacy of its first title XCoin.

Notice the ticker, an abbreviated cryptocurrency name. Dashcoin is referred to as DSH, whereas Dash is known as DASH. It’s pretty simple: the longest name has the shortest ticker.

Finally, you may explore the currencies’ official websites and accounts in social media.

Official Dashcoin website http://dashcoin.info/
Official Dash website https://www.dash.org/

Nevertheless, I expect that naming scheme be consistent under different markets, that is if I ask for DSH/BTC pair in one market, I'll get same pair on other markets too.

It's not in issue whether there exist DASH and DSH, but the naming consistency across markets.

There's also reverse pair naming in different markets with similar ask/bid/last price:
import ccxt
h = ccxt.kraken()
h.load_products()
pp.pprint(h.fetch_ticker("ETH/BTC"))

k = ccxt.bittrex()
k.load_products()
pp.pprint(k.fetch_ticker("BTC/ETH"))

Output:
{'ask': 0.102895,
 'average': None,
 'baseVolume': None,
 'bid': 0.102745,
 'change': None,
 'close': None,
 'datetime': '2017-07-06T15:57:31.000Z',
 'first': None,
 'high': 0.105472,
 'info': {'a': ['0.102895', '3', '3.000'],
          'b': ['0.102745', '30', '30.000'],
          'c': ['0.102896', '1.50000000'],
          'h': ['0.105472', '0.105472'],
          'l': ['0.100500', '0.099300'],
          'o': '0.102000',
          'p': ['0.103227', '0.100233'],
          't': [4984, 8575],
          'v': ['18455.17522042', '30599.50119370']},
 'last': 0.102896,
 'low': 0.0993,
 'open': 0.102,
 'percentage': None,
 'quoteVolume': 30599.5011937,
 'timestamp':<PHONE_NUMBER>937,
 'vwap': 0.100233}
{'ask': 0.10309993,
 'average': None,
 'baseVolume': None,
 'bid': 0.10300001,
 'change': None,
 'close': None,
 'datetime': '2017-07-06T15:53:59.000Z',
 'first': None,
 'high': 0.1055,
 'info': {'Ask': 0.10309993,
          'BaseVolume': 3300.39366237,
          'Bid': 0.10300001,
          'Created': '2015-08-14T09:02:24.817',
          'High': 0.1055,
          'Last': 0.10300001,
          'Low': 0.099485,
          'MarketName': 'BTC-ETH',
          'OpenBuyOrders': 5491,
          'OpenSellOrders': 11723,
          'PrevDay': 0.10000201,
          'TimeStamp': '2017-07-06T15:53:59.59',
          'Volume': 32130.16436321},
 'last': 0.10300001,
 'low': 0.099485,
 'open': None,
 'percentage': None,
 'quoteVolume': 32130.16436321,
 'timestamp':<PHONE_NUMBER>000,
 'vwap': None}

If I reverse the arguments under any market it screams with some exceptions, depending on where it breaks.

When you ask for DSH/BTC from Bitfinex and then ask DSH/BTC from HitBTC, you are getting the same pair. But notice that the HitBTC DSH volume is 0.0, meaning that the price for DSH/BTC may be outdated there (this is what their API gives). Whereas on Bitfinex the price is up to date.
As for reverse pair naming – I will fix that for bittrex, thank you for noting that!

You cannot reverse pairs manually, and should only be using the keys of market.products array.
import ccxt

kraken = ccxt.kraken()
kraken.load_products ()
print (list (kraken.products.keys ())) # use these symbols only

bittrex = ccxt.bittrex ()
bittrex.load_products ()
print (list (bittrex.products.keys ())) # use these symbols only

Thank you for your report, I will investigate further into the reversed pairs to fix that for more consistency across markets.

When you ask for DSH/BTC from Bitfinex and then ask DSH/BTC from HitBTC, you are getting the same pair. But notice that the HitBTC DSH volume is 0.0, meaning that the price for DSH/BTC may be outdated there (this is what their APIs return). Whereas on Bitfinex the price is up to date.

I'm not really following you here. From Bitfinex I'm getting DASH/BTC pair instead of DSH/BTC(which IIRC doesn't exist on that exchange). Prices match approximately.

Thank you for your report, I will investigate further into the reversed pairs to fix that for more consistency across markets.

import ccxt
h = ccxt.poloniex()
h.load_products()
pp.pprint(h.fetch_ticker("BTC/ETH"))

k = ccxt.gdax()
k.load_products()
pp.pprint(k.fetch_ticker("ETH/BTC"))

There are more markets where they have internal inconsistencies. Those are ones I found for now, though I haven't been looking too hard.

Oh yeah, and there's this market API/consistency gem:
import ccxt
h = ccxt.btce()
h.load_products()
pp.pprint(h.fetch_ticker("ETH/LTC"))

k = ccxt.bittrex()
k.load_products()
pp.pprint(k.fetch_ticker("ETH/LTC"))

{'ask': 5.262,
 'average': 5.23501,
 'baseVolume': 6538.3599,
 'bid': 5.28339,
 'change': None,
 'close': None,
 'datetime': '2017-07-06T16:25:01.000Z',
 'first': None,
 'high': 5.52,
 'info': {'avg': 5.23501,
          'buy': 5.28339,
          'high': 5.52,
          'last': 5.262,
          'low': 4.95002,
          'sell': 5.262,
          'updated':<PHONE_NUMBER>,
          'vol': 34721.04192,
          'vol_cur': 6538.3599},
 'last': 5.262,
 'low': 4.95002,
 'open': None,
 'percentage': None,
 'quoteVolume': 34721.04192,
 'timestamp':<PHONE_NUMBER>000,
 'vwap': None}
{'ask': 0.19299995,
 'average': None,
 'baseVolume': None,
 'bid': 0.19,
 'change': None,
 'close': None,
 'datetime': '2017-07-06T16:24:54.000Z',
 'first': None,
 'high': 0.20499999,
 'info': {'Ask': 0.19299995,
          'BaseVolume': 1658.76170155,
          'Bid': 0.19,
          'Created': '2017-06-25T03:06:46.83',
          'High': 0.20499999,
          'Last': 0.19,
          'Low': 0.18341639,
          'MarketName': 'ETH-LTC',
          'OpenBuyOrders': 173,
          'OpenSellOrders': 98,
          'PrevDay': 0.19999979,
          'TimeStamp': '2017-07-06T16:24:54.123',
          'Volume': 8434.69400369},
 'last': 0.19,
 'low': 0.18341639,
 'open': None,
 'percentage': None,
 'quoteVolume': 8434.69400369,
 'timestamp':<PHONE_NUMBER>000,
 'vwap': None}

I check on their webpages, https://i.imgur.com/WyeOSQu.png  and it's ok from API perspective. Those numbers are reciprocal as if they reversed the pairing but not the names

I'm not really following you here. From Bitfinex I'm getting DASH/BTC pair instead of DSH/BTC(which IIRC doesn't exist on that exchange). Prices match approximately.
Oh, I see. The Bitfinex lists Dash as DSH, instead of DASH.
I will fix that too. Appreciate your help!

Oh yeah, and there's this market API/consistency gem:

Bittrex seems to have reverse pair naming, I will fix that. Thanks!

Bittrex pairs are now fixed (reversed the way they should be, consistent with the other markets). Working on Bitfinex (DSH) and other issues you mentioned... Will let you know when it's done.

Fixed Bitfinex DSH → DASH inconsistency. Investigating Poloniex vs GDAX now.

Poloniex is also fixed now with proper pair ordering. Thank you for reporting this!


Add pussthecat.org/1

@bradleytaunt It's the favicon that their browser automatically pull... The actual html is 815: https://github.com/PussTheCat-org/PussTheCat.org/blob/master/public/1/index.html

@TheFrenchGhosty The closing of the PR wasn't meant to be rude - sorry if it came off that way!
Unfortunately the weight of the favicon is taken into account for page size - since it is requested by the browser. A good way to avoid that is setting it as a data-type

@bradleytaunt Done.
Do you want me to use the size from gtmetrix (565 Bytes) or is the actual HTML size (815 Bytes) what you want?

The 643 from the gt score should be fine! https://gtmetrix.com/reports/pussthecat.org/VTFLYkrO/

@bradleytaunt Should I use the size of the redirect or the size of the actual page?
/1 = 79 Bytes more https://gtmetrix.com/reports/pussthecat.org/VTFLYkrO/
/1/ = just the HTML https://gtmetrix.com/reports/pussthecat.org/SCUo3M09/
I used /1 in the markdown because that's how you did it for the others, but it's technically just a redirect.

@TheFrenchGhosty It is fine to use the /1/ number (565) but keep it as /1 for simplicity :+1:

@bradleytaunt Done.


Feature suggestion: re-snapping automatically the selected assets

To level design with modular assets we use the snapping to place the assets, but sometimes we forget to snap an asset correctly and all their duplicates aren't on the grid. I suggest a useful feature like in Unity to re-snap every selected assets. The snapping can also work with rotation, for example with an angle of 15 it will only use a multiple of this value, same for the scale.
The default values should be: translation at 1/1/1, scale 0.1 and rotation 15 degrees.

Feature and improvement proposals for the Godot Engine are now being discussed and reviewed in a dedicated Godot Improvement Proposals (GIP) (godotengine/godot-proposals) issue tracker. The GIP tracker has a detailed issue template designed so that proposals include all the relevant information to start a productive discussion and help the community assess the validity of the proposal for the engine.
The main (godotengine/godot) tracker is now solely dedicated to bug reports and Pull Requests, enabling contributors to have a better focus on bug fixing work. Therefore, we are now closing all older feature proposals on the main issue tracker.
If you are interested in this feature proposal, please open a new proposal on the GIP tracker following the given issue template (after checking that it doesn't exist already). Be sure to reference this closed issue if it includes any relevant discussion (which you are also encouraged to summarize in the new proposal). Thanks in advance!


[NEMO-213] Use Beam's DoFnRunners to execute DoFn

JIRA: NEMO-213: Use Beam's DoFnRunners to execute DoFn
Major changes:

use simpleDoFnRunner to process events of DoFn
convert all beam Transforms to process WindowedValue
create a BeamBoundedWindowedSourceVertex that generates WindowedValues
modify PipelineTranslator to use the newly created Transforms (SimpleDoFnTransform...)

Minor changes to note:
Tests for the changes:

create a unit test that executes SimpleDoFnTransform

Other comments:

We need a performance test

Closes #122

TPC-H job completion times I got are (10 h1.4xlarge, Scale Factor=100):
| My branch (master + some fixes) | My branch + This branch (merged)
-- | -- | --
Q3 | 4mins, 51sec | 5mins, 13sec
Q4 | 3mins, 22sec | 3mins, 45sec
Q5 | 7mins, 24sec | 6mins, 34sec
Q6 | 2mins, 13sec | 2mins, 21sec
Q10 | 3mins, 33sec | 3mins, 50sec
Q12 | 2mins, 55sec | 3mins, 14sec
Q13 | 3mins, 21sec | 3mins, 42sec
Q14 | 2mins, 9sec | 2mins, 21sec
This PR seems to add around 10% overhead by using the WindowedValue wrappers rather than raw data objects, which I think is not so bad also considering that we're still mostly faster than the Spark runner. (@seojangho - what do you think about this?)
I'll review the code now.

@johnyangk Thanks for the review! I've addressed your comments and left some comments.

@taegeonum LGTM. Please leave a TODO in PipelineTranslator regarding AtomicReference<Pipeline> PIPELINE. I'll merge as soon as the test passes.


ARM / mac M1 support

Hello, I'm trying to install the package on M1 Mac and it is failing to do so -- panic: could not run [generate --schema ../../packages/db/prisma/schema.prisma --verbose]: fork/exec /Users/hua/Library/Caches/prisma/binaries/cli/4.15.0/prisma-cli-darwin-x64: bad CPU type in executable. It appears that when searching for binary, the package hardcodes x64 https://github.com/steebchen/prisma-client-go/blob/main/binaries/binaries.go#L25.
The packages are properly built, eg prisma-cli-4.15.0-darwin-arm64.gz - I think that we just need to add the architecture (x64 or arm64) as an argument to the URL.
I'm happy to make a PR for that, I think it should be pretty straightforward.

Thanks for reporting, will take a look

Do you have rosetta enabled/installed? Because I'm also on M1 but I think it uses rosetta for me

no, I don't use Rosetta, which would explain why it works in your case
I think https://github.com/steebchen/prisma-client-go/pull/874 should solve it, but let me test it real quick.

Thanks looks good, see my comment

dupe of #809


update int8 flag for model conversion

@eaidova  Can you please also add her? https://github.com/openvinotoolkit/openvino.genai/blob/a3168aaaecef2a12abc147934053907f17e32fb9/llm_bench/python/utils/model_utils.py#L223
OV_FP16-INT8_ASYM and OV_FP32-INT8_ASYM , also PT_FP16-INT8_ASYM and PT_FP32-INT8_ASYM


Fail a task if it retries too many times

Previously it would just never be owned or trigger any of its successors, preventing (easy)
failure of the following tasks.

Codecov Report

Merging #898 (f7c0dbc) into master (45a5ff6) will increase coverage by 0.00%.
The diff coverage is n/a.

@@           Coverage Diff            @@
##           master     #898    +/-   ##
========================================
  Coverage   45.38%   45.38%
========================================
  Files         141      142     +1
  Lines       11054    10939   -115
========================================
- Hits         5017     4965    -52
+ Misses       5400     5364    -36
+ Partials      637      610    -27

Impacted Files
Coverage Δ

catalog/diff.go
0.00% <0.00%> (-18.52%)
:arrow_down:

catalog/cataloger_diff.go
58.18% <0.00%> (-11.27%)
:arrow_down:

catalog/db_branch_scanner.go
84.44% <0.00%> (-5.88%)
:arrow_down:

catalog/cataloger_create_entry.go
94.73% <0.00%> (-5.27%)
:arrow_down:

catalog/cataloger_create_repository.go
59.25% <0.00%> (-3.71%)
:arrow_down:

db/tx.go
0.00% <0.00%> (ø)

catalog/db_scanner.go
100.00% <0.00%> (ø)

catalog/db_lineage_scanner.go
77.55% <0.00%> (ø)

catalog/db_diff_scanner.go
81.96% <0.00%> (ø)

catalog/cataloger_merge.go
73.18% <0.00%> (+10.22%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 45a5ff6...f7c0dbc. Read the comment docs.

Thanks!


Remote intellisense

Switch function completion to use R Host

Are you thinking of doing HTML scraping inside the host? Or going away from HTML entirely?

I hope to go away entirely, use R to get functions if possible. If not, then do HTML thing in the broker (as a last resort)

https://github.com/Microsoft/RTVS/commit/61a643b907e7e167d311b464c8e4252aaf93bba4


Fix regression of .Truncated evaluation in manual summaries

This fixes the behavior of .Truncated that was introduced with commit
bef496b97e1dc2df8c52b080152d539a58752801 which was later broken.  The
desired behavior is that .Truncated would evaluate to false when there
was nothing after the user defined summary marker.
This also adds a simple unit test to ensure that this feature isn't
broken again.  The check for content after the user defined summary
marker is done on the raw content instead of the working copy because
some of the markup renderers add elements after the marker, making it
difficult to determine if there is actually any content.
The behavior (evaluating to false when there is no content, just
summary) is also now documented.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Anton Staaf seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.

Hi Bjørn, I've updated to only do the raw data split once, I've also included in this version the removal of some dead code, that might have been a mistake though.  Let me know if you would like me to make a separate pull request for the removal.


New type StrLimited

Change Summary

This represents a simplified length limited string and is an alias for the following syntax:
StrLimited[max_length] = constr(max_length=max_length, strip_whitespace=True)
Usage example:
class Foo:
    bar: StrLimited[10] # bar is a str with maximum length of 10 characters

Related issue number

fix #2104
Checklist

[x] Unit tests for the changes exist
[x] Tests pass on CI and coverage remains at 100%
[x] Documentation reflects the changes where applicable
[x] changes/<pull request or issue id>-<github username>.md file added describing change
(see changes/README.md for details)
[x] My PR is ready to review, please add a comment including the phrase "please review" to assign reviewers

please review

please update.

@lucastosetto any chance you can fix this?

See twitter :bird:, I've you'd like this to be included in V1.10, please fix it and request a review TODAY.
Or if you need this in V1.10 but don't have time to complete it (or aren't the author), please comment here and on #4324

@lucastosetto any chance you can fix this?

@samuelcolvin Sure, I can work on it this week, but I won't have time to do this for v1.10

@lucastosetto any chance you can fix this?

Sure, I can work on it this week, but I won't have time to do it for v1.10 release.

Ok, I might try to finish it for you.
If it doesn't make it into v1.10 much of the implementation will have to change for V2.

Ok, I might try to finish it for you.

Ignore that, I'm not going to have time to work on this, I think it'll have to wait for V2.


Not visible in SetupHelper

Hi,
i have the latest SetupHelper and upgraded the latest dbus-opendtu manually. Also added manually dbus-opendtu to setup helper.
But it remains like this:

did i miss something?

SetupHelper support is not yet release. see #122


[Question] Cannot run InfoLink project locally Value cannot be null. (Parameter 'uriString')

I'm trying to run Infolink project locally but I'm getting a null exception, I traced it and I think it has something to do with InfolinkClientOptions the InfolinkClient configuration section. Is it a required configuration section in the web application main project? what should be there?
Also, I have another question: services.AddCloudFiles(); is this service a requirement for the functionality of the project? I commented this line because I do not have amazon cloud services account, I just want to try to send post request to local web-api project through Infolink.
Thanks a lot.

Infolink client is used by the UI to call its APIs. Its options include the APIs base URL.
As for the cloud files service, it is needed for infolink to function, but you can use any S3 compatible storage.
Here is the schema of the appsettings needed for the app to function.


ipv6 support

Replace *:80 with bind :::80 for ipv6
nginx controller: https://github.com/kubernetes/ingress-nginx/blob/master/docs/user-guide/nginx-configuration/configmap.md#disable-ipv6
cc: @gavvvr

Another use-case: https://appscode.slack.com/files/UBEUMR86R/FBFS3SRGX/-.txt
** Support 2 ip:port for the same Domain (host)


How to trace asynchronous code?

Sorry for asking this question here...
Is there a recommended way to trace/measure asynchronous code?
What I mean: I have 1 service and set of workers connected via queue.
First -  (start of parent Span) (start child1 span) validate request and store in queue (end child 1 span).
Second - get task from queue and  (start child2 span) do the job (end child 2 span) and store it in result table (end of parent span).
So what I really want to see is something like that:
[------------------------------]
  [---]
                       [---]

But from reading documentation it is not really clear what should I do:
Remote span context expects that this span is started - there is no way to continue remote span without starting it again.
So best what I can get looks more like the following:
[---]
                      [---]

what is not good but missing trace of "how long it took to process request"...
Will really appreciate any help in a recommended way. (and tell me if I want something strange)...
Thanks

Consider using Links: https://opencensus.io/tracing/span/link/. Java API: https://github.com/census-instrumentation/opencensus-java/blob/c943c6c63637cc866e92b90dae0e48dccd488130/api/src/main/java/io/opencensus/trace/SpanBuilder.java#L130.

Thanks for the reply. The problem here is that there is no way to create a span in one place and finish it in another.
But still, it somehow working...

@eiva do you have sample code on how you did this? Thanks


is it for 1.21?

can this be used for 1.21?

I didnt updated the dependencies yet but it should work if not let me knoe

:)


CHANGELOG.md HTML tags not appearing correctly.

HTML tags in the changelog file aren't escaped and therefore act as tags themselves, and appear invisible. Please escape tags with < and >. Thanks.

https://github.com/codeddraig/ffau/pull/3 - Fixed.

Fixex


iOS Permission Dialog Appearing On Launch

Even after I do not call the grantPermission there is a dialog appearing on Launch. I cannot find anywhere as to how I can delay this dialog. I am using it in an Ionic app v3. cordova -8 .

Update to version 1.0.4 at least.

Hi,
I had opened this issue following the issue #648 being closed and still facing the problem.
But as @Hirbod replied to my earlier message of maybe the package being wrong. I am trying to uninstall it
viz  ionic cordova plugin remove cordova-plugin-firebase
I get UnhandledPromiseRejection because of no such file or directory.
/users/name/app/platforms/android/AndroidManifest.xml
whereas the AndroidManifest is not in that path but a different path.

Also, just a side note, when I installed the plugin my cordova version was 8 and the platform android was 7 and above. I have come to known that the cordova 8 has the manifest file at a different location than the later one. So @Hirbod do you suggest I go and delete the folders and the config.xml and plugin.xml manually?

Ok. I removed Android platform, then removed the plugin and then added the latest version of the plugin and the notifications at startup is removed.


This make the last failure be the default installed nightly if any

I haven't properly tested this :), so let's consider it WIP for now.

Feel free to merge once CI passes (I'm not sure what it tests beyond just compilation, but it exists, so we might as well go by it)


Sidecar backup fails to retain user data

Testing with operator 0.3.3 and cluster 3.1.9 we wanted to see what happens when deleting enough cluster pods to break quorum. What we found was the cluster recovered, but all our stored keys were gone. Is this the expected behaviour? If so how would one maintain user data via backups, or is that not possible?
Steps to reproduce:

Create a key (etcdctl mk foo bar)
Triggered a sidecar backup via the sidecar /v1/backupnow endpoint
Delete 75% of the pods
Operator eventually brings up a new set of pods, which settles into a healthy cluster
The created key is gone (etcdctl get foo)

This is the cluster configuration yaml:
apiVersion: "etcd.coreos.com/v1beta1"
kind: "Cluster"
metadata:
  name: "etcd-cluster"
spec:
  size: 7
  version: "3.1.9"
  backup:
    backupIntervalInSecond: 300
    maxBackups: 5
    storageType: "PersistentVolume"
    pv:
      volumeSizeInMB: 512

but all our stored keys were gone

how do you verify this? please provide some details

Create a key (etcdctl mk foo bar)

etcd3 does not have mk command. probably you are using etcd2, which operator does not really support for backup.


Remove padding below pageHeader/pageFooter

When using a page header/footer, a huge padding is automatically inserted below it in the PDF. The padding between header and content is a bit larger than between footer and the end of the page; like this:
-----------
Header
  (padding)
  (padding)
  (padding)
Content
Content
Content
Footer
  (padding)
  (padding)
-----------

My options don't specify a border or padding:
var options = {
  format: 'A4',
  orientation: 'portrait',
  type: 'pdf'
};

Here's how I generate the PDF:
htmlPdf.create(html, options).toFile('./report.pdf', ...);

Is this padding added by html-pdf on purpose? How can I get rid of it?

In case there's no height defined, the script is setting that: https://github.com/marcbachmann/node-html-pdf/blob/master/lib/scripts/pdf_a4_portrait.js#L191-L192
I think I've done this because phantomjs itself has a default height which is not documented.
Can you try to set null or 0 and see what happens?

Hey, thanks a lot -- your hint fixed my problem!
I had to explicitly set the header/footer height to a value > 0 to make it work (0 or null were no good). Also, I previously had my header/footer contents defined in HTML, which did not work in conjunction with setting the height in JS; so I had to move the contents to JS as well:
var options = {
  // ...
  header: {
    contents: 'my title',
    height: '10mm'
  },
  footer: {
    contents: '{{page}}/{{pages}}',
    height: '10mm'
  }
};


Document Usage-Scenarios

We should add Documentation for common Usage-Scenarios like:

Core and GUI and Sources on the same System
Core and Sources on the same System, GUI on a different one
Core and GUI on the same System, Sources (partitially) on another (for example an x11 grabber script)

The Documentation should state common issues of these setups (like clocking) as well as things to keep in mind (like bandwith requirements).
The Documentation should probably be in the Wiki.

see
https://media.ccc.de/v/froscon2015-1520-conference_recording_und_streaming
and
https://media.ccc.de/v/froscon2016-1696-voctomix


Validate CR in CI workflow

This PR adds the CR validation in the CI workflow.
Example failed run: https://github.com/leandroberetta/kiali-operator/actions/runs/4669451430

excellent -- it shows the current CRD/CR fails validation :) I'm going to force merge this, since this is working.


KfConsumerTest.java:20: Consumer data polling Test

The puzzle 41-a2146b71 from #41 has to be resolved:
https://github.com/eo-cqrs/eo-kafka/blob/446bb9731e9486671d27b8e2651b668c62935196/src/test/java/org/eocqrs/kafka/consumer/KfConsumerTest.java#L20-L20
The puzzle was created by Aliaksei Bialiauski on 26-Feb-23.
Estimate: 30 minutes,  role: DEV.
If you have any technical questions, don't ask me, submit new tickets instead. The task will be "done" when the problem is fixed and the text of the puzzle is removed from the source code. Here is more about PDD and about me.

can be completed after #81

The puzzle 41-a2146b71 has disappeared from the source code, that's why I closed this issue.


Error notification will not  automatically be hidden

This is a...

[X] Enhacement
[ ] Feature request
[ ] Regression (a behavior that used to work and stopped working in a new release)
[ ] Bug report
[ ] Documentation issue or request

The problem

When the error notification shows,

if the user create a new mapping, the error notification will not automatically be hidden. The user may misunderstand the the new mapping is incorrect as well.

When more errors occur, the user will need to manually close the error messages one by one.

Expected behavior

It is better to autometically hide the error notification after the user start a new mapping / delete the current mapping

When the error notification shows, It is better to change the invalidate mapping clicked color to a warning color in order to better warn the user.

Related Issues

#375 Improve error diagnostic if a user attempts multiple mappings (map mode) to the same target element

@igarashitm Hi Tomo, please help to review the above behaviour. Thank you~!

Ugh I misread at first glance, this is a nasty bug apparently. Just because this error message doesn't belong to any mapping, it's shown in the global error area, while those belong to the specific mapping are shown only for active (focused) mapping.
@pleacu can we make this instant and remove in a few seconds? even better if we can remove it as soon as user click the other field.


Scope '$inheritedDefinitionsScopes' not found in environment

I am attempting to build a policy plan for a child Management Group with an initiative assigned that references a custom Policy Definition that exists in the parent Management Group.
As an illustration:
ROOT MG
- policyDef1
  | CHILD MG, Definition Root Scope
  | -policySet, includes policyDef1

The CHILD MG is the Definition Root Scope, and has ROOT MG listed under inheritedDefinitionsScopes
When I run  build-deploymentplans -PacEnvironmentSelector "CHILD" -DefinitionsRootFolder "./Definitions" -OutputFolder "./Output" I get the error Scope '/providers/Microsoft.Management/managementGroups/ROOT' not found in environment
My PacEnvironment is set up as the following:
"pacSelector": "CHILD",
"cloud": "AzureCloud",
"tenantId": "MYTENANT",
"deploymentRootScope": "/providers/Microsoft.Management/managementGroups/CHILD",
"inheritedDefinitionsScopes": [
    "/providers/Microsoft.Management/managementGroups/ROOT"
],
"desiredState": {
"strategy": "ownedOnly",
"includeResourceGroups": false,
"excludedScopes": [],
"excludedPolicyDefinitions": [],
"excludedPolicySetDefinitions": [],
"excludedPolicyAssignments": []

I've traced this down and I think this is an issue with the Get-AzScopeTree not taking the inheritedDefinitionsScopes into consideration when it's building the $ScopeTable.
The Build-NotScopes -ScopeTable $ScopeTable -ScopeList $customPolicyDefinitionScopes -NotScopeIn $excludedScopesRaw command is passing $customPolicyDefinitionScopes which includes the definition root scope and the inherited definitions scope, but the $ScopeTable from Get-AzScopeTree does not include it so when it's looping through and checking each entry it throws that error.
If I remove the inheritedDefinitionsScopes, then I run into the following error much later in processing:
Write-Error: \EnterprisePolicyAsCode\8.2.4\internal\functions\Build-PolicySetPolicyDefinitionIds.ps1:45
Line |
  45 |              $policyId = Confirm-PolicyDefinitionUsedExists `
     |                          ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
     |     Policy
     | '/providers/Microsoft.Management/managementGroups/ROOT/providers/Microsoft.Authorization/policyDefinitions/ef14017d-8b46-48a4-ae4a-c5ddb7cc15e6' not found.
Write-Error: \EnterprisePolicyAsCode\8.2.4\functions\Build-DeploymentPlans.ps1:124
Line |
 124 |  Build-PolicySetPlan `
     |  ~~~~~~~~~~~~~~~~~~~~~
     | POLICYSETNAME: One or more invalid Policy entries referenced in Policy Set 'POLICYSETNAME'
     | from 'POLICYSETNAME.jsonc'.

Is the parent management group managed by EPAC as well?
From the documentation it appears that if the parent scope is managed this will work however if it is unmanaged then you must set the deployment root scope to the parent management group.
Get Outlook for Androidhttps://aka.ms/AAb9ysg

From: Daniel Zabinski @.>
Sent: Tuesday, October 10, 2023 12:49:51 AM
To: Azure/enterprise-azure-policy-as-code @.>
Cc: Subscribed @.***>
Subject: [Azure/enterprise-azure-policy-as-code] Scope '$inheritedDefinitionsScopes' not found in environment (Issue #387)
I am attempting to build a policy plan for a child Management Group with an initiative assigned that references a custom Policy Definition that exists in the parent Management Group.
As an illustration:
ROOT MG

policyDef1
| CHILD MG, Definition Root Scope
| -policySet, includes policyDef1

The CHILD MG is the Definition Root Scope, and has ROOT MG listed under inheritedDefinitionsScopes
When I run build-deploymentplans -PacEnvironmentSelector "CHILD" -DefinitionsRootFolder "./Definitions" -OutputFolder "./Output" I get the error Scope '/providers/Microsoft.Management/managementGroups/ROOT' not found in environment
My PacEnvironment is set up as the following:
"pacSelector": "CHILD",
"cloud": "AzureCloud",
"tenantId": "MYTENANT",
"deploymentRootScope": "/providers/Microsoft.Management/managementGroups/CHILD",
"inheritedDefinitionsScopes": [
"/providers/Microsoft.Management/managementGroups/ROOT"
],
"desiredState": {
"strategy": "ownedOnly",
"includeResourceGroups": false,
"excludedScopes": [],
"excludedPolicyDefinitions": [],
"excludedPolicySetDefinitions": [],
"excludedPolicyAssignments": []
I've traced this down and I think this is an issue with the Get-AzScopeTree not taking the inheritedDefinitionsScopes into consideration when it's building the $ScopeTable.
The Build-NotScopes -ScopeTable $ScopeTable -ScopeList $customPolicyDefinitionScopes -NotScopeIn $excludedScopesRaw command is passing $customPolicyDefinitionScopes which includes the definition root scope and the inherited definitions scope, but the $ScopeTable from Get-AzScopeTree does not include it so when it's looping through and checking each entry it throws that error.
If I remove the inheritedDefinitionsScopes, then I run into the following error much later in processing:
Write-Error: \EnterprisePolicyAsCode\8.2.4\internal\functions\Build-PolicySetPolicyDefinitionIds.ps1:45
Line |
45 |              $policyId = Confirm-PolicyDefinitionUsedExists      |                          ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~      |     Policy      | '/providers/Microsoft.Management/managementGroups/ROOT/providers/Microsoft.Authorization/policyDefinitions/ef14017d-8b46-48a4-ae4a-c5ddb7cc15e6' not found. Write-Error: \EnterprisePolicyAsCode\8.2.4\functions\Build-DeploymentPlans.ps1:124 Line |  124 |  Build-PolicySetPlan
|  ~~~~~~~~~~~~~~~~~~~~~
| POLICYSETNAME: One or more invalid Policy entries referenced in Policy Set 'POLICYSETNAME'
| from 'POLICYSETNAME.jsonc'.
—
Reply to this email directly, view it on GitHubhttps://github.com/Azure/enterprise-azure-policy-as-code/issues/387 or unsubscribehttps://github.com/notifications/unsubscribe-auth/ACWCJVR3RHXY32TB24LRLQTX6P6H7BFKMF2HI4TJMJ2XIZLTSOBKK5TBNR2WLJDUOJ2WLJDOMFWWLO3UNBZGKYLEL5YGC4TUNFRWS4DBNZ2F6YLDORUXM2LUPGBKK5TBNR2WLJLJONZXKZNENZQW2ZNLORUHEZLBMRPXI6LQMWBKK5TBNR2WLJDUOJ2WLJDOMFWWLLTXMF2GG2C7MFRXI2LWNF2HTLDTOVRGUZLDORPXI6LQMWSUS43TOVS2M5DPOBUWG44SQKSHI6LQMWVHEZLQN5ZWS5DPOJ42K5TBNR2WLKJTGM3TCNRSHAZTRAVEOR4XAZNFNFZXG5LFUV3GC3DVMWVDCOJTGMYTEMRWGYYKO5DSNFTWOZLSUZRXEZLBORSQ.
You are receiving this email because you are subscribed to this thread.
Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

According to Use Case 3 in the Desired State Strategy page, that attribute is intended to be used when the Root scope is not under management of the Child scope.
I configured my environment based on the descriptions in that document. Is there some other page I should be referencing?

If the parent management group is not managed by EPAC - can you just change the deployment root scope in global-settings.json to point to the parent?
Can you confirm that the parent management group is not managed by EPAC at all? My understanding from the documentation is that if the parent scope is not managed then the inheritedDefinitionsScopes won't work - and you should set the deploymentRootScope to point to the parent management group.
If the parent is managed by EPAC then that setting will work.
Let me know how you go - if it is still causing issues we can have a call to sort it out :)

The parent group is managed by EPAC.
On Fri, Oct 13, 2023, 6:28 PM Anthony Watherston @.***>
wrote:

If the parent management group is not managed by EPAC - can you just
change the deployment root scope in global-settings.json to point to the
parent?
Can you confirm that the parent management group is not managed by EPAC at
all? My understanding from the documentation is that if the parent scope is
not managed then the inheritedDefinitionsScopes won't work - and you
should set the deploymentRootScope to point to the parent management
group.
If the parent is managed by EPAC then that setting will work.
Let me know how you go - if it is still causing issues we can have a call
to sort it out :)
—
Reply to this email directly, view it on GitHub
https://github.com/Azure/enterprise-azure-policy-as-code/issues/387#issuecomment-1762316739,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACDTJ5MY3UWNPS2XUJXHBZDX7G6CJANCNFSM6AAAAAA5Y24VBE
.
You are receiving this because you authored the thread.Message ID:
@.***>

Experienced the same issue and did some investigation, as I see the inherited policyDefinitions feature is simply not working at the moment.
First of all, currently the https://github.com/Azure/enterprise-azure-policy-as-code/blob/main/Scripts/Helpers/Build-NotScopes.ps1 script throws exception, since it checks if the "scope to inherit from" is not in the ScopeTable, which will always be the case, since the ScopeTable just contains the deploymentRoot and its child scopes as I understand. May adding the "scopes to inherit from" could help?
Later on if I add some quick and dirty fix, the next error will appear here:
https://github.com/Azure/enterprise-azure-policy-as-code/blob/507bdf2f344f51e3fbe2fce3920084b9c7d03736/Scripts/Helpers/Get-AzPolicyResources.ps1#L218C78-L218C78
This line would be the one which tries to add the inherited definitions to some target which is not defined, may here we only should change this to deployedPolicyTable.readOnly
Sorry for not creating some PR on this, but I didn't had enough time to go deep enough, and create some solution I could be proud of :) Hope this helps someone anyways

@borondy @DanZab - I've created a fix in a branch called issue387 - are you able to test the fix and see if it resolves your issue? For me I tested by creating a child management group - then pointed my pac environment to that group and attempted to deploy a definition created in a different management group...

@anwather - Thanks a lot! It looks good to me. Tried exporting the policy resources from a child MG, built plan and even deployed it. Everything worked as expected.


Breakpoint - remain TODO

[x] Don't stop if the previous opcode is a jump out and current opcode jump dest.
[x] Don't stop If the current source location contains the previous one.

https://github.com/ethereum/remix/issues/205


remove dependeny from opencast_nginx role

If we would remove this dependency, this role would also work out-of-the-box with the simple_nginx_reverse_proxy.

Just removing that would mean:

You break backwards compatibility
You now have to explicitly use one of the aforementioned roles

Both things are fine but definitely need documentation since this would not work with a default 'nginx' on CentOS, Debian or Ubuntu.
I'm also wondering if it would make sense to rename this if you want to decouple it from the Opencast roles.

I copied this role to make a new one under a new name: https://github.com/elan-ev/elan_certbot
For my purposes, this works fine and makes this pull request useless.


Simplify module handling

Couple of small changes making the module.dep generation code a little cleaner and simpler. Namely:

stop passing extension/suffix array as argument - it's constant data
remove unneeded sorting of modules.dep contents

The contents of the modules.dep may be unsorted with this MR.
In my testing that's not an issue and kmod doesn't bother sorting either.

bors r+


added iverilogOptions config

I wanted to be able to pass additional options to iverilog command, so I added a way for the user to specify the options via config.

#1


Fixed #6376 -- Allowed usage of custom gettext domains

Trac ticket: 6376
The locale loading system was written in such a way it only loaded locale files
with names 'django'. Modified the process, so the developers can now provide
additional locale filenames using settings.LOCALE_FILENAMES. Updated documentation
to reflect the added changes.

I'll let people more familar with the translation internals deal with the following review but may I ask you to remove the @charettes mention from the commit message as I receive an email every time the branch is rebased. If you really want to refer to me please use "Simon" or "Simon Charette". Thanks!

Closing in favor of an implementation which doesn't require a new setting as mentioned on the ticket and mailing list.


OmegaConf doesn't properly support StrEnum

Describe the bug
In the example in the docs for Enums these all work:
>>> conf.height = Height.TALL
>>> assert conf.height == Height.TALL

>>> # The name of Height.TALL is TALL
>>> conf.height = "TALL"
>>> assert conf.height == Height.TALL

>>> # The ordinal of Height.TALL is 1
>>> conf.height = 1
>>> assert conf.height == Height.TALL

but for Str enums (same as docs but use StrEnum instead):
from enum import StrEnum
class Height(StrEnum):
    SHORT = "short"
    TALL = "tall"

The first two examples work as with regular enums but the third:
>>> conf.height = "tall"

gives: omegaconf.errors.ValidationError: Invalid value 'tall', expected one of [SHORT, TALL]
To Reproduce
See description
Expected behavior
You would be able to set a StrEnum with the key or the value.
Additional context

[latest ] OmegaConf version: <FILL>
[3.11+ ] Python version: <FILL>
[any] Operating system: <FILL>
[ x] Please provide a minimal repro

One more note - this is an issue for us as when we write out the config it will use the value ("tall" in this case) but that same config can't be read back in as it will throw the above error.

Feel free to suggest patch to fix it (with tests).


SSH keys: re-fetch keys on component re-render

Description
This PR fixes 2 issues:

SSH keys modifications (add/remove) not detected until page reload
Line break in Connect via SSH command

Co-authored by: Alessandro Bacci<EMAIL_ADDRESS>

/deploy-staging

/merge


Consider bwf write filter

bwf, the Beckhoff Write Filter, is described as follows:

As is familiar from the Windows operating system, TwinCAT/BSD provides a write filter. This protects the system against persistent changes. With the write filter activated, the system is in a previously defined state following a restart.

https://infosys.beckhoff.com/english.php?content=../content/1033/twincat_bsd/7873538059.html describes how to use it.
It can be downloaded from https://tcbsd.beckhoff.com/TCBSD/13/stable/packages/All/ (by the way, unlike FreeBSD, this package repository allows directory listing and has a neat https://tcbsd.beckhoff.com/TCBSD/13/stable/packages/packagesite.html page)
The package names "SLA4BSP" as the license ("This package has a single license: SLA4BSP (Software License Agreement for Beckhoff Software Products)"). Is it open source? I can't seem to find it on https://github.com/Beckhoff.
It would remain to be tested whether bwf can be used to get a reliable Live system from read-only media such as ISO.

Looking at usr/local/bin/bwfctl it seems like this is "just" elaborate zfs trickery, and we already found out that zfs is apparently not capable of making a read-only device (like an ISO) appear read-write.


Added Netlify Cache Control Headers

Invalidate CDN Cache from Netlify
Harness Developer Pull Request
Thanks for helping us make the Developer Hub better. The PR will be looked at
by the maintainers.
What Type of PR is This?

[x] Issue
[ ] Feature
[ ] Maintenance/Chore

If tied to an Issue, list the Issue(s) here:

Issue(s)

House Keeping
Some items to keep track of. Screen shots of changes are optional but would help the maintainers review quicker.

[x] Tested Locally
[x] Optional Screen Shoot.

https://harness.atlassian.net/browse/HDH-127

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app


First reprocessing of health scanner data

update: running first dev pipeline tests with following changes (will appear formally in a changelog):
• ElasticsearchPlus developed to chain together row-wise transformations such as:
• “company” (for crunchbase) or “paper” (for nih) added as new field type_of_entity
• applying null values to fields as described in https://github.com/nestauk/nesta/blob/health2/nesta/production/schemas/tier_1/field_null_mappings/health_scanner.json
• Changed “crunchbase” to “companies” as _index name, in accordance with Ts&Cs of new crunchbase contract
• Aliases applied as described in https://github.com/nestauk/nesta/blob/health2/nesta/production/schemas/tier_1/aliases/health_scanner.json
• empty string filtered to null
• countries automatically detected in large text
• terms_ fields are automatically listified, with the most likely delimiter automatically identified. In practice, this means the ; seperated values will now be a proper json array from the ES response.
• Geographic lat lon values are now always floats
other changes:
• State names in CB data
Things not done yet (relatively short tasks) which will go into the same release:
⇒ Mixed analyzers for country and city lists
⇒ Add funders to CB and NiH
⇒ Add continent names
I’ll get in touch once the pipeline is flowing properly

@mindrones @russwinch @pngwn
if you could take a look at the new index companies to confirm the above changes for CB. Note that it also contains new data (i.e. updates and new entries). New NiH data to follow in the nearish future.

Here are my previous observations (Slack, May 16th 4:29PM).
• “company” (for crunchbase) or “paper” (for nih) added as new field type_of_entity
OK

• applying null values to fields as described in https://github.com/nestauk/nesta/blob/health2/nesta/production/schemas/tier_1/field_null_mappings/health_scanner.json

What about cost for items not having a currency?
Should we consider the cost null or?
Maybe a missing currency might mean implicit currency (like, a USA-oriented DB might imply USD but can we use that?)

• Changed “crunchbase” to “companies” as _index name, in accordance with Ts&Cs of new crunchbase contract

OK

• Aliases applied as described in https://github.com/nestauk/nesta/blob/health2/nesta/production/schemas/tier_1/aliases/health_scanner.json

Wondering why:
"novelty": {
  "nih": "cost_total_project",
  "crunchbase": "cost_of_funding"
},

rather than
"novelty": {
  "nih": "_novelty_rank",
  "crunchbase": "_novelty_rank"
},

(or similar naming)

• empty string filtered to null

OK

• countries automatically detected in large text

OK

• terms_ fields are automatically listified, with the most likely delimiter automatically identified. In practice, this means the ; seperated values will now be a proper json array from the ES response.

OK

• Geographic lat lon values are now always floats

OK

other changes:
• State names in CB data

Now that we decided to send ID for countries, maybe it’s trivial to add a id_state_organisation to NIH too?
Apologies for this, I’ve been on the verge of talking about it 3 or 4 times and I didn’t have a chance and then I forgot.

Things not done yet (relatively short tasks) which will go into the same release:
⇒ Mixed analyzers for country and city lists

re: analyzers
Many more fields should have mixed analyzers, as I was doing in this https://github.com/nestauk/nesta/pull/74/files, see https://github.com/nestauk/nesta/blob/2d1cc12fc73959afa1c2bd43e36c34119fb1ba64/nesta/production/orms/crunchbase_es_config.json
Basically:

all of geographic entities (continent, country, state, region, city)
categories (terms_category_organisation, terms_subcategory_organisation)
labels (_terms_mesh_description)

Also from the PR, have a look at the types I was suggesting: for example url_of_organisation should be of type text rather than keyword: this lets us find items with “cancer” or similar terms in the URL.
In what branch is this?
So that I can have a quick look at nesta/production/orms/*_es_config.json files to confirm the types.

⇒ Add funders to CB and NiH

OK.
Do we have some quick coverage of this?

⇒ Add continent names

OK. Do we want to also use IDs for continents? At this point we might just use a lookup table for everything geographic to slim down the response as much as possible (1000 items would have 100s of repetitions of 6 continent strings).

Another thing still to discuss is where to find an endpoint to fetch the mappings among ids and labels for geographic entities (countries, states), and potentially other things like regions, continents, categories and ordinal values in general, to avoid repetitions in the query response.

@mindrones @pngwn @russwinch  further to the last message: reprocessed NiH data is appearing at nih_v3. Please take a look at this when you have time.

nih_v3 finished processing overnight. Note an additional cleaning which I didn't mention was converting any UPPER CASE text longer than 3 chars (to avoid the ISOs) to Camel Case. Naturally it leads to some acronyms being Camel Case'd, but I think the in overwhelming majority of cases it cleans the result.
There are some quirks in the countryTags field (such as "US" and "India" being inferred from the term "American Indian") but again in the overwhelming majority the result is pretty good.

Rerunning nih data collection since it appears many projects and abstracts are missing.

Also mesh terms are missing from the reprocessed crunchbase data due to a missing task. I'm looking into this now.

Mesh terms also missing from NiH data as these need to be reprocessed (recall this stage is manual, which George does).
Nevertheless, please review the data quality, as adding in the mesh terms can happen in parallel.

Just to follow up on the crunchbase mesh terms, these are being added now. Expect some down time whilst these add (around an hour from now).

further follow up on crunchbase mesh terms, these are now done.

(marking with (*) things that could be separate issues)

mapping:

[ ] mixed analysers, use keyword and text for

all of geographic entities (continent, country, state, region, city)
terms_category_organisation, terms_subcategory_organisation, terms_mesh_description

[ ] possibly sort alphabetically these config files (ignoring the initial "_"  like I did in #74:

https://github.com/nestauk/nesta/blob/master/nesta/production/orms/crunchbase_es_config.json
https://github.com/nestauk/nesta/blob/master/nesta/production/orms/nih_es_config.json

[ ] rename countries_codes to countries_ids for consistency

[ ] (*) check that we're using correct values in sdg_labels
[ ] (*) cost_ref is still pointing to non de-inflated values
[ ] (*) novelty is still pointing to cost values
geographic information:

[ ] (*) add continent ids
[ ] (*) add id_state_organisation on NIH #73
[ ] (*) Some companies in the United States don't have id_state_organisation [1]
[ ] (*) host a static lookup table (see nestauk/health-innovation-scanner/issues/25), to be kept in sync with geo codes used in nestauk/nesta, for:

continents
countries
states

[ ] (*) nullify cost fields for items not having a currency
[ ] (*) Add funders to CB and NiH

[1]
{
  "_index": "crunchbase_orgs_v1",
  "_type": "_doc",
  "_id": "7ce5bb09-f734-255b-4f9a-9c6e31cabf58",
  "_score": 26.6893,
  "_source": {
    "placeName_country_organisation": "United States",
    "textBody_summary_organisation": "Puma Biotechnology acquires and develops innovative products for the treatment of various forms of cancer.",
    "currency_of_funding": "USD",
    "terms_mesh_description": [
      "Animals",
      "Humans",
      "N-(4-(3-chloro-4-(2-pyridinylmethoxy)anilino)-3-cyano-7-ethoxy-6-quinolyl)-4-(dimethylamino)-2-butenamide",
      "Puma",
      "Quinolines",
      "Breast Neoplasms",
      "Protein Kinase Inhibitors",
      "Biotechnology",
      "Biological Products",
      "Protein-Tyrosine Kinases"
    ],
    "coordinate_of_city": {
      "lon": -118.242767,
      "lat": 34.053683
    },
    "date_birth_organisation": "2010-01-01",
    "textBody_descriptive_organisation": "Puma Biotechnology, Inc., is a development stage biopharmaceutical company that acquires and develops innovative products for the treatment of various forms of cancer. The Company focuses on in-licensing drug candidates that are undergoing or have already completed initial clinical testing for the treatment of cancer and then seeks to further develop those drug candidates for commercial use. The Company is initially focused on the development of PB-272 (oral neratinib), a potent irreversible tyrosine kinase inhibitor, for the treatment of patients with HER2 positive metastatic breast cancer.",
    "cost_of_funding": 674300000,
    "name_of_organisation": "Puma Biotechnology",
    "id_iso2_country": "US",
    "placeName_city_organisation": "Los Angeles"
  }
},

@luca, please refer to the index companies (not crunchbase). The above example [1] is fixed in https://search-health-scanner-5cs7g52446h7qscocqmiky5dn4.eu-west-2.es.amazonaws.com/companies/_doc/7ce5bb09-f734-255b-4f9a-9c6e31cabf58

@mindrones please use the companies index. The above issue regarding [1] is fixed (see https://search-health-scanner-5cs7g52446h7qscocqmiky5dn4.eu-west-2.es.amazonaws.com/companies/_doc/7ce5bb09-f734-255b-4f9a-9c6e31cabf58)

Note: re-rerunning production processing of NiH and CB now. These will appear under the companies_v1 and nih_v4 indexes.

Following up on previous message: companies_v1 and nih_v4 are finished processing. Just waiting on mesh labels for nih.

Moved part of these tasks to #102


Maria Runner Incorrectly Parsing DATETIME

I have UTC values stored in my DB as the value of DATETIME.
However here https://github.com/tgriesser/knex/blob/9777a1c3dea044666e3066b76935dd45ee8a6a84/lib/dialects/maria/runner.js#L89-L91 you can see that the DATETIME is parsed the same as TIMESTAMP.
function parseType(value, type) {
  switch (type) {
    case 'DATETIME': // <-------
    case 'TIMESTAMP':
      return new Date(value);
    case 'INTEGER':
      return parseInt(value, 10);
    default:
      return value;
  }
}

Is it possible to be able to pass some information on the timezone here?

I'll close this as duplicate of #1461. Newer ticket has more discussion and proposed fix to allow users override how types returned from mariasql driver to javascript values.


ActionButton Component - Color Fixes

Fixed button component colors without affecting rest of elements by creating custom fields for the coloring. The naming can be altered later should re-use apply.
This should resolve the change request on #55 , #57 (the reference is to where the coloring element was introduced and subsequently removed, respectively).

I think it finally clicked--Here's a TypeScript-friendly version.


[macOS] Set double_click for mouse up events and non left mouse button events.

Same as https://github.com/godotengine/godot/pull/89018 for macOS, also allow double click from other buttons than left.

Superseded by #92582.


Constants with type declarations

This is not allowed:
FOO : Int64 = 123

I think it should, because this allows constant initializers to use autocasting. In this case FOO = 0_i64 would also suffice, but things change when the integer type does not have a fixed size, e.g. it is platform-specific:
FOO : LibC::SizeT = 123

It is better than the following:
FOO = LibC::SizeT.new(123)

because it is easier for the compiler to infer in the first case that FOO is a compile-time constant and skip the generation of the run-time initializer (~FOO:init here).
Naturally this would allow Crystal::Macros::TypeDeclaration#var to be a Path node. Constant declarations with a type and without an initializer would still be disallowed, unless we further define them like in https://github.com/crystal-lang/crystal/issues/14085#issuecomment-1856233248.

Is there anything that would prohibit this from being implemented? I think this could be really useful, and would be happy to try implementing this.

No, I don't think there are any obstacles. Just needs someone to pick it up. You're welcome to =)


Bug (or Feature?) - Right Clicking on "arrow" makes "line" transparent

I find myself naturally right clicking the always visible "arrow" menu bar icon to access preferences. However this does not produce a pop-up menu but instead expands the hidden menu bars and toggles the "line" menu bars visibility.
https://user-images.githubusercontent.com/765324/146647271-8dcdb3b1-7270-4388-8504-8e23693bc4ef.mov
I find this behaviour very confusing but I'm not sure if its a bug or a feature.
I'd love it if it were possible to just right click ether "line" or "arrow" to access preferences.
Thanks for listening :-)

You can right click the line to access preferences.
Being able to hide the "line" is a must, as it does not need to be visible once its places where its wanted. Otherwise it adds an unnecessary icon to the bar, which extends the menu.
Sidenote: the ability to hide the "line" is the only reason, personally, I use Hidden over other apps that hide menubar icons.

Please try the v1.9, it needs more time to test so I put it in the prerelease tag, It should fix a lot of bugs.


Memory Requirements of PPO Example

I am trying to run the Brax PPO example locally, but I am experiencing Cuda out-of-memory errors. For simple environments such as reacher everything works fine. For half-cheetah and ant, I am experiencing out-of-memory errors. I presume that the required memory is proportional to the number of environments. However, even when setting the environment to 1, I get an out-of-memory error.

RuntimeError: INTERNAL: Failed to launch CUDA kernel: fusion_29 with block dimensions: 128x1x1 and grid dimensions: 1x1x1: CUDA_ERROR_OUT_OF_MEMORY: out of memory

These errors are surprising to me as I am using an RTX 3090 with 24gb RAM, which is identical to the K80 mentioned in #49 that runs ant in the collab.  Therefore, I am wondering what component affects the GPU memory the most and is it possible to reduce the GPU memory needs?

Hi Michael,
Yes, jax PPO should work fine on such a card.  A few things worth trying:

Can you please grab the brax in main rather than pypi (pip install git+https://github.com/google/brax.git@main), as it contains some fixes specifically for GPU memory usage, that have not made it into pypi yet.
I've noticed that frameworks (JAX included) try to grab big continuous slabs of memory in a way that CUDA cannot satisfy, especially if two things are running on the GPU at once.  can you run nvidia-smi to confirm that nothing else is running on the card?  If you see something else occupying memory on the card, you may want to stop that other process.
Alternatively, if neither of the above fixes the problem, you can ask JAX to disable its default allocation policy (I think upon first allocation it tries to grab 90% of the free memory on the GPU) by playing with some combination of the XLA_PYTHON_CLIENT_ALLOCATOR and XLA_PYTHON_CLIENT_PREALLOCATE flags, see info here: https://jax.readthedocs.io/en/latest/gpu_memory_allocation.html

Let us know if that gets you unstuck.

Hi Erik,
thank you so much for your help.
Using XLA_PYTHON_CLIENT_MEM_FRACTION & XLA_PYTHON_CLIENT_PREALLOCATE, I have been getting it to work and can describe the problem in more detail. However, I don't know why it is happening. Without pre-allocation and 1024 env + 128 eval env the total GPU memory is 8Gb. With the standard JAX settings, it initially allocates 90% but immediately 'believes' that the memory is exhausted and requests additional memory which then triggers the out-of-memory error. When one sets the MEM_FRACTION to 0.5, one can nicely observe that, that the 50% is directly reserved but then additional memory is immediately requested.
Do you have an idea why it wants to allocate additional memory instead of using the original 90% which is more than enough?
Is there some multi-processing involved that might cause it?
Using no pre-allocation, I got it to run. However, I am experiencing very long compile times of 17 minutes for Half-cheetah. The compile times are spent when executing the jitted reset function for the first time, e.g. reset train env and reset eval env. From my understanding compiling these functions should not take a lot of time as it just samples a joint configuration. Furthermore, the compile-time depends on the number of environments. My unscientific measuring was
                       |   1    |     2    |     4    |     8   |    16   |   32   |

Reset Train Env  | 7.6s | 10.0s | 10.0s | 16.0s | 16.7s | 150s |
Reset Eval Env   | 6.1s |   7.2s |   8.2s | 42.4s | 42.4s | 887s |
Do you have an idea why the jit of the reset functions takes so much time?
Does it trigger something from the lazy execution from JAX? (As far as I saw it does not call step)
Do you have an idea why the compile-time scales so bad with the number of environments?
Can it be that some underlying installation issues of Cuda / CuDNN are causing these compile times?

Hi,
I'm also experiencing the same issue after updating brax today.
Previously I was able to jit and run a vmapped set of 4,000 random rollouts of the halfcheetah in a few tens of seconds, but now I get a memory error. The oom is avoided if add the PREALLOCATE and MEM_FRACTION but the compilation time is incredibly long. This has slowed down my code by a huge amount.
Unfortunately I'm not able to find out what the previous version of brax was, but it was from around a month ago.
Versions of packages:
jax                       0.2.25                   pypi_0    pypi
jaxlib                    0.1.73+cuda11.cudnn805          pypi_0    pypi
brax                      0.0.7                    pypi_0    pypi

Full listing to reproduce:
from jax._src.api import value_and_grad
from jax._src.tree_util import tree_map, tree_multimap, tree_flatten

from jax import jit, vmap, lax
import jax.numpy as jnp
import jax.random as rnd
from typing import cast, Tuple

from brax import envs
import jax.random as rnd
from brax.envs.env import State
from typing import cast
import jax.numpy as jnp

from functools import partial
from jax._src.prng import PRNGKeyArray

T = 200
action_lim = 1

env_name = "halfcheetah"  # @param ['ant', 'humanoid', 'fetch', 'grasp', 'halfcheetah', 'ur5e', 'reacher']
env_fn = envs.create_fn(env_name=env_name)
env = env_fn()
action_dim = env.action_size
obs_dim = env.observation_size
n_initial_trials = 8

def rollout_random(rng_key: jnp.ndarray, T: int):
    init_s = env.reset(rng_key)
    rng_keys = rnd.split(rng_key, T)

    def inner(state, rng_key):
        rng_key_1, _ = rnd.split(rng_key, 2)
        action = (rnd.uniform(rng_key_1, shape=(action_dim,)) - 0.5) * 2 * action_lim
        action = cast(jnp.ndarray, action)
        next_state: State = env.step(state, action)
        outputs = (next_state.obs, action, next_state.reward, next_state.done, state)  # type: ignore
        return next_state, outputs

    _, outputs = lax.scan(inner, init_s, (rng_keys), unroll=1)
    return outputs

@partial(jit, static_argnames=("N", "T"))
def get_random_rollouts(
    rng_key: PRNGKeyArray, N: int, T: int
) -> Tuple[jnp.ndarray, jnp.ndarray, jnp.ndarray, jnp.ndarray, State]:
    return vmap(rollout_random, in_axes=(0, None))(rnd.split(rng_key, N), T)  # type: ignore

print(f"Rolling out {n_initial_trials} random inital trajectories")
obs, actions, rewards, _, full_states = get_random_rollouts(
    rnd.PRNGKey(0), n_initial_trials, T
)

I updated to the new Brax Version 0.0.8 from 0.0.7 and now all the compile-time and memory problems are gone. The half-cheetah compiles within 20s and the memory error is gone.
@erikfrey Could you comment on what you changed between the versions? Just from looking at the recent commit logs, I could not figure out what could have resolved these issues?

That's great to hear!  We made some major changes to the default_qp function here:
https://github.com/google/brax/commit/e1a8faf253bc50e1cba2a9b49a38dbd2f8b68944#diff-d5809d1d70b284727c83d435055073c0de6aa3a6a414ca00b6e24ba8756fcd5eR83
The old code iterated through the kinematic tree using a for loop, which forced JAX to unroll the creation of the initial state as a set of operations over giant literal constants embedded in the generated code (scaled, as you saw, by the number of environments... more environments means larger constants embedded into the generated code).
The new approach liberally uses jax.lax.scan so that the initial state isn't emitted as giant blobs of data in the generated code, but instead constructed on device on the fly.

Thanks, this greatly improved the experience and resolved all issues!


allow importing into eclipse

This PR fixes the issue with not being able to import the project into eclipse using buildship (gradle integration).  This is detailed in #1359.
Eclipse is able to have multiple projects unlike intellij which can only have one(i assume intellij sets the working directory to the root of this folder), eclipse sets it working directory to its workspace which is a different directory to its project directory.  When it tries to find the last annotated tag via git its looking in the workspace directory which is not a git repo.
The fix simply adds the -C <project root directory> from the project so it can find the correct git repository.
I have imported the project into intellij and eclipse, all existing tests pass when run from a terminal.

Thanks for your PR! I'll review and pull in this PR shortly.

I can confirm this fixed importing the project into eclipse (using the Spring Tools Suite 4 build of eclipse)

@dilipkrish any plans to get this merged?

@a1dutch sorry for the really late reply. Im just coming out of a hiatus. I had a question about this change.
While this apparently doesn't have any problems, Im curious why the build system needs to know about how the IDE works?

@dilipkrish the issue is to do with how the ide’s set different working directories.
IntelliJ can only open a single project at a time and obviously sets the working directory to that project.
Eclipse on the other hand can import multiple projects into its workspace. The workspace is the working directory but not the directory of the project.
Gradle is aware of the absolute directory of the project it just needed to tell git what directory to use as the working directory is different