Could not connect to Mongo.

Hello,
I followed the installation instructions, but I'm stuck, I need help. what am I doing wrong?

Can you post your .config file? Are you able to connect to your mongo instance from the CLI (eg - mongo)?

Thanks for the reply.
If you were thinking of the config file of MangoDB, it is below.
mongodb.pdf
And I can connect to mongo shell.

Before you run MultiCast for the first time, be sure to configure it
multicast config

and fill out the requested values.

and fill out the requested values.

I've tried a lot of times, but I could not find out which data should be entered. I did not find anything in the instructions.

Yeah, that looks correct. If you haven't set a username/password for Mongo or changed the authDb, you can use the default values. For Application ID, yes, use your GoogleCast SDK AppID. The final output should look like:
  mongoHost: 'localhost',
  mongoPort: 27017,
  mongoUsername: '',
  mongoPassword: '',
  mongoAuthDB: 'admin',
  appId: 'YOUR_GOOGLECAST_SDK_APP_ID'

Run multicast config with those options and then try multicast start again and let me know if it works.

If that doesn't work and you feel comfortable editing JS, you can find your install directory
which multicast

and edit the dbConnect.js lib to output the stacktrace for what's causing the connection error:
// app/lib/dbConnect.js
// line 16
-    .catch(() => console.log('Could not connect to Mongo.'))
+    .catch(e => {
+      console.log('Could not connect to Mongo.'))
+      console.error(e)
+    })

Same error: "Could not connect to Mongo.".
I changed dbConnect.js as you described, and now I have this:

Ahh, looks like your Mongo installation is out of date. You'll have upgrade to at least v2.6, though you may as well go ahead and update to the latest version (v4.0 as of time of writing). You can find installation instructions for the latest version here.


Launching Emulationstation blanks the screen

I am not sure if you want me to open this as an issue here, and if not, that's ok.
I have been playing with launching Emulationstation from within your launcher, as I had mentioned I would do on the clockworkpi forums.  Emulationstation will launch from X by itself, but when I try to launch it within your launcher, it seems to switch right, but it blanks the screen.  Killing emulationstation doesn't return it either, you have to restart X. Right now, it runs from a gnome-terminal session because I have been playing with retropie which needs a terminal in the background for some things.  I can run it without the terminal and it does the same thing.
Here is a readout ofthe log from the launcher
[WM] Set always on top window to 4194307
Set status title to GameShell
MappingNotify event received from 0
App id returned: 0
[Start Command Entry thread]
cd '/home/cpi/godot-launcher/apps'
exec ./ES.sh
[End Command Entry]
ConfigureRequest event received from 14680070
Updating window title to Terminal
MapRequest event received from 14680070

MapNotify event received from 14680070
[WM GODOT] Active window returned: 14680070
[GODOT] Window mapped event: 14680070, stack: 4194307; 14680070;
[GODOT] Activating a new window: 14680070
[GODOT] Giving the activating window to App LauncherApp
[GODOT] Adding a new app to the apps stack...
[WM GODOT] Active window returned: 14680070
[WM GODOT] Trying to get title of window 14680070
[WM GODOT] Window title received: Terminal
Set status title to Terminal
[GODOT] App title set
Switching to TRANSPARENT mode.
[GODOT] New app added to the apps stack.

ConfigureRequest event received from 18874391
Updating window title to EmulationStation
MapRequest event received from 18874391

MapNotify event received from 18874391
[WM GODOT] Active window returned: 18874391
Set status title to EmulationStation
[GODOT] Window mapped event: 18874391, stack: 4194307; 14680070; 18874391;
[GODOT] Activating a new window: 18874391
[GODOT] Giving the activating window to App RunningApp
Running App: active window changed
[WM GODOT] Active window returned: 18874391
[WM GODOT] Trying to get title of window 18874391
[WM GODOT] Window title received: EmulationStation
Set status title to EmulationStation
[GODOT] App title set

[GODOT] Window unmapped event: 18874391, stack: 4194307; 14680070;
[GODOT] Activating a new window: 14680070
[GODOT] Giving the activating window to App RunningApp
Running App: active window changed
[WM GODOT] Active window returned: 14680070
[WM GODOT] Trying to get title of window 14680070
[WM GODOT] Window title received: Terminal
Set status title to Terminal
[GODOT] App title set

[Command Entry thread finished with exit code 0]
[]

Waiting for thread.
Thread terminated.

[GODOT] Window unmapped event: 14680070, stack: 4194307;
[GODOT] Activating a new window: 4194307
[GODOT] Giving the activating window to App RunningApp
Running App: active window changed
[WM GODOT] Active window returned: 4194307
[WM GODOT] Trying to get title of window 4194307
[WM GODOT] Window title received:
Set status title to
[GODOT] App title set
Running app closing: 14680070
Trying to purge window 14680070

X error code 2 detected

Let me know if there's anything else you would like to see.

It's perfectly fine to open an issue here!
Can you describe your setup and the steps needed to reproduce your issue?

The setup is a bit... interesting.
Basically, it's the clockwork-debian base setup from https://github.com/wolfallein/clockworkpi-debian (with some patches to make it work right), layered with the things to get godot to work and get RetroPie to work.  I don't have a good step by step yet.
I did manage to get EmulationStation to show up, compton wasn't starting right due to a missing library.  But when Emulationstation exits, it still doesn't go back to the launcher right.  I think that something is happening with the window manager trying to change to the launcher window, which is what's spitting out the "X error code 2 detected"  I also think that's coming from the "Native" library in the library/ directory.  I am curious where the source for those libraries are.  Also, the source for your compton and godot binaries, and if we can just use the ones that would ship with debian instead.

I had the same thought you did, so I took the terminal out of the equation.  So now, ES.sh runs emulationstation directly.  The same behavior is present.
I don't mind giving it a try to test and try to fix and submit a PR.  Coding doesn't scare me a bit.  Just need the source and build scripts.
Another point that might be relevant, I can't seem to get the launcher's top and bottom bars to pop up when in emulationstation, but that could be a separate issue, which I also don't mind helping with.

I updated the repository with the source code of the native library and with basic instructions in the README, even though I'm not sure whether the procedure will work without issues.
It is quite messy right now, but at least it's there. I'll surely have to do a cleanup.

I'm glad to help if I can and if you are cool with it.

Sure! The project is open source for exactly this reason!

@uberlinuxguy I updated the native library contained in the repository.
Can you check if it behaves the same way?
I don't know how outdated it was as I'm committing from my Windows pc and I usually don't have the latest version of the armv7 compiled version locally.
Now it's the one I compiled today to fix a bug with windows dimensions/position.


[tracking] [ccx-data-pipeline-monitor] Returned error value is not checked in: server/server.go:112:24

server/server.go:112:24: responses.SendResponse(writer, responses.BuildOkResponse())

Upstream issue https://github.com/RedHatInsights/ccx-data-pipeline-monitor/issues/130

Fixed in https://github.com/RedHatInsights/ccx-data-pipeline-monitor/pull/134


mkpr

Applied mkpr on undefined
sed s/\/service": "^.*"/\/service": "^9.2.15"/

Codecov Report

Merging #704 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #704   +/-   ##
=======================================
  Coverage   99.08%   99.08%
=======================================
  Files           1        1
  Lines         109      109
  Branches        9        9
=======================================
  Hits          108      108
  Misses          1        1

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b79ed86...751a03c. Read the comment docs.


Wrong request for page creation

Looks like a request for page creation by page ref is wrong.
Following code
RichTextList richTextList = new RichTextList();
        richTextList.text("Name", Annotations.DEFAULT);

        return pages.createPage(new PageReference(parentPage), richTextList, content)

produce request
{
  "parent": {
    "type": "page_id",
    "page_id": "6bd77e46-914a-44dd-98a4-bd5f85d163a4"
  },
  "properties": {
    "title": {
      "rich_text": [
        {
          "text": {
            "content": "Name"
          }
        }
      ]
    }
  },
  "children": [
    {
      "object": "block",
      "type": "paragraph",
      "paragraph": {
        "text": [
          {
            "text": {
              "content": "Test paragrgaph"
            }
          }
        ]
      }
    }
  ]
}

it fails with errors
{"object":"error","status":400,"code":"validation_error","message":"body failed validation. Fix one: body.parent.database_id should be defined, instead was `undefined`. body.properties.title should be an array or `undefined`, instead was `{\"rich_text\":[{\"text\":{\"content\":\"Name\"}}]}`."}

The correct request should look like this:
{
    "parent": {
        "page_id": "6bd77e46-914a-44dd-98a4-bd5f85d163a4"
    },
    "properties": {
       "title": [
                {
                    "type": "text",
                    "text": {
                        "content": "Name"
                    }
                }
            ]
    },
    "children": [
        {
            "object": "block",
            "type": "paragraph",
            "paragraph": {
                "text": [
                    {
                        "type": "text",
                        "text": {
                            "content": "Test paragrgaph"
                        }
                    }
                ]
            }
        }
    ]
}

Thanks for reporting!
I've noticed this was wrong indeed, but this looks like a bug on the Notion API's side, because this makes the syntax different than from the "create page in database" case. Notion devs have been informed on the dedicated Slack, but so far this is not resolved on their side.  I'll leave this issue open for now.

@BoD Looks like same syntax for DB is also working
{
    "parent": {
        "database_id": "{{DATABASE_ID}}"
    },
    "properties": {
       "title": [
                {
                    "type": "text",
                    "text": {
                        "content": "Page title - Test 123"
                    }
                }
            ]
    },
    "children": [
        {
            "object": "block",
            "type": "paragraph",
            "paragraph": {
                "text": [
                    {
                        "type": "text",
                        "text": {
                            "content": "Lacinato kale is a variety of kale with a long tradition in Italian cuisine, especially that of Tuscany. It is also known as Tuscan kale, Italian kale, dinosaur kale, kale, flat back kale, palm tree kale, or black Tuscan palm."
                        }
                    }
                ]
            }
        }
    ]
}

Thanks for the insight! This is a bit odd - and doesn't match with the documentation.  I will wait for Notion's feedback on this, I still think it's a bug on their side.

Any update on this?
I've got the same issue but when trying to create a very simple page in a database.
notionClient.pages.createPage(
        parentDatabase = DatabaseReference(DATABASE_ID),
        properties = PropertyValueList()
            .title("Name", "Gandalf")

    )

generates following body:
{
    "parent":  {
            "type":"database_id",
            "database_id":"bcxxxc8e-f2df-49ac-9d45-bexxcdxx6xc"
    },
    "properties":  {
            "Name":{
                    "title":  [ {
                                      "text":  {
                                            "content":"Gandalf"
                                       }
                                 } ]
            }
    },
   "children":null
}

Gives following error:

Caused by: io.ktor.client.features.ClientRequestException: Client request(https://api.notion.com/v1/pages) invalid: 400 . Text: "{"object":"error","status":400,"code":"validation_error","message":"body failed validation: body.parent.page_id should be defined, instead was undefined."}"

@liquid-void This is odd, for a database parent this should definitely work. It is known to fail for a page parent only.
Are you sure the DATABASE_ID you passed is correct?
Or maybe Notion changed something on their side that broke this?
I will try to have a look on my side with my workspace and tell you if I can reproduce the issue.

@BoD
I just tested with Insomnia and curl.
And it makes no difference whether I provide this line
            "type":"database_id",
or not.
The issue is this line in the request body
   "children":null
I tried leaving it out and now the response is fine.

Thanks for the update, this is good information. Yes the children: null looks suspicious. I'll see what I can do.

@liquid-void  I've just published v1.5.1 which fixes this issue.
However the title is still ignored in the "parent is a page" case - but this on Notion API's side.
Closing this issue for now as there is nothing I can do on the client side.


[Design]: Improve Form Alignment and Aesthetic Appeal on Contact Us Page

Is there an existing issue for this?

[X] I have searched the existing issues

What happened?
Title: Improve Form Alignment and Aesthetic Appeal on Contact Us Page
Description:
The current layout of the "Contact Us" page is visually unbalanced. The form on the left and the map on the right are not properly aligned, resulting in a less professional appearance and negatively affecting user experience.
Proposed Improvements:

Vertically and horizontally align the form and map to create a balanced layout.
Adjust the margins and padding to ensure consistent spacing between the form and the map.
Ensure the layout is responsive and works well across various screen sizes.
Optionally, consider centering the form and map within the page for better aesthetics.

Expected Outcome:
The "Contact Us" page will look more professional and visually appealing, with a well-aligned layout that improves the user experience.
Add Screenshots / Video Clip
Issue:

What browsers are you seeing the problem on?
Microsoft Edge
Agreements

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSoC contributor
[X] I'm a Hacktoberfest contributor
[X] I want to work on this issue [Optional]
[X] I'm willing to provide further clarification or assistance if needed.

I would like to work on this issue. Please assign it to me.

@Tejashri-Taral please assign me this issue under gssoc extended label and hacktoberfest label using appropriate level


MissingPluginException(No implementation found for method listen on channel jitsi_meet_events)

On clicking join meeting, the following error is logged in the console.
The following MissingPluginException was thrown while activating platform stream on channel jitsi_meet_events:
MissingPluginException(No implementation found for method listen on channel jitsi_meet_events)

Please try the newest version.


[HOTFIX] Restore uninteded change of exit code in testing/dowloadSpark.sh

What is this PR for?
This PR rollbacks unintended change of exit code in testing/downloadSpark.sh after #1599 which is raised by this comments.
What type of PR is it?
Hot Fix
Questions:

Does the licenses files need update? no
Is there breaking changes for older versions? no
Does this needs documentation? no

Looks great to me, thank you @minahlee !
Merging as a hotfix, if there is no further discussion

LGTM to merge as hotfix since affects CI on other PRs


webserver unreachable [and papalook AF925 working]

Hi nopnop2002 your code is awesome, i wasted 3 days with anothers... With your code i get stream worked (or almost that)
I´m using an ESPRESSIF ESP32-S3-WROOM-1
This is my trouble, i hope would you help me:
When i start the server this apparently is started but is unrecheable, i already tested with 3 different routers (all of they working, and with differents ssid, different password, network, etc), also tested differents ports everytime is same thing
When i run the code get this on console:
I (1031) example: wifi_init_sta finished.
I (1101) wifi:new:<10,2>, old:<1,0>, ap:<255,255>, sta:<10,2>, prof:1
I (1101) wifi:state: init -> auth (b0)
I (1101) wifi:state: auth -> assoc (0)
I (1111) wifi:state: assoc -> run (10)
I (1221) wifi:connected with (my ssid), aid = 7, channel 10, 40D, bssid = (an router mac)
I (1221) wifi:security: WPA2-PSK, phy: bgn, rssi: -52
I (1221) wifi:pm start, type: 1

I (1221) wifi:set rx beacon pti, rx_bcn_pti: 0, bcn_timeout: 0, mt_pti: 25000, mt_time: 10000
I (1241) wifi:<ba-add>idx:0 (ifx:0, b0:95:75:fa:0b:8e), tid:0, ssn:3, winSize:64
I (1301) wifi:AP's beacon interval = 102400 us, DTIM period = 1
I (2731) esp_netif_handlers: sta ip: <IP_ADDRESS>, mask: <IP_ADDRESS>, gw: <IP_ADDRESS>
I (2731) example: got ip:<IP_ADDRESS>
I (2731) example: connected to ap SSID:(my ssid) password:(my pass)
I (2741) example: mdns hostname set to: [esp-cam-test]
I (2741) example: cparam0=[<IP_ADDRESS>]
I (2751) HTTP: Start task_parameter=<IP_ADDRESS>
I (2751) HTTP: Starting HTTP server on http://<IP_ADDRESS>:8080
Waiting for device

but in browser i can´t get any bit of response when i try to open or connect whith the url (http://<IP_ADDRESS>:8080)

i tested with terminal with get command and this stucked here:

 wget http://<IP_ADDRESS>:8080
--2023-03-07 16:47:27--  http://<IP_ADDRESS>:8080/
Connecting to <IP_ADDRESS>:8080...

sometimes i got this, but i can´t read any bit become from the esp32-s3:
wget http://<IP_ADDRESS>:8080/
--2023-03-07 17:46:00--  http://<IP_ADDRESS>:8080/
Connecting to <IP_ADDRESS>:8080... connected.
HTTP request sent, awaiting response...

if try to connect with the mdns i get: DNS_PROBE_FINISHED_NXDOMAIN
I tested this before and afeter of connect the cammera (papalook AF925) and always is same thing the server is unreacheable
I setup the cammera in resolution 160 x 120, 5 FPS and actived MJPEGFormat and work fine as your example:

In the terminal got:
END DEVICE CONFIGURATION
I (767971) example: format_desc->fourccFormat=(YUY2)
I (767971) example: frame_desc->wWidth=160
I (767981) example: frame_desc->wHeight=120
I (767981) example: format_desc->bDescriptorSubtype=4
I (767991) example: frame_desc->dwDefaultFrameInterval=500000
I (768001) example: format_desc->bDescriptorSubtype == UVC_VS_FORMAT_UNCOMPRESSED
W (768001) example: FRAME SIZE=160x120 FRAME RATE=5
W (768011) example: FRAME FORMAT=MJPEG
I (768011) example: format=7 width=160 height=120 fps=5
bmHint: 0001
bFormatIndex: 2
bFrameIndex: 1
dwFrameInterval: 2000000
wKeyFrameRate: 0
wPFrameRate: 0
wCompQuality: 61
wCompWindowSize: 0
wDelay: 0
dwMaxVideoFrameSize: 39528
dwMaxPayloadTransferSize: 512
bInterfaceNumber: 1
I (768061) example: uvc_start_streaming=0
Streaming...
I (770341) example: fps: 4, bytes per second: 156112
I (771751) example: fps: 3, bytes per second: 117084
I (773161) example: fps: 3, bytes per second: 117084
I (774561) example: fps: 3, bytes per second: 117084
I (775941) example: fps: 3, bytes per second: 117084
I (777351) example: fps: 3, bytes per second: 117084
I (778761) example: fps: 3, bytes per second: 117084
I (780161) example: fps: 3, bytes per second: 117084
I (781541) example: fps: 3, bytes per second: 117084
I (782951) example: fps: 3, bytes per second: 117084

Your problem looks like a network problem.
try this.
https://github.com/espressif/esp-idf/tree/master/examples/protocols/http_server
In my environment, I got this result.

Your problem looks like a network problem.
try this.
https://github.com/espressif/esp-idf/tree/master/examples/protocols/http_server
In my environment, I got this result.

Thanks nopnop2002 i try in this way but the browser don´t received any bit of info, i also tested with /favicon.ico and same thing no response, but in code are an handler for that url
httpd_uri_t _favicon_get_handler = {
		.uri		 = "/favicon.ico",
		.method		 = HTTP_GET,
		.handler	 = favicon_get_handler,
		//.user_ctx  = "Hello World!"
	};
	httpd_register_uri_handler(server, &_favicon_get_handler);

First of all, can you ping the IP address of the your ESP32?
ping your_esp32_ip_address

Hi nopnop2022, forget my error your code is great... The mistake was corrupted data from the camera i just buy an logitech C270 and Microsoft HD 3000 and now can work.
I only may work the Microsoft HD 3000 at 15FPS in 640x480 with MPEJFormat ¿do you can recommed config for the logitech C270?

do you can recommed config for the logitech C270?

It can stream at 160x120 10FPS YUYV.


New Feature: Announce layout changes

When using several layouts (e.g. QWERTY and Colemak) on the same machine it is hard to track which one is currently active (e.g. to show in status bars). While layers are announced to listeners in keyd listen, the same is not true for layouts. This PR adds that and also sends the last active layout whenever a new listener is connected to always have the current state available.

Implemented in 44d086. In the future please create an issue describing the feature before submitting a pull request.


HttpContext.User.HasUserID() is false, but HttpContext.User.Identity seems fine

Hello,
I am getting some weirdness in my MR implementation. The root of my issue seems to be that after a long time (probably when my login expires) I am getting a situation where HttpContext.User.HasUserID() is false, but HttpContext.User.Identity.Name has correct login name, and HttpContext.User.Identity.IsAuthenticated is true.
Is this normal behaviour?
~Shea M.

Odd. Not sure, someone will have to debug it :)

If it helps, if I do a logout, then login again it is fine.
I am just using the nuget package, I could download source, and have a look, which projects would I need to reference? But I need to know what is expected behavior. I am assuming that HasUserID should be returning false if Identity.Name has a value and Identity.IsAuthenticated is true? Is it just a cookie not being wiped out?

Sorry, I am not meaning to say the problem lies in MR, nor am I saying I want someone else to solve my issue. But in order for me to do anything, I need some clarification on the MembershipReboot's helper function HttpContext.User.HasUserID() .
I'll try and be more clear:
Should it ever return false when HttpContext.User.Identity.Name has a valid value?

Hmmm, digging a little deeper, and looking at cookies, I did not have a FedAuth cookie. But I did have a ASP_AUTH cookie. Not sure where this cookie came from, but it seems to be the reason that HttpContext.User.Identity.Name has a value when it shouldn't and also why Request.IsAuthenticated is returning true when it should not.
Must be a cross contamination of cookies from another MVC project I am working on and debugging on locatlhost...

So all set now? We can close this?

Yes, go ahead and close it.


Making executor consider all pending pods as requiring resource

Currently we consider pods requiring resource as:

Those running on "processing nodes"
Those that are "managed" by Armada and not assigned a node (i.e Pending)

The issue with this is that pods that are pending and not "managed" are not considered by Armada
So Armada keeps scheduling pods to take up the space this pending pod wants to use
This change should make it easier for non-Armada pods to get on the cluster (Pending -> Scheduled)

As we now leave space for it to get on

Closing old PR


Provide C interface

Bloaty has a use for Rust name demangling (see bloaty#110). Bloaty being C++ application we'd need to have a C interface to be able use rustc-demangle for that purpose.
I made quick wrapper (zokier/rustc-demangle-clib) but I think it is something that would make sense to have in-tree here.
The exact form of the interface can be discussed further, that wrapper has been made solely for the needs of bloaty.
If agreed, I can polish the the code (add tests and docs) and submit it as PR here.

For further context, bloaty is a elf/mach file size analyzer, which I think would be useful for the wider Rust community if it were able to demangle Rust symbols.

@zokier & @alexcrichton Is there anything blocking this PR? What would be needed to push it over the finish line?

Nah nothing blocking, just never got around to finishing it I think!


j4ts 0.4.0 release depends on org.jsweet:jsweet-core:5-SNAPSHOT

Related to https://github.com/cincheo/jsweet/issues/272
Tracking down dependencies that aren't showing up with only the release repo exposed to maven, I figured out this is where maven is attempting to pull down a version of jsweet-core that doesn't exist in the release repository (in addition to attempting to pull down es6-promise from the jsweet transpiler)
                <dependency>
			<groupId>org.jsweet</groupId>
			<artifactId>jsweet-core</artifactId>
			<version>5-SNAPSHOT</version>
		</dependency>

On a related note - I tried forking so I can manually build this locally and I can't find any reference to v0.4.0 anywhere in the git history.  Was 0.4.0 developed in a since-deleted branch that was never merged to master?

Ok. version 0.4.0 was a mistake. Sorry about this. I have created and deployed version 0.3.0, which should remove wrong dependencies to snapshots. It is for JSweet v1.x. If you are using JSweet v2.x, you should avoid using J4TS if possible anyway.
So, the best way for you is to use the following dep:
<dependency>
	<groupId>org.jsweet.candies</groupId>
	<artifactId>j4ts</artifactId>
	<version>0.3.0</version>
</dependency>

I hope it will fix your issues.


Error: Insufficient sites with >0.9 sample coverage in results/tree/roast_noN.fa.

Hello! Armin
I used the Call_conversation in msa_pipeline, but it errored me as below:

Found Snakefile: workflow/Snakefile. Executing test analysis.
Config file config/config.yaml is extended by additional config specified via the command line.
Building DAG of jobs...
Your conda installation is not configured to use strict channel priorities. This is however crucial for having robust and correct environments (for details, see https://conda-forge.org/docs/user/tipsandtricks.html). Please consider to configure strict priorities by executing 'conda config --set channel_priority strict'.
Using shell: /usr/bin/bash
Provided cores: 20
Rules claiming more threads will be scaled down.

[Wed Nov 15 12:08:59 2023]
rule cds_fold:
input: data/MdHF.fa
output: results/tree/sitefold.txt
log: logs/cds_fold_log.txt
jobid: 12
reason: Missing output files: results/tree/sitefold.txt
resources: tmpdir=/tmp
Activating conda environment: .snakemake/conda/7e29029ac4d1260a5defa3a8c8662fcc_
Activating conda environment: .snakemake/conda/7e29029ac4d1260a5defa3a8c8662fcc_
[Wed Nov 15 12:17:40 2023]
Finished job 12.
1 of 13 steps (8%) done
Select jobs to execute...
[Wed Nov 15 12:17:40 2023]
rule sitefold2bed:
input: results/tree/sitefold.txt
output: results/tree/sitefold.bed
log: logs/sitefold2bed_log.txt
jobid: 11
reason: Missing output files: results/tree/sitefold.bed; Input files updated by another job: results/tree/sitefold.txt
resources: tmpdir=/tmp
[Wed Nov 15 12:17:40 2023]
Finished job 11.
2 of 13 steps (15%) done
Removing temporary output results/tree/sitefold.txt.
Select jobs to execute...
[Wed Nov 15 12:17:40 2023]
rule maf2fold:
input: results/roast/roast.maf, results/tree/sitefold.bed
output: results/roast/roast.sitefold.maf
log: logs/maf2fold_log.txt
jobid: 10
reason: Missing output files: results/roast/roast.sitefold.maf; Input files updated by another job: results/tree/sitefold.bed
resources: tmpdir=/tmp
Activating conda environment: .snakemake/conda/45029268ad8b9444e2538700341456f4_
[Wed Nov 15 12:18:17 2023]
Finished job 10.
3 of 13 steps (23%) done
Select jobs to execute...
[Wed Nov 15 12:18:17 2023]
rule clean_maf:
input: results/roast/roast.sitefold.maf
output: results/roast/roast.sitefold.clean.maf
jobid: 9
reason: Missing output files: results/roast/roast.sitefold.clean.maf; Input files updated by another job: results/roast/roast.sitefold.maf
resources: tmpdir=/tmp
[Wed Nov 15 12:18:17 2023]
Finished job 9.
4 of 13 steps (31%) done
Removing temporary output results/roast/roast.sitefold.maf.
Select jobs to execute...
[Wed Nov 15 12:18:17 2023]
rule maf2fa:
input: results/roast/roast.sitefold.clean.maf
output: results/tree/roast.fa
log: logs/maf2fa_log.txt
jobid: 8
benchmark: benchmark/maf2fa_bm.txt
reason: Missing output files: results/tree/roast.fa; Input files updated by another job: results/roast/roast.sitefold.clean.maf
resources: tmpdir=/tmp
Activating conda environment: .snakemake/conda/7e29029ac4d1260a5defa3a8c8662fcc_
Activating conda environment: .snakemake/conda/7e29029ac4d1260a5defa3a8c8662fcc_
[Wed Nov 15 12:18:18 2023]
Finished job 8.
5 of 13 steps (38%) done
Removing temporary output results/roast/roast.sitefold.clean.maf.
Select jobs to execute...
[Wed Nov 15 12:18:18 2023]
rule filtN:
input: results/tree/roast.fa
output: results/tree/roast_noN.fa
log: logs/filtn_log.txt
jobid: 7
benchmark: benchmark/filtn_bm.txt
reason: Missing output files: results/tree/roast_noN.fa; Input files updated by another job: results/tree/roast.fa
resources: tmpdir=/tmp
Benchmark: unable to collect cpu and memory benchmark statistics
[Wed Nov 15 12:18:18 2023]
Finished job 7.
6 of 13 steps (46%) done
Removing temporary output results/tree/roast.fa.
Select jobs to execute...
 It is empty.
ERROR: Insufficient sites with >0.9 sample coverage in results/tree/roast_noN.fa.
Check coverage in multiple alignment results/roast/roast.maf.
Note that some highly diverged genomes may require tuning/changing of the aligner to achieve adequate coverage.
Waiting at most 5 seconds for missing files.
MissingOutputException in rule filtcols in file /ngsproject/bcguo/tools/msa_pipeline/workflow/./rules/call_conservation.smk, line 100:
Job 6  completed successfully, but some output files are missing. Missing files after 5 seconds. This might be due to filesystem latency. If that is the case, consider to increase the wait time with --latency-wait:
results/tree/roast_mincol.fa
Shutting down, this might take some time.
Exiting because a job execution failed. Look above for error message

I tried using another reference gff, and this issue no longer occurs. But I wanted to use the original gff file as a reference, How can I solve this issue? Can you help me solve this issue?
best-wish
Bo-Cheng

Sorry, I think I have solve this issue.


Add MacOS support

Compile + run on CI.

I think we require Clang 17+ on MacOS due to our use of C++20 features of <chrono> (formatting and clock_time_conversion).  The version on the current GitHub runner for MacOS 14 (the latest) is Clang 14 and 15 (https://github.com/actions/runner-images/blob/main/images/macos/macos-14-arm64-Readme.md) so we need to wait a bit longer.


Missing container information

Describe the bug
After the last Docker Update on Mac OS, all the information on the right side of lazydocker are not visible anymore.
To Reproduce
Just open lazydocker with the latest Docker Version (<IP_ADDRESS>).
Screenshots

Desktop:

OS: MacOS 10.15.6
Lazydocker Version 0.9.1

Same over here

Same here
Docker Enginge: 19.03.13
Compose: 1.27.4
MacOS: 10.15.6
LD: 0.9

LD version
Version: 0.9
Date: 2020-05-28T02:55:29Z
BuildSource: binaryRelease
Commit: 10617da5608990bf4911142745d31566bac6964a
OS: darwin
Arch: amd64

Docker version 19.03.13, build 4484c46d9d
Docker desktop version: <IP_ADDRESS>(48506)

Is it only logs? Or does Stats , Config and Top does not produce any output too?

Stats, Config and Top are also empty.

👍  same here
Lazydocker version 0.9.1
Docker version 19.03.13
Docker desktop version: <IP_ADDRESS>(48506)

I am seeing the same issue regardless of Lazydocker version. I've seen this with

Lazydocker version 0.9.1
Lazydocker version 0.7.6

I am running Docker Desktop (version <IP_ADDRESS>) on MacOS (version 10.14.6 -- Mojave). Not being able to review the logs within a central location (like lazydocker) makes using lazydocker less attractive :-(

same here

Lazydocker Version: 0.9.1
Docker Desktop (version <IP_ADDRESS>) on MacOS
Docker version 19.03.13, build 4484c46d9d

Looks like mine, logs hiding while switch containers in app, after quit - message "Waited three seconds for child process to stop. There may be an orphan process that continues to run on your system.".
sysinfo:
lazydocker installed from brew
lazydocker: stable 0.9.1 (bottled)
Docker Desktop <IP_ADDRESS> (48506), engine 19.03.13

there is  a PR to fix this problem
https://github.com/jesseduffield/lazydocker/pull/241


License Resolve issue for nuget

When I generate the SBOM for NuGet, the license resolves to CUSTOM with GitHub license text URL, and when I check the GitHub license text URL the license is MIT or Apache only not the CUSTOM license

but I am able to resolve the licenses using Cyclonedx for .NET

@sgupta22altair, you have commented out everything I need to fix this bug :) Could you share the name of any opensource repo exhibiting the same issue?

Hi @prabhu , try this project https://github.com/nkovacic/Sample-ASP.NET-project

https://github.com/owin-contrib/owin-hosting/blob/master/LICENSE.txt


Push new SNOW Clone Data Preserver file

Context: https://pagerduty.atlassian.net/browse/DOGE-314
Lisa cleaned up the file from our KB to strip some faulty configurations. I've tested this xml file on ServiceNow, which successfully preserved the PD Settings page upon clone.

Sean Higgins approves.


[Alert] Add ability to change default icon rendered when onClose is provided

Duplicates

[X] I have searched the existing issues

Latest version

[X] I have tested the latest version

Summary 💡
The icon for the close IconButton when onClose is provided to Alert is hard-coded to be the MUI Close icon. This should be configurable through props for MUI consumers using a different icon library.
Examples 🌈
Pagination exposes a components prop that lets consumers specify first, last, next, and previous icons.
Motivation 🔦
We are using MUI as a base for a component library with different designs and icons. We temporarily worked around this by documenting that consumers of our library should never pass onClose and instead provide an IconButton with our own close icon in the action prop.

Looks like we can add the components & componentsProps API here to allow people to override all slots available.


Haddock web site links to trac, which is deprecated.

This is the website I'm talking about: https://www.haskell.org/haddock/

To submit a bug report or a feature request, use the Haddock Trac.

And then the Trac links here.

The whole site is pretty grossly out of date, we may scrap it all together.

#360


[sqlserver] Add table filter to speed up SqlServerSchema reading

@Jiabao-Sun @pgm-rookie Pls code review, If you are available.


stack create with blocking state

Docker version 1.11.2
rancher with HA

Useful
Info

Versions
Rancher v1.1.0-dev3 Cattle: v0.161.5 UI: v1.1.3

Access
localauth admin

Orchestration
Cattle

Route
environment.index

Did you add a docker-compose.yml and rancher-compose.yml when you tried to add a stack? If so, there is most likely a yaml error in your files that is blocking it from succeded.
You can copy the same yml files and use rancher-compose CLI to test out your yaml files. The errors would surface using the CLI.
There's an open issue to have the errors from the parsing to surface to Rancher UI when creating stacks.
https://github.com/rancher/rancher/issues/3950

@demohi If you are still facing issues, please re-open and provide the requested information


Screenshots page: Add vaccination section

Feature description
The screenshots page should, starting at the release date of version 2.3, cover the new vaccination certificate with its own section.
Problem and motivation
All other central features of the app have an own section, but the vaccination feature.
Is this something you're interested in working on
I assume you are tracking this internally already and will work on it, so (:

Will be implemented, see https://github.com/corona-warn-app/cwa-website/commit/a3c8c2283eaaf8c5174a9d1b13249ce601a5d787

This has already been implemented.
Closing as implemented.


StateError: Bad state: Future already completed  Flutter sdk 2.2.3

Flutter crash report.
Please report a bug at https://github.com/flutter/flutter/issues.
command
flutter --no-color attach --machine --device-id=96a684a0 lib/main.dart
exception
StateError: Bad state: Future already completed
#0      _AsyncCompleter.complete (dart:async/future_impl.dart:45:31)
#1      FlutterDevice.connect.<anonymous closure> (package:flutter_tools/src/resident_runner.dart:327:17)
<asynchronous suspension>

flutter doctor
[✓] Flutter (Channel stable, 2.2.3, on Mac OS X 10.15.7 19H2 darwin-x64, locale zh-Hans-CN)
    • Flutter version 2.2.3 at /Users/xxxx/FVM_FlutterSDK/2.2.3
    • Framework revision f4abaa0735 (5 个月前), 2021-07-01 12:46:11 -0700
    • Engine revision 241c87ad80
    • Dart version 2.13.4

[✓] Android toolchain - develop for Android devices (Android SDK version 30.0.3)
    • Android SDK at /Users/xxxxx/Library/Android/sdk
    • Platform android-30, build-tools 30.0.3
    • Java binary at: /Library/Java/JavaVirtualMachines/jdk1.8.0_291.jdk/Contents/Home/bin/java
    • Java version Java(TM) SE Runtime Environment (build 1.8.0_291-b10)
    • All Android licenses accepted.

[✗] Xcode - develop for iOS and macOS
    ✗ Xcode installation is incomplete; a full installation is necessary for iOS development.
      Download at: https://developer.apple.com/xcode/download/
      Or install Xcode via the App Store.
      Once installed, run:
        sudo xcode-select --switch /Applications/Xcode.app/Contents/Developer
        sudo xcodebuild -runFirstLaunch
    ✗ CocoaPods not installed.
        CocoaPods is used to retrieve the iOS and macOS platform side's plugin code that responds to your plugin usage on the Dart side.
        Without CocoaPods, plugins will not work on iOS or macOS.
        For more info, see https://flutter.dev/platform-plugins
      To install see https://guides.cocoapods.org/using/getting-started.html#installation for instructions.

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[!] Android Studio (version 2020.3)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    ✗ Unable to find bundled Java version.
    • Try updating or re-installing Android Studio.

[✓] Connected device (2 available)
    • GM1900 (mobile) • 96a684a0 • android-arm64  • Android 11 (API 30)
    • Chrome (web)    • chrome   • web-javascript • Google Chrome 96.0.4664.45

! Doctor found issues in 2 categories.

Duplicate of #77581


Expose sensor history for Elgato Eve

Nice to have feature: Integrate fakegato-history so historical data can be viewed in the Eve app.

Fakegato mentions that the updates should preferably happen at a fixed interval. Unfortunately I'm not sure that this is the case for all devices. I would have to see if I can come up with some logic to work around this (if it's needed).

love to see this :)

Would love this feature also.

Power consumption for Fakegato also would be great

That would be a very nice feature. I recently switched my config from Deconz/Homebridge to Z2M/Homebridge, that's the only thing I miss.

Any progress?

Any progress?

Not from my side.

Any progress?

Not from my side.

Thank you
That’s too bad ))

Of course that does mean setting up another service and using another interface, which obviously mighty not be as easy as using an off-the-shelf app for certain users.

It's very nice to just pop into the Eve app to see what the temperature has been during the night. I used to be able to compare the outdoor (from homebridge-weather-plus) and indoor temperature changes when I used dconz (via homebridge-hue), but now I can only see the current temperature from my zigbee devices indoor.

@T-IOOO, I think this might perhaps be "better" solution to the log thingy you proposed on Discord.

Thanks! I will give it a try

It's not implemented in this plugin yet. Just saying that to me, spending time on this feature would make more sense than the feature you have requested and would probably serve your use case even better.

I'd be happy to contribute $10 to a bug bounty for this - let me know if you have a preferred platform?


Weird design for broadcast_to Op

@sxjscience: Why does broadcast_to force the user to specify trailing 1's to make the input dimension the same rank as the broadcast shape rank? (and thus forcing users to use an extra reshape layer?)
For example, the Numpy example doesn't even work with broadcast_to, it throws
src/operator/./broadcast_reduce_op-inl.h:102: Check failed: (param.shape.ndim()) == (ishape.ndim())

when inferring the output shape.

Actually, I see now that this is to resolve ambiguities. Closing the issue.


Fails on Xcode 16

The xcresulttool version that comes bundled with Xcode 16 deprecates the commands currently used, such as xcresulttool get object, and introduces new ones.
For it to work normally, without changing to use the new commands, it  requires the --legacy argument to be passed when calling deprecated methods, otherwise it errors out, for example
mint run xcparse screenshots my_repo/someTarget.xcresult my_repo/output_dir

fails with
Error: Error: This command is deprecated and will be removed in a future release, --legacy flag is required to use it.
Usage: xcresulttool get object [--legacy] --path <path> [--id <id>] [--version <version>] [--format <format>]
  See 'xcresulttool get object --help' for more information.

Environment:

OS:  macOS 14.6.1 (23G93)
xcode_summary version:  latest
Swift version: 6.0 (the default when using Xcode's 16(.1) toolchain)
XCResult version

"version" : {
   "major" : 3,
   "minor" : 53
 }

To Reproduce
use danger-xcode_summary with Xcode 16 as the selected toolchain (i.e. via xcode-select -s)
Expected behavior
It should not fail
Additional context
I've a fork with a simple fix for it, let me know if I should move a PR with it
Here's an example of a similar issues:

https://github.com/fastlane/fastlane/issues/22132
https://github.com/ChargePoint/xcparse/issues/87

https://github.com/fastlane-community/xcresult has released a version with a fix for it, I believe that updating it will do it

Fixed in #93

@diogot Will you create new release with that fix ?

It's already released https://github.com/diogot/danger-xcode_summary/releases/tag/v1.3.1


Mathjax does not render on chrome in hosting but render on chrome in localhost?

Hi, i have a problem when runing Mathjax on chrome in hosting.
My website runing ok on localhost when upload to my hosting it's not working
I tested on firefox it's ok and opera still ok too
Any ideal for that problem ?

Without a link to a live page, there's not much to say, I'm afraid. Do you get any errors in the developer console? Do you have Chrome extensions that might interfere?

This sounds similar to what I'm experiencing. I can retrieve the base MathJax.js file which pulls down MathMenu.js and MathZoom.js, but no other extensions within Chrome (localhost or not). I've tried pointing to an apache deployment, a simple http-server, our dev and QA deployments, and even went as far as trying:
<script type="text/javascript" src="http://cdn.mathjax.org/mathjax/2.2-latest/MathJax.js" defer></script>
All yielded the same results.
https://gyazo.com/71bac7549a0d1c6d92d65e1f36f2a558
No console errors, no 404's, no toast messages (just that it's Loading MathMenu and MathZoom, nothing else). This happens in Chrome 53 on OSX and Chrome (version unknown at the moment) within a Windows 7 VM. Stranger still is it only seems to happen on my machine and no one else's. It's not my extensions as I don't have those running within the VM and even after disabling all of them the problem still occurs.

@hprofit again, not much to say without a live page. I would suggest to try clearing the browser cache to ensure that it is not due to file corruption (Chrome developer tools => network tab => disable cache, or via the Chrome settings but then include a restart of Chrome).
Also, your screenshot shows that MathJax v2.2 is being loaded. That version was released over 3 years ago and has numerous bugs that have been fixed since then; if you can, please try the latest version.

@hprofit, you do not include a configuration file (via the ?config=... option following MathJax.js in the src attribute), so unless you are including an in-line configuration block (we can't tell since you didn't give a complete example), then MathJax will not have been told what input format you are planning to us, nor what output format you want to provide.  So it won't load or register any pre-processors, and so won't look for any math on the page.
See the documentation for more details about loading a configuration file.  And as Peter says, you might want to update to the current version of MathJax.


docs: Add Easypanel as a deployment method

Could you move this the community-contributed sections instead?
ref: https://www.chatwoot.com/docs/self-hosted#community-contributed-providers

@sojan-official At the same time, this directory remains under the cloud, but Easypanel is a self hosting solution rather than a cloud solution.

@sojan-official Hello, I'm writing because I haven't received an answer for a long time.


adding note about yo generators

I have added a section to list info about yeoman generators. Right now we just have generator-aspnet and generator-csharp. Later when other community members create their unique generators we can update this list.
Any concerns?

Any concerns if I merge this?

Sorry @sayedihashimi, just seen this. No concerns :)


[windows build]: please add RelWithDebInfo build type

flutter currently only have Debug/Release/Profile build types on windows. but visual studio has a RelWithDebInfo type, which can help produce debug symbol files (pdb) when build a deployable app, to symbolic crash report after app release.
so please add the RelWithDebInfo build type on windows platform.

Some ref to this request
https://docs.microsoft.com/en-us/cpp/build/customize-cmake-settings?view=msvc-170#configuration-type
https://cmake.org/pipermail/cmake/2001-October/002479.html

FWIW, for the main app executable this is currently possible via CMakeLists.txt - see #98863
It won't include the plugins which are built as .dll libs though so I'll also vote for an option to have the build add the linker option producing full and/or stripped PDB files for everything.

U can try this workaround, add script in your windows project root CMakeLists.txt, so u can got your build pdb files.
# make Release => RelWithDebInfo
set(CMAKE_CXX_FLAGS_RELEASE "${CMAKE_CXX_FLAGS_RELWITHDEBINFO}")
set(CMAKE_EXE_LINKER_FLAGS_RELEASE "${CMAKE_EXE_LINKER_FLAGS_RELWITHDEBINFO}")
set(CMAKE_SHARED_LINKER_FLAGS_RELEASE "${CMAKE_SHARED_LINKER_FLAGS_RELWITHDEBINFO}")


Documentation

Poorly documented, this is unfortunate.

I see some reasonably good docstrings in, for example, the high_level module. Worth copying and pasting some of that into the docs?

@ldo

I see some reasonably good docstrings in, for example, the high_level module. Worth copying and pasting some of that into the docs?

It should be a good start, but I think you should use that as a reference and create the definitions yourself. So that it is more understood by the users.

Agreed! The docstrings should be used to document specific classes and methods. These could be included in the online docs as reference, but it is only part of the documentation. Other parts usually are tutorials (how to get started, how to solve common problems) and topics (background info).


Support for Azure Keyvault

Hi,
It will be very useful and secure to have a dependency that allows us to connect our Quarkus Applications properties with Azure KeyVault to retrieve secrets.
The concept is very simple, just add a few properties to enable the extension to list all properties and select those that make a match with a specific placeholder.
Example:
password: ${APPLICATION_USER_PASSWORD:localpassword}
In Spring Cloud there is already an extension for that https://learn.microsoft.com/en-us/azure/developer/java/spring-framework/configure-spring-boot-starter-java-app-with-azure-key-vault but this only works for spring I guess.

@radcortez I think you've worked on this, don't you?

Not the KeyVault. I did the Azure App Configuration.
I also had plans to implement the Key Vault support. I'll do it in the next few weeks.

@radcortez there is already a Key Vault extension in Camel, I thought you were involved in it. I'll try to migrate this extension as a high priority

there is already a Key Vault extension in Camel

That one is JVM-only - i.e. it has no proper tests.

I looked, and it is the specific Camel component, so it is not integrated with Quarkus Config system. We should provide proper integration with it.

@all-contributors please add @JoaoBrandao for bug

Hello @JoaoBrandao loading Secrets as properties is available now, please see https://docs.quarkiverse.io/quarkus-azure-services/dev/quarkus-azure-key-vault.html#_read_secrets_as_properties.

Close the issue, please let me know if you have any question.


Adopt latest proxy core

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 3 committers have signed the CLA.:white_check_mark: dzahariev:x: NickyMateev:x: pankratorYou have signed the CLA already but the status is still pending? Let us recheck it.


investigate using RNA-STAR alignment results as input for RNA-STARfusion calling

Currently the most expensive single step in immuno is STAR-fusion.  This is mostly because it starts alignments from scratch instead of using the results generated in the STAR-align step.
Refer here for details on this:
https://github.com/STAR-Fusion/STAR-Fusion/wiki#alternatively-kickstart-mode-running-star-yourself-and-then-running-star-fusion-using-the-existing-outputs

This has been resolved by https://github.com/griffithlab/analysis-wdls/pull/53


Add prevention of destruction by headless pistons.

This allows server owners to disable pistons being able to break any blocks by adding a check to see if the would-be head is actually a piston head. Direction isn't tested, but could be added on if need be.

Thinking about the naming the property some more; perhaps it would be better to be more broad, since there could be more than just pistons?
A name that could work would be preventPermanentWorldDestructionExploits, or a bit more simply preventWorldDestructionExploits. Which should it be?

Thank you so much for the contribution!
I think's it's alright to leave the name to be piston related. If a new destruction exploit is found (e.g. plant one), it can simply be added as another option.
Imho grouping more patches under same option (as it is rn) has proven not to be the best option :P.


Fix Smithing Recipes and update to 1.19.3

I have updated the mod to 1.19.3. Also, because Fabric uses intermediary mappings when run outside of a development environment, I had to use a mixin accessor to get the correct field for SmithingRecipe.base and SmithingRecipe.addition.

Thank you so much for opening this PR :) Apologies I didn't get to it sooner. I have just one comment on your TODO, wondering if there is any regression I should be aware of before I merge it.

Whoops! I thought I removed that. It all works as expected from what so can tell. I would give it a test locally first yourself.


Create data-residency.md

Adding information pertaining to data residency when using Azure Remote Rendering

Microsoft authors of articles need to make updates through the private repository so the updates can be staged and validated by the current validation rules. After you review staging and fix all validation issues, you can add the sign-off comment to let the PR reviewers know the updates are ready to be merged.It's easy to access the private repo version of your articles in GitHub. Just add -pr to the URL, as follows:
Public repo URL: https://github.com/MicrosoftDocs/azure-docs
Private repo URL: https://github.com/MicrosoftDocs/azure-docs-pr
We have closed this pull request. Please resubmit the updates through the private repo. For more information, [see the contributor guide].(https://docs.microsoft.com/en-us/contribute/)


Can't open file: Absolute URIs are not supported

I'm running OpenXMLSDK(2.5.0) on Mac OS 10.11.2 (EI Capitan) with Mono 4.2.1 .
When I'm trying to open a Docx file, I got this exception:
targetUri Parameter name: Absolute URIs are not supported
My code is below:
public static void Main (string[] args)
{
    Console.WriteLine ("Hello World!");
    using (WordprocessingDocument doc = WordprocessingDocument.Open ("/tmp/test_open.docx", true))
    {
          MainDocumentPart mainPart = doc.MainDocumentPart;
    }
}

Error stack:
Unhandled Exception:
System.ArgumentException: targetUri
Parameter name: Absolute URIs are not supported
  at System.IO.Packaging.PackUriHelper.ResolvePartUri (System.Uri sourcePartUri, System.Uri targetUri) <0x32b0440 + 0x00187> in <filename unknown>:0
  at DocumentFormat.OpenXml.Packaging.OpenXmlPartContainer.LoadReferencedPartsAndRelationships (DocumentFormat.OpenXml.Packaging.OpenXmlPackage openXmlPackage, DocumentFormat.OpenXml.Packaging.OpenXmlPart sourcePart, DocumentFormat.OpenXml.Packaging.RelationshipCollection relationshipCollection, System.Collections.Generic.Dictionary`2 loadedParts) <0x32b3208 + 0x0021b> in <filename unknown>:0
  at DocumentFormat.OpenXml.Packaging.OpenXmlPart.Load (DocumentFormat.OpenXml.Packaging.OpenXmlPackage openXmlPackage, DocumentFormat.OpenXml.Packaging.OpenXmlPart parent, System.Uri uriTarget, System.String id, System.Collections.Generic.Dictionary`2 loadedParts) <0x32b4678 + 0x001eb> in <filename unknown>:0
  at DocumentFormat.OpenXml.Packaging.OpenXmlPartContainer.LoadReferencedPartsAndRelationships (DocumentFormat.OpenXml.Packaging.OpenXmlPackage openXmlPackage, DocumentFormat.OpenXml.Packaging.OpenXmlPart sourcePart, DocumentFormat.OpenXml.Packaging.RelationshipCollection relationshipCollection, System.Collections.Generic.Dictionary`2 loadedParts) <0x32b3208 + 0x00447> in <filename unknown>:0
  at DocumentFormat.OpenXml.Packaging.OpenXmlPackage.Load () <0x784b88 + 0x003eb> in <filename unknown>:0
[ERROR] FATAL UNHANDLED EXCEPTION: System.ArgumentException: targetUri
Parameter name: Absolute URIs are not supported
  at System.IO.Packaging.PackUriHelper.ResolvePartUri (System.Uri sourcePartUri, System.Uri targetUri) <0x32b0440 + 0x00187> in <filename unknown>:0
  at DocumentFormat.OpenXml.Packaging.OpenXmlPartContainer.LoadReferencedPartsAndRelationships (DocumentFormat.OpenXml.Packaging.OpenXmlPackage openXmlPackage, DocumentFormat.OpenXml.Packaging.OpenXmlPart sourcePart, DocumentFormat.OpenXml.Packaging.RelationshipCollection relationshipCollection, System.Collections.Generic.Dictionary`2 loadedParts) <0x32b3208 + 0x0021b> in <filename unknown>:0
  at DocumentFormat.OpenXml.Packaging.OpenXmlPart.Load (DocumentFormat.OpenXml.Packaging.OpenXmlPackage openXmlPackage, DocumentFormat.OpenXml.Packaging.OpenXmlPart parent, System.Uri uriTarget, System.String id, System.Collections.Generic.Dictionary`2 loadedParts) <0x32b4678 + 0x001eb> in <filename unknown>:0
  at DocumentFormat.OpenXml.Packaging.OpenXmlPartContainer.LoadReferencedPartsAndRelationships (DocumentFormat.OpenXml.Packaging.OpenXmlPackage openXmlPackage, DocumentFormat.OpenXml.Packaging.OpenXmlPart sourcePart, DocumentFormat.OpenXml.Packaging.RelationshipCollection relationshipCollection, System.Collections.Generic.Dictionary`2 loadedParts) <0x32b3208 + 0x00447> in <filename unknown>:0
  at DocumentFormat.OpenXml.Packaging.OpenXmlPackage.Load () <0x784b88 + 0x003eb> in <filename unknown>:0

Does anyone know what is the problem here? Thank you.

+1 The same issue here using Mono.

The SDK hasn't been systematically checked out with Mono, although I have heard anecdotal reports of success using it.  I have successfully made a 'hello world' Open XML SDK app using Mono, but that's about it.
There have been reported issues associated with the implementation of System.IO.Packaging that comes with Mono - minor variations in semantics in certain limited scenarios that cause errors.  I have not researched if it would be possible to code around those issues, but have heard from other developers that they have got it working.  It would be necessary to do a systematic test of the SDK on Mono to understand all issues.  The PackUriHelper class is not very complicated, so there certainly should be a reasonable way to solve the above issue, but without precise details, it is difficult to know what the issue is.
It could, in theory, be possible to use the new, open source System.IO.Packaging that comes with the SDK, which in turn uses System.IO.Compression.  However, I have heard other anecdotal evidence that there are issues/bugs with Mono's implementation of System.IO.Compression.  Again, would be necessary to do a systematic test to determine if this is a good way forward.
If the Mono implementation of System.IO.Compression isn't workable, it could be possible to port the COREFX implementation of System.IO.Compression to Mono.  COREFX is licensed using the MIT license, so no legal issues here.  I don't have any idea of what issues one might encounter when doing this port.
Long story short, there probably is a way forward to get the SDK to work reliably and predictably with Mono, but it will require some work and research.  This currently is not on the schedule.  If this is vital to your project, please let us know.  This feedback is super important to those who are in charge, so that they know where to allocate resources for the SDK.
Instead of using Mono, would it be an option to use COREFX?  (https://github.com/dotnet/corefx)  It works on Linux and Mac (and of course Windows).  The folks in charge are discussing the desirability of porting the SDK to COREFX.  If you have an opinion about this, please let us know.
We are currently in the process of expanding the XUnit tests for the SDK.  (Commit to the repo should happen today!)  These XUnit tests are vital to doing the port of the SDK to Mono / COREFX.  After doing the port, if the new set of XUnit tests run, we can have good confidence about the functionality of the SDK on that port.  Without these tests, we would have no good way of determining whether the SDK is working properly or not on Mono / COREFX.
So, we are doing the right stuff to enable porting to other platforms, but the actual porting work hasn't really started.  The System.IO.Packaging in COREFX is identical to the System.IO.Packaging that is included in the Open XML SDK, so we are a good step along in doing this port, but more work remains.
Leaving this issue open to keep visibility.

Thank a lot for introducing COREFX. I'll try it out!

@santochan Do you solve it?

@codepandy :
Please test your scenario with the latest bits as we have replaced custom System.IO.Packaging (https://github.com/OfficeDev/Open-XML-SDK/commit/5ef669ba14b043ece9e1fa4643c294d9120d4a4e ). If it still does not work with latest bits, let us know.

I'm running with the latest mono 4.8 on Debian 8.7 and the latest NuGet package for Open-XML-SDK.
I'm still getting this exception, even when I temporarily change the current working directory of the process such that i use relative files instead of absolute paths. I've tried with System.IO.Packaging but to no avail.
Creating a new file works without issues. Has anyone code that successfully opens an existing Excel file for edit?
This is a very important project for us I'm desperate to find a solution or workaround.

@jvanriel When I last looked at this issue, there was also a bug In Mono itself. I attempted a poor pull request at https://github.com/mono/mono/pull/3630 but with those changes I was able to manipulate xlsx files.

It looks like the mono pull request form igitur is not (yet) merged.  From an Open-XML-SDK perspective a simple test like the one below : create an .xlsx file (which works) and then open that file again (which fails) seems like a pretty fundamental issue.
As far as i understand both Open-XML-SDK and Mono are under the same MS umbrella. Could I get some guidance from an insider about when this issue could be fixed and released and as of when we could consider to use a Linux-Mono/OpenXML for production use?
I've used the joelharkes.DocumentFormat.OpenXml version 2.7.1 package for this. Here is the test:
using DocumentFormat.OpenXml;
using DocumentFormat.OpenXml.Packaging;
using DocumentFormat.OpenXml.Spreadsheet;
namespace ExcelOpen
{
class MainClass
{
public static void Main(string[] args)
{
string fileName = "/tmp/test.xlsx";
		SpreadsheetDocument document = SpreadsheetDocument.Create(fileName, SpreadsheetDocumentType.Workbook);
		WorkbookPart workbookPart = document.AddWorkbookPart();
		workbookPart.Workbook = new Workbook();
		WorksheetPart worksheetPart = workbookPart.AddNewPart<WorksheetPart>();
		worksheetPart.Worksheet = new Worksheet();
		workbookPart.Workbook.Save();

		SpreadsheetDocument.Open(fileName, true);
	}
}

}
Note that when using only a workbook (without a sheet) there is no issue.

This appears to be fixed on Mono. A similar issue is seen on Xamarin, but is due to: https://github.com/OfficeDev/Open-XML-SDK/issues/249. Closing this issue.


CI for pull requests from forks

The environment variables in the CI are only available for branches on the main repo. This means that some tests fail as they are looking for COIL_USER/COIL_PASSWORD

Apparently we could use restricted contexts and add a step that requires approval to the workflow. If not the exact step itself, then another doing essentially the same thing, could be ran in the case of branches pushed to this main repo.
See: https://circleci.com/docs/2.0/contexts/

@sublimator is this just for the extension ci jobs?

extension/oauth-scripts yeah


FFI list iterator

Codecov Report

Merging #958 (96082aa) into main (161a0d8) will decrease coverage by 0.01%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##             main     #958      +/-   ##
==========================================
- Coverage   84.32%   84.31%   -0.02%
==========================================
  Files         389      389
  Lines       41115    41122       +7
==========================================
  Hits        34672    34672
- Misses       6443     6450       +7

Impacted Files
Coverage Δ

lib/ffi/src/list.rs
0.00% <0.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 161a0d8...96082aa. Read the comment docs.


Wallet Autounlock failed when I start siad via systemd

BUG REPORT
Wallet autounlock does not work when I start siad via systemd
Stack Trace or error message
Jun 25 19:06:51 siacontainer systemd[1]: Started Sia Daemon.
Jun 25 19:06:51 siacontainer siad[378]: Sia Daemon v1.3.3
Jun 25 19:06:51 siacontainer siad[378]: Git Revision 94ea84e
Jun 25 19:06:51 siacontainer siad[378]: Loading...
Jun 25 19:06:51 siacontainer siad[378]: (0/5) Loading siad...
Jun 25 19:06:51 siacontainer siad[378]: (1/5) Loading gateway...
Jun 25 19:06:51 siacontainer siad[378]: (2/5) Loading consensus...
Jun 25 19:06:52 siacontainer siad[378]: (3/5) Loading transaction pool...
Jun 25 19:06:52 siacontainer siad[378]: (4/5) Loading wallet...
Jun 25 19:06:52 siacontainer siad[378]: (5/5) Loading host...
Jun 25 19:06:52 siacontainer siad[378]: Sia Wallet Password found, attempting to auto-unlock wallet
Jun 25 19:06:52 siacontainer siad[378]: Auto-unlock failed.
Jun 25 19:06:52 siacontainer siad[378]: Finished loading in 0.336557167 seconds
Expected Behavior
Auto unlock the wallet when systemd start siad
How to reproduce it (as minimally and precisely as possible)
Create this siad.service
[Unit]
Description=Sia Daemon
After=network.target
[Service]
ExecStop=/siadata/Sia-v1.3.3-linux-amd64/siac stop
WorkingDirectory=/siadata/Sia-v1.3.3-linux-amd64
Restart=always
RestartSec=5
Environment=SIA_WALLET_PASSWORD="secretpassword"
ExecStart=/siadata/Sia-v1.3.3-linux-amd64/siad -M gctwh
[Install]
WantedBy=multi-user.target
Autounlock does fail.
Environment

Sia version: 1.3.3
OS: Ubuntu 16.04

This looks like Sia is getting the wrong seed.  I'm not sure if you're supposed to have the quotes, and double check your seed is correct.

I double checked the password. I put it in a Textfile in the systemd script an it is correct. It does not work.
I have I custom password when i export it direct in the Environment I works. But not via systemd can you check it?

There is no bug. However the sia auto wallet unlock works only if in systemd the environment is set like this
Correct:
Environment="SIA_WALLET_PASSWORD=secretpassword"
False
Environment=SIA_WALLET_PASSWORD="secretpassword"
The difference are the quotes.

I'll close this for now since it seems like the problem got resolved.


Most Lipis flags have the wrong colors

Earlier this year I corrected some flags in this repo
Soon discovered nearly all flags have bloated SVG because of weird transforms 'pushing' the flags into a 640x480 viewBox
Comparing other SVG Repos I learned a lot of Lipis flags use the wrong colors, overall Lipis flags are too bright
Switched tactics, instead of correcting SVG, I re-created all flags with a 23 KB (gzip) Custom Element
Example where Lipis flags have wrong colors:

Lipis flag triangle is wrong also:

Repo Flags can be compared at:
https://flagmeister.github.io/documentation.html?flag=za

Hi,
You tool is really fun to compare!
There have been a lot of discussions here and I think it boils down to the issues that on one hand many countries don't specify a precise color and the other mostly specify a pantone color which is a colorspace for physical objects. And I think it isn't possible to uniquely map the color of objects into a tuple of red, green and blue light brightnesses.
The Flag I can tell most about is the Austrian flag which should be a very simple case (red-white-red). But then the Wikipedia explains (quoting a proper document by the Austrian military) that formerly The red used to be [Pantone 032 C]https://www.pantone.com/color-finder/Red-032-C) and since last year is now Pantone 186 C (which is a lot darker and doesn't really look like the flag to me).
Now if we want to believe the RGB mappings on the pantone website (and honestly I don't think one can as the exact color depends on so many things like display settings) then this would be #EF3340 and #C8102E.
But none of the flags in your nice comparison have either of these two. And this is just the look at what should be one of the easiest cases.
So I think getting pedantic over flag colors is a fun thing to do, but getting a precise "correct" result is probably pretty close to impossible.
But that doesn't mean that cases where the colors are visibly far off shouldn't be corrected.

Yes, I did get a bit pedantic over flags
First SVG size, then colors, then JS size
After long comparison of several sources I chose the SchemeColor site to be "my" truth,
https://www.schemecolor.com/austria-flag-colors.php = #ED2939 for Austria red
So we now have 4 colors for Austria-red, this Repo goes for #DF0000

Given the other flags I say #DF0000 is clearly wrong.
My guess is some kind of export color-filter was used for many flags
https://flagmeister.github.io/documentation.html?flag=at


Upload of large file fails in dev branch

Dev branch throws
(node:29857) UnhandledPromiseRejectionWarning: RangeError [ERR_FS_FILE_TOO_LARGE]: File size<PHONE_NUMBER>) is greater than possible Buffer:<PHONE_NUMBER> bytes
when uploading a large file (above size of buffer) chunking is expected to prevent this
Chunking options in the .env file weren't touched
I raised the max size in .env and in the nginx site.conf
Screenshot of console output:

Sorry for getting back to you so late, but this is being reworked on. You should not try to use the dev branch as a daily driver, at least with big files.

This is no longer the case.
Solved in the dev release I'm pushing tonight


Add a body to for() loops to fix Google closure warnings

This fixes the JSC_SUSPICIOUS_SEMICOLON warning when using Google closure on the file.
WARNING - If this if/for/while really shouldnt have a body, use {}

I've been looking at using json3 and was running this through closure and noticed these warnings. Do you know why this commit broke the Travic CI tests? If so is there any chance that these will be fixed and resubmitted soon?


Add support for PubSub emulator host variable

This fixes #998. Datastore already support emulator host variable.

Coverage increased (+0.0007%) to 84.673% when pulling fc80c3eaba83f2d93cf81248a67c6ae078f68244 on mziccard:pubsub-emulator-host into 513ca7034aca5395ab4e1b7a36899ffa56566af8 on GoogleCloudPlatform:master.

/cc @lesv

LGTM - I had to do something like that last week.


RX100iv 24h time format

Hi,
Many thanks for your good work! I have installed the play memory app on my US purchased Sony RX100 iv and can now access all languages, removed recording time limits etc.
I would appreciate the possibility to set the time to 24h format. As my camera is a "US model" it seems to be restricted to 12h am/pm format which is not the biggest problem in the world but very annoying.
Many thanks in advance

I also would love this.


Tabular: os.fork() called by MXNet NN model during prediction causing OOM

This OOM error was caused during training of Albert OpenML dataset (Large) on m5.2xlarge. This OOM error has never been encountered before. (Happened 3 times on latest benchmark run on Albert and Airlines datasets).
The error happened during the setup for training the weighted ensemble with bagging and stacking disabled. Therefore, each model needs to do predictions on the validation data in turn (The amount of validation data is very small, less than 10,000, and therefore should not cause issues). For whatever reason, TabularNN is forking the process, which likely leads to a doubling of memory usage.
Question: Why are we running OOM during a stage that should require very minimal memory usage, and why are we forking the process?
Stack Trace, note that the memory check shortly prior to this indicates 32% memory usage:
[INFO] [amlb.utils.process:01:07:58.029] CPU Utilization: 41.7%
[INFO] [amlb.utils.process:01:07:58.029] Memory Usage: 32.1%
[INFO] [amlb.utils.process:01:07:58.029] Disk Usage: 15.7%
[ERROR] [amlb.benchmark:01:08:55.237] [Errno 12] Cannot allocate memory
Traceback (most recent call last):
  File "/home/ubuntu/workspace/automlbenchmark/amlb/benchmark.py", line 391, in run
    meta_result = framework.run(self._dataset, task_config)
  File "/home/ubuntu/workspace/automlbenchmark/frameworks/autogluon_nobag/__init__.py", line 4, in run
    return run(*args, **kwargs)
  File "/home/ubuntu/workspace/automlbenchmark/frameworks/autogluon_nobag/exec.py", line 16, in run
    return exec_template.run(dataset=dataset, config=config, parameters=parameters)
  File "/home/ubuntu/workspace/automlbenchmark/frameworks/autogluon/exec_template.py", line 82, in run
    **fit_params
  File "/home/ubuntu/workspace/autogluon/autogluon/task/tabular_prediction/tabular_prediction.py", line 425, in fit
    hyperparameters=hyperparameters, time_limit=time_limits_orig, save_data=cache_data, verbosity=verbosity)
  File "/home/ubuntu/workspace/autogluon/autogluon/utils/tabular/ml/learner/default_learner.py", line 99, in fit
    hyperparameters=hyperparameters)
  File "/home/ubuntu/workspace/autogluon/autogluon/utils/tabular/ml/trainer/auto_trainer.py", line 39, in train
    self.train_multi_and_ensemble(X_train, y_train, X_test, y_test, models, hyperparameter_tune=hyperparameter_tune, feature_prune=feature_prune)
  File "/home/ubuntu/workspace/autogluon/autogluon/utils/tabular/ml/trainer/abstract_trainer.py", line 507, in train_multi_and_ensemble
    self.train_multi_levels(X_train, y_train, X_test, y_test, models=models, hyperparameter_tune=hyperparameter_tune, feature_prune=feature_prune, level_start=0, level_end=self.stack_ensemble_levels)
  File "/home/ubuntu/workspace/autogluon/autogluon/utils/tabular/ml/trainer/abstract_trainer.py", line 522, in train_multi_levels
    self.stack_new_level(X=X_train, y=y_train, X_test=X_test, y_test=y_test, models=models, level=level, hyperparameter_tune=hyperparameter_tune, feature_prune=feature_prune, time_limit_core=time_limit_core, time_limit_aux=time_limit_aux)
  File "/home/ubuntu/workspace/autogluon/autogluon/utils/tabular/ml/trainer/abstract_trainer.py", line 533, in stack_new_level
    aux_models = self.stack_new_level_aux(X=X_test, y=y_test, fit=False, level=level+1, time_limit=time_limit_aux)
  File "/home/ubuntu/workspace/autogluon/autogluon/utils/tabular/ml/trainer/abstract_trainer.py", line 568, in stack_new_level_aux
    X_train_stack_preds = self.get_inputs_to_stacker(X, level_start=0, level_end=level, fit=fit)
  File "/home/ubuntu/workspace/autogluon/autogluon/utils/tabular/ml/trainer/abstract_trainer.py", line 797, in get_inputs_to_stacker
    X = dummy_stackers[level+1].preprocess(X=X, preprocess=False, fit=False, compute_base_preds=True)
  File "/home/ubuntu/workspace/autogluon/autogluon/utils/tabular/ml/models/ensemble/stacker_ensemble_model.py", line 92, in preprocess
    y_pred_proba = base_model.predict_proba(X)
  File "/home/ubuntu/workspace/autogluon/autogluon/utils/tabular/ml/models/tabular_nn/tabular_nn_model.py", line 384, in predict_proba
    return self._predict_tabular_data(new_data=X, process=True, predict_proba=True)
  File "/home/ubuntu/workspace/autogluon/autogluon/utils/tabular/ml/models/tabular_nn/tabular_nn_model.py", line 398, in _predict_tabular_data
    new_data = self.process_test_data(new_data, batch_size=self.batch_size, num_dataloading_workers=self.num_dataloading_workers, labels=None)
  File "/home/ubuntu/workspace/autogluon/autogluon/utils/tabular/ml/models/tabular_nn/tabular_nn_model.py", line 486, in process_test_data
    problem_type=self.problem_type, labels=labels, is_test=True)
  File "/home/ubuntu/workspace/autogluon/autogluon/utils/tabular/ml/models/tabular_nn/tabular_nn_dataset.py", line 150, in __init__
    self.generate_dataset_and_dataloader(data_list=data_list)
  File "/home/ubuntu/workspace/autogluon/autogluon/utils/tabular/ml/models/tabular_nn/tabular_nn_dataset.py", line 158, in generate_dataset_and_dataloader
    num_workers=self.num_dataloading_workers)  # no need to shuffle test data
  File "/home/ubuntu/virtual/automlbenchmark/lib/python3.6/site-packages/mxnet/gluon/data/dataloader.py", line 642, in __init__
    initargs=[self._dataset, is_np_shape(), is_np_array()])
  File "/home/ubuntu/anaconda3/lib/python3.6/multiprocessing/context.py", line 119, in Pool
    context=self.get_context())
  File "/home/ubuntu/anaconda3/lib/python3.6/multiprocessing/pool.py", line 174, in __init__
    self._repopulate_pool()
  File "/home/ubuntu/anaconda3/lib/python3.6/multiprocessing/pool.py", line 239, in _repopulate_pool
    w.start()
  File "/home/ubuntu/anaconda3/lib/python3.6/multiprocessing/process.py", line 105, in start
    self._popen = self._Popen(self)
  File "/home/ubuntu/anaconda3/lib/python3.6/multiprocessing/context.py", line 277, in _Popen
    return Popen(process_obj)
  File "/home/ubuntu/anaconda3/lib/python3.6/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/home/ubuntu/anaconda3/lib/python3.6/multiprocessing/popen_fork.py", line 66, in _launch
    self.pid = os.fork()
OSError: [Errno 12] Cannot allocate memory

pip freeze output:
attrs==19.3.0
# Editable install with no version control (autogluon==0.0.7b11042020)
-e /home/ubuntu/workspace/autogluon
# Editable install with no version control (autogluon-utils==0.0.1)
-e /home/ubuntu/workspace/autogluon-utils
Babel==2.8.0
bcrypt==3.1.7
boto3==1.12.36
botocore==1.15.36
catboost==0.22
certifi==2<IP_ADDRESS>
cffi==1.14.0
chardet==3.0.4
click==7.1.1
cloudpickle==1.3.0
colorama==0.4.3
ConfigSpace==0.4.10
cryptography==2.9
cycler==0.10.0
Cython==0.29.16
dask==2.6.0
deap==1.3.1
debtcollector==2.0.0
decorator==4.4.2
distributed==2.6.0
docutils==0.15.2
fasteners==0.15
fire==0.3.0
fsspec==0.7.1
future==0.18.2
gluoncv==0.7.0b20200405
gluonnlp==0.8.1
graphviz==0.8.4
h2o==<IP_ADDRESS>
HeapDict==1.0.1
idna==2.9
importlib-metadata==1.6.0
ipython-genutils==0.2.0
iso8601==0.1.12
jmespath==0.9.5
joblib==0.14.1
jsonschema==3.2.0
jupyter-core==4.6.3
kaggle==1.5.6
kiwisolver==1.2.0
liac-arff==2.3
lightgbm==2.3.1
matplotlib==3.2.1
mock==4.0.2
monotonic==1.5
more-itertools==8.2.0
msgpack==1.0.0
mxnet==1.6.0
nbformat==5.0.5
netaddr==0.7.19
netifaces==0.10.9
networkx==2.4
nose==1.3.7
numpy==1.18.2
openml==0.7.0
oslo.concurrency==4.0.1
oslo.config==8.0.1
oslo.i18n==4.0.0
oslo.utils==4.1.0
packaging==20.3
pandas==0.25.3
paramiko==2.7.1
pbr==5.4.4
Pillow==6.2.1
plotly==4.6.0
pluggy==0.13.1
portalocker==1.6.0
protobuf==3.11.3
protobuf3-to-dict==0.1.5
psutil==5.7.0
py==1.8.1
pyaml==20.4.0
pyarrow==0.16.0
pycparser==2.20
PyNaCl==1.3.0
pyparsing==2.4.6
pyrsistent==0.16.0
pytest==5.4.1
python-dateutil==2.8.1
python-slugify==4.0.0
pytz==2019.3
PyYAML==5.3.1
requests==2.23.0
retry==0.9.2
retrying==1.3.3
rfc3986==1.3.2
ruamel.yaml==0.16.10
ruamel.yaml.clib==0.2.0
s3fs==0.4.2
s3transfer==0.3.3
sagemaker==1.55.0
scikit-learn==0.20.4
scikit-optimize==0.8.dev0
scipy==1.2.3
six==1.14.0
smdebug-rulesconfig==0.1.2
sortedcontainers==2.1.0
stevedore==1.32.0
stopit==1.1.2
tabulate==0.8.7
tblib==1.6.0
termcolor==1.1.0
text-unidecode==1.3
toolz==0.10.0
tornado==6.0.4
TPOT==0.11.1
tqdm==4.45.0
traitlets==4.3.3
typing==<IP_ADDRESS>
update-checker==0.16
urllib3==1.25.8
wcwidth==0.1.9
wrapt==1.12.1
xmltodict==0.12.0
zict==2.0.0
zipp==3.1.0

To clarify, you never saw this issue previously show up on Albert/Airlines before this issue was posted, right?  Or do you think that in the previous runs, the NN never got a chance to produce this error due to time limits, and it is now producing the error because of increased efficiency in the other models?

I believe the latter given more thought. This run was on non-bagged, so every model trains 10x faster in a sense. It is also possible that it didn't run OOM on bagged version because it failed in the try/except part of the code during training (NN predicts on validation in fit() with bagging, which the exception can get caught and NN gets skipped).

One fix that should avoid the os.fork() / multiprocessing is to change the self.num_dataloading_workers from:
self.num_dataloading_workers = max(1, int(kwargs['num_cpus']/2.0))
...
self.num_dataloading_workers = 1

in these lines:
https://github.com/awslabs/autogluon/blob/7e551a22921de4c2fdef594f99f7b06896a5ed6b/autogluon/utils/tabular/ml/models/tabular_nn/tabular_nn_model.py#L172-L174
to simply always have:
self.num_dataloading_workers = 0
This just supposes extra available threads will be utilized by the installed MXNet (MKL) as appropriate for the network computations rather than data-loading. It might be too unsafe for us to presume we can more aggressively ask for extra dataloading_worker threads for arbitrary heterogeneous datasets, especially when the available memory differs during training/validation/prediction phases based on outside context.
If num_dataloading_workers = 0 fixes the issue, we could discuss setting num_dataloading_workers > 0 during training and num_dataloading_workers = 0 during prediction.  It's just unfortunately hard to come up with a single setting that exploits efficiency gains where possible but still works on any dataset.

Do you know why it is running OOM? Is the fork causing memory doubling? Does it call fork for every core? Would it make sense to multi-thread instead? Forking and doubling memory would also be a significant time overhead, which would actually slow down most inference.

Discussed offline with @jwmueller , according to the existing use case, there's no reason to use multiprocessing workers, since each worker process has to keep a copy of original ndarray.
Two choices here:

Stick with num_workers=0 for DataLoader, to avoid duplicate data in child processes
Use num_workers>0, together with thread_pool=True, this will not bypass GIL, but can significantly reduce the memory usage, while potentially improve the IO

Thanks for your input!  I think we should first try thread_pool=True to avoid

I was able to demonstrate NN slowdown on the current setting by creating a large list in memory before calling task.fit():
long_lst = [i for i in range(200000000)]
On my Mac, this 7 GB list increased inference time by ~20% consistently for the NN. This would probably be much more severe on a larger machine with more cores and more data in memory.
Inference Time by Scenario:
Normal: 0.48s
LongLst: 0.60s
ThreadPool: 0.37s (Not affected by LongLst)
NumWorkers0: 0.13s (Not affected by LongLst)
I will plan to run a full benchmark with ThreadPool and NumWorkers0 settings to see how they compare to the current settings.

Interesting... after delving into it a bit, I also found the DataLoader behaves in counterintuitive ways.  Most of the public MXNet material regarding DataLoader practices is with regards to datasets stored on-disk rather than in-memory like the ArrayDataset we operate on.  Older MXNet models used to usually use DataIterator rather than DataLoader, but this documentation specifically recommends DataLoader over DataIterator:
https://mxnet.apache.org/api/python/docs/tutorials/packages/gluon/data/datasets.html#Appendix:-Upgrading-from-Module-DataIter-to-Gluon-DataLoader
It seems we may end up in the strange situation where the NN could plausibly run at optimal performance using num_workers = 0 rather than > 0, and using mxnet (single-thread) rather than mxnet-mkl (multi-thread)...

Benchmark Results:

                               framework  time_train_s  metric_error  time_infer_s       acc       auc   logloss  bestdiff  loss_rescaled      rank  rank=1_count  rank=2_count  rank=3_count  rank>3_count  error_count
0    autogluon_ag_nn_nostack_numwork0_4h    283.258974      0.330012      1.147583  0.831875  0.849475  0.562289  0.003097       0.025641  1.923077             4            34             1             0            0
1             autogluon_ag_nn_nostack_4h    244.100000      0.329844      1.204280  0.832035  0.849426  0.561840  0.002009       0.066691  2.025641             0            38             1             0            0
2  autogluon_ag_nn_nostack_threadpool_4h    883.158974      0.329747      1.817375  0.832004  0.849349  0.561519  0.001360       0.083982  2.051282             1            35             3             0            0

This suggests to use the current setting during training, and numwork0 for inference, or perhaps numwork0 for both in we want to lean towards memory stability. thread_pool=True should be avoided, at least for m5.2xlarge instances.

I tested with an additional configuration (called _mixed in the benchmark): training set is kept as is, but validation set and test sets for inference use numworkers = 0. This achieves the best result with no downsides compared to the other methods:
                               framework  time_train_s  metric_error  time_infer_s       acc       auc   logloss  bestdiff  loss_rescaled      rank  rank=1_count  rank=2_count  rank=3_count  rank>3_count  error_count
0    autogluon_ag_nn_nostack_numwork0_4h    290.444737      0.338697      1.174810  0.827697  0.842307  0.562289  0.003178       0.026316  2.381579             4             0            33             1            0
1             autogluon_ag_nn_nostack_4h    250.284211      0.338524      1.229560  0.827861  0.842256  0.561840  0.002062       0.054820  2.513158             0             2            36             0            0
2       autogluon_ag_nn_nostack_mixed_4h    243.205263      0.338736      1.173114  0.827857  0.842221  0.562271  0.002979       0.089021  2.539474             0             2            35             1            1
3  autogluon_ag_nn_nostack_threadpool_4h    905.784211      0.338425      1.859594  0.827830  0.842176  0.561519  0.001396       0.082441  2.565789             1             1            33             3            0

Please see #422 for the proposed solution.


1.0 Docs

Here's a checklist of things to document. Please comment with requests/suggestions:
Getting Started

[x] Quick start (install, start, build)
[x] What is a toolkit?
[x] Working with Fabricator - overview of directory structure, templating engine, css and js comilation, code/note toggles.

Building a toolkit

[x] Materials

Defining your taxonomy
Adding materials
Adding notes to a material

[x] Rapid Prototyping (fabricator-assemble)
[x] Data

Adding data files
Sample context footprint
Reserved context (title, baseurl)

[x] Stylesheets and Javascript (define your own architecture)

Sass
Browserify

Advanced

[x] Adding Helpers
[x] Using Ruby Sass and other Pre-compilers
[x] Customizing the menu
[x] Third party dependencies (bower recipe)
[x] Themes

I have all these items documented locally and push after proof-reading.

http://fbrctr.github.io/docs


WIP: Yet another simulator (browser, typescript, React, Threejs)

Not polished at all, but you can experiment and try out your animations.
Demo available: https://leqwasd.github.io/treesim/

Tree is loaded from https://raw.githubusercontent.com/standupmaths/xmastree2021/main/coords_2021.csv
For animations - you can either upload, load from URL, or select from a list (Since I saw only 1 PR with an example, there is only one example to choose from.
Mine tree does not have fractal tree 😜 but you can play, pause, and seek, just like media controls :)
Known bugs and TODOs:

[x] Sometimes animation doesn't stop
[x] Framerate of the animation speed goes whacy
[ ] add README
[x] add styles

Added option to embed animation CSV urls into URL with scheme:
https://leqwasd.github.io/treesim/?url=<URL> e.g.
https://leqwasd.github.io/treesim/?url=https://raw.githubusercontent.com/BoostCookie/xmastree2021/main/examples/bouncy-ball.csv

If you Submit a Query with a local file but you haven't browsed to any file, the animation starts counting frames with "xx/-1" (with xx being some number) and goes on probably forever with the LEDs staying white. You missed a check if there is any csv-file.
Other than that, that's my go-to tree simulator right now. Everything I could ask for.


fix(balance): debugging call on mobile web

:tada: This PR is included in version 5.10.1 :tada:
The release is available on npm package (@latest dist-tag)
Your semantic-release bot :package::rocket:


Camel sslContextParameter not working

Hi Team,
I am trying to use ssl certificate to make rest call , but seems its not working as expected however its working on spring boot with camel:
#Code snippet for updating ssl context parameter
CamelContext camelContext = getContext();
KeyStoreParameters ksp = new KeyStoreParameters();
ksp.setResource("/etc/camel/conf.d/_secrets/****/.p12");
ksp.setPassword("");
KeyManagersParameters kmp = new KeyManagersParameters();
kmp.setKeyStore(ksp);
kmp.setKeyPassword("*****");
SSLContextParameters scp = new SSLContextParameters();
scp.setKeyManagers(kmp);
camelContext.setSSLContextParameters(scp);
#command :
kamel run --secret=*** --dependency=camel-http --dependency=camel-undertow  ***Proxy.java --dev

If you are using the latest version of camel-k (1.2.0), the default runtime has been switched to quarkus so best is to follow this guide: https://quarkus.io/guides/http-reference#ssl

@lburgazzoli
Thanks for your reply
Created a config map for application.properties and added below content:
quarkus.http.ssl.certificate.key-store-file="/etc/camel/conf.d/_secrets/***/certificate.p12"
quarkus.http.ssl.certificate.key-store-file-type="P12"
quarkus.http.ssl.certificate.key-store-password=""
then used below command to run but still same
kamel run --configmap=configmap --secret=**-cert --dependency=camel-http --dependency=camel-undertow  ***Proxy.java --dev

In latest version 1.5 we're introducing a different way to manage secret and properties. You may have a look at the examples here to see how we're setting SSLContextParameter with the new configuration: https://github.com/apache/camel-k/tree/main/examples/http


Hierarchical hyper-parameter configurations

Specifying hyper-parameters in flat/non-hierarchical form is the most natural first approach but as models grow in complexity such flat schemes can become unwieldy - both from the human perspectives of (1) understanding / intuiting how to improve and (2) maintaining them as well as from (3) the optimization perspective of a software tuner seeking to infer what a previous success indicates about what to try next.
Gin is an example of how to implement this (as is in practice in the Trax library). This seems like a great approach with only minor exceptions from perspective e.g. that it feels a little unnatural when developing in the notebook to specify hparams as a block of strings instead of as python objects.
Another requirement beyond hierarchy to consider is the means to specify allowable hyper-parameter ranges as was done in the tensor2tensor library and which could be used to configure tuning on CloudML.
A differential for this feature would be the perspective that flax is meant to be lower-level than the concern that would require such a means of configuration to be included in the core library.

So, we have a lot of experience with Gin and tensor2tensor (and I personally worked on trax as well).  Though Gin can be a lifesaver when trying to bring sanity to an existing codebase needing configuration management, we find that Gin tends to infect the entire codebase with its dependency injection approach and adds a number of issues, e.g. too much noise to stacktraces, making debugging much less pleasant.  If our users wish to use Gin that's great:  it can be a great way of organizing hparam settings and we really don't want to dictate how users control their training loops.  We just want to avoid adding that additional complexity to our examples for now.
That said, we would like to settle on a better 'canonical' strategy for hparam management in Flax.  The one demonstrated in the examples is a kick-the-can-down-the-road non-answer.
A subset of design questions on the table:

do we just use a global config-dictionary scope?  perhaps we scope some configs to a flax model?  or to particular layers or functions?  (The latter being closer to Gin's function wrapping.)
whether to use a 'smart' config system in python itself as in t2t, or a 'dumb' config format like YAML, etc. that only allows plain-old-data as configuration variables.  This is of course an old design debate in the software/devops world generally.
do we include hyperparameter domain-annotations as you mention for helping random/guided search libraries?
how do we support hparam "hierarchy"?  e.g. in t2t subclassing/templating is short-term convenient but leads in my experience to confusing "nested-doll" configurations that can take many hours to unwind and debug after months of research accretion (So we lean hard no on that kind of inheritance based on past pain.)
how tightly do we integrate it w. Flax layers? It could turn out that we only offer some minimal tooling to support the diverse opinions in the ML community.  We tend to lean strongly in the "anti-framework" direction for flax and want to keep things decoupled, but also recognize how core hparam management is for ML work.

So: we're still trying to find the right spot in design space that will maximize utility for our users without getting in their way or precluding their own solutions.  Further comments on the issue are most welcome!

Ack on timing, importance of clear docs, clear debugging, imposition on training strategy, and built-in vs. canonical recommendations / anti-framework. Partial metaphor in another domain is OpenWC that offers an opinionated docs site + a generator.
To your point above about unconstrained the functional sub-classing know exactly what you mean. That ref to t2t was just noting the feature of range or set hparams.
About hierarchy it's worth acknowledging there are two kinds to consider i.e. hierarchical configuration of a single model vs. a hierarchical lineage of configurations (perhaps the latter was source of complexity in t2t configs).
Your reference to yaml vs. python config in the devops world is great food for thought (linked examples). In our case local + same language vs. remote + potentially different.
Free thinking... perhaps useful to shift perspective from management of a library of independent hparam configs to individual experiment specification - that being the conjunction of settings and model and training etc. code (perhaps plus annotations for what is tunable) e.g. with an individual experiment specified by an individual python module.
In this latter pattern, arbitrary hierarchy, composition, etc. is supported in the natural way of specifying a program instead of looking for a non-program DSL that can be used to configure arbitrary programs. The in-program specification of hparams won't break these out as cleanly as e.g. the Gin approach but you could easily write an editor plugin that extracts and displays these.
... good to better understand the problem and clearly the design context is complex. Thank you for the interesting discussion.


CR19: Home Page: Add the word 'Food' in banner titles

Tools: JQuery

Added 'Food' text to banner to make the distinction as to what recalls are being displayed