default discovery workflow for compute nodes is hard coded

Following up from Slack conversation -
the default discovery workflow is hard coded and a system configuration can't change what workflow is invoked by default for a new compute node. The relevant code in question is https://github.com/RackHD/on-http/blob/master/lib/services/profiles-api-service.js#L125-L135
The system should allow for a configuration to define an alternate base discovery graph

@heckj Would a preferred approach, which is possible today, be to just change the definition for the Graph.Discovery workflow via the API? The downside is it will get replaced on a git update, but the upside, I think, is less complexity because we encourage editing workflows rather than adding additional config variables.

Good question - that makes sense to me, not sure what the driver was behind Lakshmi's request in Slack

@heckj I think this might tie in nicely as more of a driver to implement the "second" stage cataloging step, where we do further cataloging based on a generated SKU definition. I could also see slotting in some space for "just do whatever extra cataloging the user has specified."

The current flow that i observed is as follows:

rackHD discovers a compute node
Node tries to PXE boot and fails.
apply "bootSettings" to discovered node.
reboot node.
Node now boots with the kernel and initrd specified in the bootSettings.

My requirement is to automate this discovery process eliminating steps 2 and 4 so that any compute node discovered by my rackhd instance auto boots my custom linux image.

@lakshminv the way I would recommend doing this is having a SKU driven workflow that runs as part of our extra SKU workflow stage within discovery, where the SKU driven workflow adds the boot settings data. We are missing a task that would be able to make updates to a node document, but at the same time it would be trivial to add. Does this sound like something that would work for you?

@benbp Yes, I've experimented with the SKU driven workflow and i think it will be good for me now. but the problem with SKUs is to create the matching rules. for now i can create rules to match the nodes that I already know. But with new nodes i'm still not confident. Is there a way to specify a SKU rule to apply for all compute nodes?
As you mentioned earlier, could you point me to the API used to change the default Graph.Discovery workflow?
But in the long run, I feel having the default discovery workflow as a configurable parameter would help in many ways.

@lakshminv You could just use a catch-all regex to match all nodes, something like
rules: [
    "path": "dmi.System Information.Manufacturer",
    "regex": "*"
]

The API you can use to change the default Graph.Discovery is just the graph definitions API, so you would be modifying the existing discovery workflow.
PUT /api/2.0/workflows/graphs
Content-type: application/json
Body: <workflow definition>

# You can get the existing workflow definition via
GET /api/2.0/workflows/graphs/Graph.SKU.Discovery
GET /api/2.0/workflows/graphs/Graph.Discovery
# The Graph.SKU.Discovery workflow runs the Graph.Discovery workflow as a sub-workflow

It seems from your listed requirements that you want to just create bootSettings automatically. I think the simplest way is for us to create a task allowing for node document changes, and then you can append this task to the discovery workflow, or just add it to a SKU workflow.

thanks @benbp. can you please reuse this ticket to create a task allowing for node document changes.

@lakshminv sounds good. We've got some outstanding work coming soon for that. I'll add some links in here.

@lakshminv : Found this old issue that was still open.  So a couple things here if you are still in this space:

We have work currently going up (PRs up from @VulpesArtificem ) to enable a configurable discovery workflow. PRs here:
https://github.com/RackHD/on-http/pull/543
https://github.com/RackHD/docs/pull/365

We have a ticket in our backlog to be able to modify a node document. Was originally for another use case besides "bootSettings" but we had been getting push back there because of having it too wide open. Anyway, now that I have the specific use case I'll try to push it forward. benbp (who is no longer around) had mentioned this use case, but I didn't know the background/details until I found this ticket.

Based on no response, closing this ticket out.  One last piece of information here is there is an API under the nodes/{identifier} route that allows a PATCH to add bootSettings.


Toolkit reportedly doesn't work at all for some users with v1.0.0

Defective ToolKit Feature Name:
Entire Toolkit
Expected Behavior
Toolkit should load and be active in user session.
Actual Behavior
User sees no Toolkit features.
Export of Toolkit Settings (Bottom Left of Settings Page)
[{"key":"CustomFlagNames","value":false},{"key":"ShowCategoryBalance","value":false},{"key":"TargetBalanceWarning","value":false},{"key":"accountTransactionSearch","value":false},{"key":"accountsClearSelection","value":true},{"key":"accountsDisplayDensity","value":"1"},{"key":"accountsEmphasizedOutflows","value":false},{"key":"accountsRowHeight","value":"0"},{"key":"accountsSelectedTotal","value":true},{"key":"accountsStripedRows","value":false},{"key":"activityTransactionLink","value":true},{"key":"betterScrollbars","value":"3"},{"key":"budgetBalanceToZero","value":true},{"key":"budgetProgressBars","value":"0"},{"key":"budgetQuickSwitch","value":true},{"key":"budgetRowsHeight","value":"0"},{"key":"calendarFirstDay","value":"0"},{"key":"categoryActivityPopupWidth","value":"2"},{"key":"changeEnterBehavior","value":true},{"key":"checkCreditBalances","value":false},{"key":"checkNumbers","value":false},{"key":"closeReconcileWindow","value":false},{"key":"collapseExpandBudgetGroups","value":true},{"key":"collapseSideMenu","value":true},{"key":"colourBlindMode","value":false},{"key":"compactIncomeVsExpense","value":true},{"key":"currentMonthIndicator","value":false},{"key":"daysOfBuffering","value":true},{"key":"daysOfBufferingHistoryLookup","value":"0"},{"key":"editButtonPosition","value":"0"},{"key":"enableRetroCalculator","value":true},{"key":"enlargeCategoriesDropdown","value":true},{"key":"enterInRegisterNow","value":true},{"key":"exportTransactions","value":true},{"key":"goalIndicator","value":false},{"key":"goalIndicatorWarningColor","value":true},{"key":"googleFontsSelector","value":"0"},{"key":"hideAOM","value":false},{"key":"hideAccountBalancesType","value":"0"},{"key":"hideHelp","value":true},{"key":"highlightNegativesNegative","value":false},{"key":"importNotification","value":"0"},{"key":"incomeFromLastMonth","value":"1"},{"key":"l10n","value":"0"},{"key":"largerClickableIcons","value":false},{"key":"monthlyNotesPopupWidth","value":"2"},{"key":"moveMoneyAutocomplete","value":true},{"key":"moveMoneyDialog","value":true},{"key":"navDisplayDensity","value":"0"},{"key":"options.dark-mode","value":true},{"key":"pacing","value":"2"},{"key":"popupCalculator","value":true},{"key":"printingImprovements","value":true},{"key":"privacyMode","value":"2"},{"key":"reconciledTextColor","value":"0"},{"key":"removePositiveHighlight","value":false},{"key":"removeZeroCategories","value":true},{"key":"reports","value":true},{"key":"resizeInspector","value":true},{"key":"rightClickToEdit","value":true},{"key":"runningBalance","value":true},{"key":"seamlessBudgetHeader","value":true},{"key":"showIntercom","value":true},{"key":"spareChange","value":false},{"key":"splitKeyboardShortcut","value":true},{"key":"splitTransactionAutoAdjust","value":true},{"key":"squareNegativeMode","value":false},{"key":"stealingFromNextMonth","value":true},{"key":"swapClearedFlagged","value":false},{"key":"toBeBudgetedWarning","value":true},{"key":"toggleSplits","value":true},{"key":"toggleTransactionFilters","value":"1"},{"key":"warnOnQuickBudget","value":false}]

System Settings
ToolKit Version: 1.0.0
Operating System (Mac/Windows/Etc): Windows
Browser (Chrome/Firefox/Safari): Chrome
Browser Version: 48.0.2564.116

I recommend 2 things.

Upgrade Chrome to the latest version
Shut Chrome down completely, restart it and then try YNAB again

I reported this. It is definitely an issue with the version of chrome. I was on 32bit Linux and chrome is no longer supported on 32bit systems. The toolkit works fine on another machine using the latest version of chrome and in firefox. After updating my system to 64bit and installing chrome latest version there are no issues.

Cool, I'll go ahead and close this issue then. Thanks!


How to change the logo?

How to change the logo?

Not sure if that possible, currently logo image is embedded resource, along with a ton of static resources, even include the handle bar views.
Even if you change the SitePhysicalDirectory options, and prepare replacement image, other static resources still not be found.
So in short... i don't think that possible at this point.
But still... a nice option to have.

SilkierQuartzOptions
public string Logo { get; set; } = "Content/Images/logo.png";
Supports any value that is a viable as a img src attribute value: url, or base64
src='data:image/jpeg;base64, LzlqLzRBQ...[end of base64 data]'
Defaults to the SilkierQuartz original logo


lxc stop waits indefinitely

lxc info

Distribution:
Distribution version: 2.6.2
apiextensions:

storage_zfs_remove_snapshots
container_host_shutdown_timeout
container_syscall_filtering
auth_pki
container_last_used_at
etag
patch
usb_devices
https_allowed_credentials
image_compression_algorithm
directory_manipulation
container_cpu_time
storage_zfs_use_refquota
storage_lvm_mount_options
network
profile_usedby
container_push
container_exec_recording
certificate_update
container_exec_signal_handling
gpu_devices
container_image_properties
migration_progress
id_map
network_firewall_filtering
apistatus: stable
apiversion: "1.0"
auth: trusted
environment:
architectures:

x86_64
i686
driver: lxc
driverversion: 2.0.6
kernel: Linux
kernelarchitecture: x86_64
kernelversion: 4.1.12-61.1.18.el7uek.x86_64
server: lxd
serverpid: 194945
serverversion: 2.6.2
storage: zfs

Issue description
I have encountered a strange behavior in which lxc stop command waits indefinitely. In another window issuing any lxc command (like lxc info) succeeds and also releases the previous lxc command (which now succeeds).
I have seen this behavior mostly after copying a container to a different host using  'lxc copy'. This happens on the second host during the first start/stop.
Any help?

Any chance you can try to reproduce this with liblxc 2.0.7 (instead of 2.0.6) and LXD 2.11 (instead of 2.6.2)?
liblxc 2.0.7 fixes a number of multi-threading issues that could explain your hangs and LXD has similarly received a great number of fixes since 2.6.2.

This could well be the same issue as I had and reported here:
https://github.com/lxc/lxd/issues/2947
At least the symptoms are greatly alike.
sidxz you could try to log into the container after the failing stop command and see with ps what the state is. it is also useful to peek into the container syslog.
I also reported it here: https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1668049?comments=all
but unfortunately nothing happened yet.

@FransM what seems different here is that the reporter says that running "lxc info" unsticks the "lxc stop", which would be very inconsistent with systemd failing to stop the container.

Hm yes you are right.

Thank you.
Will test this soon.

driver: lxc
driver_version: 2.0.7
kernel: Linux
kernel_architecture: x86_64
kernel_version: 4.4.0-66-generic
server: lxd
server_pid: 4833
server_version: "2.11"
sometimes "lxc stop" freezes. but container is stopped.
cant' reproduce this by any things. tried most of what i did before it happens, but nothing repeats this.
when it happens i'm just pressing ctrl+c and continue normal work processes.

@Laguna-x this is unrelated to this issue and most likely just a problem with the init system in your container not setting up its shutdown handler properly.
This issue is special in that "lxc info" or similar LXD command will unstick it, hinting that it's an actual LXD problem.

i catched some one like this:
when container is running i did 'dd if=backeduped_image of=/dev/pool/container'. next lxc stop waits indefinitely. when i pressed ctrl-c - command terminates but container still running.
only 'service lxd stop' unstucked it (when runs lxc stop container) and container finaly stopped. next start|stop was fine.

@Laguna-x, is this a Debian Jessie container from issue ttps://github.com/lxc/lxd/issues/3178? If so this is completely unrelated and see my comment https://github.com/lxc/lxd/issues/3178#issuecomment-296163319.

@brauner yes debian, but it stucked only when i did dd with container. after lxd was restarted - container stops and starts well (with no stuck). may be something goes wrong inside container, but about lxd - stopping works fine now without waitings (checked most times).

Whether the systemd signal handler in a Debian Jessie container is correctly setup before systemd completely freezes is pure chance iirc. So you might get lucky, you might not.


Crash multiblock structure

Found the crash issue before that was squashed in 0.3.0
(https://github.com/erogenousbeef/BigReactors/issues/98)
Seems to have returned in 0.4.1A2
Sorry if this is already fixed.
Used in FTB Infinity 1.7x v1.2.0
https://gist.github.com/Magiks21/be8bb88aea0292bbb749

Those are different callstacks, so they're different crashes.
This looks like the sort of thing which would occur if, somehow, you created a reactor with no fuel rods. Can you supply any information as to how this occurred?

Interrogated users to get the info you needed.
Turned out someone used a hammer from TiC with a silk touch upgrade on it. harvested the area with the fuel rod. Maybe server timing sync fell out and tried to reassemble the multiblock without  the fuel rod?

Ah yes. Using a TIC hammer on a reactor is on the "don't do that" list. The TIC hammer's multi-block breaking seems to happen outside of the normal tick loop, so all sorts of stuff breaks, and there's pretty much nothing I can do to guard against it.

To be exact tic breaks the additional blocks during the blockbreak of the original block. It's behaving exactly like vanilla, except it all happens within 1 call.
Is a callback missing that big reactors relies on for its multiblock logic? All appropriate callbacks and events should get called/fired.

So, the call-chain works like this:

In BeefCore, I rely on TileEntity::Invalidate to know when a block has been broken, or otherwise removed by the user: https://github.com/erogenousbeef/BeefCore/blob/master/src/main/java/erogenousbeef/core/multiblock/MultiblockTileEntityBase.java#L123
That calls MultiblockTileEntityBase::detachSelf, which informs the multiblock's manager object that the block is detaching, via MultiblockControllerBase::detachBlock (https://github.com/erogenousbeef/BeefCore/blob/master/src/main/java/erogenousbeef/core/multiblock/MultiblockControllerBase.java#L215)
That hits the onDetachBlock method, which sets the multiblock as Paused which forwards the method to the abstract onBlockDetached method.
This is implemented in MultiblockReactor::onBlockDetached, which will remove the block from any internal tracking lists (such as the list of fuel rods). (https://github.com/erogenousbeef/BigReactors/blob/master/src/main/java/erogenousbeef/bigreactors/common/multiblock/MultiblockReactor.java#L214)

This will also mark the controller dirty, which will then (on the subsequent Server TickEnd call) revalidate the multiblock. Since the multiblock is inevitably now invalid, it will split apart and not run the MultiblockReactor::updateServer method, which is where the crash is emerging.
So what I'm wondering is:
(a) Is Invalidate getting called for all the blocks the TIC hammer is breaking?
(b) If so, then is the BlockBreak occurring after the server's TickEnd and before the server's next TickBegin calls? That would mean the controller is clean on TickEnd, has some blocks removed, and then is ticked in the subsequent TickBegin.
I thought all world modifications happened after TickBegin but before TickEnd, at least based on my observations when initially building BeefCore. (Maybe something moved around?)

I am, for the most part, following this. However, I have a large server full of players wondering why they cannot use hammers (And possibly other items that cause large scale block breaking?) to disassemble their reactors (and maybe other multiblocks).
Would it be selfish of me to ask for help explaining it to them? The explanation I have currently I'm finding shaky at best. And I know pointing the general pop from my server to this ticket will just confuse them more.

The easiest way to explain it is basically, "there's a bug in BR or a bug in TIC, not sure which at the moment, just don't do it."

The hammer calls the same vanilla functions that a regular block break would also call, during the blockbreaking of the original block:

https://github.com/SlimeKnights/TinkersConstruct/blob/master/src/main/java/tconstruct/library/tools/AOEHarvestTool.java#L28

https://github.com/SlimeKnights/TinkersConstruct/blob/master/src/main/java/tconstruct/library/tools/HarvestTool.java#L300

removedByPlayer in the vanilla Block class calls world.setBlockToAir, which calls setBlock

This calls 'func_150807_a' in the chunk

Which then calls world.removeTileEntity

Which calls TileEntity.invalidate

From that it should behave exactly as if the blocks were broken by a player one after another in the same tick.

hmm i think i should have done it earlier :D.

Yeah, I'll give it a shot. Is there a place to grab deobf/dev builds of TiCon?

Yes, we have a public jenkins. This is the release version for 1.8.3b: https://dvs1.progwml6.com/jenkins/job/TConstruct_1.7.x/919/

Any progress on this?

Working on it now.

Looks like this is my bug. The problem seems to be that the invalidate calls are evaluated on the server after tickEnd() but before tickBegin(). This leaves a one-tick race condition whereby a controller which shouldn't be ticked is ticked, which violates a bunch of runtime assumptions.
(a) You remove the entire top of the reactor, causing BR to look at the topmost block in the reactor's bounding box, grab a TE and try to cast it to a ControlRod.
(b) You break all the fuel rods.
It's going to take some digging to figure out how to solve this correctly. It might be as simple as doing all the recalculation logic in TickBegin instead of trying to be clever with TickBegin/TickEnd.


Edit install script to generate from unfilled desktop shortcut

coindicator. desktop is contained some absolute path
and python3-pygame is also not found
so I decided to remove 2 rows in the desktop shortcut (install.sh is filling it anyway)
and change apt-get pygame into pip3 install pygame

good point. I've clearly accidentally committed a locally generated file :)


Scala/Java Library for mxnet

Anyone interested? I'll jump in to help whenever I have time but still rusty on C side.

Hi @terrytangyuan
We don't have anyone working on that yet. You are well come to open a repo!

Could @tqchen or anyone else create a repo for mxnet.scala for me?  It says I have insufficient permission. We'll go from there.

They are probably off line at the moment. You can create your own repo and transfer it's ownership later.

Sure, it's created here: https://github.com/terrytangyuan/mxnet.scala
I haven't thought of any architectural plan yet so any help and direction is welcomed.

@yanqingmen seems has already have some progress on JNI, maybe you can sync up on this.
Let us consider directly put things in main repo when it is ready, as xgboost did. The reason for mxnet.js and mxnet.jl was mainly the for the convention of packaging and requirement on hosting additional big files that do not suitable for the main code repo.

Ok sounds good. Please share some updates on that.

@yanqingmen  if you have time maybe comment on this issue?

Hi all,
I've done some beginning work here https://github.com/javelinjs/mxnet-scala
Any suggestion or help is highly appreciated.

@javelinjs Cool. Could you grant me write access so I can jump in to help? Also, are we able to move your lib under the main mxnet repo as @tqchen mentioned? Are you and @yanqingmen working on different libraries and whice one should we stick with?

@terrytangyuan Thank you for your interest. Since it is still a fledging project and the code base may change rapidly, I suggest to follow the fork & pull-request process at this moment. I didn't know @yanqingmen was also working on the JNI package when I started. @yanqingmen Would you mind sync your progress here?

Added @terrytangyuan to collaborators :)

+1 for Java

hi, very glad to see this issue, I‘ve done some beginning work for jni package, and would be glad to help.since I don't have too much jni program experience, I've done it in a more naive way than @javelinjs. Maybe we could have a discuss group~

https://github.com/yanqingmen/mxnet/tree/java_wrapper  this is my fork:)

Hi @yanqingmen Great to see your work! I quickly browsed your code base and found you've already finished the NDArray and IO part, and you really did a nice work. From my side, I just finished the NDArray class (with a few test cases). And the automatic JNI compiling settings in maven seems to work well. Are you interested in Scala? It writes more naturally, (e.g. we can write (ndarray + 1.0) or (1.0 + ndarray) directly in scala code), and can also provide java-friendly interfaces. @terrytangyuan has created a gitter here https://gitter.im/javelinjs/mxnet-scala , would you like to join to have a discussion?

great, I'll join you

@yanqingmen @javelinjs The repo has been moved to https://github.com/terrytangyuan/mxnet
cc: @tqchen
We can discuss issues from the Gitter in mxnet-scala folder.

@tqchen As you mentioned here https://github.com/javelinjs/mxnet-scala/issues/2 , Did you mean to keep mxnet-scala as an independent project, or make it as a folder in mxnet as @terrytangyuan suggested?

both works for me, I think making it officially part as mxnet can make the integration more up to date easily

Yeah it would be easier to with with Travis for example. We have both just agreed to work on https://github.com/terrytangyuan/mxnet and later merge to dmlc/mxnet.

@tqchen Thank you, we moves to https://github.com/terrytangyuan/mxnet/scala-package
@yanqingmen I sent an email to you, please check your mail box, thank you :)

Correct url https://github.com/terrytangyuan/mxnet/tree/master/scala-package

Hi, just FYI, it shouldn't be too hard to create full bindings using JavaCPP. Check the ones for Caffe and TensorFlow, for example:
https://github.com/bytedeco/javacpp-presets/tree/master/caffe
https://github.com/bytedeco/javacpp-presets/tree/master/tensorflow
Let me know if interested!

Hi @saudet Your project is awesome. We'll check it later to see if we can learn something from javacpp-presets. I think it'll be a great tool if we need full bindings some day.

@tqchen I vote for independent repo for java binding. The integrated R package is already making travis test very slow. If we put more language binding and tests into the main repo integration tests is going to take forever.

@piiswrong I think what tianqi considered is to keep the contribution history. I wonder If we transfer it's ownership later to dmlc, will all these commit history also be transferred?

Maybe we should try to speed up Travis tests instead. For example:

only run Scala tests when there are files changed in Scala directory.
run non-vital tests only once a while on a regular basis, e.g. lint tests
for major developers, I recommend to activate their Travis for the forked repo.

Let us keep things in one repo, so contribution to the scala package also seen as major contribution to mxnet. We have done this for matlab, python and R and it works well so far.
@piiswrong The major problem on R tests is the cost to install R env, instead of running the test. For java and others, it is likely that we can do it in the docker images and things should be faster

@tqchen Just for my information, I can't seem to find where the the CI is done for Windows. Do you have another build server for that?

We don't yet have a CI for windows setup.

@tqchen I see, that's one of the major problems I'm having with JavaCPP. People who can't do builds by themselves are mostly the Windows users...

@piiswrong @tqchen There are only a few R tests currently so it shouldn't take long for the unit tests to run. It only took a couple of minutes to install those R dependencies and tools when I was setting it up long time ago but it looks like it's in a very different shape now. I will take a look to speed it up once we are done with the Scala package.

@saudet How are the javacpp-presets for mxnet going?  I have joined the sparknet project  github.com/amplab/SparkNet  and we want to add mxnet bindings . Presently they have only caffe.

Hi @javadba , the scala package for mxnet will soon be released. And we also have plan to integrate it with spark. If I didn't misunderstand, Caffe/Tensorflow in SparkNet follows the distributed weight calculation - average workflow, instead of a parameter server strategy, right?

I am new to the SparkNet project but believe what you were saying to be correct.

So what does that mean wrt javacpp-presets for mxnet?

You're free to use javacpp-presets in SparkNet if it contains mxnet bindings. But I doubt whether the synchronized training strategy is a right way for deep networks. We'll discuss it later.
And you are so welcomed to help us test the scala package https://github.com/javelinjs/mxnet/tree/scala-package-l, if you would like to :)

@javelinjs  My team is investigating approaches to distributed gpu computations especially for CNN. We will be using Spark for the resource scheduling. Beyond that we are open to considering different approaches .  The parameter server approach has been considered as well. Your input would be taken into account.

@javadba The C API is very simple, so I could provide presets for that right away if that's enough. The C++ API would take a bit more time, but not that much...

OK. Re: Spark with mxnet. My takeaway is your preferred approach is to use a Parameter Server vs the synchronized training (the SparkNet approach).
There might be two solutions here:
(a)  Write your own Spark interface
(b)   Collaborate with SparkNet to enhance their platform to support a  Parameter Server
Have you also considered the (b) approach?  If so why was it not chosen?
Thanks!

Re: the C API Presets: they  would be helpful yes! thanks.  I am new to this and would not be able to answer if C++ were required though I would venture a guess that no.

@javadba Since SparkNet, according to its published paper, is a synchronized approach, it seems that ps cannot take advantage of any exist interface in SparkNet. But I'm still open to any possible approach. Also correct me if I'm wrong.

Hi Yizhi,   thanks for the response. I am new to both projects and am
learning myself what are their characteristics. My team is looking for a
distributed gpu support for deep learning - and both mxnet and SparkNet
seem to have pieces of the answer that may be useful.  We will look more
into/understand better  the Parameter Server vs Synchronous approaches to
be more helpful in these disucssions.
Thanks.
2016-02-17 8:45 GMT-08:00 Yizhi Liu<EMAIL_ADDRESS>
@javadba https://github.com/javadba Since SparkNet, according to its
published paper, is a synchronized approach, it seems that ps cannot take
advantage of any exist interface in SparkNet. But I'm still open to any
possible approach. Also correct me if I'm wrong.
—
Reply to this email directly or view it on GitHub
https://github.com/dmlc/mxnet/issues/842#issuecomment-185292076.

I think we are open for the options in terms of integrations. MXNet already support YARN and I think spark integration is one the plan.
One key difference between the project you mentioned here is. While caffe style model follows a config and run strategy, which is fine for pre-defined CNN. MXNet focuses on maximum customization via hybrid declarative and imperative API.
Here are some examples I believe which is easier in mxnet:

Use scala to define customized optimization algorithm that runs on GPU
Fully take advantage of the scala NDArray API, so you can do other strange stuffs besides data parallel training of a model.

This being said, the goal of mxnet is being portable, this should include being able to easily ported to other projects, as well as being able to port to major platforms. We have done this for MPI, YARN and I suppose spark or even flink is another natural option

Thanks Tianqui for that insight.  MxNet sounds like a great project!   We
are  interested in the dynamic / runtime / flexible algorithmic declaration
approach that you mention.  So we will be interested in these developments
going forward.
2016-02-17 9:46 GMT-08:00 Tianqi Chen<EMAIL_ADDRESS>
I think we are open for the options in terms of integrations. MXNet
already support YARN and I think spark integration is one the plan.
One key difference between the project you mentioned here is. While caffe
style model follows a config and run strategy, which is fine for
pre-defined CNN. MXNet focuses on maximum customization via hybrid
declarative and imperative API.
Here are some examples I believe which is easier in mxnet:

Use scala to define customized optimization algorithm that runs on
GPU
Fully take advantage of the scala NDArray API, so you can do other
strange stuffs besides data parallel training of a model.

This being said, the goal of mxnet is being portable, this should include
being able to easily ported to other projects, as well as being able to
port to major platforms. We have done this for MPI, YARN and I suppose
spark or even flink is another natural option
—
Reply to this email directly or view it on GitHub
https://github.com/dmlc/mxnet/issues/842#issuecomment-185321990.

Totally agreed with @tqchen . I hope scala package can make MXNet more portable to other JVM platforms.

Is there any plan to integrate scale-package to mxnet project? Can I ask when will it happen?

@Yunrui Yes, I will make a PR within two weeks. We are doing more tests for models on multiple devices. Thank you for paying close attention to this project.

@javelinjs thanks, looking forward to integrating this feature to my pipeline

@javadba I've finally been able to take a few hours to work on a wrapper for the C API along with some sample code: https://github.com/bytedeco/javacpp-presets/tree/master/mxnet

Thanks!  We will be looking at it probably in mid March- had a bit of
rearrangement of tasks.
2016-02-28 7:28 GMT-08:00 Samuel Audet<EMAIL_ADDRESS>
@javadba https://github.com/javadba I've finally been able to take a
few hours to work on a wrapper for the C API along with some sample code:
https://github.com/bytedeco/javacpp-presets/tree/master/mxnet
—
Reply to this email directly or view it on GitHub
https://github.com/dmlc/mxnet/issues/842#issuecomment-189891997.

Hi, due to sync difference bewteen parameter server and Spark, how to integrate scala package with Spark? Thanks!

Hi, due to sync difference bewteen parameter server and Spark, how to integrate scala package with Spark? Thanks!

@kelly-lxg Good question. It needs some hack efforts to make mxnet run in one spark stage. If you have any idea, feel free to let us know. @CodingCat and @tqchen are doing similar things with xgboost4j, they have experiences on this.

We may don't agree the spark interface plan which sparknet take, because it may allocate memory twice both in c++ and jvm.  Do you have some feasible way? thanks!

@javelinjs @kelly-lxg ,
for making mxnet run in one stage, you have to call mxnet within a spark task and block the thread until the training done....e.g. trainingData.mapPartition( partition => mxnet.train ...).foreachPartition(() => _) (each partition maps to a task )
for memory cost, I think we have to accept the overhead in off-heap memory part, unless you rely on 3rd-party solutions to share the memory space between JVM and c++ process (e.g. Apache Arrow

I've got your idea and  I will try,Thanks.


Package request: GoatCounter

Project description
GoatCounter is an open source web analytics platform available as a (free) hosted service or self-hosted app. It aims to offer easy to use and meaningful privacy-friendly web analytics as an alternative to Google Analytics or Matomo.
There are two ways to run this: as hosted service on goatcounter.com, or run it on your own server. The source code is completely Open Source/Free Software, and it can be self-hosted without restrictions.
go, golang, analytics

homepage URL: https://www.goatcounter.com/

source URL: https://github.com/arp242/goatcounter

license: a slightly modified version of European Union
Public License (EUPL) 1.2; the only difference is that the “Compatible Licenses”
Appendix removes some licenses, but is otherwise identical.

platforms: any platform supported by Go

Hi, I have tried to create an overlay for it using buildGoModule:
self: super:

{
  goatcounter = super.callPackage (
    { pkgs, lib, buildGoModule, fetchFromGitHub }:

    buildGoModule rec {
      pname = "goatcounter";
      version = "2.4.1";

      src = fetchFromGitHub {
        owner = "arp242";
        repo = pname;
        rev = "v${version}";
        sha256 = "sha256-L4310L+L2Qn8NkRMqze7KNwZ18LXz8PAoXCCpYa5J4I=";
      };

      vendorSha256 = "sha256-nKfqZ5hGGVLBY/hnJJPCrS/9MlGoR2MWFUWDnpwWgyM=";
    }
  ) {};
}

Unfortunately the build fails with the following log:
@nix { "action": "setPhase", "phase": "unpackPhase" }
unpacking sources
unpacking source archive /nix/store/g4yx979f6wqnnnyx7k0qm329m6lq9am8-source
source root is source
@nix { "action": "setPhase", "phase": "patchPhase" }
patching sources
@nix { "action": "setPhase", "phase": "updateAutotoolsGnuConfigScriptsPhase" }
updateAutotoolsGnuConfigScriptsPhase
@nix { "action": "setPhase", "phase": "configurePhase" }
configuring
@nix { "action": "setPhase", "phase": "buildPhase" }
building
Building subPackage .
Building subPackage ./acme
Building subPackage ./bgrun
main module (zgo.at/goatcounter/v2) does not contain package zgo.at/goatcounter/v2/bgrun

I do not have a lot of insights into buildGoModule or go builds in general, but I'd guess it has something to do with these lines. Maybe someone with more experience around go packaging can help?

Nevermind, I found this flake with working buildGoModule code.


Automatically call randomize() in Random singletons

Global instances (Random, Random2D) will automatically call randomize(), unlike GDScript in Godot 3.2. Local instances must still call randomize() manually.
The only issue is that the --doctool produces random values, so this creates annoying problem of diffs in VCS, and I'm not sure whether it's possible to fix this in a module, so postponing merging for now.
See also godotengine/godot-proposals#1774.

The random defaults issue is worked-around both in Godot (godotengine/godot#43318) and Goost now.
The seed property and any other random properties have to be "re-defaulted" each time in derived classes, wrote a proposal about this in godotengine/godot-proposals#1777.


Can't set rootViewController with XIB

Hey, I import ReactorKit in my project.  when i set rootViewController it can't load xib File.Sorry about my english。

@Sky-star How can I reproduce the bug?

I just create a test project, here .
I set the view color with pink, but when i run the project i got white.

You set background color in a storyboard, but you are not using Storyboard.

this is empty application, no Main.stroyboard in here. so I set rootViewController in AppDelegate.
i set color in RootViewController.xib.

Oh, my bad. You have to initialize the view controller using init(nibName:bundle:) if you're using a single xib file.
- RootViewController()
+ RootViewController(nibName: "RootViewController", bundle: Bundle.main)

Thanks for your help~ it seems like can't support default initialization method. So Sad.
Do you know where the problem is?  Because when i remove ReactorKit in Project, it Can operate normally.

Hmm yeah, it seems a ReactorKit bug. I'll check this soon. Thanks for reporting.

Thank you very much. it's nice kit.

@Sky-star, #38 could fix this bug.


TCServerMain process is not visible on some platforms

Current Galvan implementation uses "ps" command to find the target server process on *nix platforms.  It turns out that certain Linux platforms limit ps line output to 4k characters which is not enough to find the right process using this method.

In order to grab the PID is a more platform agnostic fashion, scrape it from the stdout.


Convert expressions to array in CrateDocCollector

In order to avoid iterator allocations due to the for-each loop in the
collect method.

ack


Remove existing properties inside Module class and unused properties

Questions
Answers

Description?
Clean a little bit the code in order to facilitate the read of it.

Type?
refacto

BC breaks?
no

Deprecations?
no

How to test?
Check that property exists inside Module class (on <IP_ADDRESS> or <IP_ADDRESS>) and/or that property it's just init but never used.

@PrestaEdit Can you rebase your PR please? :)

I've surely do something bad here.
Could you indicate us, inside the contributing docs, the good way for a rebase, please ?

I've surely do something bad here.
Could you indicate us, inside the contributing docs, the good way for a rebase, please ?

Not sure it's a good idea to document how git itself document the rebasing: https://git-scm.com/book/en/v2/Git-Branching-Rebasing.

Seeing the state of this Pull Request and as I've no time to handle more and more GIT commands, what it's the best to do ? Remake it ?

Seeing the state of this Pull Request and as I've no time to handle more and more GIT commands, what it's the best to do ? Remake it ?

imho, rebasing a pull request is quite easy and should be done in few minutes. It depends if you want to learn something that can help you in the future, or wanna redo the job of creating a pull request.

If you check the commits states, you will see that I've try to do it, but it's seems not as wanted/working. It's why I ask.
I'd like to know, as I need to made a rebase like every five Pull Requests, of course.

Seeing the state of this Pull Request and as I've no time to handle more and more GIT commands, what it's the best to do ? Remake it ?

imho, rebasing a pull request is quite easy and should be done in few minutes. It depends if you want to learn something that can help you in the future, or wanna redo the job of creating a pull request.

Some help 😄

https://dev.to/matks/what-it-means-to-rebase-a-pull-request-submitted-on-github-5717
https://github.com/openedx/edx-platform/wiki/How-to-Rebase-a-Pull-Request
https://www.digitalocean.com/community/tutorials/how-to-rebase-and-update-a-pull-request

@PrestaEdit unless you grant us the rights to modify your branch we cannot do the rebase for you.
I can however tell you what I would you in your situation:
// 1. start again from dev branch
$ git checkout develop
// 2. create a new branch
$ git checkout -b clean-2
// 3. cherry-pick my changes into the new branch
git cherry-pick f0e86b65770dad6247592fb201477d19fbffb592
git cherry-pick f96ca1470398f31e22697bd9fecdccc6d87211ab
// 4. push this branch
git push

Then I would close this PR and open another PR

Hello,
It looks like this PR is now stale. I close it as our rules state it "Pull Requests may be closed after 30 days of inactivity following a request for modifications." (https://www.prestashop-project.org/maintainers-guide/reviewing-pull-requests/)
But if you're motivated, we can reopen 😉 just ping me.
Thank you


humidity is real value in some device

humidity is real value in some device, need not divider.

Thanks, make sense!!


How to install a new language for CMUSphinx?

I'm trying to install italian support for CMUSphinx with no luck.
I've found models here:
https://sourceforge.net/projects/cmusphinx/files/Acoustic and Language Models/Italian/
And I think they must be placed here:
/usr/local/lib/python2.7/dist-packages/speech_recognition/pocketsphinx-data/it-IT
But actual en-US folder content is different from archives content linked above.
Can you help me?
Thank you in advance.
Yuri
System information
My system is Lubuntu 15.04 "Vivid"
My Python version is 2.7.9
My Pip version is pip 9.0.1
My SpeechRecognition library version is 3.3.1
My PyAudio library version is 0.2.9
I installed PocketSphinx from (cannot remember, done it a long time ago, probably repos)

Hi,
you have to rename and restructure the files in the italian zip folder:
etc/voxforge_it_sphinx.lm > speech_recognition/pocketsphinx-data/it-IT/language-model.lm.bin
etc/voxforge_it_sphinx.dic > speech_recognition/pocketsphinx-data/it-IT/pronounciation-dictionary.dict
model_parameters/voxforge_it_sphinx.cd_cont_2000/ > speech_recognition/pocketsphinx-data/it-IT/acoustic-model/

To add on to what @jhoelzl said, you might want to check out the language data documentation!
Also, here are exact instructions for building the Italian model:

Italian: /speech_recognition/pocketsphinx-data/it-IT/:

/speech_recognition/pocketsphinx-data/it-IT/language-model.lm.bin is generated as follows:

Download cmusphinx-it-5.2.tar.gz from the Sphinx Italian language model <https://sourceforge.net/projects/cmusphinx/files/Acoustic%20and%20Language%20Models/Italian/>__.
Extract /etc/voxforge_it_sphinx.lm from cmusphinx-it-5.2.tar.gz as italian.lm.
Convert from ARPA format to Sphinx binary format: sphinx_lm_convert -i italian.lm -o italian.lm.bin.
Replace /speech_recognition/pocketsphinx-data/it-IT/language-model.lm.bin with italian.lm.bin created in the previous step.

/speech_recognition/pocketsphinx-data/it-IT/pronounciation-dictionary.dict is /etc/voxforge_it_sphinx.dic from cmusphinx-it-5.2.tar.gz (from the Sphinx Italian language model <https://sourceforge.net/projects/cmusphinx/files/Acoustic%20and%20Language%20Models/Italian/>__).
/speech_recognition/pocketsphinx-data/it-IT/acoustic-model/ contains all of the files in /model_parameters extracted from cmusphinx-it-5.2.tar.gz (from the Sphinx Italian language model <https://sourceforge.net/projects/cmusphinx/files/Acoustic%20and%20Language%20Models/Italian/>__).

I have attached the result of following those instructions here:

it-IT.zip

You guys are great. Thank you so much. I'll try and test your hints.

Sadly I have a problem:
ERROR: "ngram_model_arpa.c", line 351: Trigrams not in bigram order
ERROR: "ngram_model_dmp.c", line 121: Wrong magic header size number a5c6461: italian.lm is not a dump file
FATAL_ERROR: "sphinx_lm_convert.c", line 170: Failed to read the model from the file 'italian.lm
Here's the complete log:
$ sphinx_lm_convert -i italian.lm -o italian.lm.bin
INFO: cmd_ln.c(691): Parsing command line:
sphinx_lm_convert
-i italian.lm
-o italian.lm.bin
Current configuration:
[NAME]		[DEFLT]	[VALUE]
-case
-debug			0
-help		no	no
-i			italian.lm
-ienc
-ifmt
-logbase	1.0001	1.000100e+00
-mmap		no	no
-o			italian.lm.bin
-oenc		utf8	utf8
-ofmt
INFO: ngram_model_arpa.c(477): ngrams 1=3741, 2=11194, 3=13364
INFO: ngram_model_arpa.c(135): Reading unigrams
INFO: ngram_model_arpa.c(516):     3741 = #unigrams created
INFO: ngram_model_arpa.c(195): Reading bigrams
INFO: ngram_model_arpa.c(533):    11194 = #bigrams created
INFO: ngram_model_arpa.c(534):      429 = #prob2 entries
INFO: ngram_model_arpa.c(542):     2362 = #bo_wt2 entries
INFO: ngram_model_arpa.c(292): Reading trigrams
ERROR: "ngram_model_arpa.c", line 351: Trigrams not in bigram order
ERROR: "ngram_model_dmp.c", line 121: Wrong magic header size number a5c6461: italian.lm is not a dump file
FATAL_ERROR: "sphinx_lm_convert.c", line 170: Failed to read the model from the file 'italian.lm

Oh, I just realized you mentioned installing Pocketsphinx from the repos - that won't work, you need a more recent version of Pocketsphinx, preferably 0.0.9, which is what I have installed.
I recommend using one of the Python wheels I bundle with the project - all of these are properly tested.


updated eaglefiler (1.7)

Changes to a cask
Editing an existing cask

[x] Commit message includes cask’s name (and new version, if applicable).
[x] brew cask audit --download {{cask_file}} is error-free.
[x] brew cask style --fix {{cask_file}} left no offenses.

Merged as 54fdb23ebdc49a58e62d8f4bb9bab2039727aa2c.


Quieter debug logging for clean exec commands

Signed-off-by: John Howard<EMAIL_ADDRESS>@crosbymichael. This makes an idle daemon running in debug mode a little quieter - no outputting if there are no unused exec commands cleaned.

LGTM

LGTM


Spacing errors in cached files

If there is a link in the text or formatting like italics spaces are omitted between the linked text and adjacent words.
In the example below, popularCookie Clicker, "Cookie Clicker" is a link, but cached there is no space between it and the preceding word "popular".
In apaperclip maximizer, "paperclip maximizer" is italicized and cached there is no space between it and the preceding word "a".
In Thissoundslike the italicized "sounds" is run together with the words before and after it.
Also, the paragraphs are run together instead of having a newline between them.
The example URL is active so you can see the original document.
$ bogrep paperclips
Match in bookmark: https://www.vice.com/en/article/xwgnxq/this-game-about-paperclips-will-make-you-ponder-the-apocalypse Ever since the wildly popularCookie Clicker,idle clicker games have been about hockey stick curves, about exponential growth unleashed by multiplicative advances in productivity. InCookie Clicker,that was employed in service of an absurdist joke about cookies.Universal Paperclips,a new free game from designer Frank Lantz, instead takes this to its darkly literalistic conclusion.It's a clicker game where you play as apaperclip maximizer,an AI that, once tasked with making paperclips, proceeds to turn the entire universe into paperclips.Thissoundslike a premise arrived at specifically to spoof clicker games, but it harkens back to a thought experiment proposed by Nick Bostrom, an Oxford philosophy professor, in a2003 paper:The risks in developing superintelligence include the risk of failure to give it the supergoal of philanthropy. […] Another way for it to happen is that a well-meaning team of programmers make a big mistake in designing its goal system. This could resul

Partly related: https://github.com/quambene/bogrep/issues/16. But the present issue is much more complete.

Trimmed HTML content was fixed in v0.9.0


gftools check-vtt-compile added

Allow users to check whether vttLib will compile a font's VTT hinting. Output is a list of GIDs, glyph names. Perfect format for a hinter to work with.
Following glyphs cannot compile using vttLib:
GlyphID GlyphName
231 U.i
260 uni0298
298 uni0259
544 exclamdown
546 questiondown
557 parenright
559 braceright
561 bracketright
573 quotedblright
577 guillemotright
617 uni2219
629 greaterequal
654 uni2198
655 arrowdown
656 uni2199
657 arrowleft
658 uni2196
663 uni21E9
664 uni21E6
666 uni2B95
667 uni2B07
869 uni2326
877 less_hyphen.dlig
878 less_equal.dlig
881 uni02BB
887 uni02BE
905 uni0311
906 uni0312
910 uni0326
946 caron.case

The try and accept block in this script may be too greedy. I'm going to leave this open while and test teh script on some families we're planning to release soon.


Repeated request vips-es6.js

When I use import Vips from "wasm-vips" to import, many vips-es6.js requests are generated during runtime. When I check the source code, I find the following code function Pe() { var a = new URL("vips-es6.js", import.meta.url); a = new Worker(a, { type: "module", name: "em-pthread" }); Le.push(a) }.
vips-es6.js is also imported into the worker, which seems to lead to repeated import of vips-es6.js. Is there any way to optimize this problem?

This behavior is intentional. Emscripten's pthread integration uses self-referencing web workers, meaning the main document and all workers share the same script. As a result, fewer network requests are made since the main script is cached before any web worker is created.
See commit d6cdcbbb3104b3a3688c3fd71320e88945ab30b1 for more details.

thanks a lot.


Fake Hacks

Can I add this project which removes all the images and replace it with hacked images like it can be used for fake hacking.It is simply
built using javascript Can I add this?

@SamarthKadam  What will be the utility of this? Can you explain in detail?

It is basically pranking the person using this extension. It replaces all the images where user visits with the provided link of image.
It doesn't have any utility but can be used for fun.

Sure go-ahead
All the best


Add external authorization via http request

This is similar to Envoys external authorization, and can be used for example in combination with Ory Oathkeeper.

👍 for this PR!


Add RUN --mount=type=cache support

This PR adds support for buildkit's RUN --mount=type=cache.
The updated example illustrates the new feature.
Closes #19.
Updated example image

Codecov Report

Merging #23 (2907692) into main (09c670b) will increase coverage by 6.09%.
The diff coverage is 84.61%.

@@            Coverage Diff             @@
##             main      #23      +/-   ##
==========================================
+ Coverage   41.86%   47.95%   +6.09%
==========================================
  Files           3        3
  Lines          86       98      +12
==========================================
+ Hits           36       47      +11
- Misses         49       50       +1
  Partials        1        1

Impacted Files
Coverage Δ

internal/dockerfile2dot/build.go
0.00% <0.00%> (ø)

internal/dockerfile2dot/convert.go
95.91% <100.00%> (+1.18%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 09c670b...2907692. Read the comment docs.


chore: make tsc happy :^)

This will be a draft until I can further review my own code.
This was a rushed PR written at 03:00 in the morning :p

This is now ready for review :^)

Closing as with the merge of #315 this has been fixed. Thanks anyway!


Adding info how to search for feedback submitted by user

:x: Validation status: errors

File
Status
Preview URL
Details

:x:Error

Details

Line 16: [Error] Restore nuget package W:\a43b-s.optemp\packages\opbuild.scripts.1.47.2\tools\packages.config in folder:W:\a43b-s.optemp\packages failed, possibly due to transient errors from nuget servers. Please retry building your content. If the issue still happens, open a ticket in http://SiteHelp. Detailed error:  Errors in packages.config projects     Unable to find version '1.47.2' of package 'opbuild.initializecrrtool'.       D:\Windows\system32\config\systemprofile.nuget\packages: Package 'opbuild.initializecrrtool.1.47.2' is not found on source 'D:\Windows\system32\config\systemprofile.nuget\packages'.       https://www.myget.org/F/op/api/v2/: Package 'opbuild.initializecrrtool.1.47.2' is not found on source 'https://www.myget.org/F/op/api/v2/'.       https://www.myget.org/F/op-dev/api/v2/: Package 'opbuild.initializecrrtool.1.47.2' is not found on source 'https://www.myget.org/F/op-dev/api/v2/'.       https://www.myget.org/F/docfx/api/v2/: Package 'opbuild.initializecrrtool.1.47.2' is not found on source 'https://www.myget.org/F/docfx/api/v2/'.       https://www.myget.org/F/docfx-dev/api/v2/: Package 'opbuild.initializecrrtool.1.47.2' is not found on source 'https://www.myget.org/F/docfx-dev/api/v2/'.       https://nuget.org/api/v2/: Package 'opbuild.initializecrrtool.1.47.2' is not found on source 'https://nuget.org/api/v2/'.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Error when running the mup setup

When I run the mup setup commend.
There's an error when the commend tries to start the mongodb.

+1

looks like you already have mongodb running in your VM.

Yeah. I find the process which binds the port and kill the process. The error is fixed.
Thanks for help!


Columns in ACE output file renamed leading to error in processing

Problem: Column N and P of the ACE demographics file were renamed, which seems to be causing an error in processing
Error provided in the R script: Error in if (mask$get_size() > 0) { : argument is of length zero
Potential solution: Update aceR script to handle "Participant ID" for column N and "PID" for column Y of the demographics file. In previous versions they were set as "Nexus.Id" and "Participant.Id" respectively

Hi! Clarifying questions:

Is the R script that is erroring erroring directly out of an aceR function, or is the aceR function returning something but a downstream line of the user's script is then erroring because the aceR output was unexpected?
The development branch of this repo is implementing changes related to the ACE Nexus big version update. There are a couple sticky cases I haven't been able to finish yet, but it mostly works. Are these ACE demo file column renames coming straight out of Nexus? If so, I would recommend having the user install the development branch. (Bonus that if they catch bugs there, they're helping get Nexus development closer to completion!)

Confirming that whatever change closes #51 will also close this. aceR on the development branch for Nexus should already coerce "Participant ID" and "participant.Id" or "participantID" etc. all to "participant_id" under the hood. However, "PID" will not get caught unless this is a newly expected column. that we should keep, separately from the participant ID column. I will keep discussion of the new participant ID column name handling over on #51 and we'll close both at the same time when I get enough info to update the code.


CUDA host/gpu memory disparity

It looks like in certain circumstances, there's possible race condition for HOST/GPU memory, when memory gets copied out of execution order.
Supposed issue: https://github.com/deeplearning4j/deeplearning4j/issues/1907

Fixed here: https://github.com/deeplearning4j/nd4j/pull/1167
However, fix will be improved during next iteration of changes, as part of allocator/executor refactoring.


Add an optional debug mode to get verbose logging

This is just an idea I've had that might help us resolve issues quicker. I'm thinking something along the lines of debug, though we can roll our own pretty easily I think if we want to.
Essentially I think it would be great if we could inject a few console.log calls in key parts of the code path, so when we (or anyone else) are trying to isolate an issue it's easy to see what might be going on. This would be good for checking state in internal code paths when reproducing an issue, and would let us ask users to share the output for hard-to-reproduce issues.
I'm just opening this issue for a discussion on the idea, I'm not entirely sure it's either practical or useful just yet, but I'm inclined to think it's both.
A few ways we can possibly do it (edit: these ideas aren't necessarily good at all, just examples in the same ballpark):

If possible, parse any CLI flags (though I don't think we can do that since we're not a CLI app)
Expose an option to enable debug logging (enzyme.enableDebugging() or something)
Export a wrapper function that does it:

import enzyme, {mount, debug} from 'enzyme'
debug(enzyme)

Use a special environmental variable (process.env.ENZYME_DEBUG or something)

I like the idea of easier debugging. I don't think I'm a fan of adding more exports if we could avoid it.
I think an env var might not make sense for this use case, since you may want to debug just one test, while running with the whole suite, etc.
What if we had shallow.debug() and mount.debug() (and render.debug()), for the top-level only, that enabled debug mode for that wrapper?

@ljharb Yeah I was just spitballing, none of my suggestions seemed ideal, just a ballpark of what I'm envisioning. I think top-level methods like shallow.debug() would be cool. Would the debug call toggle the debugging on and off? So you'd just do something like
shallow.debug(); // turns it on
const wrapper = shallow(<App />)
// do wrapper stuff here
shallow.debug() // turns it off

no - i'd think debugging would be permanently on for that wrapper.

Oh I see what you mean now, so shallow.debug() would basically wrap shallow() and enable debugging for the returned wrapper?

shallow.debug() might be confused with wrapper = shallow(...); wrapper.debug()

@Aweary yes.
@nfcampos naming obv subject to debate, if the approach (a different wrapper method that's attached to the exported wrapper method) seems sound.

I could definitely see how it might be confused, but I'm not sure it's entirely a big deal. It seems like a mistake you'd only make once that would be pretty obvious, but maybe I'm biased and assuming too much.
So far I like the idea of having a top-level method that returns a wrapped instance with debugging enabled most. Since most traversal methods have access to the this.node we could tag an internal debug flag onto that?

At this point, I think this would be best as an adapter option.


Pass dashArray property to leaflet

dashArray property was left out, adding it to options handler passing dashArray property to leaflet.

Thanks


Should we disable ID flushing

Currently, GraphDatabaseConfiguration.IDS_FLUSH default to true, meaning that ids are assigned to elements upon creation. This has the advantage that ids are directly available to the user (and not just after commit) but has the distinct disadvantage that graph partitioning doesn't work well since we cannot reason about optimal placement on a just-created element.
Hence, it should be considered to default this option to FALSE and rewrite those test cases where we make the assumption that ids are immediately available (this shouldn't be the case, but I am pretty sure we have done that). This would educate users to only access ids after commit which is needed when enabling graph partitioning (and expecting results).

Just wanted to point out that this is a headache for non-java languages. It implies keeping track of every object generated from a gremlin-server write and then refreshing their IDs on a transaction commit event (creating a whole other set of database read queries). It's a bit of a nightmare when you're trying to cut down you query time and serve information quickly to you end users.
I totally understand the necessity behind it but maybe considering a cache that could link temp IDs to real IDs would be a good idea (if at all possible).
It wouldn't have to last long as most of the time threads on our end last only a few seconds and then elements (and IDs) are refetched in subsequent threads.
Food for thought.

Yeah, I can see how that is a pain. Also, graph partitioning is an advanced enough use case that we can expect those users needing it to disable this configuration option.


1449 Integration test for triggering build in multiple authorized nodes environment

Part of: #1449
Test is provided as bash script and consists of following steps:

Starts build pipeline, 2 authorized node and 2 regular nodes. All are started in separate processes.
The logs and pids of started nodes are present inside directory: /tmp/pyrsia-manual-tests/.log and /tmp/pyrsia-manual-tests/.pid
Triggers first build docker artifact from first authorized node
Checks logs on all 4 nodes contain information about buit docker artifact
Triggers second build docker artifact from second authorized node
Checks logs on all 4 nodes contain information about buit docker artifact
Stops all nodes

Test is located in pyrsia repository' by path: tests/test_multiple_authorized_nodes.sh
It requires to specify following paramters:

pyrsia home path
pyrsia build pipeline home path
Example:
test_multiple_authorized_nodes.sh $PYRSIA_HOME $PYRSIA_BUILD_PIPELINE_HOME

Is it intentionally separated from the integration tests repo
https://github.com/pyrsia/pyrsia-integration-tests? Did we already decide move them to this repo?
Sorry if I missed something


TreeView loses focus under some conditions

Description
The following is when operating with Keyboard only.
If you open a parent node, select a child node, and then close the parent node and then focus on a non-TreeView, you will not be able to focus on the TreeView.
Link to Reproduction (or Detailed Explanation)
https://ark-ui.com/react/docs/components/tree-view
Steps to Reproduce

Go to https://ark-ui.com/react/docs/components/tree-view
Press the Tab key to focus on item 1
Press the Right Arrow key to open item 1
Press the Right Arrow key to focus on item 1.1
Press the Enter key to select item 1.1
Press the Left Arrow key to focus on item 1
Press the Left Arrow key to close item 1
Press the Tab key to focus on next element(Not treeview)
Press the Shift + Tab key to focus on TreeView

TreeView does not get focus after 9 operations.
https://github.com/user-attachments/assets/96fb4dc4-d5a4-46cd-9cf7-4ee584138337
Ark UI Version
3.12.0
Framework

[X] React
[ ] Solid
[ ] Vue

Browser
No response
Additional Information
No response

Duplicate of #1751. Will work on a fix for this shortly


Arrow function support

Are arrow functions supported and which version of Esprima is used in the online demo?
The online demo states that the following code is invalid:
let multiply = (number) => { return number * 2 };

Is there any update on this?

Is there any update on this?

We're currently rewriting some modules to use Babel instead of escodegen in our project to work around this

@simondel as far as i can see, Babel branch is merged, so would it resolve this issue?

We have decided to deprecate the code that was using escodegen and have written a new implementation that uses babylon and babel-generate


update Installation.md

Signed-off-by: sugary199<EMAIL_ADDRESS>

1、change the command of cloning branch code
2、The copy operation usually reports an error because the previous absolute path is different
3、There is also a scripts folder below the agent-lib directory，we need go back to probe directory

Anyway, I think this PR could be merged except for the comment I left above, as it will spend some time to finish the new documentation.

Close #96


[WIP] Add prop to have different featureClass for MVT

Needed for SDK-874
by having a real Feature as the MVT feature class, we can get to the geometry which we need for highlighting

Closing this one, since in hindsight this will not be the solution, due to geometries being clipped at the tile boundaries


Microsoft.AspNetCore.Authentication is deprecated

The package Microsoft.AspNetCore.Authentication version 2.2.0 has been released in 2018 and has deprecated for a long time. Referencing this nuget package results in multiple vulnerabilities being included through its dependencies such as https://github.com/advisories/GHSA-ghhp-997w-qr28.
In the Microsoft docs #1 and #2 , it is explained that AspNetCore packages are no longer published on nuget since dotnet 2.2 and should be replaced with a FrameworkReference when used in class libraries. However, in my own testing locally it seems like removing the nuget reference altogether does not break the build or the tests.
Please consider either removing the reference or changing the current reference from a PackageReference to a FrameworkReference.
Thanks!

Thank you for the new issue!
I would much appreciate a PR/MR for this!
Currently, I'm on a very tight schedule and do not have a lot of time left to work on such projects.

No problem! I have created the PR, just let me know if there is anything else I can do.


Universal Binaries for MacOS Builds

References:

https://stackoverflow.com/a/66875783
https://developer.apple.com/documentation/apple-silicon/building-a-universal-macos-binary

To test the MacOS build, check out this release from my fork.

Nice, thank you!
I don't have access to a Mac at the moment. Have you tested the produced binary on both systems?

 I can only vouch that this binary runs fine on my M1 Mac Mini. I do not have an x86-based Mac.

This works on my 2015 MacBook Pro (macOS 12.4)


Changed windows macro checks from _WINDOWS to _WIN32

This is the pull request mentioned by my issue #86. Replaces all macro checks from _WINDOWS to _WIN32.

Good catch. I'd like to add a Windows build checker in the TravisCI pipeline soon so that it catches things like this.


DUPLO-21144 TF: duplocloud_azure_k8_node_pool: Updating availability zone should show force replacement of resource in Plan

Overview
Added force replacement for availability_zones
Summary of changes
Added force replacement for availability_zones in duplocloud_azure_k8_node_pool resource schema
This PR does the following:

Added forcenew property for availability_zones attribute
...

Testing performed

[ ] Using unit tests
[ ] Manually, on my local system
[ ✓] Manually, on a remote test system

Describe any breaking changes

...

Task linked: DUPLO-21144 TF: duplocloud_azure_k8_node_pool: Updating availability zone should show force replacement of resource in Plan


Feature/issue 2444 nested paralellism

Summary
Stan math programs may run potentially within a nested parallel environment. In that case we need to use task isolation to avoid that the calling thread gets to do work from other contexts not related to the AD task being processed in the current thread.
Tests
NA
Side Effects
NA
Release notes
Make stan math safe for nested paralellism.
Checklist

[X] Math issue #2444

[X] Copyright holder: Sebastian Weber
The copyright holder is typically you or your assignee, such as a university or company. By submitting this pull request, the copyright holder is agreeing to the license the submitted work under the following licenses:
- Code: BSD 3-clause (https://opensource.org/licenses/BSD-3-Clause)
- Documentation: CC-BY 4.0 (https://creativecommons.org/licenses/by/4.0/)

[X] the basic tests are passing

unit tests pass (to run, use: ./runTests.py test/unit)
header checks pass, (make test-headers)
dependencies checks pass, (make test-math-dependencies)
docs build, (make doxygen)
code passes the built in C++ standards checks (make cpplint)

[X] the code is written in idiomatic C++ and changes are documented in the doxygen

[X] the new changes are tested

Ah sorry, was to quick to merge, just saw green.


Performance completely killed with update

Issue Type: Performance Issue
Updating Code from ~1.29 to 1.3* has completely killed it's performance. It never becomes unresponsive, but is completely unresponsive, scrolling the slightest bit in a file takes seconds to register.
If I downgrade back to ~1.29, it works completely fine.
I have managed to get it working just about fine by running code using the following flags code --use-gl=osmesa --disable-gl-drawing-for-tests
I notice when running code --status I get the following error:
[7102:0322/114433.979383:ERROR:sandbox_linux.cc(379)] InitializeSandbox() called with multiple threads in process gpu-process.

Possibly something GPU related?
(I have had to redact some project names for security purposes)
VS Code version: Code 1.32.3 (a3db5be9b5c6ba46bb7555ec5d60178ecc2eaae4, 2019-03-14T23:38:49.842Z)
OS version: Linux x64 4.15.0-46-generic

System Info

Item
Value

CPUs
Intel(R) Core(TM) i3-7100 CPU @ 3.90GHz (4 x 3900)

GPU Status
2d_canvas: enabledchecker_imaging: disabled_offflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onnative_gpu_memory_buffers: disabled_softwarerasterization: disabled_softwaresurface_synchronization: enabled_onvideo_decode: unavailable_offwebgl: enabledwebgl2: enabled

Load (avg)
3, 3, 2

Memory (System)
11.69GB (1.11GB free)

Process Argv

Screen Reader
no

VM
0%

Process Info
CPU %	Mem MB	   PID	Process
    1	   120	  6032	code main
    0	    36	  6035	   zygote
    0	   263	  6114	     window (Payruns.js - *removed* (Workspace) - Visual Studio Code)
    0	   132	  6139	       extensionHost
    0	   347	  6188	         electron_node tsserver.js
    0	   108	  6331	           electron_node typingsInstaller.js typesMap.js
    0	   108	  6202	         electron_node eslintServer.js
    0	   263	  6279	         /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -jar /home/johnminns/.vscode/extensions/sonarsource.sonarlint-vscode-1.6.0/server/sonarlint-ls.jar 45501 file:///home/johnminns/.vscode/extensions/sonarsource.sonarlint-vscode-1.6.0/analyzers/sonarjs.jar file:///home/johnminns/.vscode/extensions/sonarsource.sonarlint-vscode-1.6.0/analyzers/sonarphp.jar file:///home/johnminns/.vscode/extensions/sonarsource.sonarlint-vscode-1.6.0/analyzers/sonarpython.jar file:///home/johnminns/.vscode/extensions/sonarsource.sonarlint-vscode-1.6.0/analyzers/sonarts.jar file:///home/johnminns/.vscode/extensions/sonarsource.sonarlint-vscode-1.6.0/analyzers/sonarhtml.jar
    0	    84	  6460	           node --max-old-space-size=2048 /home/johnminns/.sonarlint/work/.sonartmp_3804671756200196163/1727752109807396556/sonarts-bundle/node_modules/tslint-sonarts/bin/sonarts-server 33127
    0	    48	  6491	           node /home/johnminns/.sonarlint/work/.sonartmp_3804671756200196163/eslint-bridge-bundle/node_modules/eslint-bridge/bin/server 45715
    0	    24	  6374	         PHP Language Server
    0	     0	  6382	           sh -c '/usr/bin/php7.2' '-n' '-c' '/tmp/C3n2eV' '/home/johnminns/.vscode/extensions/felixfbecker.php-intellisense-2.3.10/vendor/felixfbecker/language-server/bin/php-language-server.php' '--tcp=<IP_ADDRESS>:42583' '--memory-limit=4095M'
    0	   275	  6383	             PHP Language Server
    0	    72	  6157	       watcherService
    0	    48	  6190	       searchService
    0	   108	  6362	     shared-process
    2	    96	  7283	     window (Issue Reporter)
    1	    96	  6096	   gpu-process
    0	     0	  7313	   /bin/sh -c /bin/ps -ax -o pid=,ppid=,pcpu=,pmem=,command=
    0	     0	  7314	     /bin/ps -ax -o pid=,ppid=,pcpu=,pmem=,command=

Workspace Info
|  Window (Payruns.js - *removed* (Workspace) - Visual Studio Code)
|    Folder (*removed*): 231 files
|      File types: js(95) scss(35) eot(24) woff(24) woff2(24) json(6) map(5)
|                  css(4) html(2) png(2)
|      Conf files: package.json(1)
|    Folder (*removed*): 614 files
|      File types: js(241) css(157) scss(125) woff2(24) woff(24) eot(24)
|                  json(6) map(5) html(2) env(1)
|      Conf files: package.json(1)
|    Folder (*removed*): 467 files
|      File types: js(320) scss(110) md(23) json(4) gitignore(2) html(2)
|                  npmrc(1) arcconfig(1) editorconfig(1) babelrc(1)
|      Conf files: package.json(1)
|    Folder (wowanalyzer): 2578 files
|      File types: js(2007) png(178) jpg(174) scss(39) json(27) css(24) md(17)
|                  snap(17) gif(17) xml(15)
|      Conf files: jsconfig.json(2) package.json(2)
|    Folder (*removed*): 6671 files
|      File types: php(3804) png(521) js(308) inc(293) bcmap(168) xml(164)
|                  gif(161) fixed(141) css(121) properties(105)
|      Conf files: makefile(3) grunt.js(2) package.json(2) settings.json(1)
|    Folder (*removed*): 9302 files
|      File types: php(6520) html(320) inc(299) phpt(273) xml(272) json(226)
|                  md(188) txt(159) fixed(141) css(79)
|      Conf files: makefile(5) package.json(1) launch.json(1) settings.json(1)
|      Launch Configs: php(2)
|    Folder (*removed*): 8074 files
|      File types: php(4556) png(483) js(449) inc(315) xml(268) phpt(200)
|                  md(195) fixed(193) bcmap(168) css(160)
|      Conf files: package.json(3) makefile(2) grunt.js(1) csproj(1) sln(1);

Extensions (16)

Extension
Author (truncated)
Version

markdown-toc
Ala
1.5.6

vscode-eslint
dba
1.8.2

EditorConfig
Edi
0.13.0

php-debug
fel
1.13.0

php-intellisense
fel
2.3.10

phpcs
ika
1.0.5

sublime-babel-vscode
jos
0.2.10

string-manipulation
mar
0.3.1

php-docblocker
nei
1.8.0

laravel-blade
one
1.18.0

material-icon-theme
PKi
3.6.3

partial-diff
ryu
1.4.0

sonarlint-vscode
Son
1.6.0

vscode-apielements
vnc
0.6.7

gitblame
wad
2.6.3

ReactSnippets
xab
2.3.0

(1 theme extensions excluded)

We are building exploration builds that use a much newer version of our UI framework (Electron version 4.0.x). I wonder if this issue reproduces with one of these builds, could you try? Download:

macOS: Download
Linux: Download
Windows: Download

I'm not perfectly sure, they are related, but I'm using the same build (and hash) and windows 10 and every few seconds my editor becomes unresponsive for minutes at time. Here's a profile:

@bpasero just as bad I'm afraid :(
Let me know if you need any other information.

Can you follow this wiki and post the results back here to understand more about why performance is so bad for you: https://github.com/Microsoft/vscode/wiki/Performance-Issues
Thanks!

Here's a profile from the exploration version, and it seems reproducible with all extensions disabled:

System Info

Code - Exploration: 1.32.0-exploration (14236f9f44cc7c94055bb8e65ebda29a4a91ddc7)
OS: linux(4.15.0-46-generic)
CPUs: Intel(R) Core(TM) i3-7100 CPU @ 3.90GHz(4 x 3899)
Memory(System): 11.69 GB(0.14GB free)
Memory(Process): 290.21 MB working set(212.76MB private, 1.26MB shared)
VM(likelyhood): 0%
Initial Startup: true
Has 0 other windows
Screen Reader Active: false
Empty Workspace: false

Performance Marks

What
Duration
Process
Info

start => app.isReady
118
[main]
initial startup: true

nls:start => nls:end
1
[main]
initial startup: true

require(main.bundle.js)
66
[main]
initial startup: true

app.isReady => window.loadUrl()
237
[main]
initial startup: true

require & init global storage
24
[main]
initial startup: true

window.loadUrl() => begin to require(workbench.main.js)
299
[main->renderer]
NewWindow

require(workbench.main.js)
310
[renderer]
cached data: YES

require & init workspace storage
15
[renderer]
-

init workspace service
14
[renderer]
-

register extensions & spawn extension host
501
[renderer]
-

restore viewlet
25
[renderer]
workbench.view.explorer

restore panel
0
[renderer]
-

restore editors
537
[renderer]
1: workbench.editors.files.fileEditorInput

overall workbench load
644
[renderer]
-

workbench ready
2406
[main->renderer]
-

extensions registered
2596
[renderer]
-

Extension Activation Stats

Extension
Eager
Load Code
Call Activate
Finish Activate
Event

vscode.debug-auto-launch
true
14
0
6
*

vscode.emmet
true
13
2
4
*

vscode.git
true
30
2
37
*

vscode.merge-conflict
true
10
2
10
*

vscode.extension-editing
false
38
0
3
onLanguage:markdown

vscode.markdown-language-features
false
57
2
0
onLanguage:markdown

vscode.php-language-features
false
27
2
6
onLanguage:php

Raw Perf Marks
Name	Timestamp	Delta	Total
main:started<PHONE_NUMBER>561	0	0
main:appReady<PHONE_NUMBER>679	118	118
nlsGeneration:start<PHONE_NUMBER>682	3	121
nlsGeneration:end<PHONE_NUMBER>683	1	122
willLoadMainBundle<PHONE_NUMBER>683	0	122
didLoadMainBundle<PHONE_NUMBER>749	66	188
main:willInitGlobalStorage<PHONE_NUMBER>769	20	208
main:didInitGlobalStorage<PHONE_NUMBER>793	24	232
main:loadWindow<PHONE_NUMBER>916	123	355
renderer/started<PHONE_NUMBER>194	278	633
willShowPartsSplash<PHONE_NUMBER>197	3	636
didShowPartsSplash<PHONE_NUMBER>200	3	639
willLoadWorkbenchMain<PHONE_NUMBER>215	15	654
didLoadWorkbenchMain<PHONE_NUMBER>525	310	964
main/startup<PHONE_NUMBER>297	772	1736
willInitWorkspaceService<PHONE_NUMBER>306	9	1745
willInitWorkspaceStorage<PHONE_NUMBER>308	2	1747
didInitWorkspaceService<PHONE_NUMBER>320	12	1759
didInitWorkspaceStorage<PHONE_NUMBER>323	3	1762
willStartWorkbench<PHONE_NUMBER>323	0	1762
LifecyclePhase/Ready<PHONE_NUMBER>325	2	1764
willRestoreEditors<PHONE_NUMBER>430	105	1869
willRestoreViewlet<PHONE_NUMBER>430	0	1869
willResolveExplorer<PHONE_NUMBER>447	17	1886
didRestoreViewlet<PHONE_NUMBER>455	8	1894
willLoadExtensions<PHONE_NUMBER>656	201	2095
didResolveExplorer<PHONE_NUMBER>826	170	2265
didRestoreEditors<PHONE_NUMBER>967	141	2406
LifecyclePhase/Restored<PHONE_NUMBER>967	0	2406
didStartWorkbench<PHONE_NUMBER>967	0	2406
extensionHostReady<PHONE_NUMBER>145	178	2584
didLoadExtensions<PHONE_NUMBER>157	12	2596
LifecyclePhase/Eventually<PHONE_NUMBER>486	2329	4925

prof-291f.extHost.cpuprofile.txt
prof-291f.renderer.cpuprofile.txt
prof-291f.main.cpuprofile.txt

p.s. I notice there is not much free memory. I closed a lot, freed up the RAM to * Memory(System): 11.69 GB(2.59GB free) but there is no noticeable improvement in performance.

https://github.com/Microsoft/vscode/issues/70955#issuecomment-475667789 has a lot of IPC traffic. Adding @joaomoreno to get more people on this, not sure this is any regression yet, but needs more investigation.

@Johnogram Can you reproduce using a brand new user data dir? code --user-data-dir FOLDER.

@joaomoreno Still basically unusable :(
prof-06e5.extHost.cpuprofile.txt
prof-06e5.renderer.cpuprofile.txt
prof-06e5.main.cpuprofile.txt

@joaomoreno Still basically unusable :(
Uploading prof-06e5.extHost.cpuprofile.txt…
Uploading prof-06e5.renderer.cpuprofile.txt…

I see nothing wrong in the attached CPU profiles...
@bpasero Given that this doesn't repro with the flags code --use-gl=osmesa --disable-gl-drawing-for-tests, I'm not sure there's much I can help here. I don't think that's our IPC.

@Johnogram @DanielFabian does it also reproduce when you disable GPU via "code --disable-gpu" from the command line?

Code Exploration works fine for me using code --disable-gpu

@bpasero It does seem much better with --disable-gpu. Also, I think I must have measured it somehow incorrectly before, because I couldn't repro without any extensions today on the exploration build. However, I've managed to narrow it down to a single extension. The --disable-gpu flag helps also when then extension is active.
Name: TypeScript Importer
Id: pmneo.tsimporter
Description: Automatically searches for TypeScript definitions in workspace files and provides all known symbols as completion item to allow code completion.
Version: 2.0.0
Publisher: pmneo
VS Marketplace Link: https://marketplace.visualstudio.com/items?itemName=pmneo.tsimporter

/duplicate https://github.com/microsoft/vscode/issues/15211


Main

I would like to start deleting obsolete methods and properties

@mwolf1963 Was this meant as an issue? In that case you can file one here: https://github.com/cake-build/cake/issues
I'm going to go ahead and close this one for now since it seems to be empty.


[634] Added subjects public v1 endpoint

Context
subjects public v1 endpoint
Changes proposed in this pull request
Added subjects public v1 endpoint, inclusive of sorting by name as per
https://api.publish-teacher-training-courses.service.gov.uk/api-reference.html#subjects-get
Guidance to review
http://localhost:3001/api/public/v1/subjects
http://localhost:3001/api/public/v1/subjects?sort=name
Checklist

[x] Make sure all information from the Trello card is in here
[x] Attach to Trello card
[x] Rebased master
[x] Cleaned commit history
[x] Tested by running locally

 [M] Implement public/v1 subjects


some times can not connect db

Issue Type: Bug
the db manager page can not show db or table list,and when I restart it ,sometimes the azuredatastudio worked, sometimes not

Azure Data Studio version: azuredatastudio 1.23.0 (d296b6397e0acfddc57e9085e736e084969cdaeb, 2020-10-13T23:03:09.799Z)
OS version: Windows_NT x64 10.0.19041

System Info

Item
Value

CPUs
Intel(R) Core(TM) i5-4590 CPU @ 3.30GHz (4 x 3300)

GPU Status
2d_canvas: enabledflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onoop_rasterization: disabled_offopengl: enabled_onprotected_video_decode: unavailable_offrasterization: enabledskia_renderer: disabled_off_okvideo_decode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabled

Load (avg)
undefined

Memory (System)
7.87GB (1.40GB free)

Process Argv

Screen Reader
no

VM
0%

Extensions (7)

Extension
Author (truncated)
Version

admin-pack
Mic
0.0.2

ads-language-pack-zh-hans
Mic
1.9.0

agent
Mic
0.47.0

dacpac
Mic
1.6.0

import
Mic
1.1.0

profiler
Mic
0.11.0

schema-compare
Mic
1.6.0

@oxwanawxo do you see any error in the development tools console when this happens? you can open it from here: Help menu => Toggle Developer Tools

These infos may help
<EMAIL_ADDRESS>发送自 Windows 10 版邮件https://go.microsoft.com/fwlink/?LinkId=550986应用
发件人: Alan<EMAIL_ADDRESS>发送时间: 2020年10月28日 02:24
收件人<EMAIL_ADDRESS>抄送<EMAIL_ADDRESS><EMAIL_ADDRESS>主题: Re: [microsoft/azuredatastudio] some times can not connect db (#13031)
@oxwanawxohttps://github.com/oxwanawxo do you see any error in the development tools console when this happens? you can open it from here: Help menu => Toggle Developer Tools
[image]https://user-images.githubusercontent.com/13777222/97345152-f8731100-1846-11eb-9ea2-bea975fc489b.png
―
You are receiving this because you were mentioned.

Those errors are implying that the JSON RPC channel is getting some invalid content when reading messages, which is pretty bizarre.
https://github.com/microsoft/vscode-languageserver-node/blob/main/jsonrpc/src/common/messageBuffer.ts#L103
Unfortunately there isn't really any logging that deep into the RPC layer to see what the client is receiving that's causing it to throw there. And we don't log the full message content being sent on the server side either...so we'd likely need to start by looking into adding more verbose logging in both of those places to try and track down what could be happening here.

I'm seeing the "Message header must separate key and value using :" error. I don't recall seeing the "Unexpected token S" one.
It can happen spontaneously while I'm working on a db I'm already connected to or while trying to create a new connection, either just after starting the program or later. It will affect one server but not another. It happens frequently enough that I'm sure I could get you some more error data within a couple days.
Nice hat, btw.

Ahh, I DO get the "Unexpected token S" error, after all.
[[object Object]]Unexpected token S in JSON at position 0

@yorkshirelandscape
recently, this situation do not show again when i updated it to the lastest version, and may be the issue related with computers, my office pc occured,my owner do not

Closing as issue is not reproducible anymore.
Let us know if you continue to experience the issue along-with logs for investigation, and we can re-open the issue.


Service load-balancing differentiates between protocols

Builds off the work started by @aojea in https://github.com/cilium/cilium/pull/26399.
TODO:

[x] Add double lookup in datapath to preserve compat
[ ] TC eBPF unit tests
[ ] XDP eBPF unit tests
[ ] Add agent support for setting protocol in services map
[ ] Add a feature flag that's disabled by default
[ ] Update backend address API spec
[ ] Update docs
[ ] Integration tests
[ ] Update cilium-dbg CLI

Fixes: #9207
Service load-balancing differentiates between protocols

@akhilles are you planning to work on this still? If not I would like to continue working from this PR.

@akhilles are you planning to work on this still? If not I would like to continue working from this PR.

please go ahead

@i404788 are you currently working on a fix? We are currently blocked by this issue and were wondering if it's being actively worked on.

@abhay-krishna haven't started yet as other tasks got in between, still plan to work on it eventually as it blocks us as well but it's lower priority. Feel free to pick it up if you need it in short order

Reopening because of https://github.com/kubernetes/kubernetes/pull/120069

maybe we can link the final implementation? https://github.com/cilium/cilium/pull/33434


ValueError: Layer weight shape not compatible with provided weight shape

after installing Tensorflow Python 3 / CPU only on anaconda, I tried to run the script without success:
$ make_image_analogy.py images/a.jpg images/a.jpg images/b.jpg out/b
Using TensorFlow backend.
Tensorflow detected. Forcing --a-scale-mode=match (A images are scaled to same size as B images)
Using PatchMatch model
Scale factor 0.25 "A" shape (1, 3, 48, 64) "B" shape (1, 3, 48, 64)
W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use SSE3 instructions, but these areavailable on your machine and could speed up CPU computations.
W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use SSE4.1 instructions, but these are available on your machine and could speed up CPU computations.
W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use SSE4.2 instructions, but these are available on your machine and could speed up CPU computations.
W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use AVX instructions, but these are available on your machine and could speed up CPU computations.
W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use AVX2 instructions, but these areavailable on your machine and could speed up CPU computations.
W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use FMA instructions, but these are available on your machine and could speed up CPU computations.
Traceback (most recent call last):
  File "/home/dori/.conda/envs/py36/bin/make_image_analogy.py", line 27, in <module>
    image_analogy.main.main(args, model_class)
  File "/home/dori/.conda/envs/py36/lib/python3.6/site-packages/image_analogy/main.py", line 69, in main
    net = vgg16.get_model(img_width, img_height, weights_path=args.vgg_weights, pool_mode=args.pool_mode)
  File "/home/dori/.conda/envs/py36/lib/python3.6/site-packages/image_analogy/vgg16.py", line 89, in get_model
    layer.set_weights(weights)
  File "/home/dori/.conda/envs/py36/lib/python3.6/site-packages/keras/engine/topology.py", line 1154, in set_weights
    'provided weight shape ' + str(w.shape))
ValueError: Layer weight shape (3, 3, 3, 64) not compatible with provided weight shape (64, 3, 3, 3)

Any idea how to solve this issue ?
PS: Note that I renamed all calls Convolution2D(XXX, 3, 3, activation=... into Conv2D(XXX, (3, 3), activation=... to fix the many UserWarnings
/home/dori/.conda/envs/py36/lib/python3.6/site-packages/image_analogy/vgg16.py:71:
UserWarning: Update your `Conv2D` call to theKeras 2 API: `Conv2D(512, (3, 3), activation="relu", name="conv5_3")`
model.add(Convolution2D(512, 3, 3, activation='relu', name='conv5_3'))

Update. After adding the following line:
weights[0] = weights[0].reshape(list(reversed(weights[0].shape)))

after line 88, I got the error Intel MKL FATAL ERROR: Cannot load libmkl_avx2.so or libmkl_def.so.   just after start of iteration 0x0.
Might be something wrong with my conda env. Reinstalled a tensorflow + image-analogies env with virtualenv py3.6 and it seems to work now (now iteration 1x4)

Well, the resulting images look like nothing, so there must be something wrong with my installation and the code :(  Support appreciated.
Input
A:

A':

B:

Output:

Which version of Keras are you using? Sounds like you're using Keras v2 whereas this currently supports v1.

I see, maybe this could be updated in the readme. Will try again, thx!

@awentzonline there's also something wrong with the pip package. While I can see versions hardcoded with == in the requirements.txt file, the pip package metadata shows >= instead, hence keras 2 gets installed instead of 1:
Requires-Dist: Keras (>=1.0.0)
Requires-Dist: Pillow (>=3.1.1)
Requires-Dist: PyYAML (>=3.11)
Requires-Dist: Theano (>=0.8.2)
Requires-Dist: h5py (>=2.5.0)
Requires-Dist: numpy (>=1.10.4)
Requires-Dist: scikit-learn (>=0.17.0)
Requires-Dist: scipy (>=0.17.0)
Requires-Dist: six (>=1.10.0)

@awentzonline after force installing the requirements.txt package versions, I'm now getting the following error:
Using TensorFlow backend.
ValueError: Not property objects (Not property objects)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/dori/Projects/personal/image-analogies/venv/bin/make_image_analogy.py", line 13, in <module>
    import image_analogy.main
  File "/home/dori/Projects/personal/image-analogies/venv/lib/python3.6/site-packages/image_analogy/main.py", line 9, in <module>
    from image_analogy import img_utils, vgg16
  File "/home/dori/Projects/personal/image-analogies/venv/lib/python3.6/site-packages/image_analogy/img_utils.py", line 4, in <module>
    from . import vgg16
  File "/home/dori/Projects/personal/image-analogies/venv/lib/python3.6/site-packages/image_analogy/vgg16.py", line 3, in <module>
    import h5py
  File "/home/dori/Projects/personal/image-analogies/venv/lib/python3.6/site-packages/h5py/__init__.py", line 31, in <module>
    from .highlevel import *
  File "/home/dori/Projects/personal/image-analogies/venv/lib/python3.6/site-packages/h5py/highlevel.py", line 13, in <module>
    from ._hl.base import is_hdf5, HLObject
  File "/home/dori/Projects/personal/image-analogies/venv/lib/python3.6/site-packages/h5py/_hl/base.py", line 78, in <module>
    dlapl = default_lapl()
  File "/home/dori/Projects/personal/image-analogies/venv/lib/python3.6/site-packages/h5py/_hl/base.py", line 65, in default_lapl
    lapl = h5p.create(h5p.LINK_ACCESS)
  File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper (/tmp/pip-build-a61i3wcx/h5py/h5py/_objects.c:2847)
  File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper (/tmp/pip-build-a61i3wcx/h5py/h5py/_objects.c:2805)
  File "h5py/h5p.pyx", line 131, in h5py.h5p.create (/tmp/pip-build-a61i3wcx/h5py/h5py/h5p.c:2886)
  File "h5py/h5p.pyx", line 72, in h5py.h5p.propwrap (/tmp/pip-build-a61i3wcx/h5py/h5py/h5p.c:2693)
ValueError: Not a property list class (Not a property list class)

What version of h5py are you using ? :/

looking at the h5py repo, seems like the v2.5 branch was quite buggy. Installed the latest version 2.7, and it force installed numpy 1.12.1. Restarting a make_image_analogy.py run and crossing fingers...

Unfortunately, it still doesn't look anything like a city.  I wasn't expecting something of high quality (purposedly ran on images scaled down to 512px to test it out with cpu on my laptop), and the plan was then to re-run the script on AWS with GPU using the HD images. But clearly, if I tried AWS now, it'd still result in some garbled image.

I didn't use any option (simply make_image_analogy.py images/a.jpg images/ap.jpg images/bp.jpg out/b). Does that explain the result? Are options mandatory for this use-case maybe?

Tried running the render_example_cpu.sh script, which I assumed was the one use to generate the arch example, but the results are even worse:
Texture:

Style xfer:

Blend:

Analogy:

@awentzonline really, you just close without even a comment ? great support ...

@Fandekasp I must've accidentally closed this without commenting.
Two things: quality settings are documented in the readme, and the mask you're using for the city should probably be more detailed if you want interesting results.
This is some random thing I made available for free a year ago and is otherwise a time sink for me. Passive-aggressive comments like yours make me less enthusiastic about supporting this at all.

@awentzonline at the time, it felt like coming to your door, explaining you an issue I had and asking for help, then... getting the door slammed to my face ^^  Sorry for the reaction, and thank you for coming back to give more details.
I'm currently finishing the fast.ai course, and will then study Keras in more detail. Since I'm very interested by this kind of project, I might even be able to upgrade your repo to the latest packages versions. Keep in touch

Hey, no big deal--I hope you end up with some nice results.


Appstudio update test-component-pac-qftq

Pipelines as Code configuration proposal
To start the PipelineRun, add a new comment with content /ok-to-test
For more detailed information about running a PipelineRun, please refer to Pipelines as Code documentation Running the PipelineRun
To customize the proposed PipelineRuns after merge, please refer to Build Pipeline customization

Pipelines as Code CI/test-component-pac-qftq-on-pull-request has successfully validated your commit.

StatusDurationName

✅ Succeeded
7 seconds
init

✅ Succeeded
19 seconds
clone-repository

✅ Succeeded
32 seconds
build-container

✅ Succeeded
21 seconds
inspect-image

✅ Succeeded
22 seconds
deprecated-base-image-check

✅ Succeeded
45 seconds
clamav-scan

✅ Succeeded
4 minutes
clair-scan

✅ Succeeded
18 seconds
sbom-json-check

✅ Succeeded
14 seconds
label-check

✅ Succeeded
7 seconds
show-sbom

✅ Succeeded
7 seconds
show-summary

Pipelines as Code CI/test-component-pac-qftq-on-pull-request has successfully validated your commit.

StatusDurationName

✅ Succeeded
11 seconds
init

✅ Succeeded
16 seconds
clone-repository

✅ Succeeded
32 seconds
build-container

✅ Succeeded
20 seconds
deprecated-base-image-check

✅ Succeeded
20 seconds
inspect-image

✅ Succeeded
11 seconds
clair-scan

✅ Succeeded
49 seconds
clamav-scan

✅ Succeeded
15 seconds
sbom-json-check

✅ Succeeded
11 seconds
label-check

✅ Succeeded
7 seconds
show-sbom

✅ Succeeded
7 seconds
show-summary


Removed unnecessary code that caused confusion

What does this PR do? (please provide any background)
Removes default messages passed in that were not needed & left behind from development.
What tests does this PR have?
The usual unit tests.
How can this be tested?
npm run test
Screenshots / Screencast
N/A
What gif best describes how you feel about this work?
nope... not wasting my time.

[x] I have checked the contributing document and I'm happy for this to be reviewed.

Reviewers
Review 1

[x] :+1:

Review 2 *

[x] :+1:

Review 3 (optional)

[ ] :+1:

By adding a +1 you are confirming you have...

Witnessed the work behaving as expected (this could be on the author's machine or screencast).
Checked for coding anti-patterns.
Checked for appropriate test coverage.
Checked all the tests are passing.

*  for HX this review must be completed by an SE, SA or Project Guru

Ok with me

Thanks for this change, I was using this as an example and it confused me! :shipit:


Fixing ottjax 0.4.6 Errors

errors also faced in #677

[x] test import error, same as this commit from another PR: https://github.com/theislab/moscot/pull/677/commits/fd407df652a1a41f81196927e784a28f58c26b4f
[x] resave the alignment and mapping pickle file to fix the regression test, this commit https://github.com/theislab/moscot/pull/677/commits/a2589dab71cbfffee53138d7242437397eca992b
[x] added https://github.com/theislab/moscot/issues/678
[x] ignore failing test see https://github.com/ott-jax/ott/issues/519

[ ] resave the alignment and mapping pickle file to fix the regression test

hi @selmanozleyen thank you, it looks good but could you please skip instead of modifying iterations for the other two that needs to be fixed? so we can keep track of them better, after that, it can be merged!

@giovp ok done


added coinor-libosi-dev to base.yaml

I think this would be a candidate coin-or-Osi

Thanks for digging that up @mikaelarguedas


:seedling: convert vulnerabilities check to probe

What kind of change does this PR introduce?
Migration of Vulnerabilities check to probe.

[x] PR title follows the guidelines defined in our pull request documentation

[x] Tests for the changes have been added (for bug fixes/features)

Which issue(s) this PR fixes
NONE
Special notes for your reviewer
Does this PR introduce a user-facing change?
No

@laurentsimon @spencerschrock PTAL again.