typical range of num_train_steps?

Thanks for sharing this great repo!
I'm wondering what is the typical range of num_train_steps for a SoundStream model and others.
I tested with 10000 and saw the loss went down somewhat smoothly, but it did not generate any meaningful results (very noisy).

what version are you using?  what is your batch size?  i suspect you'll need to train more than 10k steps, however, there might be a problem with the recent versions...
@lucidrains i'm still testing and was going to wait until i had more data before posting, but i'm worried the complex stft discriminator might need to come back.  i've moved onto a larger training set (so not quite the same as before), and i was 2 days into training on 0.10.3 and was still getting mostly noise, so i'm now testing at 0.7.8 (the last version before you removed it) with use_complex_stft_discriminator = True.  i'm only half a day in, but the loss curves are looking better (trending down vs. up) and samples seem less noise (but more time is needed to tell there).  i'll report back in time...

what version are you using? what is your batch size? i suspect you'll need to train more than 10k steps, however, there might be a problem with the recent versions...
@lucidrains i'm still testing and was going to wait until i had more data before posting, but i'm worried the complex stft discriminator might need to come back. i've moved onto a larger training set (so not quite the same as before), and i was 2 days into training on 0.10.3 and was still getting mostly noise, so i'm now testing at 0.7.8 (the last version before you removed it) with use_complex_stft_discriminator = True. i'm only half a day in, but the loss curves are looking better (trending down vs. up) and samples seem less noise (but more time is needed to tell there). i'll report back in time...

oh bummer, i really need help on this one :cry:
ok, i've reverted it for now

@djqualia could it be a precision issue? i notice complex calculations are all done in 64 bits, which i'm not doing for the simulated complex

@djqualia @lucidrains thanks for your comments!  I tried with batch_size = 4 and 8.  I'll try again with the reverted version and see how it goes!

Update, I tested with 0.11.1 and confirm the samples are MUCH better (I can already hear the source in some samples, <1 day in).  The total loss was much higher than previous versions, but is generally trending down.

@djqualia that's great! thank you! btw I like your name 🤣

@djqualia definitely has the best name

Was able to replicate @djqualia's result with 0.11.1 :)
Here's a rough sketch of the total loss over time (unfortunately, had some weird issues with print statement issues and whatever so this doesn't cover the full training run but you get the general idea. 20k training steps, batch_size=4 grad_accum_every = 8, OpenSLR dev-clean dataset )

BTW, the end result generally contains things that I recognize as sounding like human speech but if you ran it on 0.25x (sort of like a robot):
https://user-images.githubusercontent.com/13173037/218032553-f3775870-037e-4271-aca7-c9c5e14787e4.mp4
(I hear "rarely succeed")
Is this to be expected and hopefully would get better with more training, or is it more likely I did something wrong with running SoundStream e2e?

my first thought https://www.youtube.com/watch?v=uc6f_2nPSX8 🤖🎵

I think the "robot sound" is probably expected this early on in training.  It's akin to bit-reduction effects in music production (as soundstream builds up the RVQ network).  My early samples trained on music have a similar effect, which has gone away with more training.  Example:
https://user-images.githubusercontent.com/5771497/218266970-9029f852-7f1a-430c-930f-d9327353228c.mp4

I'm having trouble with understanding what I'm doing wrong... I left the data_max_length to 320 * 32...  I don't understand with these numbers mean after looking through the code base.  The data I'm using is all 30s clips, but for some reason I'm only getting less than a second for the samples that gets spit out at the end of each save results... Is there documentation anywhere on what this data_max_length means as I feel it's my problem.

Sounds like some decent progress thus far 👍
@djqualia  - may I ask what dataset you trained upon to get that ten-second clip you posted above? And, in addition, how many steps had you trained over when that clip was emitted, and what 'data_max_length' value did you use when training upon that dataset?

@aTylerRice Did you ever reach a conclusion on your question above Re: data_max_length? I'm also training on 30s clips, and my save results are also <1s. Thanks.

re: data_max_length, yes you will need to set this to your desired sample length based on your sample_rate.  the default value is low i suspect for testing and also because most GPUs can't handle a large value
for my sample above, i'm being a bit ambitious and attempting to train a general music soundstream model at 44100 sample rate.  to achieve this, i've adjusted the stride factor from 320 -> 882 (using 3,6,7,7), based on my limited understanding of the research papers.  with my gpu, i can only support a puny batch size of 2. data_max_length is 10 x 44100 for 10s
i'm now 2 days into training on 0.12.1 (at step 41500), and there's still robot/bit-reduction effect on most samples (some more than others), but it's getting better.  TBD on whether this goes away with time (in my past data set, it was only bass-instrument sounds, which perhaps enabled it to converge faster?)
initially, my data set was my very large collection of music.  i've been augmenting it with every free music database i can find (fma, jamendo, audioset).  i've probably spent more time writing code to gather/organize datasets than anything else so far :-)

p.s.  i would recommend reading and trying to understand the associated research papers (soundstream, audiolm, hubert, musiclm).  this all state of the art so it's not an easy thing to get working (yet)

@djqualia I still had these robotic sounds after training on 15s clips on about 80k samples from fma dataset.. I'm guessing google either had many more samples to train on and maybe the model is even slightly different. It's a sad state that research is so hard to reproduce. I'm going to try training with a sample size of 10s next but using all the audio from fma large so essentially 300k examples.. This is going to wait though as my machine learning computer is currently in pieces due to an upgrade

@djqualia Thanks very much indeed for the info. I've set off a new training run some ten minutes ago with data_max_length set at 240000, as per 24kHz * 10 seconds. With this much higher data_max_length, I had to drop batch_size down to 2 (with grad_accum_every at 8) in order to not get an OOM thrown straight back. I've also adjusted rq_num_quantizers from 8 -> 12 just to see if that helps anything.
My dataset at present is just fma_large, so I'm training on a dataset of over 100k samples atm. I'm also using the 0.12.1 tag.
I've just got two quick questions if you find a moment, please 🙂   RE: i've adjusted the stride factor from 320 -> 882 (using 3,6,7,7), based on my limited understanding of the research papers - what parameter are we talking about here? I couldn't find any stride parameter set at 320. Secondly, might I ask what GPU and setup you're using? I've just set off the training run per my descriptions above on an A100 (lambda labs), and by the looks of things I'm sure not going to hit step 41500 in two days of training! 🙂
Thanks for your help and pointers - they're very much appreciated 🙂

the stride factor is a series of convolutions that reduces the dimensionality of the incoming audio signal.  the default in this repository, and what was used in the original audiolm paper, was (2, 4, 5, 8).  2 x 4 x 5 x 8 = 320.  this results in embeddings at 50hz (every 20ms).
i believe this factor of 320 needs to be scaled to other sampling rates.  in the musiclm paper, they used a stride factor of 480 for 24000, which is proportional.  thus, for 44100 i computed a stride factor of 882 was needed (44100 / 16000 * 320).  i then determined the factors of 882 to come up with a set of strides that resulted in this...
my GPU is an expensive NVIDIA RTX A6000 w/48 gb ram...
hth!

@djqualia thanks again for the info above - very much appreciated.
Something occurred to me in re-reading your posts above, and I was wondering if I might clarify something with you if possible. Tagging @lucidrains in as well because it's related to the current codebase itself, so I'd be able to put up a PR if the below is correct.
In the SoundStream class' constructor (__init__), the default value for target_sample_hz is 24000, and the default value for strides is (2, 4, 5, 8), i.e.
class SoundStream(nn.Module):
    def __init__(
        self,
        *,
        channels = 32,
        strides = (2, 4, 5, 8),

...

        target_sample_hz = 24000

...
    ):

In your post above, you recall that 320 (i.e. (2, 4, 5, 8)) is the strides value used in the AudioLM paper when the sampling rate is 16kHz, and a strides value of 480 is used in MusicLM when the sampling rate is 24kHz. Does this mean that the default strides value of (2, 4, 5, 8) and the default sampling rate (target_sample_hz = 24000) for the SoundStream class aren't quite compatible with one another?
Best,
Shaun

sampling rate is 16kHz, and a strides value of 480 is used in MusicLM when the sampling rate is 24kHz.

Yes you're right, for 16 kHz used in the article SoundStream/AudioLM strides (2, 4, 5, 8) = 320, and for 24 kHz article MusicLM (3, 4, 5, 8) = 480
PS Screenshot of the audio file from the original SoundStream

Thanks for confirming @Afiyetolsun 👍

sampling rate is 16kHz, and a strides value of 480 is used in MusicLM when the sampling rate is 24kHz.

Yes you're right, for 16 kHz used in the article SoundStream/AudioLM strides (2, 4, 5, 8) = 320, and for 24 kHz article MusicLM (3, 4, 5, 8) = 480
PS Screenshot of the audio file from the original SoundStream

What do you mean in "audio file from the original SoundStream"? from where you took this audio?

from where you took this audio?

https://google-research.github.io/seanet/audiolm/examples/
"Original" from Audiolm you can download the audio files and check the sampling rate. In the audiolm article it says 16kHz and in the files as well, everything makes sense :D
And in MusicLm 24kHz

OK, i though you meant original from SoundStream, and in SoundStream paper they actually used 24000 sample rate.

00

SoundStream paper they actually used 24000 sample rate.

Sorry for the confusion!  :)

@djqualia Thanks very much indeed for the info. I've set off a new training run some ten minutes ago with data_max_length set at 240000, as per 24kHz * 10 seconds. With this much higher data_max_length, I had to drop batch_size down to 2 (with grad_accum_every at 8) in order to not get an OOM thrown straight back. I've also adjusted rq_num_quantizers from 8 -> 12 just to see if that helps anything.
My dataset at present is just fma_large, so I'm training on a dataset of over 100k samples atm. I'm also using the 0.12.1 tag.
I've just got two quick questions if you find a moment, please slightly_smiling_face RE: i've adjusted the stride factor from 320 -> 882 (using 3,6,7,7), based on my limited understanding of the research papers - what parameter are we talking about here? I couldn't find any stride parameter set at 320. Secondly, might I ask what GPU and setup you're using? I've just set off the training run per my descriptions above on an A100 (lambda labs), and by the looks of things I'm sure not going to hit step 41500 in two days of training! slightly_smiling_face
Thanks for your help and pointers - they're very much appreciated slightly_smiling_face

I have also started training on fma_large + MagnaTagATune data for a total of 125k datapoints. I have trained for about 6k steps but it is still mostly noise and the loss is sort of stuck between 1200-1300 (with STFT normalization enabled). Have you gotten better results or are things the same for you? I have a stride factor of 320, 8 quantizers at 24KHz.

I tried to train with the clean part of librispeech (100 + 360) for 12k steps, and it seems still robot sound there. data_max_length is 16000 * 2, with 16kHZ. Any suggestions?

@yygle I have the same problem, have you solved it?

@djqualia do you mind sharing some of your training curves? I'm wondering what the discriminator losses look like. e.g. do they drop low, then increase and oscillate? Suggesting the generator has caught up

@lucidrains i wanna train voice clone of chinese mandarin, and i plan to change soundstream to encodec instead. and i found chinese hubert model ,trained by weNetSpeech,10k+ hours. but k-means is not provided, which is required by project, the project require n_clusters and clusters_center, what should i do to continue to my exploration about voice clone? @lucidrains

https://huggingface.co/TencentGameMate/chinese-hubert-base/tree/main

but k-means is not provided, which is required by project, the project require n_clusters and clusters_center, what should i do to continue to my exploration about voice clone?
I encountered a similar problem, could you please share whether you found a good solution now? Thanks a lot! @hyhzl


Online editor throwing error ?

Hi, not sure if this is the right place, but the online editor at
https://bootstrapemail.com/editor
Throws this error when hitting the "re-render" button. Even with just the demo content without changes.

Related: #27


New error

2017-10-04 09:41:07-0400 [HTTPChannel (TLSMemoryBIOProtocol),4076377,<IP_ADDRESS>] Client disconnected (False, 1006, connection was closed uncleanly (peer dropped the TCP connection without previous WebSocket closing handshake))
2017-10-04 09:41:07-0400 [HTTPChannel (TLSMemoryBIOProtocol),4076389,<IP_ADDRESS>] Client disconnected (False, 1006, connection was closed uncleanly (peer dropped the TCP connection without previous WebSocket closing handshake))
2017-10-04 09:41:07-0400 [HTTPChannel (TLSMemoryBIOProtocol),4076390,<IP_ADDRESS>] Client disconnected (False, 1006, connection was closed uncleanly (peer dropped the TCP connection without previous WebSocket closing handshake))

Sounds like you're out of memory, too many connections possibly

Is the problem resolved?

@x25 No, this problem still continues

@x25 Where can I contact you? Do you accept projects to develop?

@vphelipe my email<EMAIL_ADDRESS>

Solution: Create your private pool


PBI 28841 SC REST API - Server SDK - Java - Update with sprint 35+36 release changes + Publish

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@00942fd). Click here to learn what that means.
The diff coverage is 28.57%.

@@            Coverage Diff            @@
##             master      #46   +/-   ##
=========================================
  Coverage          ?   43.18%
  Complexity        ?      522
=========================================
  Files             ?      136
  Lines             ?     4254
  Branches          ?       59
=========================================
  Hits              ?     1837
  Misses            ?     2395
  Partials          ?       22

Impacted Files
Coverage Δ
Complexity Δ

...afecharge/request/builder/SafechargeCCBuilder.java
62.5% <ø> (ø)
8 <0> (?)

...rc/main/java/com/safecharge/util/APIConstants.java
0% <ø> (ø)
0 <0> (?)

...java/com/safecharge/request/CreateUserRequest.java
20% <20%> (ø)
1 <1> (?)

.../com/safecharge/request/SafechargeBaseRequest.java
85.36% <50%> (ø)
9 <0> (?)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 00942fd...458fa6d. Read the comment docs.


Feature/issue 236 expanding div

In the  Android emulator the initial collapsing of the text is quite obvious and should eventually be animated. This functions a lot nicer without debug mode on or when using the ios simulator however, It's likely it may be a none issue in production.

@rasmus-storjohann-PG your changes look good, feel free to merge.


Support base64-encoded nested messages

This is not part of the spec, but youtube loves to pass base64 encoded
messages in string fields of other messages. So when a string is
encountered, attempt decoding and recursing into it.
Hope that's understandable, I'm not too familiar with protobuf's terminology. In essence, I'm doing some reversing of youtube's internal browse_ajax API, which is littered with this idiosyncrasy. So to decode such a message, I currently have to pass the protobuf-message to your tool, copy-paste the base64-encoded submessage, decode it, and pass it through again (often multiple times).
Here's how such a message is displayed currently:

and now with my patch applied:

both times invoked with echo '4qmFsgJSEhhVQ1Y1dkNpM2pQSmRVUlp3QU9PX0ZOZlEaNkVnWjJhV1JsYjNNWUF5QUFNQUU0QWVvREUwTm5RVk5EWjJsVmFXOWZRVzVoTWtJdFZ6USUzRA=='|base64 -d|./main.py

hi, thanks for the patch! it's a pretty specific use-case (urlsafe base64 encoded, missing padding) so I'm not sure it's a good fit to have it by default. However, the config system already allows the user to specify custom handlers for fields, so you could go ahead and define one for base64-encoded nested messages. If you place this in protobuf_config.py:
types = {
  "root": {
    80226972: "msg1",
  },
  "msg1": {
    3: "base64_message",
  },
}

def parse_base64_message(x, type):
  from urllib.parse import unquote
  from subprocess import run
  import base64

  x = unquote(x.read().decode('ascii')) + '=='
  x = base64.urlsafe_b64decode(x)
  output = run('./main.py', input=x, capture_output=True).stdout
  return "base64 encoded message => " + output.decode().rstrip()

native_types = {
  "base64_message": (parse_base64_message, 2),
}

You'll get the desired output. But I understand you want this to happen in the chunk handler to avoid having to explicitely specify it for fields... this can't be easily done for now, I'll think of the best way to make it possible.

On Sun, Dec 13, 2020 at 10:28:55AM -0800, Alba Mendez wrote:

hi, thanks for the patch! it's a pretty specific use-case (urlsafe
base64 encoded, missing padding) so I'm not sure it's a good fit to

Note that the way I've implemented this, it works for any of the
following combinations:

urlencoded / not urlencoded
urlsafe base64 (-_) / normal base64 (+/)
with padding / without padding

In other words, I tried to keep it as non-special-case as possible.

You'll get the desired output. But I understand you want this to happen
in the chunk handler to avoid having to explicitely specify it for
fields... this can't be easily done for now, I'll think of the best way
to make it possible.

Correct. In my use case (reverse engineering) i don't know the field
numbers beforehand.
How about a command line flag (passed to the StandardParser class) that
enables additional heuristics (maybe someone else has other needs that
could be added to it)? I can't think of a good name, but something like
--try-harder or something?


feat(package): add repository information to package.json

Signed-off-by: Aniruddha Shriwant<EMAIL_ADDRESS>Issue #341

Changes

Added Package Repository Information (directory) in package.json

Coverage remained the same at 96.637% when pulling 79b608fa3e17dcc5a62509a01d2e1a6db328e0f6 on Aniruddha-Shriwant:aniruddha/techdocs-341/addRepositoryInPackage.json into b78e759d47053f73f9d7a5d357b4ace98807da40 on accordproject:master.

Please don't merge until all related PRs are approved (tracked in https://github.com/accordproject/techdocs/issues/341)


tinyint and checkbox

Laravel Version: 5.5
Voyager Version: 1.0.17
PHP Version: 7.2
Database Driver & Version: 5.5.59-0+deb8u1 - (Debian)

Description: I ticked checkbox "Featured" and $request->featured = true, but $data after save not have featured.

Oke


wrong field type in  vpc.CreateRouteRequest struct

See this pull reuest for detail.

same issue on the  vpc.DeleteRoutesReques struct

It seems already fixed in recent releases, can you confirm it and close this issue? Thanks.


libsql-sys build requires libclang

The build.rs of libsql-sys crate runs bindgen for every build, requiring libclang to be present on all build boxes. This is a regression from what we had before.

This has been fixed


Sorry to bother you again, Can you give some advice use senet for 3d image

Hi,
Thanks for your great work, I get some troubles when it use to 3d image. for example, my input shape is (BCZWH--1-1-4-160-160). when I use nn.AdaptiveAvgPool3d(1), it worked like this

And when I change self.avg_pool = nn.AdaptiveAvgPool3d((4,40,40)),another bug occurs

Then I change  self.att3 = SELayer(channel=64*4*40*40,reduction=16), it fixed above problem but display OOM. Are there some wrong steps? Can you give me some advice

Hi, if I understand correctly, you need to reshape y like y.view(b, c) as https://github.com/moskomule/senet.pytorch/blob/3b2a90ad9bcebe6ef004da614f2ecd2d1e29fdb1/senet/se_module.py#L17, as of the first problem.

Hi，
Thanks for your kind help! I think i have fixed it!!


Add Custom Resource Definitions to bundle.yaml

Follow-up PR to the following discussion.
cc @brancz

Thanks, we also have to add the v1 and v1beta1 CRD manifests, correct?

Yes, but this PR is mainly meant to fix what was missing in #3155. I'll move to v1beta1 in another PR.

Yes, but this PR is mainly meant to fix what was missing in #3155. I'll move to v1beta1 in another PR.

Yes, agreed! sgtm 👍


old clang not available on Precise anymore

I think it is related to #4327, we have been experiencing issues for the last couple of hours, "Disallowing sources: llvm-toolchain-precise-3.6" as shown in this log for instance.
The same issue occurs for versions 3.7, 3.8 and 3.9.

I just found the commit removing all keys for precise environment, so I guess this is actually not a bug.


Testing an array of promise middleware

I'm trying to work out a way of testing an array of promised middleware and I came up with this contraption. I was wondering if there was something that you had in your arsenal. Thoughts?
function mapRoute(req, res, middlewares){
  var errors = []
  var next = []
  var route = false
  return Promise.map(middlewares, function(middleware) {
    return middleware(req, res).then(function(response){
      if(response == "route") route = true
      if(response == "next") next.push("next")
    }).catch(function(e){
      errors.push(e)
    })
  }, {concurrency: 1})
  .then(function(){
    if(route) return "route"
    if(errors) throw errors[0]
    if(next.length == middlewares.length) return "next"
    return false
  })
}

function mapRoute(req, res, middlewares){
  function createNext(index){
    return Promise.resolve()
      .then(function(){
        return middlewares[index](req, res)
      })
      .then(function(action){
        if(action == "route") return "route"
        if(action == "next"){
          if(middlewares.length-1 >= index+1){
            return createNext(index+1)
          }
        }
        return "done"
      })
  }
  return createNext(0)
}

The above works way better.

All of this behavior should already be captured in express / express-promise-router, so I'm not sure it necessarily makes sense to reproduce it in tests.
I would suggest taking a look at supertest so that you can test your routes without worrying about how your handlers and middleware are structured.

Here's another example of something I want to do without testing.
Let's say I have a chain of middleware for one route, like this.
app.use("/page", [
  middleware.validateQuery(),
  middleware.processPage(),
  middleware.retrieveFromDb(),
  middleware.setValue(),
])

And not In a new route I want to use this chain from above conditionally.
var chain = [
  middleware.checkMethod(),
  middleware.validateQuery(),
  middleware.processPage(),
  middleware.retrieveFromDb(),
  middleware.setValue(),
]

app.use("/page", chain) // same as above
app.use("/page", function(req, res){
  if(req.query.setting == "something"){
    return _.simulateRoute(req, res, chain)
  }
  return res.send("no setting")
})

Here's my simulateRoute function.
function simulateRoute(req, res, middlewares){
  function fakeNext(){
    return "next"
  }
  function createNext(index, req, res){
    return Promise.resolve()
      .then(function(){
        return middlewares[index](req, res, fakeNext)
      })
      .then(function(action){
        console.log(action)
        // console.log("/////action/////")
        // console.log(action)
        // console.log("/////index/////")
        // console.log(index)
        if(action == "route") return "route"
        if(action == "next"){
          if(middlewares.length-1 >= index+1){
            return createNext(index+1, req, res)
          }else{
            return "next"
          }
        }
        return "next" // changed from done
      })
  }
}

My problems are as follows

Doesn't this exist somewhere within express-promise-router or express?
This only supports promised middlewares (I guess I can pass in next as well and call the original next function)

This ties in with some of the stuff I was talking about here https://github.com/strongloop/express/issues/2709

My goal is to have the ability to run a chain of middleware (promised (using express-promise-router or native) without a route, or pass in req and res from an existing route. This would greatly solve all of my problems.


thread 'main' panicked at 'called Result::unwrap() on an Err value: SpotifyIdError', libcore/result.rs:945:5

Hi there,
first of all: thanks for your good work! I am a raspberry / linux / raspotify beginner, so the second thing is asking for your patience.
Coming to the point: I updated to the latest version as I had connection issues. It works on one smartphone, but on the other I do find the error above. What can I do?
Thanks!
Florian

This has been fixed in the latest version of Raspotify. Please have a look at issue #122. If your problem is solved, please consider closing this issue yourself with the button below.

Thanks!


Provide build system for combined & minified files, module structure

The repository currently only contains the dedicated source files and a minified result. Please provide a description and/or commands to create the combined files as well as the minified version for testing and to be able to reproduce it.
As a side request, it would be great if the whole thing was set up to be used with require.js / browserify in an AMD like structure.
Would you accept a pull request with the whole thing reworked using requirejs?

This is fixed in PR #26


Error when run "Epoch Command Line Application", Safari GET http://localhost:8080

fatal error: Array index out of range in processedDataFromSource(:bytesProcessed:)
(lldb) bt
* thread #1: tid = 0x645362b, 0x000000010017f0e8 Epoch Command Line Application`function signature specialization <Arg[0] = Exploded, Arg[1] = Exploded, Arg[2] = Dead, Arg[3] = Dead> of Swift._fatalErrorMessage (Swift.StaticString, Swift.StaticString, Swift.StaticString, Swift.UInt) -> () + 40, queue = 'com.apple.main-thread', stop reason = EXC_BAD_INSTRUCTION (code=EXC_I386_INVOP, subcode=0x0)
    frame #0: 0x000000010017f0e8 Epoch Command Line Application`function signature specialization <Arg[0] = Exploded, Arg[1] = Exploded, Arg[2] = Dead, Arg[3] = Dead> of Swift._fatalErrorMessage (Swift.StaticString, Swift.StaticString, Swift.StaticString, Swift.UInt) -> () + 40
    frame #1: 0x0000000100037e9e Epoch Command Line Application`Swift.Array._checkIndex <A> (Swift.Array<A>)(Swift.Int) -> () + 126
    frame #2: 0x0000000100037dbc Epoch Command Line Application`Swift.Array.subscript.getter : (Swift.Range<Swift.Int>) -> Swift.ArraySlice<A> + 60
  * frame #3: 0x000000010025b3dc Epoch Command Line Application`Epoch_Command_Line_Application.processedDataFromSource (data=256 values, bytesProcessed=351) -> Swift.Array<Swift.Int8> + 124 at TCPClientSocket.swift:162
    frame #4: 0x000000010025ba1a Epoch Command Line Application`Epoch_Command_Line_Application.TCPClientSocket.receiveLowWaterMark (lowWaterMark=1, highWaterMark=256, deadline=-1, self=(socket = 0x0000000102001e00, closed = false), $error=ErrorType @ 0x0000000100d3f540)(Swift.Int, highWaterMark : Swift.Int, deadline : Swift.Int64) throws -> Swift.Array<Swift.Int8> + 1418 at TCPClientSocket.swift:108
    frame #5: 0x000000010025def4 Epoch Command Line Application`Epoch_Command_Line_Application.TCPClientSocket.receive (lowWaterMark=1, highWaterMark=256, received=(Epoch Command Line Application`partial apply forwarder for Epoch_Command_Line_Application.TCPStream.(receive (Epoch_Command_Line_Application.TCPStream) -> ((Epoch_Command_Line_Application.Result<Swift.Array<Swift.Int8>>) -> ()) -> ()).(closure #1) at TCPStream.swift), self=(socket = 0x0000000102001e00, closed = false), $error=ErrorType @ 0x0000000100d3f540)(lowWaterMark : Swift.Int, highWaterMark : Swift.Int, received : (Swift.Array<Swift.Int8>) -> ()) throws -> () + 116 at TCPClientSocket.swift:188
    frame #6: 0x0000000100247e23 Epoch Command Line Application`Epoch_Command_Line_Application.TCPStream.receive (completion=(Epoch Command Line Application`partial apply forwarder for Epoch_Command_Line_Application.HTTPParser.(parseRequest (Epoch_Command_Line_Application.HTTPParser) -> (Epoch_Command_Line_Application.StreamType, completion : (Epoch_Command_Line_Application.Result<Epoch_Command_Line_Application.HTTPRequest>) -> ()) -> ()).(closure #2) at HTTPParser.swift), self=0x0000000100900f20)((Epoch_Command_Line_Application.Result<Swift.Array<Swift.Int8>>) -> ()) -> () + 195 at TCPStream.swift:36
    frame #7: 0x0000000100248507 Epoch Command Line Application`protocol witness for Epoch_Command_Line_Application.StreamType.receive <A where A: Epoch_Command_Line_Application.StreamType> (A)((Epoch_Command_Line_Application.Result<Swift.Array<Swift.Int8>>) -> ()) -> () in conformance Epoch_Command_Line_Application.TCPStream : Epoch_Command_Line_Application.StreamType in Epoch_Command_Line_Application + 55 at TCPStream.swift:32
    frame #8: 0x000000010025f1e9 Epoch Command Line Application`Epoch_Command_Line_Application.HTTPParser.parseRequest (client=StreamType @ 0x0000000100d3f608, completion=(Epoch Command Line Application`partial apply forwarder for reabstraction thunk helper from @callee_owned (@in Epoch_Command_Line_Application.Result<Epoch_Command_Line_Application.HTTPRequest>) -> (@unowned ()) to @callee_owned (@owned Epoch_Command_Line_Application.Result<Epoch_Command_Line_Application.HTTPRequest>) -> (@unowned ()) at HTTPParser.swift))(Epoch_Command_Line_Application.StreamType, completion : (Epoch_Command_Line_Application.Result<Epoch_Command_Line_Application.HTTPRequest>) -> ()) -> () + 297 at HTTPParser.swift:42
    frame #9: 0x000000010025f3f4 Epoch Command Line Application`protocol witness for Epoch_Command_Line_Application.RequestParserType.parseRequest <A where A: Epoch_Command_Line_Application.RequestParserType> (A)(Epoch_Command_Line_Application.StreamType, completion : (Epoch_Command_Line_Application.Result<A.Request>) -> ()) -> () in conformance Epoch_Command_Line_Application.HTTPParser : Epoch_Command_Line_Application.RequestParserType in Epoch_Command_Line_Application + 116 at HTTPParser.swift:26
    frame #10: 0x000000010023544c Epoch Command Line Application`Epoch_Command_Line_Application.RequestResponseServer.(client=Epoch_Command_Line_Application.HTTPSerializer @ 0x0000000100d3f7c8, self=Epoch_Command_Line_Application.RequestResponseServer<Epoch_Command_Line_Application.HTTPParser, Epoch_Command_Line_Application.HTTPServerResponder, Epoch_Command_Line_Application.HTTPSerializer> @ 0x0000000100d3f7c0, failure=(Epoch Command Line Application`partial apply forwarder for static Epoch_Command_Line_Application.HTTPServer.(defaultFailureHandler in _EE9D680126FCC20B1A5BC8B98197EC35) <A where A: Epoch_Command_Line_Application.HTTPResponder, A.Request == Epoch_Command_Line_Application.HTTPRequest, A.Response == Epoch_Command_Line_Application.HTTPResponse> (Epoch_Command_Line_Application.HTTPServer<A>.Type)(Swift.ErrorType) -> () at HTTPServer.swift)) -> (failure : (Swift.ErrorType) -> ()) -> ()).(closure #1).(closure #1) + 796 at RequestResponseServer.swift:54
    frame #11: 0x0000000100233f9c Epoch Command Line Application`partial apply forwarder for Epoch_Command_Line_Application.RequestResponseServer.(start <A, B, C where A: Epoch_Command_Line_Application.RequestParserType, B: Epoch_Command_Line_Application.ResponderType, C: Epoch_Command_Line_Application.ResponseSerializerType, A.Request == B.Request, B.Response == C.Response> (Epoch_Command_Line_Application.RequestResponseServer<A, B, C>) -> (failure : (Swift.ErrorType) -> ()) -> ()).(closure #1).(closure #1) + 284 at RequestResponseServer.swift:0
    frame #12: 0x000000010023d1a1 Epoch Command Line Application`Epoch_Command_Line_Application.Result.success <A> (f=(Epoch Command Line Application`partial apply forwarder for Epoch_Command_Line_Application.RequestResponseServer.(start <A, B, C where A: Epoch_Command_Line_Application.RequestParserType, B: Epoch_Command_Line_Application.ResponderType, C: Epoch_Command_Line_Application.ResponseSerializerType, A.Request == B.Request, B.Response == C.Response> (Epoch_Command_Line_Application.RequestResponseServer<A, B, C>) -> (failure : (Swift.ErrorType) -> ()) -> ()).(closure #1).(closure #1) at RequestResponseServer.swift), self=Failure)((A) -> ()) -> () + 545 at Result.swift:39
    frame #13: 0x000000010023507f Epoch Command Line Application`Epoch_Command_Line_Application.RequestResponseServer.(acceptResult=Success, self=Epoch_Command_Line_Application.RequestResponseServer<Epoch_Command_Line_Application.HTTPParser, Epoch_Command_Line_Application.HTTPServerResponder, Epoch_Command_Line_Application.HTTPSerializer> @ 0x0000000100d3fac0, failure=(Epoch Command Line Application`partial apply forwarder for static Epoch_Command_Line_Application.HTTPServer.(defaultFailureHandler in _EE9D680126FCC20B1A5BC8B98197EC35) <A where A: Epoch_Command_Line_Application.HTTPResponder, A.Request == Epoch_Command_Line_Application.HTTPRequest, A.Response == Epoch_Command_Line_Application.HTTPResponse> (Epoch_Command_Line_Application.HTTPServer<A>.Type)(Swift.ErrorType) -> () at HTTPServer.swift)) -> (failure : (Swift.ErrorType) -> ()) -> ()).(closure #1) + 383 at RequestResponseServer.swift:55
    frame #14: 0x000000010023330c Epoch Command Line Application`partial apply forwarder for Epoch_Command_Line_Application.RequestResponseServer.(start <A, B, C where A: Epoch_Command_Line_Application.RequestParserType, B: Epoch_Command_Line_Application.ResponderType, C: Epoch_Command_Line_Application.ResponseSerializerType, A.Request == B.Request, B.Response == C.Response> (Epoch_Command_Line_Application.RequestResponseServer<A, B, C>) -> (failure : (Swift.ErrorType) -> ()) -> ()).(closure #1) + 284 at RequestResponseServer.swift:0
    frame #15: 0x000000010024f8aa Epoch Command Line Application`Epoch_Command_Line_Application.TCPServer.(socket=(socket = 0x0000000100900a00, closed = false), completion=(Epoch Command Line Application`partial apply forwarder for Epoch_Command_Line_Application.RequestResponseServer.(start <A, B, C where A: Epoch_Command_Line_Application.RequestParserType, B: Epoch_Command_Line_Application.ResponderType, C: Epoch_Command_Line_Application.ResponseSerializerType, A.Request == B.Request, B.Response == C.Response> (Epoch_Command_Line_Application.RequestResponseServer<A, B, C>) -> (failure : (Swift.ErrorType) -> ()) -> ()).(closure #1) at RequestResponseServer.swift), self=Epoch_Command_Line_Application.TCPServer @ 0x0000000100d3fd48) -> ((Epoch_Command_Line_Application.Result<Epoch_Command_Line_Application.StreamType>) -> ()) -> ()).(closure #1) + 362 at TCPServer.swift:42
    frame #16: 0x0000000100247791 Epoch Command Line Application`reabstraction thunk helper from @callee_owned () -> (@unowned ()) to @callee_owned (@in ()) -> (@out ()) + 17 at Select.swift:0
    frame #17: 0x00000001002591c1 Epoch Command Line Application`partial apply forwarder for reabstraction thunk helper from @callee_owned () -> (@unowned ()) to @callee_owned (@in ()) -> (@out ()) with unmangled suffix "5" + 81 at Co.swift:0
    frame #18: 0x00000001002599f0 Epoch Command Line Application`reabstraction thunk helper from @callee_owned (@in ()) -> (@out ()) to @callee_owned () -> (@unowned ()) + 32 at Co.swift:0
    frame #19: 0x0000000100259a27 Epoch Command Line Application`reabstraction thunk helper from @callee_owned () -> (@unowned ()) to @callee_unowned @convention(block) () -> (@unowned ()) + 39 at Co.swift:0
    frame #20: 0x000000010021a8b1 Epoch Command Line Application`co(routine=<parent is NULL>) + 145 at libmill_swift.c:34

thanks mate!


update to use jupyterlab instead of notebooks

for 2024, it would be better to use jupyterlab instead of jupyter-notebooks individually

Closed with #31


not scraping locations

{'date', 'location', 'points'}

Need to add them to the object st the same time or i add a location to the squish list

Location list = []
Index for the squish list is the same then it adds it to the object so many just a simple for statement


Opt out tool has two files with same name

The document links to an opt out tool at https://www.microsoft.com/en-us/download/details.aspx?id=40897 . But it lists two LsaPplConfig.efi files with the same name and different sizes.
How do we pick which file to use?

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 7b04bc4d-9435-cdbc-429f-2433ada7bd37
Version Independent ID: 5c902397-b2e7-4435-2b37-a57919434c9e
Content: Configuring Additional LSA Protection
Content Source: WindowsServerDocs/security/credentials-protection-and-management/configuring-additional-lsa-protection.md
Product: windows-server
Technology: security
GitHub Login: @JasonGerend
Microsoft Alias: jgerend

Hello @maweeras-msft,
Thank you for contacting Microsoft. We value your feedback.
You are correct that the Download Center has two files with the same name. We determined that the smaller file is for 32-bit systems, and the larger file is for 64-bit systems. We've made a documentation update to clarify this, which will be live after the next business day.
We'll now be closing this issue. Thank you again for your feedback, and have a most pleasant day.
#please-close


"helpers" feature not removing babelHelpers

Hey @milesj - following on from the discussion on https://github.com/milesj/packemon/issues/207

I've tried all the options for the features.helpers field and I'm still seeing the babelHelpers bundled inline.
I tested invalid values to make sure the config was picking this up, but it wouldn't start without one of the 4 valid options.

I noticed you mentioned in the previous issue:

But I can't seem to get the snapshots to reflect the helper changes, and I can't figure out why...

From looking at the snapshots in your PR to implement the helper option, I would expect Scenario 2 not to have the babel helpers above the example function because it's set to be external here? This is the same output I'm seeing when setting the config locally and build too:

After spending hours debugging this, I think I figured it out here: https://github.com/milesj/packemon/pull/220
The issue was I was passing the @babel/plugin-transform-runtime plugin to babel input instead of babel output.
Like... come on.

Ok can you try 3.2.2


Add Windows support to main

Very similar to #31, but now targeting main

[x] Bump to latest version
[x] Add Windows support
[x] Add myself as maintainer

Checklist

[x] Used a personal fork of the feedstock to propose changes
[ ] Bumped the build number (if the version is unchanged)
[x] Reset the build number to 0 (if the version changed)
[x] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[x] Ensured the license file is being packaged.

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

Ready for review


set -e added to 30-set-permissions.sh causes script failure when using mounted configmap configuration files.

About 5 months ago, a 'set -e' was added to 30-set-permissions.sh causes script failure when using mounted configmap configuration files. Not sure why this was changed; it causes problems for folks like us who run Puppet in kubernetes and manage configuration files in a configmap and mount to a pod.

Nevermind. I can just locate it to a new directory.


Deploy Pipelines and Datasets based on the folder created in Azure Data factory.

Is your feature request related to a problem? Please describe.
We have ability to create folders inside Azure Data Factory UI/UX., but we do not have the ability to filter by specific pipeline let alone folder through official methods.
Describe the solution you'd like
I want to be able to deploy only those Pipelines and Datasets that are inside a specific folders in ADF.
Describe alternatives you've considered
Only way I can achieve this by maintaining list of all pipelines and using your include method, but that is not feasible if folder contains many pipelines.
Additional context

I want to be able to deploy pipeline resources in folder named 77 and similarly we should be able to do this in Dataset

hey @anandmrya, thanks for bringing this idea.
TBH, I was thinking about that feature, but I'm surprised specifically this one is demanded the most.
I will take a look at this option this weekend.

This is done in v.0.7.0.
Take a look at the documentation (README) to check how to use it.


BrightcoveOs/Diamond Libvirtkvm Collector is Not working In KVM Hypervisor

Hi,
I am trying to collect the metrics of  each instance cpu,memory,etc using the LibvirtKvm collectors and trying to store the metrics in opentsdb server. Unfortunately other collectors which I have tried was working fine.
For eg : Kvm,cpu,vmstats,memory etc.
But the LibvirtKvm collector was not working and we have noticed the python error on log file which mentioned below:
[2016-01-20 11:01:13,018] [MainThread] Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/diamond/handler/Handler.py", line 74, in _process
self.process(metric)
File "/usr/lib/python2.6/site-packages/diamond/handler/tsdb.py", line 114, in process
Collector=metric.getCollectorPath(),
File "/usr/lib/python2.6/site-packages/diamond/metric.py", line 143, in getCollectorPath
offset = self.path.index(self.host)
ValueError: substring not found
Could you please share your tips to resolve the problem. Thanks for  reading my post using your valuable time.

This repo has moved to https://github.com/python-diamond/Diamond
Please open a new ticket there if this issue is not resolved with the current code there.
Thanks!


Add option to preserve scroll position between updates

@JedWatson this was useful for me so I thought I'd make it an option and contribute upstream. Note that the option is disabled by default so no implicit change for existing users. Also updated lib and added new option to README.

Neat, thanks @skidding!

Thanks, Jed. Any chance you can publish a new npm version? I don't mean to pressure, but the last version seems 7mo old.


handle_client_disconnect panics if an entity was manually despawned when a client disconnected

I accidentally triggered this by despawning an entity when handling a EventReader<DisconnectEvent> event on the server side (at the time, I didn't know lightyear already handled despawning).

You mean this system?
https://github.com/cBournhonesque/lightyear/blob/deec7e62fae81cbf328728a6a08d2cc17032cbd1/lightyear/src/server/clients.rs#L73-L73
I'm surprised that it panics, there doesn't seem to be any part of the code that can panic.
Do you have a stacktrace?

Its prob just that controlled entities contains an invalid entity ref since he despawned it beforehand. The system doesnt account for this and simply derefs it with .entity (not get_entity)

Yeah, apologies, I didn't have the stacktrace as I forgot to save it and then changed my code.
handle_client_disconnect calls commands.entity(*entity), which panics if an entity doesn't exist:
    pub fn entity(&mut self, entity: Entity) -> EntityCommands {
        #[inline(never)]
        #[cold]
        #[track_caller]
        fn panic_no_entity(entity: Entity) -> ! {
            panic!(
                "Attempting to create an EntityCommands for entity {entity:?}, which doesn't exist.",
            );
        }

        match self.get_entity(entity) {
            Some(entity) => entity,
            None => panic_no_entity(entity),
        }
    }

I hope this provides enough details, but if you still need a stacktrace, please let me know.

Thanks, I didn't realize that commands.entity() could panic.
I fixed this, but only in the cb/0.16 branch (which tracks bevy 0.14)


chore(script): Upgrade docker-compose-wait and refactor shebang to Bash

Changes Overview
PR brings two key updates to the script handling the taiko-client prover process:

Upgrade of docker-compose-wait: The script now uses version 2.12.1 of docker-compose-wait, replacing the previous version 2.9.0. This upgrade incorporates the latest features and bug fixes from the docker-compose-wait utility.

Switch to Bash Shebang: The script's shebang line has been updated from #!/bin/sh to #!/bin/bash. This change enhances script compatibility across different systems and ensures better handling of bash-specific features.

Rationale:

Ensures the latest utility features and fixes.
Improves script compatibility and reliability.

Don't see those changes are necessary.


XLA Conv Docstrings Fix

Related to #42513
Files changed:

xla.py

Changed the docstring to point to the correct XLA operator.

Yes. This PR should be closed. We should open a new one addressing new documentation on ConvGeneralDilated.


root_view no longer available in phoenix_live_view

as of https://github.com/phoenixframework/phoenix_live_view/commit/8bb6f44554f22bf580048e20562b62dd6b26e2b5 root_view is now private
==> appsignal_phoenix
Compiling 11 files (.ex)

== Compilation error in file lib/appsignal_phoenix/metadata.ex ==
** (CompileError) lib/appsignal_phoenix/metadata.ex:25: unknown key :root_view for struct Phoenix.LiveView.Socket
    lib/appsignal_phoenix/metadata.ex:25: (module)

Having the same issue after upgrading to Elixir 1.12.0

Hey @iwarshak,
Thanks for opening this issue. I’ve just released version 2.0.7, which includes a patch for this. Could you try that and let me know if that resolves the issue for you?

@jeffkreeftmeijer so far, so good. thanks!


Update configs in PCPA.yaml

The configs in PCPA.yaml such as learning rate, epochs are different from that in the paper, especially for JAAD_behave, JADD_all datasets. Could you please update the configs for reproducing the results easily ?

Please see issues #10 and #11


Change install instructions: Ubuntu/Debian users shouldn't install nodejs-legacy

I'm on Linux Mint 18 ("Sarah") (based on Ubuntu Xenial). I installed nodejs-legacy per the README instructions, through my usual package manager. When I run nodejs --version I see I'm on v4.2.6. We require node >= v6.3.1. We need to give people instructions for installing Node.js & npm that won't give them old versions of Node.

Yeah, we should just recommend using nvm (or really, script using it) as part of the installer.
There's some code in tools/install-node in zulip.git we may be able to reuse.
Almost nobody has a modern node/npm shipped with their distro.

I have just pointed to nvm repo to install nodejs. Is it good enough or we should write it in details like-
For the most recent LTS (the 6.x.x branch), use:
curl -sL https://deb.nodesource.com/setup_6.x.x | sudo -E bash -

The PPA will be added to your configuration and your local package cache will be updated automatically. After running the setup script from nodesource, you can install the Node.js package :
sudo apt-get install nodejs

I think we should update the installation instructions (or provide a script) that Just Works, so that installing is super easy for folks who want to test out the development version.
I'm not sold on the PPA approach, though, since users might be relying on a specific version of the system node, whereas with NVM, we can avoid disrupting users' existing setup.

Development guide has been updated. Merging this into #145.


Issues when more than one package exist for winget install (ambigous names)

-->
ambigous software packages won't install is -v is specified. Here PowerShell 7.x

Steps to reproduce
open Powershell 5.1/ 7.x or Terminal
winget install Powershell
Output: 2 possible products tagged as powershell the correct install name would be Microsoft.Powershell and ...Powershell-Preview
Specifying the full ID give same list
Specifying -v 7.0.2
still will not install PowerShell 7.0.2 via winget but throws 2 possible packages still

Expected behavior
issueing
winget install powershell -v 7.0.2 should install PowerShell
winget install Microsoft.Powershell -v 7.0.2 should install PowerShell
same with preview tags, ID and version

Actual behavior
just outputs 2 versions are available no selection, installation possible.

Environment
[winget --info]
Windows Package Manager version: v1.0.41331.0
Windows: 20161.1000 and earlier
Package: : 1.0.41331.0

I now understand that -v / --version is to fetch and display the version of the tool winget.
I'd rather would use this to specify a version for installation (or later uninstall)

What exactly is one supposed to do here?
PS C:\dev> winget install Microsoft.Powershell
Multiple apps found matching input criteria. Please refine the input.
Name               Id                           Version
---------------------------------------------------------------
PowerShell-Preview Microsoft.PowerShell-Preview 7.1.0-preview.3
PowerShell         Microsoft.PowerShell         7.0.2

I see no way to pare this down to anymore

@tommck are you asking me?

@tommck are you asking me?

No, was mostly ranting in support of you :)
Turns out you have to use -e, like:
PS C:\dev> winget install -e Microsoft.Powershell

-e is not even documented

https://docs.microsoft.com/en-us/windows/package-manager/winget/

as said -v is more logical to pick a version and -v is a duplicate of --info.
for --info there is no -i command
Team, you're going the same path as for Terminal lads remote related design question / issue
https://github.com/microsoft/terminal/issues/4632#issuecomment-618462070

@Karl-WE You seem to be new to command line programs. winget supports a number of subcommands (install, show, search, etc.). If you pass the -? to one of those you'll see the additional options for those subcommands. You would've also seen that had you checked the online documentation.
To install a version other than latest you use:
# winget install --exact <id> --version <version number>

winget install Microsoft.dotnet --version 3.1.301 --exact
Found .NET Core [Microsoft.dotnet]
This application is licensed to you by its owner.
Microsoft is not responsible for, nor does it grant any licenses to, third-party packages.
Downloading https://download.visualstudio.microsoft.com/download/pr/4e88f517-196e-4b17-a40c-2692c689661d/eed3f5fca28262f764d8b650585a7278/dotnet-sdk-3.1.301-win-x64.exe
  ██████████████████████████████   124 MB /  124 MB
Successfully verified installer hash
Installing ...
Successfully installed!

@denelon This is a duplicate of #292

@megamorf I am not new to this megamorf.
winget --version will output the version of the tool

Given the logic that you can enter -? at any level reminds me much of Cisco IOS and speaking for Windows

fsutil
netsh
dism

but it is not overly very common in Windows to have the ability to specify /? any time with the previous level of commands. Some have it some have not.
Thanks for giving me the idea winget would favour this. Powershell does not offer a context sensitive help, quite unfortunately.
Before this dupe is entirely wasted time, please let us have a PR to make the winget ? more pointing out to this.
Still I see a inconsistency with the commandline options, we might discuss this in a new bug / feature request:
example
winget ? = help
winget install ? or winget install /?
"no matching criteria"
winget install --? works
Mind we are still on Windows, and -- commandlines are not common here. We need a consistenty with command lines everything should to work /? or ? see also, I refrain: microsoft/terminal#4632 (comment) otherwise it is a linux user friendly command line tool, but not Windows user friendly.

@Karl-WE the issue as posted looks like a duplicate of #292 as @megamorf commented. I think the issue as you've elaborated now looks more like a new request to either make aliases for other forms of "?" or to provide hints when one is used. I don't believe we have an Issue for that feature.

Duplicate of #292


defs-zos: [Fix] prevent schema parsers from hitting recursion-loop while resolving types.

Hi Team,
Following PR makes sure that des-zos.json is consistent with schema definition w.r.t to entire spec.
I think following PR ( https://github.com/opencontainers/runtime-spec/pull/1095 )  has introduced type-resolution issues on downstream parsers.
Specifying definition-files for types present in existing .json would result in infinite type resolution loop. However existing convention is just using # instead of specifying def-file for example  https://github.com/opencontainers/runtime-spec/blob/master/schema/defs-linux.json
Thanks

@najohnsn could you please take a look?

Hi @najohnsn Were you able to take a look at this.

Sorry, I was on vacation. This looks good to me. Not sure why a relative reference wasn't used before.
@SteeleDesmond, you should take a look too.

This seems like it's doing the opposite of what https://github.com/opencontainers/runtime-spec/blob/82ab996a5bf91804a440391bff43140b17bbadd4/schema/config-linux.json does? (lots of "$ref": "defs-linux.json#/... in there)

@tianon, yes, config-linux.json has references to defs-linux.json. But defs-linux.json has the relative reference that is being proposed here for defs-zos.json.

:facepalm: doh, thanks for clarifying :+1:


start to document

I decided to improove freneet doc. I am a bit confused. I am showing where.

Open a PR with documentation but when there is something more tangible, closing  due to being stale.


New auto index creation only works in IN_MEMORY_TRANSACTIONAL

Memgraph version
2.16.0
Environment
Docker
Describe the bug
The new auto indexing options only seem to work in IN_MEMORY_TRANSACTIONAL. This is not mentioned in the docs, at least as far as I can see.
To Reproduce
Start Memgraph with --storage-automatic-edge-type-index-creation-enabled=true and --storage-automatic-label-index-creation-enabled=true.
Set the storage mode to IN_MEMORY_ANALYTICAL.
Create a node with a label.
No index is created.
Expected behavior
Either documentation should specify that this scenario doesn't work, or it should work.
Logs
Additional context
Verification Environment

Hi @gcleaves, I have transferred this issue from the Memgraph repo to the docs repo since it is mostly docs related.
cc @kgolubic looks like we have some missing content around automatic index creation.


Add configurable timeout to config file

Default to previous 10 sec default

Coverage increased (+0.02%) to 98.025% when pulling c0368dfd50abc3fd5e8add2cdb1089e8d69577af on add_timeout_lachesis into bc58bed3acf088b9c273687d75848d0dfe9b2251 on master.

Coverage increased (+0.02%) to 98.025% when pulling c0368dfd50abc3fd5e8add2cdb1089e8d69577af on add_timeout_lachesis into bc58bed3acf088b9c273687d75848d0dfe9b2251 on master.

@lachesis can you try running on this branch after setting the timeout higher and seeing if it works for you?

Coverage increased (+0.02%) to 98.025% when pulling 88b14b1dff39dbcc4e5a65beba54a2fc81f40697 on add_timeout_lachesis into bc58bed3acf088b9c273687d75848d0dfe9b2251 on master.

It seems to have worked for me on my second try (with a timeout of 15 minutes :P). I tried 90 seconds but I got distracted and when I came back it had this stack trace:
/usr/lib/ruby/2.4.0/net/protocol.rb:176:in `rbuf_fill': Net::ReadTimeout (Faraday::TimeoutError)
	from /usr/lib/ruby/2.4.0/net/protocol.rb:154:in `readuntil'
	from /usr/lib/ruby/2.4.0/net/protocol.rb:164:in `readline'
	from /usr/lib/ruby/2.4.0/net/http/response.rb:40:in `read_status_line'
	from /usr/lib/ruby/2.4.0/net/http/response.rb:29:in `read_new'
	from /usr/lib/ruby/2.4.0/net/http.rb:1446:in `block in transport_request'
	from /usr/lib/ruby/2.4.0/net/http.rb:1443:in `catch'
	from /usr/lib/ruby/2.4.0/net/http.rb:1443:in `transport_request'
	from /usr/lib/ruby/2.4.0/net/http.rb:1416:in `request'
	from /usr/lib/ruby/2.4.0/net/http.rb:1409:in `block in request'
	from /usr/lib/ruby/2.4.0/net/http.rb:877:in `start'
	from /usr/lib/ruby/2.4.0/net/http.rb:1407:in `request'
	from /usr/lib/ruby/2.4.0/net/http.rb:1165:in `get'
	from /home/eswanson/.gem/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/adapter/net_http.rb:80:in `perform_request'
	from /home/eswanson/.gem/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/adapter/net_http.rb:40:in `block in call'
	from /home/eswanson/.gem/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/adapter/net_http.rb:87:in `with_net_http_connection'
	from /home/eswanson/.gem/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/adapter/net_http.rb:32:in `call'
	from /home/eswanson/.gem/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/rack_builder.rb:139:in `build_response'
	from /home/eswanson/.gem/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/connection.rb:377:in `run_request'
	from /home/eswanson/.gem/ruby/2.3.0/gems/faraday-0.9.2/lib/faraday/connection.rb:140:in `get'
	from /home/eswanson/.gem/ruby/2.3.0/gems/barge-0.12.0/lib/barge/resource/base.rb:22:in `public_send'
	from /home/eswanson/.gem/ruby/2.3.0/gems/barge-0.12.0/lib/barge/resource/base.rb:22:in `request'
	from /home/eswanson/.gem/ruby/2.3.0/gems/barge-0.12.0/lib/barge/resource/base.rb:16:in `block (2 levels) in <module:Base>'
	from /home/eswanson/.gem/ruby/2.3.0/gems/barge-0.12.0/lib/barge/resource/droplet.rb:11:in `all'
	from /home/eswanson/.gem/ruby/2.4.0/gems/tugboat-3.1.0/lib/tugboat/middleware/base.rb:92:in `block (2 levels) in get_droplet_list'
	from /home/eswanson/.gem/ruby/2.4.0/gems/activesupport-4.2.9/lib/active_support/core_ext/range/each.rb:7:in `each'
	from /home/eswanson/.gem/ruby/2.4.0/gems/activesupport-4.2.9/lib/active_support/core_ext/range/each.rb:7:in `each_with_time_with_zone'
	from /home/eswanson/.gem/ruby/2.4.0/gems/tugboat-3.1.0/lib/tugboat/middleware/base.rb:91:in `block in get_droplet_list'
	from /home/eswanson/.gem/ruby/2.4.0/gems/tugboat-3.1.0/lib/tugboat/middleware/list_droplets.rb:13:in `each'
	from /home/eswanson/.gem/ruby/2.4.0/gems/tugboat-3.1.0/lib/tugboat/middleware/list_droplets.rb:13:in `each'
	from /home/eswanson/.gem/ruby/2.4.0/gems/tugboat-3.1.0/lib/tugboat/middleware/list_droplets.rb:13:in `call'
	from /home/eswanson/.gem/ruby/2.4.0/gems/tugboat-3.1.0/lib/tugboat/middleware/inject_client.rb:29:in `call'
	from /home/eswanson/.gem/ruby/2.4.0/gems/tugboat-3.1.0/lib/tugboat/middleware/check_configuration.rb:17:in `call'
	from /home/eswanson/.gem/ruby/2.4.0/gems/tugboat-3.1.0/lib/tugboat/middleware/inject_configuration.rb:10:in `call'
	from /home/eswanson/.gem/ruby/2.4.0/gems/ibsciss-middleware-0.4.2/lib/middleware/runner.rb:31:in `call'
	from /home/eswanson/.gem/ruby/2.4.0/gems/ibsciss-middleware-0.4.2/lib/middleware/builder.rb:133:in `call'
	from /home/eswanson/.gem/ruby/2.4.0/gems/tugboat-3.1.0/lib/tugboat/cli.rb:71:in `droplets'
	from /home/eswanson/.gem/ruby/2.3.0/gems/thor-0.18.1/lib/thor/command.rb:27:in `run'
	from /home/eswanson/.gem/ruby/2.3.0/gems/thor-0.18.1/lib/thor/invocation.rb:120:in `invoke_command'
	from /home/eswanson/.gem/ruby/2.3.0/gems/thor-0.18.1/lib/thor.rb:363:in `dispatch'
	from /home/eswanson/.gem/ruby/2.3.0/gems/thor-0.18.1/lib/thor/base.rb:439:in `start'
	from /home/eswanson/.gem/ruby/2.4.0/gems/tugboat-3.1.0/bin/tugboat:10:in `<top (required)>'
	from /home/eswanson/.gem/ruby/2.1.0/bin/tugboat:23:in `load'
	from /home/eswanson/.gem/ruby/2.1.0/bin/tugboat:23:in `<main>'

Since I didn't see how long it took to fail like that, I'm not 100% sure that the 15 minute timeout is what made it work and not just caching on DigitalOcean's side. Even with the 10 second timeout, I could get it to load after a few retries.
Here is what I added to my config file:
connection:
  timeout: 900

Coverage increased (+0.02%) to 98.025% when pulling a3cac233f282d4f2253b0f733ab60fe475d18444 on add_timeout_lachesis into bc58bed3acf088b9c273687d75848d0dfe9b2251 on master.

Coverage increased (+0.02%) to 98.025% when pulling 45eef9a3653dd0fee493c8a5f08e3c9bb8bfa4db on add_timeout_lachesis into bc58bed3acf088b9c273687d75848d0dfe9b2251 on master.

Coverage increased (+0.02%) to 98.025% when pulling 45eef9a3653dd0fee493c8a5f08e3c9bb8bfa4db on add_timeout_lachesis into bc58bed3acf088b9c273687d75848d0dfe9b2251 on master.

Coverage increased (+0.02%) to 98.025% when pulling 45eef9a3653dd0fee493c8a5f08e3c9bb8bfa4db on add_timeout_lachesis into bc58bed3acf088b9c273687d75848d0dfe9b2251 on master.

Coverage increased (+0.02%) to 98.025% when pulling 45eef9a3653dd0fee493c8a5f08e3c9bb8bfa4db on add_timeout_lachesis into bc58bed3acf088b9c273687d75848d0dfe9b2251 on master.

I'm going to merge this anyways, as it's a nice change to have, but I've got an idea to fix your issue.


how to control timeout?

I want to get result in 3s, if error, I will give other page.

Hey @pisces22745 thanks for the issue.
If you use the AbortController you can abort the fetch after a certain time has passed using the AbortController#abort():
const controller = new AbortController();
const signal = controller.signal;

const fetchPromise = fetch(url, {signal});

// 5 second timeout:
const timeoutId = setTimeout(() => controller.abort(), 5000);

I'll close this - as it should solve your question, and it isn't a bug within this repository. If you find any bugs please feel free to raise more issues!

FWIW, I've opened an issue https://github.com/whatwg/fetch/issues/951 with a proposal for a timeout option that solves 90% of use cases, in case anyone's interested. I think it's super important to add to make sure calls to fetch (or res.json()) don't hang indefinitely.


Revise and update github actions

For instance, smalltalkCI should be soon updated to 1.1.0

codecov/codecov-action updated from v1 to v1.5
actions/checkout updated from v2 to v2.3.4
Updating hpi-swa/setup-smalltalkCI from v1 to 1.1.0 breaks, so I reverted it.


Not able to connect to selenium chrome standalone container.

What are you trying to achieve?
I am trying to follow the documentation regarding docker composer.
I use the following docker-compose.yml
version: '3'
services:
  codeceptjs:
    image: codeception/codeceptjs
    depends_on:
      - chrome
    volumes:
      - .:/tests
  chrome:
    image: selenium/standalone-chrome:3.8.1-bohrium
    ports:
      - '4444'
      - '5900'

and I run docker-compose up.
What do you get instead?
Recreating chrome_1 ...
Recreating chrome_1 ... done
Recreating codeceptjs_1 ...
Recreating codeceptjs_1 ... done
Attaching to chrome_1, codeceptjs_1
codeceptjs_1  | CodeceptJS directory has been found.
chrome_1      | 19:59:13.809 INFO - Selenium build info: version: '3.8.1', revision: '6e95a6684b'
chrome_1      | 19:59:13.814 INFO - Launching a standalone Selenium Server
chrome_1      | 2017-12-23 19:59:14.163:INFO::main: Logging initialized @1356ms to org.seleniumhq.jetty9.util.log.StdErrLog
chrome_1      | 19:59:14.327 INFO - Using `new FirefoxOptions()` is preferred to `DesiredCapabilities.firefox()`
chrome_1      | 19:59:14.372 INFO - Using `new ChromeOptions()` is preferred to `DesiredCapabilities.chrome()`
chrome_1      | 19:59:14.383 INFO - Using `new EdgeOptions()` is preferred to `DesiredCapabilities.edge()`
chrome_1      | 19:59:14.386 INFO - Driver class not found: com.opera.core.systems.OperaDriver
chrome_1      | 19:59:14.386 INFO - Using `new OperaOptions()` is preferred to `DesiredCapabilities.operaBlink()`
chrome_1      | 19:59:14.392 INFO - Using `new SafariOptions()` is preferred to `DesiredCapabilities.safari()`
chrome_1      | 19:59:14.395 INFO - Driver class not found: org.openqa.selenium.phantomjs.PhantomJSDriver
chrome_1      | 19:59:14.514 INFO - Driver provider class org.openqa.selenium.ie.InternetExplorerDriver registration is skipped:
chrome_1      |  registration capabilities Capabilities {browserName: internet explorer, ensureCleanSession: true, platform: WINDOWS, version: } does not match the current platform LINUX
chrome_1      | 19:59:14.515 INFO - Driver provider class org.openqa.selenium.edge.EdgeDriver registration is skipped:
chrome_1      |  registration capabilities Capabilities {browserName: MicrosoftEdge, platform: WINDOWS, version: } does not match the current platform LINUX
chrome_1      | 19:59:14.516 INFO - Driver provider class org.openqa.selenium.safari.SafariDriver registration is skipped:
chrome_1      |  registration capabilities Capabilities {browserName: safari, platform: MAC, version: } does not match the current platform LINUX
chrome_1      | 19:59:14.681 INFO - Using `new ChromeOptions()` is preferred to `DesiredCapabilities.chrome()`
chrome_1      | 19:59:14.683 INFO - Using `new EdgeOptions()` is preferred to `DesiredCapabilities.edge()`
chrome_1      | 19:59:14.683 INFO - Using `new FirefoxOptions()` is preferred to `DesiredCapabilities.firefox()`
chrome_1      | 19:59:14.686 INFO - Using `new OperaOptions()` is preferred to `DesiredCapabilities.operaBlink()`
chrome_1      | 19:59:14.686 INFO - Using `new SafariOptions()` is preferred to `DesiredCapabilities.safari()`
chrome_1      | 19:59:14.711 INFO - Using the passthrough mode handler
chrome_1      | 2017-12-23 19:59:14.880:INFO:osjs.Server:main: jetty-9.4.7.v20170914
chrome_1      | 2017-12-23 19:59:14.983:WARN:osjs.SecurityHandler:main: ServletContext@o.s.j.s.ServletContextHandler@7cbd213e{/,null,STARTING} has uncovered http methods for path: /
chrome_1      | 2017-12-23 19:59:14.998:INFO:osjsh.ContextHandler:main: Started o.s.j.s.ServletContextHandler@7cbd213e{/,null,AVAILABLE}
chrome_1      | 2017-12-23 19:59:15.087:INFO:osjs.AbstractConnector:main: Started ServerConnector@509f3a27{HTTP/1.1,[http/1.1]}{<IP_ADDRESS>:4444}
chrome_1      | 2017-12-23 19:59:15.089:INFO:osjs.Server:main: Started @2282ms
chrome_1      | 19:59:15.089 INFO - Selenium Server is up and running
codeceptjs_1  | CodeceptJS v1.1.1
codeceptjs_1  | Using test root "/tests"
codeceptjs_1  |
codeceptjs_1  | Creation of investor's account. Some Validations --
 ✖ "before all" hook: codeceptjs.beforeSuite in 37ms
codeceptjs_1  | Error: connect ECONNREFUSED <IP_ADDRESS>:4444
codeceptjs_1  | Creation of investor's account --
 ✖ "before all" hook: codeceptjs.beforeSuite in 10ms
codeceptjs_1  | Error: connect ECONNREFUSED <IP_ADDRESS>:4444
codeceptjs_1  |
codeceptjs_1  | -- FAILURES:
codeceptjs_1  |
codeceptjs_1  |   1) Creation of investor's account. Some Validations
codeceptjs_1  |        "before all" hook: codeceptjs.beforeSuite:
codeceptjs_1  |      connect ECONNREFUSED <IP_ADDRESS>:4444
codeceptjs_1  |
codeceptjs_1  |   Run with --verbose flag to see NodeJS stacktrace
codeceptjs_1  |
codeceptjs_1  |   2) Creation of investor's account
codeceptjs_1  |        "before all" hook: codeceptjs.beforeSuite:
codeceptjs_1  |      connect ECONNREFUSED <IP_ADDRESS>:4444
codeceptjs_1  |
codeceptjs_1  |   Run with --verbose flag to see NodeJS stacktrace
codeceptjs_1  |
codeceptjs_1  |
codeceptjs_1  |   FAIL  | 0 passed, 2 failed   // 77ms
codeceptjs_1 exited with code 1

Details

Operating System: MAC OSX
WebDriverIO
Configuration file:

  "tests": "./*_test.js",
  "timeout": 50000,
  "output": "./output",
  "helpers": {
     "WebDriverIO" : {
       "smartWait": 5000,
       "browser": "chrome",
       "desiredCapabilities": {
         "chromeOptions": {
           "args": [ "--incognito"]
         }
       },
       "url":"https://www.as.com",
       "restart": false,
       "windowSize": "maximize",
       "timeouts": {
         "script": 60000,
         "page load": 10000
       }
     }
   },
  "include": {
    "I": "./steps_file.js",
    "SignupPage":"./pages/signup.page.js",
    "Onboarding":"./pages/onboarding.page.js",
    "Dashboard":"./pages/dashboard.page.js",
    "Financials":"./pages/financials.page.js"
  },
  "bootstrap": false,
  "mocha": {
    "reporterOptions": {
        "mochaFile": "output/result.xml"
    }
  },
  "name": "exercise"
}

My first thought was that it tries to connect to the selenium server before it is ready, I added a command to the compose with wget with retries and after 4 mins it is still not able to connect.
I am not sure if it is a bug, but I haven't been able to execute the tests and I ran out of ideas.
Thanks.

Yes, this requires additional configuration. In case of Docker you need to connect to host other than <IP_ADDRESS>. Please try to add host config option to WebDriverIO and set it to "codeceptjs" (as the name of your service in your container)
     "WebDriverIO" : {
       "smartWait": 5000,
       "browser": "chrome",
       "host": "codeceptjs",

@DavertMik thanks for the hint.
I did what you suggested. Added the "host": "codeceptjs", line in my codecept.json.
But the result is almost identical:
docker-compose up
Starting chrome_1 ...
Starting chrome_1 ... done
Starting codeceptjs_1 ...
Starting codeceptjs_1 ... done
Attaching to chrome_1, codeceptjs_1
chrome_1      | 23:30:32.245 INFO - Selenium build info: version: '3.8.1', revision: '6e95a6684b'
chrome_1      | 23:30:32.248 INFO - Launching a standalone Selenium Server
codeceptjs_1  | CodeceptJS directory has been found.
chrome_1      | 2017-12-23 23:30:32.500:INFO::main: Logging initialized @775ms to org.seleniumhq.jetty9.util.log.StdErrLog
chrome_1      | 23:30:32.621 INFO - Using `new FirefoxOptions()` is preferred to `DesiredCapabilities.firefox()`
chrome_1      | 23:30:32.693 INFO - Using `new ChromeOptions()` is preferred to `DesiredCapabilities.chrome()`
chrome_1      | 23:30:32.703 INFO - Using `new EdgeOptions()` is preferred to `DesiredCapabilities.edge()`
chrome_1      | 23:30:32.705 INFO - Driver class not found: com.opera.core.systems.OperaDriver
chrome_1      | 23:30:32.706 INFO - Using `new OperaOptions()` is preferred to `DesiredCapabilities.operaBlink()`
chrome_1      | 23:30:32.708 INFO - Using `new SafariOptions()` is preferred to `DesiredCapabilities.safari()`
chrome_1      | 23:30:32.716 INFO - Driver class not found: org.openqa.selenium.phantomjs.PhantomJSDriver
chrome_1      | 23:30:32.814 INFO - Driver provider class org.openqa.selenium.ie.InternetExplorerDriver registration is skipped:
chrome_1      |  registration capabilities Capabilities {browserName: internet explorer, ensureCleanSession: true, platform: WINDOWS, version: } does not match the current platform LINUX
chrome_1      | 23:30:32.816 INFO - Driver provider class org.openqa.selenium.edge.EdgeDriver registration is skipped:
chrome_1      |  registration capabilities Capabilities {browserName: MicrosoftEdge, platform: WINDOWS, version: } does not match the current platform LINUX
chrome_1      | 23:30:32.817 INFO - Driver provider class org.openqa.selenium.safari.SafariDriver registration is skipped:
chrome_1      |  registration capabilities Capabilities {browserName: safari, platform: MAC, version: } does not match the current platform LINUX
chrome_1      | 23:30:32.942 INFO - Using `new ChromeOptions()` is preferred to `DesiredCapabilities.chrome()`
chrome_1      | 23:30:32.948 INFO - Using `new EdgeOptions()` is preferred to `DesiredCapabilities.edge()`
chrome_1      | 23:30:32.949 INFO - Using `new FirefoxOptions()` is preferred to `DesiredCapabilities.firefox()`
chrome_1      | 23:30:32.953 INFO - Using `new OperaOptions()` is preferred to `DesiredCapabilities.operaBlink()`
chrome_1      | 23:30:32.953 INFO - Using `new SafariOptions()` is preferred to `DesiredCapabilities.safari()`
chrome_1      | 23:30:32.969 INFO - Using the passthrough mode handler
chrome_1      | 2017-12-23 23:30:33.063:INFO:osjs.Server:main: jetty-9.4.7.v20170914
chrome_1      | 2017-12-23 23:30:33.176:WARN:osjs.SecurityHandler:main: ServletContext@o.s.j.s.ServletContextHandler@7cbd213e{/,null,STARTING} has uncovered http methods for path: /
chrome_1      | 2017-12-23 23:30:33.190:INFO:osjsh.ContextHandler:main: Started o.s.j.s.ServletContextHandler@7cbd213e{/,null,AVAILABLE}
chrome_1      | 2017-12-23 23:30:33.253:INFO:osjs.AbstractConnector:main: Started ServerConnector@509f3a27{HTTP/1.1,[http/1.1]}{<IP_ADDRESS>:4444}
chrome_1      | 2017-12-23 23:30:33.254:INFO:osjs.Server:main: Started @1528ms
chrome_1      | 23:30:33.254 INFO - Selenium Server is up and running
codeceptjs_1  | CodeceptJS v1.1.1
codeceptjs_1  | Using test root "/tests"
codeceptjs_1  |
codeceptjs_1  | Creation of investor's account. Some Validations --
 ✖ "before all" hook: codeceptjs.beforeSuite in 41ms
codeceptjs_1  | Error: connect ECONNREFUSED <IP_ADDRESS>:4444
codeceptjs_1  | Creation of investor's account --
 ✖ "before all" hook: codeceptjs.beforeSuite in 8ms
codeceptjs_1  | Error: connect ECONNREFUSED <IP_ADDRESS>:4444
codeceptjs_1  |
codeceptjs_1  | -- FAILURES:
codeceptjs_1  |
codeceptjs_1  |   1) Creation of investor's account. Some Validations
codeceptjs_1  |        "before all" hook: codeceptjs.beforeSuite:
codeceptjs_1  |      connect ECONNREFUSED <IP_ADDRESS>:4444
codeceptjs_1  |
codeceptjs_1  |   Run with --verbose flag to see NodeJS stacktrace
codeceptjs_1  |
codeceptjs_1  |   2) Creation of investor's account
codeceptjs_1  |        "before all" hook: codeceptjs.beforeSuite:
codeceptjs_1  |      connect ECONNREFUSED <IP_ADDRESS>:4444
codeceptjs_1  |
codeceptjs_1  |   Run with --verbose flag to see NodeJS stacktrace
codeceptjs_1  |
codeceptjs_1  |
codeceptjs_1  |   FAIL  | 0 passed, 2 failed   // 92ms
codeceptjs_1 exited with code 1

nevermind : the host that i had to use was:
"host":"chrome"

and everything worked as expected. Thanks @DavertMik for the hints.

Yes, sure "chrome". Sorry, I was too tired so I suggested the wrong container :)
Yes, this should be added to documentation...

I'm just adding this so that anyone searching also has another example:
https://stackoverflow.com/questions/47561478/codeception-in-docker-compose-cant-connect-to-webdriver

Hi. I would like to ask if you can help me to debug these errors.
My First Test --
test something
× "before each" hook: codeceptjs.before for "test something" in 7020ms
Error: Can't connect to WebDriver.
Error: Cannot define class using reflection
Please make sure Selenium Server (ChromeDriver or PhantomJS) is running and accessible
-- FAILURES:

My First Test
"before each" hook: codeceptjs.before for "test something":
Can't connect to WebDriver.
Error: Cannot define class using reflection

Please make sure Selenium Server (ChromeDriver or PhantomJS) is running and accessible
Run with --verbose flag to see NodeJS stacktrace
FAIL  | 0 passed, 1 failed   // 7s
I'm new here and new to codeceptjs as well. Please bear with me.

I meet this issue, too!
See my terminal log:
DEPRECATION WARNING WebDriverIO helper is deprecated
DEPRECATION WARNING WebDriverIO was based on webdriverio package v4 which is outdated now
DEPRECATION WARNING Upgrade to "webdriverio@5" and switch to WebDriver helper
CodeceptJS v2.0.7
Using test root "/home/developer/gavin/sc-e2e-test"
Helpers: WebDriverIO, Login, Register, Locator, ShadowDom, MysqlDBManage, TxClient, TxWeb, VirtualMachine, Message, Benchmark, SequelizeDBManage, ConnectSequelize, ConnectDB, ConfigSchema, SystemMsgSchema, DeviceSchema, ClientExceptionSchema, InvitationSchema, InvoicesSchema, InvoiceStatesSchema, InvoiceInfosSchema, NetInfoSchema, OrderItemsSchema, OrderQuantitiesSchema, OrderStatesSchema, OrdersSchema, OrgsSchema, PaymentsSchema, PreAccountsSchema, ProductLimitModesSchema, ProductLimitsSchema, ProductsSchema, SummariesSchema, TerminalSchema, TrialCardsSchema, UsersSchema, CloudtrustActiveSchema, AccountSchema, CloudtrustAccountSchema, Ln2Locator, Ln2MysqlDBManage, registerTimeSchema, blockSiteExceptionSchema, ToolCommendSchema, ToolSchema, ToolUsageRecordSchema, SequelizeMongoDBManage, TxApi
Plugins: screenshotOnFail, allure

dashboard --
 › [Session] Starting singleton browser session
  ✖ "before all" hook: codeceptjs.beforeSuite in 1569ms
(node:10535) UnhandledPromiseRejectionWarning: Error: socket hang up
(node:10535) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 1)
(node:10535) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.
  ✖ "after all" hook: codeceptjs.afterSuite in 1ms
(node:10535) PromiseRejectionHandledWarning: Promise rejection was handled asynchronously (rejection id: 1)
(node:10535) UnhandledPromiseRejectionWarning: Error: socket hang up
(node:10535) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 2)

-- FAILURES:

  1) dashboard
       "before all" hook: codeceptjs.beforeSuite:
     Can't connect to WebDriver.
Error: socket hang up

Please make sure Selenium Server (ChromeDriver or PhantomJS) is running and accessible
  Error: socket hang up

  Run with --verbose flag to see NodeJS stacktrace

  Run with --verbose flag to see NodeJS stacktrace

  2) dashboard
       "after all" hook: codeceptjs.afterSuite:
     Can't connect to WebDriver.
Error: socket hang up

Please make sure Selenium Server (ChromeDriver or PhantomJS) is running and accessible
  Error: socket hang up

  Run with --verbose flag to see NodeJS stacktrace

  Run with --verbose flag to see NodeJS stacktrace

  FAIL  | 0 passed, 2 failed   // 2s
(node:10535) PromiseRejectionHandledWarning: Promise rejection was handled asynchronously (rejection id: 2)
(node:10535) UnhandledPromiseRejectionWarning: Error: socket hang up

Run with --verbose flag to see NodeJS stacktrace

Run with --verbose flag to see NodeJS stacktrace
(node:10535) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 3)

:cry:
But when i restart my computer, the issue just disappear and everything is ok again!
I think maybe my computer's cpu or memory or something is not enough.
See my top log:
top - 15:27:32 up 1 day,  4:17,  1 user,  load average: 0.90, 0.91, 1.02
Tasks: 309 total,   1 running, 293 sleeping,  15 stopped,   0 zombie
%Cpu(s): 11.5 us,  3.4 sy,  0.0 ni, 76.8 id,  8.2 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem : 16291756 total,   860768 free,  9124004 used,  6306984 buff/cache
KiB Swap: 16635900 total, 16136940 free,   498960 used.  5185672 avail Mem

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
11250 develop+  20   0<PHONE_NUMBER>16  88700 S  11.6  1.2   1:14.93 chrome
 2987 develop+  20   0 1746692 281484  52928 S   6.3  1.7  54:58.80 compiz
 1063 root      20   0<PHONE_NUMBER>92 212632 S   4.6  1.6  51:31.48 Xorg
 7105 develop+  20   0<PHONE_NUMBER>16 105848 S   2.6  1.3   0:35.85 chrome
 5063 develop+  20   0  712384  38592  22888 S   2.0  0.2   0:52.01 gnome-terminal-
 6810 develop+  20   0 1633644<PHONE_NUMBER>24 S   1.7  2.0  53:50.57 chrome
 6852 develop+  20   0<PHONE_NUMBER>28 271076 S   1.3  2.2 156:33.78 chrome
 3248 develop+  20   0 1474772  69348  44868 S   0.7  0.4   1:14.91 nautilus
 9506 develop+  20   0 1606276<PHONE_NUMBER>36 S   0.7  1.4   0:08.00 atom
  896 root      20   0    4396    768    700 S   0.3  0.0   0:47.81 acpid
 1052 root      20   0  611624   7788   6332 S   0.3  0.0   9:31.23 ECAgent
 1704 develop+  20   0   44636   4720   2740 S   0.3  0.0   1:10.40 dbus-daemon
 1779 root      20   0  633972  62036  37352 S   0.3  0.4   2:34.77 dockerd
 1874 root      20   0  530952  39132  20948 S   0.3  0.2   2:43.71 docker-containe
 2954 develop+   9 -11  576516  10880   8580 S   0.3  0.1   1:42.72 pulseaudio
 2961 develop+  20   0  972732   8720   7760 S   0.3  0.1   0:30.58 indicator-datet
 3267 develop+  20   0  803688  83488  27704 S   0.3  0.5   1:19.20 docky
 9554 develop+  20   0 1402012<PHONE_NUMBER>32 S   0.3  1.5   0:11.82 atom
12161 root      20   0       0      0      0 S   0.3  0.0   0:00.07 kworker/u4:0
14150 develop+  20   0  504708  62364  38360 S   0.3  0.4   1:54.98 Discord
25594 develop+  20   0 3913888 2.227g 2.174g S   0.3 14.3  20:15.96 VirtualBox
    1 root      20   0  185856   6088   3700 S   0.0  0.0   0:25.68 systemd
    2 root      20   0       0      0      0 S   0.0  0.0   0:00.02 kthreadd
    3 root      20   0       0      0      0 S   0.0  0.0   0:08.96 ksoftirqd/0
    5 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 kworker/0:0H
    7 root      20   0       0      0      0 S   0.0  0.0   0:54.78 rcu_sched
    8 root      20   0       0      0      0 S   0.0  0.0   0:00.00 rcu_bh
    9 root      rt   0       0      0      0 S   0.0  0.0   0:00.17 migration/0
   10 root      rt   0       0      0      0 S   0.0  0.0   0:00.18 watchdog/0
   11 root      rt   0       0      0      0 S   0.0  0.0   0:00.20 watchdog/1
   12 root      rt   0       0      0      0 S   0.0  0.0   0:00.16 migration/1
   13 root      20   0       0      0      0 S   0.0  0.0   0:09.62 ksoftirqd/1
   15 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 kworker/1:0H
   16 root      20   0       0      0      0 S   0.0  0.0   0:00.00 kdevtmpfs
   17 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 netns
   18 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 perf
   19 root      20   0       0      0      0 S   0.0  0.0   0:00.10 khungtaskd
   20 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 writeback
   21 root      25   5       0      0      0 S   0.0  0.0   0:00.00 ksmd
   22 root      39  19       0      0      0 S   0.0  0.0   0:00.70 khugepaged
   23 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 crypto
   24 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 kintegrityd
   25 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 bioset
   26 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 kblockd
   27 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 ata_sff
   28 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 md
   29 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 devfreq_wq
   34 root      20   0       0      0      0 S   0.0  0.0   0:14.06 kswapd0
   35 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 vmstat
   36 root      20   0       0      0      0 S   0.0  0.0   0:00.00 fsnotify_mark
   37 root      20   0       0      0      0 S   0.0  0.0   0:00.00 ecryptfs-kthrea
   53 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 kthrotld
   54 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 acpi_thermal_pm

:speak_no_evil:
And this is my command to build the webdriver container:
docker run -d -p 4444:4444 -p 5900:5900 --dns <IP_ADDRESS> -e SCREEN_HEIGHT=1080 -e SCREEN_WIDTH=1920 selenium/standalone-chrome-debug:3.7.0-arsenic


use ajv-draft-04

This solves issues resulting from the conversion of draft-04 specs to draft-07 specs.
Most notably:  "exclusiveMinimum" and "exclusiveMaximum" have been changed from a boolean to a number to be consistent with the principle of keyword independence between JSON-schema-draft04 and JSON-schema-draft07

Pull Request Test Coverage Report for Build 973767486

1 of 1 (100.0%)  changed or added relevant line in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build 972362475:
0.0%

Covered Lines:
119

Relevant Lines:
119

💛  - Coveralls

Pull Request Test Coverage Report for Build 973767486

0 of 1 (100.0%)  changed or added relevant line in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build 972362475:
0.0%

Covered Lines:
119

Relevant Lines:
119

💛  - Coveralls


Make sure the audit mode output is reflected both in the logs and in the formatter output.

Fixes https://github.com/chef/chef/issues/2910

Hi. I am an automated pull request bot named Curry. There are commits in this pull request whose authors are not yet authorized to contribute to Chef Software, Inc. projects or are using a non-GitHub verified email address. To become authorized to contribute, you will need to sign the Contributor License Agreement (CLA) as an individual or on behalf of your company. You can read more on Chef's blog.
GitHub Users Who Are Not Authorized To Contribute
The following GitHub users do not appear to have signed a CLA:

@Sgtpluck

Please sign the CLA here.

/cc: @mcquin, @chef/client-core

Hi. Your friendly Curry bot here. Just letting you know that all commit authors have become authorized to contribute. I have added the "Signed CLA" label to this issue so it can easily be found in the future.

:+1:

:shipit:

@btm / @thommay I have rebased this and fixed a few merge conflicts. Once Travis is happy it should be ready to go.

Looks like the travis failure is a timeout that is not related to my changes. I have restarted the failing job. Hoping everything will turn green soon.

Rebased one more time. Can we get this merged in when Travis is happy?


flake-list: add chaotic nyx flake

Nix flake for bleeding-edge and unreleased packages (e.g., mesa_git, telegram_git)
Additonally it provides cachyos linux kernel.
@dasJ @Mic92 friendly ping

Note: I wonder if CI from this repo will work in this flake, since it uses https://github.com/NixOS/nix/pull/8892

Ah, it's a shame then.

Re-opened with the hope of adding this if flake schemas feature is added to nix, someday.


Fix Event definition loading using reflection

Hello Lutando,
When I'm using the Emit method in AggregateRoot using the IAggregateEvent interface as reference, in the VersionnedTypeDefinitionService, the framework is actually trying to load the base type and not the actual event type. Using the GetType() method on the event fixes the issue. It applies also on the EmitAll method when we are trying to emit different events from a list.

Fantastic!
Can I ask you to also do the same in AggregateSaga? The same problem seems to be there as well. Looks like the snapshot definition service uses reflection as well.
Thanks for this!

You are welcome.
I've already done the same for the AggregateSaga.
The snapshot definition service is already used whit the correct type using the GetType() method in your code.

Fantastic, will merge. Next time do a PR to dev so that I can accumulate all the changes into one release :) thanks for everything Damian!


VBoxManage: error: Unknown option: --clipboard

Using the an unchanged Vagrantfile vagrant/virtualbox throws an error
$ vagrant up --provider  virtualbox
<snip>
["modifyvm", :id, "--clipboard", "bidirectional"]

The following error was experienced:

#<Vagrant::Errors::VBoxManageError: There was an error while executing `VBoxManage`, a CLI used by Vagrant
for controlling VirtualBox. The command and stderr is shown below.

Command: ["modifyvm", "c553546c-59f4-4524-957e-05ef4a7bda54", "--clipboard", "bidirectional"]

$ vagrant --version
Vagrant 2.2.6
$ VBoxManage --version
6.1.0r135406
Maybe this is the problem?
https://forums.virtualbox.org/viewtopic.php?f=6&t=95992
What's odd, if I REMOVE this line
v.customize ["modifyvm", :id, "--clipboard", "bidirectional"]

from the Vagrantfile I still get the error

It seems like the flag --clipboard got renamed to --clipboard-mode in 6.1.
More details: hashicorp/vagrant#11288

You can find more details about this issue here:
https://github.com/ruzickap/packer-templates/issues/54#issue-551453456

It seems that VirtualBox 7 has added a compatibility fallback, so the issue is gone:
vboxmanage modifyvm $ID --clipboard bidirectional works correctly.
$ vboxmanage --version
7.0.12r159484

We could just raise the minimum version in the README file. Sooner or later, VirtualBox 6.1 will reach its end of life anyway.


custom cart.js not injected

Problem
Hi,
i created a new cart.js file as product.js but is not being injected. How can i create a new cart.js that would work only for the template /cart?
Replication steps

Is the file in src/assets/templates/cart? Don't see why it shouldn't be working..

Hi T!
no, its not showing as it is when I am in product, the product.js
In this image you can see how it looks my filesystem and my code inside the cart.js:
https://imgur.com/pqBAc5j
In this one, you can see what i get in the dev tools when i am in /cart:
https://imgur.com/pMCg9li
and in this one what i get when i see a product:
https://imgur.com/vwglG5g
I am not sure if i have to do something more than adding the file to the current folder.

Oh it's because you're trying to see it in development build. The development doesn't bundle assets separately because it's not needed while you're developing and would slow down the build (slower time to see your changes).
You need to run yarn deploy if you want to test bundles.

But @t-kelly, if I want to work with specif js for a specific section (cart in this case), how can I do it then? Where can I add my code, inside the template file(cart.liquid), in index.js, or in a custom file I could add to the static folder?
Thanks!

I just want to follow this up.
I'd be happy to provide more information or steps I have done to try and fix this issue. I am using beta.5 version of the code.
My question is: how should I work with js or .css that is specific to a page, can I create separate files as the documentation says? I am trying to figure out how to add specific code to cart/product/home from the template system and not asking in the index if it's cart >> load cart.js
Any response is greatly appreciated.
Thanks

I will close this issue since @t-kelly's reply solved the issue:
– when creating a specific js for a template file (eg: cart.js for cart page), you need to run:
yarn deploy
in order to create the file. Once created, you can work on it normally when running
yarn start or yarn watch
Thanks @t-kelly !


Add encryption to launch template ebs block

Another one: I would like to utilize encrypted volumes. Not sure whether we should introduce an explicit block_settings and ebs key in the node groups to mirror the corresponding AWS module. I just started out with terraform on monday and it would've been easier for me if this was unified for this module and the AWS provided modules. I had to check out the module code whenever there was no example to understand how to structure my input which defies the purpose of a module.

Okay this might not be useful at all because the initial volumes are not used for any sensitive data which resides in separate EBS volumes allocated via the PVC mapped into a pod.


Docs: Fix UG and add tags commands into UG

Do check for the add and remove syntax for tags. I did not notice Elroy's PR so I created one on my own haha :p my bad.

Codecov Report

Merging #81 (030aacf) into master (6fbeca4) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master      #81   +/-   ##
=========================================
  Coverage     66.64%   66.64%
  Complexity      400      400
=========================================
  Files            74       74
  Lines          1346     1346
  Branches        143      143
=========================================
  Hits            897      897
  Misses          404      404
  Partials         45       45

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6fbeca4...030aacf. Read the comment docs.


Mark cells with the warning flag on load, if their values are over limit

When loading the page, determine if the cells are over limit and mark them with the warning class. This negates the need to persist the warnings.

Done.

This issue was moved to sakaiproject/sakai#1349


chore: remove & re"format" format tasks

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#403  👈
#402
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @davidlj95 and the rest of your teammates on  Graphite


Widget: Connection with API

Connect the app_widget with app_service

➤ Ilya Kitayev commented:
{
"data": [
{
"date": "2019-10-14",
"spots": [
{
"start": "2019-10-14T06:00:00.003Z",
"end": "2019-10-14T06:15:00.003Z",
},
...
}


Add ability to get 2nd, 3rd and nth matches to property criteria

Closing, will try and attempt to repro but doesnt have repro steps in here.


[WIP] UX review enhancements

Description
Fixes some issues found during our UX review meeting with @terezanovotna
Issues
14. Alphabetical order of applications
And same text size as other text
18. Manage application text
Choose an application to add

Codecov Report

Merging #103 into master will increase coverage by 0.06%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master     #103      +/-   ##
==========================================
+ Coverage   73.79%   73.86%   +0.06%
==========================================
  Files          36       36
  Lines         416      417       +1
  Branches       56       56
==========================================
+ Hits          307      308       +1
  Misses         87       87
  Partials       22       22

Impacted Files
Coverage Δ

src/components/SourcesSimpleView/formatters.js
100% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cc2ceae...42e3f29. Read the comment docs.

@martinpovolny


Update CHANGELOG for pull request 397

Thanks.  @homu r+

:pushpin: Commit e872f28 has been approved by posborne

:zap: Test exempted - status


Fix(kclvm-win): Added the missing kclvm-python in build.bat.

1. Does this PR affect any open issues?(Y/N) and add issue references (e.g. "fix #123", "re #123".):

[ ] N
[x] Y

issue #357

2. What is the scope of this PR (e.g. component or file name):
Added the missing kclvm-python in build.bat.
3. Provide a description of the PR(e.g. more details, effects, motivations or doc link):

[x] Affects user behaviors
[ ] Contains syntax changes
[ ] Contains variable changes
[ ] Contains experimental features
[ ] Performance regression: Consumes more CPU
[ ] Performance regression: Consumes more Memory
[ ] Other

4. Are there any breaking changes?(Y/N) and describe the breaking changes(e.g. more details, motivations or doc link):

[x] N
[ ] Y

5. Are there test cases for these changes?(Y/N) select and add more details, references or doc links:

[ ] Unit test
[ ] Integration test
[ ] Benchmark (add benchmark stats below)
[ ] Manual test (add detailed scripts or steps below)
[x] Other

6. Release note

Please refer to Release Notes Language Style Guide to write a quality release note.
None

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 89.712%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
1369

Relevant Lines:
1526

💛  - Coveralls


fix: Swap out TODOs with generic api error element

fixes #168
Also added in a quick storybook for UnrecoverableError just so it's there.

PR Storybook available here

Rebased and found the rest of 'em

PR Storybook available here

This needs a re-approve looks like, turns out I missed some imports on the first pass.


STS does not respect ca cert setting

Describe the bug
https://github.com/aws/aws-sdk-cpp/blob/e9d0d247be909ade39f213a3e2915aa262755a78/src/aws-cpp-sdk-core/source/auth/STSCredentialsProvider.cpp#L110
The SDK Client Configuration allows user to set caPath and caFIle but STS authentication doesn't use/respect the setting
Expected Behavior
All authentication respects caPath and caFile setting.
Current Behavior
The SDK Client Configuration allows user to set caPath and caFIle but STS authentication doesn't use/respect the setting
Reproduction Steps
In the below code, caFile is pointed to wrong ca file. Yet STS auth should still be able to return a valid token yet the connection to the storage should fail.
Aws::Client::ClientConfiguration config;
config.caFile = "WRONG_CA_FILE";
Aws::S3::S3Client s3_client(config, Aws::Client::AWSAuthV4Signer::PayloadSigningPolicy::Never, false);
Aws::S3::Model::ListObjectsV2Request objects_request;
objects_request.WithBucket("abc");
auto list_objects_outcome = s3_client.ListObjectsV2(objects_request);

Possible Solution
No response
Additional Information/Context
No response
AWS CPP SDK version used
1.11.201
Compiler and Version used
gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0
Operating System and version
Ubuntu 22.04

Thanks for pointing this out to us. This is a problem with how the sts client was written, and will require a significant refactor of the sts client. This has been added to our backlog, but this is not something that will get completed this quarter. I don't have a timeline for when fixed, but I will update here when it does. Sorry for the delay

It appears I am not able to use IRSA in my EKS cluster for my C++ application because it requires a call to STS to fetch credentials using a web identity token. Is there any workaround?

@ryansburgoyne could you open a discussion and provide more details about what exactly you are trying to do?

related issue: https://github.com/aws/aws-sdk-cpp/issues/1963


Updates to genbank_accession lines (529 new, seqs downloaded 2020-12-18)

Another bi-weekly update of genbank accessions matched by 1. sequences being identical (possibly except for runs of N's at beginning and/or end) and 2. similar country/isolate/year names.
Last update in 2020!  Just 529 new genbank_accessions this time.
Thanks & happy holidays!

529 seemed awfully small and it was -- I missed some new sequences.  Closing this for now, should be able to fix it soon.

I didn't have quite all of the latest sequences the first time around -- now there are 1418 new mappings which is more in line with what I would expect after two weeks.  Thanks again!

Thank you Angie!! As always your work on this is always so appreciated!

Thank you Emma!  :)