Uncaught exception 'CasperException' with message... (the cURL request fails)

Hello guys I understand the both the API and the repository are fully working right now and I truly thank you all for this amazing project, but nevertheless I'm having this problem while downloading snaps using the latest version of the repository.
The account I´m using currently has more than 1300 friends, just clarifying because of possible data limit issues.
I have obtained the API Key and the API Secret and have copied them perfectly.
$snapchat->getSnaps(true); this is the code I´m running.
and this is the error I'm getting (the cURL request fails):
PHP Fatal error:  Uncaught exception 'CasperException' with message 'Operation timed out after 10002 milliseconds with 0 bytes received' in /Users/Pilo/Desktop/SC-API-master/src/Casper-API-PHP/CasperAgent.php:163
Stack trace:
#0 /Users/Pilo/Desktop/SC-API-master/src/Casper-API-PHP/CasperAgent.php(95): CasperAgent->request('/snapchat/attes...', NULL, Array, true)
#1 /Users/Pilo/Desktop/SC-API-master/src/Casper-API-PHP/CasperAPI.php(92): CasperAgent->post('/snapchat/attes...', NULL, Array)
#2 /Users/Pilo/Desktop/SC-API-master/src/snapchat.php(152): CasperAPI->getSnapchatAttestation('VuEFQhnAfbn8pJL...')
#3 /Users/Pilo/Desktop/SC-API-master/src/snapchat.php(363): Snapchat->getAttestation('xXUserNXx', 'xXPasswdXx,<PHONE_NUMBER>999)
#4 /Users/Pilo/Desktop/SC-API-master/examples/exampleFunctional.php(22): Snapchat->login('xXPaswdXx')
#5 {main}   thrown in /Users/Pilo/Desktop/SC-API-master/src/Casper-API-PHP/CasperAgent.php on line 163
Where do think this problem might come from?

I'm sorry, is it possible that I have to upgrade my API Rate Limit?
because messages are sent succesfully, but snaps are not downloaded.

@liamcottle

@LanchaBasualdo have you logged in more than 120 times in an hour?

no, since it stopped working on friday I haven't fully used it. Just today probably tried to login a max of 13 times.
why?

If you're going to be logging in that much, I recommend you just keep the
auth token and use that. That way no login necessary.
On Oct 12, 2015 5:53 PM, "mgp25"<EMAIL_ADDRESS>wrote:

@LanchaBasualdo https://github.com/LanchaBasualdo have you logged in
more than 120 times in an hour?
—
Reply to this email directly or view it on GitHub
https://github.com/mgp25/SC-API/issues/228#issuecomment-147543345.

@chiggins I haven't

@LanchaBasualdo are you still getting this error if you try now?

one sec, let me try it

I've just downloaded the latest version of the library, entered my details and it logs in. Just checking server logs, there doesn't seem to be any downtime while I was out.

@liamcottle Dude, I'm completely sure its a problem on my end. Thing is you guys might know what it is causing it.
Tried on two different computer with same set up and same accounts and now both have different errors.
Computer 1
PHP Warning:  First parameter must either be an object or the name of an existing class in /home/pilo/Desktop/Dropbox/SC-API-General/src/snapchat_agent.php on line 443
Computer 2
PHP Notice:  Trying to get property of non-object in /Users/Pilo/Desktop/SC-API-master/src/snapchat.php on line 3079
PHP Warning:  Invalid argument supplied for foreach() in /Users/Pilo/Desktop/SC-API-master/src/snapchat.php on line 3080
PHP Warning:  Attempt to modify property of non-object in /Users/Pilo/Desktop/SC-API-master/src/snapchat.php on line 904
PHP Notice:  Trying to get property of non-object in /Users/Pilo/Desktop/SC-API-master/src/snapchat.php on line 907
PHP Warning:  Invalid argument supplied for foreach() in /Users/Pilo/Desktop/SC-API-master/src/snapchat.php on line 1039

Errors vary through time
now I get the PHP Fatal error:  Uncaught exception 'CasperException' with message 'Failed to decode response!' in /home/pilo/Desktop/Dropbox/SC-API-General/src/Casper-API-PHP/CasperAgent.php:169error

I've actually been randomly getting that in my Python implementation as
well.
On Oct 12, 2015 7:03 PM, "Lancha"<EMAIL_ADDRESS>wrote:

Errors vary through time
now I get the PHP Fatal error: Uncaught exception 'CasperException' with
message 'Failed to decode response!' in
/home/pilo/Desktop/Dropbox/SC-API-General/src/Casper-API-PHP/CasperAgent.php:169
error
—
Reply to this email directly or view it on GitHub
https://github.com/mgp25/SC-API/issues/228#issuecomment-147552677.

If you could log the HTTP Code, and the response data at line 166 just before it throws the Exception at line 166 that'd be great.
I can't replicate this error on my end, so if you could do a log like below, for me that would help me out!
$json = json_decode($result);
if($json == null){
  $code = curl_getinfo($ch, CURLINFO_HTTP_CODE);
  echo "Code: ". $code;
  echo "Result: " . $result;
  curl_close($ch);
  throw new CasperException("Failed to decode response!");
}

Also, if you could log the Endpoint it's making the request to :)

Outputs:
This is the link to the following error:
https://www.dropbox.com/s/bizo0m09ygpvhvx/Output.rtf?dl=0
Code: 500Result: PHP Fatal error:  Uncaught exception 'CasperException' with message 'Failed to decode response!' in /Users/Pilo/Desktop/Dropbox/SC-API-master/src/Casper-API-PHP/CasperAgent.php:172
This link has no error, but functions are not accomplished:
https://www.dropbox.com/s/78bda6l56e7ffln/output2.txt?dl=0

Okay. The response code is 500. However you have logged the Exception, not the Server response.
Can you add the POST parameter "_debug" to your request to my server.
Just add it to the Params array in the getSnapchatAttestation getSnapchatClientAuth methods.

You could do this instead.
Change line 43
From:
$response = parent::post("/snapchat/clientauth/signrequest", null, array(

To:
$response = parent::post("/snapchat/clientauth/signrequest?_debug", null, array(

Change line 43
From:
$response = parent::post("/snapchat/clientauth/signrequest", null, array(

To:
$response = parent::post("/snapchat/clientauth/signrequest?_debug", null, array(

Wrong button... Sorry.

@liamcottle  ok, used the line changing method. I'll request a couple of times from different computers.

I'm now getting the first error: Fatal error: Uncaught exception 'CasperException' with message 'Operation timed out after 10003 milliseconds with 0 bytes received' in /Users/Pilo/Desktop/Dropbox/SC-API-master/src/Casper-API-PHP/CasperAgent.php on line 163
CasperException: Operation timed out after 10003 milliseconds with 0 bytes received in /Users/Pilo/Desktop/Dropbox/SC-API-master/src/Casper-API-PHP/CasperAgent.php on line 163

@liamcottle please tell me if you are receiving the debug

I can run this all fine, so if you're getting timeout issues, it's an issue on your end as the server is running fine.
However, if you get the previous error, with the Code 500, I'd like to see the response with the added _debug param.

The _debug param just outputs the error in the response. I can't see it unless you post it here.

I'm sorry, my PHP is rusty, how should I do so?

Exactly the same as this: https://github.com/mgp25/SC-API/issues/228#issuecomment-147555035 But you need to add the _debug param to your requests first.

https://www.dropbox.com/s/z5mei9soo4bv7zs/Output.txt?dl=0
I have added the _debugparameter the in line 43

There's no errors in there.

Sorry, look at it again

The server isn't providing the error response, but it should when you give it that param... I'm not sure how to fix this for you dude. Since it's all working fine on the servers I've tested it on just now.

@liamcottle dam, I understand.
Is it possible that the problem comes from the size of the account as it has more than 1300 friends?
because messages are sent succesfully, but snaps are not downloaded.

Looking at the stacktrace, the issue is that my server is responding to your request with a 500 Internal Server error.
This exception is happening before the code makes any requests to Snapchat.
Because it's working fine for everyone else, the data being sent to the server from you must be invalid or something...
... it's not possible for me to know what the issue is without seeing the debug data from the server.
I've made some server changes which should now log these errors on my end.
So could you try again?

I'm, it is weird thow that I can successfully log in and send messages and retrieve the list of friends but I can not download the snaps.

Believe me, neither do I

On 13/10/2015, at 1:13, Liam Cottle<EMAIL_ADDRESS>wrote:
I don't understand how that would cause it, but glad it's fixed.
—
Reply to this email directly or view it on GitHub.

Error started to appear again, there is al ready an open issue on this topic so I wont re open it. But please might taking a look at it?

Hello i have bug :(
i still can't logging
Fatal error: Uncaught exception 'CasperException' with message 'API Response: [503] Attestation Service Unavailable' in /home4/abdullah/public_html/SC-API-master/src/Casper-API-PHP/CasperAgent.php:179 Stack trace: #0 /home4/abdullah/public_html/SC-API-master/src/Casper-API-PHP/CasperAgent.php(95): CasperAgent->request('/snapchat/attes...', NULL, Array, true) #1 /home4/abdullah/public_html/SC-API-master/src/Casper-API-PHP/CasperAPI.php(92): CasperAgent->post('/snapchat/attes...', NULL, Array) #2 /home4/abdullah/public_html/SC-API-master/src/snapchat.php(152): CasperAPI->getSnapchatAttestation('pJB/+nrPLynIc2U...') #3 /home4/abdullah/public_html/SC-API-master/src/snapchat.php(363): Snapchat->getAttestation('xxxxxxxx', 'xxxxxx', 1.xxxxxxxx+12) #4 /home4/abdullah/public_html/SC-API-master/examples/exampleBots/friendBot.php(17): Snapchat->login('xxxxx') #5 {main} thrown in /home4/abdullah/public_html/SC-API-master/src/Casper-API-PHP/CasperAgent.php on line 179
i do everything good but i am still to fix it
:(
i can't
/
also i need to make bypass in .vbnet
/
i do this coded
by me

you need to add curl to vrif  SSL

also
Fatal error: Uncaught exception 'CasperException' with message 'API Response: [401] Invalid X-Casper-Signature' in /home4//public_html/SC-API-master/src/Casper-API-PHP/CasperAgent.php:179 Stack trace:
i get this msg
[401] Invalid X-Casper-Signature
i am sure all info
crrert


Images should be using PHP-FPM for better performance

Currently the PHP images are using the Apache 2 Handler which basically results in new PHP process being spawned. Nowadays, it would be much more efficient to use PHP-FPM to speed up the load times of applications and also reduce consumed memory, especially given, these are the sample images.

Note that this issue also exist in the php docker image when using the apache tag. I just made an issue about it:
https://github.com/docker-library/php/issues/681

Aditionally, you can take a look here - I implemented it the similar way just with FPM and Apache - https://github.com/hajekj/hajekjnet-php/
The image consumes way too less memory when running and the responses are about 50% faster.

Looks great. Already made my own dockerfile, but it looks like we took the exact same approach. :)

We are working on a php-fpm+nginx image: https://github.com/patricklee2/php/tree/nginx/7.2.5-nginx-fpm, it is still a work in progress, so don’t use it in prod.  You are is welcome to test it out and provide feedback.

It looks really promising! Yet I still would like to see Apache2 FPM image available as well. Since I have a working one already (it could be ported to Alpine images to make it more compact), I could probably do a PR on the repo, what do you think?

We have no plans to support an apache+fpm blessed image.  Please make a request at https://feedback.azure.com/forums/169385-web-apps.

please use https://github.com/Azure-App-Service/nginx-fpm


TF Lite tensor field is_variable isn't displayed

Do you have an example why this is needed?

Do you have an example why this is needed?

No, but once it is included in the format it should be displayed by TF Lite viewers.

Can you share a file that is using this setting or some insights when it would be set to true?

TF and TF Lite support variables. If is_variable=true then this tensor has no static data, instead data is provided at the computation time.

tensorflow/tensorflow@a3273e090f7

Sure: https://people.freebsd.org/~yuri/fully-connected-with-is_variable=true.tflite

is_variable seems to be false for all tensors in this file?
name: tensor_input   is_variable: false
name: tensor_output  is_variable: false
name: tensor_weight  is_variable: false
name: tensor_bias    is_variable: false

Sorry, my bad. I just updated the file.

netron_issue386.zip

netron_issue_386.zip


Fix startup jingle

Renze/Telegram 2022-07-10 ~18:05
Yup, on production badges the amp starts a bit slowly for some reason
on green ones the full tune plays
(as RobotMan2412 suggested: just put playing the tune in an os task and delay playing by some ms)


Web API for Object Detection isn't returning bounding boxes property

System Information:

Model Builder Version: <IP_ADDRESS>6603
Visual Studio Version: 16.11 Preview 2

Describe the bug
When creating an API from the Consume step, the BoundingBoxes property doesn't seem to be getting serialized.
Screenshots
API call from Powershell:

API call from PostMan:

Additional context
I did try to add the Serializable attribute on the BoundingBox class, but the result was the same.

Thanks for reporting this, we will take look.

@luisquintanilla - This is what we chatted about right?
I think you were able to work around this?
@LittleLittleCloud thoughts?

@jwood803
If you go check the implementation of ModelOutput.BoundingBox property, you will find it's a read-only property, that's why it's not serialized.
To fix this, you can either add a setter to that property and make it editable, or simply not saving the ModelOutput.BoundingBox. You can reconstruct it through boxes, labels and scores later.

Thanks @LittleLittleCloud
@JakeRadMSFT this is what we talked about but I didn't have a workaround for it.


Resource Timing in Firefox

First off: thanks for your efforts, I love this library.
I have an issue capturing resource timings in Firefox (75.0) with the following config:
new Perfume({ resourceTiming: true, logging: true })

I'm able to see resource timings logged in Chrome but not Firefox. (Firefox does log navigation timings though.) Is this something that's expected to work?

Thank you 💛
Would you mind sharing a screenshot of what you are seeing between Chrome and Firefox?
And exactly what version of the two you are using.
Firefox is a little behind on supporting several Web Performance API, and Perfume.js instead of mocking the value, it only serves the information if the browser supports the API.

Sure. Here's Firefox - as mentioned, version 75.0:

and here's the same page in Chrome (80.0):

it looks as though Firefox does have some resource timings though:

So yeah, Firefox still doesn't support paint as entryTypes which is sad 😓
Try to run this simply vanilla JS code in any browser you prefer, https://plnkr.co/edit/ZSjeZb?p=preview&preview
Because this is an experimental API, Firefox will not support yet.

So similar story for probably all other entryTypes like: first-input, largest-contentful-paint, layout-shift.
About resource, try to enable the DataConsumption API as well:
resourceTiming: true,
dataConsumption: true,

Now that I think about it, it could be that the main problem is related to not support the resource type for the PerformanceObserver API.

Thanks for taking the time to look into this. FWIW, I'm pretty sure the resource type is supported. For example, the following seems to work in the Firefox console:
> PerformanceObserver.supportedEntryTypes
< Array(4) [ "mark", "measure", "navigation", "resource" ]

> function perf_observer(list, observer) {
   console.log(list.getEntries())
}
< undefined

> observer = new PerformanceObserver(perf_observer)
< PerformanceObserver {  }

> observer.observe({entryTypes: ['resource']})
< undefined

> fetch('https://github.com/')
< Promise { <state>: "pending" }

(1) […]

0: PerformanceResourceTiming

connectEnd: 45599
connectStart: 45599
decodedBodySize: 136654
domainLookupEnd: 45599
domainLookupStart: 45599
duration: 56
encodedBodySize: 41860
entryType: "resource"
fetchStart: 45599
initiatorType: "fetch"
name: "https://github.com/"
nextHopProtocol: "http/1.1"
...

Would you be comfortable to debug this part of the code https://github.com/Zizzamia/perfume.js/blob/77f66638649a6dcffe2a199ab876901f42f5fa72/src/perfume.ts#L733 on Firefox? I would do the same in the next few days.

Ok, the short story is that to enable Performance Observer for Firefox will require a major release because it could introduce some breaking changes.
I am going to start a few release candidates to test out Perfume v5 before releasing it officially.

@nickcox here our fix https://github.com/Zizzamia/perfume.js/releases/tag/v5.0.0-rc.1 my friend ☕
Perfume.js v5 contains some breaking changes so please feel free to open a new issue or ask me more questions if something unusual comes up.
Grazie Mille 💛


CRITICAL: Node v18 drops RIPEMD160

This is going to be very short-lived unless we update (or replace 😈) dashcore-lib due to Node v18+ adopting libssl3 and dropping many deprecated algos, including RIPEMD160, which is used for P2PKH (payment addresses).
Obviously we can't fix DashCore, but we can get a pure JS implementation of RIPEMD160 - though we should probably propose an adoption strategy for secure payment addresses so that we can one day deprecate the current version.

dashcore-lib hasn't been updated to use package.json.browser, but instead relies on crypto-browserify.
dashcore-lib
    => crypto-browserify
        => create-hash
            => ripemd160

We just need to go find in the code where rmd160 is used and call those functions directly. Likewise, we could do that for the other algos we need (using package.json.browser so that we keep things lightweight and use native implementations).

Bumped priority because even the average joe (or jojobyte) would run into this problem:
https://github.com/dashhive/crowdnode-cli/issues/16#issuecomment-1176941222

Fixed via d68470b5c56660bb66ce02356ccba4467e0aa52d in v1.0.7


Green Tunnel doesn't work with Telecommunication Company of Iran(Mokhaberat)

Describe the bug

Green Tunnel doesn't work with Telecommunication Company of Iran(Mokhaberat). for example, youtube.com does not load at all! can you solve this?

When I open the .exe file I see an error(see Screenshots section for more information).

Screenshots

when i click on yes button, this page is load
Desktop (please complete the following information):

OS: windows 10 - 64bit
OS Build: 18362.387
Browser: Chrome
Version: 77

Resolve in v1.6.7


Refactor SPARK integrators and implement some new flavours.

Coverage increased (+0.4%) to 60.242% when pulling f5d3741b18a140d6f6f30eb984f880b84a4826d6 on michakraus:dev-spark into 1cb37bbb096a82fa1cb997155734ce8bb9c4d7dc on DDMGNI:master.


Bazel: add filegroups for better query support [phab:D209]

Created by schroederc at 2015-04-21 17:06:30:
This ensures bazel query kythe/release/kythe.sh works even without kythe.sh being used in a target.

zarko accepted this revision at 2015-04-21 17:26:52

schroederc closed via commit 51ad21a76334ba0728364a9d143047f0432e4282 at 2015-04-21 17:34:49


[Bug] CPU mode have different result with the model trained on GPU

I am training a image retrieval model using mxnet, the output (full connect layer) is a 128-dim vector.
The model is trained on GPU mode and the GPU forward can get a reasonable output, however when I load the model and run a CPU forward I get a very different output.
OS: Ubuntu 16.04 LTS
CUDA: 8
cudnn: 5.1
mxnet: 13facf065fcef5d745865a590cc5a669405594bb
OpenCV: 3.1.0

Here is a little more information that may help:
If the net have a BatchNorm layer, the output is very different,  the magnitude is about 10e8 to 10e10. and if the net don't have the BatchNorm layer, the magnitude is about 10e-1 to 10e-2.

Is it correct without BN layer?

Without BN layer, the two output vector is not exactly the same. To one image, if both train and test run on GPU, the Euclidean distance of output vectors is exactly zero, if train on GPU and test on CPU, the distance is about 10e-1 to 10e-2. If with BN layer, the distance is about 10e8 to 10e10.

sorry everyone, it's my fault. I did not pass the aux_params to the executor correctly. Now the difference between cpu mode and gpu mode is about 10e-8, I think it is reasonable.


#41 Github Actions with Testing Container

Proposed solution to Issue #41:
Ubuntu 22.0.4 Testing Container with following packages installed:

Xyce 7.6.0
NgSpice 38+
iVerilog 11.0.1
Deadsnakes PPA (allows APT to install all Python versions)

All skip tests removed aside from Spectre. All tests pass except NgSpice noise analysis test.

Any further features required?

I think the feature-set is great!
But do we know why all these tests are failing?

Only one test is failing in all of them: test_noise1 - is there something that the container is missing that could fix this?

Maybe the version of ngspice?
It passes on my Mac:
(py310) ras-28-1:VlsirTools $ pytest --simulator_test_mode required --spectre disabled
# ...
tests/test_vlsirtools.py .....s...s..                                                                                [100%]
# ...
=== 10 passed, 2 skipped in 1.34s ===

I have:
$ ngspice -v
******
** ngspice-37 : Circuit level simulation program
** The U. C. Berkeley CAD Group
** Copyright 1985-1994, Regents of the University of California.
** Copyright 2001-2022, The ngspice team.
** Please get your ngspice manual from http://ngspice.sourceforge.net/docs.html
** Please file your bug-reports at http://ngspice.sourceforge.net/bugrep.html
******

Separately, the if_available mode doesn't quite do what we want. On the same Mac it tried to run spectre, and fails:
(py310) ras-28-1:VlsirTools $ pytest --simulator_test_mode if_available
# ...
        # The async subprocess module does not raise Python exceptions: check the return code instead.
        if proc.returncode != 0:
            from . import SimError

>           raise SimError(sim=self, stdout=stdout, stderr=stderr)
E           vlsirtools.spice.spice.SimError:
E           rundir: /var/folders/2t/c78725w17pb1bcxb9t3k17wc0000gn/T/tmp5jzpn52q
E           stdout: b''
E           stderr: b'/bin/sh: spectre: command not found\n'

Can you also share the content/ build-process/ Dockerfile for this container:
+    container: tpluck95/vlsir-test-container

I see in the commentary it should be installing ngspice 38+ (even newer than I have).
Do the tests pass if you locally run them in that container?

Can you also share the content/ build-process/ Dockerfile for this container:

https://github.com/ThomasPluck/vlsir-test-container
My wires got crossed, its installing the apt version of ngspice distributed for jammy ubuntu which is version 36. So the source of the bug at this point is pretty clear.

Do the tests pass if you locally run them in that container?

No, they don't. I'll tinker with the dockerfile and get ngpsice 38 working on it. It should then be possible to pass all tests.

Modified docker container with ngspice-38 pushed here:
https://hub.docker.com/repository/docker/tpluck95/vlsir-test-container/general
New commits can also be seen on repository linked above

I have no idea why this would fail in different Python versions as the ngspice version should be constant. This seems to be a deeper version control problem in the Python itself.

Yeah let's get this merged and just make that a separate issue.

FTR I stared at it awhile too, and showed it in a meeting-full of similarly astounded people, and everybody agrees, WTF is that.

Glad it's not just me then lol. Let me know if you want me to transfer the container repository to the VLSIR organization.

Yeah that sounds like exactly the right steps to finish this up.

Transfer the container repo. (I don't think that effects any code or config here?)
Skip that crazily failing ngspice/ AC/ python3.7-8 test

Does your new VLSIR membership include sufficient permissions to move that container repo?

I transferred the repository here, and xfail'd test_ngspice1. Nothing needs to change in the github action unless you decide to push a vlsir-test-container to a dedicated VLSIR dockerhub repository.

Terrific thanks!
And there's no project-level presence on Docker hub to date. If we add one, we can change the CI config then.
MERGE


Unable to set custom filter EmbedImages

First of all, thank you for unoserver! It is a very helpful tool.
I am trying to convert a .doc file (available at https://file-examples.com/wp-content/storage/2017/02/file-sample_100kB.doc) to a HTML file. The document contains images and I would like to embed them into the HTML.
I am able to achieve this by setting the EmbedImages filter option when using LibreOffice <IP_ADDRESS> directly:
soffice.bin --convert-to html:HTML:EmbedImages=true --outdir ./soffice/ ./file-sample_100kB.doc

When inspecting the output HTML, we can see that the images are embedded as Base64 blobs:
$ cat ./soffice/file-sample_100kB.html | grep img
<img src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAA[...]

However, I am not able to achieve the same using the new --filter-options parameter from @mitya57's #73:
unoconvert --port 3030 --convert-to html --filter HTML --filter-options EmbedImages=true ./file-sample_100kB.doc ./unoserver/out.html

The output HTML contains references to the image files instead of being embedded:
$ cat ./unoserver/out.html | grep img

I also tried using --filter "HTML (StarWriter)" or leaving out the --convert-toand/or--filterflags entirely, but without success. Since it is working when using LibreOffice directly, I suspect that somehowEmbedImagesis not forwarded to LibreOffice properly. The same happens when using theSkipImages` flag, which is not applied when using unoconvert.
I would appreciate any help here.

In the version of LibreOffice I have installed there are no flags for the filters, and I can not make it embed with the --convert-to html:HTML:EmbedImages=true. However, if I use --convert-to xhtml:HTML it will embed the images.
For unoserver, the filtername is "XHTML Writer File". So unoconvert image.doc image.html --filter "XHTML Writer File" works for me.

Thank you for the quick response, I will try it out :)

Hi @regebro
I followed what you suggested but I still have the same issue and images are not embedded.
I have tried all the followings:
unoconvert image.doc image.html --filter "XHTML Writer File"
unoconvert image.doc image.html --filter "XHTML Writer File" --filter-options EmbedImages=true
unoconvert image.doc image.html --convert-to xhtml --filter "XHTML Writer File" --filter-options EmbedImages=true
unoconvert image.doc image.html --convert-to xhtml
unoconvert image.doc image.html --convert-to xhtml --filter "XHTML Writer File"
unoconvert image.doc image.html --convert-to html --filter "XHTML Writer File" --filter-options EmbedImages=true
unoconvert image.doc image.html --convert-to html --filter "XHTML Writer File"
unoconvert image.doc image.html --convert-to html --filter "HTML" --filter-options EmbedImages=true
unoconvert image.doc image.html --convert-to html --filter "HTML (StarWriter)" --filter-options EmbedImages=true
None of these have worked for me and still the images is appearing unembedded
Some of them fail straight away too and don't work at all
These are my environment details:

Alpine Linux version: 3.16.8
LibreOffice <IP_ADDRESS> 8d03155cd8b504dd05955b7a0d23f830c24a9f30
Python version: Python 3.10.13

Any thought?

Can you attach an example document that doesn't work for you?

Here it is @regebro
Thanks.
test.docx

I tried with the following version too and same result

Alpine Linux version: 3.18.5
LibreOffice <IP_ADDRESS> 50(Build:2)
Python version: Python 3.11.6

@regebro
I found that if I move the image from footer to body of the document your solution works
However using that filter completely ditches the footer and header of the document while HTML (StarWriter) filter keeps the header and footer with no image embedded
Maybe that's a better issue explanation and I just realised it

With LibreOffice <IP_ADDRESS> 60(Build:2) this works for me:
unoconvert image.doc image.html --filter "HTML"
Also unoconvert image.doc image.html --filter "HTML (StarWriter)" works, I think it's the same.
I'm not sure any of the HTML filters has any usable options in these versions, the XHTML will ignore the footer and embed images, and the HTML will include the footer but not include the images. LibreOffice doesn't show any filter options for these things, so I don't think there are any.


⚠ SceneTime has degraded performance

In f2395be, SceneTime ($ST) experienced degraded performance:

HTTP code: 200
Response time: 5709 ms

Resolved: SceneTime performance has improved in a9bd771 after 37 minutes.


refactoring of jp.co.yahoo.yosegi.message.objects

What is the necessity of this update? What is updated?
refactoring including modification of if -else if cascade to dispatcher using map.
How did you do the test? (Not required for updating documents)
Path the maven test.

Could you please check jp.co.yahoo.yosegi.message.objects.BooleanObj: line 112.
It seems errata in original code, then I modified.

LGTM


Revert "production: reduce general platform nginx to 10s"

Reverts wmde/wbaas-deploy#1787
https://phabricator.wikimedia.org/T375866
This seems to make things worse or at least doesnt help much, appearantly

didnt wait for approval because of urgency


Flyway and schema migrations

Which version and edition of Flyway are you using?
org.flywaydb:flyway-core:5.1.4
Which client are you using? (Command-line, Java API, Maven plugin, Gradle plugin)
Java API
Which database are you using (type & version)?
Postgres 9.5
Which operating system are you using?
Mac OS X 10.11.6
What did you do?
I have a migration file containing:
create schema test;
I create a Flyway object:
  private val flyway = Flyway().also {
        with(databaseConfig) {
            it.setDataSource(url, user, password)
        }

        val fileSystemPaths = migrationsPaths.map({ "filesystem:$it" }).toTypedArray()

        it.setLocations(*fileSystemPaths)

        if (schemas.isNotEmpty()) {
            it.setSchemas(*schemas.toTypedArray())
        }
    }

schemas contains the schema 'test'.
Then I run:
flyway.clean()
flyway.migrate()

on an empty database.
The first one logs that it cannot drop 'test' as it does not exist. Fair enough.
But the second one, throws an SQLException 'The schema test already exists'.
How can that be?
What did you expect to see?
An empty schema 'test'
What did you see instead?
SQLException

I am only guessing as you didn't share your exact config, but I assume you configure the schemas property with the value test. When running for the first time, Flyway will attempt the create its schema history table if it doesn't already exist. As part of this process, Flyway will create the configured schema if it is missing as well. This is the reason why your own create schema statement fails, as Flyway has effectively already done the work for you.
Works as designed.


Update the FIPS checksums

Marking as urgent - this is needed prior to the release today.

Agreed with urgent.

Pushed. Thanks.


Adding Furrboye

its a very cool boat ok
This pull request was created using the https://discordbots.co.uk/edit menu.

The background may be too contrast-y for your tastes.
You may wish to modify this in the future
Btw, for reference, you can preview your bot page before it is pulled


Create Tools menu items to build debug and release MSI's

Create two external tools on the Tools menu to build debug and release MSI's.
This work item was migrated from CodePlex
CodePlex work item ID: '3624'
Assigned to: 'tfabraham'
Vote count: '0'

[UnknownUser@1/20/2009]
Resolved with changeset 18064.

[UnknownUser@2/21/2013]

[UnknownUser@5/16/2013]


[BUG] Multi-master not sync under heavy load

Describe the bug
When nodes under heavy load - replication is not working
To reproduce
3 nodes:
client-output-buffer-limit normal 0 0 0
client-output-buffer-limit replica 8129mb 8192mb 60
client-output-buffer-limit pubsub 32mb 8mb 60
server-threads 14
active-replica yes
multi-master yes

node 1:
replicaof km02 6389
replicaof km03 6389

node 2:
replicaof km01 6389
replicaof km03 6389

node 3:
replicaof km01 6389
replicaof km02 6389

haproxy is load-balance 6379/tcp on 3 nodes:
root@km01:~# cat /etc/haproxy/haproxy.d/6379.cfg
listen keydb_6379
       bind *:6379
       mode tcp
       option dontlog-normal
       timeout connect 2s
       timeout client  600s
       timeout server  120s
       timeout client-fin 2s
       timeout server-fin 2s
#      option tcplog
#      balance leastconn
       balance roundrobin
       maxconn 1000000
       fullconn 1000000

       server km01 km01:6389 check
       server km02 km02:6389 check
       server km03 km03:6389 check

other host simulate heavy load by haproxy port 6379:
# memtier_benchmark -s km01 -p6379 -Predis -c 1 -t 1000 -n 10000 --ratio 2:1 --data-size-range=4-512 --data-size-pattern=S --key-minimum=100 --key-maximum=300 --key-pattern=G:G --key-stddev=10 --key-median=200 --hide-histogram -x 5

other host check:
while (true); do for h in {01..03}; do echo "km$h: "; redis-cli -h km$h -p 6389 get test1; done; echo "------------"; sleep 1; done

other host - direct action on each keydb-server by port 6389:
redis-cli -h km01 -p 6389 set test1 "AAAAAA"
redis-cli -h km02 -p 6389 set test1 "BBBBBB"
redis-cli -h km03 -p 6389 set test1 "ZZZZZ"

In result:
Data syncronization is slow and unpredicable:
km01: "BBBBBB"
km02: "ZZZZZ"
km03: "BBBBBB"

Without heavy load data syncronization is predicable and correct
Expected behavior
Under heavy load data syncronization is fast and values is predicable and correct
Additional information
root@km01:~# egrep -v '^#|^$' /etc/keydb/keydb.conf
bind <IP_ADDRESS>
protected-mode yes
port 6389
tcp-backlog 4096
timeout 0
tcp-keepalive 300
daemonize yes
pidfile /var/run/keydb/keydb-server.pid
loglevel notice
logfile /var/log/keydb/keydb-server.log
databases 16
always-show-logo yes
set-proc-title yes
proc-title-template "{title} {listen-addr} {server-mode}"
save 900 1
save 300 10
save 60 10000
stop-writes-on-bgsave-error yes
rdbcompression yes
rdbchecksum yes
dbfilename dump.rdb
rdb-del-sync-files no
dir /var/lib/keydb
replica-serve-stale-data yes
replica-read-only yes
repl-diskless-sync no
repl-diskless-sync-delay 5
repl-diskless-load disabled
repl-disable-tcp-nodelay no
replica-priority 100
acllog-max-len 128
lazyfree-lazy-eviction no
lazyfree-lazy-expire no
lazyfree-lazy-server-del no
replica-lazy-flush no
lazyfree-lazy-user-del no
lazyfree-lazy-user-flush no
oom-score-adj no
oom-score-adj-values 0 200 800
disable-thp yes
appendonly no
appendfilename "appendonly.aof"
appendfsync everysec
no-appendfsync-on-rewrite no
auto-aof-rewrite-percentage 100
auto-aof-rewrite-min-size 64mb
aof-load-truncated yes
aof-use-rdb-preamble yes
lua-time-limit 5000
slowlog-log-slower-than 10000
slowlog-max-len 128
latency-monitor-threshold 0
notify-keyspace-events ""
hash-max-ziplist-entries 512
hash-max-ziplist-value 64
list-max-ziplist-size -2
list-compress-depth 0
set-max-intset-entries 512
zset-max-ziplist-entries 128
zset-max-ziplist-value 64
hll-sparse-max-bytes 3000
stream-node-max-bytes 4096
stream-node-max-entries 100
activerehashing yes
client-output-buffer-limit normal 0 0 0
client-output-buffer-limit replica 8129mb 8192mb 60
client-output-buffer-limit pubsub 32mb 8mb 60
hz 10
dynamic-hz yes
aof-rewrite-incremental-fsync yes
rdb-save-incremental-fsync yes
jemalloc-bg-thread yes
server-threads 14
active-replica yes
multi-master yes

Hi @JohnSully !
Do you have any advice on this?

Hi @rnz does synchronization complete successfully after the heavy load subsides or does it remain out of sync?

@MalavanEQAlpha after the heavy load subsides does it remain out of sync.

Is there any progress on this?

Additional info:
I try to migrate standalone node (6.0.18) to 5 nodes multi-master (6.2.2)
Which configuration is right?
I use next: https://paste.debian.net/plain/1264279
I asking because I can't make stable replication beetwen nodes. I tried multi-master-no-forward no|yes - both is not stable.
What I did: I run 5 empty nodes in multi-master scheme and on one of them I add replicaof on standalone keydb (dataset ~4G, ~17mln keys,  100-150 kops). After few minutes nodes in multi-master randomly  "== WARNING == This replica is rejecting a command from its master: '-LOADING KeyDB is loading the dataset in memory' after processing the command 'KEYDB.MVCCRESTORE'"
In a few more minutes, all the masters in down, because the base is loaded into memory on variable nodes:
master_global_link_status:down
master_host:rdb05-prod  #<-- (standalone node)
master_link_status:down
master_1_host:kdb15-prod
master_1_link_status:down
master_2_host:kdb12-prod
master_2_link_status:down
master_3_host:kdb13-prod
master_3_link_status:up
master_4_host:kdb14-prod
master_4_link_status:down

HI, as discussed in another issue this is not a supported configuration, going to close this issue.


Find a fun Display font for the title of the app

It would be nice to have a cool stylized font for the page title "Lithium".
Go ahead and find one here:
https://fonts.google.com/
Leave links as comments on this issue.

I like this one - https://fonts.google.com/specimen/Bungee+Inline?preview.text=Lithium&categoryFilters=Feeling:%2FExpressive%2FPlayful
This is iPlayGamez :)

For title I like Novo Square
For body normally I like roboto, but it looks pretty sick with poppins too (to be clear my vote is still roboto)

Thanks for the suggestions. For now I'm thinking Bungee Inline fits.


[P0] Support multiple tags in autorest.md

Microsoft.Resources (Resource manager) management SDK requires multiple package tags in order to build the SDK library.
While the autorest.md seems only support single tag reference in Track2 generation, how can I get autorest to support this scenario?
Thanks

We figured out how to get library generated with a single invocation.


New Helix Queue for Tethered AppleTVs

Per request from the product team, they would like to move the systems currently running macOS 11 to a new queue that is running the latest Apple OS.
Please create a new queue called macos.arm64.appletv.open (the existing osx.14.arm64.open and osx.1100.arm64.appletv.open queues can be used as "baselines" for this new queue).
Once the queue has been created, we will need to reach out to DDFUN to update the systems to the latest Apple OS and move them to this new queue.

Release Note Category

[ ] Feature changes/additions
[ ] Bug fixes
[ ] Internal Infrastructure Improvements

Release Note Description
Create Tethered AppleTV Helix queue

/cc: @matouskozak for visibility

ack

osx.14.arm64.open
- &OSX-14-00-ARM64
  <<: *Base
  Name: OSX.14.Arm64.Open
  OperatingSystemId: Apple-macOS-14.00-ARM64
  # No real EstimatedRemovalDate for this queue
  UpdateRequiredDate: 2025-01-01
  EstimatedRemovalDate: 2025-01-01
  Architecture: ARM64
  Public: true
  PreInstalledImage:
    System: Darwin
    Version: 23.0.0
    Processor: arm64
    Distro: macOS
    DistroVersion: 14.00
  Artifacts:
  - Name: macos-xcode
    Parameters:
      version: 15.0.1
    UpdateDate: 2024-06-30
  - *OSXArtifacts

osx.1100.arm64.appletv.open
- &OSX-11-00-ARM64-AppleTV-Open
  <<: *OSX-11-00-M1
  Name: OSX.1100.Arm64.AppleTV.Open
  Public: true
  Artifacts:
  - Name: macos-rosetta
  - Name: macos-xcode
    Parameters:
      version: 13.0
    UpdateDate: 2024-06-30
  - *OSXArtifacts
  - Name: macos-signing-certs
    Parameters:
      user: helix-runner
  TetheredDevices:
  - OperatingSystemId: Apple-tvOS-15.0-ARM64
    DeviceModel: Apple_TV

Based on our conversation, what needs to be done is to use osx.14.arm64.open for OS info and osx.1100.arm64.appletv.open for the rest.  So, something like...
macos.arm64.appletv.open
&MacOS-ARM64-AppleTV-Open
  <<: *Base
  Name: MacOS.Arm64.AppleTV.Open
  OperatingSystemId: Apple-macOS-14.00-ARM64
  # No real EstimatedRemovalDate for this queue
  UpdateRequiredDate: 2025-01-01
  EstimatedRemovalDate: 2025-01-01
  Architecture: ARM64
  Public: true
  PreInstalledImage:
    System: Darwin
    Version: 23.0.0
    Processor: arm64
    Distro: macOS
    DistroVersion: 14.00
  Artifacts:
  - Name: macos-rosetta
  - Name: macos-xcode
    Parameters:
      version: 13.0
    UpdateDate: 2024-06-30
  - *OSXArtifacts
  - Name: macos-signing-certs
    Parameters:
      user: helix-runner
  TetheredDevices:
  - OperatingSystemId: Apple-tvOS-15.0-ARM64
    DeviceModel: Apple_TV

@ilyas1974 thoughts?

just a couple of "fixes"
EstimatedRemovalDate: 2027-01-01
Name: macos-xcode
Parameters:
version: 15.0.1
UpdateDate: 2024-06-30
everything else looks good.

Completed with https://dev.azure.com/dnceng/internal/_git/dotnet-helix-machines/pullrequest/39945

@chcosta do you know if macos.arm64.appletv.open is available to use? I was trying to use it but my AppleTV jobs where timing-out...

Let's take a look after the current helix outage has been resolved.

the queue has been created (I see it receiving messages in Azure).
I'm not certain, but I think there might be another step required to get physical hardware connected to the queue...

Once the queue has been created, we will need to reach out to DDFUN to update the systems to the latest Apple OS and move them to this new queue.

@ilyas1974 , do you know if there are next steps here?


Error consistency during trace generation

Currently, we don't have a consistent approach to handling unexpected behavior. In some cases, we throw errors where a proof can be generated but we know it has issues (i.e. an assumption of the operation is not met). In other cases, we don't throw an error, and we allow it to continue if a valid proof can be generated, even if an underlying assumption of an operation is broken.
It would be good to pick a method so that programs have a guarantee of either

if any internal assumptions are broken by the program, trace generation will fail
if a valid proof can be generated, we won't throw an error, but it's not guaranteed that no internal assumptions have been violated.

Another option would be to do (1) in debug mode, and (2) in release mode, which would provide more safety without additional overhead during regular execution.
Once we've chosen our approach, we should review our implementation to ensure that we're following it consistently.

I also noticed a few instance of assert!(...) being used in the code which will lead to panic upon failed assertion.  I wonder if it would be preferable to throw errors that can be handled?

My preliminary thoughts:

The only time when processor/prover/verifier etc. should panic is when there is a bug in our codebase. So, any asserts we use should not be triggered by user inputs.
If we can't generate an execution trace (e.g., in case of divide-by-zero), we should return an error.
If the execution trace can be generated, but we know that the proof won't be verified (e.g., performing an AND on non-binary inputs), we should also return an error.
If the execution trace can be generated and the proof may be verified, but we know there is an issue with the program (e.g., performing an unsafe u32 operation on non-u32 inputs), we should print out a warning.


Tests distroless and minimal docker images for integration tests

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: howardjohn
To complete the pull request process, please assign icygalz
You can assign the PR to them by writing /assign @icygalz in a comment when ready.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

prow/OWNERS
tools/OWNERS [howardjohn]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@howardjohn: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

integ-new-install-k8s-presubmit-tests-master
c9d48f983103de0af6c559cda05684636da5297f
link
/test integ-new-install-k8s-presubmit-tests-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@howardjohn: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

integ-new-install-k8s-presubmit-tests-master
c9d48f983103de0af6c559cda05684636da5297f
link
/test integ-new-install-k8s-presubmit-tests-master

integ-mixer-k8s-presubmit-tests-master
c9d48f983103de0af6c559cda05684636da5297f
link
/test integ-mixer-k8s-presubmit-tests-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@howardjohn: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

integ-new-install-k8s-presubmit-tests-master
c9d48f983103de0af6c559cda05684636da5297f
link
/test integ-new-install-k8s-presubmit-tests-master

integ-mixer-k8s-presubmit-tests-master
c9d48f983103de0af6c559cda05684636da5297f
link
/test integ-mixer-k8s-presubmit-tests-master

integ-pilot-k8s-presubmit-tests-master
c9d48f983103de0af6c559cda05684636da5297f
link
/test integ-pilot-k8s-presubmit-tests-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

This speeds things up a bit, but caused some errors in pilot/security. It may be worth exploring further in the future

@howardjohn: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

integ-new-install-k8s-presubmit-tests-master
c9d48f983103de0af6c559cda05684636da5297f
link
/test integ-new-install-k8s-presubmit-tests-master

integ-mixer-k8s-presubmit-tests-master
c9d48f983103de0af6c559cda05684636da5297f
link
/test integ-mixer-k8s-presubmit-tests-master

integ-pilot-k8s-presubmit-tests-master
c9d48f983103de0af6c559cda05684636da5297f
link
/test integ-pilot-k8s-presubmit-tests-master

integ-security-k8s-presubmit-tests-master
c9d48f983103de0af6c559cda05684636da5297f
link
/test integ-security-k8s-presubmit-tests-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.


Gradle example should be updated now that 10842 is marked fixed.

Gradle example suggests that a better config should be used once https://github.com/microsoft/azure-pipelines-tasks/issues/10842 is fixed.
However 10842 is fixed since August 2019. The example should be updated.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 77c20289-dab2-7a6e-4f63-4b30eaff2c71
Version Independent ID: d75cc196-90c1-8291-9907-ff405bde4edf
Content: Pipeline caching - Azure Pipelines
Content Source: docs/pipelines/release/caching.md
Product: devops
Technology: devops-cicd-release
GitHub Login: @ramiMSFT
Microsoft Alias: rabououn

What does the new way look like?

@ramiMSFT @WilliamAntonRohm  Any progress on the docs? Any example you can provide here?

@sarod Apologies for the delayed response. The updated content will go live shortly. Thank you for your feedback!

This problem is resolved? the example with gradle don't work

Yeah, I removed all pipeline caching months ago, it just doesn't work and is so slow that you're better without it.


Helm charts and add Minio docker-compose (Local AWS S3 compatible API and UI)

Summary
Finally, I present working helm charts to enable deployment of Superagent to Kubernetes.
Documentation is provided in helm/README.md, as well as examples in the helm/examples folder.
Default values are in helm/values.yml
Subcharts are provided for Postgres and PGAdmin so users can optionally spin those up in K8s along with superagent.
I also added an optional docker-compose.minio.yml file, to allow running of Minio an AWS S3 compatible Object Storage API and UI to allow users to run Superagent completely locally and be able to upload and use documents, without hosting them publicly on AWS S3
This required adding an optional UI env var NEXT_PUBLIC_AWS_OVERRIDE_S3_BASEURL and optionally using it in the S3 setup in code, to allow overriding the base url for AWS S3.
Minio have their own helm charts if anyone wants to run it in kubernetes.
Fixes

Fixed docker-compose.yml to enable ports on pgadmin and remove un-needed dependency check between superagent-api and pgadmin
Much improved .docker/README.md, covering docker networking, setting up Minio and overall tidy up of documentation.
Added logging and error handling to app\api\documents.py - needed to figure out why document upload was not working (Turned out I had not provided enough RAM in my helm deployment)

Test plan
Full documentation in helm/README.md and .docker/README.md with steps

Screenshots
Minio Console, with file uploaded via Superagent

Checklist

[x] My code follows the code style of this project and passes make format.
[x] My change requires a change to the documentation.
[x] I have updated the documentation accordingly.
[x] My change has adequate unit test coverage.

@heresandyboy would you be up for joining my youtube channel and talk about how you set this up?


[revert] Reverting PR #4062

This PR reverts https://github.com/apache/incubator-superset/pull/4062 which added a MySQL check to the /health check. The reason for the revert is two-fold:

I learned that /health could return OK even if all your requests are failing and the network is down and looking at 5xx errors was a better measure.
Whilst trying to remove duplicate uniqueness constraints this check caused our instance of Superset to return a 502 which is undesirable.

to: @graceguo-supercat @mistercrunch @timifasubaa

Sounds good though PR has a conflict...


Problem encountered when installing v 0.0.2 via pip

Hi @c-goosen! Thanks for publishing this package :)
I'm hitting an error when trying to install new release 0.0.2 via pip (0.0.1 is still working):
poetry.core.masonry.utils.module.ModuleOrPackageNotFound: No file/folder found for package za-identity-number
I had a quick look and I think underscores should be used here: https://github.com/c-goosen/za_identity_number/blob/9cfb06160c8f649073d889118790b39c43e2120e/setup.py#L38

@gsvr Please try version 0.0.3
Looks like its working.

@gsvr Please try version 0.0.3
Looks like its working.

Just fyi don't think that was the only problem, so did some cleaning up of pip & poetry

Just fyi don't think that was the only problem, so did some cleaning up of pip & poetry

@c-goosen Yup, it's working :)
I had to change the import name but that's not an issue. Thanks!

@c-goosen Yup, it's working :)
I had to change the import name but that's not an issue. Thanks!

@gsvr Perfect. Made some slightly breaking changes just for ease of use.
Welcome to open issues as feature requests if there is anything I didn't think of

@gsvr Perfect. Made some slightly breaking changes just for ease of use.
Welcome to open issues as feature requests if there is anything I didn't think of


Fixes paginator cache, problem with the generation of cacheInternalId

This fix also fixes a future problem with complex Adapters that cannot be serializable.
fixes #1 , joined the #24 and part of #30 , and included tests for both.
Also, improved the method to get cacheInternalId to accept inherited adapter as well, without considering those the same adapters.

@weierophinney I have fixed this cache problem, but Travis isn't working because there is a problem with a Trait in ServiceManager... and a problem with HHVM on unserialize function, but those problems aren't related to this fix. I tried to figure it out the HHVM problem, but couldn't.

Having the same problem! @rwrz still working on this?

@rwrz The build failures are due to an issue with the upstream zend-servicemanager library when using the latest version (essentially, a trait used in testing within this library is provided by that component, but it uses a newer PHPUnit version). I'll try and address that, and then merge this patch.

Thanks, @rwrz!


Undefined content

I see "::: moniker-end" before "Choose the category and template you want to use. For a list of supported templates, see Default and supported notifications."

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c2fdc7bf-dd88-5f39-cfaf-77dca428990e
Version Independent ID: c939066c-c671-7f50-3ba3-9916b0f4cd4c
Content: Manage personal notification settings - Azure DevOps
Content Source: docs/notifications/howto-manage-personal-notifications.md
Product: devops
GitHub Login: @chcomley
Microsoft Alias: chcomley

@turibbio Thanks for the heads up. Currently working on it and will push a fix to master today. Thanks again!


SyncCluster failing on possibly non-existant API endpoint

I've been unable to get the etcd client to properly sync the cluster. From this line in the code:
https://github.com/coreos/go-etcd/blob/master/etcd/client.go#L301
it seems like the SyncCluster command is making a call to a /v2/members endpoint which, as far as i can tell, does not exist. The result is the client complaining that all the peers are unreachable if the only machine presently listed is not the primary.

Looks like this is an API difference with the latest version of etcd. Thought that the v2 prefix would have guaranteed compatibility, but I guess not.

@buth Please use v0.4.6 go-etcd for v0.4 etcd.


Add some fake seismic data to the esv-intersection-data repo

For now we don't care that the seismic data is not aligned with the surfaces

Volve seismic in REP dev&test and can be taken to data repo.


Run staticcheck in CI?

Should we do this? (If the consensus is "yes", let's relabel this as an enhancement)
My VSCode configuration shows warnings from staticcheck but we don't get them from our existing linting (#744, #746, #747, #748, #749, #750, #751, #752, #753)
https://staticcheck.io/docs/getting-started/

Considering the number of warnings coming from generated code, we will probably want to exclude those files from linting or ignore results from them.

@theganyo Here's a discussion about the generator that I forgot to link: https://github.com/googleapis/gapic-generator-go/issues/1138

From https://golangci-lint.run/usage/linters, a description of enabled linters:
"It's a set of rules from staticcheck. It's not the same thing as the staticcheck binary. The author of staticcheck doesn't support or approve the use of staticcheck as a library inside golangci-lint."

FYI, there is a github action here: https://github.com/marketplace/actions/staticcheck. If we go forward with this, we'll need to find a way to avoid the generate code.


Fixes #399

Fixes #399

modified __init__
added a test with ReplayCompose

Please review

I think we shouldn't give ability to not apply totensor.. maybe fix it from the other side?

We can use **kwargs without passing it to super constructor

Shouldn't it behave similarly to FromFloat and similar ?

okay, let's make it always_apply by default, it should be fine

2 approvals, let's merge it :)


Change apostrophe placement in advanced.rst

See Rule2a on http://www.grammarbook.com/punctuation/apostro.asp

Yup, this looks right. Thanks for the patch! :sparkles:

Codecov Report

Merging #3922 into master will decrease coverage by 1.44%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #3922      +/-   ##
==========================================
- Coverage   89.32%   87.88%   -1.45%
==========================================
  Files          15       15
  Lines        1940     1940
==========================================
- Hits         1733     1705      -28
- Misses        207      235      +28

Impacted Files
Coverage Δ

requests/compat.py
64.86% <0%> (-35.14%)
:x:

requests/init.py
83.33% <0%> (-10%)
:x:

requests/_internal_utils.py
93.75% <0%> (-6.25%)
:x:

requests/models.py
91.15% <0%> (-2.27%)
:x:

requests/adapters.py
89.75% <0%> (-0.49%)
:x:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 29085e7...e0ba829. Read the comment docs.

These CI failures aren't your fault. @kennethreitz, looks like our CI setup has busted again: want to take a look?

Yep, this is a bug in the last release of pipenv. There's a patch underway, thanks @Lukasa!


Remove silx deprecation

This PR removes deprecation warning from silx while running the tests.
related to #2609

LGTM


Stable/7.0

there is a lost key 'apply_and_proceed_button' in chinese translation

Thank you for contributing to openstack/fuel-web!
openstack/fuel-web uses Gerrit for code review.
If you have never contributed to OpenStack before make sure you have read the
getting started documentation:
http://docs.openstack.org/infra/manual/developers.html#getting-started
Otherwise please visit
http://docs.openstack.org/infra/manual/developers.html#development-workflow
and follow the instructions there to upload your change to Gerrit.


[Bug]: When you apply for library permissions and submit them again, the validity period of the permissions is different from the first time

ODC version
4.3.3.
OB version
no related
What happened?

When you apply for a library permission, the permission is valid for 30 days when you submit it, and the permission for re-initiating the permission is valid for 7 days
What did you expect to happen?
When re-initiated, the value of the permission validity period should be the same as the validity period selected for the first submission
How can we reproduce it (as minimally and precisely as possible)?
Submit a database permission application, select a validity period of 30 days or another time, and initiate the request again to check whether the validity period of the newly generated ticket is the same as that of the first time
Anything else we need to know?
No response

Fixed In Commit cde598c983709bbebf6b34952101d749d03336aa
------
艺泽
Wed Dec 18 17:36:39 2024 +0800


import item

[x] in item page  import item not working

[ ] All fields on item creation page are missing in CSV file
[ ] secondary name
[ ] sales account
[ ] purchase account
[ ] description
[ ] tax category
[ ] inventory account
[ ] Prefered vendor id

[ ] By filling  brand and category and import the CSV  file import not working fine

[ ] after importing items ,if we go to edit page ,user not able to edit the base unit

[ ] after giving inventory details in csv file and importing ,the imported item should show the inventory details.but here inventory details is not showing and we can't enable the inventory tracking

[ ] if we not filling mandatory data's on csv file and importing it showing internal server error,i.e, content of validation is invalid
[ ] same issue occur in service creation
[ ] in case of service importing SAC code column is not provided in csv file,so change the column name to Hsn Code/Sac code


Need test to ensure OpenIdConnectConfigurationRetriever performs TLS server auth

Need to validate that:

the cert used to protect the channel owns the url, altSubjectName == host
check certificate revocation
certificate has valid chain

handled by schannel.


Fix changelog check for no changes.

This initial changelog check fails. Then, when modified to have the no-changelog label, it passes.


When the error will be logged in

I have problems when the application live, there are error messages like this, if anyone can help me

This issue is created for the v0.x version of the project, which is no longer support nor maintained as of January 16th 2017. I'm therefore closing this issue.
All development effort will be put in the new version of the project that is named Colmena CMS.


Ensure that weekly schedules always run on the weekday specified

There's a bug that can progressively cause weekly schedules to run a day late, which should be fixed by: https://github.com/gamernetwork/gastatsdash/pull/57
This needs testing with a dry run of the scheduler and deploying.

@MrJonty This is deployed - hopefully weekly reports will start running as expected going forward

This is fixed!


Add repo info to list issues

It's hard to test at present, but it compiles.

This change will need to be resubmitted based on changes to master.

Couldn't merge it in before, eh?

If I am reading the new code correctly, it looks like it already includes the repo in the issue listing.


How to backup seetings during install.

Hello
Today I finish install openvpn with your script. I face a lot of trial and error. So I want to make backup. Is there any way to backup current openvpn install setting for future install script?

You can backup /etc/openvpn


Mocking inserts

Hey, I'm struggling with mocking - I am inserting a document with a randomly-generated ID and I can't mock it, because I can't anyhow predict the ID. Any tips on how to do that?

Unfortunately this is not possible as the current implementation of the mocking utility only supports mocking exact queries (this is due to the simple way the library compares queries). I plan to make mocking more flexible but I am not sure when I will have time to work on this as there are a couple of other features that I am trying to finish first. That being said I have created the issue https://github.com/dancannon/gorethink/issues/347 where I have added a bit more information and will update whenever I get round to working on mocking again.
I will also close this issue and keep the discussion in the linked issue to try and keep things clear, if you have any further questions just ask :)


Add support for base_url

Description
Add support for base_url. Fix #150
Checklist - did you ...

[x] Add a file to the news directory (using the template) for the next release's release notes?

[x] Add / update necessary tests?
[x] Add / update outdated documentation?

Should we add base_url to index.html also?


Firefox 112 Error: Add-on not verfied

Body
I am unable to instal the addon version 0.2251 on Firefox manually and I am getting an error message that the addon hasnt been verified even I setup xpinstall.signatures.required to FALSE, closed and restarted Firefox (several times). I have checked that when I restarting Forefox  that xpinstall.signatures.required is correctly setup tp FALSE. I am using Firefox 112 on a Mac. I had the previous version 0.2039 before. Not sure what I am missing here...
Version
0.2251
What browsers are you seeing the problem on?
Firefox
What OS are you seeing the problem on?
MacOS
Anything else?
n/a

Duplicate of #947
See https://github.com/FastForwardTeam/FastForward/releases/tag/0.2237

OK. You should make it clear in your wiki to users they can't expect to install the addon on a mainstream FF channel since this won't be resolvable without one using FF Nighlty.

You can install the signed version from the release I linked https://github.com/FastForwardTeam/FastForward/releases/download/0.2237/fastforwardteam-0.2237.xpi

Many thsnka


ListTile padding render issue

Steps to reproduce

Create a list using ListTiles.
Make sure to give the ListTile contentPadding.
The list must load dynamically when you navigate to the page with the list.
You should notice when the page loads initially the padding on some of the ListTiles will not render correctly causing text to overflow outside if the ListTile in weird ways.
If you scroll on this page or simply move the page up and down the issue corrects itself and then renders correctly.

Expected results
The expected result should be as shown in the image attached: Basically the text inside the ListTiles should be aligned correctly.

Actual results
When the page opens the ListTile is not rendering correctly at first. The text inside the ListTile will be missaligned and sometimes overflow outside of the ListTile. When you scroll or move up and down on the page it will correct itself. Please see video attached:
https://github.com/user-attachments/assets/0bc7436b-23bf-47d5-90f6-df6cfefbe1c4
Code sample
Code sample
Padding(
      padding: const EdgeInsets.only(bottom: 5),
      child: ListTile(
        onTap: (){
          controller.toggleCheck();
          if (onClick != null) {
            onClick!(id, title, controller!.getChecked());
          }
        },
        contentPadding: const EdgeInsets.fromLTRB(8, 6, 20, 6),
        horizontalTitleGap: 10,
        tileColor: Colors.white,
        leading: Checkbox(
          value: controller.getChecked(),
          onChanged: (p0) {
            controller.setChecked(p0!);
            if (onClick != null) {
              onClick!(id, title, p0);
            }
          },
        ),
        title: Column(
          crossAxisAlignment: CrossAxisAlignment.start,
          children: [
            CustomText(
              content: title ?? '',
              color: Colors.black,
              fontWeight: FontWeight.w500,
              fontSize: 16,
            ),
            CustomText(content: desc ?? '', fontSize: 12,),
          ],
        ),
      ),
    );

Screenshots or Video

Screenshots / Video demonstration

https://github.com/user-attachments/assets/cb74b648-be5b-471f-8eb4-790564eb40d1

Logs
Logs
[Paste your logs here]

Flutter Doctor output
Doctor output
[Paste your output here]

Hi @Camden031, please provide a complete minimal reproducible code sample so that we can properly investigate this.
Please also provide the output of flutter doctor -v
Side note: Why are you using a Column in your title? If you want to have a subtitle in your ListTile you can use subTitle property of the ListTile.

Hi @Camden031, please provide a complete minimal reproducible code sample so that we can properly investigate this.
Please also provide the output of flutter doctor -v
Side note: Why are you using a Column in your title? If you want to have a subtitle in your ListTile you can use subTitle property of the ListTile.

Thank you, I will provide a sample code. I will remove the column and try with the subtitle instead just to make sure it's not that causing it.


Add favico documentation to the "CD Elements" section

Add favico documentation to the "CD Elements" section, to help implementors not forget it.
Cf https://www.eda.admin.ch/eda/de/home.html

ok

great!


Error: Shader compilation error for shader 5: 0:9(8): error: unrecognized layout identifier `set'

Hi
Error: Shader compilation error for shader 5: 0:9(8): error: unrecognized layout identifier `set'
What does this error mean?

Sorry for the late reply! I think it was my mistake, and since I only tested this code on Nvidia driver (which doesn't manifest this issue), the bug got overlooked. I updated the code to remove all references to set in the shaders.


self signed cert for testing

to fix periodic test failures.

This change is

/assign @jlewi @richardsliu

/lgtm
/approve


vite is too slow when i use it

Describe the bug

my app is not too fast when i use vite one month ago
it's maybe a good issue to develop the speed of vite
my project demo address is : http://www.github.com/cmdparkour/vue-admin-box.git

Reproduction
http://www.github.com/cmdparkour/vue-admin-box.git
git clone it and use yarn run dev to see the problem.
today i see it in 10460ms , other time i see it in 1000ms
System Info
window 10 and 16Gb memory

It starts on my Mac in 2s, but takes 18s in the Windows VM. Seems a Windows-only issue.

On first clear run:
$ vite
Pre-bundling dependencies:
  vue
  element-plus
  vue-router
  vue-i18n
  vuex
  (...and 16 more)
(this will be run only when your dependencies or config have changed)

  vite v2.3.8 dev server running at:

  > Local: http://localhost:3000/
  > Network: use `--host` to expose

  ready in 1310ms.

Second run
$ vite

  vite v2.3.8 dev server running at:

  > Local: http://localhost:3000/
  > Network: use `--host` to expose

  ready in 402ms.

If there is a problem, I can't reproduce it.
  System:
    OS: Windows 10 10.0.19042
    CPU: (16) x64 AMD Ryzen 7 4800H with Radeon Graphics
    Memory: 9.55 GB / 15.42 GB
  Binaries:
    Node: 16.3.0 - C:\Program Files\nodejs\node.EXE
    Yarn: 1.22.10 - ~\AppData\Roaming\npm\yarn.CMD
    npm: 7.15.1 - C:\Program Files\nodejs\npm.CMD
  npmPackages:
    @vitejs/plugin-vue: ^1.2.2 => 1.2.3
    vite: ^2.2.3 => 2.3.8

@cmdparkour I would advise you to minimize your project (exclude all JS / CSS from compilation, disable all plugins, etc.) and gradually return the functionality and tracking the time to compile. This will help to localize the problem more accurately.

Same issue for me: around 700 files in a project, each file loads in average of 10ms, some files load for 100-500ms, and total page load time is ~5-10s (colleague reporting even longer time). Even with all plugins disabled (and proxy option of dev server too, as long it switches between http2 and https in vite) nothing changes.
No idea what causes it, but mac users reports everything is more or less OK.
Win 11, node 16, vite 2.5.0

After some research I've figured out some of reasons:
https://github.com/vitejs/vite/blob/main/packages/vite/src/node/plugins/resolve.ts#L356
probably accessSync should be async to make things run in parallel.
This call in sum takes 1.1 seconds out of my 5-6 seconds (another consumers - around 1s in total on http server and streams, some time on transforms, some time being idle).

After i used more time, i found the reason is what i open many windows to do some other task, when i close those and do it again, the time is too slow, so it's not a bug for vite. i will close the issue


proposal: spec: Formal Seal Model & Support for Go Features and Libraries including from the Go Community

Go has been praised for its simplicity, and I would add its productivity. Only 2 to 6 features seem superfluous or have a questionable place in the Core language. On individual level I don't use and that's it.
A bigger deal seem to me

The impossibility for companies to use GO even simpler by disallowing language features and have all GO tools, no matter from which vendor, enforces this policy.
The absence of a "seal" (label/ category) below "core language" and "standard" which could be given to community packages, e.g. if the initial author transfers them wholly, including in legal sense, to the GO community at large and the latter commit to maintain them at least for a well-defined period and consolidate licence terms. The same mechanism could be used for language features,
The combination of the two to e.g.  define which language features are permitted to de-activate ("soft deprecation"). Some may not, e.g. because the language would no longer be complete.

The answer may not bee much or everything, just some infrastructure at the right level, preferably language level. At the very least, it could be just fixing the semantic (e.g. GOLD; SILVER; BRONZE) and the protocol tools should have to implement.
Thanks for considering,
Eugene

What current, real world, problem does this proposal address?

Hi Dave,
thanks for the prompt response. Sorry,  for the late response.
Take e.g. Javascript: Douglas Grockford spent time identifying the “good parts of JavaScript”—for PayPal. He should not have needed to write a whole tool (JSLint) that checks code for “bad parts”.
Go not being JavaScript, let me take Mat Ryer’s “Things in Go I never Use” (speech at GothamGo 2018). Companies may decide which “not good for us parts”. They lack tool enforcement for non-usage of bad parts. Tools like JSLint cannot restore the lost productivity.
“Bad libraries” are an even greater challenge “Bad” may mean because they contain other “bad parts” or non-technical properties It may be because of attached risks with regard to maintenance assurance, licensing issues etc. Tool support is needed for libraries as well.
I hope this added some clarity.
Thanks for considering
Eugene

Thank you for your reply. This still feels rather subjective. Can you give some examples of specific features, packages, or api calls which should be disallowed? Personally I’d like to see runtime.Finalizer banished.

Right. Even objectively people come to different conclusions due to e.g. differences in expertise degree and background, operational context, tasks to solve, … I accept that and want to deal with it. Esp. given that GO does not throw the maximum features to the world trying to make everybody happy. Providing some room and mechanisms for additional and differentiated minimization to those who know best about the concrete GO usage deserves at least a consideration. The proposal is such it is thereby not needed to know, care or agree on what is reduced in each instance.
As a prominent example occurring in each company take the dichotomy between needs of infrastructure vs. application builders --each company practically does both. Let take a few features:
•	Labels, fallthrough, goto …: Most likely no one would have missed them
•	Panic, error and reflect packages: Infrastructure builders need them. In applications with human interaction just using the error package would be a violation of I18N and L12N standards. As BIZ application vendor you want them enforced. Panic in end user messages would be banned as well as too rude to end users. Application developers would need and be required to use libraries of higher abstraction level and greater convenience under the impossibility to use reflect.
•	Generally speaking, as a company you don’t necessarily want features and libraries always banned., but specifically  per environment assigned a clear usage.
I know there is some advice, e.g. on how to do better with errors than just the error package (Dave Cheny, Steve Francia,…,) or why not unnecessarily toying with e.g. the reflect package (Rob Pike ...). Some technical built-in assistance, not built-around the JSLint style, should at least be considered.

What’s wrong with the reflection package? It’s going to be pretty hard to do json decoding or print a formatted string without it?

Re: panic. If you remove panic from the language what should happen if a slice out of bounds condition occurs? Can that still panic)

application developer would use panic only indirectly, i.e. through a library that itself uses reflect.
I don't want panic to be removed. The runtime should panic. Not application developers. They should always recover and terminate the application more nicely and meaningful info the end user can act upon

To me this sounds like a proposal that is better implemented by a third party rather than the core Go team.

fair enough

Update (esp. to Ian): Meanwhile I took a try. I was surprised how awesome go.token, go/types, go/ast, go/parser, go/printer et al. are: Putting the standardization aspect aside, I realized that GO already does an excellent job at enabling implementation of GO code introspection and transformation tool even beyond the requirements raised above. And that despite having written my first go code only a year ago. I am not new at programming though.

Based on the discussion above, this proposal seems like a likely decline.
— rsc for the proposal review group

No change in consensus, so declined.
— rsc for the proposal review group


Add users list

On the firepad website, a connected user list is displayed.
Each user can choose a name — and their total count is displayed on top of the list.
This feature could be great in atom too ;-).

I'm working on user cursor (similar to hackpad) that points out the current row position of other users.
I think this won't take too long.


Carbonserver panic and Out of Memory

Hello here,
we're running a graphite production cluster based on a carbon-c-relay frontend and go-carbon  as a backend.
The cluster is composed by 3 go-carbon nodes running on well-equipped servers (128GB of memory and a bunch of 8 core cpus).
We've recently upgraded to go-carbon version 0.10.0. Futhermore we're currently running a nightly cron task to clean up the stale wsp files.
The problem we've experienced today was an out of memory, followed by the OOM intervention on all the 3 nodes, presumably caused by the carbonserver component.
What we've seen was the OOM intervention:
[20944265.175516] Out of memory: Kill process 30346 (go-carbon) score 726 or sacrifice child
[20944265.175782] Killed process 30346 (go-carbon) total-vm:115783724kB, anon-rss:99334204kB, file-rss:0kB
[20946896.158156] perf samples too long (10010 > 10000), lowering kernel.perf_event_max_sample_rate to 12500
[21361096.704491] TCP: TCP: Possible SYN flooding on port 2003. Sending cookies.  Check SNMP counters.

associated with the following error stacktrace in the go-carbon logs:
[2017-07-06T10:45:33.416Z] ERROR [carbonserver] panic encountered {"handler": "fileListUpdated", "stack": "github.com/lomik/go-carbon/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/vendor/go.uber.org/zap/field.go:209\ngithub.com/lomik/go-carbon/carbonserver.(*CarbonserverListener).updateFileList.func1\n\t/home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/carbonserver/carbonserver.go:340\nruntime.call32\n\t/home/travis/.gimme/versions/go1.8.1.linux.amd64/src/runtime/asm_amd64.s:514\nruntime.gopanic\n\t/home/travis/.gimme/versions/go1.8.1.linux.amd64/src/runtime/panic.go:489\nruntime.panicmem\n\t/home/travis/.gimme/versions/go1.8.1.linux.amd64/src/runtime/panic.go:63\nruntime.sigpanic\n\t/home/travis/.gimme/versions/go1.8.1.linux.amd64/src/runtime/signal_unix.go:290\ngithub.com/lomik/go-carbon/carbonserver.(*CarbonserverListener).updateFileList\n\t/home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/carbonserver/carbonserver.go:418\ngithub.com/lomik/go-carbon/carbonserver.(*CarbonserverListener).fileListUpdater\n\t/home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/carbonserver/carbonserver.go:331", "error": "runtime error: invalid memory address or nil pointer dereference"}

[2017-07-06T10:46:02.420Z] ERROR [persister] failed to open whisper file {"path": "/data/graphite/whisper/sprcom/servers/qa/rabbitmq_mothership-qa/queues-MOCacheInvalidationTopic_sgw_SI2_/r
eturn.wsp", "error": "open /data/graphite/whisper/sprcom/servers/qa/rabbitmq_mothership-qa/queues-MOCacheInvalidationTopic_sgw_SI2_/return.wsp: too many open files"}
[2017-07-06T10:46:02.420Z] ERROR [persister] failed to open whisper file {"path": "/data/graphite/whisper/servers/sl-live-aim-03/irq/irq-72.wsp", "error": "open /data/graphite/whisper/serve
rs/sl-live-aim-03/irq/irq-72.wsp: too many open files"}
[2017-07-06T10:46:02.420Z] ERROR [persister] failed to open whisper file {"path": "/data/graphite/whisper/servers/sl-live-rone-ml-master-11_springer-sbm_com/irq/irq-108.wsp", "error": "open
 /data/graphite/whisper/servers/sl-live-rone-ml-master-11_springer-sbm_com/irq/irq-108.wsp: too many open files"}
[2017-07-06T10:46:02.420Z] ERROR [persister] failed to open whisper file {"path": "/data/graphite/whisper/servers/sl-live-static-content-02/df-a05/df_complex-reserved.wsp", "error": "open /
data/graphite/whisper/servers/sl-live-static-content-02/df-a05/df_complex-reserved.wsp: too many open files"}

From our metrics dashboards (which include an external Datadog) we could not see the memory usage spike, and we think it actually happened extremely sudden.
The only evident oddity is, maybe, a visible spike in the number of goroutines just before the processes crashed:
Looking at the source, on the (seemingly) faulty path, we also noticed that the Unlock call to the mutex here is not deferred.
Any help or support on this would be really appreciated :)!
Many thanks,
Claudio Benfatto

I tried and manage to reproduce the bug:
I initially set the scan-frequency carbonserver parameter to a relatively small value:
scan-frequency = "10s"

then I sent 5 metrics to graphite:

for i in $(seq 1 5);do echo "test.metric.$i 1 `date +%s`" | nc -w 1 localhost 20030; done;

accessed and then deleted them:

curl -X GET "http://localhost:10000/render?format=json&target=test.metric.*"
rm -rf /data/graphite/whisper/test/metric/*

sent them again:

for i in $(seq 1 5);do echo "test.metric.$i 1 `date +%s`" | nc -w 1 localhost 20030; done;

At this point I see a panic stacktrace in the go-carbon log file:

[2017-07-07T09:44:30.779Z] ERROR [carbonserver] panic encountered {"handler": "fileListUpdated", "stack": "github.com/lomik/go-carbon/vendor/go.uber.org/zap.Stack\n\t/home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/vendor/go.uber.org/zap/field.go:209\ngithub.com/lomik/go-carbon/carbonserver.(*CarbonserverListener).updateFileList.func1\n\t/home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/carbonserver/carbonserver.go:340\nruntime.call32\n\t/home/travis/.gimme/versions/go1.8.1.linux.amd64/src/runtime/asm_amd64.s:514\nruntime.gopanic\n\t/home/travis/.gimme/versions/go1.8.1.linux.amd64/src/runtime/panic.go:489\nruntime.panicmem\n\t/home/travis/.gimme/versions/go1.8.1.linux.amd64/src/runtime/panic.go:63\nruntime.sigpanic\n\t/home/travis/.gimme/versions/go1.8.1.linux.amd64/src/runtime/signal_unix.go:290\ngithub.com/lomik/go-carbon/carbonserver.(*CarbonserverListener).updateFileList\n\t/home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/carbonserver/carbonserver.go:418\ngithub.com/lomik/go-carbon/carbonserver.(*CarbonserverListener).fileListUpdater\n\t/home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/carbonserver/carbonserver.go:331", "error": "runtime error: invalid memory address or nil pointer dereference"}

and if I render the metrics again:

curl -X GET "http://localhost:10000/render?format=json&target=test.metric.*"

this is what I get:

root@graphite2:~# lsof -p 31809 | grep CLOSE_WAIT
go-carbon 31809 root   11u  IPv6 23789142        0t0      TCP graphite2.domain.com:http-alt->graphite2.domain.com:43314 (CLOSE_WAIT)
go-carbon 31809 root   14u  IPv6 23789147        0t0      TCP graphite2.domain.com:http-alt->graphite2.domain.com:43315 (CLOSE_WAIT)
go-carbon 31809 root   15u  IPv6 23789152        0t0      TCP graphite2.domain.com:http-alt->graphite2.domain.com:43316 (CLOSE_WAIT)
go-carbon 31809 root   16u  IPv6 23789157        0t0      TCP graphite2.domain.com:http-alt->graphite2.domain.com:43317 (CLOSE_WAIT)
go-carbon 31809 root   17u  IPv6 23789162        0t0      TCP graphite2.domain.com:http-alt->graphite2.domain.com:43318 (CLOSE_WAIT)

done it 2 more times:

root@graphite2:~# lsof -p 31809 | grep CLOSE_WAIT | wc -l
10

[]root@graphite2:~lsof -p 31809 | grep CLOSE_WAIT | wc -l*"
15

and finally after enabling pprof and looking at the active goroutines:

goroutine profile: total 52
15 @ 0x42e25a 0x42e33e 0x43ebb1 0x43e894 0x46e2ad 0x46e4a4 0x6f94e8 0x6f83c4 0x6f85c6 0x814654 0x7e8bad 0x7eb926 0x6e5c70 0x45b381
#   0x43e893    sync.runtime_SemacquireMutex+0x33                           /home/travis/.gimme/versions/go1.8.1.linux.amd64/src/runtime/sema.go:62
#   0x46e2ac    sync.(*Mutex).Lock+0x9c                                 /home/travis/.gimme/versions/go1.8.1.linux.amd64/src/sync/mutex.go:87
#   0x46e4a3    sync.(*Once).Do+0x43                                    /home/travis/.gimme/versions/go1.8.1.linux.amd64/src/sync/once.go:40
#   0x6f94e7    github.com/lomik/go-carbon/cache.(*WriteoutQueue).makeRebuildCallback.func1+0xa7    /home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/cache/writeout_queue.go:62
#   0x6f83c3    github.com/lomik/go-carbon/cache.(*WriteoutQueue).get+0x1a3             /home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/cache/writeout_queue.go:101
#   0x6f85c5    github.com/lomik/go-carbon/cache.(*WriteoutQueue).GetNotConfirmed+0x65          /home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/cache/writeout_queue.go:117
#   0x814653    github.com/lomik/go-carbon/cache.(*WriteoutQueue).GetNotConfirmed-fm+0x33       /home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/carbon/app.go:220
#   0x7e8bac    github.com/lomik/go-carbon/persister.(*Whisper).worker+0xec             /home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/persister/whisper.go:218
#   0x7eb925    github.com/lomik/go-carbon/persister.(*Whisper).Start.func1.1+0x45          /home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/persister/whisper.go:272
#   0x6e5c6f    github.com/lomik/go-carbon/helper.(*Stoppable).StartFunc.func1.1+0x2f           /home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/helper/stoppable.go:42
15 @ 0x42e25a 0x42e33e 0x43ebb1 0x43e894 0x46e2ad 0x7c9fbb 0x7d6a00 0x7e1948 0x66e834 0x7e00e2 0x783a8d 0x783bd0 0x66e834 0x66fc70 0x77dadd 0x66e834 0x6710f2 0x66d3a2 0x45b381
#   0x43e893    sync.runtime_SemacquireMutex+0x33                                               /home/travis/.gimme/versions/go1.8.1.linux.amd64/src/runtime/sema.go:62
#   0x46e2ac    sync.(*Mutex).Lock+0x9c                                                     /home/travis/.gimme/versions/go1.8.1.linux.amd64/src/sync/mutex.go:87
#   0x7c9fba    github.com/lomik/go-carbon/carbonserver.(*CarbonserverListener).UpdateMetricsAccessTimes+0x7a                   /home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/carbonserver/carbonserver.go:309
#   0x7d69ff    github.com/lomik/go-carbon/carbonserver.(*CarbonserverListener).renderHandler+0x1d7f                        /home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/carbonserver/carbonserver.go:1041
#   0x7e1947    github.com/lomik/go-carbon/carbonserver.(*CarbonserverListener).(github.com/lomik/go-carbon/carbonserver.renderHandler)-fm+0x47 /home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/carbonserver/carbonserver.go:1547
#   0x66e833    net/http.HandlerFunc.ServeHTTP+0x43                                             /home/travis/.gimme/versions/go1.8.1.linux.amd64/src/net/http/server.go:1942
#   0x7e00e1    github.com/lomik/go-carbon/carbonserver.TraceHandler.func1+0x251                                /home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/carbonserver/carbonserver.go:140
#   0x783a8c    github.com/lomik/go-carbon/vendor/github.com/dgryski/httputil.TimeHandler.func1+0x7c                        /home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/vendor/github.com/dgryski/httputil/times.go:26
#   0x783bcf    github.com/lomik/go-carbon/vendor/github.com/dgryski/httputil.TrackConnections.func1+0xef                   /home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/vendor/github.com/dgryski/httputil/track.go:40
#   0x66e833    net/http.HandlerFunc.ServeHTTP+0x43                                             /home/travis/.gimme/versions/go1.8.1.linux.amd64/src/net/http/server.go:1942
#   0x66fc6f    net/http.(*ServeMux).ServeHTTP+0x12f                                                /home/travis/.gimme/versions/go1.8.1.linux.amd64/src/net/http/server.go:2238
#   0x77dadc    github.com/lomik/go-carbon/vendor/github.com/NYTimes/gziphandler.NewGzipLevelHandler.func1.1+0x15c              /home/travis/gopath/src/github.com/lomik/go-carbon/_vendor/src/github.com/lomik/go-carbon/vendor/github.com/NYTimes/gziphandler/gzip.go:167
#   0x66e833    net/http.HandlerFunc.ServeHTTP+0x43                                             /home/travis/.gimme/versions/go1.8.1.linux.amd64/src/net/http/server.go:1942
#   0x6710f1    net/http.serverHandler.ServeHTTP+0x91                                               /home/travis/.gimme/versions/go1.8.1.linux.amd64/src/net/http/server.go:2568
#   0x66d3a1    net/http.(*conn).serve+0x611                                                    /home/travis/.gimme/versions/go1.8.1.linux.amd64/src/net/http/server.go:1825

I hope this could help fixing the issue ;)

Managed to reproduce this with 0.10.1 too (same procedure)

I tried this change: https://gist.github.com/claudio-benfatto/a443ae2452b97ca6d661fe8c81936248 and it helped fixing the bug caused by the panic in combination with the unreleased lock.
While this would mitigate the effects of the panic itself, it does not solve its root cause, which is to attribute, I guess, to some, not synchronized memory references. The references seem to be updated by a subsequently render operation only

Thanks for the detailed report!
@Civil, FYI

I'll have a look at that monday or so.

Can you please check (and post trace) if you can reproduce that with master branch?
https://github.com/lomik/go-carbon/commit/c539e3466bf3124b56ce548aeb7bd5509b25cffa - this commit changed the logic quite a bit and honestly I can't reproduce that even on 0.10.1

hello, @Civil I confirm that it doesn't seem to happen when using the master branch.
It definitely happens in v0.10.1, and I think this is expected given that the logic didn't really change much in respect to v0.10.0.
The reason why this happens is that at this point: https://github.com/lomik/go-carbon/blob/v0.10.1/carbonserver/carbonserver.go#L410-L421
	if fidx != nil {
		fidx.Lock()
		for m := range fidx.accessedMetrics {
			accessedMetrics[m] = struct{}{}
		}

		for m := range fidx.accessedMetrics {
			if d, ok := details[m]; ok {
				d.RdTime = fidx.details[m].RdTime
			}
		}
		fidx.Unlock()
	}

if you follow the steps I posted, the details dictionary will contain the re-added metrics, while the fidx won't.
And this is because the fidx index was updated during the previous iteration: https://github.com/lomik/go-carbon/blob/v0.10.1/carbonserver/carbonserver.go#L425-L432 when the files were still absent because deleted.
So a panic is generated here: https://github.com/lomik/go-carbon/blob/v0.10.1/carbonserver/carbonserver.go#L418 when you access fidx.details[m].
Anyhow, imho a defer for that lock would be good anyhow, defensively speaking, as the cost of introducing a bug in that area of code, would most likely result in crashing the servers (and the whole cluster).

In case of panic carbonserver should actually stop working, that's saner than trying to run despite of that.
And again if the panic happens there, then the bug is somewhere in how accessedMetrics is populated, because it should contain only keys that are present in fidx.details.
As about this lock - in current code state it shouldn't be deferred, because it might lead to double unlock in case of failure in some other parts of this function. It might though if I'll move that loop into it's own function. Not sure that it's worth it.

I have only a superficial knowledge of the carbonserver code, therefore I'm not going to discuss further the points you highlighted.
However, I want to remark that a panic in that section, given that the goroutines are not bounded, would bring the entire server to resource starvation, and this means that both go-carbon and carbonserver (which are co-located), would stop working (breaking not only the carbonapi api side but also the metric ingestion).

Hi @Civil, I am a colleague of Claudio. About this issue, one of the collateral effects we saw was the persister threads of go-carbon stop working because it runs out of FD (our hard limit is 4096, which was more than enough until we found this issue):
[2017-07-06T10:46:02.421Z] ERROR [persister] failed to open whisper file {"path": "/data/graphite/whisper/sprcom/servers/qa/rabbitmq_mothership-qa/queues-EBooksListenerMDB/rabbitmq_details-messagesrate.wsp", "error": "open /data/graphite/whisper/sprcom/servers/qa/rabbitmq_mothership-qa/queues-EBooksListenerMDB/rabbitmq_details-messages/rate.wsp: too many open files"}

The second effect is go-carbon process does do not die and it keeps throwing those messages in the logs each time it cannot open a file (also filling /var).
The point is, even if the carbonserver panics and stops working cleanly, there is still running the persister part, so, the process is not working properly: it is not doing what it should do and the only way to recover it is restarting the process. In my opinion, your approach of let the carbonserver panics is fine if it runs on its own process and then it crashes and exits (with error code). But, as the persister part (go-carbon) is also running on the same process now both parts of the service (persister and "API" are affected.

We have panic issue with enabled carbonserver as well.

@maggnus the same questions:

Is it still happening with go-carbon from master branch?
If it happens - what's the error message and a stack trace for the panic?

@jriguera well, that's I think very good question how to behave in such situations. My opinion is that we should shutdown go-carbon in that case. It will be impossible to reliably and correctly handle all the cases.
For example in that case we end up having fidx in some unknown state which I don't think is possible to reliably recover.

@Civil

yes

# /opt/go-carbon/bin/go-carbon --version
0.10.1

I did not see any stack trace messages, just OOM Killer notification

Out of memory: Kill process 18913 (go-carbon) score 266 or sacrifice child

@Civil Looks like trigram-index = false help us.

@maggnus still seems to be first of all - separate issue, and secondly - that's still not enough info. What kind of HW/VM do you have? What's the amount of metrics? What's the config file? etc.


feat: added ingress urls to the chart notes

Which problem does the PR fix?
#736
What's in this PR?
I added Ingress URLs for combined and separated Ingress to NOTES.txt
I used https://helm-playground.com to test the NOTES.txt against the values files mentioned here: Combined and separated Ingress setup
Checklist
Please make sure to follow our Contributing Guide.

Before opening the PR:

[x] There is no other open pull request for the same update/change.
[x] The commits follow our Commit Guidelines.
[x] Tests for charts are added (if needed).
[x] The main Helm chart and sub-chart are updated (if needed).
[x] In-repo documentation are updated (if needed).

After opening the PR:

[x] Did you sign our CLA (Contributor License Agreement)? It will show once you open the PR.
[x] Did all checks/tests pass in the PR?

@aabouzaid I fixed some based on the comments you put, but I need the final look so I could work on rendering it

@mustafaelghrib I will get back to this soon.

@mustafaelghrib thanks for your contribution :rocket:
I did a couple of minor fixes and I will merge it now :ok_hand:

@aabouzaid Great, Thanks


Add monitoring for identity columns approaching limit

It would be good to have some monitoring for identity columns that are approaching the limit.  For example a table with an INT identity that is approaching 2 billion rows.
Capture:
Capture identity columns that are within a percentage of the limit.
Reporting:
Show the max % used for an identity column on the dashboard for each instance with warning/critical thresholds.
Have a drill down to show detail for the identity columns captured.
Show:
DB, object_id, object_name, column_name,last value, row count, type, increment, seed, pct used (based on max value for the column type and last_value), pct rows used (based on row count and max number of rows including negative values)
If last_value is negative the % used could be calculated based on the max possible number of rows.

Collection is available in 2.22.0.
Doc Link


Remove version: MicronTechnology.MicronStorageExecutive version 9.09.092023.03

[Automated] It returns code over 400 in all urls
Microsoft Reviewers: Open in CodeFlow

URL: https://media-www.micron.com/-/media/client/global/documents/products/software/storage-executive-software/storageexecutive_windows.exe
Response status code does not indicate success: 404 (Not Found).
(Automated message - build 896)

Hi @Exorcism0666,
This manifest has the highest version number for this package. Is it available from another location? (This might be in error if the version is switching from semantic to string, or string to semantic.)
(Automated response - build 896.)

URL: https://media-www.micron.com/-/media/client/global/documents/products/software/storage-executive-software/storageexecutive_windows.exe
Response status code does not indicate success: 404 (Not Found).
(Automated message - build 896)

URL: https://media-www.micron.com/-/media/client/global/documents/products/software/storage-executive-software/storageexecutive_windows.exe
Response status code does not indicate success: 404 (Not Found).
(Automated message - build 896)

URL: https://media-www.micron.com/-/media/client/global/documents/products/software/storage-executive-software/storageexecutive_windows.exe
Response status code does not indicate success: 404 (Not Found).
(Automated message - build 896)


Revert "raftstore: fix load base split cannot works in pure follower scenario

This reverts commit defc9338fd9e0539db86e0998e4e889334cc94d4.

What is changed and how it works?

Issue Number: Ref https://github.com/tikv/tikv/issues/16314
will use other way to implement.

What's Changed:

Related changes

[ ] PR to update pingcap/docs/pingcap/docs-cn:
[ ] Need to cherry-pick to the release branch

Check List
Tests

[ ] Unit test
[ ] Integration test
[ ] Manual test (add detailed scripts or steps below)
[ ] No code

Side effects

[ ] Performance regression: Consumes more CPU
[ ] Performance regression: Consumes more Memory
[ ] Breaking backward compatibility

Release note

None

/merge


Add docs for vitess connector for changes made in DBZ-7698 & DBZ-7773

Add docs for vitess connector for these changes
https://issues.redhat.com/browse/DBZ-7698
https://issues.redhat.com/browse/DBZ-7773

@jpechane can you review docs updates for these changes we collaborated on? Thank you

@roldanbob Could you please review the PR? Thanks a lot!

Applied, thanks


Hide Image Hover Art not saving

Hi,
This button works, but it resets all the time, and I have to check it again.

Hi Brunocalado,
I believe this happens when you move a token from the actors directory to the canvas but the token setting is not displayed correctly (even though it is working).
I will fix this for next release, let me know if I misunderstood or if you're experiencing a different bug.
Thanks!


More webhook fixes

This updates to use the exception throwing bang methods.
I have also updated the renewing class, we get passed an invoice-object so we need to use event.data.object.subscription to find the subscription instead of object.id
cc: @excid3

I have more tests coming, these stripe ones are just such a slog