How to get rid of bad depths below min-range

Required Info

Camera Model
D415, D435

Firmware Version
5.9.14

Operating System & Version
Win10

SDK Version
2.14.0

Segment
3D Scanning

We use the D415 for 3D Scanning and we frequently run into the issue of users getting too close (below min-range) with the camera, causing a lot of bad/stray points in the depth image, causing some corruption in the resulting model.
We were trying the D4 presets and the tuning parameters but unfortunately they do have a lot of side effects so, although we can theoretically find a setting that minimizes bad depths below min-range, it's not practical since we'd also be getting rid of most of the good depth values.
Hence, we're looking for a way to filter bad points from the depth image before they can corrupt the model. Is there some sort of confidence map that we could get through libRS to help with the filtering? Any other post-processing setting?
Btw, we appreciate all the existing post-processing options but in terms of importance, filtering bad depths below min-range and bad depths due to over-exposure (https://github.com/IntelRealSense/librealsense/issues/1912) would be way above the offered downsampling and spatial/temporal filtering.

If your problem is with users getting too close to the camera lens, the advice in the link below may be of use.
https://communities.intel.com/message/553939#553939

Appreciate the quick response. However, reducing the input resolution is generally not a good option for us as it would come with undesired side-effects and would only move the problem to a closer range, instead of getting rid of it entirely.

Some people have solved the problem of distance between camera and the scan target by mounting the camera overhead, pointing downwards.  Is this an option for the scans that you take?

Unfortunately no, in this case the camera is hand-held or mounted to a tablet that is.

Section 5 of Intel's paper on camera tuning best-practices offers tips for minimum operating distance (MinZ) in section 5 of the paper.
https://www.intel.com/content/dam/support/us/en/documents/emerging-technologies/intel-realsense-technology/BKMs_Tuning_RealSense_D4xx_Cam.pdf

Thanks. Disparity shifts aren't going to work either unfortunately because, like resolution reduction, they only move the problem instead of solving it and they come with a hard trade-off.

So could you confirm please that any solution that involves altering the resolution will not be suitable for you?

Anything that only slightly moves the problem instead of solving it doesn't work for us. Resolution reduction itself may be an option but right now it's simply not worth it if we look at the benefits vs. the side effects.

I wonder if some kind of user feedback in the scanning application would help, such as an on-screen warning being displayed when MinZ was about to be exceeded,.  Or when the sensed distance between camera and object falls below a certain level, depth scanning stops.

Sure, yes. We already do that. Still can't avoid it completely though.

Apologies that this process is taking a while.   It feels like we are making progress through a process of elimination though!
My sense is that D415 probably is an appropriate camera for this application, since new tablets from Panasonic and MobileDemand use the D410 and D415 cameras respectively for their scanning.  So it should work.  The problem is in minimizing bad data from proximity to the object.

Btw, we appreciate all the existing post-processing options but in terms of importance, filtering bad depths below min-range and bad depths due to over-exposure (#1912) would be way above the offered downsampling and spatial/temporal filtering.

Out of curiosity, have you set the "Depth Clamp Min" ? I find it super efficient to get rid of anything too close to my setup.
If I understood correctly, your application consists in scanning objects, which I assume might be close to the user ? If you could specify your scanning range, I might be able to share some of my settings for close range scanning (I'm using the max resolution btw). It is indeed hard to find a configuration that work well for both close and long range scanning.
I think it is worth trying to nicely set up the ".json" parameters before doing any extra post processing. Please let me know if you are interested.

Thanks Antoine!  Yes, I was thinking of Depth Clamp Min / Max too, though wasn't sure if it would be one of the resolution-changing options that xtrawurst is keen to avoid.
Thanks for your help!  Any insights you can offer would be welcome.

@AntoineWefit
Thanks for your comment. "Depth Clamp Min" does not help because it only eliminates good depth points in the first place. The erroneous false positive depths caused by physically going below min-Z are typically quite a bit above min-Z.
So you'll find that if you get too close (below min-Z) to your setup you will get false positive depth values.
   There is a thin line between stupidity and inspiration though, so I will take the chance.
If the tablet was mounted to some kind of short tripod that the user moved around in their hands, and the camera was attached to the tripod a bit behind the tablet in a way that didn't obscure its view, then it would be physically very hard for users to get the camera close enough to the object to go past MinZ, because the tablet would reach the object first.

@xtrawurst
I have to admit that I'm a bit confused

Depth Clamp Min" does not help because it only eliminates good depth points in the first place. The erroneous false positive depths caused by physically going below min-Z are typically quite a bit above min-Z.
So you'll find that if you get too close (below min-Z) to your setup you will get false positive depth values.

Could you explain how/where did you find that ? I might have missed, or completely misunderstood something.
From what I tried, I understood that both "Depth Clamp Min/Max" are setting a range of depth for the scanning process. Anything below or upper those limits is basically ignored, and I didn't notice any loss of quality whatsoever on what is left in the scanning area (again, I'm not an expert, I only have experimented a few things).
Why not setting the "Depth Clamp Min" (yes, I like this parameter !) to 5000 (with "Depth Units" set to 100), so you are within your scanning range, and anything closer won't be processed by the camera ? You won't have any bad/erroneous points (in fact, you won't have any points at all).
I also think that the max achievable "depth perception" is in theory 0.1 mm, by setting the "Depth Units" to 100 (correct me if I'm wrong), thus, it may be hard to deal with artifacts below this size.

Our scanning range is 0.5 m to 3 m.

I know that it is possible to scan objects close to 0.25 m with the D400 series (with decent quality), so 0.5 m is not that close and should not be a problem.
@MartyG-RealSense

it would be physically very hard for users to get the camera close enough to the object to go past MinZ, because the tablet would reach the object first.

Looks like a physical/hardware type of "Depth Clamp Min" to me :) in fact, a simple and efficient way to the problem !

@AntoineWefit What happens to the depth in your setup when you bring something (e.g. a large piece of cardboard) physically close to the camera (say 15 or 20 cm)?

@xtrawurst I told you, the cardboard is completely ignored :) The data left aren't affected.
The field of view will obviously be blocked if the cardboard is very big, but the camera won't see it.
There will be a "shadow" of the cardboard projected on your object.
I could attach some pictures of a demonstrative setup tomorrow if you want to.

@AntoineWefit  Yes, if possible please post a video of RS Viewer running (showing the depth), where you bring a large piece of cardboard closer and closer to the camera. I'd be very interested in that.

I'm sorry I can't provide a video, but you can easily reproduce these conditions yourself.
I simply put a cup in front of the object a want to scan (the box). The goal is to ignore anything too close to the camera (the cup), see by yourself :
Here are some screenshots :
"Situation 1" plastic cup in front of the box + no "Depth Clamp Min"

"Situation 2" plastic cup in front of the box + "Depth Clamp Min" set to 3400 (340 mm) to ignore the cup

As you see, there is no vertices in front of the box in "Situation 2", where the cup should be.
Be aware that you'll most certainly need to tinker the "Disparity Shift" to get the best quality if you modify  the "Depth Clamp Min/Max".
Let me know if that answered your question.

@AntoineWefit Thanks for providing the examples. Some questions:

How close is the cup to the camera physically?
What happens if you bring the cup closer (20 cm, 10 cm)?
What is your disparity shift setting?
What happens if you bring your RS camera really close to the white wall in the background (20 cm, 10 cm)?

@xtrawurst
You're not crazy, I see these effects too. As I bring my hand closer to the camera (streaming colourised depth on D415), the camera first 'blacks out' my hand at say 25cm, then if I move it closer still (to <20cm) it goes all speckly with patches of different colours on my hand. If I mouseover these patches it returns a variety of distances, 0.5m, 1m etc. This happens even if I put the clamp on. My hand will go black sooner because the camera sees it as too close, then when I move it closer it will light up again because it thinks the depth values are legit and greater than the clamp.
To partially get around this, we recognise when the subject first goes out of range, or gets too close to the near extreme, and tell the user to move backwards. Doesn't help if the user starts off too close though!

@xtrawurst
I dismantled the setup but :

Less than 340 mm, so I'd say it was at around 250 mm.
The "shadow" of the cup projected on; the scanned object and everything behind the cup; will be bigger and will occult a bigger part of the scenery. (Have to check if what @jb455 said happens too)
You can check the values on the screenshots.
Depends if you change the parameters or not :

Same parameters : I think that, with the "Depth Clamp Min" set up to 3400 (so 34 cm), you won't see anything on the depth stream if you come closer than that.
Different parameters : let's say no "Depth Clamp Min"; your camera will still see the scenery (depending on many other parameters) until it reaches the minimal working distance. And at this point, you won't get any good data obviously.

You should really try this yourself, because it's not that difficult to set up and I'm not sure that my explanations are clear enough.
@jb455
I might had experienced that too (can't remember precisely though), but I think that also happened when being excessively close to the camera. I will try to check that out.

@AntoineWefit Thanks. Sorry, hadn't noticed the parameter settings on the left.
I'm sure what's helping you in your case is the big disparity shift of 100, not the "depth clamp min".
I'm also sure you'll see a lot of bad depths if you reset the disparity shift to 0 or if you try to see past, say, 1m in depth.
As I said before a disparity shift wouldn't solve the problem for us as our scanning range is up to 3m.

Dropping back into this excellent conversation for a moment ...   :)
Regarding the 'tablet and camera on a tripod' concept above: the 400 Series cameras' tripod attachment screw-thread on the bottom of the camera is apparently a standard thread-size for tripods.  So it might not be too difficult to screw the RealSense camera onto the top of the tripod, behind the tablet, without needing a special mount for the camera.
https://communities.intel.com/message/524440#524440
Intel's own documentation shows them using a tripod other than the one supplied with the camera.  They state: "Any medium sized tripod should be sufficient.  In this example setup, we used a Manfrotto Compact Light Aluminum Tripod with ball head.  The ball head makes
adjustment to device orientation easier".

@xtrawurst

I'm sure what's helping you in your case is the big disparity shift of 100, not the "depth clamp min".

Yes and no, I found that both impact the data quality quite a lot.

I'm also sure you'll see a lot of bad depths if you reset the disparity shift to 0 or if you try to see past, say, 1m in depth.

Yes, I think so ! As I said before, it is difficult to find parameters that will suit a big range of depth.

As I said before a disparity shift wouldn't solve the problem for us as our scanning range is up to 3m.

I didn't test anything at that distance, so I can't say anything on that, sorry.
@MartyG-RealSense
Something like that maybe ? (maybe without the overkill-clamp-thingy, but you get the idea).

@RealSense-Customer-Engineering
Any ideas w.r.t. the original question?

Hey @RealSense-Customer-Engineering @RealSenseCustomerSupport  I am facing the same problem as @xtrawurst
I have the depth clamp set too. Lowering the resolution or changing the disparity shift would just shift the error. I have attached the pictures describing the error. As an object(my hand here) comes closer to the camera, there seems to be many wrong depth values calculated and shifted behind as you can see in the second image.This seems to be an inherent problem with the type of imaging I guess as the SR300 does not cause such errors, being a coded-light sensor camera.
Is there any solution to this issue provided by realsense or would I have to do a bit of post-processing?

As your hand becomes sufficiently close to the camera to pass under its minimum depth, the image will start progressively breaking up as the hand gets closer and closer to the lens.  Using a disparity shift would normally allow the hand to get closer.  I understand though why this is not an option for you (other users have opted not to use a disparity shift because they do not want to change the data).
Section 8b on page 6 of Intel's tuning guide PDf offers advice about using the camera at very close range and explains why matching between the left and right imagers can break down at this range with stereo cameras.
https://www.intel.com/content/dam/support/us/en/documents/emerging-technologies/intel-realsense-technology/BKMs_Tuning_RealSense_D4xx_Cam.pdf

Is there any solution to this issue provided by realsense or would I have to do a bit of post-processing?

@srinath-iko Did you try to tune the Min Distance of the Threshold Filter ? You'll have to enable the post-processing in the Viewer : go to Stereo Module / Post-Processing / Threshold Filter / Min Distance. It should get rid of every data below that value of distance.

I think that it could be a solution for you :)
Hope this'll help !

@MartyG-RealSense
Thank you for the suggestion. The depth unit size wouldn't change the inherent errors caused. It again just shifts the error.
@AntoineWefit
Thank you for the input. I tried the post-processing threshold too. Although this gets rid of the data below the minimum distance, if an object goes near, the depth points are still present at the wrong location as they are calculated to be behind the threshold minimum.

@srinath-iko @RealSense-Customer-Engineering
I concur. The issue is that the D400 series cannot disambiguate false positive depth values from true positive depth values well. There are some tuning parameters for the depth algorithm but typically these reduce false positive depths and true positive depths equally, so not always a good trade off.
What would be required is a clean-up algorithm in the driver or on the chip that's designed solely to get rid of false positive depth values. The old venerable Primesense PS1080 had this and I believe Occipital is doing this in the driver for their new Structure Core sensor. Both with very good results.
It's a big, big missing feature in the, otherwise excellent, RealSense offering that I still hope is going to get filled at some point.

@xtrawurst The lack of a 'confidence threshold' in the 400 Series to decide if a value is valid or invalid is a consequence of the stereo depth technique.  The SR300, which is based on coded light / structured light, does have confidence threshold support.  @dorodnic comments on the subject here:
https://github.com/IntelRealSense/librealsense/issues/3185#issuecomment-460540961

@MartyG-RealSense @xtrawurst
Yes, I did check @dorodnic 's comments. its an inherent issue with the method of imaging that can only be solved with a few custom post processing steps.
Thanks!


Added Laravel 6.0.x compatibility

Description
Thix fixes #20 in the v2 branch, and fixes a code style issue.
Motivation and context
I'd like to use the package with Laravel 6.0
How has this been tested?
I've tested this with a clean Laravel 6 installation.
Types of changes
What types of changes does your code introduce? Put an x in all the boxes that apply:

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:
Go over all the following points, and put an x in all the boxes that apply.
Please, please, please, don't send your pull request until all of the boxes are ticked. Once your pull request is created, it will trigger a build on our continuous integration server to make sure your tests and code style pass.

[x] I have read the CONTRIBUTING document.
[x] My pull request addresses exactly one patch/feature.
[x] I have created a branch for this patch/feature.
[x] Each individual commit in the pull request is meaningful.
[x] I have added tests to cover my changes.
[x] If my change requires a change to the documentation, I have updated it accordingly.

If you're unsure about any of these, don't hesitate to ask. We're here to help!

Hi @sandervanhooft, this is my first PR ever, so please do let me know if I should things otherwise. Thanks!

Thanks! One tip: keep an eye on the Travis build status.

Nice first PR @janmaarten, thanks! 🎉

Just released it (1.1.0)

Ha, so proud 💃  Thanks :)

Hm, it seems like you tagged the master branch from 05/12/2018 as 1.1.0 @sandervanhooft.

Ouch, seems like I missed that you were working on the v2 branch, which is still in development

#22

My bad. Just released 1.2.0 to fix this.
https://github.com/sandervanhooft/laravel-invoicable/releases/tag/1.2.0


Fix: DRONE_SERVER_PORT isn't valid for drone 0.4

Signed-off-by: Chengwei Yang<EMAIL_ADDRESS>

fixed in newer 0.4 Dockerfile


Fix fabric.io provider setup fix

The FabricProvider and Fabric itself uses an NSArray as initializer arguments. But the ARAnalytics uses an in-corresponding type. (NSDictionary)

Oh yeah, there is it, any chance you can note this in the changelog too please

Oh, yeah, just recalling that I have to do so

Thank you, :+1: - just going to wait on CI now


Subclassing torch._C._TensorBase is not supported

When using the latest version of PyTorch, users are seeing the following error: "RuntimeError: Cannot subclass _TensorBase directly"
https://github.com/pytorch/pytorch/issues/131463
This happens because PyTorch recently started forbidding subclassing from the raw c++ _TensorBase type in favor of subclassing torch.Tensor directly. Subclassing the base type is very unsafe as many methods on it actually assume attributes from Tensor are there and so it is not really a valid class to use ever.
Unfortunately, the trick used in https://github.com/patrick-kidger/torchtyping/blob/1f3749c5b5617ec6b6449e98ad9ae3fb6645ef54/torchtyping/tensor_type.py#L32 to create the mixing based on type(torch.Tensor) makes it so that the meta type sees a new class of that metatype being created without torch.Tensor being the base class. Hence triggering the error.
I'm not sure why we need the extra step of creating the mixin and then having the final class inherit from Tensor here https://github.com/patrick-kidger/torchtyping/blob/1f3749c5b5617ec6b6449e98ad9ae3fb6645ef54/torchtyping/tensor_type.py#L176 but avoiding the mixin and have the base class be class TensorType(torch.Tensor, metaclass=_TensorTypeMeta): would avoid this issue.
Not sure if that is a proper fix though.

Unfortunately torchtyping has long been deprecated in favour of jaxtyping -- which despite the historical name, does not depend on JAX and does support PyTorch. (And does far fewer evil things under the hood... although it does still try to subclass the metaclass, do you know if it also goes wrong here?)
At any rate, I'd recommend that the issue reporter update to using jaxtyping instead!

Hello all, which version of Pytorch should I roll back to solve this issue?

torch < 2.4 should work in terms of releases. For nightlies would need to check a bit more carefully
Sorry for the churn here. If you think this is a going to lead to a lot of churn and cannot be worked around in dependencies, I'm willing to consider reverting that change in PyTorch, I wasn't expecting anyone to use this by side effect :/

I'm happy either way! I can press the button on a new release of torchtyping if need be.

Thanks for the quick turnaround @patrick-kidger  !


[ShowAsTree] ShowAsTree property causes error

Hi,
We faced an issue with the ShowAsTree property on the page we created to implement requirements. When the source table of this page contains more than 100000 records, the last record cannot be selected using the FindLast function or using UI. The following error is shown:

This error was reproduced on different web browsers and does not depend on their settings.
We managed to reproduce this error on the demo database (D365BC 18.0 BE and D365BC 19.2 BE) on page 9900 (Code Coverage). When several objects are loaded (for instance, by pressing the Load country objects action), the same error is displayed when the last record is selected using the Ctrl+End shortcut.
Is it possible to fix this issue? Or, probably, there are some ways to overcome this issue?

Do you consider to request hotfix via technical support? This is not an extensibility question.

Thank you for reaching out. Your request could be reporting a product bug not related to the AL application extensibility. Please reach out to the relevant support channels:

For collaboration in preview or beta versions of AL Language in Visual Studio Code (aka ModernDev), use GitHub (https://github.com/microsoft/al).
For Microsoft partners, for versions already in general availability and supported, file requests through Microsoft Partnersource (https://mbs.microsoft.com/partnersource/).
For ISVs/VARs who have discovered a bug in a in preview or beta version, use MS Collaborate (https://docs.microsoft.com/en-us/collaborate/).
For Business Central customers who have issues or found bugs, please contact your Microsoft partner.
For the new features please submit a product suggestion on https://aka.ms/bcideas


Consider using docker-compose for stand-alone deployments

Addition Description
Docker-compose is one way to orchestrate docker services. It allows users or devs to define infrastructure-as-code and could help users deploy this plugin more easily.
Current Behavior
Docker services are built and launched one at a time
Proposed Behavior
Provide infrastructure to deploy q2galaxy along with the rest of galaxy, perhaps like this:
https://github.com/bgruening/docker-galaxy-stable
Questions
Project scope: Given that Qiime2 is focused on end users, deployment and orchestration could be out of scope for this plugin
Where's the best place to put this code? Within this repo, a separate repo, or as part of an existing docker infrastructure project?
What orchestration engine to use? Why not use Kubernetes instead of docker-compose?

User stories:

Qiime2 forums x-ref; user successfully deploys docker and q2galaxy on AWS, but has some trouble setting up ports

Thanks @colinbrislawn,
These are good suggestions. Our base image is already made out of the linked container, but I suspect I could be using it better.
Creating a docker-compose file might be a nice way to skip some initial deployment issues on cloud infrastructure.
We can probably just put something like that in this repo for the sake of convenience. The dockerfile is similarly here.

In this context, what do you mean by user admin? Like, login or SSO? How is this handled now and can you see how it's addressed by that other docker-compose galaxy repo?

The currently baked image assumes single user mode, no password, etc. That's not ideal for internet facing services, so I would need to look into how the base image handles these things (our image inherits from bgruening/docker-galaxy-stable).


Use ICS4Wrapper to send raw IBC packets & fix Fee middleware in wasm stack

This PR adds an ICS4Wrapper to the wasm keeper, which serves as the interface for sending raw IBC packets. This feature enables the chain to use middlewares with IBC-enabled contracts.
As of v0.31, the Fee middleware is only configured for incoming packets, as shown in this code snippet: link. On the other hand, for outgoing packets, the wasm keeper directly uses the IBC channel keeper, as shown here: link. Consequently, the Fee middleware is bypassed for outgoing packets. Since IBC relayer fees are paid on the sending chains, this means that a relayer can be paid for relaying IBC packets to wasmd but not for relaying packets from wasmd.

Thanks for the CR. I'll fix everything on Sunday.

I'll fix everything on Sunday.

Enjoy your weekend. I will merge the PR as it is and inline the interface in a new PR

Oh cool, thanks!


Difficulty dropping on bottom half of item with multiple divs

Here's an example
Try to drag any item to the bottom half of another item. This is most apparent when dragging over the bottom half last item in the list, it is very difficult to drop something at the bottom of the list.
If you use just a single larger div inside the draggable div, then it works fine.

I can verify that. The problem is in isMouseInFirstHalf, specifically when calculating the mousePointer position. The 20px offsetTop of the bottom div would need to be added to calculate the mousePointer relative to the li element correctly.
Might be worth a try to refactor the whole positioning algorithm to be a bit more elegant and work in IE without workarounds. Actually, this might work correctly in (old versions of) IE, since it triggers the event on the ul element rather than the element it is actually over.

A rudimentary workaround for this is to have a div overlay on top of problematic list items like this while you are dragging something (use dragstart and dragend to determine when you are dragging). Here's my CSS
.dropzone .dndOverlay {
  position: absolute;
  top: 0;
  bottom: 0;
  left: 0;
  right: 0;
  z-index: 99999;
  opacity: 0;
}

The example in the opening post now works well with the new positioning algorithm in version 2.0


[StarRocks] Update README.md

Adding in StarRocks, a database that can read delta lake.  Database was mentioned at the DataBricks keynote this year.  https://www.youtube.com/watch?v=CU8krhcNI2M&t=88s

Which Delta project/connector is this regarding?

[ ] Spark
[ ] Standalone
[ ] Flink
[ ] Kernel
[X] Other (StarRocks)

Description

added links to starrocks.
How was this patch tested?

yes via preview.
Does this PR introduce any user-facing changes?

Yes. It's just adds a link to the README.

@allisonport-db Is there a way you can help with this PR?


Feature Request: Publish to AWS SAR

Hello,
I think it'd be a good idea to have this published in AWS Serverless Application Repository to make users deployment of this almost easier. Plus, it has the benefit to give you out-of-the box analytics counting the number of deployments ;)
Thanks for your consideration,

Thank you for the suggestion. Publication for easier consumption/deployment is on our roadmap, in at least one of a few different ways.


how to get higher fps than 60

i tested a simple demo on win10 with qt, only 1 triangle in the scene,the highest fps is 60,
if (m_renderer->beginFrame(m_swap_chain.get()))
{
m_renderer->render(m_view.get());
m_renderer->endFrame();
}
my card is 2080ti, i should get much higher fps than 60.

Filament doesn't limit frame rate, you'll have to look at how you've setup Qt or how you schedule frames.

in the official animation sample, in FilamentApp::get().animate callback, the fps is around 54 only without qt,why the fps so low

The sample schedules frames badly using a fixed timestep of ~16ms, it doesn't try to use vsync at all. It has nothing to do with performance.


losing wallet assets through a tlegram bot

Unfortunately, I was scammed 5 days ago through a Telegram bot called “Ton Ston.” My balance was reduced to zero, even though the transaction shows as unsuccessful, and the destination address is the same as my wallet address.
Can anyone guide me on whether it is possible to recover my funds or not?

Hi there,
We use GitHub issues as a place to track bugs and other development-related issues.
Please see the link below to our dedicated support line:
Help Center :  Click Here
Ticket ID: WB240
Note: Click on the live chat icon at the bottom corner of the page to start a conversation.

Hi there,
Falling victim to a cryptocurrency scam can be frustrating, but there’s hope for recovery. I will refer you to the official general support page for this case to be reviewed and investigated. Use the chat icon on the page to initiate a chat with an agent for further assistance via Ton-Blockchain Live chat support.

Unfortunately, I was scammed 5 days ago through a Telegram bot called “Ton Ston.” My balance was reduced to zero, even though the transaction shows as unsuccessful, and the destination address is the same as my wallet address.
Can anyone guide me on whether it is possible to recover my funds or not?

Thanks for bringing this issue to our attention. For a quicker resolution, we recommend reaching out to our live support team. Simply click the live chat icon located at the bottom corner of the page, and one of our support agents will assist you right away.
Support: Ton-Blockchain Help Center
Note: Click on the live chat icon at the bottom corner of the page to start a conversation


relative Urls in Email Links

As far as I can see if you use the StreamlineField in the Email Body as described in the documentation:
class SaleEmail(Campaign):     body = StreamField(DefaultBlocks())
All Page and Document Links inserted with the Editors Link Buttons have relative Urls.

Unfortunately this is a problem with Wagtail, if you have a single Site, all links inserted using richtext edit handler are relative instead of absolute. You can get around this by adding another dummy Site via the admin that isn't active.
A better solution would be to use a hook to alter the richtext link handlers so they are always absolute or create a richtext field specific for emails that handles this?

my solution was to add custom link handlers to wagtail_hooks
and make sure that my newsletter app gets called after birdsong in the settings.
That seems to work.
But it might not be the best/shortest code possible.
I you want to i could include it in a pull request.
`# Link Handlers for absolute Urls
from django.utils.html import escape
from wagtail.core import hooks
from wagtail.core.rich_text import LinkHandler
from wagtail.core.rich_text.pages import PageLinkHandler
from wagtail.documents.rich_text import DocumentLinkHandler
from wagtail.core.models import Site
from django.core.exceptions import ObjectDoesNotExist
class AbsoluteLink(object):
@classmethod
def getAbsoluteLink(cls, page):
try:
root_path = Site.get_site_root_paths()
# that is probably not ideal but worked for me
root_url = root_path[0].root_url
page_url = page.url
full_url = f"{root_url}{page_url}"
return f''
except (ObjectDoesNotExist, KeyError):
return ""
class PageAbsoluteLinkHandler(PageLinkHandler):
identifier = "page"
@classmethod
def expand_db_attributes(cls, attrs):
try:
page = cls.get_instance(attrs)
return AbsoluteLink.getAbsoluteLink(page)
except (ObjectDoesNotExist, KeyError):
return ""
class DocumentAbsoluteLinkHandler(DocumentLinkHandler):
identifier = "document"
@classmethod
def expand_db_attributes(cls, attrs):
try:
document = cls.get_instance(attrs)
return AbsoluteLink.getAbsoluteLink(document)
except (ObjectDoesNotExist, KeyError):
return ""
@hooks.register('register_rich_text_features')
def register_link_handler(features):
features.register_link_type(DocumentAbsoluteLinkHandler)
features.register_link_type(PageAbsoluteLinkHandler)
`

I'm not sure about making this the default approach for the plugin, this will affect all richtext fields, event outside of emails.
This implementations also assumes we want the first site root path which isn't always correct, you could call page.full_url for pages, and it's probably safe to assume that Site.objects.get(is_default_site=True) is correct for documents. Maybe putting it behind a flag is the best approach and documenting how to switch it on/off

good advice. i changed it as you suggested.
instead of
@hooks.register('register_rich_text_features')
i could use
@hooks.register_temporarily('register_rich_text_features')
so it only affects the rich text fields in the birdsong campaing.
but then i have to move it to editor.py.
I already tested it and it seems to work.
should i provide that code to you ?
and do you think a flag is still necesarry?


symbol lookup error - undefined symbol "dlamch_" when using LAPACK in OpenBLAS

Hi,
I encountered the following error when trying to use LAPACK from OpenBLAS:
/usr/lib/jvm/java-8-oracle/jre/bin/java: symbol lookup error: /tmp/jniloader7041787223867102319netlib-native_system-linux-x86_64.so: undefined symbol: dlamch_
The wrapper calling the OpenBLAS shared library is netlib-java.
The Makefile.rule I've used is
VERSION = 0.2.19
BINARY=64
USE_THREAD = 1
BUILD_LAPACK_DEPRECATED = 1
COMMON_PROF = -pg

the links are
sudo update-alternatives --install /usr/lib/libblas.so     libblas.so     /opt/OpenBLAS/lib/libopenblas.so 1000
sudo update-alternatives --install /usr/lib/libblas.so.3   libblas.so.3   /opt/OpenBLAS/lib/libopenblas.so 1000
sudo update-alternatives --install /usr/lib/liblapack.so   liblapack.so   /opt/OpenBLAS/lib/libopenblas.so 1000
sudo update-alternatives --install /usr/lib/liblapack.so.3 liblapack.so.3 /opt/OpenBLAS/lib/libopenblas.so 1000

If I change the last two to use default lapack like from sudo apt-get install liblapack-dev, I do not see the above error
I'm not sure what I did wrong, any help or advise is greatly appreciated.
EDIT:
to follow up, I checked the content of libopenblas.a with
ar t /opt/OpenBLAS/lib/libopenblas.a | grep dlamch
and was not able to find anything

to follow up, I checked the content of libopenblas.a with
 ar t /opt/OpenBLAS/lib/libopenblas.a | grep dlamch
and was not able to find anything

As far as I can see, dlamch should be included unconditionally (and my x86_64 builds definitely have it) anything in your build logs about leaving out driver/others ? (Also make sure that the libopenblas in /opt/OpenBLAS/lib is actually the one you built...)

Hi, thanks for the reply!
I re-ran make again and checked with ar on the file in the OpenBLAS build directory just in case, and still same result.
output of make did not mention anything about dlamch in particular, and only mentions entering and leaving /driver/others:
...
make[1]: Entering directory `/home/ubuntu/OpenBLAS-0.2.19/driver/others'
gcc -O2 -DMAX_STACK_ALLOC=2048 -fopenmp -Wall -m64 -DF_INTERFACE_GFORT -fPIC -DNO_LAPACK -DNO_LAPACKE -DSMP_SERVER -DUSE_OPENMP -DMAX_CPU_NUMBER=4 -DASMNAME=memory -DASMFNAME=memory_ -DNAME=memory_ -DCNAME=memory -DCHAR_NAME=\"memory_\" -DCHAR_CNAME=\"memory\" -I../.. -c memory.c -o memory.o
...
ar  -ru ../../libopenblas_sandybridgep-r0.2.19.a memory.o xerbla.o c_abs.o z_abs.o openblas_set_num_threads.o openblas_get_num_threads.o openblas_get_num_procs.o openblas_get_config.o openblas_get_parallel.o openblas_error_handle.o openblas_env.o blas_server.o divtable.o blasL1thread.o init.o parameter.o
make[1]: Leaving directory `/home/ubuntu/OpenBLAS-0.2.19/driver/others'

--
As a side note, this error seems to occur only on an EC2 instance (m3.2xlarge, Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz)
I tried OpenBLAS on a different local machine with Intel(R) Core(TM) i7-4770K CPU @ 3.50GHz, running
ar t /opt/OpenBLAS/lib/libopenblas.a | grep dlamch
shows
dlamch.o
lapacke_dlamch.o
lapacke_dlamch_work.o

both are running ubuntu 14.04

Hmm. Is the -DNO_LAPACK in that log snippet intentional, given that you mentioned using BUILD_LAPACK_DEPRECATED=1 in your Makefile.rule above ?

I'm not sure about -DNO_LAPACK, the only thing I changed from the OpenBLAS Readme is the Makefile.rule, as I found that turning on CPU_AFFINITY worked better for my code.
I left BUILD_LAPACK_DEPRECATED=1 alone, which was the default setting.
I also make sure to do make clean.

If you did not set NO_LAPACK=1 in Makefile.rule , the explanation could be that the EC2 setup lacks a
usable FORTRAN compiler ?

 That was very silly of me. I will try again and update.

Hi, the fortran compiler was indeed the issue. Thanks so much for the quick response!


Modified CORS middleware with Redis cache workflow

At application startup:

Fetch CORS settings from application resources application-config
Fetch CORS from env variable and asure all this origins represented in resource application-config
Write it to Redis cache

With /cors endpoint each user can add more origins to CORS application-config, after it the cache and 'allowed_origins' will be extended. List of all allowed origins available only to Moonstream admin.
As a source used design doc: https://docs.google.com/document/d/1ZGXAvGTH1zj3jr4hUWN-0-9VHrHcAgcQBYvywqg3WpM/edit#heading=h.5gdp4oo0iu7i
Tested locally.

@kompotkot : Did you profile how long it takes to resolve requests using this new middleware compared to how long it took to resolve requests in previous scheme?

@kompotkot : Did you profile how long it takes to resolve requests using this new middleware compared to how long it took to resolve requests in previous scheme?

No I did not run profile tests.

@bugout-dev

[ ] First add Redis to playbook

@bugout-dev check

[ ] Add env vars for redis


Updated to properly parse error for callables in [$class,$method] format.

When i used Slim3 with callables '\App\Controller\Main','mainMethod' when there weren't class loaded, instead of proper error i was getting conversion array to string errors from previous line. This patch fixes the issue by json_encoding the callable before trying to sprintf %s it.

Coverage remained the same at 96.603% when pulling 784ffa48212161f59a6b62c9c6387aa48943f7f4 on Setitch:3.x into 30cfe3c07dac28ec1129c0577e64b90ba11a54c4 on slimphp:3.x.

FILE: /home/travis/build/slimphp/Slim/Slim/CallableResolver.php
----------------------------------------------------------------------
FOUND 0 ERRORS AND 1 WARNING AFFECTING 1 LINE
----------------------------------------------------------------------
 82 | WARNING | Line exceeds 120 characters; contains 158 characters
----------------------------------------------------------------------

Can you provide a unit test for this. Also there's a build failure.

Oh, sorry for no unit testings, i just saw you answered me here:(

No worries :) Thanks for fixing the issue.


Submit a Cloud Definition

Do NOT copy/paste a definition from somewhere else. Read about the word you want to define and come up with your own definition. Copy/Paste submissions will be closed and not added.
Fill out the JSON with your submission:
    {
    "word": "Endpoint",
    "content": "A combination of IP address and port number. For example: <IP_ADDRESS>:2020; where 2020 is the port number.",
    "learn_more_URL":"https://subscription.packtpub.com/book/cloud-and-networking/9781783986545/1/ch01lvl1sec10/creating-an-endpoint#:~:text=A%20pair%20of%20values%20consisting,network%20is%20called%20an%20endpoint.",
    "tag":"networking",
    "abbreviation": "",
    "author_name":"Ella Adeka",
    "author_link": "https://github.com/ella-adeka/"
    }

Fill out the JSON below with the following.
Word (REQUIRED)
The word you are defining. Check this URL for all words we currently have.
Content (REQUIRED)
The definition. No more than 3 sentences.
learn more URL (REQUIRED)
Website where people can visit to learn more about the word.
tag (REQUIRED and select one)
Tech category the word fits in. Options:

compute
security
service
general
analytics
developer tool
web
networking
database
storage
devops
ai/ml
identity
iot
monitoring
cost management
disaster recovery

abbreviation (OPTIONAL)
If the word is commonly abbreviated, please provide it. For example, command line interface is often abbreviated as CLI.
author name (REQUIRED)
Your name.
author link (REQUIRED)
The URL you want your name to link to.

Added, https://definethecloud.guide/endpoint, thank you for the contribution


test attempt to increase max collection name length from 64 chars to 256

Scope & Purpose
Increase maximum collection name length from 64 chars to 256.

[x] Strictly new functionality (i.e. a new feature / new option, no need for porting)
[x] The behavior change can be verified via automatic tests

Testing & Verification
This change is already covered by existing tests, such as shell-collection.js.
This will need adjustments in the docs, and potentially for some of the drivers, so please keep this PR open for now and don't merge it.

https://<IP_ADDRESS>/view/PR/job/arangodb-matrix-pr/6817/

https://jenkins01.arangodb.biz/view/PR/job/arangodb-matrix-pr/6826/

https://jenkins01.arangodb.biz/view/PR/job/arangodb-matrix-pr/6875/

Note: may affect drivers and needs a documentation PR.


Many admissions do not have dx code

Hi, I run the following query to count the number of admissions using icd9/icd10 code but found many admissions without dx code:
select p.anchor_year_group,icd_version, count(distinct ad.hadm_id) as ad_count from `physionet-data.mimic_core.admissions`  as ad
left join `physionet-data.mimic_hosp.diagnoses_icd` as dx
on ad.hadm_id = dx.hadm_id
left join `physionet-data.mimic_core.patients` as p
on p.subject_id = ad.subject_id
group by icd_version, p.anchor_year_group
order by p.anchor_year_group

Row | anchor_year_group | icd_version | ad_count |
-- | -- | -- | -- | --
1 | 2008 - 2010 | 10 | 36000 |
2 | 2008 - 2010 | null | 74496 |_
3 | 2008 - 2010 | 9 | 120819 |
4 | 2011 - 2013 | 9 | 96763 |
5 | 2011 - 2013 | null | 1796 |
6 | 2011 - 2013 | 10 | 23110 |
7 | 2014 - 2016 | 10 | 54068 |
8 | 2014 - 2016 | 9 | 42165 |
9 | 2014 - 2016 | null | 2150 |
10 | 2017 - 2019 | 10 | 70152 |
11 | 2017 - 2019 | null | 3011 |

Hm, odd. Nothing jumps to mind about why this would happen but I'll look into it.

This was caused by an internal data issue - we've since fixed the data pull and this is no longer an issue. For full transparency this issue affected the diagnoses_icd, procedures_icd, hcpcsevents, and drgcodes tables. https://mimic-iv.mit.edu/docs/overview/changelog/#mimic-iv-v10
Row | anchor_year_group | icd_version | ad_count |
-- | -- | -- | -- | --
1 | 2008 - 2010 | 9 | 194705 |
2 | 2008 - 2010 | 10 | 36157 |
3 | 2008 - 2010 | null | 449 |
4 | 2011 - 2013 | 9 | 97790 |
5 | 2011 - 2013 | 10 | 23204 |
6 | 2011 - 2013 | null | 371 |
7 | 2014 - 2016 | 9 | 42881 |
8 | 2014 - 2016 | 10 | 54736 |
9 | 2014 - 2016 | null | 470 |
10 | 2017 - 2019 | 10 | 71645 |
11 | 2017 - 2019 | null | 1340 |
12 | 2017 - 2019 | 9 | 2 |
Thanks for the report!


Update Content Pages “homePage”

Automatically generated by Netlify CMS

Deploy preview for dds-mil ready!
Built with commit e771193fa819b341c98ab00767c6213217d72275
https://deploy-preview-118--dds-mil.netlify.app


Add info on getting EasyAuth claims for non .NET languages

The current documentation doesn't appear to explain how to get claims (such as group information) if you're not in a .NET language.
As far as I can tell, parsing the JWT in X-MS-TOKEN-AAD-ID-TOKEN works for AAD, but it would be great if this information was incorporated into the documentation.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 5c7d2cdb-23c1-0b1a-ff5d-cc0e5687c98d
Version Independent ID: 6670e4f0-fd40-54c5-0b40-2220c06d2118
Content: User identities in AuthN/AuthZ - Azure App Service
Content Source: articles/app-service/configure-authentication-user-identities.md
Service: app-service
GitHub Login: @cephalin
Microsoft Alias: cephalin

@iUnknwn Thanks for the feedback! We are currently investigating and will update you shortly.

@iUnknwn You may refer to this detailed document link here: https://docs.microsoft.com/en-us/azure/app-service/configure-authentication-oauth-tokens#retrieve-tokens-in-app-code
As its mentioned "Different language frameworks may present these headers to the app code in different formats, such as lowercase or title case."

To clarify - while that same note is available on the page I linked, the problem is not the header name or capitalization.
On the page Access User Identities there is information on how to access the identity claims when you are in a .NET language (such as using ClaimsPrincipal.Current). However, there is no information if you are, for example, using Java or Python.
The same information that is automatically populated in .NET is exposed to the application in the ID token, provided by the EasyAuth system as an HTTP header.
However, there is nothing in the current documentation explaining that these claims are available here, or even that the identity token is a JWT. Adding the following paragraph to the identity page could resolve this issue:

Some providers also include identity claims as a JWT, which is available as an HTTP header. If you are using a non-.NET language, you can access the user identity claims by parsing the id token that is generated by your identity provider.
Please see this page for the exact name of the header for your provider.

Adding this will make it much easier for users with non-.NET apps to understand how to get user claims, which can be critical.


i can't compile the source code

Describe your problem here.
i'm new to this stuff so in the first time i tried to compile the code this keeps happening

can someone help me with this?
Are you modding a build from source or with Lua?
Source
What is your build target?
Windows x64
Did you edit anything in this build? If so, mention or summarize your changes.
No

use sscript 4.1.0

maybe this can help you: #10756

maybe this can help you: #10756

I just gave the solution

use sscript 4.1.0

it didn't work

use sscript 4.1.0

it didn't work

haxelib install SScript 4.1.0

haxelib install SScript 4.1.0

i already have it and still didn't work

show

show

it still shows this error

show

it still shows this error

use the latest experimental branch

show

it still shows this error

use the latest experimental branch

what is this?

show

it still shows this error

use the latest experimental branch

what is this?

https://github.com/ShadowMario/FNF-PsychEngine/tree/experimental this

show

it still shows this error

use the latest experimental branch

what is this?

https://github.com/ShadowMario/FNF-PsychEngine/tree/experimental this

it worked thank you!!!

show

it still shows this error

use the latest experimental branch

what is this?

https://github.com/ShadowMario/FNF-PsychEngine/tree/experimental this

it worked thank you!!!

np


show tree does not render non-task checkboxes

Please check that this issue hasn't been reported before.

[X] I searched previous Bug Reports didn't find any similar reports.

Steps to reproduce

Launch obsidian sandbox
Install tasks plugin
Set global filter to #task, and disable/re-enable the plugin as I couldn't reload the sandbox directly.
Create a "Testing note" note, and use the following content:

# Task query:
```tasks
filename includes Testing note
show tree
```

# Task definition
- [ ] #task Testing trees ➕ 2024-11-05
	- This is a sub-bullet
	- [ ] This is a sub checkbox - it does not appear in the tree
	- [ ] #task This is a sub-task - it does appear in the tree

Expected Behavior
First of all, thanks a ton for the amazing plugin!
I think tree view is not yet 100% stable, but I really enjoy the idea as I already use tree structures when defining my tasks.
In this case, I expected to see non-task checkboxes rendered like bullet points currently are (see example in current behavior). Maybe the bullet points behavior is also bound to change, so this is not a priority, but I did not find any documentation/other reference to this behavior.
Current behaviour
Non-task Checkboxes simply do not appear in the query result. On the left is the source view. Right is the reading view, but the live preview mode also has the same behavior as the reading view.

Which Operating Systems are you using?

[ ] Android
[ ] iPhone/iPad
[X] Linux
[ ] macOS
[ ] Windows

Obsidian Version
1.7.5
Tasks Plugin Version
7.13.0
Checks

[X] I have tried it with all other plugins disabled and the error still occurs

Possible solution
No response

Hi, thanks for the feedback.
Really it never occurred to me that someone would have nested lines some of which matched the global filter and some did not.
The Tasks plugin basically just ignores task lines with no global filter.
Can you please give a real-world example of why you would mix by types of task line?

Before tree view, I found that writing everything as a task was a bit tedious and would flood my view/queries, and I focused on having fewer, bigger tasks, where I would write subgoals using non-task checkboxes.
Concretely:

[ ] #task A somewhat big task (the feature I need, experiments I should run,...)

[ ] smaller task that requires context of the bigger task to make sense
[ ] miscellaneous idea of things to try to achieve this task, not very through though.
basic remark about this task

For example, I have:

[ ] #task Look at Dirichlet partitionning results to see if I attacks scale well ➕ 2024-11-08 ⏳ 2024-11-11 📅 2024-11-11

[x] #task Launch attack on Dirichlet partitionning. ➕ 2024-11-11 ⏳ 2024-11-08 📅 2024-11-08 ✅ 2024-11-08

[x] Adapt the attack code
[x] Test the code on the computing grid
Attacks seems to take more VRAM than expected.

And since I consider I was supposed to do all the subtasks on the same date as the parent task, I don't really bother with defining them as tasks, as otherwise, they would appear under my "task without a scheduled date" filter.
Before tree view they would also appear as standalone task, that cluttered the queries since there was no structure (a "Test the code" task does not give me any information)
To me, this seemed like my ideal workflow, and I naturally organized tasks like this before Tree view. Hence, Tree view seems to be perfect for this approach. The only issue I faced is those checkboxes not appearing in the queries.
I'll also try in the upcoming week to define everything as a task, see how it feels and to have a more objective idea of how this would work, since I never really tried it properly. At the very least, tree view gives me more option, and they deserve a more thorough investigation on this front.

Thank you very much. I look forward to hearing back about your experiments...
I'll leave the question label on, as a reminder for me to come back and check on progress...

Just to note that the parent/child code is not designed to handle non-task checkboxes...
We have these classes:

ListItem which is a pure list item, that does not have a [ ]. It does not have a way to store the extra info about [, ], and the character in between.
Task which inherits ListItem and is a checkbox that is recognised by Tasks... That is, it has the global filter, if the user defined one.

This means it's going to be non-trivial to support this.
I'll leave it for another day or two, whilst I think about it some more. But my current inclination is to close this as 'not planned' for now, as a  low priority...

Sorry, can you please summarise the question succinctly?

Thanks a lot for looking into it on your end! I just wanted to give a quick feedback about my current setup. After looking into converting every checkbox into tasks, I made the following observations:

I often create a very quick list of checkboxes for various reasons (for instance, to write a set of parameters for experiments I have to do/that failed).
I really like the option that automatically dates the done date when checking a box

Those two observations do not always combine well for me. For instance, this automatic date makes those somewhat random checkboxes appear in some of my queries (like my "done today" query).
I can think of some workarounds, but that would, I believe, also require significant changes to the current plugin (like having multiple types of tasks: one with tag #task and another without global filters/another tag, and being able to set parameters, such as automatic done date, separately for each and query those independently).

There is already a Tasks mechanism for toggling tasks and not adding done-dates... Use a custom status with type NON_TASK:

https://publish.obsidian.md/tasks/Getting+Started/Statuses/Status+Types#NON_TASK

When I wrote this issue (and given the additional context you provided about the code), I assumed non-tasks checkboxes should simply behave like ListItem, because this was my expected behavior for tree view. But I completely understand that it is not that simple given the current code (I have a very limited knowledge of JS). Since this issue also probably arises from my use of Obsidian, I also understand that this is not a priority for the plugin.

It doesn't arise from Obsidian, it arises from the current Tasks code.

From your explanation, my naive approach would have been to create a CheckboxItem class, inherited from ListItem, that only stores the missing [] information as well as what's in between the brackets, in addition to what ListItem does. I think it would also be possible to make Tasks inherit from this CheckboxItem.

That is a reasonable suggestion - this all comes down to tradeoffs - where do the two of us who work on Tasks chose to spend our time.
And for me, it's not just development time, it's user-support time and managing PRs, which themselves can take hours.

Do you think, from your experience, that this is a feasible solution? If yes, I'll be making a note to try this solution on my end once I have time (should be in December), and if it works I'll try to open a PR. But as I have close to no experience in JS, this is possibly too naïve of a solution.

I am not accepting many PRs these days - only from people who are already very familiar with Tasks code and my ways of working - just because otherwise they usually take too much time to shepherd through and maintain.

@dimiarbre For now I will leave this open, so that others may comment.
Because Tasks and Obsidian are so flexible, people use them in ways I had not considered - and sometimes in conflicting ways...
So based on this just one datapoint I would not yet change anything... and would encourage you to work within the confines of the existing Tasks capabilities.
But over time, I will collect more data about how people are using the Tasks plugin with nested tasks and list items, and we can decide what to do from there...

I'll look into NON_TASKS, thanks for the pointer.
And I completely understand that you have better value for your time elsewhere than this issue, I'll leave it to your judgement.
Once again, thanks a lot for your time, and also for this incredible plugin!

Another discovery of the same issue:

https://github.com/obsidian-tasks-group/obsidian-tasks/discussions/3223


Marathon list ID only Mode

adding quiet mode to match job functionality to get list of ids

@bamarni ready for a review.   I like what we did with jobs and I'm bring to the rest of marathon lists that make sense.

run linux integration tests

run linux integration tests

@bamarni ready for review.

@bamarni any help here?


[BUG] System.MissingFieldException

I'm registering this class in my Splat container (also tried container.Register and got the same error so it's not the SourceGenerator)
SplatRegistrations.Register<AboutViewModel>();

When I call Locator.Current.GetService<AboutViewModel>(), I get: System.MissingFieldException

Base class
public abstract class AboutViewModelBase<TSettings> : ReactiveObject, IModalDialogViewModel, ICloseable
    where TSettings : SettingsDataBase, new()
{
    private readonly IEnvironmentService _environment;
    private readonly ISettingsProvider<TSettings> _settings;
    private readonly IProcessService _processService;
    private readonly IUpdateService _updateService;

    /// <inheritdoc />
    public event EventHandler? RequestClose;
    /// <inheritdoc />
    public bool? DialogResult { get; } = true;

    protected AboutViewModelBase(IEnvironmentService environment, IProcessService processService, ISettingsProvider<TSettings> settings,
        IUpdateService updateService)
    {
        _environment = environment;
        _processService = processService;
        _settings = settings;
        _updateService = updateService;
        // _updateService.FileFormat = UpdateFileFormat;

        // Start in constructor to save time.
        if (!Design.IsDesignMode)
        {
            CheckForUpdates.Execute();
        }
    }
    // rest is properties and commands, pretty standard stuff

The one thing that I find strange is that if I hit CTRL+F12 on base, it shows 2 classes: one with ISettingsProvider<TSettings> and one with ISettingsProvider<AppSettingsData>. Could there be a conflict between these 2?

I cleared bin/obj folders and restarted the IDE.
I removed "abstract" on the base class.
I tried tweaking the code in various ways, and the only way to make the error go away is to not have any type parameter on the base class...
Even simply adding AboutViewModelBase<T> with no reference to T whatsoever makes it crash again!
Does the Splat container not support classes with generic base classes AT ALL?

AHAH! Found the problem.
Base class has a property marked with [Reactive] (ReactiveUI.Fody). If I remove that line, it works!


Suggest NASA datasets for deep learning demo

These would be listed in a wiki page with direct links to NASA Open Data.
Intermediate/advanced data enthusiasts can create their own deep learning demos with these datasets.
If there is sufficient interest, we could have a virtual meetup to hack on the new datasets after the setup + demo virtual meetups.

Added list to wiki https://github.com/alexisylchan/introdl/wiki


In PathResolver.php line 23:    Could not resolve vendor package directory

please note that i am facing the below error when trying to generate a patch.
I have PHP 8 , laravel 9

Hi, thanks for the patience, there was a pile of issues last month.
I think it might be related to windows paths. Could you share minimal reproducer?
This is the class responsible for resolving path, maybe you'll be able to fix it:
https://github.com/symplify/symplify/blob/7dde2caca43f4f7712d60d7dad6314e888777f9e/packages/vendor-patches/src/FileSystem/PathResolver.php#L19-L27

Closing for lack of feedback. We're narrowing issues to keep focus on active and engaging contributor to keep project growing. Thank you for understanding.
Feel free to re-open with failing test case.

I wanted to test this package too but couldn't because my OS is Windows. So $fileInfo->getRealPath() returns something like C:\path\to\changed\file where slashes are reversed.
By fixing the regex to '#^(?<vendor_package_directory>.*?vendor(\\/|\\\)(\\w|\\.|\\-)+(\\/|\\\)(\\w|\\.|\\-)+)(\\/|\\\)#si'; it's working now.

Hi, that's great work :+1:
Could you propose a PR with test for this fix?

Okay, I will try ASAP.


HAProxy: Add logging of router and ingress operator images used in ingress test.

Description
Adds a log of the important/relevant images used in router performance test.
Fixes
I ran a couple of tests and now I'm not sure if used the right images, but I can't look back at the logs to confirm I used the right images. This would help log the images used that way I can be sure the test was valid and I didn't miss setting the image correctly.

Can one of the admins verify this patch?

Logging the ${HAPROXY_IMAGE} already exists: https://github.com/cloud-bulldozer/e2e-benchmarking/blob/master/workloads/router-perf-v2/common.sh#L54-L55

/hold
Just want to get a couple more tests with this.

@sjug okay I feel good about this now have been running a couple times with this. Let me know your thoughts.

Actually, just found a bug, let's hold off until I get a patch set up.

Okay fixed.

Actually, just found a minor edge case. Hold one second


build: perform package.json substitutions in bazel build

@josephperrott @gregmagolan
This pr mimics the package.json substitutions that build.ts performs, minus substituting dependency versions for tar paths on a local build (that's coming up in the next pr). The current build will not be affected by this change as we haven't yet flipped build.ts to use bazel.

Closing in favour of https://github.com/angular/angular-cli/pull/22425.


Updated v1.9.0

Checklist

[x] Used a personal fork of the feedstock to propose changes

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

This is duplicates with  #15.

Sorry I didn't realise it. I will close this PR as the another one looks closer to be completed.

Sorry again, I reopened this PR as I noticed later the other one is closed.
Please let me know if we should or not close this PR as well.

I will close it and fix the two other open PRs.


While doing prediction facing this error

input_ids (101072, 96)
input_mask (101072, 96)
segment_ids (101072, 96)
num of samples: 15878
PyTorch model loaded from output/20200207_105347\model_4.pt
model prediction start
Traceback (most recent call last):
File "wikisql_prediction.py", line 73, in
model_outputs = model.dataset_inference(pred_data)
File "C:\Users\mohdf\OneDrive\Desktop\Hydranet_sql\HydraNet-WikiSQL\modeling\base_model.py", line 24, in dataset_inference
model_outputs = self.model_inference(dataset.model_inputs)
File "C:\Users\mohdf\OneDrive\Desktop\Hydranet_sql\HydraNet-WikiSQL\modeling\torch_model.py", line 57, in model_inference
model_output = self.model(**input_tensor)
File "C:\Users\mohdf\anaconda3\envs\hydranet2\lib\site-packages\torch\nn\modules\module.py", line 1102, in _call_impl
return forward_call(*input, **kwargs)
File "C:\Users\mohdf\OneDrive\Desktop\Hydranet_sql\HydraNet-WikiSQL\modeling\torch_model.py", line 114, in forward
bert_output, pooled_output = self.base_model(
File "C:\Users\mohdf\anaconda3\envs\hydranet2\lib\site-packages\torch\nn\modules\module.py", line 1102, in _call_impl
return forward_call(*input, **kwargs)
File "C:\Users\mohdf\anaconda3\envs\hydranet2\lib\site-packages\transformers\models\roberta\modeling_roberta.py", line 815, in forward
encoder_outputs = self.encoder(
File "C:\Users\mohdf\anaconda3\envs\hydranet2\lib\site-packages\torch\nn\modules\module.py", line 1102, in _call_impl
return forward_call(*input, **kwargs)
File "C:\Users\mohdf\anaconda3\envs\hydranet2\lib\site-packages\transformers\models\roberta\modeling_roberta.py", line 508, in forward
layer_outputs = layer_module(
File "C:\Users\mohdf\anaconda3\envs\hydranet2\lib\site-packages\torch\nn\modules\module.py", line 1102, in _call_impl
return forward_call(*input, **kwargs)
File "C:\Users\mohdf\anaconda3\envs\hydranet2\lib\site-packages\transformers\models\roberta\modeling_roberta.py", line 395, in forward
self_attention_outputs = self.attention(
File "C:\Users\mohdf\anaconda3\envs\hydranet2\lib\site-packages\torch\nn\modules\module.py", line 1102, in _call_impl
return forward_call(*input, **kwargs)
File "C:\Users\mohdf\anaconda3\envs\hydranet2\lib\site-packages\transformers\models\roberta\modeling_roberta.py", line 323, in forward
self_outputs = self.self(
File "C:\Users\mohdf\anaconda3\envs\hydranet2\lib\site-packages\torch\nn\modules\module.py", line 1102, in _call_impl
return forward_call(*input, **kwargs)
File "C:\Users\mohdf\anaconda3\envs\hydranet2\lib\site-packages\transformers\models\roberta\modeling_roberta.py", line 187, in forward
mixed_query_layer = self.query(hidden_states)
File "C:\Users\mohdf\anaconda3\envs\hydranet2\lib\site-packages\torch\nn\modules\module.py", line 1102, in _call_impl
return forward_call(*input, **kwargs)
File "C:\Users\mohdf\anaconda3\envs\hydranet2\lib\site-packages\torch\nn\modules\linear.py", line 103, in forward
return F.linear(input, self.weight, self.bias)
File "C:\Users\mohdf\anaconda3\envs\hydranet2\lib\site-packages\torch\nn\functional.py", line 1848, in linear
return torch._C._nn.linear(input, weight, bias)
RuntimeError: CUDA error: CUBLAS_STATUS_ALLOC_FAILED when calling cublasCreate(handle)

getting this error while running wikisql_prediction.py

What's the PyTorch and Transformers versions? Could you test in CPU mode first (CUDA_VISIBLE_DEVICES=-1 python wikisql_prediction.py) and see if any exception?

torch              1.10.1
transformers       4.5.0

``

how much time it will take on cpu for the predict

This is simply a test because it will take super long time on cpu. Now it seems to be some CUDA/GPU issue, could you google a bit to see if any solution?

Could you try with Pytorch==1.7.1? I haven't had this issue from all the user feedbacks before and it's hard to debug from my side without env to reproduce this exception.

btw, could you try run with docker?
We can also run experiments with docker image: docker build -t hydranet -f Dockerfile .
This should match the environment exactly and produce no error

ok thanks let me try . I am not familiar with docker

Please refer to
https://github.com/lyuqin/HydraNet-WikiSQL/blob/afdf1e5c32a5259bc926e7d3f095e06019eaef6d/wikisql_prediction.py#L76
https://github.com/lyuqin/HydraNet-WikiSQL/blob/afdf1e5c32a5259bc926e7d3f095e06019eaef6d/wikisql_prediction.py#L88

after exploring these methods got these result.But still not converting it into sql query or Giving answer to the question.
then I tried out evaluator file. got this random jargons as predicted query.

after exploring these methods got these result

The dictionary format is expected output of predict_SQL. It's in the same format as defined in WikiSQL for the sql label, and the two outputs exactly match the labels of the first two samples of test set.

then I tried out evaluator file

As explained in readme, you can get official number from the output file by running the official evaluation script (evaluate.py in WikiSQL repo):
Run WikiSQL evaluation script to get official numbers: cd WikiSQL && python evaluate.py data/test.jsonl data/test.db ../output/test_out.jsonl
where test_out.jsonl is the file which contains outputs from predict_SQL.  Moreover, you can find the way to get SQL query for excecution in their script:
https://github.com/salesforce/WikiSQL/blob/0af869a830033f89a026b6c748879e04e1b0e2fc/evaluate.py#L25
Note that the evaluator.py file you ran is from HydraNet repo, and is only for evaluation during training. Its code under https://github.com/lyuqin/HydraNet-WikiSQL/blob/afdf1e5c32a5259bc926e7d3f095e06019eaef6d/evaluator.py#L101
is for unit test of the evaluation module. It randomly initiates a new model and hence produces random outputs.

Thanks finally got final predictions


Do you have a plan support Schematron?

Hi eclipxe13
Do you have a plan support Schematron?
ISO Schematron is a rule-based xml validation, language for XmlSchemaValidaton
I'm not sure about this feature need to use with PHP XSLT extension or not.
XSLT extension (Sablotron)
Ref:
https://github.com/Youniwemi/schematron
https://www.php.net/manual/en/class.xsltprocessor.php
Thank you so much.

No, sorry. I don't have any plan to support Schematron.
I had made some test but looks like the specification is different enough to consider that the project it is not compatible/adaptable.
XSD are based on http://www.w3.org/2001/XMLSchema while Schematron is based on http://purl.oclc.org/dsdl/schematron. They simply work different.
On the other hand, the looks similar: You could inspect Schematron schemas to extract schema and include nodes (in XSD is made on schemaLocation attribute) and build a schema that includes all, then ask schematron to validate.


gate per-consumer metrics on presence of consumer project info

Codecov Report

Merging #31 into master will increase coverage by 0.17%.
The diff coverage is 95.23%.

@@             Coverage Diff              @@
##             master      #31      +/-   ##
============================================
+ Coverage     66.36%   66.54%   +0.17%
- Complexity      639      644       +5
============================================
  Files            45       45
  Lines          2991     3010      +19
  Branches        449      453       +4
============================================
+ Hits           1985     2003      +18
  Misses          832      832
- Partials        174      175       +1

Impacted Files
Coverage Δ
Complexity Δ

...ain/java/com/google/api/control/ControlFilter.java
59.2% <100%> (+0.44%)
38 <0> (+1)
:arrow_up:

...om/google/api/control/model/ReportRequestInfo.java
87.85% <100%> (+0.26%)
52 <2> (+2)
:arrow_up:

...java/com/google/api/control/model/KnownLabels.java
81.81% <100%> (+0.78%)
19 <0> (ø)
:arrow_down:

...ava/com/google/api/control/model/KnownMetrics.java
91.66% <90%> (-0.38%)
31 <1> (+2)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8c1acb0...a2860fa. Read the comment docs.


flippy disks

It would be nice to have some more documentation about flippies aka flippy disks aka flippy floppies in the wiki.
My suggestion under usage:
Flippy Disks
Several 8bit home computers used 5.25" drives with a single read head but used both side of the disk to store data. IBM PC compatible drives with two heads can't read the other side of the disk. If greaseweazle uses both heads to read the other side no useful data is recorded. If the physically flipped disk is an error occurs `Command Failed: GetFluxStatus: No Index.
Those drives require a hardware modification to the drive to provide an alternative index sensor.
An alternative solution is to fake the index pulse signal by greaseweazel.
Measure your drive
The rotation speed of your drive is required.

Put your a disk in your drive
measure your speed by gw rpm --nr 10

The values should be relative constant for every measurement. If the rate spread is to high the chances are high wrong data is read with an fake index.
Read flip side
Now flip the floppy in your drive as you would do on the original hardware. And use the following command: `gw read --fake-index  --tracks h=0" with your other options see (link to tracks). Example:

gw read --fake-index 360 --tracks h=0 --drive 0 --raw test.scp  reads a RAW single sided image with 360rpm  for shugart drive 0.

Afaik it would be also useful to link this new wiki page in the FAQ @ "Track 0 not found"

Thank you so much for starting this discussion, adding a table for models and hardware people worked with, would be an excellent step as well.

If I may say so, most of the 360 RPM drives will refuse to communicate with the host computer (aka Greaseweazle board) until they find the index. So the --fake-index option may often not work. It's more for very old drives (300 RPM) that don't manage themselves the index hole. The alternative index sensor is more difficult to make, but it works.

yeah good point:

Mitsubishi MF504A-368U  :white_check_mark:
Ye-Data YD-380B :x:

I have made a wiki page here https://github.com/keirf/greaseweazle/wiki/Flippy-Disks
Comments are welcome.

I have a suggestion for clarifying the first method for reading flippy disks and adding a second.
I'd make the first bullet:
1. Punch two holes to make a second index hole in the disk jacket in
the correct flipped position.  An ordinary hand hole punch can be used, but
ensure that the punch is protected from scratching or damaging the media,
often using plastic tape to cover any exposed metal.

There is no need to open the jacket for this approach.  I do it all the time the way I describe.  I had an old flippy drive that got stolen, so to recover my old media, I did the above most of the time.
New method:
2. Read the normal side first.  For the flippy side, carefully slice open the
jacket on the label end not to nick or damage the media, remove the media,
flip it over, and reinsert it.

A modification to method #2 is to cut open the jacket, remove its media, and insert it into another jacket that's already been prepped with double index holes.  I use this method when the original jacket has problems such as mold.
Please fix any of the verbiage to make it clearer.  If you have any questions about my changes, please ask.

@qbarnes I'm unclear exactly how you perform suggestion (1). This is one of this style of hole punch? https://uk.rs-online.com/web/p/pliers/4458841
Do you slip the anvil side inside the jacket? Is this easy without warping the jacket or scratching the media? How do you get the positioning correct?

This is one of this style of hole punch?

Nothing so sophisticated.  I just used a cheap, single hole punch from Staples for under $3.  I think this was it: https://www.staples.com/Staples-10573-CC-1-Hole-Punch-5-Sheet-Capacity-Silver/product_146308
The 1/4" hole punch punched a slightly larger hole than the original, but it didn't matter for all the diskettes I punched with the drive I was using.

Do you slip the anvil side inside the jacket? Is this easy without warping the jacket or scratching the media?

Generally correct.  I do have to make a gap between the jacket and media to slip the taped up, bottom side of the punch inside, but the bending to accommodate the punch is minor and does not do any damage.

How do you get the positioning correct?

With a template I made.
My paper template isn't a perfect technique.  I use it with a felt tip pen to draw where I want the index hole circle on the opposite side.  Then I compare that pen mark to its symmetrically matching hole already in the jacket and ever so slightly adjust where I need punch through the jacket to make a more accurate hole.
I only did about a 20-25 disks this way.  If I was doing more, I might make the template out of a more durable, less flexible material to more accurately position the pen mark (or maybe a jig), so I didn't have to manually check it and adjust.
Template and taped up punch: https://drive.google.com/file/d/1poNi4z_KxyJCfps-Rm_ZRv5RRCCdwzHp/view?usp=sharing
I realize I'm still hand-waving here and there, so if further explanation or pictures are needed, just let me know.
I originally started using approach 2 where I slice off a bit of the jacket on the outside edge (side furthest from the drive head hole) to extract and flip the media, but once I made the template, I found the above technique quicker, easier, and less intrusive.

I have made a wiki page here https://github.com/keirf/greaseweazle/wiki/Flippy-Disks
Comments are welcome.

Thanks looks good to me


strokeColor property does not work after latest update (iOS 18)

Summary
After updating from 1.18.1 to 1.20.1 every polyline i have with strokeColor property does not work with Google Maps on iOS.
The issue is caused because of this 2 lines of code that added after 1.20.1 in ios/AirGoogleMaps/AIRGoogleMapPolyline.m
L23:    _polyline.spans = @[[GMSStyleSpan spanWithColor:_strokeColor]];
L24:    _polyline.strokeColor = _strokeColor;

After commenting this 2 lines everything works as before.
Reproducible sample code
<MapView
	ref={mapRef}
	provider={PROVIDER_GOOGLE}
	style={styles.map}>
	   <Polyline
		coordinates={cord}
		strokeColor="red"
		strokeWidth={4}
	   />
</MapView>

Steps to reproduce
Just use the strokeColor with a Polyline with PROVIDER_GOOGLE as map provider
Expected result
Display the right color set as strokeColor
Actual result
Return blue color which as i understand is the default google maps polyline color
React Native Maps Version
1.20.1
What platforms are you seeing the problem on?
iOS (Google Maps)
React Native Version
0.75.3
What version of Expo are you using?
Not using Expo
Device(s)
All iPhones
Additional information
No response

Works as expected.

Not with 1.20.1. Except if you mean than strokeColor should not be used for coloring the polyline path.
Every example that exists colors the path with strokeColor and strokeColors. It was working fine until 1.20.1.

@sakdog you are right, i will fix it but with dashes it works as expected.


Make loadFileAsync in file.service.ts take absolute path for zip file.

Motivation
Why is this feature required? What problems does it solve?
I am writing a script that would be usable by users and uses loadFileAsync and now it depends on the directory the script is executed on. If I have a structure like src/scripts/data.zip  and  src/scripts/script.js which executes const zipFile = await fileService.loadFileAsync("data") and I have started the script from the src folder which gives me an error.
Proposed solution
An ideal solution for the above problems.
Make an overload function / new function that takes an absolute path for the file
Additional context
Add any other context, screenshots, or reference links about the feature request here.

You might want to use a workaround to change the current working directory (docs for node.js).
Ideally in a try-catch block and in finally change the directory back.
But agreed this would be a good and handy feature and possibly usable also as CLI parameter.
Related to https://github.com/gatsbyjs/homepage-starters/pull/126


framedecoder

hello tananaev ! i want to ask you about Framedecoder.java there is protocols that use this class but others don't use it i want to know the utility  of this class and if it is responsible to treat the binary format

This class does exactly what the name says. It breaks down TCP stream info message frames.
All TCP-based protocols have frame decoders, not only binary.

good !thank you tananaev


Update Conductor repo details

Since the Netflix Conductor repo is archived - https://github.com/Netflix/conductor, updated the new Conductor OSS repo.
Read more details here - https://orkes.io/blog/evolving-conductor-open-source-and-the-conductor-community/


Group apps in a zone on taskbar

Description of the new feature / enhancement
Greetings!
Taskbar edits seem to be something EXTREMELY difficult to get done; so I'll understand if this one seems difficult to do:
It would be really neat/helpful if we could group ALL apps in a given zone on the taskbar.
I have a few ideas how this could look, but I always find devs like to figure out how THEY like it and see if it flies with the community, so I'll just leave the idea here to discuss =D.
Scenario when this would be used?

Productivity
More easily finding windows
Better window management

Supporting information
No response

/dup #264


Remove support for ctags

ctags won't be needed anymore since we're soon going to ship Jedi behind LSP to all users.

@karthiknadig I assume this can be closed?

Yes this can be closed. This is in the remove-old "stuff" branch. That branch has to be merged with main. that is the only thing pending


Markers above/below pieces

Sometimes I need the "markers" to be positioned above or below the pieces.

In the image, the "blue square" must be below the piece but the dot above.
I have committed a possible solution for it included in our fork: aa6a6ea.

Nice and thank you for contributing. I think the part with the markers I will integrate into core. Regarding the arrows (which are also included in the commit) I think they are also a candidate for a plugin/Extension/AddOn System, like the external pieces bar.

Now possible with extensions, see the arrows extension.


Raven.tags_context is not working - I don't see any tags in my Sentry errors

I'm trying to send some extra tags with my Sentry error reports, but they aren't showing up in Sentry. I set up the Sentry config in a file at config/initializers/sentry.rb:
  Raven.tags_context(
    region: ENV['REGION'],
    domain: ENV['DOMAIN_NAME'],
    service: Sidekiq.server? ? :worker : :web
  )

These tags aren't showing up for either Sidekiq jobs, nor for controller actions:

Should I be calling Raven.tags_context somewhere else, or I am doing this wrong? Thanks!

We have very similar code in the same initializer file and also don't see any tags in Sentry itself.
We are using Rails 5 + Unicorn, is that the same for you @ndbroadbent ?

We are also seeing issues where a block defined with .tags_context and .extra_context is not tagging the events.
def with_error_context(&block)
  Raven.tags_context("organization_id" => @organization.id) do
    Raven.extra_context("descriptoin" => @organization.description, &block)
  end
end

@ndbroadbent Raven.tags_context is meant to be used like
Raven.tags_context(interesting: 'yes') do
  # the `interesting: 'yes'` tag will only present in the requests sent inside the block
  Raven.capture_exception(exception)
end

If you want to add tags globally, try:
    Raven.configure do |config|
      config.tags.merge!(foo: "bar")
    end


vscode-extensions.tamasfe.even-better-toml: init at 0.9.3

Motivation for this change
Even better toml is a vscode extension that provides support for toml files.
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 106394 run on x86_64-linux 1

1 package built:

vscode-extensions.tamasfe.even-better-toml

Result of nixpkgs-review pr 106394 run on x86_64-linux 1

1 package built:

vscode-extensions.tamasfe.even-better-toml


Add alpha web interface

Still in alpha development

Should this be reviewed or is more work needed?

I think it's OK for preliminary review. The web interface is only really FPGA (vivado) tested for now.

@ben-k Would you like to give it a quick review?

I don't know enough about this to review it at this point.

Punting to #316


Regarding opening issues

@yash982000  Sir ,are there no issues available from the maintainers' side
Do we have to open issues of our own , to work ?

@yash982000 Sir ,are there no issues available from the maintainers' side
Do we have to open issues of our own , to work ?

Yes @Jassi10000 Once you are interested, you can open an issue and I will give you some tasks.

@Jassi10000 You can open a new issue and I will assign you task on a new thread.


[Bug] AssertionError: Download failed or shared storage is unavailable (in distributed training setting)

Branch
1.x branch (1.0.0rc2 or other 1.x version)
Describe the bug
Training on a single instance worked fine, but when I try to train with 2 nodes I get the error:

[1,mpirank:0,algo-1]:Extracting data/cifar10/cifar-10-python.tar.gz to data/cifar10
[1,mpirank:9,algo-2]:Traceback (most recent call last):
[1,mpirank:9,algo-2]:  File "/opt/conda/lib/python3.8/site-packages/mmengine/registry/build_functions.py", line 121, in build_from_cfg
[1,mpirank:9,algo-2]:    obj = obj_cls(**args)  # type: ignore
[1,mpirank:9,algo-2]:  File "/opt/mmclassification/mmcls/datasets/cifar.py", line 65, in init
[1,mpirank:9,algo-2]:    super().init(
[1,mpirank:9,algo-2]:  File "/opt/mmclassification/mmcls/datasets/base_dataset.py", line 92, in init
[1,mpirank:9,algo-2]:    super().init(
[1,mpirank:9,algo-2]:  File "/opt/conda/lib/python3.8/site-packages/mmengine/dataset/base_dataset.py", line 247, in init
[1,mpirank:9,algo-2]:    self.full_init()
[1,mpirank:9,algo-2]:  File "/opt/mmclassification/mmcls/datasets/base_dataset.py", line 169, in full_init
[1,mpirank:9,algo-2]:    super().full_init()
[1,mpirank:9,algo-2]:  File "/opt/conda/lib/python3.8/site-packages/mmengine/dataset/base_dataset.py", line 298, in full_init
[1,mpirank:9,algo-2]:    self.data_list = self.load_data_list()
[1,mpirank:9,algo-2]:  File "/opt/mmclassification/mmcls/datasets/cifar.py", line 98, in load_data_list
[1,mpirank:9,algo-2]:    assert self._check_integrity(),
[1,mpirank:10,algo-2]:Traceback (most recent call last):
[1,mpirank:10,algo-2]:  File "/opt/conda/lib/python3.8/site-packages/mmengine/registry/build_functions.py", line 121, in build_from_cfg
[1,mpirank:10,algo-2]:    obj = obj_cls(**args)  # type: ignore
[1,mpirank:10,algo-2]:  File "/opt/mmclassification/mmcls/datasets/cifar.py", line 65, in init
[1,mpirank:10,algo-2]:    super().init(
[1,mpirank:10,algo-2]:  File "/opt/mmclassification/mmcls/datasets/base_dataset.py", line 92, in init
[1,mpirank:10,algo-2]:    super().init(
[1,mpirank:10,algo-2]:  File "/opt/conda/lib/python3.8/site-packages/mmengine/dataset/base_dataset.py", line 247, in init
[1,mpirank:10,algo-2]:    self.full_init()
[1,mpirank:10,algo-2]:  File "/opt/mmclassification/mmcls/datasets/base_dataset.py", line 169, in full_init
[1,mpirank:10,algo-2]:    super().full_init()
[1,mpirank:10,algo-2]:  File "/opt/conda/lib/python3.8/site-packages/mmengine/dataset/base_dataset.py", line 298, in full_init
[1,mpirank:10,algo-2]:    self.data_list = self.load_data_list()
[1,mpirank:10,algo-2]:  File "/opt/mmclassification/mmcls/datasets/cifar.py", line 98, in load_data_list
[1,mpirank:10,algo-2]:    assert self._check_integrity(),
[1,mpirank:10,algo-2]:AssertionError: Download failed or shared storage is unavailable. Please download the dataset manually through https://www.cs.toronto.edu/~kriz/cifar-10-python.tar.gz.

Environment
OrderedDict([('sys.platform', 'linux'), ('Python', '3.8.13 | packaged by conda-forge | (default, Mar 25 2022, 06:04:10) [GCC 10.3.0]'), ('CUDA available', True), ('numpy_random_seed',<PHONE_NUMBER>), ('GPU 0,1,2,3', 'Tesla V100-SXM2-16GB'), ('CUDA_HOME', '/usr/local/cuda'), ('NVCC', 'Cuda compilation tools, release 11.3, V11.3.109'), ('GCC', 'gcc (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0'), ('PyTorch', '1.12.1+cu113'), ('PyTorch compiling details', 'PyTorch built with:\n - GCC 9.3\n - C++ Version: 201402\n - Intel(R) Math Kernel Library Version 2020.0.0 Product Build 20191122 for Intel(R) 64 architecture applications\n - Intel(R) MKL-DNN v2.6.0 (Git Hash 52b5f107dd9cf10910aaa19cb47f3abf9b349815)\n - OpenMP 201511 (a.k.a. OpenMP 4.5)\n - LAPACK is enabled (usually provided by MKL)\n - NNPACK is enabled\n - CPU capability usage: AVX2\n - CUDA Runtime 11.3\n - NVCC architecture flags: -gencode;arch=compute_37,code=sm_37;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_80,code=sm_80;-gencode;arch=compute_86,code=sm_86\n - CuDNN 8.3.2 (built against CUDA 11.5)\n - Magma 2.5.2\n - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=11.3, CUDNN_VERSION=8.3.2, CXX_COMPILER=/opt/rh/devtoolset-9/root/usr/bin/c++, CXX_FLAGS= -fabi-version=11 -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Werror=cast-function-type -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=1.12.1, USE_CUDA=ON, USE_CUDNN=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=OFF, USE_MPI=ON, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, \n'), ('TorchVision', '0.13.1+cu113'), ('OpenCV', '4.6.0'), ('MMEngine', '0.2.0')])

Other information
I've tried CIFAR10 both with automatic downloading setting as well as manually downloading and providing path.

did you start using slurm？

Nope, using MPI + NCCL or SMDDP

Do you have shared storage on all ranks? If the storage is not shared, other ranks cannot access the dataset downloaded by the master rank.
You can download and extract the dataset manually from https://www.cs.toronto.edu/~kriz/cifar-10-python.tar.gz and place it in the dataset path.

@mzr1996 I don't have shared storage. The data is streamed from S3 (using SageMaker's FastFile mode)
"FastFile mode – SageMaker exposes a dataset residing in Amazon S3 as a POSIX file system on the training instance. Dataset files are streamed from Amazon S3 on demand as your training script reads them."
ref: https://aws.amazon.com/blogs/machine-learning/choose-the-best-data-source-for-your-amazon-sagemaker-training-job/

Can MMDetection automatically download datasets to aws s3?
Please tell me the dataset type, and I will check it.


Convert cocoapods to swiftpm

Description
Convert cocoapods to swiftpm
Type of change

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update
[X] Code quality improvements

Checklist

[X] I have tested this code
[ ] I have updated the documentation

Yeah I haven't removed everything just in case I mess something up.


[MGDOBR-713] - deployment_validation_operator_no_anti_affinity rhose …

…app-sre-stage-01
Signed-off-by: Mauricio Magnani<EMAIL_ADDRESS>Insert JIRA Issue number and update link
PR owner checklist
Please make sure that your PR meets the following requirements:

[ ] Your code is properly formatted according to this configuration.
Run mvn clean verify -DskipTests so that imports are correctly set.
[ ] Your commit messages are clear and reference the JIRA issue e.g: "[MGDOBR-1] - $clear_explanation_of_what_you_did"
[ ] The layers in the kustomize folder have been updated accordingly.
[ ] All new functionality is tested
[ ] Pull Request title is properly formatted: MGDOBR-XYZ Subject
[ ] Pull Request contains link to the JIRA issue
[ ] Pull Request contains link to any dependent or related Pull Request
[ ] Pull Request contains description of the issue
[ ] Pull Request does not include fixes for issues other than the main ticket

PR reviewer(s) checklist

[ ] Check if code and Github action workflows have been modified and if the modification is safe
[ ] If the modification is safe, add the safe to test label

How to trigger pipelines and use the bots:

Run the end to end pipeline
Annotate the pull request with the label: safe to test. If you want to run the pipeline again, remove and add it again.

Rebase the pull request
Comment with: /rebase.

Deploy BOT
Comment with `/deploy <dev,stable> when the PR has been merged to deploy to a target environment.

oc process -f app-interface/manifests/rhose-fleet-manager.yml --local -p CLOUDWATCH_SECRET_NAME=mysecret | oc apply --dry-run=client --validate -f -
W0620 07:42:10.870617  292997 shim_kubectl.go:58] Using non-groupfied API resources is deprecated and will be removed in a future release, update apiVersion to "template.openshift.io/v1" for your resource
deployment.apps/rhose-fleet-manager configured (dry run)
service/rhose-fleet-manager configured (dry run) ```


Cheapest hour time range

Is it possible to have a sensor that shows calculated cheapest hours?
Ex. cheapest hours start at 21:00 and last until 03:00.
Like attribute starts_at.

For sure, can have a look at it.
But can also be solved by a template sensor
- sensor:
    - name: "Sheap at"
      unique_id: electricity_sheap_at
      state: "{{ state_attr('binary_sensor.nordpool_planner_entity_id', 'start_at') }}"

For sure, can have a look at it.
But can also be solved by a template sensor
- sensor:
    - name: "Sheap at"
      unique_id: electricity_sheap_at
      state: "{{ state_attr('binary_sensor.nordpool_planner_entity_id', 'start_at') }}"

Since create individual binary_sensors by the settings it's not obvious how to copy those settings to value sensors.

As each nordpool_panner entity is configured manually as a binary_sensor there is no intuitive way to create these sensor cloned with numerical date-time values. Could be solved together with #23. Until then the template-sensor above will be the easiest solution.


Unseals I18n class and sets locales protected so we can subclass to customize locales, re: #2

Fixes #2

Closing pull request in favor of #5 which includes documentation you provided in issue. Thanks for your contribution jbroadway 👍


Added to new Plugins

bottle-jwt: JSON Web Token authentication plugin for bottle.py
bottle-smart-filters: Bottle Querystring smart guessing.

Both plugins are useful for building web services

We have two jwt plugins now. One should probably go.

Is there something wrong with pull request? Should I make another one?


Allocate funds from Moore Grant in 2022

Develop a process for allocating funds from the Moore grant which builds on the processes developed in 2020 (#113) and 2021 (#199).

This has been done.


here have these like three things that you need to fix

this

and this

im not sure about the second one, that might just be a discord bug and not a theme bug

@Maxie01 papa bless

WEW its been a while. I'll look into it :)

OK AYYYYYYY
The 1st is a feature™
and the 2nd is fixed when they changed the layout.


What are the prerequisites ?

Looks like i'm missing an item, but what ?
Input
nmap -sV -T4 -v -d --script=$PWD/ <IP_ADDRESS>
Output:
NSE: Using Lua 5.3.
NSE: Arguments from CLI:
NSE: module 'libssh2' not found:
NSE failed to find nselib/libssh2.lua in search paths.
no field package.preload['libssh2']
no file '/usr/local/share/lua/5.3/libssh2.lua'
no file '/usr/local/share/lua/5.3/libssh2/init.lua'
no file '/usr/local/lib/lua/5.3/libssh2.lua'
no file '/usr/local/lib/lua/5.3/libssh2/init.lua'
no file './libssh2.lua'
no file './libssh2/init.lua'
no file '/usr/local/lib/lua/5.3/libssh2.so'
no file '/usr/local/lib/lua/5.3/loadall.so'
no file './libssh2.so'
stack traceback:
/usr/bin/../share/nmap/nse_main.lua:293: in function 'stdnse.silent_require'
/usr/bin/../share/nmap/nselib/libssh2-utility.lua:14: in main chunk
[C]: in function 'require'
/root/nse-log4shell//ssh-log4shell.nse:4: in function </root/nse-log4shell//ssh-log4shell.nse:1>
NSE: Failed to load '/root/nse-log4shell//ssh-log4shell.nse'.
NSE: Loaded 47 scripts for scanning.
NSE: Script Pre-scanning.
NSE: Starting runlevel 1 (of 2) scan.
........
Whereis
whereis lua
lua: /usr/bin/lua /usr/lib64/lua /usr/share/lua /usr/share/man/man1/lua.1.gz
Package libssh2-1.9.0-5.el8.x86_64 is already installed.
OS
cat /etc/os-release
NAME="CentOS Linux"
VERSION="8"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="8"
PLATFORM_ID="platform:el8"
PRETTY_NAME="CentOS Linux 8"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:8"
HOME_URL="https://centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"
CENTOS_MANTISBT_PROJECT="CentOS-8"
CENTOS_MANTISBT_PROJECT_VERSION="8"

After a reboot it works

sry problem still exists for: NSE: Failed to load '/root/nse-log4shell//ssh-log4shell.nse'

update was the sollution, sry for the spam :P

No problem. Glad you fixed it. Probably because you had old version of Nmap or your version of Nmap was compiled without libssh2.
Good luck with your scans!