Heap out of memory error: Memory hungry

On 64GB RAM with 38GB SWAP machine, analyzing big binaries (about 10-20mb) takes even more than 6 hours (once even 14h on i9-9900k) and most of the binaries just crashing in the middle with an error as the title. I tried to analyze one by one but the same issue occurs. Do you maybe know why the CppClassAnalyzer is so memory hungry?
Regards,
TheAifam5

On 64GB RAM with 38GB SWAP machine, analyzing big binaries (about 10-20mb) takes even more than 6 hours (once even 14h on i9-9900k) and most of the binaries just crashing in the middle with an error as the title. I tried to analyze one by one but the same issue occurs. Do you maybe know why the CppClassAnalyzer is so memory hungry?
Regards,
TheAifam5

Unfortunately the only solution to how much memory it consumes would be to create db entries in ghidra's internal db. This would be in the same fashion as the GhidraClassDB, SymbolDB, etc etc. I started on it a few months ago but didn't get very far before the spring semester started. This was sort of something I had hoped would come along as a result of getting the GccRttiAnalyzer merged into ghidra but I don't think it will happen anytime soon.
At the moment the analyzers currently search out all type_info instances and their vtables and stores them.
The most I've analyzed was a game with ~750 classes with only takes a minute or two on an i3 processor with 6gb ram. This used to be a big concern as analyzing it used to take approximately 10 minutes.
Do you know how many classes are in the binary you're working with?

I always run the plugin with following options:

Find Fundamental types
Fill class Fields
Locate Constructors

Locate Constructors is what takes so much time mostly and crashes on big binaries.
I don't know how many classes are in the binary, but searching for "^(*|_)?(Z([A-Z]|\d)|N\d)" shows: 1637 items.

I have a database implementation partially functional at the moment. I only started it yesterday so its not ready to be pushed anytime soon but it is coming.

I'm not pushing this commit because they are intrusive and some things are broken but progress is being made. I have to iron out some spaghetti code, deprecate some things and then document and stress test the rest. Unfortunately I have some exams next week and a report due so this probably won't make it into until early May.
[master f26b564] DB checkpoint 1
 28 files changed, 2237 insertions(+), 199 deletions(-)
 create mode 100644 src/main/java/ghidra/app/plugin/prototype/CppCodeAnalyzerPlugin/wrappers/WindowsClassTypeInfo.java
 create mode 100644 src/main/java/ghidra/program/database/data/rtti/ClassTypeInfoManager.java
 create mode 100644 src/main/java/ghidra/program/database/data/rtti/ClassTypeInfoManagerDB.java
 create mode 100644 src/main/java/ghidra/program/database/data/rtti/DataBaseIterable.java
 create mode 100644 src/main/java/ghidra/program/database/data/rtti/RecordIterable.java
 create mode 100644 src/main/java/ghidra/program/database/data/rtti/typeinfo/AbstractClassTypeInfoDB.java
 create mode 100644 src/main/java/ghidra/program/database/data/rtti/typeinfo/GnuClassTypeInfoDB.java
 create mode 100644 src/main/java/ghidra/program/database/data/rtti/typeinfo/WindowsClassTypeInfoDB.java
 create mode 100644 src/main/java/ghidra/program/database/data/rtti/vtable/AbstractVtableDB.java
 create mode 100644 src/main/java/ghidra/program/database/data/rtti/vtable/VftableDB.java
 create mode 100644 src/main/java/ghidra/program/database/data/rtti/vtable/VtableModelDB.java

@TheAifam5 if you're able to do would you mind giving the experimental branch a shot? I haven't backported it yet so it'll require the current ghidra dev branch.

@astrelsky Checking right now :)

Wow, GitHub almost got me again with changing quote to edit message. Anyway...

There is alot of Variable Utils returned wrong class structure! printed logs.

Unfortunately there always was. However I think I made an error reworking the logic there. https://github.com/NationalSecurityAgency/ghidra/issues/1210#issue-517202664
Looking into the stack trace. I'm assuming it threw up dialog boxes everywhere. I need to figure out a way to make it halt so that doesn't occur.

It froze Ghidra completely for a while but I gave it a time. After that 2 errors popped out, then I cancelled analysis.

It froze Ghidra completely for a while but I gave it a time. After that 2 errors popped out, then I cancelled analysis.

May you try letting it run until completion? Just the rtti analyzer and not the class analyzer. Knowing if it is just a handful of cases as opposed to 100s can help narrow it down. I'll come up with a non disruptive way of handling the error in the morning. This was at least the tree and what went through will be usable until the cause is tracked down.

@TheAifam5 I believe I've fixed the freezing issue and the errors. If you could give it another shot it would be appreciated.
If you get an error when opening the program in ghidra it is because I changed one of the database schemas. To fix this open the code browser with no programs open, disable the plugin, open the program, run the ResetDatabaseScript script in the developer_scripts folder, save and close the program and then you can re-enable the plugin and re-open the program.
There is no automatic upgrader at this time as I don't want to change the schema version numbers until it is moved out of the experimental branch.

This should be fixed in the experimental branch. If you still have an issue using said branch please feel free to reopen this.


[JS] Remove superfluous child assignment

From type.mjs:

TypeScript's data modifiers automatically create a this.children = children assignment.
I suggest matching the other code and just removing the modifier instead of removing the assignment.

There's a lint error. I also added a js reviewer :)


Make tractability, safety, and baseline expression data files available for download

Currently, we make the associations, evidence, gene list, and target list files available for download. @d0choa suggested that we also make the tractability, safety, and baseline expression data files also available for download.
Based on a suggestion from @mkarmona, can we please also make the normalised (post platform-input-support-support) files for tractability, target safety, and baseline expression also available for download?

Confirmed with @cmalangone that files are available for download in the input/annotation-files directory


Wait for updated state in the enhanced meshing workflow

Remove the time.sleep(1) by updating and waiting for the updated state.

@prmukherj I think this is already resolved by other changes.


Referece.related should handle pure binary association table

binary : Has 2 outbound foreign keys.
pure: The table has only one composite key constraint. This key includes all the columns from both foreign keys.
(As an exception, the table can have one extra key that is made of one serial type column.)

One way to implement this is to set a flag ._isPureBinaryAssociation flag to indicate whether the table is a pure binary association. Then while the Reference.related is created, add the logic that will update the related entities' display_name, uri, and columns appropriately. See diagram below.

For now, I would like to make this flag reflect the strict definition above.
Note: The binary association table could have other literal columns such as rank in protocol_author scenario. However, until we know how to merge tables together, let's not include this scenario.

I changed the definitions accordingly:

binary : Has 2 outbound foreign keys. The table has only one composite key constraint. This key includes all the columns from both foreign keys.
(As an exception, the table can have one extra key that is made of one serial type column.)
pure: All its columns are part of some key constraints.

#167 changed the definitions based on the previous comment and resolved this issue.


Initial blessing in column-like layout

@danbalogh
Please have a look at this one also:

On the top of this stele we find

on the left, in 2 lines, the blessing "hariḥ Om"
on the right, in 1 line, the blessing "svasti śrī"

The "main" text then starts.
What would you advise?
To encode both initial blessings in <fw>?
And as per EGD 3.3.5, I understand I should not indicate <lb> in the top left blessing.

For this one, you should definitely use the guidelines for incipits, EGD §3.3.3. Forme work should primarily (and preferably only) apply to documents with actual pages or pagelike partitions. This was taken for granted in drafting the section, hence the note that the fw element must always follow the pb.

Noted. Thanks!


Feature request: allow static linking to libasound

I am trying to build an embedded audio project using cpal, alsa-rs and alsa-sys. The target OS has an old GLibc and it might be tricky to upgrade. Building a static linked binary would be ideal.
At present alsa-sys hardwires statik(false) in build.rs so there's no way to static link.
I experimented with changing this to static(true) and building with armv7-unknown-linux-musleabihf toolchain. Something goes wrong with the link at this point, and various link errors appear like these:
  = note: /home/sam/src/organelle-ports-musl/output/host/lib/gcc/arm-buildroot-linux-musleabihf/10.3.0/../../../../arm-buildroot-linux-musleabihf/bin/ld: /home/sam/src/alsa-rs/synth-example/target/armv7-unknown-linux-musleabihf/debug/deps/libalsa_sys-aae2be964235592b.rlib(conf.o): in function `config_file_load':
          conf.c:(.text+0x4fa0): undefined reference to `__stat_time64'
          /home/sam/src/organelle-ports-musl/output/host/lib/gcc/arm-buildroot-linux-musleabihf/10.3.0/../../../../arm-buildroot-linux-musleabihf/bin/ld: /home/sam/src/alsa-rs/synth-example/target/armv7-unknown-linux-musleabihf/debug/deps/libalsa_sys-aae2be964235592b.rlib(conf.o): in function `snd_config_update_r':
          conf.c:(.text+0xc130): undefined reference to `__stat_time64'
          /home/sam/src/organelle-ports-musl/output/host/lib/gcc/arm-buildroot-linux-musleabihf/10.3.0/../../../../arm-buildroot-linux-musleabihf/bin/ld: /home/sam/src/alsa-rs/synth-example/target/armv7-unknown-linux-musleabihf/debug/deps/libalsa_sys-aae2be964235592b.rlib(pcm_dmix.o): in function `snd_pcm_dmix_status':
          pcm_dmix.c:(.text+0xe0c): undefined reference to `__clock_gettime64'

I experimented with adding -lc or removing -nodefaultlibs from the generated linkline and got other errors suggesting double linking against libc.
This is the limit of my expertise, just reporting the issue in case someone else has been looking into the same thing.

A quick googling yields this result, might be helpful? https://stackoverflow.com/questions/61934997/undefined-reference-to-stat-time64-when-cross-compiling-rust-project-on-mu

Thanks for the pointer! This suggests that changing .statik(true) should just work, and something about my toolchain / sysroot is broken.
I am building with Buildroot 2021.08, which has Musl 1.22 and Rust 1.54. I have just spotted that Buildroot doesn't build the rust-std libraries itself, it downloads them from https://static.rust-lang.org/dist/rust-std-1.54.0-armv7-unknown-linux-musleabihf.tar.xz and looking at the contained liblibc-e1ae72f87d6a487b.rlib file, this might indeed contain a statically linked copy of Musl 1.1.

Feel free to add a PR that adds support for static linking, I suppose this would be implemented as a feature not enabled by default?

Right, I wasn't sure how to do this, but a feature flag makes sense. When I get some time I will do a PR.

@ssssam  @diwic  does this mean that i cannot manually compile alsa lib and link it with cargo-zigbuild on my mac??
I have been trying for days to make it work. and it compiles and links successfuly, just to segfault on my players...

any updates on this?

@AnthonyMichaelTDM Not to my knowledge. The other binding I maintain - https://github.com/diwic/dbus-rs - someone contributed a way to download the alsa-lib C code and cross compile it with the rest of the code. That might be an option here as well, if someone wants to do the work?

This worked for me:
sudo apt-get install crossbuild-essential-arm64
rustup target add aarch64-unknown-linux-gnu
RUSTFLAGS="-C linker=aarch64-linux-gnu-gcc" cargo build --target aarch64-unknown-linux-gnu


PR.gql: add field fileChanged

GitHub api will soon support filesChanged field. By soon i mean they already added it, just waiting for it to appear in changelog.
Refs: https://platform.github.community/t/feature-request-files-field-in-pullrequest/4041/3

Awesome, thanks for opening the feature request!

Finally landed in api https://developer.github.com/v4/changelog/2017-11-24-schema-changes/


BUG: frustum contains method

In the file "math/shapes.d", the method contains(box3!T box) for the Frustum struct contains a bug: The array for the eight corner vertices of the argument box are populated with only two distinct vectors. The bug is fixed by changing the three identical i == 0 checks to to the proper index, ie: i == 0, j == 0 and k == 0 (from line 478 time of writing).

Fixed in v6.2.13.
Thanks for noticing this :)


Package Requested

[X] I would like someone else to build the manifest.
[ ] I would like help so I can submit the manifest.
[X] I have performed a search and couldn't find this package.
[X] I have checked that the installer for this package is not a standalone or portable executable or a .zip file
[ ] I think there is a new version available and I have provided the URL.

Please provide the following information
Publisher: Skillbrains
Publisher URL: https://www.dobreprogramy.pl/skillbrains,wydawca,6627154906330753
Package Name: Lightshot
Description: The fastest way to take a customizable screenshot (more can be found on the official website)
Package Version: <IP_ADDRESS>
Installer URL: https://app.prntscr.com/build/setup-lightshot.exe

Last I checked, this package had validation blocked because the publisher doesn't allow requests from the Azure pipelines
https://github.com/microsoft/winget-pkgs/pull/23768#issuecomment-918945591


Math Tests

Summary of the PR
See #412

Going to close this as not much work is going into it, and will likely become out-of-date very quickly once 3.0 dev starts.
The diff will be preserved by GitHub should we need to recover this small start!


[Bug]: Nested Input Empty If List Widget Is Filtered

Is there an existing issue for this?

[X] I have searched the existing issues

Description
The user has a List widget with a nested Input field tied to one of the properties of the currentItem. Sometimes, when filtering the list, the Input field displays as empty, although the evaluated value is correct and it is also correctly displayed in a Text widget that has the same binding.

Ticket
Steps To Reproduce

Open the sample app.
Filter the List widget by using the Select widget.
Note that sometimes the Inputs are empty although the Text values tied to the same value are showing correctly.

To easily reproduce the unexpected behavior:

When in edit mode, after the unfiltered list loads, select Red or Blue.
In the deployed view of the app, select Yellow first, then select one of the other options.

Public Sample App
https://app.appsmith.com/app/filtered-list-with-nested-input-bug/input-text-disappearing-671b4182b32c7d4aac3eab33
Environment
Production
Severity
Medium (Frustrating UX)
Issue video log
No response
Version
v1.48

@Nikhil-Nandagopal @carinanfonseca @rahulbarwal @somangshu Could you please help me understand the timeline for solving this bug?

@Nikhil-Nandagopal @carinanfonseca @rahulbarwal @somangshu Could you provide an update on this bug?

Hey @sonali-humanedge, @hebase
We are evaluating this and will prioritize soon, we will keep you updated.

Hey @rahulbarwal any updates here?

Hey @sonali-humanedge, This is picked up by the team, should be solved within this week. We will update the availability of fix in next version, after we merge the fix.

Hey @sonali-humanedge,
Update: this is still not solved yet. This is a peculiar edgecase that is taking some time to get fixed. I'll keep you updated for the fix.


Refactoring mixed precision training and inference with backend bridge

[x] Create backend bridge
[ ] Create different element type levels that the users can modify with backend settings.

linked to #1694


Remove legacy extension api

This PR removes the public api for the deprecated legacy extensions.
Internally, ASDF still uses this api for building and registering the BuiltinExtension so removal of the legacy extension methods and functions is not possible at this point.
Some objects were made private to prevent their inclusion in the documentation (AsdfType and AsdfExtension).
The asdf_extension entry point is preserved but modified to only load the BuiltinExtension. This modification means that many types previously converted by astropy.io.misc.asdf are now converted by asdf-astropy. This required updates to the test_version_map_support test to match the supported tags in asdf-astropy (and to make this test aware of the new extensions).

weldx downstream job failure for this job looks like it should be fixed by weldx PR: https://github.com/BAMWelDX/weldx/pull/863

weldx downstream job failure for this PR looks like it should be fixed by weldx PR: BAMWelDX/weldx#863

Yes we will release a new version soon based on the new extension API which should fix the downstream job

feel free to rerun the downstream welx test again now with weldx 0.6.5 @braingram

This might have broken 2 of the astropy release branches: v5.2.x and v5.3.x
astropy v6.0.dev seems compatible but that is not going to be released until the end of 2023. Any chances this can be reverted and then wait 6 months? It is the v5.3.x that I worry about.
Example logs:

https://github.com/astropy/astropy/actions/runs/4920084061/jobs/8788506464
https://github.com/astropy/astropy/actions/runs/4920080182/jobs/8788497391

cc @WilliamJamieson

p.s. I opened https://github.com/astropy/astropy/issues/14795

astropy v6.0.dev seems compatible but that is not going to be released until the end of 2023. Any chances this can be reverted and then wait 6 months? It is the v5.3.x that I worry about.

I would prefer to find a solution that does not revert and delay these changes for 6 months.
One option might be to install asdf-astropy and require it for building the docs on v5.3.x and v5.2.x (and update the documentation for the modeling example to describe that asdf-astropy is now required for saving astropy models to a file). Similar changes appear to have been included in https://github.com/astropy/astropy/pull/14668

That would be too confusing for astropy users, as we have not removed deprecated code yet in those branches. I can always pin maxversion of asdf for those branches but I have a feeling that @nden won't like that.

Also, what is the rush of removing code here so much so soon?

That would be too confusing for astropy users, as we have not removed deprecated code yet in those branches. I can always pin maxversion of asdf for those branches but I have a feeling that @nden won't like that.

I must be missing something. How would adding a dependency for building the docs be confusing to an astropy user?

We are breaking the promise of requiring something that should not be required.

Didn't y'all write a whole long-term support policy a few months ago? I thought downstream would have another year, which wouldn't be a problem for us by then because astropy 6.0 should come out in 6 months.

Didn't y'all write a whole long-term support policy a few months ago? I thought downstream would have another year, which wouldn't be a problem for us by then because astropy 6.0 should come out in 6 months.

It was agreed that ASDF does not have the resources to support formal LTS releases. Would committing to supporting 2.15 for 6 months meet your needs?
The currently released version of ASDF (2.15) should allow the doctest you linked to pass. However the run you linked installed the 3.0 development branch (main) of ASDF. This will continue to fail even if we can agree to support 2.15.

It would be very easy for me to pin asdf<3 for astropy 5.x series, but it means STScI cannot use asdf 3 with stable astropy for another 6 months.

Is that the solution you prefer?

Is that the solution you prefer?

If you cannot revert this, then that is what I must do. It is wrong to introduce breaking changes in v5.3.x after the freeze. We are already in RC.
Thanks for your inputs!


Using EventSource API

For this application I am working on, I want to use server side events through the EventSource API. I am wondering whether this is possible with Hyper. Since I am not extremely experienced and could not find any examples of an implementation, I am opening this issue.
Maybe, it is possible that someone writes a very simplistic example how to implement EventSource through Hyper, as has been done for PHP and NodeJS by the EventSource polyfill project. Or, if EventSource is not supported, we can leave this issue open until support is implemented.
Anyway, I hope someone is able to answer my question. Thanks for the great work already!

Sending a server-sent events through Hyper should be possible, by setting the header Content-Type : text/event-stream on a response and calling write with a serversent event payload.
However, it may be worth noting that this will keep one of your threads busy.

@rsolimo Thanks for your reply! So, should I spawn a new thread per new EventSource connection? In my project, the webserver is just for monitoring purposes. I do not expect lots of traffic. Will that change after #395 is implemented?

I don't know how or if it would be possible spawn a new thread per EventSource connection in Hyper.
#395 should make use cases like this nicer since we won't be using a thread for each connection.

@rsolomo Thanks again. Maybe I should implement websockets after all then.

Nonetheless, I will leave this thread open since EventSource API is not really usable at this moment. When #395 is implemented, I will see if I can provide an example with your suggestions.

#395 is on master now. You can receive a Control from hyper that allows you wake up the socket every time you have a new event to send, and then write the payload when the loop has woken up the socket.

@seanmonstar Fantastic! Thanks for the great library!

I'm making an attempt to build a standalone Server Sent Event broker using async hyper. Will update this thread with my progress...
Still trying to figure out how to manage "subscribed" connections for a given channel. The goal then is to then able to "publish" an event message to all connections "subscribed" to a given channel.

@mikeycgto It be very nice to follow your progression. I did spend time on this since the issue was resolved, but still have some very relevant use-cases.

@frederikbosch will keep you posted and let you know when I get up on GitHub :smile:

Any advice on how to achieve this @seanmonstar? I've tried a few techniques using channels and other async approaches but haven't been able to come up with something that works well with hyper's new event based design.
It feels like I need to leverage an event loop to implement this sort of thing. Ultimately, I'm trying to have two main HTTP endpoints:

/subscription/:channel route which will be the event stream endpoint and will leave the socket waiting.
/publish/:channel route which lets you publish an arbitrary message to all subscribed clients

I have the skeleton setup already but the guts of it all still elude me 😵! Any guidance would be much appreciated.

I made a basic example that responds to every HTTP request with an event stream. You can see it on Stack Overflow.

@seanmonstar Would you expect something like this to work:
fn on_response_writable(&mut self, response: &mut Encoder<HttpStream>) -> Next {
    // ...
    return Next::wait().timeout(remaining);
}

It would have been very convenient, but there's no way to say what the next state should be, so the handler just... exits Instead, I ended up spawning a thread to provide my timeout and trigger the Control.

What about using rotor's event loop directly and expanding a Handler type to support some sort of on_publish event? Perhaps one could compose two state machines together via rotor_compose!?
The first would be a hyper handler and the second would be a custom state machine for publishing events between different connections and clients.

Doable though hyper hides rotor at the moment.
On Jul 4, 2016 3:01 PM, "Michael Coyne"<EMAIL_ADDRESS>wrote:

What about using rotor's event loop directly and expanding a Handler type
to support some sort of on_publish event? Perhaps one could compose two
state machines together via rotor_compose!?
The first would be a hyper handler and the second would be a custom state
machine for publishing events between different connections and clients.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/hyperium/hyper/issues/719#issuecomment-230348194, or mute
the thread
https://github.com/notifications/unsubscribe/AAISnxhTb9duDiwu09B736VTbj3p_mKzks5qSWaxgaJpZM4HB6EZ
.

@shepmaster yes, I would expect that to eventually trigger Handler.on_error(Error::Timeout).

@mikeycgto hyper won't be exposing the rotor interior. I'd rather the internals of how hyper works not be part of its public contract.
You could do it the way @shepmaster did, by spawning a thread to wakeup the Control eventually. My first thought was instead to send the Control of the request to something that pools all of them, using something like a HashMap<StreamId, Vec<Control>>, when there is a /publish/some_id, you can send the contents to that thingy, it looks up all the subscriptions to that stream, and calls control.wakeup(Next::write()), on all of them.
And then in the on_response_writable method, you can lookup all the new messages that need to be sent.

@seanmonstar definitely understand hiding rotor complete and keeping it internal to hyper.
I had a similar idea with using a HashMap to track Control instances across handlers and have something that works for a single threaded server. I then moved to creating multiple Server instances within different threads using something like the following:
Broker {
    // other stuff
    control: Control,
    subscribers: Arc<HashMap<String, Vec<Control>>>
}

impl Broker {
    fn new(ctrl: Control, subs: Arc<HashMap<String, Vec<Control>>>) -> Broker {
        Broker {
            // other stuff
            control: ctrl,
            subscriber: subs
        }
    }
}

fn main(){
    let listener = HttpListener::bind(&"<IP_ADDRESS>:3002".parse().unwrap()).unwrap();
    let mut handles = Vec::new();

    let subs: HashMap<String, Vec<Control>> = HashMap::new();
    let subs_ref = Arc::new(subs);

    for _ in 0..2 {
        let listener = listener.try_clone().unwrap();

        handles.push(thread::spawn(move || {
            Server::new(listener).handle(|ctrl| Broker::new(ctrl, subs_ref.clone())).unwrap();
        }));
    }

    for handle in handles {
        handle.join().unwrap();
    }
}

Which then started producing the following error:
error: the trait bound `std::sync::mpsc::Sender<hyper::Next>: std::marker::Sync` is not satisfied

I also tried to do something with callbacks so that you could call a subscribe function and supply a closure that would call wakeup on a closed Control instance as well as receive the actual message data somehow. Was having issues sorting out the sync aspects with Fn's though.

That error you received is because you tried to put HashMap<T, Control> into an Arc. Arc requires that anything put into it be Sync. The Control isn't Sync because it uses std::sync::mpsc::Sender internally, which itself is not Sync.
One possible option is to use a Arc<Mutex<HashMap>>, because a Mutex will guarantee synchronization of the value it's guarding.

Alternatively, hyper could force unsafe impl Sync for Control {}, by making sure the Sender used internally is always cloned once. mpsc::Sender starts with internals that don't synchronize the sending with other threads. Once it has been cloned once, the internals upgrade to be safe. Unfortunately, mpsc::Sender remains !Sync, because that's how the type system works.
So, hyper could do something like this:
struct ClonedSender(Sender<Next>);

unsafe impl Sync for ClonedSender {}

impl ClonedSender {
    pub fn new(sender: Sender<Next>) -> ClonedSender {
        sender.clone(); // upgrades internals
        ClonedSender(sender)
    }
}

It's safe, and allows Control to be Sync. But it also means that everyone pays the synchronization cost, even if someone only ever needs 1 copy of Control...

Thanks @seanmonstar!
I had tried an RwLock but I now realize that you need a full Mutex to provide the proper guarantees for this sort of thing. Thanks again for the help and the explanations!

Got a pretty complete POC working. If anyone is interested in viewing it, it's available on here: https://github.com/mikeycgto/esper
I'm planning on developing it further, check out the issues section for more thoughts on that!


Update introduction.md

This PR has been approved and merged into master. You can view content to verify.

Committed


Plugin support

How to use plugins with this?

Please see https://github.com/paradox41/angular-chartist.js/issues/67
On Feb 4, 2016 8:53 AM, "patronovski"<EMAIL_ADDRESS>wrote:

How to use plugins with this?
—
Reply to this email directly or view it on GitHub
https://github.com/paradox41/angular-chartist.js/issues/72.


Some information when application is active in light mode is hard to see.

This issue is a part of issue #201


Documentation: Create docs on how members of the community can represent BPD at conferences

In /how_to/be_a_conference_delegate.md, we need to document how members of the community can effectively represent BPD at conferences. The created docs will include instructions on running the BPD booth and issuing tickets.
Anyone with conference experience who is willing to collaborate on our Discord to gather best practices from experienced delegates can take on this task.

I dont know what you consider as conference experience does attending tech conferences count?


Update prometheus-grafana.md

Motivation
Improve documentation
Description
In Prometheus & Grafana Setup documentation: metrics.port instead of metrics.serverPort (metrics.serverPort did not work for me, also according to https://chainsafe.github.io/lodestar/reference/cli/ metrics.port is correct)

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


APC: relinquish DR/BDR mode on Cloud conn loss

If there is a cloud connectivity loss, we do not
want the AP to be elected as a DR/BDR since that would
mean the APs configuration could mismatch with all the
other APs linked to it.
Signed-off-by: Chaitanya Godavarthi<EMAIL_ADDRESS>

Github says this code will not merge cleanly, please rebase.
Why are you polling the Manager table instead of listening for events?
There is an example in command/src/webserver.c that does a listen on the Manager table.
You can improve on that by using a filter so only get notified of "status" changes; see cm2_ovsdb.c/cm2_ovsdb_init() around line 2087 (this is another example of listen on Manager table).

I have rebased the patch. I did initially use the method you mention above, however it would not work in case where the AP always remains in the is_connected=false state from the beginning and doesn't change state at all.  in which case we would not get any events.

Could you handle by assuming "not connected" until notified otherwise?

Could you handle by assuming "not connected" until notified otherwise?

Ok, In this case we need a one time timer to poll that "not connected" variable.

Merged d4oe1f9d, thanks.  WIFI-2343


Batch: cache instead of block for statePollingWait

Improves support for configuring interval to query schedulers. This
builds off #1769 which blocked to avoid extra queries. Unfortunately
this also blocks submissions of jobs, making it hard to scale up
analyses. This change uses caching instead of blocking, so Toil can
continue to submit and monitor jobs and will refresh queries to the
scheduler only within the statePollingWait period. The behavior when
statePollingWait is unset does not change.

Totally endorse this PR, fixes/improves greatly on top of https://github.com/BD2KGenomics/toil/pull/1686 and https://github.com/BD2KGenomics/toil/pull/1617, thanks a lot @chapmanb!

Yes please. Almost there to have Toil run on PBS.

Thank you @chapmanb


Run Error

When I ran the dataset of Cricket in MTS-UEA, I found a problem that describes
tensorflow.python.framework.errors_impl.InvalidArgumentError: indices[97] = 97 is not in [0, 97)
[[{{node GatherV2}}]].
I have changed a lot, but the problem still exists. Please help me ,that means a lot for me.
This is the picture.

Hello,
Sorry for the late response. I have tested the released code in Cricket dataset. Everything works well. Could you please point out the command that you have used, or the testing scenarios that you are applying (supervised or semi-supervised?). Apparently, the problem is caused by an out-of-index error.
Best regards,


Detect and Add GitBash as a profile, if Git is installed in a particular machine

Description of the new feature/enhancement

Detect and Add GitBash as a profile, if Git is installed in a particular machine, this is similar to that of the Visual Studio Developer Command Prompt feature
Proposed technical implementation details (optional)

GitBash will be made available as a profile in the context of Windows Terminal.

This is something they already support!

Git for Windows v2.32.0-rc1 (or the next snapshot) will have this option.

/dup #1394
/dup https://github.com/git-for-windows/git/issues/3183
/dup https://github.com/git-for-windows/build-extra/pull/339


Grapher not showing up

On matrix-reloaded (on server v1.1.0, client v<IP_ADDRESS>-g280f46b), none of the data vault directory structure shows up on the grapher tab. See screenshot below:

If I instead use a prior version (server/client both v1.0.1-7-g0c80392), the full data vault directory shows up.

@maffoo @joshmutus Is this due to the latest ansible changes?
If it's code related, can someone get me the password to matrix-reloaded so I can inspect the page.

@jwenner, it works fine for me. Have you tried hard refreshing the page (Ctrl-Shift-R)? Also, do you see any errors in the log in the developer tools?

@jwenner Are you viewing through remote desktop?

@joshmutus Remote desktop shouldn't break the directory view, only potentially the view of the actual plots.

Even with this hard refresh, the data vault still doesn't show up. I am not viewing though remote desktop. The URL is https://matrix-reloaded.physics.ucsb.edu:7443/trench/grapher/.

Can you check if webGL is running?
Can you follow these steps?
Step 1: Open Google Chrome
Step 2: Type chrome://flags in the address bar
Step 3: Press Ctrl + f and type ” Rendering list “, “Override software rendering list” should come up, >Now click on Enable and restart the browser.

Also, do you see any errors in the log in the developer tools?

Is this the correct screen? If so, it looks like only deprecation warnings.

@joshmutus This isn't a WebGL problem, this page doesn't render any WebGL.
@maffoo I can confirm that the page loads just fine for me and I'm able to navigate to graphs.
@jwenner That error console looks just fine... very strange... have you tried closing the browser entirely?

@joshmutus, once I enabled that "Override software rendering list" and restarted the browser, it now shows up.

@jwenner Can you disable it again, restart, and see if it breaks again?

Once I go back to disabling "Override software rendering list" and restart, the data vault directory still shows up

So, looks like indeed a full restart of the browser was needed. Thanks, all!

Good, I was going to be very confused if the flag fixed anything. Would have needed further investigation. Glad this was easily fixed.


Ms sql version provider

Hi
I have added a MsSqlVersionProvider and a test project.
Please note. The "Transactions" must be false. Otherwise you need to extend the ConnectionProvider with IConnectionProvider<IDbConnection,IDBTransaction> (i.e. add ). And return the transaction on the begintransaction in SimpleMigrator (And where ever else the generic is needed)
You see the command for the MsSql needs the transaction.. Up to you. Other DBs may have the same issue?
I can add it for you if you like?
By the way. Great little migrator. Saved me lots of trouble and bother. Didn't have to do FluentMigrator, nor Enity. Nice and thin.. Thanks.
I can add the MySql also if you like?

Thanks for this!

Please note. The "Transactions" must be false. Otherwise you need to extend the ConnectionProvider with IConnectionProvider (i.e. add ). And return the transaction on the begintransaction in SimpleMigrator (And where ever else the generic is needed)

You see the command for the MsSql needs the transaction.. Up to you. Other DBs may have the same issue?

I'm afraid I don't follow you. What "Transactions" are you referring to? What do you mean to add the IConnectionProvider to ConnectionProvider - ConnectionProvider already implements IConnectionProfider. I don't follow why BeginTransaction needs to return the transaction here either.
I don't see anything relating to transactions in your PR, and I'm not sure what issue you're referring to, I'm afraid.
I need to figure out a good approach to integration testing. I need to add a unit test project, but I don't think it's right to have integration tests in there: the CI server won't be able to run them, for a start.
A MySQL adapter would be fantastic 😃

Hi.
I added the test just to show you it works :-)
The mssql needs the transaction to be added the sql command. Otherwise it failed.
Your attribute on the Migrate allowed a false for use transaction. Otherwise the migration fails for MsSql.
Hence in the begintransaction call needs the transaction returned and sent to the command.
But as you have used generics for the database interface I did not want to hardcore the idbTransaction as a return from begintransaction.
Let me know what you think about this. We can have a skype meeting if you like?
Br Rik
Sent from my iPhone

On 13 Oct 2016, at 22.31, Antony Male<EMAIL_ADDRESS>wrote:
Thanks for this!
Please note. The "Transactions" must be false. Otherwise you need to extend the ConnectionProvider with IConnectionProvider (i.e. add ). And return the transaction on the begintransaction in SimpleMigrator (And where ever else the generic is needed)
You see the command for the MsSql needs the transaction.. Up to you. Other DBs may have the same issue?
I'm afraid I don't follow you. What "Transactions" are you referring to? What do you mean to add the IConnectionProvider to ConnectionProvider - ConnectionProvider already implements IConnectionProfider. I don't follow why BeginTransaction needs to return the transaction here either.
I don't see anything relating to transactions in your PR, and I'm not sure what issue you're referring to, I'm afraid.
I need to figure out a good approach to integration testing. I need to add a unit test project, but I don't think it's right to have integration tests in there: the CI server won't be able to run them, for a start.
A MySQL adapter would be fantastic 😃
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.

Actually I had another question.
If I want to run the migration in a console application I created, is there a way to "pass" the existing console object/application to your console runner, so it is the same windows?
Or should I use your logger somehow to output to the main application window?
Br Rik
Sent from my iPhone

On 13 Oct 2016, at 22.31, Antony Male<EMAIL_ADDRESS>wrote:
Thanks for this!
Please note. The "Transactions" must be false. Otherwise you need to extend the ConnectionProvider with IConnectionProvider (i.e. add ). And return the transaction on the begintransaction in SimpleMigrator (And where ever else the generic is needed)
You see the command for the MsSql needs the transaction.. Up to you. Other DBs may have the same issue?
I'm afraid I don't follow you. What "Transactions" are you referring to? What do you mean to add the IConnectionProvider to ConnectionProvider - ConnectionProvider already implements IConnectionProfider. I don't follow why BeginTransaction needs to return the transaction here either.
I don't see anything relating to transactions in your PR, and I'm not sure what issue you're referring to, I'm afraid.
I need to figure out a good approach to integration testing. I need to add a unit test project, but I don't think it's right to have integration tests in there: the CI server won't be able to run them, for a start.
A MySQL adapter would be fantastic 😃
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.

The mssql needs the transaction to be added the sql command. Otherwise it failed.

Are you saying that your MSSQL version provider doesn't work, because it needs to run in a transaction?

Your attribute on the Migrate allowed a false for use transaction. Otherwise the migration fails for MsSql.

Now you are saying that MSSQL migrations fail if they're run in a transaction? Hrm, maybe we need a way of specifying whether migrations are run in a transaction by default, or not.
I think you're saying that the MSSQL version provider needs to run in a transaction, but the MSSQL migrations cannot run in a transaction, which doesn't seem right.

Hence in the begintransaction call needs the transaction returned and sent to the command.

I don't follow. Which command are you talking about. One of the ones in version provider?

If I want to run the migration in a console application I created, is there a way to "pass" the existing console object/application to your console runner, so it is the same windows? Or should I use your logger somehow to output to the main application window?

So this is some custom console you've created, that doesn't use Console.WriteLine, etc?
You won't be able to use the ConsoleRunner, as that assumes it's talking to a normal console. You can write a custom logger which will output the results of your migrations to your console though.

HI
Sorry about the confusement. This type of questions shouldn’t be done over a mobile. But need screenshots.
This works:
This fails:
If I add some temp code, it passes. You see I add the transaction to the command.:
What I am saying is, that for MsSQL the transaction needs to be a part of the command.
To do it properly and follow your design the  IConnectionProvider method for BeginTransaction should have return a transaction. But since the deign uses a generic for the database connection I guess the transaction should be a generic also
I will make a candidate and make a pull request :)
BR RIk
From: Antony Male<EMAIL_ADDRESS>Sent: 14. oktober 2016 09:26
To: canton7/SimpleMigrations<EMAIL_ADDRESS>Cc: generik0<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [canton7/SimpleMigrations] Ms sql version provider (#1)
The mssql needs the transaction to be added the sql command. Otherwise it failed.
Are you saying that your MSSQL version provider doesn't work, because it needs to run in a transaction?
Your attribute on the Migrate allowed a false for use transaction. Otherwise the migration fails for MsSql.
Now you are saying that MSSQL migrations fail if they're run in a transaction? Hrm, maybe we need a way of specifying whether migrations are run in a transaction by default, or not.
I think you're saying that the MSSQL version provider needs to run in a transaction, but the MSSQL migrations cannot run in a transaction, which doesn't seem right.
Hence in the begintransaction call needs the transaction returned and sent to the command.
I don't follow. Which command are you talking about. One of the ones in version provider?
If I want to run the migration in a console application I created, is there a way to "pass" the existing console object/application to your console runner, so it is the same windows? Or should I use your logger somehow to output to the main application window?
So this is some custom console you've created, that doesn't use Console.WriteLine, etc?
You won't be able to use the ConsoleRunner, as that assumes it's talking to a normal console. You can write a custom logger which will output the results of your migrations to your console though.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/canton7/SimpleMigrations/pull/1#issuecomment-253728582 , or mute the thread https://github.com/notifications/unsubscribe-auth/ACTMK497lvay5WBGVdpc24ylA0PlO8rWks5qzy6XgaJpZM4KWPTd .  https://github.com/notifications/beacon/ACTMK2yyAvhanwLJCAlgJL1a072RJfdzks5qzy6XgaJpZM4KWPTd.gif

Unfortunately your images didn't come through, but I experimented with your MSSQL version provider and found them for myself.
I ended up changing how transactions are handled: it's now Migration<T> which puts the migration in a transaction, and I got rid of IConnectionProvider. This means we don't risk leaking IDbConnection across the codebase. See here: https://github.com/canton7/SimpleMigrations/commit/6e1fbb376d2bb34bcd1116784e12e399e61e8ee7.
I then extracted your version provider and test, and committed them (under your name) here: https://github.com/canton7/SimpleMigrations/commit/c8dc32dabc432e424e80c641cc7d2ba350d8a8e9.
Does that look sensible?

I will look.
But I just extended the classes and generics myself :)
The way you have done it is the most simple.
I just pushed a pull request wher you can see I extended your generics..
I like your generics. Easy to add non IDBconnection and IDBtransaction support in the future (Although one shouldn’t program for the future:- )
BR Ri
From: Antony Male<EMAIL_ADDRESS>Sent: 14. oktober 2016 17:29
To: canton7/SimpleMigrations<EMAIL_ADDRESS>Cc: generik0<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [canton7/SimpleMigrations] Ms sql version provider (#1)
Unfortunately your images didn't come through, but I experimented with your MSSQL version provider and found them for myself.
I ended up changing how transactions are handled: it's now Migration which puts the migration in a transaction, and I got rid of IConnectionProvider. This means we don't risk leaking IDbConnection across the codebase. See here:  https://github.com/canton7/SimpleMigrations/commit/6e1fbb376d2bb34bcd1116784e12e399e61e8ee7 6e1fbb3.
I then extracted your version provider and test, and committed them (under your name) here:  https://github.com/canton7/SimpleMigrations/commit/c8dc32dabc432e424e80c641cc7d2ba350d8a8e9 c8dc32d.
Does that look sensible?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/canton7/SimpleMigrations/pull/1#issuecomment-253834669 , or mute the thread https://github.com/notifications/unsubscribe-auth/ACTMKx29As_hsKYgdfM39GSb5i9nEq3oks5qz5_IgaJpZM4KWPTd .  https://github.com/notifications/beacon/ACTMK-R_SrLypdevSgvPX9Nh7ChOmoE2ks5qz5_IgaJpZM4KWPTd.gif

Hi again
Your develop branch is using .Net Stanadard and you have a packages.json
Unfortunately the packages are not loading for me. You are not using nuget?
Can you tell me what to do?
From: Antony Male<EMAIL_ADDRESS>Sent: 14. oktober 2016 17:29
To: canton7/SimpleMigrations<EMAIL_ADDRESS>Cc: generik0<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [canton7/SimpleMigrations] Ms sql version provider (#1)
Unfortunately your images didn't come through, but I experimented with your MSSQL version provider and found them for myself.
I ended up changing how transactions are handled: it's now Migration which puts the migration in a transaction, and I got rid of IConnectionProvider. This means we don't risk leaking IDbConnection across the codebase. See here:  https://github.com/canton7/SimpleMigrations/commit/6e1fbb376d2bb34bcd1116784e12e399e61e8ee7 6e1fbb3.
I then extracted your version provider and test, and committed them (under your name) here:  https://github.com/canton7/SimpleMigrations/commit/c8dc32dabc432e424e80c641cc7d2ba350d8a8e9 c8dc32d.
Does that look sensible?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/canton7/SimpleMigrations/pull/1#issuecomment-253834669 , or mute the thread https://github.com/notifications/unsubscribe-auth/ACTMKx29As_hsKYgdfM39GSb5i9nEq3oks5qz5_IgaJpZM4KWPTd .  https://github.com/notifications/beacon/ACTMK-R_SrLypdevSgvPX9Nh7ChOmoE2ks5qz5_IgaJpZM4KWPTd.gif

Unfortunately the packages are not loading for me.

What do you mean by that? What error are you getting? Make sure you have the .NET Core SDK Installed, see here.

You are not using nuget? Can you tell me what to do?

I'm still using nuget.

I havn’t upaded my VS to Update 3. Probably the issue. Sorry mate..
From: Antony Male<EMAIL_ADDRESS>Sent: 14. oktober 2016 18:38
To: canton7/SimpleMigrations<EMAIL_ADDRESS>Cc: generik0<EMAIL_ADDRESS>State change<EMAIL_ADDRESS>Subject: Re: [canton7/SimpleMigrations] Ms sql version provider (#1)
Unfortunately the packages are not loading for me.
What do you mean by that? What error are you getting? Make sure you have the .NET Core SDK Installed, see here https://www.microsoft.com/net/core#windows .
You are not using nuget? Can you tell me what to do?
I'm still using nuget.
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub https://github.com/canton7/SimpleMigrations/pull/1#issuecomment-253853769 , or mute the thread https://github.com/notifications/unsubscribe-auth/ACTMKwOoAozkGWU807L3n4aiyFbgESB4ks5qz6_bgaJpZM4KWPTd .  https://github.com/notifications/beacon/ACTMK7RCYCZ7zzKNqBMvxarDN9TUcCPbks5qz6_bgaJpZM4KWPTd.gif


Update SunburstIlluminationShader to Foundry VTT 0.7.9

Which class should be updated?
SunburstIlluminationShader
For which version should the class be updated?
Foundry VTT 0.7.9

taking this

Fixed by #276


handle uploading string chunks while uploading to WABS

This should handle all chunk uploads via StringIO streams to azure blob storage service. fixes #277

fixed for pep8

Awesome. It's going in.

By the way, have you confirmed that this fixes your problem with taking backups? If so, I'd like to release v1.0.1

Yes, I confirmed with "backup-push" command today. I was able to successfully take a full backup in a second try.
I had encountered another issue in my first try. The issue is definitely in the azure library as the message in exception had no reference in the wal-e code. This other exception happened while retrying for exception caused by operation time out while uploading to wabs. It was related to positional argument "status_code" missing. I found the reference to in  new function in AzureHttpError Exception class in azure-common. I was not able to reproduce it my second try.

Do you think there's a fix we should put into that? I'm trying to avoid cutting too many point releases is all.

No, I don't think we need to fix it, its not an issue with wal-e. It seemed to me that azure api didn't give a proper response that's why it failed. I was getting a lot of operation timed out exception in my first try, that didn't happen the second time. I was not able to reproduce it, so couldn't dig deep.

Did it retry successfully, or did it crash WAL-E unnecessarily?

It crashed wal-e. I lost the exception log else I would have posted here. It said that during handling exception another exception occurred. We will be running it in production soon and logging it. I will post an issue here if we encounter it again.
Currently, we are on wal-e 0.7 and just realized that our backups were failing in azure due to various exceptions. I noticed that there are lot of azure related fixes in 1.0, so was testing it when I encountered issue above. We have infra both in azure and s3. So before switching versions, I will ensure that everything thing is working as expected.

Okay, I think I will release a WAL-E point release tomorrow if you don't
find anything new before then. Let me know if you want to put anything else
in 1.0.1.
Thanks for looking into this and fixing it!
On Wed, Oct 19, 2016 at 1:28 PM Ayush Goyal<EMAIL_ADDRESS>wrote:

It crashed wal-e. I lost the exception log else I would have posted here.
It said that during handling exception another exception occurred. We will
be running it in production soon and logging it. I will post an issue here
if we encounter it again.
Currently, we are on wal-e 0.7 and just realized that our backups were
failing in azure due to various exceptions. I noticed that there are lot of
azure related fixes in 1.0, so was testing it when I encountered issue
above. We have infra both in azure and s3. So before switching versions, I
will ensure that everything thing is working as expected.


Allow configuring pod priority globally and per cluster.

Allow to specify pod priority class for all pods managed by the operator,
as well as for those belonging to individual clusters.
Controlled by the pod_priority_class_name operator configuration
parameter and the podPriorityClassName manifest option.
See https://kubernetes.io/docs/concepts/configuration/pod-priority-preemption/#priorityclass
for the explanation on how to define priority classes since Kubernetes 1.8.
Some import order changes are due to go fmt.
Removal of OrphanDependents deprecated field.

Great to see this being resolved. @aermakov-zalando

Coverage decreased (-0.01%) to 4.568% when pulling acea75461cc1fcec4cdef0428db6dca9d444dd4a on feature/pod_priority into d2d3f21dc2a7fbf6c8abe3aa8fc26a7bdf83d20b on master.

a general question regarding this capability : how will preemption work with pods originating from stateful sets ? current docs seem to be short on this topic

@zerg-junior I assume it doesn't care whether the pod to be preempted belongs to a statefulset; the expectations are that the lower-priority pod can be rescheduled in the future.
This is less a problem for a typical use-case of running PostgreSQL together with a stateless application in a single cluster: normally we expect all postgres pods to run with the same priority and nothing  PostgreSQL is usually the only service that runs in a statefulset.

@zerg-junior addressed your code review?

:+1:

👍


Generate Certificates with variables section

You can generate the certificates like shown in this PR. This generates a common CA and two certificates; one each for the master and kubelet.

@pivotal-danjahner Please sign the Contributor License Agreement!
Click here to manually synchronize the status of this Pull Request.
See the FAQ for frequently asked questions.

@pivotal-danjahner Please sign the Contributor License Agreement!
Click here to manually synchronize the status of this Pull Request.
See the FAQ for frequently asked questions.

@pivotal-danjahner Please sign the Contributor License Agreement!
Click here to manually synchronize the status of this Pull Request.
See the FAQ for frequently asked questions.

@pivotal-danjahner Thank you for signing the Contributor License Agreement!

I think we couldn't do this before because common_name didn't exist. Great to see it now.
@alex-slynko - Can we now remove set_kubernetes_certificate_in_credhub ?

@johnsonj yes, we can do that. Could you please try to remove it and trigger pipeline manually?

@pivotal-danjahner Removing our manual Credhub step and building this change gives us the following error during deploy_k8s:
20:56:13 | Error: Unable to render instance groups for deployment. Errors are:
  - Unable to render jobs for instance group 'master'. Errors are:
    - Unable to render templates for job 'kubernetes-api'. Errors are:
      - Failed to find variable '/I AM CI/ci-service/tls-kubernetes' from config server: HTTP code '404'
    - Unable to render templates for job 'kubeconfig'. Errors are:
      - Failed to find variable '/I AM CI/ci-service/tls-kubernetes' from config server: HTTP code '404'
  - Unable to render jobs for instance group 'worker'. Errors are:
    - Unable to render templates for job 'kubeconfig'. Errors are:
      - Failed to find variable '/I AM CI/ci-service/tls-kubernetes' from config server: HTTP code '404'
  - Unable to render jobs for instance group 'proxy'. Errors are:
    - Unable to render templates for job 'kubeconfig'. Errors are:
      - Failed to find variable '/I AM CI/ci-service/tls-kubernetes' from config server: HTTP code '404'

Is this expected? We're on credhub 0.4.0

@johnsonj It is curious that it is failing on attempting to access the credential and not on attempting to generate it. If the problem were related to generation (invalid params or the like), it would look like this -
22:01:22 | Preparing deployment: Preparing deployment (00:00:00)
            L Error: Config Server failed to generate value for '/gcp-director-credhub/credhub-db-uaa/credhub-encryption-password' with type 'password'. Error: ''

What Director version are you on? Can you double-check that the CredHub instance that the Director is using is running and accessible from the Director's request address?

Director is 261.4
I get a 404 when hitting the credhub service (which we host on the director):
$ wget https://<IP_ADDRESS>:8844/api/ --no-check-certificate
--2017-05-15 23:05:07--  https://<IP_ADDRESS>:8844/api/
Connecting to <IP_ADDRESS>:8844... connected.
WARNING: cannot verify <IP_ADDRESS>'s certificate, issued by '/C=USA/O=Cloud Foundry/CN=ca':
  Unable to locally verify the issuer's authority.
HTTP request sent, awaiting response... 404
2017-05-15 23:05:07 ERROR 404: (no description).

I see. That error is indicating that the certificate is not trusted by your machine. If you run curl -k https://<IP_ADDRESS>:8844/info, I expect it will return successfully.
My guess is that you are having a similar trust issue between the Director and CredHub. This line provides a trusted CA for the connection. If this value accurate? It should be providing the CA that signed the CredHub API certificate.

@pivotal-danjahner
We have removed all variables from the cert declarations, and now we are getting an error that resembles the one you mentioned:
+ - name: tls-kubernetes
+   options:
+     alternative_names:
+     - https://tcp.main.kubo.cf-app.com:6577
+     common_name: https://tcp.main.kubo.cf-app.com:6577
+   type: certificate
+ - name: tls-kubelet
+   options:
+     alternative_names:
+     - https://tcp.main.kubo.cf-app.com:6577
+     common_name: https://tcp.main.kubo.cf-app.com:6577
+   type: certificate

Task 23
09:24:58 | Preparing deployment: Preparing deployment (00:00:01)
            L Error: Config Server failed to generate value for '/I AM CI/ci-service/tls-kubernetes' with type 'certificate'. Error: ''

We had the same error for tls-ca before we removed it.

We discovered the following issues that were preventing us from a successful deployment:

We ended up using the URL as the Common Name/SAN.
We were using a vars-store file in our scripts as part of the deployment process
We used an ops-file to change the kubo URL, but it did not update the variables section

We'll try to fix these and re-deploy

I created Github issue #94  to remove vars-store from our deployment. This should help with merging this pull request.

I just realized that one of the components of my request won't work with 0.4.0. We've restructured how we generate and reference CAs in 0.5.0+, so the following will not work until you upgrade.
- name: tls-ca
   type: certificate
   options:
     common_name: "KuBo CA"
     is_ca: true

If you manually set or generate a CA and use that, the other certificate generation should work.

That's a good catch. I have created Github issue #99 to upgrade credhub to version 0.5.0. This PR will be blocked on merging until we upgrade.
I am also going to update our installation guides to remove downloading the credhub cli, since it will no longer be necessary to deploy kubo once this PR is merged.

Closing this. These changes are part of #113


move the link around for flutter doc homepage

closes https://github.com/flutter/flutter/issues/2309

cc @Hixie

lgtm


add build doc

PR Summary
Document how to build singularity-eos in all its complicated glory.

PR Checklist

[x] Adds a test for any bugs fixed. Adds tests for new features.
[x] Format your changes by using the make format command after configuring with cmake.
[x] Document any new features, update documentation for changes made.

Thanks for working on this!

@dholladay00 @annapiegra @mauneyc-LANL there seem to be some questions regarding the spackage. That said, I'd like to bring the documentation into the code regardless of any changes/fixes to the spack that may be needed. How do you all feel about that?

@dholladay00 @annapiegra @mauneyc-LANL there seem to be some questions regarding the spackage. That said, I'd like to bring the documentation into the code regardless of any changes/fixes to the spack that may be needed. How do you all feel about that?

Dumb question: should we be putting "sphinx"-style comments in the spackage?

@dholladay00 @annapiegra @mauneyc-LANL there seem to be some questions regarding the spackage. That said, I'd like to bring the documentation into the code regardless of any changes/fixes to the spack that may be needed. How do you all feel about that?

Dumb question: should we be putting "sphinx"-style comments in the spackage?

I'm not sure that's needed... we're basically using sphinx rst to hand-write the docs, but we're not doing "doxygen" style automated documentation. I'd be open to that path though if people think it's worth it.

@dholladay00 @annapiegra @mauneyc-LANL there seem to be some questions regarding the spackage. That said, I'd like to bring the documentation into the code regardless of any changes/fixes to the spack that may be needed. How do you all feel about that?

Dumb question: should we be putting "sphinx"-style comments in the spackage?

I'm not sure that's needed... we're basically using sphinx rst to hand-write the docs, but we're not doing "doxygen" style automated documentation. I'd be open to that path though if people think it's worth it.

I think the only advantage of using docstrings in the package.py file (which I think is what is being proposed?) is that the comment will exist where the code change is likely being made. Editing two files just increases the chance that the documentation will be out of date. Though as you pointed out Jonah, there's always that chance since the documentation isn't auto-generated so the advantage may not be significant.

@dholladay00 @annapiegra @mauneyc-LANL there seem to be some questions regarding the spackage. That said, I'd like to bring the documentation into the code regardless of any changes/fixes to the spack that may be needed. How do you all feel about that?

Dumb question: should we be putting "sphinx"-style comments in the spackage?

I'm not sure that's needed... we're basically using sphinx rst to hand-write the docs, but we're not doing "doxygen" style automated documentation. I'd be open to that path though if people think it's worth it.

I think the only advantage of using docstrings in the package.py file (which I think is what is being proposed?) is that the comment will exist where the code change is likely being made. Editing two files just increases the chance that the documentation will be out of date. Though as you pointed out Jonah, there's always that chance since the documentation isn't auto-generated so the advantage may not be significant.

Also for the purpose of building the code, commenting the code in the spackage probably isn't useful. All we actually care about is what spack variants are available in the spackage. Though maybe there's a way to automatically generate the table I hand-wrote here, which would be nice.

@dholladay00 @annapiegra @mauneyc-LANL there seem to be some questions regarding the spackage. That said, I'd like to bring the documentation into the code regardless of any changes/fixes to the spack that may be needed. How do you all feel about that?

Dumb question: should we be putting "sphinx"-style comments in the spackage?

I'm not sure that's needed... we're basically using sphinx rst to hand-write the docs, but we're not doing "doxygen" style automated documentation. I'd be open to that path though if people think it's worth it.

I think the only advantage of using docstrings in the package.py file (which I think is what is being proposed?) is that the comment will exist where the code change is likely being made. Editing two files just increases the chance that the documentation will be out of date. Though as you pointed out Jonah, there's always that chance since the documentation isn't auto-generated so the advantage may not be significant.

Also for the purpose of building the code, commenting the code in the spackage probably isn't useful. All we actually care about is what spack variants are available in the spackage. Though maybe there's a way to automatically generate the table I hand-wrote here, which would be nice.

It's not exactly a table, but we could pull in code into the .rst files so when someone update the code it would get pull in automatically...

I would add a note saying spack builds are still under development.

I would add a note saying spack builds are still under development. Besides that I think it's great to have build instructions!

I'll add that.

I'm going to approve this as it is a good starting place for building documentation. There are still issues with the spack itself and those can be reported elsewhere, the documentation itself is sufficient for now.


BUILD iOS. framework FAILED Xcode 14.3 for Mac

Running pod install...                                           1,280ms
├─Building plugins...                                           1,442ms
Unable to build plugin frameworks: 2023-06-01 17:52:52.130 xcodebuild[71222:1199627] DVTCoreDeviceEnabledState:
DVTCoreDeviceEnabledState_Disabled set via user default (DVTEnableCoreDevice=disabled)
** BUILD FAILED **
The following build commands failed:
Ld /XXX/flutter/Debug/iphoneos/Debug-iphoneos/Toast/Toast.framework/Toast normal (in target
'Toast' from project 'Pods')
(1 failure)

I have the same problem, it only works on android emulator


fix(pid_longitudinal_control): slope definition

Description
Fix the wrong definition of the slope in the code coming from https://github.com/autowarefoundation/autoware.universe/pull/5090.
To remove the ambiguity in the definitions of pitch angle and slope angle, they have been defined in the readme.
Additionally, because the function name getPitch was unclear, it has been unified to the function name getSlope.
Related links
None
Tests performed
run psim.
Notes for reviewers
None
Interface changes
None
Effects on system behavior
The wrong slope compensation is fixed coming from https://github.com/autowarefoundation/autoware.universe/pull/5090.
Pre-review checklist for the PR author
The PR author must check the checkboxes below when creating the PR.

[x] I've confirmed the contribution guidelines.
[x] The PR follows the pull request guidelines.

In-review checklist for the PR reviewers
The PR reviewers must check the checkboxes below before approval.

[ ] The PR follows the pull request guidelines.
[ ] The PR has been properly tested.
[ ] The PR has been reviewed by the code owners.

Post-review checklist for the PR author
The PR author must check the checkboxes below before merging.

[ ] There are no open discussions or they are tracked via tickets.
[ ] The PR is ready for merge.

After all checkboxes are checked, anyone who has write access can merge the PR.

FIxed in https://github.com/autowarefoundation/autoware.universe/pull/5199


Fail-safed vertical offset test

Attempt to fix #251. If it still fails, I'm stomped (and will probably have to move to a different testing system)

Reran the test on Travis five times - succeeded each time. This should fix it.

Nicely done @birjolaxew !


a few miscellaneous updates

did not create a jira for these minor updates:

move "SQL Commands" subnav to the first entry under "HAWQ Reference"
update kerberos principal in an example

PR merged; closing.


process view possible anomaly

Here
http://preview.pombase.org/term/GO%3A0000165
wis4 appears
MAPK cascade
  | mkh1, pek1, shk2, sin1, wis4
and
stress-activated MAPK cascade
  | wis4 during cellular response to heat
but based on our current procedure
MAPK cascade
  | mkh1, pek1, shk2, sin1, wis4
should not display because its redundant with  stress-activated MAPK cascade

Our current procedure allows less specific terms to show up in the summary view if they have extensions that the more specific terms don't. It looks like that's the case in this example.

oh yes, it has response to heat.
Ignore. That is what we want!


Assertion was thrown building _FocusInheritedScope(dirty):

The following assertion was thrown building _FocusInheritedScope(dirty):
'package:flutter/src/widgets/framework.dart': Failed assertion: line 5656 pos 14: '() {
        // check that it really is our descendant
        Element? ancestor = dependent._parent;
        while (ancestor != this && ancestor != null) {
          ancestor = ancestor._parent;
        }
        return ancestor == this;
      }()': is not true.

Either the assertion indicates an error in the framework itself, or we should provide substantially
more information in this error message to help you determine and fix the underlying cause.
In either case, please report this assertion by filing a bug on GitHub:
  https://github.com/flutter/flutter/issues/new?template=2_bug.md

The relevant error-causing widget was:
  MaterialApp MaterialApp:file:///[redacted]/lib/main.dart:34:12

When the exception was thrown, this was the stack:
#2      InheritedElement.notifyClients (package:flutter/src/widgets/framework.dart:5656:14)
#3      _InheritedNotifierElement.notifyClients (package:flutter/src/widgets/inherited_notifier.dart:125:11)
#4      _InheritedNotifierElement.build (package:flutter/src/widgets/inherited_notifier.dart:113:7)
#5      ComponentElement.performRebuild (package:flutter/src/widgets/framework.dart:5086:15)
#6      Element.rebuild (package:flutter/src/widgets/framework.dart:4805:7)
#7      ProxyElement.update (package:flutter/src/widgets/framework.dart:5417:5)
#8      _InheritedNotifierElement.update (package:flutter/src/widgets/inherited_notifier.dart:107:11)
#9      Element.updateChild (package:flutter/src/widgets/framework.dart:3686:15)
#10     SingleChildRenderObjectElement.update (package:flutter/src/widgets/framework.dart:6442:14)
#11     Element.updateChild (package:flutter/src/widgets/framework.dart:3686:15)
#12     ComponentElement.performRebuild (package:flutter/src/widgets/framework.dart:5111:16)
#13     StatefulElement.performRebuild (package:flutter/src/widgets/framework.dart:5251:11)
#14     Element.rebuild (package:flutter/src/widgets/framework.dart:4805:7)
#15     BuildOwner.buildScope (package:flutter/src/widgets/framework.dart:2780:19)
#16     WidgetsBinding.drawFrame (package:flutter/src/widgets/binding.dart:903:21)
#17     RendererBinding._handlePersistentFrameCallback (package:flutter/src/rendering/binding.dart:358:5)
#18     SchedulerBinding._invokeFrameCallback (package:flutter/src/scheduler/binding.dart:1284:15)
#19     SchedulerBinding.handleDrawFrame (package:flutter/src/scheduler/binding.dart:1214:9)
#20     SchedulerBinding._handleDrawFrame (package:flutter/src/scheduler/binding.dart:1072:5)
#21     _invoke (dart:ui/hooks.dart:142:13)
#22     PlatformDispatcher._drawFrame (dart:ui/platform_dispatcher.dart:359:5)
#23     _drawFrame (dart:ui/hooks.dart:112:31)
(elided 2 frames from class _AssertionError)

════════════════════════════════════════════════════════════════════════════════════════════════════

Another exception was thrown: 'package:flutter/src/widgets/framework.dart': Failed assertion: line 5518 pos 14: '_dependents.isEmpty': is not true.

The main.dart referenced is just return MaterialApp(. I hope this helps! I could not reproduce this when reloading the app.

@mosuem
In order to properly address the issue, we would need a minimal reproducible code sample along with steps to replicate.

I was not able to reproduce this - a one time failure only hopefully!

Thanks for the update. Although the error message does say to file an issue for the assertion thrown, but in order to make the issue actionable, a reproducible code sample is required so that we can analyze it properly.
Since it is not replicable consistently at your end, I suggest you to keep an eye on the error and if you find a pattern that throws the error, feel free to write in comments with details so that we can take the issue forward. For now, I'll close it due to lack of reproducible steps. If you disagree, write in comments and I'll reopen it.


Is there any communication between parameter servers?

No, but there's all-to-all communication between workers and servers

Could you show me the relative source code?

The code is at https://github.com/apache/incubator-mxnet/blob/master/src/kvstore/kvstore_dist.h
and
https://github.com/apache/incubator-mxnet/blob/master/src/kvstore/kvstore_dist_server.h
Feel free to reopen for further questions


feat(explore): Fill dashboard name when adding new chart from dashboard view

SUMMARY
When user enters chart creation flow starting from a dashboard (e.g. with "Create chart" button in empty state or charts list in dashboard edit mode), the chart's save modal should have that dashboard's name prefilled. To achieve that, we pass dashboard_id as a url param to /chart/add page and from there to explore.
BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF

https://user-images.githubusercontent.com/15073128/169276098-5a2578a0-7ed4-4029-aa40-2f112e3af13a.mov
TESTING INSTRUCTIONS

Open a dashboard -> edit mode -> charts tab -> click "Create new chart" OR Open a dashboard and create a new chart using the plus icon button in top right corner.
Create a chart and click save
Verify that dashboard's name is prefilled
Create a new dashboard and click "Create new chart" button in empty state. Create a chart and verify that dashboard's name is prefilled in save modal
Create a chart from any other view (for example from Welcome page). Verify that save modal is not prefilled

ADDITIONAL INFORMATION

[ ] Has associated issue:
[ ] Required feature flags:
[ ] Changes UI
[ ] Includes DB Migration (follow approval process in SIP-59)

[ ] Migration is atomic, supports rollback & is backwards-compatible
[ ] Confirm DB migration upgrade and downgrade tested
[ ] Runtime estimates and downtime expectations provided

[ ] Introduces new feature or API
[ ] Removes existing feature or API

CC @kasiazjc

/testenv up


Broken link to Google Plus n the wiki

There is a link to https://plus.google.com/u/0/+FrancoisBeaufort/posts/JDVkXALPcNq in the wiki. The link is broken — Google Plus is defunct.
I have not edited the wiki page because I don't know what new link would be a suitable replacement.

Removed reference & link to deprecated G+ discussion here.


Implement LoomProvider2 for /eth endpoint

We need to start migrating loom-js over to the /eth JSON-RPC interface. Soon it should be possible to send Ethereum txs to the /eth endpoint, at which point it'll be possible to use something like Metamask without a LoomProvider (just using web3). Nonce management is still going to be tricky though, the /eth endpoint will only support what is essentially the basic NonceTxMiddleware https://github.com/loomnetwork/loom-js/blob/3304853ea71eb41232dd0b780c63d5c85cf16e4d/src/middleware/nonce-tx-middleware.ts#L21
The basic nonce management will be good enough for simple frontends, but it won't work for some gaming use cases that need something like the cached & speculative nonce middleware, so we'll need a new LoomProvider2 that does querying via /eth, but uses the nonce middleware to manage nonces.

LoomProvider2 will have deeper integration with Web3 now that version 1.2.1 reached a stable cycle and the past issues with the lib are fixed, the next step is to put LoomProvider2 on loom-js, I'm working on that :)


⚠ RPC server - Optimism has degraded performance

In b8530eb, RPC server - Optimism ($OPTIMISM_RPC_URL) experienced degraded performance:

HTTP code: 403
Response time: 139 ms

Resolved: RPC server - Optimism performance has improved in 17c31b0 after 1 hour, 51 minutes.


Int64 indexing implemented.

Int64 Index Conversion for Large Memory Operations
What
Adds automatic conversion to int64 indices when operations would exceed int32 bounds.
Why
Enables support for:

Arrays larger than 2GB
Index calculations that exceed int32 range
Prevents integer overflow issues

How

Added pattern matcher rule for int64 conversion
Detects when values exceed int32 range using _min_max tracking
Converts operations and their inputs to int64 when needed
Preserves existing int64 operations

Testing
Added unit tests that verify:

Basic int32 overflow handling
Complex operations with large values
Value preservation after conversion
Tests are efficient (no large memory allocation) while still covering the functionality.

@geohot Could you review this PR when you have time? Let me know if there's anything else I should add or improve.

Any updates @davidjanoskyrepo

The tests look better. Not sure if gh will go for the implementation though.

@geohot
Can you give feedback on that?


Scrolling bg

Describe your problem here.
I need help to make an animated bg like nigthmare run of indie cross using .Lua
Are you modding a build from source or with Lua?
Lua
What is your build target?
Windows x64
Did you edit anything in this build? If so, mention or summarize your changes.
No response

in that mod the bg has an xml, so check the wiki here


Develop strategy for updating the IA of the authenticated site

Problem statement
The code mapping tool will not be public-facing and thus will require users to log in to use it. We need to revisit the IA and navigation patterns of the authenticated side of the website to ensure that onboarding tools (including the public key tool and submission history/daily data) are easily accessible for our users throughout their ReportStream journey.
What you need to know

ReportStream sitemap
Figma workspace

Acceptance criteria

[x] IA revisions proposed (using artifacts like the sitemap or through Figma mockups)
[x] IA revisions reviewed and approved by Product and Engineering
~- [ ] Code mapping tool designs for handoff are updated with finalized IA component~

To do

[x] Review spec design MVP with Product to determine first steps

May split into two tickets.

Reviewed with Eng and Product today. Notes below.
Raw notes

EB: Prefer opt 2 > opt 3. Opt 2 like a toolbox vs. opt. 3 is holding your hand through something prescriptive
VC: Is it possible to do all 3?

Opt 1: the links should be in the auth nav

Opt 2: need a landing page

Opt 3: having the instructions is helpful

JA: +1 to Etan, like opt 2 + 3.
JA: Where would the landing page live in the nav?
CK: The three diff opts all solve 3 diff issues.

Opt 1: We need a place for these tools to live

Opt 2: Clarifies with what RS has to offer for logged in users

Opt 3: Clarifies what the onboarding steps are

CK: Have heard more of a user need for Opt 3
CK: Thinking of the MVP as a public version of Opt 3

Reframe as the first step being reworking our onboarding steps & content

VC: Need to make sure that as a PRIME admin, I can dupe the org and actually use the tools

Action: Flag for future investigation

Next steps

Jillian/Chris/Victor (early Q2): Review onboarding steps and update site-wide
Jillian (early-mid Q2): Design auth nav bar to include more clear link to the Landing page while Chris/Etan build the code mapping tool with ACs to add to the auth nav bar
Jillian (late Q2): Design auth landing page that incorporates all 3 options

Removed last AC because we are blocked by the need to update the design for the auth bar.
Updating the code mapping design with the final nav component is now an AC for this Q2 ticket: Update auth navigation bar design #16832. Closing!


Add API endpoint for overloading the chart with a custom formatting callback

The Chart#setCustomXAxisTickLabelsMap and Chart#setCustomYAxisTickLabelsMap methods are not very user-friendly, since the user has no idea how to compute the optimal number of ticks for an axis.
This PR adds an option to override axis tick label formatting with a callback function, while maintaining the default AxisTickCalculator_Number behaviour.
Another custom formatting callback function can be added to the cursor, for more fine-grained control.
Furthermore, this PR optimizes the AxisTickCalculator so that - if x or y data is evenly spaced - it places the tick labels exactly where the data points are.
A usage example has been added with the DateChart09 class.

Does it make sense then to remove Chart#setCustomXAxisTickLabelsMap and Chart#setCustomYAxisTickLabelsMap so that there is only one unique way to set custom ticks and tick labels??

Does it make sense then to remove Chart#setCustomXAxisTickLabelsMap and Chart#setCustomYAxisTickLabelsMap so that there is only one unique way to set custom ticks and tick labels??

I would suggest deprecating them first.


Remove sync-over-async test code for Files/Queues tests

Fixes #6635 for Files/Queues

@seanmcc-msft and @amnguye - these are only changes to test code to remove sync-over-async for perf investigations and I'm planning to merge these soon.

/azp run net - storage - ci


fix(udf): upgrade arrow-udf to 0.5 which fixes rust udf compilation

I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.
What's changed and what's your intention?
Fix #18797.
Checklist

[ ] I have written necessary rustdoc comments
[ ] I have added necessary unit tests and integration tests
[ ] I have added test labels as necessary. See details.
[ ] I have added fuzzing tests or opened an issue to track them. (Optional, recommended for new SQL features #7934).
[ ] My PR contains breaking changes. (If it deprecates some features, please create a tracking issue to remove them in the future).
[x] All checks passed in ./risedev check (or alias, ./risedev c)
[ ] My PR changes performance-critical code. (Please run macro/micro-benchmarks and show the results.)

[ ] My PR contains critical fixes that are necessary to be merged into the latest release. (Please check out the details)

Documentation

[ ] My PR needs documentation updates. (Please use the Release note section below to summarize the impact on users)

Release note
If this PR includes changes that directly affect users or other significant modifications relevant to the community, kindly draft a release note to provide a concise summary of these changes. Please prioritize highlighting the impact these changes will have on users.

#18862  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @stdrc and the rest of your teammates on  Graphite

So why CI didn't fail? 👀

Oh, I got it. That's because it'll only fail to compile when there's array type in arguments. Let me add a test for this.


DotNetCoreBuild is only using the default nuget package source

What You Are Seeing?
DotNetCoreBuild is only using the default nuget package source, even though my cake script explicitly adds a new source.
What is Expected?
DotNetCoreBuild should search all available package sources in the global nuget config, as there is no local one.
What version of Cake are you using?
0.21.1
Are you running on a 32 or 64 bit system?
64-bit
What environment are you running on?  Windows? Linux? Mac?
Linux (Ubuntu 16.04 LTS) inside a Docker host that is also on Ubuntu 16.04
Are you running on a CI Server?  If so, which one?
TeamCity
How Did You Get This To Happen? (Steps to Reproduce)
I add, on build start, the credentials to access a private nuget source to my global config. Upon invoking the build, only the default NuGet server is loaded.
There is no NuGet.Config file in the repository.
	//TeamCity NuGet Setup
	var nugetSourceSettings = new NuGetSourcesSettings
	{
		UserName = EnvironmentVariable("OMNIA_PRIVATE_NUGET_USERNAME"),
		Password = EnvironmentVariable("OMNIA_PRIVATE_NUGET_APIKEY"),
		IsSensitiveSource = true,
		Verbosity = NuGetVerbosity.Detailed
	};

	var feed = new {
		Name = "OmniaPrivateFeed",
		Source = EnvironmentVariable("OMNIA_PRIVATE_NUGET_SERVER"),
	 };

	if (!NuGetHasSource(source:feed.Source,
    settings:nugetSourceSettings))
	{
		NuGetAddSource(
			feed.Name,
			feed.Source,
			nugetSourceSettings
		);
	}

//INVOKING THE BUILD:

var buildSettings = new DotNetCoreBuildSettings
{
    Configuration = configuration,
    ArgumentCustomization = args=>args.Append($"/p:Version=\"{version}\"")
};

DotNetCoreBuild("./OMNIA.sln", buildSettings);

Output Log
This is the TeamCity execution log.
https://gist.github.com/josemaia/429c3483f9f395f50feb87ed3c67dd7d
Any builds ran after this display the new feed as having been successfully added, i.e.:
[14:00:53]	[Step 1/1] Downloading NuGet...
[14:00:57]	[Step 1/1] Feeds used:
[14:00:57]	[Step 1/1] /root/.nuget/packages/
[14:00:57]	[Step 1/1] https://api.nuget.org/v3/index.json
[14:00:57]	[Step 1/1] https://teamcity.example.com/httpAuth/app/nuget/v1/FeedService.svc/

A verbose execution log is also available here, but it is a manual execution, not via TeamCity: https://gist.github.com/josemaia/94aef12b6a3d53a7826272b5041359cc

What sources do you have specified for DotNetCoreRestore?

I am not using DotNetCoreRestore, as this is a .NET Core 2.0.0 project. I attempted to add it, and add "--no-restore" to DotNetCoreBuild, but the problem still ocurred.
Should I do this, but without specifying source on Restore?

Also .NET CLI doesn't handle encrypted credentials so you'll need to specify to store as plain text
https://cakebuild.net/api/Cake.Common.Tools.NuGet.Sources/NuGetSourcesSettings/E1D7BE8B

Task("Restore")
    .IsDependentOn("Clean")
    .Does(() => {
		DotNetCoreRestore("./OMNIA.sln");
});

Task("Build")
    .IsDependentOn("Restore")
    .Does(() => {
		var buildSettings = new DotNetCoreBuildSettings
		{
		 Configuration = configuration,
		 ArgumentCustomization = args=>args.Append($"--no-restore /p:Version=\"{version}\"")
		};

		DotNetCoreBuild("./OMNIA.sln", buildSettings);
});

With this strategy, the build passed (it's failing elsewhere but that's my fault! 😆
With .NET Core 2.0, it shouldn't be necessary to do a manual restore first, though, right? Does this seem like Cake's or dotnet's fault? I can close the issue if you suspect dotnet.

Well Cake  only shells out to the tools, if you launch Cake with diagnostic verbosity you'll see the command line used by Cake and could try the same in a console.

Manual restore made the problem not happen anymore.


Fix stake is none

Stake on the chain is represented as a map of coldkey to stake value for each Neuron (hotkey).
This PR modifies the neuron stake to match this representation, as expected.
TODO:

[ ] Convert stake map to tensor
[ ] Convert stake map to dataframe for state dict
Decided not to save stake map per @unconst

Closing until tests pass


Add workaround for iOS build

There is an issue in bindgen that prevents building for the aarch64-apple-ios target. This works arounds the issue by replacing aarch64 with arm64 which clang can understand.
Also fixes conditional includes for macOS, which was using the target of the build script instead of the target we're building for.
Close #285

@karroffel I've mistakenly pushed the fix/ios-built branch to this repo instead of my fork, and have deleted it, causing the push CI build to fail (because it can't find the branch anymore). The pr CI build is passing.


UpdateCallback does not work after  some time

Hi there.
I am using this great api for some time now.
I use an UpdateCallback after signIn to get new updates.
It works fine, But if I don't use any api method for some time, It does not get any new updates at all.(it may accur other times too,I did not test for other scenarios )
It seems that it lost its connection and does not retry to connect.

Hi,
thanks for the feedback,
FYI: I'm currently in the process of refactoring (rewriting some parts) the whole lib with a better architecture, currently finished the tl-builder and tl module, now on the mtproto.
While doing the mtproto, I'll add a ping request every X secs/mins that should solve this issue hopefully.
Can't give you a date though,
in the mean time, you can try to do it manually, by adding a request every X secs/mins

Nice. Thanks for the Quick Response.
Is it going to fix #33?(It will be wonderfull)

No idea about that, I really hope so, but since I have no clue where it's coming from, I'm not too confident :/


UHF-X menu top level id

Set global navigation top level id to be the name of the site
Set first level parent id to match top level id

Codecov Report

Merging #5 (1a3062f) into main (ba109b0) will increase coverage by 0.20%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##               main       #5      +/-   ##
============================================
+ Coverage     22.64%   22.84%   +0.20%
- Complexity      112      114       +2
============================================
  Files            14       14
  Lines           371      372       +1
============================================
+ Hits             84       85       +1
  Misses          287      287

Impacted Files
Coverage Δ

...dules/contrib/helfi_navigation/src/MenuUpdater.php
100.00% <0.00%> (ø)

...trib/helfi_navigation/src/Menu/MenuTreeBuilder.php
26.19% <0.00%> (ø)

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Use huggingface auth token for downloading models

Login to HF hub (using the token from the settings) when downloading weights, config and tokenizer.
Works successfully for a private model that fails on current main branch.
Fixes #143

I'll wait till #168 is merged to avoid any merge conflicts for @haqishen


Show other than "null" for SecretString parameters when listing Graphs for LiveVideoAnalytics.Edge

Describe the bug
When getting data from GraphInstanceList, show other legend than "null" for those parameters that are defined as SecretString at the topology level.
As a dev, if I see null somewhere unexpected, my sweating begins :)
Expected behavior
<secure/hidden-string> or whatever.
Actual behavior (include Exception or Stack Trace)
[Edited...]
{
  "Value": [
    {
      "Name": "Sample-Graph-1",
      "ApiVersion": null,
      "SystemData": {
        "CreatedAt": "2020-07-31T16:42:05.766+00:00",
        "LastModifiedAt": "2020-07-31T16:42:05.766+00:00"
      },
      "Properties": {
        "Description": "Sample graph description",
        "TopologyName": "SomeTopologyName",
        "Parameters": [
          {
            "Name": "rtspPassword",
            **"Value": null**
          }
        ],
        "State": 2
      }
    }
  ],
  "ContinuationToken": null
}

Tagging and routing to the team best able to assist.

Closing as it doesn't belong here. Sorry about the confusion.


Ignore .swp files

Check the following:

[na] Breaking changes marked in commit message
[na] Changelog updated
[na] Code style cleaned (ran make style-fix)
[na] Tested on actual hardware

See review comment.


Generate correct epoch timestamp even for different Daylight Saving Time

Which issue(s) this PR fixes:
Fixes #3195
What this PR does / why we need it:
Fluentd generates wrong epoch timestamp when a configuration doesn't specify timezone (should be parsed as UTC) and incoming event has a time with different DST than now. It's because Time.now.localtime.utc_offset is always used as a time offset for event times.
This commit parse event times correctly as UTC without complicated calculation by adding %z to a time format and Z to a time value on calling strptime for such cases.
In addition, require strptime 0.2.4 or later to parse Z as UTC:
https://github.com/nurse/strptime/commit/39bbe26566985770dcb01fc39339f83da3f5e419
Docs Changes:
None
Release Note:
Same with the title

I'll try to add a test for it...

Oops, a test failed. I'll check it.

I've fixed it.


ProblemStatement needs domain filters

In hackathon app (django app) we have multiple models and you'll realize why we have models for each and everything. So in ProblemStatement model we need to have one more field called domain (eg. machine learning, AI, web development, app development etc) for each problem statement. This will help users to filter out those problem statement which their team is capable of and filter it out
In general it will be ManyToMany field with another model called ProblemDomain which will consist of name, description, created_at and obviously one id either int or uuid. So this is the task. Make sure you migrate and there should be only 1 new migration file

Fixed


Only ten posts?

I tried this theme with my blog, but it seems to have only ten posts off of the main page hardcoded into layouts_defaults\list.html - this seems like a really low number for a blog theme and I'd like to know why this is.

Hey @4thAce!
Thanks so much for the feedback, and indeed, the number of posts shouldn't be hardcoded.
Ideally, this should be customizable with the config file, but I don't have the time right now in order to do the update, so if you need this to be implemented ASAP I suggest one of the following options:

Submit a pull request with the fix
Fork the theme and customize it with the number of posts that you desire.

Cheers!

Thanks for letting me know, I thought I was missing something for the longest time. I'll probably just play around with upping the hardcoded value for now


Potentially unhandled rejection [2] Error: no writecb

Full Error:
Potentially unhandled rejection [2] Error: no writecb in Transform class
This issue has occurred here : https://github.com/stevelacy/gulp-stylus/issues/127
I believe that some form of a fix needs to be applied to gulp-stylus.
Both gulp-traceur: https://github.com/sindresorhus/gulp-traceur/pull/42
and gulp-esnext: https://github.com/sindresorhus/gulp-esnext/issues/8
have applied changes to fix the issue.
The fix appears to be small, requiring very few changes. I attempted to fix the issue and was unable to make it work.
Thank you!

I'm running into the same thing, I'd be curious to know how you fixed it?

Oh, well that was easy. Upgrading Node to the latest version fixed it (in fact I had tried that already but for some reason Gulp was still running using an older version).

well i am using the latest node already but nothing fixes this we can simply say that gulp is broken


Changes required to use "inproc" ZeroMQ transport + example app

First commits adds runSPVServerWithContext (by separating it out from runSPVServer), which allows passing a specific ZeroMQ Context to the haskoin-wallet server. A shared Context between receiver and sender is required in order to speak to the server in-process/inter-thread via the "inproc" ZeroMQ transport.
Second commit adds an example executable that embeds a haskoin-wallet server in-app, using runSPVServerWithContext and the "inproc" transport for inter-thread communication with the server. (If I had more ncurses skills I would create a proper GUI for it, but for now it makes most sense to run it as example-inproc-wallet-server 2> debug.log and, optionally, view the log using tail -f debug.log)

In a completely unrelated move, I've also added a pubkeys command to the hw command line utility, for displaying the public key related to an address.

Question: is the only case where a WalletAddr doesn't contain a compressed pubkey (in the "key" field) the case where the account is multisig? Or would a regular account (read-only or not) have some reason not to contain a PubKeyC in the key field for a WalletAddr?

Looks really cool. I will wait and see what @plaprade has to say about it. I haven’t tested yet but I like the direction this is taking.

I have factored out the "inproc"/runSPVServerWithContext patch into a separate branch. So I'm closing this pull request, and will open two separate ones.


feat: adds OracleLinux support

OracleLinux is a CentOS-based distribution, so detecting it as such.
Tested these changes on a couple of ARM-based instances with OracleLinux.

Thanks for this PR! I want to create a docker image of this distro configured for Ansible and Molecule for the tests before I merge this. Will do that in the next few days.
So CI passes, I'll fork your PR and put it up in the repo with the container addition. That will preserve your commits so your contributions to the repo are maintained.

I created https://github.com/artis3n/ansible-role-tailscale/issues/112

Going to merge this as part of #114. Added an oracle linux image for the CI tests and made some quality of life refactors. Preserved the commit history from this PR to keep your contribution to the repo recorded.


Spaces in folder names break asset search

I'm using an S3 bucket, a custom root path ("assets/"), and have found that having spaces in folder names confuses Moulinette's search.  Because it's comparing a URL-encoded string with a "normal" string.  Example from its debug messages:
Moulinette FileUtil | Assets: ignoring assets/venatus-maps/Swamp Assets/Dead Trees which is NOT a subfolder of assets/venatus-maps/Swamp%20Assets as expected!
Note the Swamp Assets is a silly attempt on my part, as I just realized it's already included in Moulinette (guessing due to Patreon membership and linking).  But, the bug still stands that Moulinette should be comparing either URL-encoded to URL-encoded, or "normal" to "normal".  Not one to the other.

I'm not able to reproduce this issue. I tested a custom path on S3 and a folder name with space.
Everything gets indexed and I can see it in moulinette.
Could you please provide more information ?

What is the action which triggers the above error (search, indexing, etc.)?
Which version of moulinette core do you use?

Closing this issue. Cannot reproduce it. Feel free to re-open it with the requested additional information.


<EMAIL_ADDRESS>-  'image/jpg' is not supported

Hi,
I have this log message for jpg images:
textPayload: "Image type 'image/jpg' is not supported, here are the supported file types: image/jpeg, image/png, image/tiff, image/webp, image/gif, image/avif"
It is very surprising that a .jpg extension would not be supported?

image/jpeg is the MIME type for JPEG files which includes both .jpeg and .jpg extensions.
image/jpg is not supported, but it could be programmed in to revert to image/jpeg should someone provide  image/jpg.