Not generating emojis correctly

Prompt: Write a Christmas message with emojis
Using the InstructExecutor.InferAsync() with the Mistral Instruct 7B model
Output: ������🎉Merry Christmas!���🏻���
Looks like the output is not getting tokenized correctly.
Thanks,
Ash

This is a known issue, and is actually a surprisingly common issue across tokenizers in many projects! For example try this tool in text mode and paste in some emoji. It's caused when one single character is represented by multiple tokens.
This has been fixed in the StatelessDecoder by using the StreamingTokenDecoder. That same fix will need to be applied to the other executors at some point.

Thanks Martin.
Quick question - Would this cause an issue with Chinese and Japanese characters too?
Thanks,
Ash

Would this cause an issue with Chinese and Japanese characters too?

Yes! In fact the issue report that got me working on this issue was from someone using Korean, but there were other related issues from people using Cyrillic and Chinese characters (and I'd spotted it myself in English, but with emoji).
It's not every character in those languages, just ones which the tokenizer cannot represent in a single token (which seems to be fairly rare).

Thanks Martin.
I tried the StatelessExecutor.
It did give me correct emojis but then continued to output nonsense text. Pasting a small snippet below.
🎁🎅🎈 Merry Christmas! 💙🎊industriëšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšćîšìîšćîšìîšćîšćìšćîššìšćîshć****ššćîšćìšćîshccššćîshć~\šćìšćîshćìšćîshćìšćîshćìšćîshćìšćîshćìšćîshćìšćîshćìšćîshćìšćîshćššćîshćìšćîshć~\ishšćîshćìšćîshćìšćîshćìšćîshćìšćîshćìšćîshćìšćîshćššćîshćìšćîshćìšćîshćìšćîshćìšćîshćššćîshćìšćîshćîshćîshć Industîshć îshîshćindustîshćİshššīshćîshćìšćîshćîshćîshćîshćîshćîshćîshćîshćîshćîshćîshćîshćîshćîshćîshšishšćîshššìšćîshćîshćîshćîshćîshćîshšìšćîshšìšćîshćîshšìšćîshšìšćîshšìšćîshšìšćîshšìššššīshšìšćîshššìšćîshšishšćîshšìšćîshššìššìšćîshšìšćîshšìšćîshšìšćîshšīshššìšššìšîshšıshšìš6îshšìšćîshšìšćîshšìšćîshšìšshîshćîshšìšćîshšīshšishšćîshšìšćîshšıshšìš-----------------š--------------------îshš---------------------,6š--------------------îshš----------------îshć Industîshš5š--------------------îshšīshš

What did you have set as your antiprompts?

List { "", "User:", ">" }

From the antiprompts it looks like it's "correct" that it never stopped - it never generated any of the antiprompts. Could you try exactly the same model and prompt in the main llama.cpp project to see if it produces the same output? It may just be that the model is getting confused by the emoji and gets stuck outputting nonsense.

I have just tried the current version of the Master Branch with emoji in the text, unfortunately they still seem to be displayed incorrectly.

Do I need to activate the StreamingTokenDecoder feature somehow?
I has used the avx2 binaries for testing, which I downloaded here:
https://github.com/SciSharp/LLamaSharp/actions/runs/6762323560

Was this using the StatelessExecutor? The StreamingTokenDecoder fixes the problem, but it's only being used in that one executor right now. Someone is going to have to modify the other executors to use it.

@martindevans Do you mean the Inference Type "Stateless"?
This seem to work with emoji, but it is writing some strange text :D

Oh, I think this problem is caused by a different model. Previously I tested with vicuna-7b-v1.5.Q3_K_M.gguf which was caused this strange behaviour in the text output. but now I tried llama-2-7b-chat.Q5_K_M.gguf, which gives me a much better result :)

That still looks like the model is running on without stopping. What are the antiprompts set to?

The Antiprompt is set to default "User:"

Ah I guess we're not looking at the raw text here, it's presumably stripping out the antiprompt so we can't see it.

the web example does a bit of extra filtering using ITextStreamTransform, so could be worth checking against vanilla LLamaSharp to confirm, its possible the web is causing stateless to go awol

Shall we take this issue as completed?

I just tested this with the latest master branch and it works :-)
Closing ...


Project list truncated

When configuring, our Project list is very long.  The list is truncated so that we can't select any projects beyond the letter "F" - is it possible to allow search, or a longer list, or manual ProjectID configuration?  Thanks in advance.

Please check out this fork, which has the issue fixed: https://github.com/blueshiftone/streamdeck-toggl


Unable to get property 'getPlacePredictions' of undefined or null reference

Short description
I have Sentry reports about an error, with the following code snippet:
is.props.country}),this.setState({isLoading:!0},function(){e.autocompleteService.getPlacePredictions(t,function(t){e.setState({isLoading:!1}

Expected results
No runtime error
Actual results
After investigating, it comes from this line, when this line "fails" and this.autocompleteService is null. It happens mostly when the user has a flaky Internet connection.
Reproduction steps

Launch the live demo
Make the call to GMaps fail with bad connection
Witness the error in console

Additional Information
I am available to do a PR if you want, but would need to discuss context beforehand (should the suggest fail silently, or retry until it succeeds, or...).
Thanks in advance!
Edit: exactly the same with this line because this line also fails, producing this snippet:
ps.country?{country:this.props.country}:null},this.geocoder.geocode(o,function(o,n){if(n===t.googleMaps.GeocoderStatus.OK){var r=o[0],i=r.ge

Thanks for bringing this up! Maybe retry three times and then fail?
Sorry for the delay, I was on parental leave the last months.

This happens for me 100% of the time.

@mynameiswillporter That’s sad. But as I mentioned before, you’re free to implement a retry and open  a PR.  :)


The text in the RadioGroup renders to the left instead of centered

Request that this be centered to match iOS or provide a HorizontalTextAlignment option.
I would like to use this control in an upcoming demo. Appreciate the library.

Note the text only shifts left once you click on a segment. Initially it is centered.

Issues seems to have resolved itself. Very strange.


completer popup is not going away sometimes

Describe the bug
in Code, typing, doesn't go away
How to reproduce
seems fairly random unfortunately.  can still hit esc or click off to get it to close, so its not perma-stuck.  some kind of mutex issue undoubtedly.
Example code
No response
Relevant output
No response
Platform
macOS

This no longer seems to happen; this issue can be reopened if it does.

yep still happening.  need to figure out conditions for reproducing.

this should now be fixed -- don't use async for 0 delay case.


Make PyDict iterator compatible with free-threaded build

This pulls in the PyCriticalSection_Begin & PyCriticalSection_End functions new in 3.13 and use it to lock the PyDict iterators as d
described here. I'm not sure about the PyCriticalSection struct definition. We cannot use the opaque_struct! macro to define this struct because we have to allocate enough space on the stack so we can pass the uninitialized  pointer to PyCriticalSection_Begin. So some help would be appreciated!
depends on #4421
related to #4265

I actually have a branch with these changes (more or less) that I was planning to do separately from that PR. Unfortunately the deadlock I found is caused by something else.
If you're planning to work on this stuff I'd appreciate it if you could comment on the tracking issue so we can coordinate work and avoid duplication.

Replace the implementation with PyObject_GetIter and PyIter_Next (slow?)

I think we should seriously consider going this way and benchmark if it's actually a performance concern. We already made the same change for sets a couple of releases back, it wasn't a major performance impact there compared to the wins from the Bound API. Two reasons why we did it for sets:

_PySet_Next (or whatever the API was called) was a private API
It doesn't do the right thing for subclasses of sets with custom __iter__ functions

Similarly our current implementation doesn't respect dict subclasses with custom __iter__ functions? Should it? Probably, in which case we might just want to switch to PyObject_GetIter anyway.

I opened https://github.com/PyO3/pyo3/pull/4477 with a different implementation of the FFI bindings.

I opened https://github.com/PyO3/pyo3/pull/4477 with a different implementation of the FFI bindings.

Sorry for the late reply. Your implementation looks good, and the 'opaque_type!' use is exactly like what I was looking for. I will update my MR after the weekend.

This use of the critical section api seems unwise. This allows users to create several critical sections (and worse) allows them to release them in arbitrary order. I don't think I understand the critical section api well but it seems guaranteed to cause issues.
I can see two obvious solutions:

Replace the implementation with PyObject_GetIter and PyIter_Next (slow?)

Implement some form of internal iteration:

impl PyDict{

    pub fn traverse<B>(&self, f: &mut impl FnMut(Bound<'py, PyAny>, Bound<'py, PyAny>) -> ControlFlow<B>) -> ControlFlow<B> {

        struct Guard { .. };

        impl Drop for Guard { ..release critical section }

        let mut cs = std::mem::MaybeUninit::zeroed();

        ffi::PyCriticalSection_Begin(cs.as_mut_ptr(), dict.as_ptr());

        let mut ma_used = ..;

        let mut di_used = ..;

        let key = ...;

        let value = ..;

        while PyDict_Next(...) != 0{

           f(key, value)?;

        }

        ControlFlow::Continue(())

    }

}

Interesting solutions 👀. I will try to implement the first one and test the performance hit after.

ouch that does seem to be a big perf hit

Yea this is really bad, but kind of expected as dict.items() creates a copy of the iterable and saves it into a PyList.

I've also looked into iterating a raw dict but this only yields the keys. So it does not protect against modifications of the values before fetching them on the next call.

I wonder if the critical section API is actually problematic in practice. You could try iterating over the same dict in many threads on the free-threaded build as a stress test. I'm not sure if there are other usage patterns that @mejrs might be concerned about.
It would be nice if we could still keep the fast path for dicts and then only degrade to the slow path if we're not handed an instance of PyDict_Type.

Yea this is really bad, but kind of expected as dict.items() creates a copy of the iterable and saves it into a PyList.
https://github.com/python/cpython/blob/main/Objects/dictobject.c#L3381-L3432

dict.items() is equivalent to the Python 2 semantics where .items() in Python did create a new list. Is perf any better if you try .dict.call_method0("items") to get an iterable items view?

Yea this is really bad, but kind of expected as dict.items() creates a copy of the iterable and saves it into a PyList.
https://github.com/python/cpython/blob/main/Objects/dictobject.c#L3381-L3432

dict.items() is equivalent to the Python 2 semantics where .items() in Python did create a new list. Is perf any better if you try .dict.call_method0("items") to get an iterable items view?

I didn't know that this is different, learning something new every day! It is indeed somewhat faster. We went down from ~87% slowdown to ~62%.

It would be nice if we could still keep the fast path for dicts and then only degrade to the slow path if we're not handed an instance of PyDict_Type.

I made the previous fast path available to non-freethreaded builds when the dict is not a subtype of PyDict. This gives us minimal performance regressions on existing code.

Thank you for all your suggestions. Please review again if you have time. I've implemented fold and try_fold methods with critical sections. We probably want to run the full CI to validate my implementation. Furthermore I do not copy the dict on free-threaded builds and added a locked_for_each method.  I will focus next on writing docs to guide people to away from using for x in dict on free-threaded.

👍 thanks! I will try to read tonight or tomorrow evening!


Add support for reading CSV files from Binance

Binance exports a different schema for spot trade
transactions and "buy bitcoin with fiat" transactions,
so they have to be separately handled.
My guess is UI will have to detect the format and
use the correct implementation based on the header.
Also, the exported trades do not have identifiers, but the buy/sell transactions do :)

For bringing this to the UI: I have a raw sketch of fetching historical pricing information from Binance as well. It would probably make sense to integrate that as a separate API module before hooking up any changes to the UI.
For the UI some of the following may be required:

Add option to import from Binance as well, and give it equal weight in the UI with Coinbase
Autodetect type of report based on header, since Binance has different output for spot trades and fiat crypto purchases
Use Binance API to get unitPriceEur for transactions carried out on Binance (different exchanges have a different selection of tokens/markets)
In manual entries, make user specify which exchange the trade was carried out on?

I'm also willing to work on #4 in the near future for better granularity of transaction times.


Changing WifiMonitor exposing method to Flow.

WifiMonitor exposes a flow of WifiStatus via start() method.
After creating a WifiMonitor object, start() should be called to start publishing in the flow.
Moved the original logic accordingly with the Flow specifications.
Close #6

Fixed as suggested: WifiStatus can be a local variable.
I also updated the CHANGELOG.


Migrate to 0x instant

Coverage remained the same at 56.073% when pulling fa1cc8b60be65b572bed67664ceca990e52024fa on justinbarry/ch17876/replace-shapeshift-link-on-account-deposit into 383150a2d981a7aea0565b74f9626a2e4776eac7 on master.

I'm curious about why the AirSwap widget was removed here. Should we not allow both of these decentralized atomic swap solutions (0x and AirSwap) and let the user choose whichever method they prefer?
Would you accept a PR that puts the AirSwap widget back into the UI?

Yes, we would accept a PR for adding back AirSwap.


⚠ Bofrost.fr has degraded performance

In e60ac03, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 1157 ms

Resolved: Bofrost.fr performance has improved in 26f702f.


[Bug] favicon incorrectly fetch

Describe the bug
The favicon is not correctly fetch and text is showed instead.
To Reproduce
Steps to reproduce the behavior:

Bookmark an other cool selfhosted project on github
Go to your grimoire page and see the text overlapping where the favicon should be

Expected behavior
The favicon should show correctly
Screenshots

Hello @rllola! The text being displayed may be a fallback for the <img> tag. Can you post here how does the URL for it look?

Yeah sure.
So if you want to reproduce it you can try to add this other cool selfhosted project to your collection : https://github.com/jordan-dalby/ByteStash
As an icon it pickup this url : https://github.com/manifest.json
It should just pickup the github icon but is missing it.


Fix loading example in opus dataset cards

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.


Add cargo-audit and some minor improvements to the dev environment

We should rebuild the docker container once it is merged into master to pre-cache cargo audit

We should rebuild the docker container once it is merged into master to pre-cache cargo audit

That's IMHO not really necessary unless we need cargo-audit in our CI pipeline.
(We may want to refactor shell.nix to differentiate between CI-deps and "devtools" if we have more of that optional buildInputs in the future btw)

That would be great, because now the ci downloads cargo-audit on every build which slows down the ci process

That would be great, because now the ci downloads cargo-audit on every build which slows down the ci process

Can't we cache e.g. /nix/store and ~/.rustup to reduce at least IO during a build?
The refactoring for the nix-shell expression is IMHO rather simple, will file a patch here tomorrow :)

We currently cache pretty much everything, but the cache depends on that shell.nix file: https://github.com/squirrel-labs/docker-rust-wasm/blob/master/Dockerfile
not an idele solution, but it works quite well


Question

Hi,
the screenshot looks really, really nice and clean. What terminal/editor was used?

Here you go: https://github.com/jorgegonzalez/snapterm
Used with Terminal.app on macOS High Sierra.


Popstate event not cleaned upon unmounting app

Version
4.1.6
Reproduction link
stackblitz.com
Steps to reproduce

In the reproduction link, click on "open in new tab" in the top bar (only works for chromium based for me)
This is needed because the embedded demo is inside an iframe which breaks what follows

open console

type getEventListeners(window), notice absence of popstate events

press mount button

type getEventListeners(window), notice 1 poptstate event

press unmount button

type getEventListeners(window), notice 2 popstate events

You can repeat 4-7 as much as you want.
What is expected?
The popstate event is cleared when app is unmounted
What is actually happening?
popstate event are never unregistered

Hello !
First of all, thank you for your work on this amazing library !
I am aware that we can "fix" the infinite push of popstate event by having the router initialized only once. However, there is still a dangling popstate event that will remain even in this case. Moreover, in our architecture, we create the router through a function which gets called everytime the app needs to be mounted. So we can't necessary rely on this solution. Nevertheless, I would argue that having dangling events can add unecessary noise, and it actually is creating an issue on our side with a micro-frontend architecture and several routers managing their own popstate events.
We noticed that the unmount function does not call the history's destroy function.
Would doing so break any behaviour that needs to be kept ?
If so, would it be possible to alter the API to provide an option like router.destoryOnAppUnmounted or so boolean to trigger this destroy ? If you uncomment line 37 in the reproduction link, you can see that it fixes the issue.
Thank you in advance,
cheers

The history instance is passed to the router, not managed by it so it makes sense to manually destroy it when the app is unmounted. Destroying it would indeed break anybody reusing the history instance and it’s there on purpose for flexibility.
Adding a line of api to replace another line of code is definitely something I would avoid 🙂

Hey,
Thank you for your quick answer ! 😄
Out of curiosity, what would be a use case of reusing the history after the app has been unmounted ?
And in such cases, what would be the goal of keeping the popstate event alive while the app is unmounted ?
About the API thing, I understand your point, but it's not necessary one line of code. If i simplify a bit our code, we have something like this :
// router.js
export const routerFactory = (base) =>
  createRouter({
    history: createWebHistory(base),
    routes: routes,
  });

In order to destroy manually, it'd mean doing something like so :
// router.js
export let history = undefined;

export const routerFactory = (base) =>
  if (!history) {
    history = createWebHistory(base);
  }

  createRouter({
    history: createWebHistory(base),
    routes: routes,
  });

and then
// index.js
import { history } from `router.js`;
...
app.use(router);
const appUnmount = app.unmount;
app.unmount = () => {
  history.destroy();
  appUnmount();
}

or
// App.vue (root element)
<script setup>
import { history } from 'router.js';
...
onUnmounted(() => {
  history.destroy();
});

I find these two solutions to be somewhat verbose compared to
// router.js
export const routerFactory = (base) =>
  createRouter({
    destroyHistoryOnUnmount: true,
    history: createWebHistory(base),
    routes: routes,
});

Wdyt ?

I wasn’t sure if this was a bug so I checked but the history still registers one even listener and remove any router listener.
You should be able to reuse the history instance across multiple router instances
Destroying the history must indeed be done manually and I don’t think it’s a good idea to add one very specific Boolean option to the router to destroy the history

If anyone stumbles accross this post, this is what we went with, as it looked the less invasive in our code :
export const routerFactory = (base) => {
  const history = createWebHistory(base);
  const router = createRouter({
    history: history,
    routes: routes,
  });

  const installRouter = router.install.bind(router);
  router.install = (app) => {
    installRouter(app);

    const unmountApp = app.unmount;
    app.unmount = function () {
      history.destroy();
      unmountApp();
    };
  }

  return router;
}


Test auto-milestone from org member

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

The action ran without errors, but it didn't milestone the PR.... https://github.com/grafana/github-actions-testrepo/actions/runs/9582250253/job/26420818697
12:46PM INF Operating inside grafana/github-actions-testrepo
12:46PM INF Target milestone name: 1.0.x
12:46PM INF Updating PR to 1.0.x
12:46PM INF PR updated
12:46PM INF Metric submission disabled (no API username/key set)


(inference_single_image) RuntimeError: Unable to find a valid cuDNN algorithm to run convolution

Thank you so much for updating "inference_single_image".
But, the following error occurred when using the script.
[02/21 14:08:53 fvcore.common.checkpoint]: [Checkpointer] Loading from weights/maskrcnn_v2/model_final.pth ... Downloading (…)ip_pytorch_model.bin: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3.51G/3.51G [04:00<00:00, 14.6MB/s] Downloading tokenizer_config.json: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 20.6k/20.6k [00:00<00:00, 19.3MB/s] Downloading tokenizer.json: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2.42M/2.42M [00:01<00:00, 2.18MB/s] Downloading (…)cial_tokens_map.json: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2.20k/2.20k [00:00<00:00, 2.71MB/s] Traceback (most recent call last):   File "inference_single_image.py", line 103, in <module>     inference_single_image(model, image_path, text_prompt_list, param_dict)   File "/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/torch/autograd/grad_mode.py", line 28, in decorate_context     return func(*args, **kwargs)   File "/app/altp/models/cooperative-foundational-models/evaluation.py", line 49, in inference_single_image     _ = inference_gdino(model, inputs, text_prompt_list, param_dict)   File "/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/torch/autograd/grad_mode.py", line 28, in decorate_context     return func(*args, **kwargs)   File "/app/altp/models/cooperative-foundational-models/ground_dino_utils.py", line 77, in inference_gdino     outputs = rcnn_model(inputs)   File "/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1102, in _call_impl     return forward_call(*input, **kwargs)   File "/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/detectron2/modeling/meta_arch/rcnn.py", line 146, in forward     return self.inference(batched_inputs)   File "/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/detectron2/modeling/meta_arch/rcnn.py", line 200, in inference     features = self.backbone(images.tensor)   File "/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1102, in _call_impl     return forward_call(*input, **kwargs)   File "/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/detectron2/modeling/backbone/fpn.py", line 126, in forward     bottom_up_features = self.bottom_up(x)   File "/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1102, in _call_impl     return forward_call(*input, **kwargs)   File "/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/detectron2/modeling/backbone/resnet.py", line 445, in forward     x = self.stem(x)   File "/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1102, in _call_impl     return forward_call(*input, **kwargs)   File "/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/detectron2/modeling/backbone/resnet.py", line 356, in forward     x = self.conv1(x)   File "/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1102, in _call_impl     return forward_call(*input, **kwargs)   File "/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/detectron2/layers/wrappers.py", line 106, in forward     x = F.conv2d( RuntimeError: Unable to find a valid cuDNN algorithm to run convolution
and, my environmet info here :
`[02/21 14:08:52 detectron2]: Environment info:

sys.platform            linux
Python                  3.8.15 (default, Nov 24 2022, 15:19:38) [GCC 11.2.0]
numpy                   1.23.5
detectron2              0.6 @/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/detectron2
Compiler                GCC 7.3
CUDA compiler           CUDA 11.3
detectron2 arch flags   /home/user/miniconda/envs/cfm/lib/python3.8/site-packages/detectron2/_C.cpython-38-x86_64-linux-gnu.so; cannot find cuobjdump
DETECTRON2_ENV_MODULE
PyTorch                 1.10.1 @/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/torch
PyTorch debug build     False
GPU available           Yes
GPU 0                   NVIDIA H100 80GB HBM3 (arch=9.0)
Driver version          535.129.03
CUDA_HOME               /usr/local/cuda
Pillow                  8.3.2
torchvision             0.11.2 @/home/user/miniconda/envs/cfm/lib/python3.8/site-packages/torchvision
torchvision arch flags  /home/user/miniconda/envs/cfm/lib/python3.8/site-packages/torchvision/_C.so; cannot find cuobjdump
fvcore                  0.1.5.post20221221
iopath                  0.1.9
cv2                     4.7.0

PyTorch built with:

GCC 7.3
C++ Version: 201402
Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications
Intel(R) MKL-DNN v2.2.3 (Git Hash 7336ca9f055cf1bfa13efb658fe15dc9b41f0740)
OpenMP 201511 (a.k.a. OpenMP 4.5)
LAPACK is enabled (usually provided by MKL)
NNPACK is enabled
CPU capability usage: AVX512
CUDA Runtime 11.3
NVCC architecture flags: -gencode;arch=compute_37,code=sm_37;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_61,code=sm_61;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_80,code=sm_80;-gencode;arch=compute_86,code=sm_86;-gencode;arch=compute_37,code=compute_37
CuDNN 8.2
Magma 2.5.2
Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=11.3, CUDNN_VERSION=8.2.0, CXX_COMPILER=/opt/rh/devtoolset-7/root/usr/bin/c++, CXX_FLAGS= -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-variable -Wno-unused-function -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=1.10.1, USE_CUDA=ON, USE_CUDNN=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON,`

Hello,
It seems to be a problem with the Pytorch/CUDA/CUDNN libraries, and not specifically with the code in this repo AFAIK.
I did search about it, and seems to be quite a common issue. It seems to occur when your GPU memory overflows, but you're using H100 with 80GB GPU, right?
I've tested the code on A100 with 40 GB GPU, and it runs fine in that.
Did you install the environment from the provided environment.yaml and followed other instructions in readme?
Let me know, regarding that. You may also try to manually install pytorch with its cuda version from the pytorch website itself instead from environment.yaml.
Further, you can refer to these links:

https://stackoverflow.com/questions/61467751/unable-to-find-a-valid-cudnn-algorithm-to-run-convolution
https://discuss.pytorch.org/t/unable-to-find-a-valid-cudnn-algorithm-to-run-convolution/78724/25

Please let me know if you are not able to resolve the issue, despite following some of the above recommendation. It may also benefit others if you are able to figure the solution out by yourself, so do post it here once you do! :)

Thank you for reply.
I only followed the instructions in readme you wrote.
I checked the versions of Pytorch, CUDA and cuDNN, as well as the contents of the links you provided me, but I was unable to resolve this error.
I'm still looking for the cause of the problem and how to fix it.

Hello, sorry to hear that.
Could you please try uninstalling Pytorch and trying to install it again manually, maybe using a different version? You can also try to install Detectron2 from the source just to make sure whether it works or not.(https://detectron2.readthedocs.io/en/latest/tutorials/install.html)
I think the cause of this problem could mostly be your CUDA/Pytorch installation. If you can install it again or try running this code on a different machine with at least 40GB VRAM, it can work.

@ralpyna you can also ensure that when you're running the code, the GPU memory is empty. Type "nvidia-smi" and verify that no other process is occupying the GPU.
The error is also thrown sometimes when you get out of memory issues.


Create web client

If we create web client, then cant contact to extension to watch history or quick bookmark feature wont work


feat: support parallel writer

并行写支持
目前集群的写入逻辑放在一个协程里面，改进思路是为每个分片开启一条或多条写入链路
已实现

现有逻辑：每个 cluster_writer 开一个 goroutinue 写入数据

思路一：每个 cluster_writer 开启多个 goroutinue，每个 standalone_writer 一个 goroutinue

思路二：在思路一基础上，每个 standalone_writer 连接多个 redis-client，每个 redis-client 一个 goroutinue

下一步
等待分配服务器资源，对改进进行性能测试

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

close

#787
#833
#750
#799
#783

docs for new parallel architecture https://github.com/tair-opensource/RedisShake/pull/872


Provider consumer proguard along with release aar

The change is pretty small, but all the users of the release aar will benefit from it.

Simple but very helpful, thanks!


No margin-right in last

Hello!
Doesn't work added margin-right:0 in mixin last. Only float: right. Susy 2.2.5.

I'm not sure I understand the question or issue. Can you show me what you input, what you expected, and what you are seeing instead?

Html:

Scss:
.page {
@include container(1280px);
}
.content{
@include span(10 of 16);
...
}
.sidebar{
@include span(6 of 16);
// or @include span(6 of 16 last);
@include last;
}
CSS:
.content {
float: left;
margin: 0.5em 0.625%;
width: 61.25%;
}
.sidebar {
float: right;
margin: 0.5em 0.625%; // right margin not 0 with mixin last, is not true?
width: 36.25%;
}

There's no way that Susy would give the shorthand margin: 0.5em 0.625%; output, so that must be coming from somewhere else? When you use the last() mixin, it should override the right margin, but you will see both in the output. See this demo on sassmeister.
.content {
  width: 62.02532%;
  float: left;
  margin-right: 1.26582%;
}

.sidebar {
  // from span mixin:
  width: 36.70886%;
  float: left;
  margin-right: 1.26582%;
  // from last mixin:
  float: right;
  margin-right: 0;
}

Thank you! This is problem from gutter-position: split.


add functionality to specify spot fields for individual spot requests

this PR

adds functionality to specify spot fields for individual spot requests.
removes deprecated spots request types and radar requests.

hi @qpowell - upon running rspec locally everything was green for these changes. it took the recording of new_episodes to be allowed for VCR and the removal of deprecated requests. these include radar, which google no longer supports and the removal of some of the types from spec, which are not considered part of the "Table 1" filterable types i.e. 'restaurant'. i noticed the build is red for CI. the failures i saw were related to not supporting Hash#dig, part of ruby 2.3.0 release. that release is from some time ago in 25 Dec 2015.
If there are any more steps I can take to assist in getting these changes approved/merged I am here to help so please let me know.

Thanks so much for your pull request - I should have some time to look through it properly tomorrow, and see what's up with specs on Travis then.

@edwinwills - thank you i will check back.

hey @edwinwills - checking in. looks like i have the ok from @qpowell. did you have a chance to look at this yet?

Sorry - I took a look over the weekend, and the code looks fine, but I didn't have a chance to try and get specs working on Travis - will try and pull down this evening and see what's up

Ok - taken a look at the spec failures - it looks like you've introduced dig, but our test suite runs across all 2.x branches of Ruby, and dig was only introduced in Ruby 2.3 - do you mind replacing dig with something that's backwards compatible. For reference, the oldest version of Ruby we test against is 2.1.3. Thanks!

@edwinwills - got it, i will switch out dig for something compatible and have that pushed by tomorrow morning. thank you.

@multiviouskalogram Eagerly waiting for this PR to be merged.

@dhruvenshah looks like it's gone a bit stale - I'll see if I can pick it up this week to get it ready to merge.

Closing as this is now tracked in https://github.com/qpowell/google_places/pull/118


Updating action command instructions in docs

Proposed changes:

Add rasa run actions to the Actions docs

Status (please check what you already did):

[ ] made PR ready for code review
[ ] added some tests for the functionality
[x] updated the documentation
[ ] updated the changelog
[ ] reformat files using black (please check Readme for instructions)

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

@TyDunn a couple things -- first, please sign the CLA. Second, looks like you ran into doc build errors (which are actually probably just warnings but we treat them like errors). You can check these by making the livedocs locally make livedocs and then addressing any warnings in the console


[BUG] Infinite "Attaching" Issue

[Description]
Cannot make a single claim against any workload I try to spin up.  Not once have I been successful at getting Longhorn to do anything.
To Reproduce
Install Docker
Install Rancher
Install Longhorn
Configure Nodes with a /mnt/dataset , hosted over NFS on a TrueNAS Server.

Log
If applicable, add the Longhorn managers' log when the issue happens.
You can also attach a Support Bundle here. You can generate a Support Bundle using the link at the footer of the Longhorn UI.
Environment:

Longhorn version: 1.1.1
Installation method (e.g. Rancher Catalog App/Helm/Kubectl):  Rancher
Kubernetes distro (e.g. RKE/K3s/EKS/OpenShift) and version: 1.20.6

Number of management node in the cluster: 5
Number of worker node in the cluster: 5

Node config

OS type and version: Ubuntu 20.04
CPU per node: 4
Memory per node:  4GB
Disk type(e.g. SSD/NVMe):  SSD for OS (HDD over NFS for /mnt/dataset points)
Network bandwidth between the nodes: 1GB

Underlying Infrastructure (e.g. on AWS/GCE, EKS/GKE, VMWare/KVM, Baremetal):  Proxmox / Truenas
Number of Longhorn volumes in the cluster: 0

Additional context
Add any other context about the problem here.

From the log, it seems like the cluster is a mix of Windows and Linux nodes.  Please follow the guide Rancher Windows Cluster to taint the nodes.
For Ubuntu nodes, please also check if Installation Requirements is fulfilled.  From node, I do not see any message go-iscsi-helper: tgtd is already running.  I suspect that ISCSI is not installed.

hi! Are you able to resolve the issue?  Perhaps provides us with some updates?

Please check your environment meets the installation requirements.
Since this issue is out of activity, I'll close the issue.
Feel free to reopen it if you have further questions.


Bump alpine installer

Followup to #4340. That one added the necessary packages for installer to work again. This bumps all of the packages excepts those in the Makefile exception list, and removes installer from the exception list.

See #4350 to address it. Once that is in, I will update this one on that basis.

@deitch, the build still fails..

I see
2024-10-14T15:01:43.3381354Z #16 [build  1/56] RUN eve-alpine-deploy.sh
2024-10-14T15:01:43.3382061Z #16 1.857   so:libprocps.so.8 (no such package):
2024-10-14T15:01:43.3383930Z #16 1.857 ERROR: unable to select packages:
2024-10-14T15:01:43.3387044Z #16 1.859     required by: procps-3.3.17-r2[so:libprocps.so.8]
2024-10-14T15:01:43.4390104Z #16 ...

in https://github.com/lf-edge/eve/actions/runs/11329895986/job/31506459644?pr=4348
Another package is missing?

Grrr. I did try this manually. Frustrating. I will figure this out.

This was debug. I am rebuilding all affected packages to check.

I will. Need to change some things for it. A few minutes.

Rebased and changed to the correct hashes. Let's let the regular tests run, and if they all pass, eden can be next.

2.5 hours, and it only is as far as pkg/u-boot, 7 out of the 17 packages it needs to build. This is going to be a while.

Excellent! All regular tests pass. Can we get another approval to restart eden tests?

Thanks @christoph-zededa ; eden tests running.

Here is the failure:
[stdout]
Log/Info/Metric Test
=== RUN   TestInfo
    lim_test.go:273: time: 2024-10-15T16:38:05.548618515Z out: Wait for info of 3aeec7e0-763d-44c0-b92c-fe4899dd1424 number=1 timewait=3m0s

    testContext.go:302: WaitForProc terminated by timeout 3m0s
    testContext.go:285: WaitForProcWithErrorCallback terminated by timeout 3m0s
--- FAIL: TestInfo (180.00s)
FAIL
FAIL: ../volume/testdata/volumes_test.txt:40: command failure

Yet another timeout... Let's wait until finished and check the logs quickly. But I guess the failure has nothing with the PR.

FAIL: ../volume/testdata/volumes_test.txt:40: command failure

This is a known failure in the ZFS test suite. It is some race in EVE that needs to be investigated. There is even a Jira on offer ;)

This is a known failure in the ZFS test suite. It is some race in EVE that needs to be investigated. There is even a Jira on offer ;)

So should I ignore it and just merge?

This is a known failure in the ZFS test suite. It is some race in EVE that needs to be investigated. There is even a Jira on offer ;)

So should I ignore it and just merge?

I would say yes.

🥳
Thanks @OhmSpectator !


update packages

please update these packages. there are Regular Expression Denial of Service vulnerabilities https://nodesecurity.io/advisories/118

@yaniswang would you like some help on this?

This is a serious concern for me and probably the rest of the developer community that want to use htmlhint.
@yaniswang Any chance you could approve and merge this, and update the package on npm?
Thanks!

Hey @ErikHellman, all packages will be soon updated and security checks will be done automatically and regularly.

Solved by #251.


Countmatrix and sample metadata table not uploading properly

Hi there
I am trying to upload my own countmatrix and sample metadata table using the interactive version of the tool, but it doesn't seem to be reading my input tables correctly. I made my tables in excel and modeled it according to the "airway" demo data. I saved the excel file as csv file but it just doesn't seem to want to work. I urgently need to plot this data, any help would be greatly appreciated. I can send you my countmatrix and sample metadata table on request.
Many thanks
J

Hi @Justin1609,
did you try to see if the files are in the csv format - despite of the extension, sometimes Excel might not really be comma-delimited. You can do so by opening these files in any text editor.
If that works: try to read them in offline (before calling the app), and call the app by specifying the count matrix and the metadata table in the respective parameters.
HTH,
Federico

Hi there Federico
Thanks so much, I managed to get it sorted out. I didn't realize that you
don't have to transpose the count matrix before inputting it. Why is it
that you don't transpose the data in your tool? By transpose I mean having
samples as objects and genes as variables. I am doing PCA on counts data
from RNA seq analysis for Saccharomyces cerevisiae. Would the output look
different if the count matrix was transposed as I described? I am also
having issues with the gene annotation file for S. cerevisiae as there is
no entry for this on the normal databases that are used in the examples for
using pcaExplorer. Do you maybe know of another database I can use for the
annotations of S. cerevisiae? I have a CSV file where I have the Gene IDs
of S.cerevisiae in column 1 and then the Standard gene names for each Gene
ID in the second column. If you could help out with these issues I would
really appreciate it.
Kind regards
Justin
On Wed, Nov 24, 2021 at 1:47 AM Federico Marini @.***>
wrote:

Hi @Justin1609 https://github.com/Justin1609,
did you try to see if the files are in the csv format - despite of the
extension, sometimes Excel might not really be comma-delimited. You can do
so by opening these files in any text editor.
If that works: try to read them in offline (before calling the app), and
call the app by specifying the count matrix and the metadata table in the
respective parameters.
HTH,
Federico
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/federicomarini/pcaExplorer/issues/16#issuecomment-977291115,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AOVIGQVZGYTPWTZE4KOFD53UNQRZ5ANCNFSM5IN52KLQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

Hi Federico
Could you also please tell me how I can edit the title and the legend name
of the plot? And I would like to remove the sample labels from the plot and
change the color scheme of the different sample groups? I tried to do this
in R but pcaplot doesn't generate the correct object that ggplot requires
to be able to edit these details.
Kind regards
Justin
On Wed, Nov 24, 2021 at 1:47 AM Federico Marini @.***>
wrote:

Hi @Justin1609 https://github.com/Justin1609,
did you try to see if the files are in the csv format - despite of the
extension, sometimes Excel might not really be comma-delimited. You can do
so by opening these files in any text editor.
If that works: try to read them in offline (before calling the app), and
call the app by specifying the count matrix and the metadata table in the
respective parameters.
HTH,
Federico
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/federicomarini/pcaExplorer/issues/16#issuecomment-977291115,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AOVIGQVZGYTPWTZE4KOFD53UNQRZ5ANCNFSM5IN52KLQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

Hi there Federico Thanks so much, I managed to get it sorted out. I didn't realize that you don't have to transpose the count matrix before inputting it. Why is it that you don't transpose the data in your tool? By transpose I mean having samples as objects and genes as variables.

Well, the reason is more like "historical" - in Bioinformatics, it is more common to see genes as features on the rows and samples on the columns. So I sticked to the "classical" version.
Yes, an even more classical biostatistics-tailored view would be indeed the transposed one.
But hey... 🤷

I am doing PCA on counts data from RNA seq analysis for Saccharomyces cerevisiae. Would the output look different if the count matrix was transposed as I described?

Sure - stick to the expected format, and it will be fine.

I am also having issues with the gene annotation file for S. cerevisiae as there is no entry for this on the normal databases that are used in the examples for using pcaExplorer. Do you maybe know of another database I can use for the annotations of S. cerevisiae? I have a CSV file where I have the Gene IDs of S.cerevisiae in column 1 and then the Standard gene names for each Gene ID in the second column. If you could help out with these issues I would really appreciate it. Kind regards Justin

Not so much experience on yeast TBH - some annotation packages are available in Bioconductor, have a look at org.Sc.sgd.db
Federico

Hi Federico Could you also please tell me how I can edit the title and the legend name of the plot? And I would like to remove the sample labels from the plot and change the color scheme of the different sample groups? I tried to do this in R but pcaplot doesn't generate the correct object that ggplot requires to be able to edit these details. Kind regards Justin

I guess for these types of request, probably you are best served by building the ggplot object from the scratch.
Actually, the object returned by pcaplot are ggplot objects, so the customization should actually work.
If you are a little familiar with code, feel free to use the source and adapt it to your needs.
HTH,
Federico

Thanks very much @federicomarini/pcaExplorer
@.***> I
really appreciate it. I did have a chat with a co-supervisor of mine who is
a Biostatistician, but why would he have suggested that I transpose the
count matrix data? Apologies, I am very new to realm of Bioinformatics so I
would just like to understand how it would affect the PCA output, if at
all? For example, would the sample view in your program look different if
the data were transposed? Why would it need to be transposed? Is there any
difference between transposing the data versus the format that you use?
Thanks I will definitely check the database out in R.
Regarding editing the plot I receive an error when trying to insert pcaplot
object as the required "pcobj" for ggplot. I am not too familiar with the
coding side either, could you maybe direct me to resources for how to go
about altering the code, like that which is available on the user guide for
pcaplot, where I could for example change the colours of the circles and
edit the legend name and the title? This would be extremely helpful.
Finally, I realise this is not the intended purpose of the program but I
was wondering if you could perhaps give me some advice on how to perform an
OPLS analysis, perhaps something that is as user friendly as your program
and uses a similar input and method? I have tried the ropls package in R,
but I honestly cannot seem to figure it out too well. If you have any
advice I would truly appreciate it.
Kind regards
Justin
On Wed, Nov 24, 2021 at 3:08 PM Federico Marini @.***>
wrote:

Hi there Federico Thanks so much, I managed to get it sorted out. I didn't
realize that you don't have to transpose the count matrix before inputting
it. Why is it that you don't transpose the data in your tool? By transpose
I mean having samples as objects and genes as variables.
Well, the reason is more like "historical" - in Bioinformatics, it is more
common to see genes as features on the rows and samples on the columns. So
I sticked to the "classical" version.
Yes, an even more classical biostatistics-tailored view would be indeed
the transposed one.
But hey... 🤷
I am doing PCA on counts data from RNA seq analysis for Saccharomyces
cerevisiae. Would the output look different if the count matrix was
transposed as I described?
Sure - stick to the expected format, and it will be fine.
I am also having issues with the gene annotation file for S. cerevisiae as
there is no entry for this on the normal databases that are used in the
examples for using pcaExplorer. Do you maybe know of another database I can
use for the annotations of S. cerevisiae? I have a CSV file where I have
the Gene IDs of S.cerevisiae in column 1 and then the Standard gene names
for each Gene ID in the second column. If you could help out with these
issues I would really appreciate it. Kind regards Justin
Not so much experience on yeast TBH - some annotation packages are
available in Bioconductor, have a look at org.Sc.sgd.db
https://bioconductor.org/packages/release/data/annotation/html/org.Sc.sgd.db.html
Federico
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/federicomarini/pcaExplorer/issues/16#issuecomment-977861689,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AOVIGQWUPZTYWJSIVSMCVBLUNTPTTANCNFSM5IN52KLQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

No problem, I am aware we in bioinformatics are doing things by default in a transposed way 😉
If you transpose it: well, in the end you do change the point of view on it: so, no more samples as linear combinations of the genes but the other way around!
For editing the ggplot object: I would say some generic resource like a tutorial on ggplot would do it, I have at the moment none I can recommend, do check out https://datavizm20.classes.andrewheiss.com/, I used to recommend it for many other reasons!
If you want to do an OPLS analysis, this is out of pcaExplorer's business, "per se", but very much in the whole dimensionality reduction business. Do have a look at Holmes & Huber MSMB book, available online. IIRC it had a couple of these alternatives to PCA introduced.
Federico


split generated yaml file inside the k8s folder into vsecm and spire yaml files — reasoning: SPIRE might already be installed, and the user might want to only touch the VSecM part

At least we are going to do something similar in Telco RICs.

On a second thought, it’s not that high prio,
For one reason, at telco we started pointing to vsecm upstream helm charts instead of adopting our own:
it’s much less effort that way, so we don’t need a separate SPIRE chart.
Also, it’s relatively easy to write some code to parse the single file and create multiple files;
so we can publish a helper script that does just that and call it a day maybe.
It can even be a make target.

Closing this. We can write a separate off-cycle helper for this.


Refreshing state with redshiftdata.Statement fails after query result expires

What happened?
After a certain amount of time (3 days, it looks like), when Pulumi tries to refresh the state that includes a Redshift Data Statement, it fails.
Diagnostics:
  aws:redshiftdata:Statement (supplementalEppEncountersView):
    error: Preview failed: refreshing urn:pulumi:pdfs.qa::pdfs::aws:redshiftdata/statement:Statement::supplementalEppEncountersView: 1 error occurred:
    	* reading Redshift Data Statement (284bfee4-49dc-4ad1-ac90-0bba0580d568): ValidationException: Could not retrieve the query result as it has expired after<PHONE_NUMBER>.

  pulumi:pulumi:Stack (pdfs-pdfs.qa):
    error: preview failed

Steps to reproduce

Add a Redshift Data Statement:

const example = new aws.redshiftdata.Statement("example", {
    clusterIdentifier: aws_redshift_cluster.example.cluster_identifier,
    database: aws_redshift_cluster.example.database_name,
    dbUser: aws_redshift_cluster.example.master_username,
    sql: "CREATE GROUP group_name;",
});

Refresh and update your stack:

pulumi up -ry

Wait 3 days (or possibly manually change the id in your Pulumi state, but I'm not sure if that will work).

Refresh (or refresh and update):

pulumi up -ry

It will fail with the above mentioned error when refreshing the state.
Expected Behavior
The state refreshes, and does not fail.
Actual Behavior
It fails while refreshing the state:
Diagnostics:
  aws:redshiftdata:Statement (supplementalEppEncountersView):
    error: Preview failed: refreshing urn:pulumi:pdfs.qa::pdfs::aws:redshiftdata/statement:Statement::supplementalEppEncountersView: 1 error occurred:
    	* reading Redshift Data Statement (284bfee4-49dc-4ad1-ac90-0bba0580d568): ValidationException: Could not retrieve the query result as it has expired after<PHONE_NUMBER>.

  pulumi:pulumi:Stack (pdfs-pdfs.qa):
    error: preview failed

Versions used
CLI
Version      3.36.0
Go Version   go1.18.4
Go Compiler  gc
Host
OS       darwin
Version  13.0
Arch     arm64
Additional context
No response
Contributing
Vote on this issue by adding a 👍 reaction.
To contribute a fix for this issue, leave a comment (and link to your pull request, if you've opened one already).

Thanks for opening the issue and also validating this occurs in the terraform provider as well @nickroberts! We will track https://github.com/hashicorp/terraform-provider-aws/issues/25882 and update to pull in the fix.
Side note but I am not sure what the provider can do in this situation since the query has expired. The best that can be done is to recreate the resource? The provider itself can't interpret the expiration as the statement being deleted since the statement would then be leaked. Perhaps you are better off modeling the statement with the aws client in your chosen language instead (within or separate from the pulumi code).

Yea...we were trying to use it as a quick and dirty way to create a view in Redshift. Looks like we are going to have to figure out a different way (which we need to, anyways, for more robust db migration scripts). Going to use boto3 and python to quickly handle this, in the meantime! Thanks!

The upstream issue has been fixed, the fix is available in 6.x version of Pulumi.Aws. I'll go ahead and close the issue as resolved.


[Feature Request] Add Search Option

I was recently doing some work on the TODO Group website and realized that the site does not have a search function, which is not conducive to retrieving information. Would it be possible to add a search option to this hugo theme, there are some recommendations in the hugo documentation?
recommended
Open source

pagefind
hugo-lyra

Commercial

algolia

Yes good feedback, I'm not sure how the original design missed adding a search. We will look to add retrospectively.

I've done some experimenting recently with Pagefind on the Kubernetes site and am impressed with it. Here's the PR for Kubernetes.

Here's the PR for this theme. Please test it out the preview instance: https://deploy-preview-37--dot-org-hugo-theme-demo-jh.netlify.app/

This is done.


Update tools-deps variants & add a feature for filtering variants in CLI commands

I added the variant filtering so when I'm doing PRs like this I can run e.g. this:
bb run build-images :build-tool tools-deps and only build those images rather than waiting on / visually filtering out the lein and boot variants.

@Quantisan I'm going to go ahead and merge this to get the clojure tools.deps version bump, but let me know if you have any feedback on the other things in here. Thanks!


GROUPING SETS syntax incorrect?

I first noticed this problem when trying to make CVs with GROUPING SETS according to the syntax I saw in the Postgres docs, https://www.postgresql.org/docs/current/queries-table-expressions.html like:
GROUP BY a, CUBE (b, c), GROUPING SETS ((d), (e))
Following along, I put parentheses around the groupings, as above. I got this error with all my queries involving GROUPING SETS:
ERROR: column "_0" has pseudo-type record
Looking at the PipelineDB tests:
https://github.com/pipelinedb/pipelinedb/blob/526a6f4c9a1cc4a054d4efb53cf5c92180979303/src/test/regress/sql/cont_grouping_sets.sql
GROUP BY GROUPING SETS (x), (x, y), (x, y, z), (x, z);
It looks like the outer parentheses are being omitted here. I inserted data into my CV and it definitely isn't working as expected. I'm guessing these are being parsed as records as in https://www.postgresql.org/docs/current/rowtypes.html ?

how can fix this bug?


[All Hosts] (COM/VSTO) correcting title to match article

Docs Build status updates of commit 43ec21b:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/toc.yml
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


two tikv crash repeatly after run some stress workload

Bug Report

What version of TiKV are you using?
/ # ./tikv-server -V
TiKV
Release Version:   5.3.0-alpha
Edition:           Community
Git Commit Hash:   e6081e301433da2679025e2f943de89f1331bf94
Git Commit Branch: heads/refs/tags/v5.3.0
UTC Build Time:    2021-11-15 13:01:10
Rust Version:      rustc 1.56.0-nightly (2faabf579 2021-07-27)
Enable Features:   jemalloc mem-profiling portable sse protobuf-codec test-engines-rocksdb cloud-aws cloud-gcp
Profile:           dist_release
What operating system and CPU are you using?
8core 16G memory
Steps to reproduce
TiKV_Workload_stress_001
TiKV_Workload_stress_002
TiKV_Workload_stress_003
TiKV_Workload_stress_004
What did you expect?
all pod is normal
What did happened?
two tikv crash repeatly
[2021/11/17 03:00:50.975 +00:00] [FATAL] [lib.rs:465] ["[region 42511] 42513 commit state jump backward (3198, 6) -> (2636, 6)"] [backtrace="   0: tikv_util::set_panic_hook::{{closure}}\n             at home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tikv/components/tikv_util/src/lib.rs:464:18\n   1: std::panicking::rust_panic_with_hook\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/std/src/panicking.rs:626:17\n   2: std::panicking::begin_panic_handler::{{closure}}\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/std/src/panicking.rs:519:13\n   3: std::sys_common::backtrace::__rust_end_short_backtrace\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/std/src/sys_common/backtrace.rs:141:18\n   4: rust_begin_unwind\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/std/src/panicking.rs:515:5\n   5: std::panicking::begin_panic_fmt\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/std/src/panicking.rs:457:5\n   6: raftstore::store::fsm::apply::ApplyFsm::handle_apply\n             at home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tikv/components/raftstore/src/store/fsm/apply.rs:3263:17\n   7: raftstore::store::fsm::apply::ApplyFsm::handle_tasks\n             at home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tikv/components/raftstore/src/store/fsm/apply.rs:3571:25\n   8: <raftstore::store::fsm::apply::ApplyPoller<EK,W> as batch_system::batch::PollHandler<raftstore::store::fsm::apply::ApplyFsm,raftstore::store::fsm::apply::ControlFsm>>::handle_normal\n             at home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tikv/components/raftstore/src/store/fsm/apply.rs:3818:9\n   9: batch_system::batch::Poller<N,C,Handler>::poll\n             at home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tikv/components/batch-system/src/batch.rs:328:27\n      batch_system::batch::BatchSystem<N,C>::start_poller::{{closure}}\n             at home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tikv/components/batch-system/src/batch.rs:442:17\n      std::sys_common::backtrace::__rust_begin_short_backtrace\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/std/src/sys_common/backtrace.rs:125:18\n  10: std::thread::Builder::spawn_unchecked::{{closure}}::{{closure}}\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/std/src/thread/mod.rs:476:17\n      <std::panic::AssertUnwindSafe as core::ops::function::FnOnce<()>>::call_once\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/std/src/panic.rs:347:9\n      std::panicking::try::do_call\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/std/src/panicking.rs:401:40\n      std::panicking::try\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/std/src/panicking.rs:365:19\n      std::panic::catch_unwind\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/std/src/panic.rs:434:14\n      std::thread::Builder::spawn_unchecked::{{closure}}\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/std/src/thread/mod.rs:475:30\n      core::ops::function::FnOnce::call_once{{vtable.shim}}\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/core/src/ops/function.rs:227:5\n  11: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce>::call_once\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/alloc/src/boxed.rs:1572:9\n      <alloc::boxed::Box<F,A> as core::ops::function::FnOnce>::call_once\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/alloc/src/boxed.rs:1572:9\n      std::sys::unix::thread::Thread::new::thread_start\n             at rustc/2faabf579323f5252329264cc53ba9ff803429a3/library/std/src/sys/unix/thread.rs:91:17\n  12: \n  13: clone\n"] [location=/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tikv/components/raftstore/src/store/fsm/apply.rs:3263] [thread_name=apply-0]

/type bug

/severity Critical

/assign gengliqi

/found automation

refresh


[feat] constant single-quota support

when I want to use a constant which annotated by single-quota I get ''.

好


How do i handle a label which groups together UNCATEGORISED or OTHERS records?

We have 10 labels of which categorises the  text records.
Some records dont fall into the 10 categories. We just label them as "OTHERS".
If i am using snorkel to automatically label the 11 labels for the input text records, should i be creating a labelling function for "OTHERS"? I have regular expressions for each of the 10 labels. So i  can  indeed write a labelling function for "OTHERS" which negates the regular expressions of the rest of the 10 labels.  But this seems to go against the idea of snorkel's ABSTAIN.
So i am wondering what is the best way to handle "OTHERS" label? appreciate any inputs?

A similar question related to the OTHER class is discussed here. Feel free to reopen if you have other questions!


Rename "docket number" to case number

Fix #564. Docket number, as far as we can tell with the dozen or so states we've interacted with, is a pretty Massachusetts-specific term. The more general term is "case number". This changes the phrasing of "Docket number" to be "case number" so that people in other states can get better interviews out of the box.
See https://github.com/SuffolkLITLab/docassemble-ALMassachusetts/issues/7 which will move the docket number phrasing to ALMassachusetts, where it is the less confusing term

+1 to changing the wording of the question, not as sure about adding an additional case_numbers variable though. Some questions that would ease my mind there:
* are there any cases where we have forms interacting across jurisdictions, where one set of forms would use docket number and the other would use case number? Splitting the same information into two separate variables would make things difficult there

* the EFileProxy will need to change to using `case_number` in addition to docket number. It seems rare enough that both would be set at the same time, so I'm inclined to just return an error on interviews where that's the case. Does that sound like the right solution?

Didn't realize the e-filing stuff depended on docket_number, so I don't have a problem removing the case_number variable and just making it a AssemblyLine ism.


Data update

would you please update "annotated_user_da_with_span_full.json"  to MultiWOZ2.1?  We all appreciate that.

MultiWOZ 2.1 has already used the user dialog act we provided.

then could you please offer a python script so that we can get a "annotated_user_da_with_span_full.json.zip" from MultiWOZ 2.1?
------------------ 原始邮件 ------------------
发件人:                                                                                "ConvLab/ConvLab"                                                                                @.>;
发送时间: 2021年10月14日(星期四) 晚上6:48
@.>;
<EMAIL_ADDRESS>主题: Re: [ConvLab/ConvLab] Data update (#135)
MultiWOZ 2.1 has already used the user dialog act we provided.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.
Triage notifications on the go with GitHub Mobile for iOS or Android.


Fix: touchGuard now, no longer blocks fab buttons

used bringToFront method to bring the buttons in front of the touchGuard, because the guard was blocking input #37

Thanks for your contribution. Can you add the following as per the doc pls?

Prior to KITKAT this method should be followed by calls to requestLayout() and invalidate() on the view's parent to force the parent to redraw with the new child ordering.

@yavski sure, here it is: #46


Patch 1 (copy update)

Updated copy, cleaned up to make it easier to read/grammatical consistency.

Thanks!

Thanks for doing this!


Add 'table of contents' to index file

An entry at the end of the index file documenting where the main sections start (and end) would help making analysis easier. For example, all postings lists of the inverted indices are currently stored uncompressed, which unexpectedly has very little size overhead.
Having better understanding what is how expensive size-wise, makes prioritising improvements easier.
Currently all references/offsets to entries in index or chunk files are stored as absolute positions of those files. One consideration was making them relative to start of their respective section. This needs said TOC in the index file as a prerequisite.

Do you have any ideas on how the TOC should look? Or should I take a rough stab at this?

@fabxc Can this be closed now?

Indeed.


Update exposed-apis-odata-samples.md

Added an example of Get devices with computerDnsName starting with

Hello, @SujudAbuAtta Thank you for the contribution. The CLA needs to be signed before continuing with the review of this PR.

Hello, @SujudAbuAtta Thank you for the contribution. The CLA needs to be signed before continuing with the review of this PR.


How to create images for new text?

Hi, I am using the pretrained COCO model, which is shared in this repo. How can I use it over some other sentences as input? Since the mode will not be train, it will use val_captions.t7. However, I am not clear on how to convert a text file to t7 file. Could you please elaborate on this?
Thanks

I have the same problem, anyone has any advice?

@314rated  @Wentong-DST have you solved the problem, cuz I'm trying to solve it too

You can load val_captions.t7 with torchfile.load(val_captions.t7).
It's a torchfile.hashable_unique_dict with two keys: raw_txt (a list texts) and fea_txt (a list of embeddings each of size 1024).
If you already have your custom embeddings you just have to follow that structure. I wanted to use python and not lua so torchfile.hashable_unique_dict was not appropriate. I used a regular dict instead and changed trainer.py at line 243 as:

t_file = torchfile.load(datapath)
<<t_file = torch.load(datapath)
captions_list = t_file.raw_txt
<<captions_list = t_file['raw_txt']
embeddings = np.concatenate(t_file.fea_txt, axis=0)
<<embeddings = np.concatenate(t_file['fea_txt'], axis=0)

This worked, but I would still be curious on how to generate the char-CNN-RNN text embeddings.

You can load val_captions.t7 with torchfile.load(val_captions.t7).
It's a torchfile.hashable_unique_dict with two keys: raw_txt (a list texts) and fea_txt (a list of embeddings each of size 1024).
If you already have your custom embeddings you just have to follow that structure. I wanted to use python and not lua so torchfile.hashable_unique_dict was not appropriate. I used a regular dict instead and changed trainer.py at line 243 as:

t_file = torchfile.load(datapath)
<<t_file = torch.load(datapath)
captions_list = t_file.raw_txt
<<captions_list = t_file['raw_txt']
embeddings = np.concatenate(t_file.fea_txt, axis=0)
<<embeddings = np.concatenate(t_file['fea_txt'], axis=0)

This worked, but I would still be curious on how to generate the char-CNN-RNN text embeddings.

Is there any way to select only a few of the captions and embeddings from the val_captions.t7?

You can load val_captions.t7 with torchfile.load(val_captions.t7).
It's a torchfile.hashable_unique_dict with two keys: raw_txt (a list texts) and fea_txt (a list of embeddings each of size 1024).
If you already have your custom embeddings you just have to follow that structure. I wanted to use python and not lua so torchfile.hashable_unique_dict was not appropriate. I used a regular dict instead and changed trainer.py at line 243 as:

t_file = torchfile.load(datapath)
<<t_file = torch.load(datapath)
captions_list = t_file.raw_txt
<<captions_list = t_file['raw_txt']
embeddings = np.concatenate(t_file.fea_txt, axis=0)
<<embeddings = np.concatenate(t_file['fea_txt'], axis=0)

This worked, but I would still be curious on how to generate the char-CNN-RNN text embeddings.

do you have a val_captions.t7 file，Icannot find this file and do not know the contents of this file...So i cannot eval  my training result.Thank you!


Update compatibility doc for -0.0 issues

This fixes #295
Not sure if we want to cherry-pick this to github-pages or not.

build

build


uses npm instead of yarn

update github actions
adds package-lock
removes yarn.lock

we gonna yarn for now might revisit this guy


feat: make security admin as dashboard admin

Description

Issues Resolved

Screenshot

Testing the changes

Check List

[ ] All tests pass

[ ] yarn test:jest
[ ] yarn test:jest_integration
[ ] yarn test:ftr

[ ] New functionality includes testing.
[ ] New functionality has been documented.
[ ] Update CHANGELOG.md
[x] Commits are signed per the DCO using --signoff

Codecov Report

Merging #114 (14ad2a2) into workspace (acaf609) will decrease coverage by 15.42%.
The diff coverage is 0.00%.

@@              Coverage Diff               @@
##           workspace     #114       +/-   ##
==============================================
- Coverage      65.77%   50.35%   -15.42%
==============================================
  Files           3336     2519      -817
  Lines          64492    48986    -15506
  Branches       10264     7514     -2750
==============================================
- Hits           42420    24669    -17751
- Misses         19496    23096     +3600
+ Partials        2576     1221     -1355

Flag
Coverage Δ

Linux_1
?

Linux_3
?

Windows_1
34.77% <ø> (ø)

Windows_2
54.74% <0.00%> (-0.01%)
:arrow_down:

Windows_3
?

Windows_4
?

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed
Coverage Δ

...er/saved_objects/permission_control/client.mock.ts
100.00% <ø> (ø)

.../server/saved_objects/permission_control/client.ts
2.63% <0.00%> (-0.08%)
:arrow_down:

... and 1424 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Fix windows connection issue with newinstance0 present in logs

Several users have reported a newinstance0  connection issue under Windows. See #98 #229 #277 #295 #354 #397 #409 #456 #466 #497 #633 #679.
I was able to repro this first time sparklyr is used in a new environment or by removing HADOOP_HOME and relaunching the RStudio.
This issue was being caused by using SETX to set the HADOOP_HOME. While this would work the next time the rsession launches (and the same session in some other environments); some other environments and packages, say plumber, Conda, etc. might not respect the SETX setting across rsession and trigger this error consistently.
The fix is to set HADOOP_HOME during spark-submit being specified through withr::with_envvar.
There is some risk of regressing scenarios where SETX was actually working appropriately. However, given that this has affected multiple Windows users, I think would be best to simplify this and perform an additional change to bring back SETX if we find environments where the new approach does not work correctly.
For those users affected by this error, please retry with sparklyr 0.5.6-9002 or newer. You can install using devtools::install_github("rstudio/sparklyr").

Hello,
I still got the same error using sparklyr (version: <IP_ADDRESS>01).
I installed using devtools::install_github("rstudio/sparklyr")
Appreciated if any suggestion
> sc <- spark_connect(master  = "spark://192.xxx.x.xx:8080", version = '2.1')
Error in file(con, "r") : cannot open the connection
In addition: Warning message:
In file(con, "r") :
  cannot open file 'C:\Users\xxxxx\AppData\Local\Temp\Rtmp4Q07Wi\file3c5c3a15674c_spark.log': Permission denied


Update WASI to 0.12.0

Replaces std.os functions that were moved to std.posix

Thanks @mgord9518!


INTLY-948 feat: add ability to specify custom path to walkthroughs in git url

Motivation
See #392. Essentially some existing content being ported is in a particular format and can often contain multiple "tracks" of work in a single repo. To avoid splitting these repos up we should support a walkthroughs directory override.
What
Added a parsing step for Git URLs passed via WALKTHROUGH_LOCATIONS environment variable. This will extract querystring params from the Git URL.
Why
See motivation.
How
By allowing users to override the default walkthroughs/ path.
Verification Steps

Using this branch start the application like so:

WALKTHROUGH_LOCATIONS="https://github.com/RedHatWorkshops/dayinthelife-integration?walkthroughsFolder=docs/labs/citizen-integrator-track&walkthroughsFolder=docs/labs/developer-track/#V2,/Users/eshortis/workspaces/work/integreatly/tutorial-web-app-walkthroughs/walkthroughs" yarn start:dev

The walkthroughs from docs/labs/citizen-integrator-track/ for the repo https://github.com/RedHatWorkshops/dayinthelife-integration#V2 should load in the UI despite not being in the typical walkthroughs/ folder. The same should occur for docs/labs/developer-track/ from the same repo. Also, note the URL when you load these walkthroughs - it contains the parent folder name, and the specific lab name to prevent conflicts since both contain labNN naming conventions.

Checklist:

[x] Code has been tested locally by PR requester
[x] Changes have been successfully verified by another team member

Progress

[x] Finished task

@evanshortiss I'm getting TypeError: window.OPENSHIFT_CONFIG is undefined when using the provided command. But it seems to work when i just run yarn start:dev. Looking into that.

@pb82 I get that at first too. I think it's because it takes a while to clone? If you wait and refresh it seems to resolve once the cloning of repos completes.

Verified locally. I'll give it a try on a cluster and then approve.

UXD is ok to have this merged. Thanks for the heads up about the changes, so we can keep this in mind as we work on groupings and the walkthroughs order for the dashboard.
@mfrances17 FYI

@finp @tiffanynolan @pb82 are we able to merge this for now while work on the new proposal happens?

@evanshortiss That works for me, whether this method is officially documented is still an open question, but I'm not blocking the code change.


[bug] No method named iter found in src/manager.rs

Describe the bug
Build fails due to error[E0599] on windows
error[E0599]: no method named `iter` found for struct `Arc<(dyn Assets + 'static)>` in the current scope
   --> C:\Users\naffy\.cargo\registry\src\index.crates.io-6f17d22bba15001f\tauri-1.5.3\src\manager.rs:640:23
    |
640 |     self.inner.assets.iter()
    |                       ^^^^ method not found in `Arc<dyn Assets>`

For more information about this error, try `rustc --explain E0599`.
error: could not compile `tauri` (lib) due to previous error
warning: build failed, waiting for other jobs to finish...
       Error failed to build app: failed to build app
ELIFECYCLE  Command failed with exit code 1.

Reproduction

Update existing tauri project to version 1.5.3
Run build script with pnpm: tauri build
Build fails

Expected behavior
Build should run successfully.
Platform and versions
[✔] Environment
    - OS: Windows 10.0.20348 X64
    ✔ WebView2: 105.0.1343.27
    ✔ MSVC: Visual Studio Enterprise 2022
    ✔ rustc: 1.74.0 (79e9716c9 2023-11-13)
    ✔ cargo: 1.74.0 (ecb9851af 2023-10-18)
    ✔ rustup: 1.26.0 (5af9b9484 2023-04-05)
    ✔ Rust toolchain: stable-x86_64-pc-windows-msvc (default)
    - node: 18.18.2
    - pnpm: 8.11.0
    - yarn: 1.22.21
    - npm: 9.8.1

[-] Packages
    - tauri [RUST]: 1.5.2
    - tauri-build [RUST]: 1.5.0
    - wry [RUST]: 0.24.4
    - tao [RUST]: 0.16.5
    - @tauri-apps/api [NPM]: 1.5.1
    - @tauri-apps/cli [NPM]: 1.5.6

[-] App
    - build-type: bundle
    - CSP: unset
    - distDir: ../dist
    - devPath: http://localhost:5173/
    - framework: React
    - bundler: Vite

Stack trace
No response
Additional context
Reverting the version back to 1.5.2 fixes the problem

Run cargo update inside src-tauti

Try running cargo update inside src-tauri*

It works. Thank you!
May I know the reason it was acting that way?

with the newly released version it depended on a new version of tauri-utils but for some reason your tauri version was updated but not tauri-utils

Okay, thanks.

Hi @amrbashir
I'm having the same issue with depandabot. Due to tauri 1.5.3 relying on Assets::iter b3e53e72(#8288) introduced in tauri-utils 1.5.1, Should tauri-utils dependency declared in core-tauri be bumped to 1.5.1? That will be translated  as >=1.5.1 according to cargo-book


Host Fastchat server instance in kubernetes

We can run fastchat in server mode which provides the capability to distrubute llm api call to different llm models.As we host arcadia in kubernetes, it would be much better to run fastchat's apiserver,controller,worker in kubernetes.

apiserver: cpu
controller: cpu
worker : cpu/gpu

[ ] Host fastchat api controller  as built-in charts in arcadia
[ ] Develop a helm chart for model worker


feat: 🎸 identities rotatePrimaryKey/attestPrimaryKeyRotation

JIRA Link
https://polymesh.atlassian.net/browse/DA-50
Changelog / Description

adds /identities/rotate-primary-key endpoint for rotating Primary Key for an Identity
adds /identities/:did/attest-primary-key-rotation for attesting Primary Key rotation

Checklist -

[x] New Feature ?
[x] Updated swagger annotation (if API structure is changed) ?
[x] Unit Test (if possible) ?
[x] Updated the Readme.md (if required) ?

Summary by CodeRabbit

New Features

Introduced primary key rotation functionality for identities, allowing users to rotate and attest primary keys securely.

Documentation

Updated API documentation to include new primary key rotation features.

Tests

Added comprehensive test cases for primary key rotation and attestation in identities management.

Looks like I got confused with attest vs rotate. Can you try to clarify the doc comments so its easier for users to understand the differences. Some of my old comments can be ignored

:tada: This PR is included in version 5.0.0-alpha.10 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Can one source handle multiple processes and can only divert data using switch?

Please describe your problem in detail, if necessary, you can upload the log file through the attachment:
Hello, in a Flow rule, can a source handle multiple flows and can only divert data using switch?

I don't understand the question. Could you please elaborate more with examples?

In one rule, a piece of data does N processing processes.

Looks like you need switch node? Check https://ekuiper.org/docs/en/latest/guide/rules/graph_rule.html#switch

多谢解惑


Market facing atProtocol FAQ

Similar to https://docs.google.com/document/d/1xFga1UvIIQcwlEeO1_IEBKphP1nN5-PG628H9pMOcHU/edit

FYI I won't get to this until next week as in my queue it is behind https://github.com/atsign-foundation/at_server/issues/1244 and https://github.com/atsign-foundation/docs.atsign.com/issues/276 ... if anyone else has bandwidth to make progress here that'd be great

@anthonyvprakash who is the target audience for this FAQ?
Technical or non-technical?

@JeremyTubongbanua  - it will be our partners, resellers and distributors. They need to speak our language and try to sell us. Assume decently technical in this case but also sales guys.

No progress on this from me in the last sprint; this sprint I'm not taking any engineering tasks, my focus will be documentation

There's been a lot of progress made by a whole lot of people during this last sprint. @ksanty you were marshalling all of our efforts here ... can this ticket be closed?

The document still needs technical review @gkc.  @anthonyvprakash and I tagged people to review, so we need to go back and see what has been completed.  There are also still some unanswered responses.  Will carry over to PR59.

I believe the bulk of questions are now completed.  Going to close as this sits with Marketing now to review and deploy across the intended outlets and audiences.


Agent hang there without response.

The agent is hanging there without receiving responses from server. Once restart the agent, it works again. In this case, it is not an issue at the server side.

Add some logging to your code and also set exceptionHandler on HttpClientRequest and HttpClientResponse to see eventual errors.
Make sure the file handles are correctly closed after each iteration
If the number of files is large, have you checked that the number of maximum open file descriptors on the client side is set to a sufficiently high number (i.e. ulimit -n)

This issue was moved to datafibers-community/df_demo#1


Move coverage check after functional tests

Codecov Report

Merging #169 into master will increase coverage by 17.12%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##           master     #169       +/-   ##
===========================================
+ Coverage   76.85%   93.97%   +17.12%
===========================================
  Files          40       40
  Lines        7009     7009
===========================================
+ Hits         5387     6587     +1200
+ Misses       1622      422     -1200

Impacted Files
Coverage Δ

src/selint_config.c
78.84% <0.00%> (+0.96%)
:arrow_up:

src/lex.l
92.78% <0.00%> (+2.06%)
:arrow_up:

src/parse_fc.c
90.50% <0.00%> (+2.53%)
:arrow_up:

src/perm_macro.c
96.19% <0.00%> (+8.57%)
:arrow_up:

src/parse_functions.c
88.18% <0.00%> (+10.95%)
:arrow_up:

src/fc_checks.c
93.97% <0.00%> (+12.04%)
:arrow_up:

src/maps.c
93.56% <0.00%> (+12.12%)
:arrow_up:

src/parse.y
87.12% <0.00%> (+13.30%)
:arrow_up:

src/tree.c
92.94% <0.00%> (+14.41%)
:arrow_up:

src/startup.c
77.03% <0.00%> (+22.96%)
:arrow_up:

... and 9 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d9256b0...7af1382. Read the comment docs.

@cgzones as soon as I hit merge on the coverage PR I noticed that you had it running before the functional tests, which are an important part of our coverage story.  This should help our coverage numbers more realistically reflect our actually coverage.  Look good?

Oops.
Thanks for noticing.
One question: do we want to include the coverage of the refpolicy parse test?
Strictly speaking we have no control over what policy constructs are getting scanned.

That's fair.  I was thinking that it's part of our CI so it's part of our overall coverage, but you're right that we get better consistency in the data if we don't have an external dependency like that.  I'll update to put it after "Test distribution" and before "checkout refpolicy".  Obviously "Test distribution" does nothing for coverage, but if we put it after then we can skip uploading coverage in the case where the distribution checks fail, since we don't really care about it at that point.

:+1:


Ability to process one transaction-related entity which contains multiple transaction information

Expected Behavior
AElf node will have the ability to handle MultiTransaction message, extract transactions of own chain id, then process these transactions.
Features:

Add new protobuf type: MultiTransaction
Add new web API sendMultiTransaction

Development Tasks:

[x] MultiTransaction type
[x] sendMultiTransaction web api

sendMultiTransaction What is MultiTransaction，Why not TransactionCollection？

Compared to a collection of transactions, this structure is more like aggregating multiple transactions of the same person into one transaction, which only requires one signature; If it is called a TransactionCollection, each transaction seems to have an independent signature.


Duplicate JS functions generated with the same name overwriting each other

Experiencing this problem while upgrading to Kotlin 1.9.0 and Compose compiler 1.5.0.
Here is a minimally-reproducing sample:
compose-js-duplicate-signatures.zip. Running ./gradlew build will exhibit the failure.
First, in the build I see this warning:
> Task :redwood-widget-compose:compileTestDevelopmentExecutableKotlinJs
w: <redwood:redwood-widget-compose> @ /Volumes/dev/cashapp/compose-js-duplicate-signatures/redwood-widget-compose/src/commonMain/kotlin/app/cash/redwood/widget/compose/ComposeWidgetChildren.kt:22:1: Abstract function 'insert' is not implemented in non-abstract class 'ComposeWidgetChildren'

Compilation of this type and subsequent tests for this type work on every other target (JVM and a bunch of native). Only JS exhibits this problem. (Note: I have disabled all targets except JS in the sample above, but they exist in the real project)
The insert function is defined in the Widget.Children interface in the 'redwood-widget' module.
public interface Widget<W : Any> {
  public val value: W

  public interface Children<W : Any> {
    public fun insert(index: Int, widget: Widget<W>)
  }
}

The ComposeWidgetChildren implementation in the 'redwood-widget-compose' module does override it with a generic type parameter that is a composable lambda.
public class ComposeWidgetChildren : Widget.Children<@Composable () -> Unit> {
  private val _widgets = mutableStateListOf<Widget<@Composable () -> Unit>>()

  @Composable
  public fun render() {
    for (index in _widgets.indices) {
      _widgets[index].value()
    }
  }

  override fun insert(index: Int, widget: Widget<@Composable () -> Unit>) {
    _widgets.add(index, widget)
  }
}

The JS tests for the 'redwood-widget-compose' module will fail with
IrLinkageError: Abstract function 'insert' is not implemented in non-abstract class 'ComposeWidgetChildren'
	at <global>.throwLinkageError(/Volumes/dev/cashapp/redwood-widget-compose/build/compileSync/js/test/testDevelopmentExecutable/kotlin/runtime/unlinked.kt:11)
	at protoOf.insert_n09y8r(/Volumes/dev/cashapp/compose-js-duplicate-signatures/redwood-widget-compose/src/commonMain/kotlin/app/cash/redwood/widget/compose/ComposeWidgetChildren.kt:20)
	at protoOf.insert_4qfcy3(redwood-redwood-widget-compose-test.2063309350.js:65529)
	at <global>.insert(/Volumes/dev/cashapp/compose-js-duplicate-signatures/redwood-widget-testing/src/commonMain/kotlin/app/cash/redwood/widget/testing/AbstractWidgetChildrenTest.kt:35)
	at protoOf.insertAppend_4conq6(/Volumes/dev/cashapp/compose-js-duplicate-signatures/redwood-widget-testing/src/commonMain/kotlin/app/cash/redwood/widget/testing/AbstractWidgetChildrenTest.kt:28)
	at <global>.test_fun$ComposeWidgetChildrenTest_test_fun$insertAppend_test_fun_i9ukp5(redwood-redwood-widget-compose-test.2063309350.js:65402)
	at Context.<anonymous>(/Volumes/dev/cashapp/compose-js-duplicate-signatures/build/js/packages/src/KotlinTestTeamCityConsoleAdapter.ts:70)

Peeking at the redwood-redwood-widget-compose.js file, we see this:
  protoOf(ComposeWidgetChildren).insert$composable_k4eb7o_k$ = function (index, widget) {
    this._widgets_1.add_exwzt0_k$(index, widget);
  };
  protoOf(ComposeWidgetChildren).insert_4qfcy3_k$ = function (index, widget) {
    return this.insert$composable_k4eb7o_k$(index, widget);
  };
  protoOf(ComposeWidgetChildren).insert_n09y8r_k$ = function (index, widget) {
    throwLinkageError("Abstract function 'insert' is not implemented in non-abstract class 'ComposeWidgetChildren'");
  };
  protoOf(ComposeWidgetChildren).insert_4qfcy3_k$ = function (index, widget) {
    return this.insert_n09y8r_k$(index, widget);
  };

This is the real implementation whose signature has been transformed with a $composable name part (despite not actually being a composable function), then presumably the insert_4q function is the override. But then we get this insert_n0 function which is some kind of abstract placeholder, and then another insert_4q which invokes that placeholder (and thus overrides the first insert_4q override).
If you disable the Compose compiler in this module the latter two functions disappear. The test obviously still fails at runtime, but with an IllegalStateException about the Compose compiler not being run after the insert function was successfully invoked.
When using Kotlin 1.8.22 and JB Compose compiler 1.4.8 only the first two JS functions are generated and the compilation and test both succeed.

Thanks!

Hi @JakeWharton!
I started to look into this issue and I'm a bit surprised with what I see now.
First I wanted it to fail at compile time instead of at runtime, so I added:
allprojects {

  afterEvaluate {

    tasks.withType(KotlinJsCompile.class) {
      kotlinOptions.freeCompilerArgs += [
              "-Xpartial-linkage=disable"
      ]
    }
  }
}

But it didn't fail at compile time, and it made it work at runtime too. I'm wondering if adding this flag would make all of your tests pass with k/js. In the meantime I'll ask kotlin team if it's expected - it doesn't seem to be right.

Oh, interesting. I will try later today/tonight on the real project.

Please check the following ticket on YouTrack for follow-ups to this issue. GitHub issues will be closed in the coming weeks.


Defaults in python code as well as templates

For some important variables there are some defaults in python code and templates. There should only be one source of truth.

One example is KUBERNETES_VERSION, which is currently 1.22.8 in custom.py but 1.20.2 in some templates. The value in custom.py will win, but it's confusing for a developer or a reader of the code when they diverge. Even having a default in both places requires a developer to reason about which one wins, but ideally it would be obvious.
We didn't want to propose a fix in the issue description, but the obvious ones are:

Remove overlapping defaults from custom.py, or
Remove overlapping defaults from the jinja template files

@devigned, I agree with @mboersma. Making sure that we only have a source of truth.
A slightly addition to removing the overlapping values will be to extract these defaults values into a standalone file that the python code and possible the jinja template could refer to.


fixed rendering issue

The value of the last sentence was not rendering correctly on the doc site.
Fixed the issue by escaping the brace.

This is fixed: https://docs.mulesoft.com/mule-runtime/4.1/configuring-properties


Disconnecting the app during safe creation breaks the safe creation process

Description
This particular issue was fixed not long ago, it seems it broke again. While creating a safe the user should be able to disconnect the account and the safe creation process should continue just fine
Environment

Browser: Chrome
Wallet: MetaMask
Chain: Rinkeby
Env: Dev

Steps to reproduce

Connect to the app
Start the safe creation process
Submit the tx
During the 6 steps where you have to wait discconect from the safe app

Expected result
The user disconects but the steps keep going until the safe is created
Obtained result
The page shows a loading icon indefinitely
Screenshots

This seems to be working on prod. Needs to be revised

In web-core, it resets to the first step.


Support ApiPlatform 3.0

I have not yet tested whether the bundle would support 3.0 in principle. Is that already something planned?
    - metaclass-nl/filter-bundle is locked to version v2.0.1 and an update of this package was not requested.
    - metaclass-nl/filter-bundle v2.0.1 requires api-platform/core ^2.5 -> found api-platform/core[v2.5.0, ..., v2.7.1] but it conflicts with your root composer.json require (^3.0).

It looks like with respect to the filters themselves little has changes between 2.6 and 3.0, just that the filters have been moved to a new namespace. So for the filter-bundle to work with 3.0 a new major version will be necessary. But i can not yet comprehend the possible impact of the new metadata.
2.7 puzzles me, I guess the old version should work with metadata_backward_compatibility_layer=true and the new version with metadata_backward_compatibility_layer=false. But AFAIK this can not be expressed in the declared dependencies in composer.json of filter-bundle...

The new metadata does have an impact on LogicFilter, but mostly on the tests. I got lost in the new namespaces so that i could not estimate the time required. So i just made a start with the adaptation. I now have it working with 2.7 with metadata_backward_compatibility_layer=false, except Metaclass\FilterBundle\Filter\DateFilter which extends a class that is now final.
I hope to finish the work during this week but i can not make any promises because i do not know how much time i can actually spend. For those who don't want to wait i will push a branch 3.0 today with a bleeding edge development version. See its readme for its status.

It went much quicker then i expected. Released as v3.0.0.rc1


Codeowners update

This PR is an honest attempt to set the correct team(s) as a codeowner for this repo. If the team listed is incorrect but you know who should have it, feel free to make a change.
Otherwise, if it looks good, just smash that merge button. (please and thank you)
If you need any help finding a home for this repo, reach out to the FSRE team in #crew-forward-sre and we can help shepherd this along.

Based on the new service owner spreadsheet this repo is going to be deprecated. Closing this PR.