Attempt to read zips with STORED data descriptors

If we get an UnsupportedZipFeatureException because of the DataDescriptor feature, create a new zip input stream with reading of entries with data descriptors enabled and attempt to parse the entries again.
Apache Ticket: https://issues.apache.org/jira/browse/TIKA-3196

@PeterAlfredLee who needs to review this to get it approved and merged?

Thank you for this PR.  Two questions:

Do we have to reset the stream before reprocessing?
Can you create a unit test with a small document that shows that this works?

For those interested in this issue, make sure to check out the conversation here: https://github.com/apache/commons-compress/pull/137
for why we don't want to make this the default.

Do we have to reset the stream before reprocessing?

+1. The stream should be reset or relocation to the beginning of the file.
I think this is complicated here, cause the stream can may be not a seekable or resetable stream. Seems we got to write the stream to a temp file, which may cause some other problems cause zip archives may be pretty huge. Maybe you have other better ideas? @tballison

Can you create a unit test with a small document that shows that this works?

+1. I can write a test for this. Will update when this is done.

I forged a zip archive in memory that uses STORED and Data Descriptor at the same time. This could be easily used as a test case :
    @Test
    public void testZipUsingStoredWithDataDescriptor() throws Exception {
        ContentHandler handler = new BodyContentHandler();
        Metadata metadata = new Metadata();

        try (InputStream stream = forgeZipInputStream() ) {
            AUTO_DETECT_PARSER.parse(stream, handler, metadata, recursingContext);
        }
    }

    private InputStream forgeZipInputStream() throws IOException {
        // generate a zip archive in memory
        try (final ByteArrayOutputStream byteArrayOutputStream = new ByteArrayOutputStream();
             final ZipArchiveOutputStream zo = new ZipArchiveOutputStream(byteArrayOutputStream);){

            final ZipArchiveEntry entryA = new ZipArchiveEntry("foo");
            entryA.setMethod(ZipEntry.STORED);
            entryA.setSize(4);
            entryA.setCrc(0xb63cfbcdl);
            zo.putArchiveEntry(entryA);
            zo.write(new byte[] { 1, 2, 3, 4 });
            zo.closeArchiveEntry();
            zo.close();

            final byte[] zipContent = byteArrayOutputStream.toByteArray();
            final byte[] old = Arrays.copyOf(zipContent, zipContent.length);

            final byte[] zipContentWithDataDescriptor = new byte[zipContent.length + 12];
            System.arraycopy(zipContent, 0, zipContentWithDataDescriptor, 0, 37);
            // modify the general purpose bit flag
            zipContentWithDataDescriptor[6] = 8;

            // copy the crc-32, compressed size and uncompressed size to the data descriptor
            System.arraycopy(zipContent, 14, zipContentWithDataDescriptor, 37, 12);

            // and copy the rest of the zip content
            System.arraycopy(zipContent, 37, zipContentWithDataDescriptor, 49, zipContent.length - 37);

            return new ByteArrayInputStream(zipContentWithDataDescriptor);
        }
    }

I have added the resetting of the stream and added some unit tests. Though I will add in the zip generation code from @PeterAlfredLee in the tests instead of adding a zip archive to the project. In the meantime, here is the solution I have come up with (and have tested):
In PackageParser if the ArchiveInputStream is a ZipArchiveInputStream, iterate through all the zip entries without trying to parse/read them. This will make it so we do not write any of the zip contents to the ContentHandler which will avoid writing any duplicate content to the ContentHandler if we end up having a data descriptor exception and attempt to scan again with the data descriptor support enabled.
If in iterating through the entries there are entries that have data descriptors a data descriptor UnsupportedZipFeatureException will be thrown, which we catch and can then try reading/parsing the zip with a ZipArchiveInputStream with the data descriptor support enabled. If we get a PasswordRequiredException, or another UnsupportedZipFeatureException, that will be handled just like it was before.
If no exception is thrown, the ArchiveInputStream is closed, a new ZipArchiveInputStream is created (or else the zip doesn't get read), the stream is reset, and reading/parsing of entries happens like normal.
How does this solution sound? I know it's not great to have to iterate through a zip twice but it was the only way I could find so far of determining if the zip has entries with data descriptors. I initially wanted to do something like, read the stream like is done now, catch the data descriptor exception, reset the contents of the ContentHandler, reset the stream and try reading again with the data descriptor enabled ZipArchiveInputStream but there is no way to reset the ContentHandler. So this was the next best thing I could come up with so far.

@PeterAlfredLee - I just put that zip generation code into the ZipParserTest but it's throwing a 'Truncated Zip File' exception when run.
`org.apache.tika.exception.TikaException: TIKA-198: Illegal IOException from org.apache.tika.parser.pkg.PackageParser@3688eb5b
at org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:283)
at org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:277)
at org.apache.tika.parser.AutoDetectParser.parse(AutoDetectParser.java:143)
at org.apache.tika.parser.pkg.ZipParserTest.testZipUsingStoredWithDataDescriptor(ZipParserTest.java:88)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:69)
at com.intellij.rt.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:33)
at com.intellij.rt.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:220)
at com.intellij.rt.junit.JUnitStarter.main(JUnitStarter.java:53)

Caused by: org.apache.tika.io.TaggedIOException: Truncated ZIP file
at org.apache.tika.io.TaggedInputStream.handleIOException(TaggedInputStream.java:133)
at org.apache.tika.io.ProxyInputStream.read(ProxyInputStream.java:106)
at org.apache.tika.io.IOUtils.read(IOUtils.java:935)
at org.apache.tika.detect.zip.DefaultZipContainerDetector.detect(DefaultZipContainerDetector.java:101)
at org.apache.tika.detect.CompositeDetector.detect(CompositeDetector.java:84)
at org.apache.tika.parser.AutoDetectParser.parse(AutoDetectParser.java:116)
at org.apache.tika.parser.DelegatingParser.parse(DelegatingParser.java:72)
at org.apache.tika.extractor.ParsingEmbeddedDocumentExtractor.parseEmbedded(ParsingEmbeddedDocumentExtractor.java:105)
at org.apache.tika.parser.pkg.PackageParser.parseEntry(PackageParser.java:351)
at org.apache.tika.parser.pkg.PackageParser.readEntries(PackageParser.java:303)
at org.apache.tika.parser.pkg.PackageParser.parse(PackageParser.java:285)
at org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:277)
... 29 more
Caused by: org.apache.tika.io.TaggedIOException: Truncated ZIP file
at org.apache.tika.io.TaggedInputStream.handleIOException(TaggedInputStream.java:133)
at org.apache.tika.io.ProxyInputStream.read(ProxyInputStream.java:106)
at org.apache.tika.io.ProxyInputStream.read(ProxyInputStream.java:102)
at org.apache.tika.io.ProxyInputStream.read(ProxyInputStream.java:102)
... 39 more
Caused by: java.io.IOException: Truncated ZIP file
at org.apache.commons.compress.archivers.zip.ZipArchiveInputStream.readStoredEntry(ZipArchiveInputStream.java:934)
at org.apache.commons.compress.archivers.zip.ZipArchiveInputStream.readStored(ZipArchiveInputStream.java:544)
at org.apache.commons.compress.archivers.zip.ZipArchiveInputStream.read(ZipArchiveInputStream.java:486)
at java.base/java.io.BufferedInputStream.fill(BufferedInputStream.java:252)
at java.base/java.io.BufferedInputStream.read1(BufferedInputStream.java:292)
at java.base/java.io.BufferedInputStream.read(BufferedInputStream.java:351)
at org.apache.tika.io.ProxyInputStream.read(ProxyInputStream.java:102)
... 41 more`

@PeterAlfredLee - I just put that zip generation code into the ZipParserTest but it's throwing a 'Truncated Zip File' exception when run.

Oops. I forgot to add the Data Descriptor signature in the generated zip - even through it is recommanded to have a DD signature, it's a legal zip without it. The generated zip could be successfully read with latest Commons Compress code(that's why I successfully read it on my computer using latest Commons Compress) but it could not work on Compress v1.20 - because I fixed this with commit 86bb35a in Commons Compress.

I updated a little bit with the DD signature part. This works with Compress 1.20 and works fine with this PR.
    private InputStream forgeZipInputStream() throws IOException {
        // generate a zip archive in memory
        try (final ByteArrayOutputStream byteArrayOutputStream = new ByteArrayOutputStream();
             final ZipArchiveOutputStream zo = new ZipArchiveOutputStream(byteArrayOutputStream);){

            final ZipArchiveEntry entryA = new ZipArchiveEntry("foo");
            entryA.setMethod(ZipEntry.STORED);
            entryA.setSize(4);
            entryA.setCrc(0xb63cfbcdl);
            zo.putArchiveEntry(entryA);
            zo.write(new byte[] { 1, 2, 3, 4 });
            zo.closeArchiveEntry();
            zo.close();

            final byte[] zipContent = byteArrayOutputStream.toByteArray();
            final byte[] old = Arrays.copyOf(zipContent, zipContent.length);

            final byte[] zipContentWithDataDescriptor = new byte[zipContent.length + 16];
            System.arraycopy(zipContent, 0, zipContentWithDataDescriptor, 0, 37);
            // modify the general purpose bit flag
            zipContentWithDataDescriptor[6] = (byte) 0x08;

            // add the Data Descriptor Signature
            zipContentWithDataDescriptor[37] = (byte) 0x50;
            zipContentWithDataDescriptor[38] = (byte) 0x4B;
            zipContentWithDataDescriptor[39] = (byte) 0x07;
            zipContentWithDataDescriptor[40] = (byte) 0x08;

            // copy the crc-32, compressed size and uncompressed size to the data descriptor
            System.arraycopy(zipContent, 14, zipContentWithDataDescriptor, 41, 12);

            // and copy the rest of the zip content
            System.arraycopy(zipContent, 37, zipContentWithDataDescriptor, 53, zipContent.length - 37);

            return new ByteArrayInputStream(zipContentWithDataDescriptor);
        }
    }

In PackageParser if the ArchiveInputStream is a ZipArchiveInputStream, iterate through all the zip entries without trying to parse/read them. This will make it so we do not write any of the zip contents to the ContentHandler which will avoid writing any duplicate content to the ContentHandler if we end up having a data descriptor exception and attempt to scan again with the data descriptor support enabled.

-1. I don't like this idea. Iterating through the zip without any reading would not save more time than reading all entries - we would always extract and read the data of the entry(see also ZipArchiveInputStream.drainCurrentEntryData about this) even through you didn't call ZipArchiveInputStream.read.
Zip archives could be pretty huge. Iterating them twice may be a time consuming job. Comparing with this, finding out a way to reset the ContentHandler would be more easier.

In PackageParser if the ArchiveInputStream is a ZipArchiveInputStream, iterate through all the zip entries without trying to parse/read them. This will make it so we do not write any of the zip contents to the ContentHandler which will avoid writing any duplicate content to the ContentHandler if we end up having a data descriptor exception and attempt to scan again with the data descriptor support enabled.

-1. I don't like this idea. Iterating through the zip without any reading would not save more time than reading all entries - we would always extract and read the data of the entry(see also ZipArchiveInputStream.drainCurrentEntryData about this) even through you didn't call ZipArchiveInputStream.read.
Zip archives could be pretty huge. Iterating them twice may be a time consuming job. Comparing with this, finding out a way to reset the ContentHandler would be more easier.

I agree. I have restored PackageParser to no longer perform the initial iteration through the zip and added a throwing and handling of TikaException when a zip entry cannot be read because of data descriptor being present. This makes it so we do not write to the content handler for this entry until we can actually read it.
I marked two of the tests as ignored for the moment until we can get the mark(int limit) and reset() to reset the stream to the right place so we can retry reading the zip starting from the entry with the data descriptor.
When I call mark before reset (before retrying with a new ZipArchiveInputStream) I get an exception with message "Unexpected record signature: 0X73696854"

finding out a way to reset the ContentHandler would be more easier.

We were thinking about adding a resettable content handler to Tika 2.0, but it is really tricky and adds some complexity.  If you can find a solution, great, but I'd be happy enough throwing the exception and then putting it on the client code to rerun the parse with PKGParser configured to allow for data descriptors.

If we do go with the stream the full thing first to see if there are data descriptors option, we should enable users to configure the PKGParser to do that because of the hit in parsing time.
Yes, ideally, we'd be able to handle this all behind the scenes, but it is sounding complicated.

I think the idea of having the client handle the exception and rerun the parse may actually be the better option at this point.

finding out a way to reset the ContentHandler would be more easier.

We were thinking about adding a resettable content handler to Tika 2.0, but it is really tricky and adds some complexity. If you can find a solution, great, but I'd be happy enough throwing the exception and then putting it on the client code to rerun the parse with PKGParser configured to allow for data descriptors.

Having the client code handle the exception / re-running the parsing seems like the better option at this point. My initial thought is to create a ZipArchiveInputStreamFactory in commons-compress in which you can set values for the various ZipArchiveInputStream parameters, and to have methods to generate a ZipArchiveInputStream using those parameters.
Then when the data descriptor exception is thrown and caught, the client can create a ZipArchiveInputStreamFactory with the data descriptor feature enabled and set that in the ParseContext.
Then in PackageParser, when we go to create an ArchiveInputStream, if the archive type is zip and a ZipArchiveInputStreamFactory is defined in the ParseContext then use the ZipArchiveInputStreamFactory to generate the ZipArchiveInputStream. Otherwise use the ArchiveStreamFactory.
Something like this:
`
// in commons-compress
import java.io.InputStream;
import static org.apache.commons.compress.archivers.zip.ZipEncodingHelper.UTF8;
public class ZipArchiveInputStreamFactory {
private String encoding = UTF8;
private boolean allowStoredEntriesWithDataDescriptor = false;
private boolean useUnicodeExtraFields = true;
private boolean skipSplitSig = false;
public ZipArchiveInputStreamFactory(){}

public void setEncoding(String encoding) {
    this.encoding = encoding;
}

public void setAllowStoredEntriesWithDataDescriptor(boolean allowStoredEntriesWithDataDescriptor) {
    this.allowStoredEntriesWithDataDescriptor = allowStoredEntriesWithDataDescriptor;
}

public void setUseUnicodeExtraFields(boolean useUnicodeExtraFields) {
    this.useUnicodeExtraFields = useUnicodeExtraFields;
}

public void setSkipSplitSig(boolean skipSplitSig) {
    this.skipSplitSig = skipSplitSig;
}

public ZipArchiveInputStream createZipArchiveInputStream(InputStream stream) {
    return new ZipArchiveInputStream(stream, encoding, useUnicodeExtraFields, allowStoredEntriesWithDataDescriptor, skipSplitSig);
}

}
// PackageParser.java
...
try {
ArchiveStreamFactory factory = context.get(ArchiveStreamFactory.class, new ArchiveStreamFactory());
// At the end we want to close the archive stream to release
// any associated resources, but the underlying document stream
// should not be closed
        CloseShieldInputStream csis = new CloseShieldInputStream(stream);
        Object zipArchiveInputStreamFactory = context.get(ZipArchiveInputStreamFactory);
        if (ArchiveStreamFactory.detect(csis).equalsIgnoreCase("zip") && zipArchiveInputStreamFactory != null) {
            ais = zipArchiveInputStreamFactory.createZipArchiveInputStream(csis);
        } else {
            ais = factory.createArchiveInputStream(csis);
        }
    }

`

Actually an even simpler solution would be to create a ZipArchiveStreamFactory which extends ArchiveStreamFactory and simply overwrite the createArchiveInputStream function. That would make it so there wouldn't need to be any change to PackageParser at all.
All the client would have to do is create that ZipArchiveStreamFactory, set the allowStoredEntriesWithDataDescriptor to true, and set that in the ParseContext and it should then use that to create the data descriptor enabled ZipArchiveInputStream.
What you think about that @tballison @PeterAlfredLee ?
`
public class ZipArchiveStreamFactory extends ArchiveStreamFactory {
private boolean allowStoredEntriesWithDataDescriptor = false;
private boolean useUnicodeExtraFields = true;
private boolean skipSplitSig = false;
public void setAllowStoredEntriesWithDataDescriptor(boolean allowStoredEntriesWithDataDescriptor) {
    this.allowStoredEntriesWithDataDescriptor = allowStoredEntriesWithDataDescriptor;
}

public void setUseUnicodeExtraFields(boolean useUnicodeExtraFields) {
    this.useUnicodeExtraFields = useUnicodeExtraFields;
}

public void setSkipSplitSig(boolean skipSplitSig) {
    this.skipSplitSig = skipSplitSig;
}

@Override
public ArchiveInputStream createArchiveInputStream(String archiverName, InputStream in, String actualEncoding) throws ArchiveException {
    if (archiverName == null) {
        throw new IllegalArgumentException("Archivername must not be null.");
    }

    if (in == null) {
        throw new IllegalArgumentException("InputStream must not be null.");
    }

    if (ZIP.equalsIgnoreCase(archiverName)) {
        Optional<String> maybeEncoding = Optional.of(actualEncoding);
        return new ZipArchiveInputStream(in, maybeEncoding.orElse(ZipEncodingHelper.UTF8), useUnicodeExtraFields, allowStoredEntriesWithDataDescriptor, skipSplitSig);
    } else {
        return super.createArchiveInputStream(archiverName, in, actualEncoding);
    }
}
}`

I think I found a solution :
we can read the archive and save the count of entries we have read. If a UnsupportedZipFeatureException is met, we can reset the stream and skip the entries we have already read(these entries have already beed written to the handler), then we can continue reading the remain of the zip with allowDataDescriptor true.
I'm almost finished with this and would push another PR.


token-2022: Add PermanentDelegate support to CLI and JS

Problem
#3725 is adding the PermanentDelegate extension and support in token-client, but we need it in the CLI and JS.
Solution
Add them!

I would like to work on this issue.

Please do! We can separate CLI and JS into separate issues if you prefer

Please do! We can separate CLI and JS into separate issues if you prefer

That would be great ! I wanted to confirm that permanentDelegate can also be used to transfer tokens from one account to another because it's working for burn instruction but when i am using it for  transfer instruction it's failing with some custom error.
transfer(connection,payer,account,destination,permanentDelegate,1,undefined,undefined,TEST_PROGRAM_ID);


Random Crashing with big modpack?

Mod Name
Unknown
Mod Homepage
Unknown
Minecraft version
1.20.1
Describe the bug
Game has a chance of crashing at random?
Steps to reproduce
No response
Logs
https://gist.github.com/BoardAnims/cefcb301d2f626fab3d8cac928b0e66d
Additional context
Sorry for asking here, but im not sure where else to ask for help in a large custom modpack.
This connector has been working quite great for me besides a few unrelated lag problems. The main problem Im having is the game randomly crashing. It doesnt seem to be triggered by anything in particular, it sort of just happens while play-testing. I can re-enter the world and continue playing without many errors.
Asking here if it's possible the sinytra connector is responsible for any of these crashes. Please read crash-reports if possible, thank you.

I've read the stacktrace in the crash report, but it doesn't point to any particular mod. Try removing Connector and all Fabric mods, which should eliminate the possibility of Connector being involved.

I've read the stacktrace in the crash report, but it doesn't point to any particular mod. Try removing Connector and all Fabric mods, which should eliminate the possibility of Connector being involved.

I'll try this in a new world, thanks.
Do you know what the error is for when forge tries to load a fabric mod?
Also if there's a way to binary search only content mods and not library/dependencies?


The Join maillist domain doesn't exist

Hi - the Join maillist (Subscribe button) domain doesn't exist, so it is impossible to subscribe. Thank you!

Thanks for noticing. The newsletter is no longer being maintained so I'm going to remove this from the codebase.


Unable to see which namespace the tool is displaying

Describe the bug
Unable to see which namespace the tool is displaying if there are too many namespaces.
To Reproduce
Steps to reproduce the behavior:

Add about 60 namespaces
try kubelive get pod

Expected behavior
To be able to see which namespaces I can switch to or use the flag -n to specify a namespace prior to running the tool.
On top of that, even if I could see which namespace is currently displayed I still would have to click through a lot of namespaces to get to where I might want to go.
Screenshots

@florianbegusch thanks for raising this,
this is a known limitation, I believe may be supporting filtering namespace might help this


Add double pendulum simulation

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
What problem is this feature trying to solve?
How do we know when the feature is complete?

@Sulagna-Dutta-Roy

This is my project
Kindly assign me this issue

What are the use of these extensions? Explain real time usecases @Aditi22Bansal

@Sulagna-Dutta-Roy
If we take the case of this issue only- double pendulum
Double pendulum simulations are used in robotics for balancing robots and precise control of robotic arms, and in biomechanics for analyzing human motion and improving gait patterns. They also enhance physics education through interactive demonstrations of chaos theory, and are utilized in computer graphics to create realistic animations.
So
these time of simulations do have a lot of real time usecases

@Sulagna-Dutta-Roy
Kindly assign me this issue according to your preferences

How many points you've earned from my repo? Please check it @Aditi22Bansal

@Sulagna-Dutta-Roy
70

Okay


Release 2.1.0

Note, this assumes #485 has been merged.

Note, this assumes #485 has been merged.


HBASE-25562 ReplicationSourceWALReader log and handle exception immed…

…iately without retrying

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
4m 20s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ branch-2.3 Compile Tests _

+1 :green_heart:
mvninstall
3m 37s
branch-2.3 passed

+1 :green_heart:
compile
3m  2s
branch-2.3 passed

+1 :green_heart:
checkstyle
1m  6s
branch-2.3 passed

+1 :green_heart:
spotbugs
2m  1s
branch-2.3 passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
3m  9s
the patch passed

+1 :green_heart:
compile
3m  2s
the patch passed

+1 :green_heart:
javac
3m  2s
the patch passed

+1 :green_heart:
checkstyle
1m  5s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
hadoopcheck
16m 47s
Patch does not cause any errors with Hadoop 2.10.0 or 3.1.2 3.2.1.

+1 :green_heart:
spotbugs
2m  8s
the patch passed

_ Other Tests _

+1 :green_heart:
asflicense
0m 15s
The patch does not generate ASF License warnings.

47m 56s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2966/1/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2966

Optional Tests
dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile

uname
Linux 850162961c2c 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
branch-2.3 / 1a703f48e9

Default Java
AdoptOpenJDK-1.8.0_232-b09

Max. process+thread count
95 (vs. ulimit of 12500)

modules
C: hbase-server U: hbase-server

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2966/1/console

versions
git=2.17.1 maven=3.6.3 spotbugs=3.1.12

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 37s
Docker mode activated.

-0 :warning:
yetus
0m  8s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ branch-2.3 Compile Tests _

+1 :green_heart:
mvninstall
4m 14s
branch-2.3 passed

+1 :green_heart:
compile
1m  4s
branch-2.3 passed

+1 :green_heart:
shadedjars
5m 50s
branch has no errors when building our shaded downstream artifacts.

-0 :warning:
javadoc
0m 42s
hbase-server in branch-2.3 failed.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
3m 51s
the patch passed

+1 :green_heart:
compile
1m  4s
the patch passed

+1 :green_heart:
javac
1m  4s
the patch passed

+1 :green_heart:
shadedjars
5m 47s
patch has no errors when building our shaded downstream artifacts.

-0 :warning:
javadoc
0m 38s
hbase-server in the patch failed.

_ Other Tests _

+1 :green_heart:
unit
126m 39s
hbase-server in the patch passed.

152m 46s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2966/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2966

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux e5a236f5a4d3 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
branch-2.3 / 1a703f48e9

Default Java
AdoptOpenJDK-11.0.6+10

javadoc
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2966/1/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-server.txt

javadoc
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2966/1/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-server.txt

Test Results
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2966/1/testReport/

Max. process+thread count
4301 (vs. ulimit of 12500)

modules
C: hbase-server U: hbase-server

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2966/1/console

versions
git=2.17.1 maven=3.6.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m 54s
Docker mode activated.

-0 :warning:
yetus
0m  7s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ branch-2.3 Compile Tests _

+1 :green_heart:
mvninstall
4m 20s
branch-2.3 passed

+1 :green_heart:
compile
0m 58s
branch-2.3 passed

+1 :green_heart:
shadedjars
5m 26s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 36s
branch-2.3 passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
3m 32s
the patch passed

+1 :green_heart:
compile
0m 57s
the patch passed

+1 :green_heart:
javac
0m 57s
the patch passed

+1 :green_heart:
shadedjars
5m 28s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 35s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
214m  8s
hbase-server in the patch passed.

240m  8s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2966/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2966

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux d5d00b8f2664 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
branch-2.3 / 1a703f48e9

Default Java
AdoptOpenJDK-1.8.0_232-b09

Test Results
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2966/1/testReport/

Max. process+thread count
2907 (vs. ulimit of 12500)

modules
C: hbase-server U: hbase-server

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2966/1/console

versions
git=2.17.1 maven=3.6.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m 59s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ branch-2.3 Compile Tests _

+1 :green_heart:
mvninstall
4m  5s
branch-2.3 passed

+1 :green_heart:
compile
3m 13s
branch-2.3 passed

+1 :green_heart:
checkstyle
1m 15s
branch-2.3 passed

+1 :green_heart:
spotbugs
2m  7s
branch-2.3 passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
3m 40s
the patch passed

+1 :green_heart:
compile
3m 12s
the patch passed

+1 :green_heart:
javac
3m 12s
the patch passed

+1 :green_heart:
checkstyle
1m 12s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
hadoopcheck
18m 49s
Patch does not cause any errors with Hadoop 2.10.0 or 3.1.2 3.2.1.

+1 :green_heart:
spotbugs
2m 14s
the patch passed

_ Other Tests _

+1 :green_heart:
asflicense
0m 12s
The patch does not generate ASF License warnings.

49m 56s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2966/2/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2966

Optional Tests
dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile

uname
Linux 9fa8a45141cf 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
branch-2.3 / 1a703f48e9

Default Java
AdoptOpenJDK-1.8.0_232-b09

Max. process+thread count
86 (vs. ulimit of 12500)

modules
C: hbase-server U: hbase-server

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2966/2/console

versions
git=2.17.1 maven=3.6.3 spotbugs=3.1.12

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m 42s
Docker mode activated.

-0 :warning:
yetus
0m  8s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ branch-2.3 Compile Tests _

+1 :green_heart:
mvninstall
4m 10s
branch-2.3 passed

+1 :green_heart:
compile
1m  8s
branch-2.3 passed

+1 :green_heart:
shadedjars
6m 37s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 46s
branch-2.3 passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
4m 30s
the patch passed

+1 :green_heart:
compile
1m 11s
the patch passed

+1 :green_heart:
javac
1m 11s
the patch passed

+1 :green_heart:
shadedjars
6m 20s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 43s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
205m 38s
hbase-server in the patch passed.

234m 54s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2966/2/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2966

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 89331da11c0e 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
branch-2.3 / 1a703f48e9

Default Java
AdoptOpenJDK-1.8.0_232-b09

Test Results
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2966/2/testReport/

Max. process+thread count
2838 (vs. ulimit of 12500)

modules
C: hbase-server U: hbase-server

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2966/2/console

versions
git=2.17.1 maven=3.6.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.


Feedback: Left-hand nav sidebar 'judders'

https://www.loom.com/share/e20cb3ddb90b4e68b0103c26f7a2935f
Left-hand nav keeps shaking as you scroll through content that is longer than the left-hand nav.

Related: #557

Wow I couldn't see that - what OS & browser combo are you using?

@mhwelander Can't seem to reproduce this. Can you point me to the right page?

Moving this to 'prioritize after release' and changed to 'on Windows', as I still see the shaking.

specificially on chrome on windows, when zoomed in too.


Question about MOSI dataset

Hi I have a question about MOSI dataset.
When I checked other research codes on MOSI data, I found they use vision features whose final dimension is 20 and audio features whose final dimension is 5. But I think those features can't be downloaded from this repo.
Do you know something?
Thank you in advance!

I would suggest contacting the authors. It's possible they used an earlier version of the dataset, but most likely they are using a subset of the dataset features or summative features (e.g., mean, median)

Thank you for replying! Yes they might use a subset of the dataset. But a couple of papers are using those features. So I thought they used some different version of the dataset. Was there an earlier version of MOSI datset? And do you know it had some option of encoding audio and vision features into 5 and 20 features? I guess this repo was created lately? So I guess some version of dataset was gone.

And I downloaded MOSI dataset from this repo. But the number of data is 2183 (train: 1283, valid: 214, test: 686).
According to those papers, it should be 2199(train: 1284, valid: 229, test : 686). Do you know something about it?

Thank you for replying! Yes they might use a subset of the dataset. But a couple of papers are using those features. So I thought they used some different version of the dataset. Was there an earlier version of MOSI datset? And do you know it had some option of encoding audio and vision features into 5 and 20 features? I guess this repo was created lately? So I guessed some version of dataset was gone.
Hello, I also encountered this problem. Have you solved it？

@Katyawa @mishimario I also encountered this problem. Have you solved it？


Only Admin node needs Elasticsearch

If other nodes need no access, they also do not need to know the Elasticsearch'es host name.
Document Elasticsearch-related environment variables.
https://groups.google.com/a/opencast.org/g/users/c/kMfY5DZEhoU/m/XvENL4dnAgAJ
This PR is untested. When I have time and there is no CI doing this, I will test it, otherwise please feel invited to test this on your side. Thanks for providing these images.

@Rillke this took a long while, and the repo has changed quite a bit. This is now solved a little bit differently. The commit is still attributed to you.


Update submodules

@borisspektor, travis fails here, because submodule points to incorrect commit at this moment (will be fixed after you will merge android-profile and android-core submodules.


Track source incompatibilities in prioritized distribution

Summary
Like with wheels, we can track the compatibility of source distributions in PrioritizedDist and use those to both backtrack and surface better error messages to users.
Closes https://github.com/astral-sh/uv/issues/2003.

I think this should actually be closed in favor of https://github.com/astral-sh/uv/pull/1298 which solves at least this problem and a few others. Gonna leave it in draft for now though until Zanie is back.

Closed in favor of https://github.com/astral-sh/uv/pull/1298.


SCIMid is not generated for user created on WSO2 APIM

I am using WSO2 Api manager 2.1.0 ,when I create a user testAM using WSO2 API manager GUI and makes request for getting user information
curl -k -v -X GET "https://<is_ip>:<is_port>/scim/Users/me" \
-s -S --header "Authorization: Bearer <oauth2_token>" \
--header "Content-Type: application/json" \
--header "Accept: application/json"

it gives 500 Internal server Error .
But when we create user testIS using WSO2 Identity Server GUI and search  for the user(testIS) using below API:
curl -k -v -X GET "https://<is_ip>:<is_port>/scim/Users/me" \
-s -S --header "Authorization: Bearer <oauth2_token>" \
--header "Content-Type: application/json" \
--header "Accept: application/json"

it gives 200 OK and gives the user information.
As per my analysis, there may be a difference in user creation procedure on both WSO2 IS and APIM because when I have checked the user information in ldap scimID and uid is not present for testAM user while scimID and uid is present for the testIS user.
Could you please suggest why both behave differently in case of user creation and whether APIM supports SCIM or not as scimId is not generated for user on APIM even if we set <Property name="SCIMEnabled">true</Property> in user-mgt.xml

API Manager does not support SCIM APIs where IS does. So if you need to have SCIM support, you can use IS as key manager to get these functionalities.
On the other hand, there are SOAP Admin services available in APIM, to retrieve user information.

So if you need to have SCIM support, you can use IS as key manager to get these functionalities.

If we use IS as key manager, will there be support for SCIM API for user created at  APIM Management Console GUI?
Is there any configuration at APIM through which scimID and uid can be associated with user created at APIM

No Apim doesn't have functionality to include scimId


glog rpm installation fails if openstack-train repo is enabled

yum install glog fails in CentOS if openstack-train repo is enabled.
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile

openstack-train: mirror2.evolution-host.com
rdo-qemu-ev: mirror.dst.ca
Resolving Dependencies
--> Running transaction check
---> Package glog.x86_64 0:0.3.3-8.el7 will be installed
--> Processing Dependency: gflags for package: glog-0.3.3-8.el7.x86_64
--> Processing Dependency: libgflags.so.2.1()(64bit) for package: glog-0.3.3-8.el7.x86_64
--> Running transaction check
---> Package gflags.x86_64 0:2.2.1-1.el7 will be installed
---> Package glog.x86_64 0:0.3.3-8.el7 will be installed
--> Processing Dependency: libgflags.so.2.1()(64bit) for package: glog-0.3.3-8.el7.x86_64
--> Finished Dependency Resolution
Error: Package: glog-0.3.3-8.el7.x86_64 (epel)
Requires: libgflags.so.2.1()(64bit)
Available: gflags-2.1.1-6.el7.x86_64 (epel)
libgflags.so.2.1()(64bit)
Installing: gflags-2.2.1-1.el7.x86_64 (openstack-train)
~libgflags.so.2.2()(64bit)
You could try using --skip-broken to work around the problem
You could try running: rpm -Va --nofiles --nodigest

You use an old glog version. Please update to latest release or master and report back.


[red-knot] Port more tests in infer.rs to mdtest

Following https://github.com/astral-sh/ruff/pull/14126, mdtest now supports Python snippets that contain invalid syntax. This enables us to port more tests in infer.rs over to the mdtest framework; we should do so

Closing as duplicate of https://github.com/astral-sh/ruff/issues/13696

Oh oops, I thought that had been closed... sorry!


[Bug][Manager] Should update status when agent result was failed

What happened
Should update status when agent result was failed.
What you expected to happen
When agent result was failed, should update task status to FAILED.
How to reproduce
See the code in AgentServiceImpl#updateCommandEntity().
Environment
No response
InLong version
master
InLong Component
InLong Manager
Are you willing to submit PR?

[ ] Yes, I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Pls assign it to me.


File to paste the "import stimulus controllers and register them" into

I'm just checking the usage instructions for esbuild-rails. It doesn't say which file you are supposed to paste the code into. The import hotwired/stimulus code looks like the start of javascript/controllers/application.js . But in the screencast, you pasted just the controller code into the autogenerated file javascript/controllers/index.js.

Import Stimulus controllers and register them:
// app/javascript/ ???
import { Application } from "@hotwired/stimulus"
const application = Application.start()

import controllers from "./**/*_controller.js"
controllers.forEach((controller) => {
  application.register(controller.name, controller.module.default)
})

You can import code in any JavaScript file.
It doesn't matter if you import stimulus controllers on the index.js or the application.js.
The reason I put it in index was that's where rails imports stimulus controllers typically.

Thank you for explaining that to me, Chris. I'm not going to be the only person who wonders if appending code to a file tagged as auto-generated is a good idea.
So I was hoping to update the README to add a filename to make it easier for people using the library, especially as  Rails JS has changed again and esbuild is new to everyone.
// app/javascript/controllers/application.js   <=== add this line or index.js
import { Application } from "@hotwired/stimulus"
const application = Application.start()

import controllers from "./**/*_controller.js"
controllers.forEach((controller) => {
  application.register(controller.name, controller.module.default)
})

...


Sonatype Lift analysis report

BadShiftAmount
Tool: ErrorProne (JDK8)
File: src/main/java/com/github/f4b6a3/ksuid/factory/KsuidFactory.java
Line: 150
Description: Shift by an amount that is out of range
https://github.com/f4b6a3/ksuid-creator/blob/b021ed55e1318638d8af7a6dff267a6cc93f6f3b/src/main/java/com/github/f4b6a3/ksuid/factory/KsuidFactory.java#L150

Released version 1.1.1


Remove old authorization system

After the redis api-keys migration, we can deprecate old authorization system and remove the code related to keeping the old behavior (use public user credentials when no api-key or an invalid one is provided in the request).

Before proceeding:

check new users are created with new Auth API keys (check it with @CartoDB/backend)
Keep the behavior: the absence of API key or a wrong one in the request means that is authenticated as default_public (to no break CARTO.js examples)

Ready to be closed?

Still in development. We will close it when it's deployed


Model Loading Error

System Info
Running latest versions of optimum and transformers.

Running following code from [docs](https://huggingface.co/docs/optimum/onnxruntime/usage_guides/models#export-and-inference-of-sequencetosequence-models):

Get error:

Traceback (most recent call last):
  File "/Users/sid/Personal/sid/src/d.py", line 5, in <module>
    model = ORTModelForSeq2SeqLM.from_pretrained("t5-base", from_transformers=True)
  File "/Users/sid/opt/anaconda3/envs/sid/lib/python3.10/site-packages/optimum/onnxruntime/modeling_ort.py", line 252, in from_pretrained
    return super().from_pretrained(
  File "/Users/sid/opt/anaconda3/envs/sid/lib/python3.10/site-packages/optimum/modeling_base.py", line 232, in from_pretrained
    return cls._from_transformers(
  File "/Users/sid/opt/anaconda3/envs/sid/lib/python3.10/site-packages/optimum/onnxruntime/modeling_seq2seq.py", line 453, in _from_transformers
    export(
  File "/Users/sid/opt/anaconda3/envs/sid/lib/python3.10/site-packages/transformers/onnx/convert.py", line 339, in export
    return export_pytorch(preprocessor, model, config, opset, output, tokenizer=tokenizer, device=device)
  File "/Users/sid/opt/anaconda3/envs/sid/lib/python3.10/site-packages/transformers/onnx/convert.py", line 163, in export_pytorch
    onnx_export(
  File "/Users/sid/opt/anaconda3/envs/sid/lib/python3.10/site-packages/torch/onnx/__init__.py", line 316, in export
    return utils.export(model, args, f, export_params, verbose, training,
  File "/Users/sid/opt/anaconda3/envs/sid/lib/python3.10/site-packages/torch/onnx/utils.py", line 107, in export
    _export(model, args, f, export_params, verbose, training, input_names, output_names,
  File "/Users/sid/opt/anaconda3/envs/sid/lib/python3.10/site-packages/torch/onnx/utils.py", line 724, in _export
    _model_to_graph(model, args, verbose, input_names,
  File "/Users/sid/opt/anaconda3/envs/sid/lib/python3.10/site-packages/torch/onnx/utils.py", line 497, in _model_to_graph
    graph = _optimize_graph(graph, operator_export_type,
  File "/Users/sid/opt/anaconda3/envs/sid/lib/python3.10/site-packages/torch/onnx/utils.py", line 216, in _optimize_graph
    graph = torch._C._jit_pass_onnx(graph, operator_export_type)
  File "/Users/sid/opt/anaconda3/envs/sid/lib/python3.10/site-packages/torch/onnx/__init__.py", line 373, in _run_symbolic_function
    return utils._run_symbolic_function(*args, **kwargs)
  File "/Users/sid/opt/anaconda3/envs/sid/lib/python3.10/site-packages/torch/onnx/utils.py", line 1032, in _run_symbolic_function
    return symbolic_fn(g, *inputs, **attrs)
  File "/Users/sid/opt/anaconda3/envs/sid/lib/python3.10/site-packages/torch/onnx/symbolic_opset9.py", line 1831, in full_like
    value_t=torch.tensor([fill_value], dtype=sym_help.scalar_type_to_pytorch_type[dtype]))
TypeError: 'float' object cannot be interpreted as an integer
(Occurred when translating full_like).

### Who can help?

@lewtun @micha

### Information

- [X] The official example scripts
- [ ] My own modified scripts

### Tasks

- [ ] An officially supported task in the `examples` folder (such as GLUE/SQuAD, ...)
- [ ] My own task or dataset (give details below)

### Reproduction

from transformers import AutoTokenizer, pipeline
from optimum.onnxruntime import ORTModelForSeq2SeqLM
model = ORTModelForSeq2SeqLM.from_pretrained("t5-base", from_transformers=True)

### Expected behavior

Load model from transformers without error

@jafri On my laptop with Optimum 1.4.1, Transformers 4.23.1 and PyTorch 1.12.0 it runs without any error.
Which version of PyTorch and ONNX did you use to run this example? You can get them with the following command: pip show torch onnx.

Name: torch
Version: 1.10.2
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org/
Author: PyTorch Team
Author-email<EMAIL_ADDRESS>License: BSD-3
Location: /Users/sid/opt/anaconda3/envs/sid/lib/python3.10/site-packages
Requires: typing_extensions
Required-by: optimum
Name: onnx
Version: 1.12.0
Summary: Open Neural Network Exchange
Home-page: https://github.com/onnx/onnx
Author: ONNX
Author-email<EMAIL_ADDRESS>License: Apache License v2.0
Location: /Users/sid/opt/anaconda3/envs/sid/lib/python3.10/site-packages
Requires: protobuf, typing-extensions, numpy
Required-by:

On M1 mac, note that the following code works
from transformers import AutoTokenizer, pipeline
from optimum.onnxruntime import ORTModelForSeq2SeqLM

tokenizer = AutoTokenizer.from_pretrained("optimum/t5-small")
model = ORTModelForSeq2SeqLM.from_pretrained("optimum/t5-small")

"optimum/t5-small" is an ONNX model so no conversion is needed. Because the error you reported happened during the conversion to the ONNX format.
I cannot reproduce this error at the moment, I will try on a M1.

Weirdly enough, I was also able to solve the issue by using python 3.10 not inside anaconda

That's weird indeed. I'm glad you managed to solve it!
Shall I close this issue?


⚠ deces.matchid.io search API has degraded performance

In d135bdd, deces.matchid.io search API (https://deces.matchid.io/deces/api/v1/search?q=pompidou) experienced degraded performance:

HTTP code: 200
Response time: 4114 ms

Resolved: deces.matchid.io search API performance has improved in 53ce2c0 after 10 minutes.


Remove upper limit of werkzeug

Checklist

[x] Used a personal fork of the feedstock to propose changes
[x] Bumped the build number (if the version is unchanged)
[x] Reset the build number to 0 (if the version changed)
[x] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[x] Ensured the license file is being packaged.

flask-login added support for werkzeug>=3 in 0.6.3 / https://github.com/maxcountryman/flask-login/pull/813. This PR removes the upper limit.

@conda-forge-admin, please rerender

@m-rossi, thanks for noticing this and for the fix.  Sorry I missed this in the last update.


Base Skyeye Image is pointed at Skyeye Scaler

Describe the bug
Appears the Skyeye Docker Image is actually the scaler image
Steps to Reproduce
docker pull ghcr.io/dharmab/skyeye:latest;docker inspect ghcr.io/dharmab/skyeye:latest
Logs
[
{
"Id": "sha256:cddd7b62c84a25dd02117491619c9612c4ded33a19785782e12e02d659538fde",
"RepoTags": [
"ghcr.io/dharmab/skyeye:latest"
],
"RepoDigests": [
"ghcr.io/dharmab/skyeye@sha256:8ad826e071fe6babb5c0f77f01c8b8069f137aee87a6f5d49fcfe4531742e10c"
],
"Parent": "",
"Comment": "buildkit.dockerfile.v0",
"Created": "2024-09-18T01:36:40.703780488Z",
"DockerVersion": "",
"Author": "",
"Config": {
"Hostname": "",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"Tty": false,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "",
"Volumes": null,
"WorkingDir": "",
"Entrypoint": [
"/opt/skyeye/bin/skyeye-scaler"
],
You can also see it here: https://github.com/dharmab/skyeye/actions/runs/10913949817/job/30291295328#step:3:3139 Where it should be pushing main image.
Platform Info
Not Applicable

Thanks for the report, this is fixed in v0.5.1


feat: add install hooks

This is a draft for install hooks.
Uninstall hooks will require a bit more thought, as currently they aren't saved when the installation happens.

This looks like good way to tackle hooks. Install hooks are easy, will need to work a strategy for uninstall hooks.

Since hooks can change, I'm assuming we want a snapshot of uninstall hooks at the time of installation.
So then, should they just be copied over to the installed theme's config?


Batched kombu consumer

This PR adds support for batch processing of messages in kombu consumer servers.
A typical use case for this would be a queue consumer that has better performance characteristics when performing batched processing, for example if performing a batch of database mutations in a single transaction is significantly faster than performing individual writes.
The KombuQueueConsumerFactory now accepts additional parameters to configure the batch processing. If the batch_size is None (default case), messages are consumed individually, so the behaviour is the same as before. If the batch_size is set, the messages will be processed in batches.
The kombu pump worker class KombuConsumerWorker accepts the same parameters and performs the actual batching. If batch_size is set, it stores new messages in a batch and processes them once the batch_size is reached or a timeout occurs.
The PR also adds a KombuBatchMessageHandler, which handles message sequences rather than individual messages. The KombuQueueConsumerFactory will return the correct type of message handler depending on whether batch_size is set.
The timeout in the KombuBatchQueueConsumer is implemented using a new Timer helper class which internally uses the library schedule to schedule the work. To prevent blocking, the default scheduler is extended to run on a separate thread.
The Timer and KombuConsumerWorker have safeguards in place for requeueing unprocessed messages in the event of a server shutdown or errors during batch processing.

@pacejackson I've made the requested changes. The pump worker is now handling the batching. However, I had to introduce these rather ugly @overload declarations to address the type changes. Do you have an idea how to make this nicer?

In addition to the comments about using separate classes, I think we can simplify things a bit further by putting the actual batch management into it's own object rather than having it be in the pump worker itself:
class BatchedQueue:
    def __init__(self, work_queue: Queue, batch_size: int, flush_interval: timedelta):
        assert batch_size >= 1
        assert work_queue is not None
        self._work_queue = work_queue
        self._batch = []
        self._batch_size = batch_size
        self._flush_interval = flush_interval
        self._flusher = None

    def put(self, data):
        self._batch.append(data)
        if len(self._batch) >= self._batch_size:
            self._flush()
        else:
            self._queue_flush()

    def _flush(self):
        self._flusher.stop()
        self._flusher = None
        batch = copy(self._batch)
        self._batch = []
        self._work_queue.put(batch)

    def _queue_flush(self):
        if self._flusher != None:
            return
        self._flusher = DelayedWorker(delay=self._flush_interval, fn=self._flush)

class DelayedWorker:
    def __init__(self, delay: timedelta, fn: Callable):
        self._delay = delay
        self._fn = fn
        self._stopped = False
        self._thread = threading.Thread(target=self._run)
        self._thread.run()

    def stop(self):
        self._stopped = True

    def _run():
        time.sleep(self._delay)
        if self._stopped:
            return
        self._fn()

    def __del__(self):
        self.stop()

So then the pump consumer is just put-ing the message into a BatchedQueue rather than directly into a queue.Queue, you might even be able to make it easy to pass in one or the other to the same PumpQueue class constructor?
Note, this also would remove the ThreadedScheduler class and the dependency on schedule, and replaces the Timer class with a DelayedWorker object.

Thank you for your recommendations. I've adapted them slightly to be generic and to merged ideas of the DelayedWorker and Timer.
I do think that either the pump worker or the queue consumer should requeue batched messages in this design. Since we didn't want to modify the QueueConsumer class, the PumpWorker seems like the only good option to me.

Sorry for taking 7 months to add the requested changes to this PR ;-)

@spladug Ready to merge ♻

@gfmio it looks like it's failing lint (non-lazy string formatting in a logger call)

@spladug The linter and tests are now all green 💚


Current develop Git Installer is not installable on Debian systems

I would suppose this would apply to all Debian based systems including Ubuntu which surprises me as I know a lot of development is currently ongoing in Ubuntu to begin with but running a GIT installation using ( bin/kalite manage setup) as was working in previous develop installations from a freshly pulled develop branch this morning on the latest debian resulted in a failure with the linked traceback. https://s3.amazonaws.com/uploads.hipchat.com/86198/1302220/PV9hID8syoOeyTT/kalite-setup-traceback.txt

This was fixed in the alpha1 release


[x] Exposes and API for querying App Insights
[x] Replaces ongoing works in #614

WHAT JIRA STORY/TASK IS RELATED TO THIS PR?

Follow instructions in the README.md file
WHICH ENDPOINTS SHOULD BE READY FOR TESTING?:
Get App Insights
IS THERE ANY JENKINS CONSOLE LINK FOR CODE COVERAGE AND BUILD INFO?
None
ARE THERE ANY RELATED PRs?
None

These are some powerful introductions. Thanks @NoahNsimbe However, we might need a team walk through since there are so many changed files. Could you organise some sort of workshops for these PRs with many changed files?

We can have a walk through during one of our standups. I suggest we merge this for now because the next release to production (early next) relies on functionality in here. The changed files are multiple because I am setting up the API


Unable to login

Hi,
my password includes a "ß" and I'm unable to login.
I get this error:
2019-12-01 13:06:49.733 T:2455761776   ERROR: [plugin.video.netflix (3)] Traceback (most recent call last):                                               File "/storage/.kodi/addons/plugin.video.netflix/resources/lib/run_addon.py", line 124, in run                                                 if _check_valid_credentials():                                               File "/storage/.kodi/addons/plugin.video.netflix/resources/lib/run_addon.py", line 90, in _check_valid_credentials                                                 if not login():                                               File "/storage/.kodi/addons/plugin.video.netflix/resources/lib/api/shakti.py", line 45, in login                                                 ui.ask_credentials()                                               File "/storage/.kodi/addons/plugin.video.netflix/resources/lib/kodi/ui/dialogs.py", line 34, in ask_credentials                                                 common.set_credentials(email, password)                                               File "/storage/.kodi/addons/plugin.video.netflix/resources/lib/common/credentials.py", line 106, in set_credentials                                                 g.LOCAL_DB.set_value('account_password', encrypt_credential(password))                                               File "/storage/.kodi/addons/plugin.video.netflix/resources/lib/common/credentials.py", line 32, in encrypt_credential                                                 raw = bytes(Padding.pad(data_to_pad=raw.encode('utf-8'), block_size=__BLOCK_SIZE__))                                             UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 3: ordinal not in range(128)
Any suggestions (yeah.. i can change my password. I mean OTHER suggestions :D)

What is meant with "ignored rules"? What have I ignored?

you didn't follow the rules to publish an issue,
open an "issue" in a right way and it will be accepted


Add new molecules for test

@KarinDuong could you have a look. There are 2 files for the same system: one all-atom and the other one coarse grain.


library: Port to Haiku.

Pretty straightforward. All tests do pass, so this should be good for a merge.

And just accepted the CLA.

@gilles-peskine-arm Sure. Pretty busy the next few days, but I'll get to it in the next week or so, I think.

Gah, I broke the PR. Sorry, I'll make a new one.

Continued in #1567


[openal-soft] Update to 1.20.1

Library name: OpenAL-soft
New version number: 1.20.1
Numerous important changes / fixes:

openal-soft-1.20.1:
Implemented the AL_SOFT_direct_channels_remix extension. This extends
AL_DIRECT_CHANNELS_SOFT to optionally remix input channels that don't have
a matching output channel.

Implemented the AL_SOFT_bformat_ex extension. This extends B-Format buffer
support for N3D or SN3D scaling, or ACN channel ordering.

Fixed a potential voice leak when a source is started and stopped or
restarted in quick succession.

Fixed a potential device reset failure with JACK.

Improved handling of unsupported channel configurations with WASAPI. Such
setups will now try to output at least a stereo mix.

Improved clarity a bit for the HRTF second-order ambisonic decoder.

Improved detection of compatible layouts for SOFA files in makemhr and
sofa-info.

Added the ability to resample HRTFs on load. MHR files no longer need to
match the device sample rate to be usable.

Added an option to limit the HRTF's filter length.

Source: https://github.com/kcat/openal-soft/blob/711c05613eceeda0e02a6c16080f725ff60cb33f/ChangeLog

But it's alreay 1.20.1 since February 10
https://github.com/microsoft/vcpkg/blob/master/ports/openal-soft/CONTROL#L2

Thanks for posting this issue. Port openal-soft has been updated to version 1.20.1 in PR #9986, you can update vcpkg and build it.


Ft crud bus company

What does this PR do?

Create,Read,Update and Delete Bus and Company

Description of Task to be completed?

An admin or operator must be able to do all CRUD function for Buses and Company and view error or success at any attempt and system should have a skelton.

How should this be manually tested?
First clone this project and

checkout on branch

git checkout origin ft-crud-bus-company

next we need to make few change on .env if you don't have if you need to create in on project root

`REACT_APP_BACKEND_URL=http://phantom-api-pirate.herokuapp.com/
this is backend url
or use  backend port to run it locally which is the only way working now

PORT=your_port`

Please rebase with develop and squash commits

The update method for a bus is errornous
Check the update action and verify


Enhance analytics implementation

From sy.zygy#8838 in Discord:
Specific areas to address:
- events (important)
- hash routing (important)
- rollup dashboard (nice to have)
- first-party include (more complete tracking, nice to have)
- Plausible <- Google Search Console integration (nice to have)
- Linking/embedding our Analytics on main site (nice to have)

https://docs.google.com/document/d/1a1olkvrzAYGRY7dWx4if0QV4XaZq7yePuEExEpwE624/edit#heading=h.z2ds9mudpm3g

Need to sync with Tigerlilly about his most high priority data needs.

Let's track outbound links by setting up goals for the following URLs:

discordInvite (please delete contributors invite)
officialDocs
forum
snapshot
-all social media
mediaRequestForm
partnerShipsContactForm
klimaInfinityContactForm
-lifiStake
lifiOffset

closed as we have GA tag manager now, this is in marketing team's hands.


clean cache a little less often

Current dependencies on/for this PR:

main

PR #3245   👈

PR #3246

This comment was auto-generated by Graphite.


Issue 103

https://github.com/awslabs/cfncluster/issues/103

travis seems to be failing, but the error is unrelated to this request.

The cookbook needs some updates for Travis-CI. Your code looks good.

Pulled into develop - https://github.com/awslabs/cfncluster-cookbook/commit/3ee2f3bb60acb685b2597f06c924dc64a48a8b59


Repair the hack to change the meeting constraint names

This addresses Issue 3083.
When setting up IETF meetings, session requests include lists of Constraint instances. Some of these represent conflicts between groups. In the original implementation, three priority levels were allowed. These have ConstraintName slugs conflict, conflic2, and conflic3. Over time, the usage changed to reflect more specific meanings. For meetings 106-110, the UI was superficially modified to give these labels consistent with their use.
This work introduces three new ConstraintName slugs, chair_conflict, tech_overlap, and key_participant and modifies the UI to handle both old and new constraints. Old Constraint objects are migrated to use the slugs that correspond to what the UI showed when they were created.
Future work to address Issue 2770 will further refine this by allowing individual meetings to be configured to use certain ConstraintName instances. A few corners are cut here, anticipating that they will be squared away by that project.

I missed a couple of places where the new constraint types were not being handled: the old agenda editor and the schedule generator. The old agenda editor is hopefully being phased out, possibly for the upcoming IETF meeting, but is still occasionally used. Since this is nearly dead code, I've tried to keep the old behavior rather than handle the new features well.
The schedule generator will still be used, but was a much simpler fix.

Changes committed - back to you.

Oops - found a few failed tests. All passing now (except for a nomcom related one that has been fixed on the trunk and will be picked up when I rebase)

Committed to svn as r19103


How to set minValue for the date picker component

Am trying
 <DateTimePicker               minValue={new Date()}               showClearButton={false}               onJsDateChange={(date) => field.onChange(date)}             />
but am getting
Type 'Date' is not assignable to type 'DateValue | undefined'.
What is that DateValue type ?

DateValue is from react-aria.
https://react-spectrum.adobe.com/react-aria/DatePicker.html

Hi,
I found that react-aria is difficult to maintain and not easy to get started with. For those who are new to it, it takes too much time to go through the documentation and still find it hard to modify. Later, I discovered the time-picker created by openStatus.
Therefore, I rewrote the entire datetimePicker. Although the input method is not as fancy as react-aria, the maintainability should be much better.
Since it has been completely rewritten, the existing issues will be closed.
You can visit datetime-picker to get the new one.
Thank you for your understanding and use.


Invert logic - user now must take action to exclude_interventions on

import.

It'd be good to include this - makes updates (like we have for Truenth interventions) happen by default.  It's a far more rare event that we need to capture 3rd party intervention changes.


Which resource jar from Meaven  can I see the real source code?

If I only add 1.4.8.jar,I can't see the source code,what sould I do? Help me plz...
Develop tools is Eclipse...

@MIkeeJY this is not general issues forum, also use Maven for dependency tracking, or download all the jars from the maven (there are jars for source, binary and javadoc). Questions like this belong to stackoverflow.com

Thx man,I've already solved it


TAJO-1552: NPE occurs when GreedyHeuristicJoinOrderAlgorithm.getCost() returns infinity

This patch is based on #547.
Changes are:

Rebasing the work of  #547
Removed an unnecessary test
Added a FAKEFILE store type for test

LGTM +1
You can reflect my trivial comments before committing it.

Thanks for your review!


getReport2 returns incorrect numbers for metrics/pageviews.

getReport2 returns incorrect numbers for metrics/pageviews. These do not match the Adobe portal. getReport returns numbers that do match the Adobe portal.

This is not a helpful description.
Can you provide the steps that create the issue.
Anything that you could share is helpful

Investigating into this, I found the same issue.

getReport2 returns:

Checking the raw response from analytics server, the problem is coming from the Analytics server.
You would need to open a ticket with Customer Care for this:
Here is a screenshot of that request:

It would be best if you reproduce that yourself in your enviornment and send that detail in the ticket.
I'll close it later.

Hi @pitchmuc, since this metric returns successfully for getReport, I thought it was an issue with aanalytics2. Any idea why it works for the getReport method but not getReport2? I'll gladly submit a customer care ticket but I'm not exactly sure what to say since it's not an issue with the Adobe portal. Thanks!

Sorry for some reason I miss that it was working for getReport.
I will check why it is working good for getReport but not getReport2...
In the backend, I am using the same endpoint, so maybe so request modification happen but strange that it is only impacting one metric.

I found out, it is a bug of a sort.
It is due to the configuration, I am not keeping the parameter you are using for these options:

nonesBehavior
countRepeatInstances

I override them by the default configuration.
But if you are doing that:
data1 = ags.getReport('pageview_request.json')
data2 = ags.getReport2('pageview_request.json',countRepeatInstances=True,returnsNone=True)

It should provide you the same result.
I willl fix it and keep the one set in your JSON and not override them, except if you want to.
Sorry for that, fix is going live today.


feat: Render components from layout object

I need to know the list of all the components which the user can pick from when declaring the layout. Also, I didn't get what was the component BlueBackground in the example of the layout provided.
I couldn't find a way to have a dynamic types for the properties.

We will have the default components that are managed by the map you did but we should plan also some external components that are given to the layout manager.
Please add property that allows this and create the following dummy components:

BlueBackground (a div with a blue background)
RedBackground (a div width a red background)
...

How did you do to test that it works ? There is no storybook ?
Please add in the storybook a new category 'layout' that display the result of the example.

Please also check the CI tests. 2 are failing.


Fix token value autosize

Why does this PR exist?
Fixes #2721

What does this pull request do?

If users try to enter something like a long linear-gradient value and the value goes quite wide, the text input currently is not big enough to make sense of anything. Let's find a way where the input grows in height when users enter more.

MentionsInput height CSS is changed to auto; MentionsInput already has the autosize prop passed to it.

We need to watch out for the prepending and appending button to the left so that those are still displayed correctly (likely vertical alignment top)

Handled by adding height: auto CSS to <StyledPrefix ... />. The prefix is automatically vertically aligned to the center.

Testing this change

Open Tokens Tab
Scroll down to Typography
Create a Token with a very long name
Click + (Add New Token)
Under the Typography fields, try entering very long values – verify that the input textarea expands to multiline
Change to Reference Mode
Click the dropdown button, or mention the very long Typography token by typing { to bring up the mention dropdown
Verify that the input textarea expands to multiline

Additional Notes (if any)

Before
After

Looks good 🚀


Django lts upgrade

Coverage increased (+0.08%) to 90.412% when pulling 6a37317bd64f8806c845c0082b7c4dc8532c2ba9 on akatsoulas:django-lts-upgrade into 9443519b74371a157f315f8a623af44f0bbef5a2 on mozilla:master.


Add Inkscape

Merged to: https://github.com/juno-fx/Terra-Official-Plugins/tree/pack-additional-software
Closing.


fix(test): v2 searchable aggregate test

Fix for Searchable v2 flaky test.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report

Merging #8214 (6c6264f) into master (f5a92e3) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #8214   +/-   ##
=======================================
  Coverage   54.42%   54.42%
=======================================
  Files         663      663
  Lines       37834    37834
  Branches     7772     7772
=======================================
  Hits        20590    20590
  Misses      16404    16404
  Partials      840      840

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2eeb994...6c6264f. Read the comment docs.

Followed a different approach to make sure the data propagation is complete.
https://github.com/aws-amplify/amplify-cli/pull/8251


Qubole s3 optimization

Fixes minor bugs in S3 optimization.

@ashwanthkumar - Just confirming, Is this ready to be merged?

It's been quite some time, I would like to do a couple of runs on the qubole with these changes and then merge them. We should also update the versioning scheme to something like v2.x since this might break on our current cluster. Thoughts?

Fair enough
On Mon, Mar 23, 2015 at 7:05 AM, Ashwanth Kumar<EMAIL_ADDRESS>wrote:

It's been quite some time, I would like to do a couple of runs on the
qubole with these changes and then merge them. We should also update the
versioning scheme to something like v2.x since this might break on our
current cluster. Thoughts?
—
Reply to this email directly or view it on GitHub
https://github.com/ind9/dfs-datastores/pull/1#issuecomment-84745829.


OnClick event missing?

Just wondering; Is there an onclick event that happens when you click the toastr that you can add custom logic to it? I don't see anything like that on the docs. Thanks!

Yes, you can use onHidden which receives a parameter to see whether it was via click or via timeout.
I will leave this open because it is not that clear.


Issue #6 - window.URL is not defined

Pull URL declaration into module.exports to squash node complaining about window object.

Thanks for the patch! Merged in 1.0.2.


run error

**********/helper/SimpleItemTouchHelperCallback.java
Error:(34, 8) error: cannot access ScrollingView
class file for android.support.v4.view.ScrollingView not found
Error:(44, 5) error: method does not override or implement a method from a supertype
Error:(49, 5) error: method does not override or implement a method from a supertype
Error:(54, 5) error: method does not override or implement a method from a supertype
Error:(57, 25) error: cannot access NestedScrollingChild
class file for android.support.v4.view.NestedScrollingChild not found

i have got the reason , the library in my project has conflict. i fix the conflict ,the problem has resolved


Command line code generation gives no output

The section https://github.com/microsoft/fhir-codegen#fhir-codegen-cli tells me:

To run this project from a command line:
dotnet run --project src/fhir-codegen-cli/fhir-codegen-cli.csproj -- [options]

However, running dotnet run --project src/FhirCodeGenBlazor/FhirCodeGenBlazor.csproj -- -p hl7.fhir.r4.core#4.0.1 --language TypeScript --output-path ~/R4.ts does not seem to generate any file.
As reported on https://chat.fhir.org/#narrow/stream/179171-dotnet/topic/Microsoft.20fhir-codegen-cli/near/383004416

Gino stated

As for the command line arguments, the UI will ignore them.

Is this not how I'm supposed to run command line arguments?

The command line arguments are for the CLI application, not the web-UI.  I will add a task to update the documentation, as well as look into what arguments make sense for the UI.


Kenny/small sm fixes

Ignore temporary output value. Handle as normal value + ignore temporary condition

rule foo:
    output:
        bam = temp("{sample}.unmapped.bam")

Ignore global ruleorder. Currently crashes if present in snakefile, - allow workflow to run as normal and avoid

ruleorder: call_consensus_reads > fastq_to_ubam

kinda weird to just ignore ruleorder, seems like it would break a lot of workflows?

(moving here so there is a record). Rule order is still used to construct the DAG in the jit step. The code here ignores the useless reference of Ruleorder object in the context of executing an isolated job


Add env var hiding android

This PR allows us to apply simple xor encryption and base64 encoding to env vars before they are injected into the BuildConfig by react-native-config during build time.
Before the xor encrypted vars are bridged to react native they are decrypted, so no decryption needs to be done in react native.
However for env var use in the android java/kotlin native layer, the app needs to define a decryption method. Sample is available in ../Example/android/app/src/main/java/com/example/ReactNativeConfigUtils.java
An array of encrypted vars can be found in BuildConfig.ENCODED_KEYS. An app trying to decrypt an env var may check if the env var's name is contained in its BuildConfig.ENCODED_KEYS before decrypting.

Before
After

Can you use a draft PR until it's ready to review? 🤔

Sorry about the noise. I actually felt it was ready. I don't know why the action is unable to build folly inside the Example app. Folly's bunch of cpp code and VS on windows are two mysteries to me that I don't even know to approach it. 😩

good job 🎉 , I left few minor comments we can merge once you address them and check the build failures

🛳🛳🛳

Make sure to make a PR on eigen with the new version of this dep! 🙌


Adding basic algorithms to python folder

Is your feature request related to a problem? Please describe.
I can't find basic algorithms and proper readme.md files.
Describe the solution you'd like
Could you assign me the recursion and arrays part? I can contribute to it.
Additional context

Recursion -> Factorial, fibonacci series, sum of list
Arrays -> Index an element, frequency dictionary, max/min/avg/sum/median/mode calculator, and other algorithms.

Count this under ssoc 23.

What do you mean by Basic Algorithm

I mentioned in Additional context.

You have mentioned multiple algorithm, kindly raise issue pertaining to one algorithm

Then I will do all the mentioned algorithms.

@Kumar-laxmi Check once again I will do all the mentioned algorithms.

@KOMNOOB You can work on Fibonacci Series using Dynamic Programming in all four languages

You can change the Issue title to Fibonacci Number and change the issue description as well

Assigned!
@KOMNOOB : C, C++, Python & Java


Motion resent101

Hi,
Thanks a lot for providing the open-source code!
     May I ask how did you get your pre-trained motion ResNet101? It's pre-trained on ImageNet and fine-tuned on UCF101 or the just changing the channels of the model trained on ImageNet?

      Highly appreciate your time and help!

Hi,
I utilize the cross-modality pretraining technique to transfer the weight of model pretrained on ImageNet to fit the motion ResNet101. The details are described in Readme!
Sincerely,
Jeffrey

Hi,
Thanks for the good question!! I utilize the cross-modality pretraining technique to transfer the model weight pretrained on ImageNet to fit the motion ResNet101. The details are described in Readme!
Sincerely,
Jeffrey

Hi Jeffrey,
       Thanks a lot for your kind and quick reply. The channels in the RGB and optical flow stream are different, how did you fit the pre-trained ImageNet model to the optical flow stream? Do you have the code to load the ImageNet pre-trained model to optical flow stream?

       Highly appreciate your time and help!

Hi,
Please refer the link below to see my implementation details of cross-modality pretraining method!
https://github.com/jeffreyhuang1/two-stream-action-recognition/blob/master/network.py#L216
Jeffrey

Great! Thanks a lot!


support typescript

please check it
feat/typescript

[x]  support @elf-framework/*  types
[x]  support tsx, mdx
[x]  support to generate meta files automatically
[x]  support jsx-runtime for typescript types

타입스크립트 지원 완료


Doesn't seem to work with GitLab

I used to use git-blame pretty frequently with my GitLab-backed project, but as of last week it no longer works. I've tried adding a custom remote repo URL, but still no luck. Any idea why it's not working?

Probably you're running into #174 which is resolved in 1.0.2

@annabel can you confirm that this is still an issue in v1.0.2?

Yep, it works now! Thanks!
Any chance you're considering adding GitLab as one of the default remote repos? 😄


Enable to add some basic logic to config file

I would like to be able to tweak the config based on some logic. My concrete use case is with the introduction of --reject-unauthorized/--no-reject-unauthorized. Depending on an env variable presence I need to disable SLL (used for local environment etc.) but when not here I want to set ssl with rejectUnauthorized: false. I end up having to write a script like:
const ssl = process.env.SSL_DISABLE !== "true";

runner({
  migrationsTable: "pgmigrations",
  dir: resolve(__dirname, "migrations"),
  direction: "up",
  count: Number.POSITIVE_INFINITY,
  verbose: false,
  databaseUrl: {
    connectionString: process.env.DATABASE_URL,
    ssl: ssl ? { rejectUnauthorized: false } : false,
  },
})

If I could have a config.js (instead of only .json), I could then write:
const ssl = process.env.SSL_DISABLE !== "true";

export default {
  db: process.env.DATABASE_URL,
  ssl: ssl ? { rejectUnauthorized: false } : false
}

Would you consider something like that?

The file specified by -f flag is required(...) so .js files should work.
The format of that file should be e.g.:
const ssl = process.env.SSL_DISABLE !== "true";

module.exports = {
  url: {
    connectionString: process.env.DATABASE_URL,
    ssl: ssl ? { rejectUnauthorized: false } : false,
  },
}


Add flutter example for macOS and add macOS instructions in README

Thanks for the code! Could you please add a few lines in the GitHub CI tests (e.g. near https://github.com/fzyzcjy/flutter_rust_bridge/blob/5c65b17be0a7c0322e7f422fc582690c893ab545/.github/workflows/ci.yaml#L181 ), such that we can be pretty sure in the future this feature does work ;)

@all-contributors please add @AlienKevin for code

@all-contributors please add @AlienKevin for code

@all-contributors please add @AlienKevin for code

@all-contributors please add @AlienKevin for code

do not worry that failed ci of android. with a re-run it will highly possibly be ok.

I added the tests, but am not sure whether it works or not. Also, the macOS versions provided by GitHub workflow are limited to Big Sur 11 and Catalina 10.15. I have only tested on my Monterey 12, though it might at least work on Big Sur I hope.

I added the tests, but am not sure whether it works or not. Also, the macOS versions provided by GitHub workflow are limited to Big Sur 11 and Catalina 10.15. I have only tested on my Monterey 12, though it might at least work on Big Sur I hope.

Thanks!

The tests for macOS failed probably because the build failed. Are there any dependencies I missed?
[  +24 ms] ld: warning: directory not found for option '-L/Users/kevin/development/dart/flutter_rust_bridge/frb_example/with_flutter/rust/target/x86_64-apple-darwin/debug'
[   +1 ms] ld: library not found for -lflutter_rust_bridge_example
[        ] clang: error: linker command failed with exit code 1 (use -v to see invocation)
[   +7 ms] ** BUILD FAILED **
[        ] The following build commands failed:
[        ] 	Ld /Users/runner/work/flutter_rust_bridge/flutter_rust_bridge/frb_example/with_flutter/build/macos/Build/Products/Debug/with_flutter.app/Contents/MacOS/with_flutter normal (in target 'Runner' from project 'Runner')
[        ] (1 failure)

Hmm

ld: warning: directory not found for option '-L/Users/kevin/development/dart/flutter_rust_bridge/frb_example/with_flutter/rust/target/x86_64-apple-darwin/debug'

What about use ls or similar commands to examine the whole target folder, then we can see whether it contains dylibs or not

In addition, when your script calls Rust's build system, try to make it verbose (e.g. -vv). Then you will see a lot of log about it.

When using your own computer, do you build the rust lib manually (before running flutter run)? If so maybe it is also needed in this CI script

When using your own computer, do you build the rust lib manually (before running flutter run)? If so maybe it is also needed in this CI script
I had to set up dylib config in Xcode and after that just do flutter run as usual.

I'm not aware of any automated scripts that add a dylib to Xcode configuration so I have always done it manually in Xcode.

Then it may be caused by this? i.e. CI does not have this step.

I'm not aware of any automated scripts that add a dylib to Xcode configuration so I have always done it manually in Xcode.

Then it may be caused by this? i.e. CI does not have this step.

Yeah, I'm pretty sure CI doesn't have this step. I saw that the Linux test case is temporarily disabled. Can we disable the macOS tests for now and merge the PR, since the steps involved are quite complicated?

All right...

@all-contributors please add @AlienKevin for doc


Refactor full_page_writes tracking in xlog.c like the other wal-logged params.

Current full_page_writes setting is recorded in the control file, as part of the checksum.  I think they're handled differently because of historical reasons, so it would be nice to refactor full_page_writes to be handled the same as the other settings, for simplicity.

Status: needs to be re-evaluated.
Will be useful for upstream, the current implementation is not very good.


Souda

git-lfs-darwin-386-1.5.5.tar.gz
Requirements

Filling out the template is required. Any pull request that does not include enough information to be reviewed in a timely manner may be closed at the maintainers' discretion.
All new code requires tests to ensure against regressions

Description of the Change

Alternate Designs

Why Should This Be In Core?

Benefits

Possible Drawbacks

Applicable Issues

Style so that we can: display a summary of the failure of all tests throughout the test.


[Event Request] Report 4 Detail Trial Balance - OnPreDataItemSetEntryNoFilter

Hi Team,
In Report 4 we need possibility to have our additional checks . Having event in the trigger OnPreDataItem, would be a perfect solution :

[IntegrationEvent(false, false)]
local procedure OnPreDataItemSetEntryNoFilter(var "G/L Entry": Record "G/L Entry")

Hi @MantasGurinas . Could you clarify what is the GLEntryNoFilter variable? I cannot find it in the report.

Hi @RomanZanizdra , i made adjustments, GLEntryNoFilter is removed.

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. We will update this issue with information about availability.


Implement Expense API

Operations:
CRUD
Model:
name amount date category
All fields are REQUIRED
Must be managed by admin.
Can be accessed by any one.
List endpoint must allow filtering using a start and end dates.


Identity

BYOid Trustable Identity Project
SSO with SSI (Single Sign On with Self Sovereign Identity), implementing user controlled universal aggregated identity as the basis for BYOid, using IoP, OpenID, WebID, ethereum uPort, social logins, etc.
Collaborations: RChain.coop, DivvyDAO.org -> diglife.com, giveth.io, cocloud.coop, sovrin.org, movim.eu, solid, consensys, ….
Meeting time: Saturdays 01:00 PM UTC, New York -4, , Seattle -6, Amsterdam +2
Screen: https://zoom.us/j/6853551826

Thanks for commencing the epic HJ. This project is in an early concept phase. Working on a user story, almost ready for collaborative retelling (aka refactoring, but for stories).

This could be useful, at least for signing in to a blockchain component of a larger infrastructure:
https://hackernoon.com/never-use-passwords-again-with-ethereum-and-metamask-b61c7e409f0d

today's byoid meeting log, video

@lapin7 @kitblake
Would the Decentralized Identity Foundation project/consortium be of interest? Makes sense to be aware of the standardization work as it develops. I spoke to the Consent team, interesting work being done.

@kdvalentine Absolutely.  RChain Holdings will need solutions in both self-sovereign and attestation-based identity, so I'm keenly interested in these topics.

@kdvalentine Thanks, that looks totally on target.
There's so much momentum in this space that it's hard to keep up with. Whichever project or solution moves to the front, we'll want to integrate with it. Our little, local identity project has to be temporary infrastructure, built with the intention to swap connectors, components, etc.
Consent looks good too. I see they're in London. And it's "Built on the Ethereum Blockchain.", nice.

Just checked in an initial user story. Here's the rendered version:
https://github.com/rchain/Members/wiki/Identity-Project-user-story
Critique welcome..

I think there's a lot more going on then it seems. The issue is in progress with @jimscarver @kitblake @kdvalentine

2017-12-30
Jim, Gary, Raymond Powell, Kit, Gurinder, Rao
Topics (likely not all items will be completed today - some are future ToDo)

Understand Raymond Powell’s (Holochain) requirements, use cases and relationship to DID and Directory service

Node.js? javascript?

Get Rchain requirements in (Kit Blake?)

Explore funding possibilities, including from Holochain, to meet their requirements

Explore technical architecture rethink based on the above.

Document use cases initially targeted.

DID - Social Ledger mapping document (for different use cases? Different persona?).

Raymond: New Earth collective requirements -- build organically and allow it to emerge.
Temporarily centralized means of authentication - across all projects - OAuth or OpenID based solution. Holochain as true distributed decentralized data layer eventually (both groups agree on the distributed and decentralized). Wants to roll out something in the next week or two - OAuth or OpenID service ? Centralized gateway temporarily is OK as long as distributed decentralized can be implemented over time. Holochain core is developed in Golang, apps in Javascript (or any language eventually). Rchain - ScalaJS.  As a first step, New Earth want to become an IDP so their ID can be used to log into multiple applications used by the members.  Jim says no certified OAuth IDP providers in Javascript?
Architecture Description: Decentralized identity for an entity, in the control of that entity (how does this work for non-individual entities?) .  Allows users to choose what they require for something to act as them on the network through UMA2.0.  Current OpenID has some centralized service discovery (?) .  OpenID does not enforce that you have trusted ID providers, though most individuals have such.  e.g.Solid.mit.edu HAE of 1 ? etc. can still leverage OpenID. Holochain brings the trustlessness of blockchain into this conversation.  Rebooting the web of trust + IIW (source of OAuth and OpenID) are source of DID. We’re currently not building the full decentralized directory right now but a standards compliant DID directory that can be leveraged in a full decentralized world.
Currently we use Mattermost as IDP in our applications, so we need not develop a separate IDP.  solid.mit.edu is a potential IDP to use - it supports webID also?
Action Item:  Evaluate Express or other node.js based provider for immediate baby step?? Jim thinks there may be good PHP solutions?
Funding:  Holo is asset backed currency = backed by computational and data storage .. They want to stay in sync with that. Fund raiser far exceeded expectations .. $2M available now to $10 M with additional raise.  $25M max. Ico. would be available.  Developer funds may be available. Roll out funding iteration for distributed Distributed decentralized Identity/DPKI is a key initiative in Holochain with funding.
ToDo:
Schedule weekly peer learning sessions with Raymond and other HC resources on HoloChain development, with initial goal of putting DID directory on Holochain.
Rao and Gurinder join Holochain channel on MM to read up on Holochain development docs.  DPKI is itself a Holo app on top of HC.  Discovering the public key by itself works only if you are entirely in HC?.  Initial task -- extend DPKI mixin and app(in the sense it has its own set of nodes etc.) to implement DID to make it work with any other decentralized DID structure, including uport (ethereum), RChain etc.  Can we use the DID reference implementation to enable this in whatever is available now?  There are a number of DID implementations that even work off of HTTP..
Easy part -- How would some other service authenticate hc id?
Problem - HC app itself may need to make the calls to various like uport etc.   Would running Solid on HC make sense?  How to make the bridging of various HC apps to DPKI, since it will be most bridged app?
2017-12-28
Jim, Rao, Gurinder. (continued from noob log

Update Architecture document

Basic DID PHP script with unix file backend

https://github.com/fire015/flintstone
http://morris.github.io/microdb/
Update php https://www.digitalocean.com/community/tutorials/how-to-upgrade-to-php-7-on-centos-7
https://firebase.googleblog.com/2017/10/introducing-cloud-firestore.html
https://firebase.google.com/docs/auth/
https://firebase.google.com/docs/firestore/data-model
https://github.com/firebase/snippets-web/blob/master/firestore/test.firestore.js#L154-L155
https://github.com/GoogleCloudPlatform/google-cloud-php-firestore
https://github.com/googlecloudplatform/google-cloud-php
https://github.com/firebase/snippets-web/tree/master/firestore

PHP OAUTH login to mattermost

Saturday Open Meeting 2017-12-23
Rao, Jim, Gurinder
Add topics anywhere is list:

Frustrations, excitements and/or meeting expectations round

Rao: get up to speed on current thinking, components
Gurinder: wanting time to get things started,
Jim: Great +ve: Art Brock took guide role in holochain DKPI - identity channel

Complete rchain membership for funding. Join diglife and holochain  for cooperation

Architecture diagram

Subutai
Cloudron on top of Subutai? When? How? Who? -- John Grant, Jochim, jim w ?
Initially BYOID should allow access to Social Ledger domain in Chat.divvydao.net, rchain.divvychain.net (to be moved to its own), chat.holochain.net, chat.letssystem.com (direct spin-off from Digitallife collective -- developing token exchange?)
Bridges between channels share activities across channels.
BYOID supports Social Ledger
Distributed OAUTH draft proposal from Amazon https://tools.ietf.org/id/draft-hardt-distributed-oauth-00.html  may be relevant as an implementation model.

Know yourself

Review of last week's topics

Saturday 2017-12-16
Gary, Jim, Tristen Roberts,

Holochain/rchain/social ledger identity,
Tristen setting up meeting with christopher allen and others will report in holochain DPKI channel
Planning oauth for social ledger
No video today

Saturday 2017-12-09
Jim, Gary, Kit, MZZ, bot

Oauth integration universal SL SSO

Store tokens in cookies and oauth cache oe firebase encrypted
Ledger webhook landing page per MM server.
discord/telegram oauth

/dig id UMA2.0 functionality

Holochain identity

App: DPKI-Identity channel (holo team invite), github
The Agent-Centric Web of Trust
DID DNS on holochain.

Dependant on Anchor GET functionality.

Thursday 2017-12-07
Leah, jim
Know yourself planning, BYOID team  vs. RChain identity channel.
Wednesday 2017-12-06

Holochain sprint bridge?

Id coop on DID directory
John in chat: fernanda from village lab will also connect online. at 3.30 or 4 (GMT) webinar engagement would be great

Oauth aggregation

Metamaps authentication

/dig id

Saturday 2017-12-02
Jim, kit, gary, John Kellas, MZZ

A prerequisite is a distributed identifier directoryhttps://w3c-ccg.github.io/did-spec/ which is not specific to the social ledger, holochain or rchain etc. DNS of DIDs

Firebase /dig
Holochain
Decentralized DNS
PGP key directories
uPort
Other?

John kellas - https://visual.tools/

Holochain cooperation on the social ledger and metamaps,

Oath aggregation, 1st mattermost.

Scribe, /dig team in BYOID?

What is exposed is part of the social ledger and everything on the social ledger is part of your identity and reputation.

we can control our identities on every level everywhere that we might control the destiny of our personna in our associations
Hubot https://hubot.github.com/