[Feature] Support insert overwrite

What type of PR is this：

[ ] bug
[x] feature
[ ] enhancement
[ ] others

Which issues of this PR fixes ：

Fixes #4798
Problem Summary(Required) ：

Support insert overwrite for OlapTable. use as following:
insert overwrite tableA select xxx from tableB;
insert overwrite tableA partitions(p1, p2) select xxx from tableB;
The design idea is create mirror temporary partitions and load new data into the temporary partitions. when all data is loaded, swap temporary partitions and original partitions.
The core points are:

modify OlapTable meta of UNPARTITIONED table to support to add temporary partitions
the atomicity of load. when the insert failed, should remove the temporary partitions created
the editlog and serialization to data persistence
the concurrent control between insert into and insert overwrite. now just mutual exclusion is used.

Please change the title and obey the rule.

Please change the title and obey the rule.

Can you give the rule's Link? I'm not sure where can I find it.

[FE PR Coverage check]
:disappointed: fail : 166 / 569 (29.17%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/catalog/OlapTable.java
0
13
00.00%

:large_blue_circle:
com/starrocks/persist/InsertOverwriteStateChangeInfo.java
0
17
00.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobRunner.java
1
202
00.50%

:large_blue_circle:
com/starrocks/persist/EditLog.java
0
10
00.00%

:large_blue_circle:
com/starrocks/journal/JournalEntity.java
0
6
00.00%

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
3
56
05.36%

:large_blue_circle:
com/starrocks/common/util/RangeUtils.java
1
4
25.00%

:large_blue_circle:
com/starrocks/qe/StmtExecutor.java
9
36
25.00%

:large_blue_circle:
com/starrocks/analysis/InsertStmt.java
4
12
33.33%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJob.java
13
32
40.62%

:large_blue_circle:
com/starrocks/sql/analyzer/InsertAnalyzer.java
2
4
50.00%

:large_blue_circle:
com/starrocks/persist/CreateInsertOverwriteJobInfo.java
10
15
66.67%

:large_blue_circle:
com/starrocks/sql/common/MetaUtils.java
8
11
72.73%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobManager.java
102
137
74.45%

:large_blue_circle:
com/starrocks/planner/OlapTableSink.java
5
6
83.33%

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
2
2
100.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobState.java
6
6
100.00%

run starrocks_fe_unittest

run starrocks_fe_unittest

[FE PR Coverage check]
:disappointed: fail : 166 / 564 (29.43%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/catalog/OlapTable.java
0
13
00.00%

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
0
38
00.00%

:large_blue_circle:
com/starrocks/persist/InsertOverwriteStateChangeInfo.java
0
17
00.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobRunner.java
1
202
00.50%

:large_blue_circle:
com/starrocks/persist/EditLog.java
0
10
00.00%

:large_blue_circle:
com/starrocks/journal/JournalEntity.java
0
6
00.00%

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
3
13
23.08%

:large_blue_circle:
com/starrocks/common/util/RangeUtils.java
1
4
25.00%

:large_blue_circle:
com/starrocks/qe/StmtExecutor.java
9
36
25.00%

:large_blue_circle:
com/starrocks/analysis/InsertStmt.java
4
12
33.33%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJob.java
13
32
40.62%

:large_blue_circle:
com/starrocks/sql/analyzer/InsertAnalyzer.java
2
4
50.00%

:large_blue_circle:
com/starrocks/persist/CreateInsertOverwriteJobInfo.java
10
15
66.67%

:large_blue_circle:
com/starrocks/sql/common/MetaUtils.java
8
11
72.73%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobManager.java
102
137
74.45%

:large_blue_circle:
com/starrocks/planner/OlapTableSink.java
5
6
83.33%

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
2
2
100.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobState.java
6
6
100.00%

[FE PR Coverage check]
:disappointed: fail : 177 / 571 (31.00%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/catalog/OlapTable.java
0
13
00.00%

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
0
38
00.00%

:large_blue_circle:
com/starrocks/persist/InsertOverwriteStateChangeInfo.java
0
17
00.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobRunner.java
1
196
00.51%

:large_blue_circle:
com/starrocks/persist/EditLog.java
0
10
00.00%

:large_blue_circle:
com/starrocks/journal/JournalEntity.java
0
6
00.00%

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
3
13
23.08%

:large_blue_circle:
com/starrocks/common/util/RangeUtils.java
1
4
25.00%

:large_blue_circle:
com/starrocks/qe/StmtExecutor.java
11
40
27.50%

:large_blue_circle:
com/starrocks/analysis/InsertStmt.java
4
12
33.33%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJob.java
13
32
40.62%

:large_blue_circle:
com/starrocks/sql/analyzer/InsertAnalyzer.java
4
6
66.67%

:large_blue_circle:
com/starrocks/persist/CreateInsertOverwriteJobInfo.java
10
15
66.67%

:large_blue_circle:
com/starrocks/sql/common/MetaUtils.java
8
11
72.73%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobManager.java
102
137
74.45%

:large_blue_circle:
com/starrocks/planner/OlapTableSink.java
5
6
83.33%

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
2
2
100.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobState.java
5
5
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/DeleteAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/UpdateAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/AnalyzeStmtAnalyzer.java
4
4
100.00%

[FE PR Coverage check]
:disappointed: fail : 278 / 576 (48.26%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/qe/StmtExecutor.java
0
40
00.00%

:large_blue_circle:
com/starrocks/journal/JournalEntity.java
0
6
00.00%

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
2
13
15.38%

:large_blue_circle:
com/starrocks/persist/EditLog.java
2
10
20.00%

:large_blue_circle:
com/starrocks/common/util/RangeUtils.java
1
4
25.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobRunner.java
49
196
25.00%

:large_blue_circle:
com/starrocks/analysis/InsertStmt.java
4
12
33.33%

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
23
43
53.49%

:large_blue_circle:
com/starrocks/sql/analyzer/InsertAnalyzer.java
4
6
66.67%

:large_blue_circle:
com/starrocks/persist/CreateInsertOverwriteJobInfo.java
10
15
66.67%

:large_blue_circle:
com/starrocks/persist/InsertOverwriteStateChangeInfo.java
12
17
70.59%

:large_blue_circle:
com/starrocks/sql/common/MetaUtils.java
8
11
72.73%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobManager.java
102
137
74.45%

:large_blue_circle:
com/starrocks/planner/OlapTableSink.java
5
6
83.33%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJob.java
29
32
90.62%

:large_blue_circle:
com/starrocks/catalog/OlapTable.java
12
13
92.31%

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
2
2
100.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobState.java
5
5
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/DeleteAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/UpdateAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/AnalyzeStmtAnalyzer.java
4
4
100.00%

[FE PR Coverage check]
:disappointed: fail : 324 / 576 (56.25%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
3
13
23.08%

:large_blue_circle:
com/starrocks/common/util/RangeUtils.java
1
4
25.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobRunner.java
49
196
25.00%

:large_blue_circle:
com/starrocks/persist/EditLog.java
4
10
40.00%

:large_blue_circle:
com/starrocks/analysis/InsertStmt.java
6
12
50.00%

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
23
43
53.49%

:large_blue_circle:
com/starrocks/qe/StmtExecutor.java
26
40
65.00%

:large_blue_circle:
com/starrocks/sql/common/MetaUtils.java
8
11
72.73%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobManager.java
102
137
74.45%

:large_blue_circle:
com/starrocks/sql/analyzer/InsertAnalyzer.java
5
6
83.33%

:large_blue_circle:
com/starrocks/planner/OlapTableSink.java
5
6
83.33%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJob.java
29
32
90.62%

:large_blue_circle:
com/starrocks/catalog/OlapTable.java
12
13
92.31%

:large_blue_circle:
com/starrocks/persist/CreateInsertOverwriteJobInfo.java
14
15
93.33%

:large_blue_circle:
com/starrocks/persist/InsertOverwriteStateChangeInfo.java
16
17
94.12%

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
2
2
100.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobState.java
5
5
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/DeleteAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/UpdateAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/AnalyzeStmtAnalyzer.java
4
4
100.00%

:large_blue_circle:
com/starrocks/journal/JournalEntity.java
6
6
100.00%

run starrocks_fe_unittest

[FE PR Coverage check]
:disappointed: fail : 341 / 569 (59.93%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
3
13
23.08%

:large_blue_circle:
com/starrocks/common/util/RangeUtils.java
1
4
25.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobRunner.java
61
195
31.28%

:large_blue_circle:
com/starrocks/persist/EditLog.java
4
10
40.00%

:large_blue_circle:
com/starrocks/analysis/InsertStmt.java
6
12
50.00%

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
23
43
53.49%

:large_blue_circle:
com/starrocks/qe/StmtExecutor.java
26
40
65.00%

:large_blue_circle:
com/starrocks/sql/common/MetaUtils.java
8
11
72.73%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobManager.java
106
131
80.92%

:large_blue_circle:
com/starrocks/sql/analyzer/InsertAnalyzer.java
5
6
83.33%

:large_blue_circle:
com/starrocks/planner/OlapTableSink.java
5
6
83.33%

:large_blue_circle:
com/starrocks/catalog/OlapTable.java
12
13
92.31%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJob.java
30
32
93.75%

:large_blue_circle:
com/starrocks/persist/CreateInsertOverwriteJobInfo.java
14
15
93.33%

:large_blue_circle:
com/starrocks/persist/InsertOverwriteStateChangeInfo.java
16
17
94.12%

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
2
2
100.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobState.java
5
5
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/DeleteAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/UpdateAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/AnalyzeStmtAnalyzer.java
4
4
100.00%

:large_blue_circle:
com/starrocks/journal/JournalEntity.java
6
6
100.00%

run starrocks_fe_unittest

run starrocks_fe_unittest

[FE PR Coverage check]
:disappointed: fail : 501 / 819 (61.17%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/master/MasterImpl.java
0
3
00.00%

:large_blue_circle:
com/starrocks/service/FrontendServiceImpl.java
0
10
00.00%

:large_blue_circle:
com/starrocks/load/lock/LockException.java
0
2
00.00%

:large_blue_circle:
com/starrocks/common/util/RangeUtils.java
1
4
25.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobRunner.java
58
183
31.69%

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
5
15
33.33%

:large_blue_circle:
com/starrocks/transaction/DatabaseTransactionMgr.java
23
61
37.70%

:large_blue_circle:
com/starrocks/persist/EditLog.java
4
10
40.00%

:large_blue_circle:
com/starrocks/analysis/InsertStmt.java
9
19
47.37%

:large_blue_circle:
com/starrocks/load/lock/LockTarget.java
23
44
52.27%

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
23
43
53.49%

:large_blue_circle:
com/starrocks/qe/StmtExecutor.java
23
43
53.49%

:large_blue_circle:
com/starrocks/transaction/TransactionState.java
7
11
63.64%

:large_blue_circle:
com/starrocks/sql/common/MetaUtils.java
8
11
72.73%

:large_blue_circle:
com/starrocks/transaction/GlobalTransactionMgr.java
11
14
78.57%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobManager.java
87
107
81.31%

:large_blue_circle:
com/starrocks/sql/analyzer/InsertAnalyzer.java
5
6
83.33%

:large_blue_circle:
com/starrocks/planner/OlapTableSink.java
5
6
83.33%

:large_blue_circle:
com/starrocks/load/lock/LockTargetDesc.java
6
7
85.71%

:large_blue_circle:
com/starrocks/load/lock/LockManager.java
101
113
89.38%

:large_blue_circle:
com/starrocks/catalog/OlapTable.java
12
13
92.31%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJob.java
30
32
93.75%

:large_blue_circle:
com/starrocks/persist/CreateInsertOverwriteJobInfo.java
14
15
93.33%

:large_blue_circle:
com/starrocks/persist/InsertOverwriteStateChangeInfo.java
16
17
94.12%

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
2
2
100.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobState.java
5
5
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/DeleteAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/UpdateAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/AnalyzeStmtAnalyzer.java
4
4
100.00%

:large_blue_circle:
com/starrocks/journal/JournalEntity.java
6
6
100.00%

:large_blue_circle:
com/starrocks/load/lock/Lock.java
6
6
100.00%

:large_blue_circle:
com/starrocks/load/lock/LockMode.java
3
3
100.00%

[FE PR Coverage check]
:disappointed: fail : 321 / 543 (59.12%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/service/FrontendServiceImpl.java
0
2
00.00%

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
3
13
23.08%

:large_blue_circle:
com/starrocks/common/util/RangeUtils.java
1
4
25.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobRunner.java
58
183
31.69%

:large_blue_circle:
com/starrocks/persist/EditLog.java
4
10
40.00%

:large_blue_circle:
com/starrocks/analysis/InsertStmt.java
9
19
47.37%

:large_blue_circle:
com/starrocks/alter/Alter.java
1
2
50.00%

:large_blue_circle:
com/starrocks/alter/SchemaChangeHandler.java
1
2
50.00%

:large_blue_circle:
com/starrocks/alter/MaterializedViewHandler.java
1
2
50.00%

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
23
43
53.49%

:large_blue_circle:
com/starrocks/sql/analyzer/InsertAnalyzer.java
6
10
60.00%

:large_blue_circle:
com/starrocks/qe/StmtExecutor.java
18
28
64.29%

:large_blue_circle:
com/starrocks/sql/common/MetaUtils.java
8
11
72.73%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobManager.java
90
110
81.82%

:large_blue_circle:
com/starrocks/planner/OlapTableSink.java
5
6
83.33%

:large_blue_circle:
com/starrocks/catalog/OlapTable.java
12
13
92.31%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJob.java
30
32
93.75%

:large_blue_circle:
com/starrocks/persist/CreateInsertOverwriteJobInfo.java
14
15
93.33%

:large_blue_circle:
com/starrocks/persist/InsertOverwriteStateChangeInfo.java
16
17
94.12%

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
2
2
100.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobState.java
5
5
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/DeleteAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/UpdateAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/AnalyzeStmtAnalyzer.java
4
4
100.00%

:large_blue_circle:
com/starrocks/journal/JournalEntity.java
6
6
100.00%

[FE PR Coverage check]
:disappointed: fail : 321 / 543 (59.12%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/service/FrontendServiceImpl.java
0
2
00.00%

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
3
13
23.08%

:large_blue_circle:
com/starrocks/common/util/RangeUtils.java
1
4
25.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobRunner.java
58
183
31.69%

:large_blue_circle:
com/starrocks/persist/EditLog.java
4
10
40.00%

:large_blue_circle:
com/starrocks/analysis/InsertStmt.java
9
19
47.37%

:large_blue_circle:
com/starrocks/alter/Alter.java
1
2
50.00%

:large_blue_circle:
com/starrocks/alter/SchemaChangeHandler.java
1
2
50.00%

:large_blue_circle:
com/starrocks/alter/MaterializedViewHandler.java
1
2
50.00%

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
23
43
53.49%

:large_blue_circle:
com/starrocks/sql/analyzer/InsertAnalyzer.java
6
10
60.00%

:large_blue_circle:
com/starrocks/qe/StmtExecutor.java
18
28
64.29%

:large_blue_circle:
com/starrocks/sql/common/MetaUtils.java
8
11
72.73%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobManager.java
90
110
81.82%

:large_blue_circle:
com/starrocks/planner/OlapTableSink.java
5
6
83.33%

:large_blue_circle:
com/starrocks/catalog/OlapTable.java
12
13
92.31%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJob.java
30
32
93.75%

:large_blue_circle:
com/starrocks/persist/CreateInsertOverwriteJobInfo.java
14
15
93.33%

:large_blue_circle:
com/starrocks/persist/InsertOverwriteStateChangeInfo.java
16
17
94.12%

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
2
2
100.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobState.java
5
5
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/DeleteAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/UpdateAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/AnalyzeStmtAnalyzer.java
4
4
100.00%

:large_blue_circle:
com/starrocks/journal/JournalEntity.java
6
6
100.00%

[FE PR Coverage check]
:disappointed: fail : 312 / 539 (57.88%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/service/FrontendServiceImpl.java
0
2
00.00%

:large_blue_circle:
com/starrocks/load/PartitionUtils.java
0
34
00.00%

:large_blue_circle:
com/starrocks/persist/EditLog.java
2
10
20.00%

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
3
13
23.08%

:large_blue_circle:
com/starrocks/common/util/RangeUtils.java
1
4
25.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobRunner.java
58
157
36.94%

:large_blue_circle:
com/starrocks/alter/Alter.java
1
2
50.00%

:large_blue_circle:
com/starrocks/alter/SchemaChangeHandler.java
1
2
50.00%

:large_blue_circle:
com/starrocks/alter/MaterializedViewHandler.java
1
2
50.00%

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
23
43
53.49%

:large_blue_circle:
com/starrocks/analysis/InsertStmt.java
6
11
54.55%

:large_blue_circle:
com/starrocks/qe/StmtExecutor.java
14
24
58.33%

:large_blue_circle:
com/starrocks/sql/analyzer/InsertAnalyzer.java
6
10
60.00%

:large_blue_circle:
com/starrocks/sql/common/MetaUtils.java
8
11
72.73%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobManager.java
91
111
81.98%

:large_blue_circle:
com/starrocks/planner/OlapTableSink.java
5
6
83.33%

:large_blue_circle:
com/starrocks/catalog/OlapTable.java
12
13
92.31%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJob.java
29
31
93.55%

:large_blue_circle:
com/starrocks/persist/CreateInsertOverwriteJobLog.java
14
15
93.33%

:large_blue_circle:
com/starrocks/persist/InsertOverwriteStateChangeInfo.java
16
17
94.12%

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
2
2
100.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobState.java
5
5
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/DeleteAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/UpdateAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/AnalyzeStmtAnalyzer.java
4
4
100.00%

:large_blue_circle:
com/starrocks/journal/JournalEntity.java
6
6
100.00%

run starrocks_fe_unittest

[FE PR Coverage check]
:disappointed: fail : 312 / 543 (57.46%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/load/PartitionUtils.java
0
34
00.00%

:large_blue_circle:
com/starrocks/persist/EditLog.java
2
10
20.00%

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
3
13
23.08%

:large_blue_circle:
com/starrocks/common/util/RangeUtils.java
1
4
25.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobRunner.java
58
157
36.94%

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
23
49
46.94%

:large_blue_circle:
com/starrocks/alter/Alter.java
1
2
50.00%

:large_blue_circle:
com/starrocks/alter/SchemaChangeHandler.java
1
2
50.00%

:large_blue_circle:
com/starrocks/alter/MaterializedViewHandler.java
1
2
50.00%

:large_blue_circle:
com/starrocks/analysis/InsertStmt.java
6
11
54.55%

:large_blue_circle:
com/starrocks/qe/StmtExecutor.java
14
24
58.33%

:large_blue_circle:
com/starrocks/sql/analyzer/InsertAnalyzer.java
6
10
60.00%

:large_blue_circle:
com/starrocks/sql/common/MetaUtils.java
8
11
72.73%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobManager.java
91
111
81.98%

:large_blue_circle:
com/starrocks/planner/OlapTableSink.java
5
6
83.33%

:large_blue_circle:
com/starrocks/catalog/OlapTable.java
12
13
92.31%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJob.java
29
31
93.55%

:large_blue_circle:
com/starrocks/persist/CreateInsertOverwriteJobLog.java
14
15
93.33%

:large_blue_circle:
com/starrocks/persist/InsertOverwriteStateChangeInfo.java
16
17
94.12%

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
2
2
100.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobState.java
5
5
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/DeleteAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/UpdateAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/AnalyzeStmtAnalyzer.java
4
4
100.00%

:large_blue_circle:
com/starrocks/journal/JournalEntity.java
6
6
100.00%

run starrocks_fe_unittest

[FE PR Coverage check]
:disappointed: fail : 312 / 543 (57.46%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/load/PartitionUtils.java
0
34
00.00%

:large_blue_circle:
com/starrocks/persist/EditLog.java
2
10
20.00%

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
3
13
23.08%

:large_blue_circle:
com/starrocks/common/util/RangeUtils.java
1
4
25.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobRunner.java
58
157
36.94%

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
23
49
46.94%

:large_blue_circle:
com/starrocks/alter/Alter.java
1
2
50.00%

:large_blue_circle:
com/starrocks/alter/SchemaChangeHandler.java
1
2
50.00%

:large_blue_circle:
com/starrocks/alter/MaterializedViewHandler.java
1
2
50.00%

:large_blue_circle:
com/starrocks/analysis/InsertStmt.java
6
11
54.55%

:large_blue_circle:
com/starrocks/qe/StmtExecutor.java
14
24
58.33%

:large_blue_circle:
com/starrocks/sql/analyzer/InsertAnalyzer.java
6
10
60.00%

:large_blue_circle:
com/starrocks/sql/common/MetaUtils.java
8
11
72.73%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobManager.java
91
111
81.98%

:large_blue_circle:
com/starrocks/planner/OlapTableSink.java
5
6
83.33%

:large_blue_circle:
com/starrocks/catalog/OlapTable.java
12
13
92.31%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJob.java
29
31
93.55%

:large_blue_circle:
com/starrocks/persist/CreateInsertOverwriteJobLog.java
14
15
93.33%

:large_blue_circle:
com/starrocks/persist/InsertOverwriteStateChangeInfo.java
16
17
94.12%

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
2
2
100.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobState.java
5
5
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/DeleteAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/UpdateAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/AnalyzeStmtAnalyzer.java
4
4
100.00%

:large_blue_circle:
com/starrocks/journal/JournalEntity.java
6
6
100.00%

run starrocks_fe_unittest

[FE PR Coverage check]
:disappointed: fail : 312 / 543 (57.46%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/load/PartitionUtils.java
0
34
00.00%

:large_blue_circle:
com/starrocks/persist/EditLog.java
2
10
20.00%

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
3
13
23.08%

:large_blue_circle:
com/starrocks/common/util/RangeUtils.java
1
4
25.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobRunner.java
58
157
36.94%

:large_blue_circle:
com/starrocks/server/LocalMetastore.java
23
49
46.94%

:large_blue_circle:
com/starrocks/alter/Alter.java
1
2
50.00%

:large_blue_circle:
com/starrocks/alter/SchemaChangeHandler.java
1
2
50.00%

:large_blue_circle:
com/starrocks/alter/MaterializedViewHandler.java
1
2
50.00%

:large_blue_circle:
com/starrocks/analysis/InsertStmt.java
6
11
54.55%

:large_blue_circle:
com/starrocks/qe/StmtExecutor.java
14
24
58.33%

:large_blue_circle:
com/starrocks/sql/analyzer/InsertAnalyzer.java
6
10
60.00%

:large_blue_circle:
com/starrocks/sql/common/MetaUtils.java
8
11
72.73%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobManager.java
91
111
81.98%

:large_blue_circle:
com/starrocks/planner/OlapTableSink.java
5
6
83.33%

:large_blue_circle:
com/starrocks/catalog/OlapTable.java
12
13
92.31%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJob.java
29
31
93.55%

:large_blue_circle:
com/starrocks/persist/CreateInsertOverwriteJobLog.java
14
15
93.33%

:large_blue_circle:
com/starrocks/persist/InsertOverwriteStateChangeInfo.java
16
17
94.12%

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
2
2
100.00%

:large_blue_circle:
com/starrocks/load/InsertOverwriteJobState.java
5
5
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/DeleteAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/UpdateAnalyzer.java
2
2
100.00%

:large_blue_circle:
com/starrocks/sql/analyzer/AnalyzeStmtAnalyzer.java
4
4
100.00%

:large_blue_circle:
com/starrocks/journal/JournalEntity.java
6
6
100.00%


Issues when downloading complete YT channel

Hi, I noticed some issues when downloading a complete YT channel like
https://www.youtube.com/@solidbugs
Overall the application seems to work and download all videos for the channel.
But the following issues occurred while downloading:

At the beginning the Media title was empty
Some vids later the Media title was showing always the first and second maybe third video title but after completing the download the Media Title did not update and kept showing the first video titles
I noticed the Status went up to +1000% in a case

Hopefuly you can reproduce the issues...

This didn't make it into v1.8, but I'll look into it and see if I can add support in the next version. Thanks for the feedback.


Comment on our manifesto!

WE HAVE A MANIFESTO! This outlines our community thoughts on the place of code in science and academia. Consultation open until end of May 2018, launching formally early June 2018.
View the manifesto here: https://codeisscience.github.io/manifesto/manifesto
**Comment on the manifesto here: ** https://github.com/codeisscience/manifesto/issues

We'll be launching the manifesto soon - closing this task. Next step is to get people to sign the manifesto!


[Question] Localization with Mkdocs backend

As a preamble of the Localization page it's written :

This feature only applies to Sphinx documentation. We are working to bring it to our other documentation backends.

I wanted to know if bringing it to Mkdocs is targeted for a specific milestone or should not be expected shortly.

This is probably a better question for mkdocs, we would only support what mkdocs supports.


Update sbt to 1.6.0

Updates org.scala-sbt:sbt from 1.5.8 to 1.6.0.
GitHub Release Notes - Version Diff
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scala-sbt", artifactId = "sbt" } ]

labels: library-update, early-semver-minor, semver-spec-minor, commit-count:1

Codecov Report

Merging #570 (828ec57) into develop (3e4c0b4) will increase coverage by 0.06%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##           develop     #570      +/-   ##
===========================================
+ Coverage    60.36%   60.42%   +0.06%
===========================================
  Files           53       53
  Lines         1539     1539
  Branches        30       30
===========================================
+ Hits           929      930       +1
+ Misses         610      609       -1

Impacted Files
Coverage Δ

...-/com/twitter/bijection/CollectionInjections.scala
96.55% <0.00%> (+3.44%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3e4c0b4...828ec57. Read the comment docs.


TypeError: 'ABCMeta' object is not subscriptable

Ubuntu Mate 20.04.6 LTS
Python 3.8.10
ffmpeg version 4.2.7
I followed the instructions:

pip install --user bbb-dl
playwright install chromium
bbb-dl

Traceback (most recent call last):
  File "/home/user/.local/bin/bbb-dl", line 5, in <module>
    from bbb_dl.main import main
  File "/home/user/.local/lib/python3.8/site-packages/bbb_dl/main.py", line 32, in <module>
    from bbb_dl.ffmpeg import FFMPEG
  File "/home/user/.local/lib/python3.8/site-packages/bbb_dl/ffmpeg.py", line 10, in <module>
    from ffmpeg.asyncio import FFmpeg
  File "/home/user/.local/lib/python3.8/site-packages/ffmpeg/asyncio/__init__.py", line 1, in <module>
    from .ffmpeg import FFmpeg
  File "/home/user/.local/lib/python3.8/site-packages/ffmpeg/asyncio/ffmpeg.py", line 14, in <module>
    from ffmpeg.asyncio.utils import create_subprocess, ensure_stream_reader, read_stream, readlines
  File "/home/user/.local/lib/python3.8/site-packages/ffmpeg/asyncio/utils.py", line 12, in <module>
    def create_subprocess(*args: Any, **kwargs: Any) -> Awaitable[asyncio.subprocess.Process]:
TypeError: 'ABCMeta' object is not subscriptable

a few months ago I used bbb-dl on mate and everything worked fine

Please make again sure you are on latest version:
pip install --user -U  bbb-dl
tell me then the version of bbb-dl using the --version option

I guess it is a problem with python 8. What is the python version on your other system?

Python 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] on linux

If the maintainer of python-ffmpeg does not fix it before me, I can make a PR later this week on the project I refered above...

should be fixed now. You just have to update again or update python-ffmpeg

now work fine


Fine-tune weather API display

need to display only what we need from the API

All done! Great work!


Sample configuration for install PowerShell module

The sampleConfigurations have been a tremendous help! Thank you for putting those in this repository. Does anyone have an example of a resource that can Install a specific PowerShell Module from PSGallery? I scanned the samples along with the PowerShell Gallery for DSC but not seeing one that jumps out that meets the specific need of specifying Module Name, Version, and PSGallery as the location.

There doesn't seem to be a PowerShell module that exists in the PSGallery that contains DSC resources to install specific PowerShell modules.
I did find this repository while doing some digging that seems to do exactly what you might be looking for: https://github.com/davidobrien1985/DscResources/tree/master/PowerShellModule
To gain full functionality with winget configure, this module would need to be published to the PSGallery or manually installed to your PowerShell modules folder prior to running winget configure.

We're painfully aware of the challenges associated with "finding" the DSC resources used to configure "things". I'm expecting we'll end up with some kind of document to try and help while we reason through building improvements around authoring configurations. I'm hoping for the WinGet packages, we can establish some kind of mapping between packages and the DSC resources used to configure them.


Failed to load plugin

Hi there,
I am running Obsidian version V1.6.7, freshly installed on the Windows machine.
As instructed, the downloaded zip has been extracted into the .obsidian/plugins folder.
Obsodian did see the plugin because it is present in the installed plugins, however, it fails to enable.
Am I doing something wrong?

Fixed it by deleting the plugin through the browse function,
deleted the plugins folder just in case also,
then reinstalled the plugin by the plugin browser of Obsidian itself.


allowed both ports to be controlled at the same time

The user can now control ports i2c-0 and i2c-1 at the same time. For example, you can open/close the shutters on the Lepton at the same time. Before, only one port could be open at a time.
Thanks, Alex

Thanks Alex

Looks good to me!

Thanks :)


Additional project field - visualisation portals, to appear both in backoffice and Catalogue

As a Data contributor/wrangler,
I would like to add the link to my project in a supported Analysis Portal (e.g. Cellxgene/SCEA/UCSC browser),
so that other scientists can view my data in the visualisation tool
Acceptance Criteria

[x] Wrangler/Contributor can specify a link to an analysis portal (through supplementary links)
[ ] Only supported portals are shown in the catalogue
[ ] catalogue can be filtered by the analysis portal
[ ] catalogue allow navigating to the analysis portal

To move to a separate ticket (and sprint)

[ ] create a new field for this on Project (core)
[ ] regex to only allow support portals (core)
[ ] UI can be filtered by the analysis portal (UI)

Just an idea: I believe if the cxgene link is added as an accession it will be displayed in project catalogue (but perhaps this requires a HCA metadata version change)

please refer to 409

please refer to 409

I created a wireframe

The recommendation here is to store links to Cellxgene / SCEA / UCSC in the project metadata schema
project.supplementary_links

External link(s) pointing to code, supplementary data files, or analysis files associated with the project which will not be uploaded.
example: https://github.com/czbiohub/tabula-muris; http://celltag.org/

The suggested change is to highlight supported URLs in the project catalogue.
@gabs / @ESapenaVentura Please can I have examples of the following urls, so that I can determine how we detect them:

Cellxgene
SCEA
UCSC

Hi, @MightyAx
So for UCSC browser links:
https://cells.ucsc.edu/?ds=fetal-thymus
https://cells.ucsc.edu/?ds=lifespan-nasal-atlas
CellxGene
https://cellxgene.cziscience.com/collections/0434a9d4-85fd-4554-b8e3-cf6c582bb2fa
https://cellxgene.cziscience.com/collections/6f6d381a-7701-4781-935c-db10d30de293

SCEA:
https://www.ebi.ac.uk/gxa/sc/experiments/E-CURD-98/results/tsne
https://www.ebi.ac.uk/gxa/sc/experiments/E-MTAB-11011/results/tsne

Just adding to this, that for the regex, don't always expect the "tsne" part at the end. It won't always end like that!

My current plan is to consider any supplementary link that contains:
cellxgene.cziscience.com/collections as a cellxgene link
ebi.ac.uk/gxa/sc/experiments as a Single Cell Expression Atlas link
cells.ucsc.edu as a UCSC Cell Browser link
We can do more regex manipulation to figure out:

the accession (SCEA)
The uuid (cellxgene)
the dataset collection name (UCSC)

But then we should probably be validating the data on input and storing it separately also.
If that's in scope for this sprint it's a much bigger task.
Also, any opinions on the use of Logos versus the following text?
cellxgene / Single Cell Expression Atlas / UCSC Cell Browser
If you would like Logo's please provide them.

@gabsie and @ESapenaVentura to take a look and give feedback

Current progress showing filtering and output for SCEA.
The code also works for cellxgene and UCSC but no prod data features those in supplementary links.
It seems like we Will need some regex after all, to display the accessions.

My big question then is how to display cellxgene since they are massive UUIDs and this cell of the table is already massively overflowing, perhaps that's where to bring in the logo.
To help with the overflow I'll just use "SCEA" rather than "Single Cell Expression Atlas"

Implemented accession regex

The accession cell is getting very full for some records.

added external link signifier and started using this formatting everywhere (just ENA for now)

Alexie - Feature complete but some refactoring remaining.

The list-of-links component has been complete, awaiting re-review

Deployment in the EBI Web Dev Environment Failed, but I don't know how to follow this up!

The test step that is failing (because yarn is not installed) was added by @jacobwindsor's recent cleanup, removing it for now.

Deployment Successful, ready for user testing:
https://wwwdev.ebi.ac.uk/humancellatlas/project-catalogue/

Known Issue: TSV generation shows [Object object] instead of accession.
Will fix tomorrow.

Also, any opinions on the use of Logos versus the following text?
cellxgene / Single Cell Expression Atlas / UCSC Cell Browser
If you would like Logo's please provide them.

I think it's fine with the names for now. Adding the logos would require a lot more work (we would need to contact each of the institutions for their logos etc)

My big question then is how to display cellxgene since they are massive UUIDs and this cell of the table is already massively overflowing, perhaps that's where to bring in the logo.

I think for now we just need to stick with the UUID, cellxgene have no open APIs where we could query a short identifier for the project
I tried to download the TSV for the project that I added the SCEA/cellxgene/UCSC cell browser accessions to test and the resulting TSV had no headers/entries for those accessions, I assume this is the error you comment above or is it different?
Other than that, I've been testing around and adding a couple of accessions to projects and it works great!

@gabsie to check as well.

Need to open ticket with EBI Gitlab team, will reference it here once opened.

Project Catalogue deployment to Prod successful!

Hey Alexie, this works great when I tried the different links. Small edit you might have to do with regards to your formula for getting the cell browser links. I have seen in the sheet that their links can sometimes be:
https://gut-cell-atlas.cells.ucsc.edu
https://covid19-influenza-response.cells.ucsc.edu
so maybe you also have to consider links that end in ... cells.ucsc.edu
I have now entered details for 4 projects, you can see them by filtering by cellxgene portal
Gabs

Ready for review on dev: https://wwwdev.ebi.ac.uk/humancellatlas/project-catalogue/
can release to prod when you approve.

Second component to allow for a bit more links in staging yet - But ready to be released

This has been checked and is OK!

Deployed to PROD


[IOTA-29] Removed the scalastyle Warnings

Removed the Scalastyle warnings and rebased with the new code and it closes #17

Hi @shiv4nsh,
Thanks for working on it.
quick question: How does adding
{code}
private val DEFAULT_NULL = null
{code}
removes the ScalaStyle warning?
It seems like you just moved the warning to another part of the code

@barbaragomes : I have minimized them by using this , as the code is tightly coupled hence to remove all the null and using None instead would take a while.

@barbaragomes : We can re-factor it over the time to make the code more subtle and in a more functional way.

@shiv4nsh Do you mind opening a JIRA for removing the scalastyle warnings related to the use of null and revert the use of private val DEFAULT_NULL = null on this PR?
I think this PR should only include what fixed the warnings.

@barbaragomes : Yes I would do that !

@barbaragomes  @tonyfaustini @asfgit : Please review this PR asap !

Hey @shiv4nsh, before we can merge this PR would you mind implementing the items bellow?

File: fey-core/src/main/scala/org/apache/iota/fey/Ensemble.scala

val performerInfo = performers_metadata.getOrElse(performerID, null)
 -      if(performerInfo != null){
 +      if (Option(performerInfo).isDefined) {

Instead of creating an Option after the getOrElse please call .get(performerID), this way the performerInfo is of type Option. (Make sure all the other implications are resolved as well)
2. File: fey-core/src/main/scala/org/apache/iota/fey/FeyGenericActor.scala
if (Option(scheduler).isDefined)

Define global variable scheduler as of type Option and make all of the other necessary changes.
3. File: fey-core/src/main/scala/org/apache/iota/fey/Monitor.scala
+    if(Option(reason).isDefined){

Define parameter reason as of type Option[Throwable] and make the necessary changes
4. File: fey-core/src/main/scala/org/apache/iota/fey/TrieNode.scala
(Option(root).isDefined)

Define variable root as of type Option and make the necessary changes

@barbaragomes : I have made the changes according to your comments please take a look !
Thanks !

@barbaragomes @asfgit @tonyfaustini I have verified the changes by running the test cases ! Please take a look as soon as possible !
Thanks.

@shiv4nsh please make sure the tests for fey-core are also reflecting the new changes:
[error] /Users/barbaragomes/Projects/clean-iota/incubator-iota/fey-core/src/test/scala/org/apache/iota/fey/MonitorSpec.scala:125: type mismatch;
[error]  found   : IllegalArgumentException
[error]  required: Option[Throwable]
[error]         monitorRef.underlyingActor.logInfo("path", "STOP", 1, "info", new IllegalArgumentException("Test"))
[error]                                                                       ^
[warn] one warning found
[error] one error found
[error] (fey-core/test:compileIncremental) Compilation failed
[error] Total time: 15 s, completed Nov 21, 2016 10:38:56 AM

@shiv4nsh Before opening a PR make sure that at least the basics are working.

http://localhost:16666/fey/activeactors is not working.

Caused by: java.lang.NullPointerException: null
	at org.apache.iota.fey.Trie.org$apache$iota$fey$Trie$$getObject(TrieNode.scala:118)
	at org.apache.iota.fey.Trie.print(TrieNode.scala:104)
	at org.apache.iota.fey.IdentifyFeyActors$.generateTreeJson(IdentifyFeyActors.scala:87)
	at org.apache.iota.fey.FeyUIService$$anonfun$router$1$$anonfun$applyOrElse$1.apply(FeyUIService.scala:46)
	at org.apache.iota.fey.FeyUIService$$anonfun$router$1$$anonfun$applyOrElse$1.apply(FeyUIService.scala:43)
	at play.api.mvc.ActionBuilder$$anonfun$apply$14.apply(Action.scala:403)
	at play.api.mvc.ActionBuilder$$anonfun$apply$14.apply(Action.scala:403)
	at play.api.mvc.ActionBuilder$$anonfun$apply$13.apply(Action.scala:371)
	at play.api.mvc.ActionBuilder$$anonfun$apply$13.apply(Action.scala:370)
	at play.api.mvc.Action$.invokeBlock(Action.scala:498)
	at play.api.mvc.Action$.invokeBlock(Action.scala:495)
	at play.api.mvc.ActionBuilder$$anon$2.apply(Action.scala:458)
	at play.api.mvc.Action$$anonfun$apply$2$$anonfun$apply$5$$anonfun$apply$6.apply(Action.scala:112)
	at play.api.mvc.Action$$anonfun$apply$2$$anonfun$apply$5$$anonfun$apply$6.apply(Action.scala:112)
	at play.utils.Threads$.withContextClassLoader(Threads.scala:21)
	at play.api.mvc.Action$$anonfun$apply$2$$anonfun$apply$5.apply(Action.scala:111)
	at play.api.mvc.Action$$anonfun$apply$2$$anonfun$apply$5.apply(Action.scala:110)
	at scala.Option.map(Option.scala:146)
	at play.api.mvc.Action$$anonfun$apply$2.apply(Action.scala:110)
	at play.api.mvc.Action$$anonfun$apply$2.apply(Action.scala:103)
	at scala.concurrent.Future$$anonfun$flatMap$1.apply(Future.scala:253)
	... 14 common frames omitted

fey-core/src/main/scala/org/apache/iota/fey/FeyGenericActorReceiver.scala
fey-core/src/main/scala/org/apache/iota/fey/JsonReceiver.scala

private final def downloadJAR - Use Option for var outputStream
Thank you.

@barbaragomes : Nice Catch ! Thanks For reviewing ! I have done the changes and now every test case is working fine along with the UI. please review it once again ! !
Test Case Screenshot:

Thank you for fixing the issues with this PR @shiv4nsh.
@tonyfaustini I have tested this PR and everything looks fine now. Please, merge it.


Kickconv and Windows

When looking for a tool to byteswap/split/join Kickstart files for EPROM burning, I found a few. But Kickconv seems the most useful tool I've found so far. The other tools require 32-bit DOS and a lot of scripting, or don't do the job at all.
So, what do I need to compile Kickconv for Windows, on a Windows machine? I think the tools mentioned in the readme only apply to Linux.
Or does a precompiled Windows version exist somewhere?

You could build within cygwin or mingw, or how about using Windows Subsystem for Linux (WSL) on Windows 10?
Arguably I should redo kickconv in python.

Thanks for the reply. I've looked at your suggestions, but I think for me it's better to use a Linux VM or maybe install Linux on one of the many old laptops I've got hanging around.
Are the binutils needed when I just want to compile Kickconv and nothing else? Or are they part of a linux distro anyway?

They are part of the compiler toolchain and you would generally always
install them along with gcc
On Thu, 5 Dec 2019, 07:26 Squirrel61<EMAIL_ADDRESS>wrote:

Thanks for the reply. I've looked at your suggestions, but I think for me
it's better to use a Linux VM or maybe install Linux on one of the many old
laptops I've got hanging around.
Are the binutils needed when I just want to compile Kickconv and nothing
else? Or are they part of a linux distro anyway?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/keirf/Amiga-Stuff/issues/13?email_source=notifications&email_token=AAGWZFXO4AOOYTQ22L5DHEDQXCUJVA5CNFSM4JVIGONKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEF7YVVY#issuecomment-562006743,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAGWZFSMZKX5M4RKRPD3T5LQXCUJVANCNFSM4JVIGONA
.

Ok, thanks again! I created a Linux VM and managed to compile the tool, which for now is good enough since I'm able to copy/paste files between Linux and Windows (my EPROM programmer needs Windows).
Since one of my computers is running Windows 10, I guess I'll be able to use it under WSL. And maybe I'll look into cross-compiling it.
For now, I'll close the issue.

I'm currently trying to cross-compile the executable for Windows 32-bits, because my Eprom programmer is running on an old XP box, that is not really capable of comfortably running a Linux virtual machine. But for some reason I'm not able to get the compile working.
I have installed the MinGW-w64 package for 32-bit Windows, but when I call the compiler, it returns two warnings converted to errors. One is about be32toh, the other about htobe32. Both are stating "implicit declaration of function".
Is it possible that the MinGW package is too old? Somewhere in the package I found a version number 4.9.0 which is less than the version advised by you for the whole Amiga Stuff.

Don't ask me how, but somehow I managed to compile a W32 executable with MinGW on Windows. It still needs the cygwin library but that's not a problem, although the whole executable plus library is about 10 times as big as the Linux executable :(
I will test it tonight on my XP box, which is at home and if it's working, I can share it for other people.

@Squirrel61 it really might be easier for you to use Python, for example I wrote this quick script to byteswap a ROM, and it's less than 20 lines. If you need it to do something else let me know I can add the feature.

Thanks @blark! Indeed a python script is a good alternative. Functions that I mainly use are the split and merge so I've created scripts for that too. Byteswap can be handled by my eprom programmer software so it doesn't really need a script. Nice to have are the checksum and decrypt functions, so I'm looking into creating scripts for that too. And maybe combine everything into one script, one day so it will be a nice replacement for the executable.

This is a much more sensible way to go.

@Squirrel61 let me know if you need a hand. Currently I'm focusing on my A500 but I have a 1200 too that will eventually need some attention, and I'll probably need the same tools. @keirf thanks for your repos! I just made a couple of your TL866 Adapter v4 boards, currently waiting for the programmer so I can try them out ;)

I've written a few other scripts for the tasks that are important to me. They're all quick and dirty because I based them on your byteswap script and because of having zero experience with python but they do the job, whiich is good enough for me. And because it's python, they're supposed to work on whatever platform I'm using.
KickTools.zip


fix function calling schema for pydantic v2

Pass the model instead of type(model) when reducing for function calling.
The previous implementation yielded an empty dictionary for the annotation which some LLM's might take to mean they should return an empty object.

@CalebCourier can you add a test to repro the original failure?

@CalebCourier can you add a test to repro the original failure?

@ShreyaR I can show that the schema included in the functions kwarg was empty before where as now it contains the schema of the model.  The closest I got to repro'ing the original failure was the llm would return less information when the empty schema was passed.
This PR is also still in draft because I'm waiting the hear back on if this solved the issue the end user was experiencing.  If it doesn't then there might be more to the problem.

@CalebCourier can you add a test to repro the original failure?

@ShreyaR I added tests that show the current behaviour as well as the empty schema issue I mention in the PR description.

Hey, encountered the same issue on my end, can provide an example with the complete_json_suffix if that helps. Wondering how much time this will take to be merged and shipped as it's a big blocking point for us :) ?

@edisontim if you could share your example where OpenAI returns empty dict that includes the complete_json_suffix that would be very helpful thank you!
I'll try to track down the serializing error with validators on pydantic models. For that, which version of pydantic are you using?

Hey! Sure here's the Models I'm using with pydantic v2.6.3
class DialogueSegment(BaseModel):
    full_name: str = Field(description="Full name of the NPC saying the sentence.")
    dialogue_segment: str = Field(description="What the NPC says")

class Townhall(BaseModel):
    dialogue: list[DialogueSegment] = Field(
        description="Discussion that was held by the NPCs. Make each NPC speak twice"
    )
    summary: str = Field(
        description="A summary of the dialogue, outlining each NPC's contributions and reactions to the event"
    )
    plot_twist: str = Field(
        description="The plot twist that you introduced in the dialogue. Only output one sentence for the plot twist."
    )

and using ${gr.complete_json_suffix_v2} in my prompt. I init the guard like this
    townhall_guard: Guard = Guard.from_pydantic(output_class=Townhall, instructions="blablabla ${gr.complete_json_suffix_v2}", num_reasks=1)

and calling like such:
        _raw_llm_response, validated_response, *_rest = self.townhall_guard(
            openai.chat.completions.create,
            model=ChatCompletionModel.GPT_4_PREVIEW.value,
            temperature=1,
            prompt="A bit of a complex prompt",
        )

@edisontim I don't see any validators in your model.  Would you mind sharing where the ValidRange validator is applied that caused the serialization error?

@edisontim I don't see any validators in your model. Would you mind sharing where the ValidRange validator is applied that caused the serialization error?

My bad, updated in the original comment

Ok, able to replicate the serialization issue with your example, thanks @edisontim.  Think I have a path forward for resolution.

@edisontim I just pushed a commit that should fix the serialization issue for pydantic 2.x.  Note though, that pydantic 1.x is still broken.


Support for multiple docker machines within a single runner instance

I'm currently doing small research in order to migrate my current GitLab runner setup (done with CloudFormation, modified and updated by hand via SSH) to Terraform. I'm currently using a setup with configuration like this:
concurrent = 20
check_interval = 0

[session_server]
  session_timeout = 3600

[[runners]]
  name = "team-a-runner"
  url = "https://gitlab.(redacted)/"
  token = "(team-a token redacted)"
  executor = "docker+machine"
  [runners.docker]
    tls_verify = false
    image = "alpine:latest"
    privileged = true
    disable_entrypoint_overwrite = false
    oom_kill_disable = false
    disable_cache = true
    volumes = ["/certs/client", "/cache"]
    shm_size = 0
  [runners.cache]
    Type = "s3"
    Shared = true
    [runners.cache.s3]
      ServerAddress = "s3.amazonaws.com"
      BucketName = "(redacted)"
      BucketLocation = "eu-central-1"
  [runners.machine]
    IdleCount = 0
    IdleTime = 1200
    MaxBuilds = 100
    MachineDriver = "amazonec2"
    MachineName = "gitlab-docker-machine-%s"
    MachineOptions = ["engine-storage-driver=overlay2", "amazonec2-instance-type=m5.large", "amazonec2-region=eu-central-1", "amazonec2-vpc-id=(redacted)", "amazonec2-security-group=(redacted)", "amazonec2-use-private-address=true", "amazonec2-iam-instance-profile=(redacted)"]
    OffPeakPeriods = ["* * 0-9,17-23 * * mon-fri *", "* * * * * sat,sun *"]
    OffPeakTimezone = "Etc/UTC"
    OffPeakIdleCount = 0
    OffPeakIdleTime = 300

[[runners]]
  name = "team-b-runner"
  url = "https://gitlab.(redacted)/"
  token = "(team-b token redacted)"
  executor = "docker+machine"
  (same as above)

[[runners]]
  name = "team-c-runner"
  url = "https://gitlab.(redacted)/"
  token = "(team-c token redacted)"
  executor = "docker+machine"
  (same as above)

[[runners]]
  name = "team-d-runner"
  url = "https://gitlab.(redacted)/"
  token = "(team-d token redacted)"
  executor = "docker+machine"
  (same as above)

[[runners]]
  name = "team-e-runner"
  url = "https://gitlab.(redacted)/"
  token = "(team-e token redacted)"
  executor = "docker+machine"
  (same as above)

I defined multiple [[runners]] section in order to register separate runners for each Gitlab group (I can't register global runner in our company). A lot of improvements can be made to this setup, yet it's a few times cheaper than defining each runner group separately. So I have a question regarding registering more than one group of docker-machine instances inside a single GL runner, as above. Is it a bad practice to register multiple runners?
I know it's doable within Terraform, as we may simply loop over instance types and generate more [[runners]] sections. If not, why not define 12 different groups that are configured with 12 different EC2 instance types and create our own "spot fleet" within a single runner?

In my opinion it is not a bad practice at all to have multiple runners, we have as well. We have deployed the module a few times. To match different use cases, some of them ar dedicated to a team.
With Terrafomr 13 it should also be possible to loop over modules, so would it be an option to deploy the module one time for each time, the overad is in that case that you have 1 small ec2 instances for the agent running per team.

To try to avoid such cost overhead mentioned by you, I created proposal PR which should enable some cool stuff, like adding multiple different docker-machine configurations that run on spot. I'll check it tomorrow in practice on my side, please take a look and tell me what you think 😉

Hi ✋,
Sorry to re-open that, but i don't find how to use multiple runners config within a single instance. Has a solution been found ?
Thanks for your help.

Wasn't closed 😄
Started to work on krzysztof-miemiec PR. But it's not that easy. But this feature is definitely wanted.


Feature suggestion - add Random values

Same as the connected api .. just instead of Value ... Fake({{text }})
I thought maybe using faker and use the faker.fake() api .
i.e
data:
json:
title: Fake({{name.firstName}})

Merged in #19


Add routing and urls for specific map views

Parameters to include:

map bounds (better than zoom + center, if we have different sized clients?). Bounds cannot be shared exactly tho, because the clients also have different shapes.
selected item (requires implementing https://github.com/GispoCoding/tarmo/issues/171 first)

This way, user can

share links to specific areas on the map or specific items
press the back button to get back to the previous area, instead of losing the whole app. "Peruuttaminen edelliseen sivuun tai kohtaan kartalla oli hankalaa, ohjelma heitti alkuun."

Duplicate of #148


Setting the initial stored energy free

Description
From the discussion with @datejada , I know that currently the storage is modelled in a way that the stored energy is, by the end of the time steps, returned, to the initial value, from which the first time step evolves. However, at the moment, we need to set an initial value manually.
I would like to propose a way that no initial value is required. This can be simply done by using the stored energy at the final time step (yes, it is a decision variable) as the base from which the first time step evolves. Basically, to connect the first time step with the final one, for the storage type.
Does this make sense? Shall we add an input type to the initial value like "none", such that this proposed way will be activated?
Thanks,
Zhi
Related Issues
No response

I really like this idea! Although it should probably be optional whether the value is set or determined.
(I think in most analyses it would be determined, but maybe needs to be set if multi-year analyses get split up?)

@clizbe that would be the idea, to have it as an option so that you can choose the option you prefer/need for your analysis

@gzclarence since this is not critical and urgent. We will plan it for next year since we have more urgent changes to make. In the meantime, for your EU case study, you can give an initial value that you prefer for the batteries. In the model, we ensure that the value of the energy storage in the last time step is above that same initial value. For a whole year of optimization, the solution won't change significantly if you use the proposed feature.
Thanks for the feedback and we will let you know when it is available in the code.

@gzclarence since this is not critical and urgent. We will plan it for next year since we have more urgent changes to make. In the meantime, for your EU case study, you can give an initial value that you prefer for the batteries. In the model, we ensure that the value of the energy storage in the last time step is above that same initial value. For a whole year of optimization, the solution won't change significantly if you use the proposed feature. Thanks for the feedback and we will let you know when it is available in the code.

Sure! I will stick with setting the initial value for now ;D.


Could not find artifact com.someco:actions-tutorial-platform-jar:amp:1.0-SNAPSHOT

Hello!
Following this ecmarchitect tutorial just try to run  alfresco-developer-series/workflow/workflow-tutorial/run.sh
Got it from git early for alfresco 5.2.xxx  (not need 6.0, still need 5.2..).
But it stops after some downloading(?) error:
[INFO] Configured Artifact: org.alfresco:alfresco-share-services:5.2.e:amp [INFO] Configured Artifact: com.someco:workflow-tutorial-platform-jar:1.0-SNAPSHOT:amp [INFO] Configured Artifact: com.someco:content-tutorial-platform-jar:1.0-SNAPSHOT:amp [INFO] Configured Artifact: com.someco:actions-tutorial-platform-jar:1.0-SNAPSHOT:amp Downloading: https://artifacts.alfresco.com/nexus/content/groups/public/com/someco/actions-tutorial-platform-jar/1.0-SNAPSHOT/maven-metadata.xml Downloading: https://artifacts.alfresco.com/nexus/content/groups/public-snapshots/com/someco/actions-tutorial-platform-jar/1.0-SNAPSHOT/maven-metadata.xml Downloading: https://artifacts.alfresco.com/nexus/content/groups/public/com/someco/actions-tutorial-platform-jar/1.0-SNAPSHOT/actions-tutorial-platform-jar-1.0-SNAPSHOT.amp Downloading: https://artifacts.alfresco.com/nexus/content/groups/public-snapshots/com/someco/actions-tutorial-platform-jar/1.0-SNAPSHOT/actions-tutorial-platform-jar-1.0-SNAPSHOT.amp [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO]  [INFO] ecmarchitect.com workflow tutorial ................. FAILURE [  4.536 s] [INFO] workflow-tutorial repo tier AMP project ............ SUCCESS [  5.490 s] [INFO] workflow-tutorial share tier AMP project ........... SUCCESS [  1.195 s] [INFO] Integration Tests Module ........................... SUCCESS [  0.787 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 13.229 s [INFO] Finished at: 2020-02-13T11:04:15+02:00 [INFO] Final Memory: 60M/365M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.alfresco.maven.plugin:alfresco-maven-plugin:3.0.1:run (default-cli) on project workflow-tutorial: Unable to execute mojo: Unable to find artifact. Could not find artifact com.someco:actions-tutorial-platform-jar:amp:1.0-SNAPSHOT in alfresco-public (https://artifacts.alfresco.com/nexus/content/groups/public) [ERROR]  [ERROR] Try downloading the file manually from the project website. [ERROR]  [ERROR] Then, install it using the command: [ERROR] mvn install:install-file -DgroupId=com.someco -DartifactId=actions-tutorial-platform-jar -Dversion=1.0-SNAPSHOT -Dpackaging=amp -Dfile=/path/to/file [ERROR]  [ERROR] Alternatively, if you host your own repository you can deploy the file there: [ERROR] mvn deploy:deploy-file -DgroupId=com.someco -DartifactId=actions-tutorial-platform-jar -Dversion=1.0-SNAPSHOT -Dpackaging=amp -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] [ERROR]  [ERROR]  [ERROR] com.someco:actions-tutorial-platform-jar:amp:1.0-SNAPSHOT [ERROR]  [ERROR] from the specified remote repositories: [ERROR] alfresco-public (https://artifacts.alfresco.com/nexus/content/groups/public, releases=true, snapshots=true), [ERROR] alfresco-public-snapshots (https://artifacts.alfresco.com/nexus/content/groups/public-snapshots, releases=true, snapshots=true), [ERROR] central (https://repo.maven.apache.org/maven2, releases=true, snapshots=false) [ERROR] -> [Help 1] [ERROR]  [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR]  [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
So there I can get actions-tutorial-platform-jar-1.0-SNAPSHOT.amp now?  Looks like its really not exist in path.  (com/someco/?)
BTW content-tutorial run OK. Need working workflow tutorial. Thank you!

Hmm. Sorry looks like my fault - need to build/run content-tutorial and actions-tutorial before start workflow-tutorial.


node 版本为18 运行yarn run init报错

- [ ] I'm sure this does not appear in [the issue list of the repository](https://github.com/arco-design/arco-design/issues)
Basic Info

Package Name And Version<EMAIL_ADDRESS>Browser: chrome<IP_ADDRESS>

What is expected?
限制node版本
Steps to reproduce
node版本为18时运行yarn run init报错

I have dealt with this problem.pr#2116


Integration with retrofit in data network client

optimized data network layer classes
integrated retrofit in network layer

@andreaguitto it's OK but as @android10 mentioned multiple times, wants to keep this repository simple for learning purposes. In your project you can use Retrofit, I did the same also.

hi @spirosoik , i appreciate your interest in my work. I think that retrofit is the best way to understand the network layer. Who uses this architecture (with dagger and other rxjava) must have a pretty good knowledge of android and java development. I don't think that the remove of 2 classes and the add of a simple dependency which uses a simple interface with just 2 easy annotations could complicate this architecture. Instead I think that it helps developers in the discovery, use and integration of a well-structured library i their apps. I manage a group of developers, some of them are juniors but they really appreciate simplicity of retrofit. Definitiely I think that retrofit helps the simplicity of architecture because it removes the attention to "Net" classes and focus developer to other packages and layers. The same is for cache classes in wich i working to embed Reservoir.

@andreaguitto at Soundcloud we are not using Retrofit and I don't see it mandatory for any architecture.

@android10 ok, i agree with you it's not a mandatory but we are talking about learning curve of this architecture. Retrofit it's compatible with skills needed for this architecture and and is documented too. Anyway it's yours choice, i hope to be helpful next time. Thank for your answers

@andreaguitto I really appreciate your effort! The purpose of this is not to learn a library. Api calls are encapsulated in a class already, and as I said, it is an implementation detail, so when it comes to readability you do not need to go into details.
In the case of RxJava, which is a library, is totally different, since it changes the paradigm and the way of thinking regarding your solution. Dagger is another library, however, nowadays I could not live without any dependency injector.

@android10 Interesting that in SoundCloud you are not using Retrofit. But because I am curious what are you using?
@andreaguitto the main concept here is to understand the concepts of Clean Architecture combined with Rx, not the HTTP implementation as @android10 mentioned. By the way I don't agree that Retrofit is simpler to understand than the classic HTTP implementation.

@spirosoik we just use a wrapper around OkHttp, so we have more control over our api calls. Retrofit does too much for my taste.

@android10 I suppose you mean all this magic via ProxyPattern it's too much.

@spirosoik :+1:

In the case of RxJava, which is a library, is totally different, since it changes the paradigm and the way of thinking regarding your solution. Dagger is another library, however, nowadays I could not live without any dependency injector.

Totally agreed :heart:
I just tried to reduce classes in net package using a library which reduces all to a single interface but i understand what you said so this is a closed pull request for me, let's work to other things :headphones:

i believe Retrofit becomes as important part of any android projects nowadays, therefore it is worth to be included here

@Fshamri again, this discussion about an implementation detail does not make any sense. Is up to the developer to use any library and Retrofit has nothing to do with the concept of Clean Architecture.

@andreaguitto Thanks so much for understanding buddy. I really like people like you collaborating.
And from this kind of discussions, we all learn, which is the reason why we are here :).

@android10 Totally agreed. Let's go for :beers: guys

Yeah! For the win! :+1: :smile:

@android10 As you said, I am trying to learn new things by everyone and to help to this great effort. You inspired us with this repository and the whole philosophy of clean architecture. So I want to thank you for this dude.

@android10 I really appreciate your efforts to spread knowledge

I'm closing this one guys.


ImportError: No module named 'avod'

When I am trying to generate mini batches using the following command, I am getting the following error:
$ python3 scripts/preprocessing/gen_mini_batches.py
Error:
File "scripts/preprocessing/gen_mini_batches.py", line 5, in
import avod
ImportError: No module named 'avod'

Solved the issue by adding an empty file with name "init.py" in the top "avod" directory


More consistent/unified method of converting from Strawberry-based objects to graphql-core schema

Description
Currently, the code that converts from Strawberry objects/types to graphql-core objects is a bit... rough, presumably due to the continuous expansion and feature addition that has occurred during early development. This PR seeks to clean up, consolidate, and standardize that conversion.
Having a consistent schema conversion process will allow us to more easily implement our own custom types support (esp. StrawberryObjectType and StrawberryField).
A few notes:

This is still in progress. First thing to note is that many tests do not pass -> especially those with Unions/Generics.
I am putting this out before completion so I can get feedback on what's going on.
The main file to look at right now is strawberry/schema/schema_converter.py
I am aiming to have migrated all the functions that exist strawberry/schema to this new paradigm. EDIT: I left the Scalar stuff behind as there's room for some more complicated logical changes, but in another PR.
As of yet, there aren't any planned new features/breaking changes. This will most likely be a backend-only change not observable to most users.
I have been committing with --no-verify while things are still very broken. None of these commits will pass the pre-commit checks.

I would like some feedback here:

I'm not a fan of the monolithic design of GraphQLCoreConverter. I would like it to be split up into multiple classes/files.
A goal would be to make GraphQLCoreConverter implement an abstract class. This would allow us to support/switch to another backend without having to rewrite the entire system.
I am not sure how to best spread an abstract class implementation to more than a single class.

Types of Changes

[x] Core
[ ] Bugfix
[ ] New feature
[x] Enhancement/optimization
[ ] Documentation

Issues Fixed or Closed by This PR

Progress towards: #489

Checklist

[x] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes.
[x] I have tested the changes and verified that they work and don't break anything (as well as I can manage).

Hi, thanks for contributing to Strawberry 🍓!
We noticed that this PR is missing a RELEASE.md file. We use that to automatically do releases here on GitHub and, most importantly, to PyPI!
So as soon as this PR is merged, a release will be made 🚀.
Here's an example of RELEASE.md:
Release type: patch

Description of the changes, ideally with some examples, if adding a new feature.

Release type can be one of patch, minor or major. We use semver,so make sure to pick the appropriate type. If in doubt feel free to ask :)

Hi, thanks for contributing to Strawberry 🍓!
We noticed that this PR is missing a RELEASE.md file. We use that to automatically do releases here on GitHub and, most importantly, to PyPI!
So as soon as this PR is merged, a release will be made 🚀.
Here's an example of RELEASE.md:
Release type: patch

Description of the changes, ideally with some examples, if adding a new feature.

Release type can be one of patch, minor or major. We use semver,so make sure to pick the appropriate type. If in doubt feel free to ask :)


Fix wechatwork webhook

Fix #29689

How does this change fix the bug? newDefaultRequest uses POST by default by a fallthrough.

And I can see JS error on the "add webhook" page
WebHookEditor.js:26 Uncaught TypeError: Cannot read properties of null (reading 'value')
    at updateContentType (WebHookEditor.js:26:58)
    at initCompWebHookEditor (WebHookEditor.js:29:3)
    at HTMLDocument.<anonymous> (index.js:109:24)

  const updateContentType = function () {
    const visible = document.getElementById('http_method').value === 'POST';  // <--------- HERE
    toggleElem(document.getElementById('content_type').parentNode.parentNode, visible);
  };

Maybe something is caused by the refactoring, while something is already broken before the refactoring.

How does this change fix the bug? newDefaultRequest uses POST by default by a fallthrough.

I have tested in production env, it fixed. I haven't looked into the logic.

I think the real bug is here:

I have tested in production env, it fixed. I haven't looked into the logic.

I guess you only tested WeCom(WechatWork)
But the underlying bug affects almost all webhooks.

I have tested in production env, it fixed. I haven't looked into the logic.

I guess you only tested WeCom(WechatWork)
But the underlying bug affects almost all webhooks.

The w.HTTPMethod should be POST but now it's GET and the database field http_method is empty. Some webhooks types accept GET like feishu/lark, so they haven't been affected.

I have tested in production env, it fixed. I haven't looked into the logic.

I guess you only tested WeCom(WechatWork)
But the underlying bug affects almost all webhooks.

The w.HTTPMethod should be POST but now it's GET and the database field http_method is empty. Some webhooks types accept GET like feishu/lark, so they haven't been affected.

I think the logic should be checked carefully. Do all these webhooks accept "GET"? Should it default the empty HTTP method to POST (just like newDefaultRequest)?

I have tested in production env, it fixed. I haven't looked into the logic.

I guess you only tested WeCom(WechatWork)
But the underlying bug affects almost all webhooks.

The w.HTTPMethod should be POST but now it's GET and the database field http_method is empty. Some webhooks types accept GET like feishu/lark, so they haven't been affected.

I think the logic should be checked carefully. Do all these webhooks accept "GET"? Should it default the empty HTTP method to POST (just like newDefaultRequest)?

Maybe we need to fill HTTPMethod clearly for every webhookParams. At present, Gitea, matrix filled the HTTPMethod when creating.

But I do not see why it should use "GET" method for a "JSON body"

Please don't use GET with body. Either move params to query or make it a POST.

Please don't use GET with body, unless the other end requires it. Either move params to query or make it a POST.

I believe #29145 accidently make the default methods as GET, we are talking about how to fix it.

But I do not see why it should use "GET" method for a "JSON body"

I just pointed out that feishu/lark hasn't been affected by the POST -> GET change because they support GET. But I don't mean it should be GET.

I was talking about https://github.com/go-gitea/gitea/pull/29690#issuecomment-1986850374 : after the feishu/lark comment, it is for the Maybe we need to fill HTTPMethod clearly for every webhookParams. At present, Gitea, matrix filled the HTTPMethod when creating, my suggestion is use "POST" for "JSON body" in the "newJSONRequest" (if it is the old behavior)

But I do not see why it should use "GET" method for a "JSON body"

I just pointed out that feishu/lark hasn't been affected by the POST -> GET change because they support GET. But I don't mean it should be GET.

I was talking about #29690 (comment) : after the feishu/lark comment, it is for the Maybe we need to fill HTTPMethod clearly for every webhookParams. At present, Gitea, matrix filled the HTTPMethod when creating, my suggestion is use "POST" for "JSON body" in the "newJSONRequest" (if it is the old behavior)

6052ecf14fb2258e267ca87a31a6e58ae7571158

Can confirm that latest nightly broke discord webhooks as well


Cost estimates should use a min runtime of 1 minute

Tasks that run for < 1 minute are billed for 1 whole minute. We need to update the cost estimates to reflect that.

https://github.com/awslabs/amazon-omics-tools/pull/62


Clarity needed on the scope

Could you please specify what the Microsoft.Web/sites/mysite1means.
for example i have say a databricks resource in my resourcegroup to which i need to provide RBAc access.In that case what will the mysite1 mean and what will be Microsoft.web etc.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 1e974af9-501a-8eac-b9c1-d3252120abbb
Version Independent ID: 8f659349-3ae6-1c39-faf4-49b70cb0db02
Content: Manage access to Azure resources using RBAC and the REST API - Azure
Content Source: articles/role-based-access-control/role-assignments-rest.md
Service: role-based-access-control
GitHub Login: @rolyon
Microsoft Alias: rolyon

@s3vhub Thank you for your feedback . We have checked this and you can check the reference of Azure Resource providers in the article.  In order to understand more please refer to Azure Resource providers and types and supported Azure RM resource provider operations.
And I hope that will clear your doubts. We do have the articles for the subject . We will add note linking the existing article with the content on this page.

We have updated the documentation . It will take a maximum 24-48 hours to reflect worldwide as per the next release cycle. We will now close this issue. Should you have any further queries, feel free to tag me or the doc author @rolyon to your reply and we will be glad to help.

So finally i could find out how to use rbac to add users to reaources but after reading a lot of documents which shouldnt be the case.
Please update the scope for reasources like databricks ,storage etc.the above document is a little bit confusing to  those coming here for some guidance


provide a option to remove all uuid-based file in HeadlessMc folder on when program start

it generated too much on Headless folder

Can you try out this version: https://github.com/3arthqu4ke/HeadlessMc/actions/runs/2592961926 ? It will delete leftover files on startup. Also if you quit the game properly, while HeadlessMc is running, either by clicking the Quit button or using the -commands/HMC-Specifics quit command they should get deleted properly as well.


Parts splash

With this PR the workbench stores the abstract structure of some workbench parts so that we can show a preview of those very early the next time the editor starts.

@jrieken before going into code review, some general observations:

the titlebar container also needs to be considered, especially now that we support it on Windows and Linux too (possibly with the menu structure so that the menu loads without delay?). On macOS to enable the custom title when running "out of sources" comment this line and this line
I wonder if we should try to get the activity bar icons in as well because that seems like a prominent UI element that is quite stable and it almost feels like a bug that you see the activity bar without these icons in the beginning (same is true for status bar, but I did not see that as being too much of an issue because the status bar is not so much in your face)
currently the data in localStorage is quite verbose, I wonder if we could store just the dynamic pieces and generate the HTML on the consuming side to store less things

Given the first 2 points I wonder if this should get a bit more support from the workbench, e.g. a Part could get asked to return a piece of the splash screen and the workbench simply collects these parts instead of hardcoding them?

the titlebar container also needs to be considered, especially now that we support

Thanks, that was an oversight. I pushed a fix but it seems that the titlebar changes color on shutdown. When persisting it is rgb(60, 60, 60) and when running it is rgba(60, 60, 60, .6). Not sure why that is. Ideas?

I wonder if we should try to get the activity bar icons in as well because that seems like a prominent UI element that is quite stable and it almost feels like a bug that you see the activity bar without these icons in the beginning

Agreed, but I wanna keep that out of the first stab on this. Ideally, each part knows what of its children can be persisted, like icons of the activity bar, titles of viewlets and panels, and editor tabs. I think that should definitely be explored but bringing in UI elements early also raises the question of how to signal that they cannot be interacted with.

currently the data in localStorage is quite verbose, I wonder if we could store just the dynamic pieces and generate the HTML on the consuming side to store less things

Yeah, it's a tradeoff between storing more and spending precious compute-cycles on startup. I went with the former. It's around 1k which isn't nothing but also just a 1/10 of my color theme data and a 1/50 of my file history.

Given the first 2 points I wonder if this should get a bit more support from the workbench, e.g. a Part could get asked to return a piece of the splash screen and the workbench simply collects these parts instead of hardcoding them during shutdown phase?

Yeah, we should explore but I don't wanna over-engineer this from the start. It's also a tricky question where to put things. Parts only know the inside-world but not how different parts are composted, e.g. the statusbar doesn't know it spreads the whole width of the window but for the parts splash that's important. I think it needs a bit of both, the part should return its inside world with relative sizing and the outside (shell) should persist the overall picture.

Thanks, that was an oversight. I pushed a fix but it seems that the titlebar changes color on shutdown. When persisting it is rgb(60, 60, 60) and when running it is rgba(60, 60, 60, .6). Not sure why that is. Ideas

I think this could be because we change the color of the title area when focus is lost to indicate the window being inactive. Maybe on shutdown this actually gets triggered?

Agreed, but I wanna keep that out of the first stab on this. Ideally, each part knows what of its children can be persisted, like icons of the activity bar, titles of viewlets and panels, and editor tabs. I think that should definitely be explored but bringing in UI elements early also raises the question of how to signal that they cannot be interacted with.

Yeah the fact that you cannot click the view icons makes it ugly to show them. Maybe we could go with an approach where it is clear that things are still loading, similar to what Slack is doing:

Yeah, we should explore but I don't wanna over-engineer this from the start. It's also a tricky question where to put things. Parts only know the inside-world but not how different parts are composted, e.g. the statusbar doesn't know it spreads the whole width of the window but for the parts splash that's important. I think it needs a bit of both, the part should return its inside world with relative sizing and the outside (shell) should persist the overall picture.

Yeah once we decide to put more into the part itself we should add it probably.

😱 scrollbar... I wonder how that happens... doesn't look it actually scrolls something. Lets sit on your machine and debug

I am going home now, but in tomorrow.

@jrieken the overflow reproduces for me also in parallels windows, it seems to:

reproduce independent from the zoom level
only when "window.titleBarStyle": "custom"

Also in the case of "window.titleBarStyle": "custom" the background color seems wrong (but you mentioned this already before I think).

Also in the case of "window.titleBarStyle": "custom" the background color seems wrong (but you mentioned this already before I think).

That was actually just a typo in the template ;-)

the overflow reproduces for me also in parallels windows,

Yeah, the problem was that some parts take height 100% despising being positioned at an top-offset.

cc @isidorn

@jrieken I added some comments directly in the code.
I tried this out on mac and works nicely (even in some corner cases). Now I will try it on Windows.

You keep all these dimensions per Workspace, however most of them we keep globaly and thus a glitch can happen.

Is there a (nice) way to get that globally stored width?

Another issue I hit with the Purple vscode, since we always hide the sidebar when purple vscode is opened it seems, and the splash screen does not respect that but paints the sidebar as it was last time I were purple.

That's easy to hardcode.

this.storageService.getInteger("workbench.sidebar.width", StorageScope.GLOBAL, 300)
Do you want me to dig out all the values you might need here?
Just wanted to add that I believe that the purple splash is very important since those are the users that open / close vscode all the time for single file editing and for them percieved startup performence is important - will test it out a bit more.

Just tried out purple vscode more and no hardcoding will be needed it seems. Since the most common scenario of just opening files works fine.
What currently fails is the following

Purple vscode, open sidebar
Open folder
Close folder (going back to purple) -> sidebar is hidden but splash shows it

Not sure how to distuingish this case from opening files in purple. So for me the current behavior works for now.

I have now pushed a change that makes sure we ignore the sidebar when the workbench state is the empty one. Doesn't look weirdly hard-coded.

@jrieken checking it out...

@jrieken works fine. Ok I am pretty puzzled when we decide to open the sidebar and when not for the purple vscode...

@jrieken I see you pushed should I check it out again?
Though from the last time I tried it it looks good to me for merging to master

Yeah, merging now. The rest are issues ;-)


Engine.create() has been tagged @deprecated

Is there a better way of doing this? The getting started documentation was written 4 years ago.

Important to note that it has been marked as deprecated in @types/matter-js.
I too, am curious about this, because I can not find any mention in the matter-js docs about this (nor on the internet).
Could this be a bug in the typings?

Thanks for reporting but this function has not been deprecated here, so it sounds like the problem is elsewhere.
I don't manage the third-party typescript bindings, so would you mind raising this with them if that's the case?

Hello, I've made a pull request to fix this.

Hello, I've made a pull request to fix this.

Thanks @enviniom hopefully they resolve it soon.
I realised that there were some // @deprecated comments internally but they were intended only for certain older features, rather than the whole function. Maybe some automated tool picked those up instead of the main jsdoc, but to avoid any confusion I've now changed these to something else.

Thanks @enviniom hopefully they resolve it soon.
I realised that there were some // @deprecated comments internally but they were intended only for certain older features, rather than the whole function. Maybe some automated tool picked those up instead of the main jsdoc, but to avoid any confusion I've now changed these to something else.


add a (very) simple install script to resolve #30

This should allow an install and update for the most simple case.

While the idea of an install file would be a great addition, this one has a few problems:

Git has an api to grab latest release built in (GET /repos/:owner/:repo/releases/latest)
Rather than curl each individual file, grabbing a release tarball and extracting to a temp folder would be better (and scales easier)
bash's completion directory should be found using the method from the readme:
pkg-config --variable=completionsdir bash-completion
Previous Installation check and uninstall should use which notes to determine the install directory (so you don't end up with two on accident)
This file also doesn't create a ~/.config/notes directory, which is fine honestly, but I would put the config.example in it on a proper install.
Uninstall should be available to be run without a re install (ie, to wipe away notes)

While this file gets the job done, it does only handle a single use case, very statically. I would not suggest accepting this PR.

Thanks for the comments. I will make updates and we can review again. It unfortunately may be a few days until I get internet again though. I won't forget.


Clean up Pokemon data retrieval code

Refactor the code for retrieving all necessary pieces of Pokémon data

Please see pull request #52 for more details.


breakoutSets bug within the get_survey_responses method

Good afternoon,
I added a pull request, and will reference it.  But there was a missing comma in the valid_keys list.  The raise statement was also confusing for me, give what was told as valid wasn't showing this as an option despite it being an option.
The pull request makes the assert and raise consistent with the list, and the list is fixed to include the missing comma.

https://github.com/Jaseibert/QualtricsAPI/pull/19 is the pull request.


Getting SSL Handshake exception. PKIX path building failed: unable to find valid certification path to requested target

Hello,
String quandlCode = "WWDI/USA_NY_GDP_MKTP_CD";
ClassicQuandlSession session = ClassicQuandlSession.create();
MetaDataResult metaData = session.getMetaData(MetaDataRequest.of(quandlCode));
logger.info(metaData.toPrettyPrintedString());
TabularResult tabularResult = session.getDataSet(DataSetRequest.Builder.of(quandlCode).build());
logger.info(tabularResult.toPrettyPrintedString());
I am getting the following error while making above calls. I have already added the necessary certificates to my jdk/jre keystore but no luck.
openssl s_client -connect quandl.com:443>public.crt (copy content including begin and end certificate lines)
C:\Program Files\Java\jdk1.8.0_141\bin>keytool -import -alias quandl.com -keystore ../jre/lib/security/cacerts -file public.crt (if prompted for a passport type: changeit)
keytool -list -v -keystore $JAVA_HOME/jre/lib/security/cacerts
and here is the exception that is getting thrown from the java app.
............
Caused by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:397) ~[na:1.8.0_141]
at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:302) ~[na:1.8.0_141]
at sun.security.validator.Validator.validate(Validator.java:260) ~[na:1.8.0_141]
at sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:324) ~[na:1.8.0_141]
at sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:229) ~[na:1.8.0_141]
at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:124) ~[na:1.8.0_141]
at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1496) ~[na:1.8.0_141]
... 43 common frames omitted
Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
at sun.security.provider.certpath.SunCertPathBuilder.build(SunCertPathBuilder.java:141) ~[na:1.8.0_141]
at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:126) ~[na:1.8.0_141]
at java.security.cert.CertPathBuilder.build(CertPathBuilder.java:280) ~[na:1.8.0_141]
at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:392) ~[na:1.8.0_141]
... 49 common frames omitted

Hi,
Sorry, for whatever reason I missed the notification of your issue. I'll look into it.
Their certificate just renewed on 2/11/17 so they must have used some cheap SSL cert authority that isn't in the Java 8 cert store by default. What you're trying to do looks like it should be the solution but clearly that's not working for you.
I'll get back to you shortly.
Jim

Oh, I think I see an issue with your command to pull the certificate

Try changing references to quandl.com to www.quandl.com

In all your commands. For some reason they bought the certificate on www and have a redirect and I recall from an issue a couple of years back that  jersey client didn't like redirected Https certs.

Any luck with my suggestions?


Actually support Node12 or update the docs to mention support for Node14 and above

Running the lib on Node12 raises:
/<path>/node_modules/aws-jwt-verify/dist/cjs/jwt-rsa.js:284
        return new this(verifyProperties, additionalProperties?.jwksCache);
                                                               ^
SyntaxError: Unexpected token '.'

This is because this project's tsconfig.json extends from<EMAIL_ADDRESS>To support Node12 it should of course be extended from<EMAIL_ADDRESS>

+1 for Node12

After a closer look we've seen we're already using a number of feature that were introduced in Node 13 (e.g. use a function as a destination in a stream.pipeline).
As Node12 is now in maintenance mode, and this being a new library, and new usage will probably be on Node 14+, it seems unwarranted to undertake effort to support Node12. Therefore we decided for Node14 to be the minimum, changed the docs accordingly in #25

Reporting that I still get the same error on node v14.18.1, v16.0.0, v16.13.1 (Macbook M1).

Still getting that @OrHaiLevy ? Do you get the exact same error message mentioned in the 1st comment of this issue?

I changed the runtime of my lambda in my SAM Template from "nodejs12.x" to "nodejs14.x" and it works!

Hi, I am still getting this error after updating from Node 13 to Node 14, 16, and 18.  The app is ran in an EC2 instance. It is the exact same error message even after rebooting the instance as well as attempting to restart the app. Any advice would be greatly appreciated.

@ttran13 best log a new issue with complete stack trace and ideally steps to reproduce


Add travis ci test

Will it be possible to add travis ci test in this repo?

@getong What do you mean exactly? We're using CircleCI.
We abandoned TravisCI some time ago: https://github.com/aeternity/epoch/pull/784


[BP-1.17][FLINK-28853][Docs] Sync watermark split alignment documentation with…

… the Chinese version. This closes #22716
Backporting this commit to 1.17 for the split level watermark alignment feature.

@MartijnVisser last one! Thanks for the catch and help on this btw

@MartijnVisser last one! Thanks for the catch and help on this btw

Thank you and you're welcome!