The document discusses how to collaborate using huggingface datasets. It introduces huggingface datasets and explains why data collaboration is needed for ML/DL projects. It then covers uploading data to the huggingface hub, including creating a repository, and the three methods of uploading - uploading the script only, uploading the dataset only, or uploading both. The document also provides guidance on writing dataset scripts, including defining configurations, metadata, and the required classes.
제 17회 보아즈(BOAZ) 빅데이터 컨퍼런스 - [AutoCar죠] : 자율주행 로봇 층간 이동을 위한 인지 기능 구현BOAZ Bigdata
데이터 분석 프로젝트를 진행한 AutoCar죠 팀에서는 아래와 같은 프로젝트를 진행했습니다.
자율주행 로봇 층간 이동을 위한 인지 기능 구현
18기 강용구 세종대학교 무인이동체공학과
18기 전효진 건국대학교 응용통계학과
18기 백채은 숙명여자대학교 컴퓨터과학전공
18기 이가은 가천대학교 의용생체공학과
18기 이소연 이화여자대학교 일반대학원 통계학과
The document is a presentation in Japanese on introducing Vue3. It discusses using Vue3 at Toranoana Lab, including for new projects, updating an existing time management tool from Vue2 to Vue3, and building a new project management tool using Vue3 from the start. It also covers the speaker's introduction, why use Vue3, the basic components in Vue, the Composition API, and plans to demonstrate Suspense, Fragments, Teleport, and JSX in Vue3.
LINQソースでGO!
In 名古屋MS系秋祭り 2013/09/21
* Containes too many aminatable elements, so broken look'n feel in slideshare.
http://www.kekyo.net/2013/09/21/%e5%90%8d%e5%8f%a4%e5%b1%8bms%e7%a7%8b%e7%a5%ad%e3%82%8a-linq%e3%82%bd%e3%83%bc%e3%82%b9%e3%81%a7go/
LINQソースでGO!
In 名古屋MS系秋祭り 2013/09/21
* Containes too many aminatable elements, so broken look'n feel in slideshare.
http://www.kekyo.net/2013/09/21/%e5%90%8d%e5%8f%a4%e5%b1%8bms%e7%a7%8b%e7%a5%ad%e3%82%8a-linq%e3%82%bd%e3%83%bc%e3%82%b9%e3%81%a7go/
This document provides references and links about using SQL Server with Linux and PHP. It includes links to documentation on installing and using the Microsoft Drivers for PHP for SQL Server on Linux, an overview of SQL Server on Linux, and a quickstart guide for installing SQL Server and creating a database on Ubuntu. It also links to a Microsoft tutorial for creating PHP apps connected to SQL Server on Ubuntu.
14. Parse してみる
TSqlParser クラス
Parse メソッドを使う
using Microsoft.SqlServer.TransactSql.ScriptDom;
using System.Collections.Generic;
using System.IO;
var parser = new TSql110Parser(false);
IList<ParseError> errors;
TSqlFragment parsed;
using (var query = new StringReader("select * from Table1")) {
parsed = parser.Parse(query, out errors);
}
20. もうちょっと細かいとこまで
例：SELECT で指定している項目の数を数える
http://msdn.microsoft.com/ja-
jp/library/microsoft.sqlserver.transactsql.scriptdom.selectelement.aspx
SELECT @Id = A.Id, @Name = B.Name
FROM ( SELECT * FROM Table1 WHERE Id = 1) A
INNER JOIN Table2 B ON ( A.USERID = B.ID )
21. もうちょっと細かいとこまで
TSqlFragmentVisitor
SELECT で指定している項目全ての件数を数える Visitor
public class SelectElementVisitor : TSqlFragmentVisitor {
public int Count { get; set; }
public override void Visit(SelectElement node) {
Count++;
base.Visit(node);
}
}
22. もうちょっと細かいとこまで
TSqlConcreteFragmentVisitor
SELECT で指定している “*” の件数を数える Visitor
public class SelectStarVisitor : TSqlFragmentVisitor {
public int Count { get; set; }
public override void Visit(SelectStarExpression node) {
Count++;
base.Visit(node);
}
}
23. もうちょっと細かいとこまで
カスタム Visitor を利用する
var q = @"SELECT @Id = A.Id, @Name = B.Name
FROM ( SELECT * FROM Table1 WHERE Id = 1) A
INNER JOIN Table2 B ON ( A.USERID = B.ID )";
var f = new TSql110Parser(false)
.Parse(new StringReader(q), out errors);
var v1 = new SelectElementVisitor();
var v2 = new SelectStarVisitor();
f.Accept(v1);
f.Accept(v2);
Console.WriteLine(v1.Count); // 3
Console.WriteLine(v2.Count); // 1
24. もうちょっと細かいとこまで
Generator – バージョン毎に用意されてる
Sql80ScriptGenerator - SQL Server 2000用
Sql90ScriptGenerator - SQL Server 2005用
Sql100ScriptGenerator - SQL Server 2008用
Sql110ScriptGenerator - SQL Server 2012用
イマイチ違いが判らず
…
40. 参考資料
Microsoft SQL Server 2012 Feature Pack
http://www.microsoft.com/ja-jp/download/details.aspx?id=29065
Microsoft.SqlServer.TransactSql.ScriptDom 名前空間
http://msdn.microsoft.com/ja-jp/library/hh215705.aspx
Visual Studio のデータベース機能の API リファレンス
http://msdn.microsoft.com/ja-jp/library/dd193281(v=vs.100).aspx
ANTLR
http://www.antlr.org/
![クエリの書式設定/統一
クエリのフォーマット
キーワードの大文字/小文字化
識別子の [] 囲み
インデント
改行](https://image.slidesharecdn.com/t-sqlparsegenerator-130323003811-phpapp02/85/T-sql-parse-generator-33-320.jpg)
![動的なクエリ生成
クエリの改造
ER => DDL (CREATE TABLE) で共通的なカラムの追加
SELECT で共通的なカラムの追加
COUNT(*) OVER() AS [全件数]
INSERT/UPDATE で共通的なカラムの追加
更新日/更新者 等](https://image.slidesharecdn.com/t-sqlparsegenerator-130323003811-phpapp02/85/T-sql-parse-generator-35-320.jpg)
![[부스트캠프 Tech Talk] 진명훈_datasets로 협업하기](https://cdn.slidesharecdn.com/ss_thumbnails/boostcampaitechtechtalkjinmyunghoon-211210113319-thumbnail.jpg?width=560&fit=bounds)
![제 17회 보아즈(BOAZ) 빅데이터 컨퍼런스 - [AutoCar죠] : 자율주행 로봇 층간 이동을 위한 인지 기능 구현](https://cdn.slidesharecdn.com/ss_thumbnails/autocar-230221082001-35f0f514-thumbnail.jpg?width=560&fit=bounds)
![[SOSCON 2017] 주니어 개발자 5000명, 개발 해서 남 주자](https://cdn.slidesharecdn.com/ss_thumbnails/5000-171026065023-thumbnail.jpg?width=560&fit=bounds)
![[LT] T sql の parse と generator](https://cdn.slidesharecdn.com/ss_thumbnails/t-sqlparsegenerator-130301234735-phpapp02-thumbnail.jpg?width=560&fit=bounds)
